2024-09-10T06:13:04.514 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T06:13:04.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T06:13:04.625 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898794 branch: wip-cls-rgw-busy-resharding description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} email: null first_in_suite: false job_id: '7898794' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f rgw: frontend: beast s3tests: force-branch: ceph-master thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cls-rgw-busy-resharding sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 4606 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-cls-rgw-busy-resharding suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f targets: smithi112.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGHJUhgGjoh0MV3nFiMaQVpelLKTUsdUvO34e4xrAVEasacT2+NFyqNZKvP/w/IbVhHVyRvDIiZlyy8OcjnSAfA= smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPTpTGIPyc6HBtCuLeUnz89paKwWE6HMVjHkuZ7MNSI1jOdABe49Dg6j8qBBBwTW+f4rfSNkE95C1xXoWad5pUM= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_user_quota.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_03:24:22 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T06:13:04.625 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa; will attempt to use it 2024-09-10T06:13:04.625 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa/tasks 2024-09-10T06:13:04.626 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T06:13:04.627 INFO:teuthology.task.internal:Checking packages... 2024-09-10T06:13:04.648 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-10T06:13:04.648 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T06:13:04.648 INFO:teuthology.packaging:ref: None 2024-09-10T06:13:04.649 INFO:teuthology.packaging:tag: None 2024-09-10T06:13:04.649 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-10T06:13:04.649 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T06:13:04.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-10T06:13:04.785 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753-gd011c522-1jammy 2024-09-10T06:13:04.787 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T06:13:04.793 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T06:13:04.793 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T06:13:04.832 INFO:teuthology.task.internal:Saving configuration 2024-09-10T06:13:04.846 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T06:13:04.858 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T06:13:04.884 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898794', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 06:07:33.386898', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICsvnWj3IRYPof7TznkafwIdecv3pftjEdX2h2GMqVj7'} 2024-09-10T06:13:04.911 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898794', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 06:07:33.385615', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINbP9qsnwxs8ksqoifmuHI19VoSAlomhOCxdynZwnlLx'} 2024-09-10T06:13:04.911 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T06:13:04.918 INFO:teuthology.task.internal:roles: ubuntu@smithi112.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-10T06:13:04.918 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-10T06:13:04.918 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T06:13:04.988 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f89c98a5240>, signals=[15]) 2024-09-10T06:13:04.988 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T06:13:04.994 INFO:teuthology.task.internal:Opening connections... 2024-09-10T06:13:04.994 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T06:13:04.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:13:05.076 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-09-10T06:13:05.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:13:05.154 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T06:13:05.161 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-09-10T06:13:05.166 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-09-10T06:13:05.166 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-09-10T06:13:05.212 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T06:13:05.213 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Ubuntu" 2024-09-10T06:13:05.213 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="22.04" 2024-09-10T06:13:05.213 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T06:13:05.213 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_CODENAME=jammy 2024-09-10T06:13:05.213 INFO:teuthology.orchestra.run.smithi112.stdout:ID=ubuntu 2024-09-10T06:13:05.213 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE=debian 2024-09-10T06:13:05.213 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T06:13:05.213 INFO:teuthology.orchestra.run.smithi112.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T06:13:05.213 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T06:13:05.213 INFO:teuthology.orchestra.run.smithi112.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T06:13:05.213 INFO:teuthology.orchestra.run.smithi112.stdout:UBUNTU_CODENAME=jammy 2024-09-10T06:13:05.214 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-09-10T06:13:05.233 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-09-10T06:13:05.238 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-09-10T06:13:05.238 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-09-10T06:13:05.286 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T06:13:05.286 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Ubuntu" 2024-09-10T06:13:05.287 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="22.04" 2024-09-10T06:13:05.287 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T06:13:05.287 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_CODENAME=jammy 2024-09-10T06:13:05.287 INFO:teuthology.orchestra.run.smithi120.stdout:ID=ubuntu 2024-09-10T06:13:05.287 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE=debian 2024-09-10T06:13:05.287 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T06:13:05.287 INFO:teuthology.orchestra.run.smithi120.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T06:13:05.287 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T06:13:05.287 INFO:teuthology.orchestra.run.smithi120.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T06:13:05.287 INFO:teuthology.orchestra.run.smithi120.stdout:UBUNTU_CODENAME=jammy 2024-09-10T06:13:05.288 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-09-10T06:13:05.308 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T06:13:05.317 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T06:13:05.349 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T06:13:05.350 DEBUG:teuthology.orchestra.run.smithi112:> test '!' -e /home/ubuntu/cephtest 2024-09-10T06:13:05.352 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-09-10T06:13:05.356 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T06:13:05.374 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T06:13:05.374 DEBUG:teuthology.orchestra.run.smithi112:> test -z $(ls -A /var/lib/ceph) 2024-09-10T06:13:05.398 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-09-10T06:13:05.496 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T06:13:05.551 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T06:13:05.565 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T06:13:05.565 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T06:13:05.566 DEBUG:teuthology.orchestra.run.smithi112:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T06:13:05.566 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T06:13:05.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:13:05.571 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-10T06:13:05.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:13:05.572 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-10T06:13:05.617 INFO:teuthology.orchestra.run.smithi112.stdout:5.15.0-56-generic 2024-09-10T06:13:05.617 INFO:teuthology.task.kernel:Running kernel on smithi112: 5.15.0-56-generic 2024-09-10T06:13:05.618 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get clean 2024-09-10T06:13:05.620 INFO:teuthology.orchestra.run.smithi120.stdout:5.15.0-56-generic 2024-09-10T06:13:05.620 INFO:teuthology.task.kernel:Running kernel on smithi120: 5.15.0-56-generic 2024-09-10T06:13:05.620 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get clean 2024-09-10T06:13:05.744 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-10T06:13:05.749 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-09-10T06:13:06.012 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T06:13:06.014 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T06:13:06.018 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T06:13:06.029 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T06:13:06.070 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T06:13:06.079 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T06:13:06.426 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T06:13:06.435 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T06:13:06.445 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T06:13:06.458 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T06:13:06.564 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T06:13:06.574 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T06:13:06.770 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T06:13:06.778 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T06:13:06.864 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T06:13:06.879 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T06:13:06.881 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T06:13:06.890 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T06:13:06.891 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T06:13:06.895 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T06:13:06.904 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T06:13:06.904 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T06:13:06.906 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T06:13:06.917 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T06:13:06.927 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T06:13:06.938 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T06:13:06.939 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T06:13:06.942 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T06:13:06.942 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T06:13:06.944 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T06:13:06.986 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T06:13:06.987 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T06:13:06.998 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T06:13:07.002 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T06:13:07.007 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T06:13:07.019 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T06:13:07.042 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T06:13:07.043 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T06:13:07.043 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T06:13:07.047 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T06:13:07.048 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T06:13:07.048 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T06:13:07.056 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T06:13:07.056 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-10T06:13:07.058 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T06:13:07.058 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T06:13:07.058 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T06:13:07.065 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T06:13:07.066 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-10T06:13:07.069 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T06:13:07.079 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-10T06:13:07.084 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-10T06:13:07.085 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T06:13:07.088 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T06:13:07.088 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T06:13:07.089 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T06:13:07.089 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T06:13:07.099 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T06:13:07.103 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-10T06:13:07.104 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T06:13:07.105 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T06:13:07.105 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T06:13:07.109 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T06:13:07.118 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-10T06:13:07.118 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T06:13:07.119 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T06:13:07.127 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T06:13:07.128 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T06:13:07.141 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T06:13:07.163 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T06:13:07.164 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T06:13:07.164 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T06:13:07.165 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T06:13:07.174 INFO:teuthology.orchestra.run.smithi120.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T06:13:07.175 INFO:teuthology.orchestra.run.smithi120.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T06:13:07.176 INFO:teuthology.orchestra.run.smithi120.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T06:13:07.177 INFO:teuthology.orchestra.run.smithi120.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T06:13:07.203 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T06:13:07.203 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T06:13:07.203 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T06:13:07.204 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T06:13:07.204 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T06:13:07.245 INFO:teuthology.orchestra.run.smithi112.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T06:13:07.256 INFO:teuthology.orchestra.run.smithi120.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T06:13:07.257 INFO:teuthology.orchestra.run.smithi120.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T06:13:07.258 INFO:teuthology.orchestra.run.smithi120.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T06:13:07.258 INFO:teuthology.orchestra.run.smithi120.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T06:13:07.259 INFO:teuthology.orchestra.run.smithi120.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T06:13:13.133 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 15.8 MB in 3s (5,856 kB/s) 2024-09-10T06:13:13.217 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 15.8 MB in 3s (5,846 kB/s) 2024-09-10T06:13:14.562 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-10T06:13:14.579 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T06:13:14.630 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-10T06:13:14.639 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-10T06:13:14.649 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T06:13:14.710 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-10T06:13:14.844 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-10T06:13:14.845 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-10T06:13:14.921 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-09-10T06:13:14.922 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-09-10T06:13:15.021 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T06:13:15.021 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T06:13:15.021 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T06:13:15.022 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T06:13:15.022 INFO:teuthology.orchestra.run.smithi112.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T06:13:15.022 INFO:teuthology.orchestra.run.smithi112.stdout: python2.7-minimal 2024-09-10T06:13:15.022 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T06:13:15.023 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-10T06:13:15.023 INFO:teuthology.orchestra.run.smithi112.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T06:13:15.023 INFO:teuthology.orchestra.run.smithi112.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T06:13:15.024 INFO:teuthology.orchestra.run.smithi112.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T06:13:15.025 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-10T06:13:15.025 INFO:teuthology.orchestra.run.smithi112.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T06:13:15.025 INFO:teuthology.orchestra.run.smithi112.stdout:Recommended packages: 2024-09-10T06:13:15.025 INFO:teuthology.orchestra.run.smithi112.stdout: thermald 2024-09-10T06:13:15.065 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-10T06:13:15.065 INFO:teuthology.orchestra.run.smithi112.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T06:13:15.065 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T06:13:15.066 INFO:teuthology.orchestra.run.smithi112.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T06:13:15.067 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages will be upgraded: 2024-09-10T06:13:15.067 INFO:teuthology.orchestra.run.smithi112.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T06:13:15.098 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T06:13:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T06:13:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T06:13:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T06:13:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T06:13:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: python2.7-minimal 2024-09-10T06:13:15.100 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T06:13:15.100 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2024-09-10T06:13:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T06:13:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T06:13:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T06:13:15.102 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2024-09-10T06:13:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T06:13:15.102 INFO:teuthology.orchestra.run.smithi120.stdout:Recommended packages: 2024-09-10T06:13:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: thermald 2024-09-10T06:13:15.118 INFO:teuthology.orchestra.run.smithi112.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T06:13:15.118 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 113 MB of archives. 2024-09-10T06:13:15.118 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T06:13:15.118 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T06:13:15.143 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2024-09-10T06:13:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T06:13:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T06:13:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T06:13:15.144 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages will be upgraded: 2024-09-10T06:13:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T06:13:15.325 INFO:teuthology.orchestra.run.smithi120.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T06:13:15.325 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 113 MB of archives. 2024-09-10T06:13:15.325 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T06:13:15.325 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T06:13:15.559 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T06:13:15.673 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T06:13:16.477 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T06:13:16.477 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T06:13:16.478 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T06:13:16.598 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T06:13:16.621 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T06:13:16.801 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T06:13:17.005 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 113 MB in 2s (73.3 MB/s) 2024-09-10T06:13:17.153 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T06:13:17.168 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T06:13:19.156 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T06:13:19.160 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:13:19.224 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:19.407 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T06:13:19.407 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T06:13:19.408 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T06:13:19.772 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T06:13:19.857 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T06:13:20.224 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 113 MB in 5s (24.1 MB/s) 2024-09-10T06:13:20.427 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T06:13:21.251 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T06:13:21.272 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:13:21.365 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:21.846 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T06:13:21.868 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:13:21.904 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:22.407 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T06:13:22.411 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:13:22.516 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:24.691 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T06:13:24.712 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:13:24.806 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:25.261 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T06:13:25.282 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:13:25.311 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:28.132 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T06:13:28.249 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T06:13:28.591 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T06:13:28.736 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T06:13:29.005 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T06:13:29.027 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T06:13:29.071 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T06:13:32.313 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T06:13:32.415 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T06:13:32.747 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T06:13:32.868 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T06:13:33.197 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T06:13:33.219 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T06:13:33.255 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T06:13:34.879 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T06:13:34.915 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:13:34.953 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:37.492 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T06:13:37.598 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T06:13:37.922 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T06:13:38.021 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:38.145 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T06:13:38.274 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:39.057 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T06:13:39.094 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T06:13:39.123 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:39.594 INFO:teuthology.orchestra.run.smithi112.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T06:13:39.594 INFO:teuthology.orchestra.run.smithi112.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T06:13:39.594 INFO:teuthology.orchestra.run.smithi112.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T06:13:39.594 INFO:teuthology.orchestra.run.smithi112.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T06:13:39.766 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:41.151 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:42.644 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T06:13:42.701 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T06:13:42.770 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T06:13:42.823 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T06:13:42.896 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:42.963 INFO:teuthology.orchestra.run.smithi112.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T06:13:42.963 INFO:teuthology.orchestra.run.smithi112.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T06:13:43.173 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T06:13:43.295 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:43.438 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T06:13:43.550 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:44.878 INFO:teuthology.orchestra.run.smithi120.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T06:13:44.878 INFO:teuthology.orchestra.run.smithi120.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T06:13:44.878 INFO:teuthology.orchestra.run.smithi120.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T06:13:44.878 INFO:teuthology.orchestra.run.smithi120.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T06:13:45.036 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:46.404 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:48.331 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T06:13:48.457 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T06:13:48.583 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T06:13:48.641 INFO:teuthology.orchestra.run.smithi120.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T06:13:48.641 INFO:teuthology.orchestra.run.smithi120.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T06:13:57.177 INFO:teuthology.orchestra.run.smithi112.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T06:13:57.177 INFO:teuthology.orchestra.run.smithi112.stdout:Sourcing file `/etc/default/grub' 2024-09-10T06:13:57.189 INFO:teuthology.orchestra.run.smithi112.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T06:13:57.211 INFO:teuthology.orchestra.run.smithi112.stdout:Generating grub configuration file ... 2024-09-10T06:13:57.471 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T06:13:57.487 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T06:13:57.774 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T06:13:57.779 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T06:13:57.838 INFO:teuthology.orchestra.run.smithi112.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T06:13:57.843 INFO:teuthology.orchestra.run.smithi112.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T06:13:57.987 INFO:teuthology.orchestra.run.smithi112.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T06:13:57.987 INFO:teuthology.orchestra.run.smithi112.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T06:13:57.987 INFO:teuthology.orchestra.run.smithi112.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T06:13:58.032 INFO:teuthology.orchestra.run.smithi112.stdout:done 2024-09-10T06:13:58.512 DEBUG:teuthology.orchestra.run.smithi112:> dpkg -s linux-image-generic 2024-09-10T06:13:58.531 INFO:teuthology.orchestra.run.smithi112.stdout:Package: linux-image-generic 2024-09-10T06:13:58.532 INFO:teuthology.orchestra.run.smithi112.stdout:Status: install ok installed 2024-09-10T06:13:58.532 INFO:teuthology.orchestra.run.smithi112.stdout:Priority: optional 2024-09-10T06:13:58.532 INFO:teuthology.orchestra.run.smithi112.stdout:Section: kernel 2024-09-10T06:13:58.532 INFO:teuthology.orchestra.run.smithi112.stdout:Installed-Size: 21 2024-09-10T06:13:58.532 INFO:teuthology.orchestra.run.smithi112.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T06:13:58.532 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: amd64 2024-09-10T06:13:58.532 INFO:teuthology.orchestra.run.smithi112.stdout:Source: linux-meta 2024-09-10T06:13:58.532 INFO:teuthology.orchestra.run.smithi112.stdout:Version: 5.15.0.119.119 2024-09-10T06:13:58.532 INFO:teuthology.orchestra.run.smithi112.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T06:13:58.532 INFO:teuthology.orchestra.run.smithi112.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T06:13:58.532 INFO:teuthology.orchestra.run.smithi112.stdout:Recommends: thermald 2024-09-10T06:13:58.533 INFO:teuthology.orchestra.run.smithi112.stdout:Description: Generic Linux kernel image 2024-09-10T06:13:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: This package will always depend on the latest generic kernel image 2024-09-10T06:13:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: available. 2024-09-10T06:13:58.533 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T06:13:58.533 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T06:13:58.533 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T06:13:58.533 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-10T06:13:58.533 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi112.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T06:13:58.534 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get clean 2024-09-10T06:13:58.693 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-10T06:13:58.942 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T06:13:58.942 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T06:13:59.016 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T06:13:59.098 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T06:14:00.384 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-10T06:14:00.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T06:14:00.464 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-10T06:14:00.673 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-10T06:14:00.674 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-10T06:14:00.849 INFO:teuthology.orchestra.run.smithi112.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T06:14:00.850 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T06:14:00.850 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T06:14:00.850 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T06:14:00.850 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T06:14:00.850 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T06:14:00.850 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T06:14:00.850 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T06:14:00.890 INFO:teuthology.orchestra.run.smithi112.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T06:14:00.892 DEBUG:teuthology.orchestra.run.smithi112:> dpkg -s linux-image-generic 2024-09-10T06:14:00.909 INFO:teuthology.orchestra.run.smithi112.stdout:Package: linux-image-generic 2024-09-10T06:14:00.909 INFO:teuthology.orchestra.run.smithi112.stdout:Status: install ok installed 2024-09-10T06:14:00.909 INFO:teuthology.orchestra.run.smithi112.stdout:Priority: optional 2024-09-10T06:14:00.909 INFO:teuthology.orchestra.run.smithi112.stdout:Section: kernel 2024-09-10T06:14:00.910 INFO:teuthology.orchestra.run.smithi112.stdout:Installed-Size: 21 2024-09-10T06:14:00.910 INFO:teuthology.orchestra.run.smithi112.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T06:14:00.910 INFO:teuthology.orchestra.run.smithi112.stdout:Architecture: amd64 2024-09-10T06:14:00.910 INFO:teuthology.orchestra.run.smithi112.stdout:Source: linux-meta 2024-09-10T06:14:00.910 INFO:teuthology.orchestra.run.smithi112.stdout:Version: 5.15.0.119.119 2024-09-10T06:14:00.910 INFO:teuthology.orchestra.run.smithi112.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T06:14:00.911 INFO:teuthology.orchestra.run.smithi112.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T06:14:00.911 INFO:teuthology.orchestra.run.smithi112.stdout:Recommends: thermald 2024-09-10T06:14:00.911 INFO:teuthology.orchestra.run.smithi112.stdout:Description: Generic Linux kernel image 2024-09-10T06:14:00.911 INFO:teuthology.orchestra.run.smithi112.stdout: This package will always depend on the latest generic kernel image 2024-09-10T06:14:00.911 INFO:teuthology.orchestra.run.smithi112.stdout: available. 2024-09-10T06:14:00.912 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-10T06:14:00.957 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.wLhN7wqg9A 2024-09-10T06:14:00.957 DEBUG:teuthology.orchestra.run.smithi112:> sudo cp /boot/grub/grub.cfg /tmp/tmp.wLhN7wqg9A 2024-09-10T06:14:01.012 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.wLhN7wqg9A 2024-09-10T06:14:01.135 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.wLhN7wqg9A is 10KB 2024-09-10T06:14:01.147 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.wLhN7wqg9A 2024-09-10T06:14:01.154 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T06:14:01.207 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:14:01.207 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T06:14:01.207 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T06:14:01.270 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T06:14:01.270 DEBUG:teuthology.orchestra.run.smithi112:> sudo update-grub 2024-09-10T06:14:02.464 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub' 2024-09-10T06:14:02.466 INFO:teuthology.orchestra.run.smithi112.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T06:14:02.467 INFO:teuthology.orchestra.run.smithi112.stderr:Generating grub configuration file ... 2024-09-10T06:14:02.660 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T06:14:02.666 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T06:14:02.899 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T06:14:02.905 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T06:14:02.945 INFO:teuthology.orchestra.run.smithi112.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T06:14:02.950 INFO:teuthology.orchestra.run.smithi112.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T06:14:03.067 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T06:14:03.067 INFO:teuthology.orchestra.run.smithi112.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T06:14:03.067 INFO:teuthology.orchestra.run.smithi112.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T06:14:03.082 INFO:teuthology.orchestra.run.smithi112.stderr:done 2024-09-10T06:14:03.095 INFO:teuthology.orchestra.run.smithi120.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T06:14:03.095 INFO:teuthology.orchestra.run.smithi120.stdout:Sourcing file `/etc/default/grub' 2024-09-10T06:14:03.101 DEBUG:teuthology.orchestra.run.smithi112:> sudo shutdown -r now 2024-09-10T06:14:03.110 INFO:teuthology.orchestra.run.smithi120.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T06:14:03.127 INFO:teuthology.orchestra.run.smithi120.stdout:Generating grub configuration file ... 2024-09-10T06:14:03.380 INFO:teuthology.orchestra.run.smithi120.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T06:14:03.393 INFO:teuthology.orchestra.run.smithi120.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T06:14:03.684 INFO:teuthology.orchestra.run.smithi120.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T06:14:03.689 INFO:teuthology.orchestra.run.smithi120.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T06:14:03.753 INFO:teuthology.orchestra.run.smithi120.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T06:14:03.758 INFO:teuthology.orchestra.run.smithi120.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T06:14:03.952 INFO:teuthology.orchestra.run.smithi120.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T06:14:03.953 INFO:teuthology.orchestra.run.smithi120.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T06:14:03.953 INFO:teuthology.orchestra.run.smithi120.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T06:14:03.994 INFO:teuthology.orchestra.run.smithi120.stdout:done 2024-09-10T06:14:04.467 DEBUG:teuthology.orchestra.run.smithi120:> dpkg -s linux-image-generic 2024-09-10T06:14:04.484 INFO:teuthology.orchestra.run.smithi120.stdout:Package: linux-image-generic 2024-09-10T06:14:04.485 INFO:teuthology.orchestra.run.smithi120.stdout:Status: install ok installed 2024-09-10T06:14:04.485 INFO:teuthology.orchestra.run.smithi120.stdout:Priority: optional 2024-09-10T06:14:04.485 INFO:teuthology.orchestra.run.smithi120.stdout:Section: kernel 2024-09-10T06:14:04.485 INFO:teuthology.orchestra.run.smithi120.stdout:Installed-Size: 21 2024-09-10T06:14:04.485 INFO:teuthology.orchestra.run.smithi120.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T06:14:04.485 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: amd64 2024-09-10T06:14:04.485 INFO:teuthology.orchestra.run.smithi120.stdout:Source: linux-meta 2024-09-10T06:14:04.485 INFO:teuthology.orchestra.run.smithi120.stdout:Version: 5.15.0.119.119 2024-09-10T06:14:04.485 INFO:teuthology.orchestra.run.smithi120.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T06:14:04.485 INFO:teuthology.orchestra.run.smithi120.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T06:14:04.485 INFO:teuthology.orchestra.run.smithi120.stdout:Recommends: thermald 2024-09-10T06:14:04.485 INFO:teuthology.orchestra.run.smithi120.stdout:Description: Generic Linux kernel image 2024-09-10T06:14:04.485 INFO:teuthology.orchestra.run.smithi120.stdout: This package will always depend on the latest generic kernel image 2024-09-10T06:14:04.486 INFO:teuthology.orchestra.run.smithi120.stdout: available. 2024-09-10T06:14:04.486 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T06:14:04.486 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T06:14:04.486 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T06:14:04.486 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-10T06:14:04.486 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T06:14:04.486 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get clean 2024-09-10T06:14:04.664 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-09-10T06:14:04.917 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T06:14:04.917 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T06:14:04.988 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T06:14:05.070 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T06:14:06.354 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-10T06:14:06.373 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T06:14:06.435 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-10T06:14:06.643 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-09-10T06:14:06.644 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-09-10T06:14:06.836 INFO:teuthology.orchestra.run.smithi120.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T06:14:06.836 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T06:14:06.836 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T06:14:06.836 INFO:teuthology.orchestra.run.smithi120.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T06:14:06.836 INFO:teuthology.orchestra.run.smithi120.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T06:14:06.837 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T06:14:06.837 INFO:teuthology.orchestra.run.smithi120.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T06:14:06.837 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T06:14:06.875 INFO:teuthology.orchestra.run.smithi120.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T06:14:06.877 DEBUG:teuthology.orchestra.run.smithi120:> dpkg -s linux-image-generic 2024-09-10T06:14:06.892 INFO:teuthology.orchestra.run.smithi120.stdout:Package: linux-image-generic 2024-09-10T06:14:06.892 INFO:teuthology.orchestra.run.smithi120.stdout:Status: install ok installed 2024-09-10T06:14:06.893 INFO:teuthology.orchestra.run.smithi120.stdout:Priority: optional 2024-09-10T06:14:06.893 INFO:teuthology.orchestra.run.smithi120.stdout:Section: kernel 2024-09-10T06:14:06.893 INFO:teuthology.orchestra.run.smithi120.stdout:Installed-Size: 21 2024-09-10T06:14:06.893 INFO:teuthology.orchestra.run.smithi120.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T06:14:06.893 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: amd64 2024-09-10T06:14:06.893 INFO:teuthology.orchestra.run.smithi120.stdout:Source: linux-meta 2024-09-10T06:14:06.893 INFO:teuthology.orchestra.run.smithi120.stdout:Version: 5.15.0.119.119 2024-09-10T06:14:06.893 INFO:teuthology.orchestra.run.smithi120.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T06:14:06.893 INFO:teuthology.orchestra.run.smithi120.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T06:14:06.893 INFO:teuthology.orchestra.run.smithi120.stdout:Recommends: thermald 2024-09-10T06:14:06.893 INFO:teuthology.orchestra.run.smithi120.stdout:Description: Generic Linux kernel image 2024-09-10T06:14:06.893 INFO:teuthology.orchestra.run.smithi120.stdout: This package will always depend on the latest generic kernel image 2024-09-10T06:14:06.894 INFO:teuthology.orchestra.run.smithi120.stdout: available. 2024-09-10T06:14:06.894 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-10T06:14:06.942 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.cQZIO175rd 2024-09-10T06:14:06.942 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub/grub.cfg /tmp/tmp.cQZIO175rd 2024-09-10T06:14:07.015 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.cQZIO175rd 2024-09-10T06:14:07.129 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.cQZIO175rd is 10KB 2024-09-10T06:14:07.141 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.cQZIO175rd 2024-09-10T06:14:07.146 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T06:14:07.201 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:14:07.201 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T06:14:07.201 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T06:14:07.265 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T06:14:07.266 DEBUG:teuthology.orchestra.run.smithi120:> sudo update-grub 2024-09-10T06:14:08.564 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub' 2024-09-10T06:14:08.568 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T06:14:08.569 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-09-10T06:14:08.759 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T06:14:08.765 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T06:14:08.996 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T06:14:09.001 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T06:14:09.039 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T06:14:09.044 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T06:14:09.186 INFO:teuthology.orchestra.run.smithi120.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T06:14:09.186 INFO:teuthology.orchestra.run.smithi120.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T06:14:09.186 INFO:teuthology.orchestra.run.smithi120.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T06:14:09.216 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-09-10T06:14:09.218 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2024-09-10T06:14:33.127 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T06:14:33.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-10T06:14:33.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:14:39.225 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-10T06:14:39.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-10T06:14:39.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:14:51.453 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-10T06:14:57.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-10T06:15:00.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-10T06:15:00.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:15:03.517 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-10T06:15:06.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-10T06:15:06.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:15:09.665 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-10T06:15:15.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-10T06:15:15.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:15:21.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-10T06:15:21.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:15:33.949 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-09-10T06:15:40.093 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-09-10T06:15:48.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-10T06:15:48.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:15:49.265 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-10T06:15:50.024 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-10T06:15:50.024 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-10T06:15:50.025 DEBUG:teuthology.orchestra.run.smithi112:> uname -r 2024-09-10T06:15:50.070 INFO:teuthology.orchestra.run.smithi112.stdout:5.15.0-119-generic 2024-09-10T06:15:50.070 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T06:15:50.070 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T06:15:50.071 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T06:15:51.071 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T06:15:51.071 DEBUG:teuthology.orchestra.run.smithi112:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T06:15:51.156 INFO:teuthology.orchestra.run.smithi112.stdout:ttyS1 2024-09-10T06:15:51.180 DEBUG:teuthology.parallel:result is None 2024-09-10T06:15:55.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-10T06:15:55.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:15:55.422 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-10T06:15:56.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-10T06:15:56.058 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-10T06:15:56.058 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-09-10T06:15:56.106 INFO:teuthology.orchestra.run.smithi120.stdout:5.15.0-119-generic 2024-09-10T06:15:56.106 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T06:15:56.106 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T06:15:56.106 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T06:15:57.107 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-10T06:15:57.108 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T06:15:57.490 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2024-09-10T06:15:57.523 DEBUG:teuthology.parallel:result is None 2024-09-10T06:15:57.523 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T06:15:57.531 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T06:15:57.531 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T06:15:57.534 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T06:15:57.540 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T06:15:57.563 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T06:15:57.596 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T06:15:57.596 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T06:15:57.599 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T06:15:57.698 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T06:15:57.705 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T06:15:57.706 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T06:15:57.708 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T06:15:57.726 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T06:15:57.729 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T06:15:57.734 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T06:15:57.738 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T06:15:57.740 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T06:15:57.750 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T06:15:57.750 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T06:15:57.783 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T06:15:57.799 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T06:15:57.809 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T06:15:57.809 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T06:15:57.839 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T06:15:57.845 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T06:15:57.893 DEBUG:teuthology.orchestra.run.smithi112:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T06:15:57.942 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:15:57.942 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T06:15:58.017 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T06:15:58.024 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T06:15:58.073 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:15:58.074 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T06:15:58.137 DEBUG:teuthology.orchestra.run.smithi112:> sudo service rsyslog restart 2024-09-10T06:15:58.139 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-09-10T06:15:58.216 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T06:15:58.225 INFO:teuthology.task.internal:Starting timer... 2024-09-10T06:15:58.225 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T06:15:58.274 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T06:15:58.310 DEBUG:teuthology.task.selinux:Excluding smithi112: OS 'ubuntu' does not support SELinux 2024-09-10T06:15:58.310 DEBUG:teuthology.task.selinux:Excluding smithi120: OS 'ubuntu' does not support SELinux 2024-09-10T06:15:58.310 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T06:15:58.310 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-10T06:15:58.310 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T06:15:58.310 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T06:15:58.340 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T06:15:58.352 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T06:15:58.353 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi112.front.sepia.ceph.com,smithi120.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T06:23:24.568 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi112.front.sepia.ceph.com'), Remote(name='ubuntu@smithi120.front.sepia.ceph.com')] 2024-09-10T06:23:24.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-10T06:23:24.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:23:24.654 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-09-10T06:23:24.731 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-09-10T06:23:24.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-10T06:23:24.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T06:23:24.812 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-09-10T06:23:24.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-09-10T06:23:24.889 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T06:23:24.900 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T06:23:24.901 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T06:23:24.901 DEBUG:teuthology.orchestra.run.smithi112:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T06:23:24.904 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T06:23:24.904 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T06:23:24.933 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T06:23:24.933 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: Command line: ntpd -gq 2024-09-10T06:23:24.933 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: ---------------------------------------------------- 2024-09-10T06:23:24.933 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T06:23:24.933 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T06:23:24.933 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: corporation. Support and training for ntp-4 are 2024-09-10T06:23:24.933 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: available at https://www.nwtime.org/support 2024-09-10T06:23:24.933 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: ---------------------------------------------------- 2024-09-10T06:23:24.934 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: proto: precision = 0.062 usec (-24) 2024-09-10T06:23:24.934 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: basedate set to 2022-02-04 2024-09-10T06:23:24.934 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: gps base set to 2022-02-06 (week 2196) 2024-09-10T06:23:24.934 INFO:teuthology.orchestra.run.smithi112.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T06:23:24.935 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T06:23:24.935 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T06:23:24.935 INFO:teuthology.orchestra.run.smithi112.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T06:23:24.936 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T06:23:24.936 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T06:23:24.936 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T06:23:24.936 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: Listen normally on 3 enp3s0f1 172.21.15.112:123 2024-09-10T06:23:24.936 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: Listen normally on 4 lo [::1]:123 2024-09-10T06:23:24.937 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb69%5]:123 2024-09-10T06:23:24.937 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:24 ntpd[18450]: Listening on routing socket on fd #22 for interface updates 2024-09-10T06:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T06:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: Command line: ntpd -gq 2024-09-10T06:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: ---------------------------------------------------- 2024-09-10T06:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T06:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T06:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: corporation. Support and training for ntp-4 are 2024-09-10T06:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: available at https://www.nwtime.org/support 2024-09-10T06:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: ---------------------------------------------------- 2024-09-10T06:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: proto: precision = 0.048 usec (-24) 2024-09-10T06:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: basedate set to 2022-02-04 2024-09-10T06:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: gps base set to 2022-02-06 (week 2196) 2024-09-10T06:23:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T06:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T06:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T06:23:24.963 INFO:teuthology.orchestra.run.smithi120.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T06:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T06:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T06:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T06:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: Listen normally on 3 enp3s0f1 172.21.15.120:123 2024-09-10T06:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: Listen normally on 4 lo [::1]:123 2024-09-10T06:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:478f%5]:123 2024-09-10T06:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:24 ntpd[18485]: Listening on routing socket on fd #22 for interface updates 2024-09-10T06:23:25.933 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:25 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:25.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:25 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:25.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:25 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:25.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:25 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:25.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:25 ntpd[18450]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:25.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:25 ntpd[18450]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:25 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:25.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:25 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:25 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:25 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:25 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:25 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:25 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:25 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:25 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:25 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:25 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:25 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:25 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:25.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:25 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:26.933 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:26 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:26.933 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:26 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:26.933 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:26 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:26.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:26 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:26.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:26 ntpd[18450]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:26.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:26 ntpd[18450]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:26 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:26 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:26 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:26 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:26 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:26.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:26 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:27.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:27 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:27.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:27 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:27.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:27 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:27.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:27 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:27.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:27 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:27.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:27 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:27.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:27 ntpd[18450]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:27.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:27 ntpd[18450]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:27.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:27 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:27.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:27 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:27.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:27 ntpd[18450]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:27.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:27 ntpd[18450]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:27.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:27 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:27.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:27 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:27.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:27 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:27.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:27 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:27.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:27 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:27.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:27 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:27.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:27 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:27.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:27 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:27.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:27 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:27.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:27 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:27.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:27 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:27.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:27 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:28.933 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:28 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:28.933 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:28 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:28.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:28 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:28.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:28 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:28.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:28 ntpd[18450]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:28.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:28 ntpd[18450]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:28.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:28 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:28.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:28 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:28.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:28 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:28.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:28 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:28.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:28 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:28.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:28 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:29 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:29 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:29 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:29 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:29 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:29 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:29 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:29 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:29 ntpd[18450]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:29.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:29 ntpd[18450]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:29.935 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:29 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:29.935 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:29 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:29.935 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:29 ntpd[18450]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:29.935 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:29 ntpd[18450]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:29.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:29 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:29 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:29 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:29 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:29 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:29 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:29 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:29 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:29 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:29 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:29 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:29.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:29 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:30.933 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:30 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:30.933 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:30 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:30.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:30 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:30.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:30 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:30.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:30 ntpd[18450]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:30.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:30 ntpd[18450]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:30.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:30 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:30.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:30 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:30.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:30 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:30.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:30 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:30.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:30 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:30.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:30 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:31.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:31 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:31.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:31 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:31.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:31 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:31.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:31 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:31.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:31 ntpd[18450]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:31.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:31 ntpd[18450]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:31.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:31 ntpd[18450]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:31.934 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:31 ntpd[18450]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:31.934 INFO:teuthology.orchestra.run.smithi112.stdout:10 Sep 06:23:31 ntpd[18450]: ntpd: time slew -0.001667 s 2024-09-10T06:23:31.935 INFO:teuthology.orchestra.run.smithi112.stdout:ntpd: time slew -0.001667s 2024-09-10T06:23:31.935 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:31 ntpd[18450]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T06:23:31.935 INFO:teuthology.orchestra.run.smithi112.stderr:10 Sep 06:23:31 ntpd[18450]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T06:23:31.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:31 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:31.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:31 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:31.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:31 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:31.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:31 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:31.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:31 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T06:23:31.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:31 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T06:23:31.962 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:31 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T06:23:31.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:31 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T06:23:31.963 INFO:teuthology.orchestra.run.smithi120.stdout:10 Sep 06:23:31 ntpd[18485]: ntpd: time slew -0.000667 s 2024-09-10T06:23:31.963 INFO:teuthology.orchestra.run.smithi120.stdout:ntpd: time slew -0.000667s 2024-09-10T06:23:31.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:31 ntpd[18485]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T06:23:31.963 INFO:teuthology.orchestra.run.smithi120.stderr:10 Sep 06:23:31 ntpd[18485]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T06:23:31.997 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T06:23:31.997 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2024-09-10T06:23:31.997 INFO:teuthology.orchestra.run.smithi112.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:23:31.997 INFO:teuthology.orchestra.run.smithi112.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:23:31.997 INFO:teuthology.orchestra.run.smithi112.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:23:31.997 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:23:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T06:23:32.016 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2024-09-10T06:23:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:23:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:23:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:23:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:23:32.017 INFO:teuthology.run_tasks:Running task install... 2024-09-10T06:23:32.027 DEBUG:teuthology.task.install:project ceph 2024-09-10T06:23:32.027 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-10T06:23:32.028 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-10T06:23:32.028 INFO:teuthology.task.install:Using flavor: default 2024-09-10T06:23:32.033 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T06:23:32.033 INFO:teuthology.task.install:extra packages: [] 2024-09-10T06:23:32.033 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-key list | grep Ceph 2024-09-10T06:23:32.034 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-key list | grep Ceph 2024-09-10T06:23:32.099 INFO:teuthology.orchestra.run.smithi112.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T06:23:32.116 INFO:teuthology.orchestra.run.smithi120.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T06:23:32.127 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T06:23:32.127 INFO:teuthology.orchestra.run.smithi112.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T06:23:32.128 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-10T06:23:32.128 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T06:23:32.143 INFO:teuthology.orchestra.run.smithi120.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T06:23:32.144 INFO:teuthology.orchestra.run.smithi120.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T06:23:32.144 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-10T06:23:32.144 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T06:23:32.277 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-10T06:23:32.278 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-10T06:23:32.309 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-10T06:23:32.310 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-10T06:23:32.387 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:23:32.387 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T06:23:32.399 DEBUG:teuthology.orchestra.run.smithi112:> sudo apt-get update 2024-09-10T06:23:32.415 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:23:32.415 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T06:23:32.429 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-09-10T06:23:32.587 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T06:23:32.599 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T06:23:32.622 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T06:23:32.644 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-10T06:23:32.653 INFO:teuthology.orchestra.run.smithi120.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T06:23:32.666 INFO:teuthology.orchestra.run.smithi112.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T06:23:32.675 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-10T06:23:32.687 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-10T06:23:32.693 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T06:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T06:23:32.715 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-10T06:23:32.718 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-10T06:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T06:23:32.746 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-10T06:23:32.769 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T06:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T06:23:32.851 INFO:teuthology.orchestra.run.smithi112.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T06:23:32.884 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T06:23:32.999 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 29.2 kB in 0s (70.9 kB/s) 2024-09-10T06:23:33.023 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 29.2 kB in 0s (70.7 kB/s) 2024-09-10T06:23:33.986 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-10T06:23:34.003 DEBUG:teuthology.orchestra.run.smithi112:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-10T06:23:34.008 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-10T06:23:34.025 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-10T06:23:34.066 INFO:teuthology.orchestra.run.smithi112.stdout:Reading package lists... 2024-09-10T06:23:34.087 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-09-10T06:23:34.273 INFO:teuthology.orchestra.run.smithi112.stdout:Building dependency tree... 2024-09-10T06:23:34.274 INFO:teuthology.orchestra.run.smithi112.stdout:Reading state information... 2024-09-10T06:23:34.297 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-09-10T06:23:34.300 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-09-10T06:23:34.480 INFO:teuthology.orchestra.run.smithi112.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T06:23:34.480 INFO:teuthology.orchestra.run.smithi112.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T06:23:34.481 INFO:teuthology.orchestra.run.smithi112.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T06:23:34.481 INFO:teuthology.orchestra.run.smithi112.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T06:23:34.481 INFO:teuthology.orchestra.run.smithi112.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T06:23:34.481 INFO:teuthology.orchestra.run.smithi112.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T06:23:34.481 INFO:teuthology.orchestra.run.smithi112.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T06:23:34.482 INFO:teuthology.orchestra.run.smithi112.stdout:The following additional packages will be installed: 2024-09-10T06:23:34.482 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T06:23:34.482 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T06:23:34.482 INFO:teuthology.orchestra.run.smithi112.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T06:23:34.482 INFO:teuthology.orchestra.run.smithi112.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-10T06:23:34.483 INFO:teuthology.orchestra.run.smithi112.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-10T06:23:34.483 INFO:teuthology.orchestra.run.smithi112.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-10T06:23:34.484 INFO:teuthology.orchestra.run.smithi112.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-10T06:23:34.484 INFO:teuthology.orchestra.run.smithi112.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-10T06:23:34.484 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-10T06:23:34.484 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T06:23:34.484 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T06:23:34.484 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T06:23:34.484 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T06:23:34.484 INFO:teuthology.orchestra.run.smithi112.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T06:23:34.484 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T06:23:34.484 INFO:teuthology.orchestra.run.smithi112.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T06:23:34.484 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-10T06:23:34.484 INFO:teuthology.orchestra.run.smithi112.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-10T06:23:34.484 INFO:teuthology.orchestra.run.smithi112.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T06:23:34.484 INFO:teuthology.orchestra.run.smithi112.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T06:23:34.485 INFO:teuthology.orchestra.run.smithi112.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T06:23:34.485 INFO:teuthology.orchestra.run.smithi112.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T06:23:34.485 INFO:teuthology.orchestra.run.smithi112.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-10T06:23:34.485 INFO:teuthology.orchestra.run.smithi112.stdout: xmlstarlet zip 2024-09-10T06:23:34.485 INFO:teuthology.orchestra.run.smithi112.stdout:Suggested packages: 2024-09-10T06:23:34.485 INFO:teuthology.orchestra.run.smithi112.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T06:23:34.485 INFO:teuthology.orchestra.run.smithi112.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T06:23:34.485 INFO:teuthology.orchestra.run.smithi112.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T06:23:34.485 INFO:teuthology.orchestra.run.smithi112.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T06:23:34.486 INFO:teuthology.orchestra.run.smithi112.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T06:23:34.486 INFO:teuthology.orchestra.run.smithi112.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T06:23:34.486 INFO:teuthology.orchestra.run.smithi112.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T06:23:34.486 INFO:teuthology.orchestra.run.smithi112.stdout:Recommended packages: 2024-09-10T06:23:34.486 INFO:teuthology.orchestra.run.smithi112.stdout: btrfs-tools 2024-09-10T06:23:34.492 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T06:23:34.493 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T06:23:34.493 INFO:teuthology.orchestra.run.smithi120.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T06:23:34.493 INFO:teuthology.orchestra.run.smithi120.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T06:23:34.493 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T06:23:34.494 INFO:teuthology.orchestra.run.smithi120.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T06:23:34.494 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T06:23:34.494 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2024-09-10T06:23:34.494 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T06:23:34.495 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T06:23:34.495 INFO:teuthology.orchestra.run.smithi120.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T06:23:34.495 INFO:teuthology.orchestra.run.smithi120.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-10T06:23:34.496 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-10T06:23:34.496 INFO:teuthology.orchestra.run.smithi120.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T06:23:34.497 INFO:teuthology.orchestra.run.smithi120.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T06:23:34.498 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T06:23:34.498 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-10T06:23:34.498 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet zip 2024-09-10T06:23:34.498 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2024-09-10T06:23:34.498 INFO:teuthology.orchestra.run.smithi120.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T06:23:34.498 INFO:teuthology.orchestra.run.smithi120.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T06:23:34.498 INFO:teuthology.orchestra.run.smithi120.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T06:23:34.498 INFO:teuthology.orchestra.run.smithi120.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T06:23:34.498 INFO:teuthology.orchestra.run.smithi120.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T06:23:34.499 INFO:teuthology.orchestra.run.smithi120.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T06:23:34.499 INFO:teuthology.orchestra.run.smithi120.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T06:23:34.499 INFO:teuthology.orchestra.run.smithi120.stdout:Recommended packages: 2024-09-10T06:23:34.499 INFO:teuthology.orchestra.run.smithi120.stdout: btrfs-tools 2024-09-10T06:23:34.589 INFO:teuthology.orchestra.run.smithi112.stdout:The following NEW packages will be installed: 2024-09-10T06:23:34.590 INFO:teuthology.orchestra.run.smithi112.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T06:23:34.590 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T06:23:34.590 INFO:teuthology.orchestra.run.smithi112.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-10T06:23:34.590 INFO:teuthology.orchestra.run.smithi112.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-10T06:23:34.590 INFO:teuthology.orchestra.run.smithi112.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-10T06:23:34.590 INFO:teuthology.orchestra.run.smithi112.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-10T06:23:34.591 INFO:teuthology.orchestra.run.smithi112.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-10T06:23:34.591 INFO:teuthology.orchestra.run.smithi112.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-10T06:23:34.591 INFO:teuthology.orchestra.run.smithi112.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-10T06:23:34.591 INFO:teuthology.orchestra.run.smithi112.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-10T06:23:34.591 INFO:teuthology.orchestra.run.smithi112.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-10T06:23:34.591 INFO:teuthology.orchestra.run.smithi112.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T06:23:34.592 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T06:23:34.592 INFO:teuthology.orchestra.run.smithi112.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T06:23:34.592 INFO:teuthology.orchestra.run.smithi112.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T06:23:34.592 INFO:teuthology.orchestra.run.smithi112.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T06:23:34.592 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T06:23:34.592 INFO:teuthology.orchestra.run.smithi112.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T06:23:34.592 INFO:teuthology.orchestra.run.smithi112.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-10T06:23:34.592 INFO:teuthology.orchestra.run.smithi112.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-10T06:23:34.592 INFO:teuthology.orchestra.run.smithi112.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-10T06:23:34.592 INFO:teuthology.orchestra.run.smithi112.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-10T06:23:34.592 INFO:teuthology.orchestra.run.smithi112.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-10T06:23:34.592 INFO:teuthology.orchestra.run.smithi112.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-10T06:23:34.592 INFO:teuthology.orchestra.run.smithi112.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-10T06:23:34.593 INFO:teuthology.orchestra.run.smithi112.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-10T06:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2024-09-10T06:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T06:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T06:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-10T06:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-10T06:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-10T06:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-10T06:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-10T06:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-10T06:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-10T06:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-10T06:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-10T06:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T06:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T06:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T06:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T06:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T06:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T06:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T06:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-10T06:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-10T06:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-10T06:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-10T06:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-10T06:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-10T06:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-10T06:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-10T06:23:34.651 INFO:teuthology.orchestra.run.smithi112.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T06:23:34.651 INFO:teuthology.orchestra.run.smithi112.stdout:Need to get 251 MB of archives. 2024-09-10T06:23:34.651 INFO:teuthology.orchestra.run.smithi112.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-10T06:23:34.652 INFO:teuthology.orchestra.run.smithi112.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T06:23:34.736 INFO:teuthology.orchestra.run.smithi112.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-10T06:23:34.739 INFO:teuthology.orchestra.run.smithi112.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T06:23:34.742 INFO:teuthology.orchestra.run.smithi112.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T06:23:34.744 INFO:teuthology.orchestra.run.smithi120.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T06:23:34.744 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 251 MB of archives. 2024-09-10T06:23:34.744 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-10T06:23:34.744 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-10T06:23:34.759 INFO:teuthology.orchestra.run.smithi112.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T06:23:34.790 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T06:23:34.818 INFO:teuthology.orchestra.run.smithi112.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T06:23:34.823 INFO:teuthology.orchestra.run.smithi112.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T06:23:34.836 INFO:teuthology.orchestra.run.smithi112.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T06:23:34.840 INFO:teuthology.orchestra.run.smithi112.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T06:23:34.841 INFO:teuthology.orchestra.run.smithi112.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T06:23:34.842 INFO:teuthology.orchestra.run.smithi112.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T06:23:34.850 INFO:teuthology.orchestra.run.smithi112.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T06:23:34.852 INFO:teuthology.orchestra.run.smithi112.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T06:23:34.854 INFO:teuthology.orchestra.run.smithi112.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T06:23:34.856 INFO:teuthology.orchestra.run.smithi112.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T06:23:34.857 INFO:teuthology.orchestra.run.smithi112.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T06:23:34.859 INFO:teuthology.orchestra.run.smithi112.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T06:23:34.874 INFO:teuthology.orchestra.run.smithi112.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T06:23:34.876 INFO:teuthology.orchestra.run.smithi112.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T06:23:34.876 INFO:teuthology.orchestra.run.smithi112.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T06:23:34.876 INFO:teuthology.orchestra.run.smithi112.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T06:23:34.878 INFO:teuthology.orchestra.run.smithi112.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T06:23:34.878 INFO:teuthology.orchestra.run.smithi112.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T06:23:34.878 INFO:teuthology.orchestra.run.smithi112.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T06:23:34.879 INFO:teuthology.orchestra.run.smithi112.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T06:23:34.891 INFO:teuthology.orchestra.run.smithi112.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T06:23:34.892 INFO:teuthology.orchestra.run.smithi112.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T06:23:34.908 INFO:teuthology.orchestra.run.smithi112.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T06:23:34.911 INFO:teuthology.orchestra.run.smithi112.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T06:23:34.911 INFO:teuthology.orchestra.run.smithi112.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T06:23:34.912 INFO:teuthology.orchestra.run.smithi112.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T06:23:34.912 INFO:teuthology.orchestra.run.smithi112.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T06:23:34.913 INFO:teuthology.orchestra.run.smithi112.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T06:23:34.914 INFO:teuthology.orchestra.run.smithi112.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T06:23:34.914 INFO:teuthology.orchestra.run.smithi112.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T06:23:34.925 INFO:teuthology.orchestra.run.smithi112.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T06:23:34.926 INFO:teuthology.orchestra.run.smithi112.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T06:23:34.941 INFO:teuthology.orchestra.run.smithi112.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-10T06:23:34.942 INFO:teuthology.orchestra.run.smithi112.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T06:23:34.948 INFO:teuthology.orchestra.run.smithi112.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T06:23:34.948 INFO:teuthology.orchestra.run.smithi112.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T06:23:34.948 INFO:teuthology.orchestra.run.smithi112.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T06:23:34.949 INFO:teuthology.orchestra.run.smithi112.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T06:23:34.950 INFO:teuthology.orchestra.run.smithi112.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T06:23:34.952 INFO:teuthology.orchestra.run.smithi112.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T06:23:34.953 INFO:teuthology.orchestra.run.smithi112.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T06:23:34.960 INFO:teuthology.orchestra.run.smithi112.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T06:23:34.961 INFO:teuthology.orchestra.run.smithi112.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T06:23:34.969 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-10T06:23:34.977 INFO:teuthology.orchestra.run.smithi112.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T06:23:34.977 INFO:teuthology.orchestra.run.smithi112.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T06:23:34.978 INFO:teuthology.orchestra.run.smithi112.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T06:23:34.981 INFO:teuthology.orchestra.run.smithi112.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T06:23:35.022 INFO:teuthology.orchestra.run.smithi112.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-10T06:23:35.032 INFO:teuthology.orchestra.run.smithi112.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T06:23:35.033 INFO:teuthology.orchestra.run.smithi112.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T06:23:35.034 INFO:teuthology.orchestra.run.smithi112.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T06:23:35.035 INFO:teuthology.orchestra.run.smithi112.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T06:23:35.036 INFO:teuthology.orchestra.run.smithi112.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-10T06:23:35.049 INFO:teuthology.orchestra.run.smithi112.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-10T06:23:35.049 INFO:teuthology.orchestra.run.smithi112.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T06:23:35.049 INFO:teuthology.orchestra.run.smithi112.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-10T06:23:35.052 INFO:teuthology.orchestra.run.smithi112.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-10T06:23:35.053 INFO:teuthology.orchestra.run.smithi112.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-10T06:23:35.066 INFO:teuthology.orchestra.run.smithi112.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T06:23:35.068 INFO:teuthology.orchestra.run.smithi112.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T06:23:35.068 INFO:teuthology.orchestra.run.smithi112.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T06:23:35.069 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-10T06:23:35.084 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-10T06:23:35.084 INFO:teuthology.orchestra.run.smithi112.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T06:23:35.085 INFO:teuthology.orchestra.run.smithi112.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T06:23:35.085 INFO:teuthology.orchestra.run.smithi112.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T06:23:35.086 INFO:teuthology.orchestra.run.smithi112.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-10T06:23:35.086 INFO:teuthology.orchestra.run.smithi112.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T06:23:35.086 INFO:teuthology.orchestra.run.smithi112.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T06:23:35.086 INFO:teuthology.orchestra.run.smithi112.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T06:23:35.087 INFO:teuthology.orchestra.run.smithi112.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T06:23:35.105 INFO:teuthology.orchestra.run.smithi112.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T06:23:35.108 INFO:teuthology.orchestra.run.smithi112.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T06:23:35.121 INFO:teuthology.orchestra.run.smithi112.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T06:23:35.123 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-10T06:23:35.123 INFO:teuthology.orchestra.run.smithi112.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T06:23:35.124 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-10T06:23:35.124 INFO:teuthology.orchestra.run.smithi112.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T06:23:35.127 INFO:teuthology.orchestra.run.smithi112.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T06:23:35.127 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-10T06:23:35.129 INFO:teuthology.orchestra.run.smithi112.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T06:23:35.129 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-10T06:23:35.130 INFO:teuthology.orchestra.run.smithi112.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T06:23:35.130 INFO:teuthology.orchestra.run.smithi112.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T06:23:35.134 INFO:teuthology.orchestra.run.smithi112.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T06:23:35.135 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-10T06:23:35.138 INFO:teuthology.orchestra.run.smithi112.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T06:23:35.141 INFO:teuthology.orchestra.run.smithi112.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T06:23:35.156 INFO:teuthology.orchestra.run.smithi112.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T06:23:35.157 INFO:teuthology.orchestra.run.smithi112.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T06:23:35.157 INFO:teuthology.orchestra.run.smithi112.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T06:23:35.159 INFO:teuthology.orchestra.run.smithi112.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T06:23:35.159 INFO:teuthology.orchestra.run.smithi112.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T06:23:35.165 INFO:teuthology.orchestra.run.smithi112.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T06:23:35.166 INFO:teuthology.orchestra.run.smithi112.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T06:23:35.166 INFO:teuthology.orchestra.run.smithi112.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T06:23:35.173 INFO:teuthology.orchestra.run.smithi112.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T06:23:35.174 INFO:teuthology.orchestra.run.smithi112.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T06:23:35.210 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T06:23:35.222 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T06:23:35.303 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T06:23:35.353 INFO:teuthology.orchestra.run.smithi112.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-10T06:23:35.355 INFO:teuthology.orchestra.run.smithi112.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-10T06:23:35.363 INFO:teuthology.orchestra.run.smithi112.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-10T06:23:35.385 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-10T06:23:35.388 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-10T06:23:35.396 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-10T06:23:35.532 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T06:23:35.543 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T06:23:35.572 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T06:23:35.581 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T06:23:35.582 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T06:23:35.583 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T06:23:35.601 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T06:23:35.605 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T06:23:35.610 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T06:23:35.614 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T06:23:35.694 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T06:23:35.698 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T06:23:35.702 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T06:23:35.706 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T06:23:35.707 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T06:23:35.708 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T06:23:35.709 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T06:23:35.712 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T06:23:35.712 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T06:23:35.777 INFO:teuthology.orchestra.run.smithi120.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T06:23:35.794 INFO:teuthology.orchestra.run.smithi120.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T06:23:35.794 INFO:teuthology.orchestra.run.smithi120.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T06:23:35.795 INFO:teuthology.orchestra.run.smithi120.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T06:23:35.800 INFO:teuthology.orchestra.run.smithi120.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T06:23:35.801 INFO:teuthology.orchestra.run.smithi120.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T06:23:35.859 INFO:teuthology.orchestra.run.smithi120.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T06:23:35.860 INFO:teuthology.orchestra.run.smithi120.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T06:23:35.862 INFO:teuthology.orchestra.run.smithi120.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T06:23:35.862 INFO:teuthology.orchestra.run.smithi120.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T06:23:35.940 INFO:teuthology.orchestra.run.smithi120.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T06:23:35.942 INFO:teuthology.orchestra.run.smithi120.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T06:23:35.944 INFO:teuthology.orchestra.run.smithi120.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T06:23:35.945 INFO:teuthology.orchestra.run.smithi120.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T06:23:35.955 INFO:teuthology.orchestra.run.smithi120.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T06:23:36.022 INFO:teuthology.orchestra.run.smithi120.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T06:23:36.023 INFO:teuthology.orchestra.run.smithi120.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T06:23:36.024 INFO:teuthology.orchestra.run.smithi120.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T06:23:36.026 INFO:teuthology.orchestra.run.smithi120.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T06:23:36.030 INFO:teuthology.orchestra.run.smithi120.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T06:23:36.103 INFO:teuthology.orchestra.run.smithi120.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T06:23:36.106 INFO:teuthology.orchestra.run.smithi120.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T06:23:36.107 INFO:teuthology.orchestra.run.smithi120.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T06:23:36.112 INFO:teuthology.orchestra.run.smithi120.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T06:23:36.113 INFO:teuthology.orchestra.run.smithi120.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T06:23:36.185 INFO:teuthology.orchestra.run.smithi120.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T06:23:36.189 INFO:teuthology.orchestra.run.smithi120.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T06:23:36.365 INFO:teuthology.orchestra.run.smithi120.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T06:23:36.365 INFO:teuthology.orchestra.run.smithi120.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-10T06:23:36.367 INFO:teuthology.orchestra.run.smithi120.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T06:23:36.369 INFO:teuthology.orchestra.run.smithi120.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T06:23:36.370 INFO:teuthology.orchestra.run.smithi120.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T06:23:36.372 INFO:teuthology.orchestra.run.smithi120.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T06:23:36.408 INFO:teuthology.orchestra.run.smithi120.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T06:23:36.412 INFO:teuthology.orchestra.run.smithi120.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T06:23:36.412 INFO:teuthology.orchestra.run.smithi120.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T06:23:36.446 INFO:teuthology.orchestra.run.smithi120.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-10T06:23:36.449 INFO:teuthology.orchestra.run.smithi120.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-10T06:23:36.451 INFO:teuthology.orchestra.run.smithi120.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-10T06:23:36.467 INFO:teuthology.orchestra.run.smithi120.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T06:23:36.467 INFO:teuthology.orchestra.run.smithi120.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T06:23:36.471 INFO:teuthology.orchestra.run.smithi112.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-10T06:23:36.487 INFO:teuthology.orchestra.run.smithi120.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-10T06:23:36.532 INFO:teuthology.orchestra.run.smithi120.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T06:23:36.532 INFO:teuthology.orchestra.run.smithi120.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T06:23:36.533 INFO:teuthology.orchestra.run.smithi120.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T06:23:36.534 INFO:teuthology.orchestra.run.smithi120.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T06:23:36.535 INFO:teuthology.orchestra.run.smithi120.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T06:23:36.536 INFO:teuthology.orchestra.run.smithi120.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T06:23:36.542 INFO:teuthology.orchestra.run.smithi120.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T06:23:36.564 INFO:teuthology.orchestra.run.smithi112.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-10T06:23:36.574 INFO:teuthology.orchestra.run.smithi112.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-10T06:23:36.579 INFO:teuthology.orchestra.run.smithi112.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-10T06:23:36.613 INFO:teuthology.orchestra.run.smithi120.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T06:23:36.616 INFO:teuthology.orchestra.run.smithi120.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T06:23:36.618 INFO:teuthology.orchestra.run.smithi120.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T06:23:36.634 INFO:teuthology.orchestra.run.smithi112.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-10T06:23:36.662 INFO:teuthology.orchestra.run.smithi120.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-10T06:23:36.694 INFO:teuthology.orchestra.run.smithi120.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T06:23:36.700 INFO:teuthology.orchestra.run.smithi120.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T06:23:36.703 INFO:teuthology.orchestra.run.smithi120.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T06:23:36.704 INFO:teuthology.orchestra.run.smithi120.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T06:23:36.715 INFO:teuthology.orchestra.run.smithi120.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T06:23:36.717 INFO:teuthology.orchestra.run.smithi120.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T06:23:36.724 INFO:teuthology.orchestra.run.smithi120.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T06:23:36.776 INFO:teuthology.orchestra.run.smithi120.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T06:23:36.777 INFO:teuthology.orchestra.run.smithi120.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T06:23:36.778 INFO:teuthology.orchestra.run.smithi120.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T06:23:36.857 INFO:teuthology.orchestra.run.smithi120.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T06:23:36.859 INFO:teuthology.orchestra.run.smithi120.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T06:23:36.861 INFO:teuthology.orchestra.run.smithi112.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-10T06:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T06:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T06:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T06:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T06:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T06:23:37.448 INFO:teuthology.orchestra.run.smithi120.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-10T06:23:37.449 INFO:teuthology.orchestra.run.smithi120.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-10T06:23:37.468 INFO:teuthology.orchestra.run.smithi120.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-10T06:23:37.508 INFO:teuthology.orchestra.run.smithi120.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-10T06:23:37.517 INFO:teuthology.orchestra.run.smithi120.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-10T06:23:37.519 INFO:teuthology.orchestra.run.smithi120.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-10T06:23:37.807 INFO:teuthology.orchestra.run.smithi112.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-10T06:23:37.808 INFO:teuthology.orchestra.run.smithi112.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-10T06:23:37.825 INFO:teuthology.orchestra.run.smithi112.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-10T06:23:37.866 INFO:teuthology.orchestra.run.smithi112.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-10T06:23:37.876 INFO:teuthology.orchestra.run.smithi112.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-10T06:23:37.878 INFO:teuthology.orchestra.run.smithi112.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-10T06:23:39.453 INFO:teuthology.orchestra.run.smithi120.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-10T06:23:39.621 INFO:teuthology.orchestra.run.smithi120.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-10T06:23:39.622 INFO:teuthology.orchestra.run.smithi120.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-10T06:23:40.363 INFO:teuthology.orchestra.run.smithi112.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-10T06:23:40.591 INFO:teuthology.orchestra.run.smithi112.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-10T06:23:40.591 INFO:teuthology.orchestra.run.smithi112.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-10T06:23:41.434 INFO:teuthology.orchestra.run.smithi120.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-10T06:23:41.437 INFO:teuthology.orchestra.run.smithi120.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-10T06:23:41.438 INFO:teuthology.orchestra.run.smithi120.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-10T06:23:41.881 INFO:teuthology.orchestra.run.smithi120.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-10T06:23:42.308 INFO:teuthology.orchestra.run.smithi112.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-10T06:23:42.310 INFO:teuthology.orchestra.run.smithi112.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-10T06:23:42.311 INFO:teuthology.orchestra.run.smithi112.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-10T06:23:42.456 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 251 MB in 7s (34.5 MB/s) 2024-09-10T06:23:42.615 INFO:teuthology.orchestra.run.smithi112.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-10T06:23:42.617 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T06:23:42.711 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T06:23:42.717 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T06:23:42.807 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T06:23:43.169 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T06:23:43.195 INFO:teuthology.orchestra.run.smithi112.stdout:Fetched 251 MB in 8s (31.3 MB/s) 2024-09-10T06:23:43.196 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T06:23:43.236 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T06:23:43.334 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T06:23:43.427 INFO:teuthology.orchestra.run.smithi112.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T06:23:43.433 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T06:23:43.507 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T06:23:43.514 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T06:23:43.540 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T06:23:43.581 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T06:23:43.819 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T06:23:43.846 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T06:23:43.878 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T06:23:44.018 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T06:23:44.045 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T06:23:44.093 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:23:44.222 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T06:23:44.249 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T06:23:44.289 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T06:23:44.497 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T06:23:44.523 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T06:23:44.563 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:23:44.751 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T06:23:44.777 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T06:23:44.825 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:23:44.892 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T06:23:44.918 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T06:23:44.958 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:23:45.179 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T06:23:45.194 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T06:23:45.237 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:23:45.303 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T06:23:45.332 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T06:23:45.369 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T06:23:45.582 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T06:23:45.609 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T06:23:45.649 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:23:45.673 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librados2. 2024-09-10T06:23:45.700 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:45.739 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:45.976 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T06:23:46.003 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T06:23:46.043 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T06:23:46.168 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librbd1. 2024-09-10T06:23:46.194 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:46.234 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:46.346 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librados2. 2024-09-10T06:23:46.361 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:46.396 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:46.679 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T06:23:46.705 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:46.745 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:46.840 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librbd1. 2024-09-10T06:23:46.867 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:46.907 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:47.057 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rados. 2024-09-10T06:23:47.072 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:47.115 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:47.351 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T06:23:47.378 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:47.384 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T06:23:47.399 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:23:47.418 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:47.443 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:47.687 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T06:23:47.704 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rados. 2024-09-10T06:23:47.713 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:47.719 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:47.754 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:47.754 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:48.299 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T06:23:48.325 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:23:48.365 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:48.398 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T06:23:48.425 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:23:48.465 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:48.693 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T06:23:48.717 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T06:23:48.720 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T06:23:48.743 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:48.760 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T06:23:48.784 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:49.045 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T06:23:49.047 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T06:23:49.060 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:23:49.073 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T06:23:49.095 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:49.113 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T06:23:49.356 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T06:23:49.374 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T06:23:49.383 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T06:23:49.401 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:49.423 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T06:23:49.441 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:49.734 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T06:23:49.760 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T06:23:49.786 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T06:23:49.801 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T06:23:49.812 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T06:23:49.852 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T06:23:50.070 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T06:23:50.084 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:50.128 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:50.130 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T06:23:50.146 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T06:23:50.189 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T06:23:50.431 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T06:23:50.457 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T06:23:50.489 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T06:23:50.492 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T06:23:50.518 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T06:23:50.558 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T06:23:50.767 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T06:23:50.790 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T06:23:50.833 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T06:23:50.878 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package lua5.1. 2024-09-10T06:23:50.905 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T06:23:50.936 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T06:23:51.137 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T06:23:51.163 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T06:23:51.220 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T06:23:51.257 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package lua-any. 2024-09-10T06:23:51.284 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-10T06:23:51.324 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T06:23:51.507 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua5.1. 2024-09-10T06:23:51.533 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T06:23:51.565 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T06:23:51.568 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package zip. 2024-09-10T06:23:51.594 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-10T06:23:51.634 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T06:23:51.876 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-any. 2024-09-10T06:23:51.887 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package unzip. 2024-09-10T06:23:51.902 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-10T06:23:51.903 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T06:23:51.937 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T06:23:51.942 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T06:23:52.178 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package zip. 2024-09-10T06:23:52.194 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-10T06:23:52.237 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T06:23:52.326 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package luarocks. 2024-09-10T06:23:52.348 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T06:23:52.392 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T06:23:52.515 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package unzip. 2024-09-10T06:23:52.537 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T06:23:52.573 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T06:23:52.767 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librgw2. 2024-09-10T06:23:52.794 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:52.833 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:52.935 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package luarocks. 2024-09-10T06:23:52.962 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T06:23:53.002 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T06:23:53.528 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T06:23:53.544 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:53.578 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:53.593 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package librgw2. 2024-09-10T06:23:53.609 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:53.643 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:53.898 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T06:23:53.924 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T06:23:53.964 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T06:23:54.213 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T06:23:54.228 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:54.267 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T06:23:54.271 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:54.294 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:54.334 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:54.624 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T06:23:54.650 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T06:23:54.690 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T06:23:54.796 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-common. 2024-09-10T06:23:54.823 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:54.862 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:54.960 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T06:23:54.986 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:55.018 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:55.430 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-common. 2024-09-10T06:23:55.457 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:55.497 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:56.360 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-base. 2024-09-10T06:23:56.387 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:56.436 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:56.998 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T06:23:57.002 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-base. 2024-09-10T06:23:57.025 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T06:23:57.028 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:23:57.065 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T06:23:57.078 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:23:57.368 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T06:23:57.395 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T06:23:57.434 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T06:23:57.656 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T06:23:57.683 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T06:23:57.723 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T06:23:57.746 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T06:23:57.772 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T06:23:57.812 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T06:23:58.042 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T06:23:58.069 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T06:23:58.074 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T06:23:58.089 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T06:23:58.108 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T06:23:58.123 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T06:23:58.393 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T06:23:58.420 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T06:23:58.595 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T06:23:58.613 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T06:23:58.621 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T06:23:58.662 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T06:23:58.897 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T06:23:58.923 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T06:23:58.923 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T06:23:58.949 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T06:23:58.963 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T06:23:58.989 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T06:23:59.241 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-portend. 2024-09-10T06:23:59.268 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-10T06:23:59.292 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T06:23:59.308 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T06:23:59.319 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T06:23:59.358 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T06:23:59.611 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T06:23:59.637 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T06:23:59.661 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T06:23:59.677 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T06:23:59.688 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T06:23:59.737 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T06:23:59.948 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T06:23:59.974 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T06:23:59.981 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-portend. 2024-09-10T06:23:59.996 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-10T06:24:00.014 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T06:24:00.031 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T06:24:00.317 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T06:24:00.344 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T06:24:00.360 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T06:24:00.384 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T06:24:00.386 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T06:24:00.426 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T06:24:00.687 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T06:24:00.713 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T06:24:00.721 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T06:24:00.747 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T06:24:00.753 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T06:24:00.787 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T06:24:01.049 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T06:24:01.076 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T06:24:01.107 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T06:24:01.107 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T06:24:01.133 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T06:24:01.195 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T06:24:01.402 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-mako. 2024-09-10T06:24:01.428 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T06:24:01.469 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T06:24:01.510 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T06:24:01.536 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T06:24:01.576 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T06:24:01.805 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T06:24:01.832 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T06:24:01.871 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T06:24:01.881 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T06:24:01.898 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T06:24:01.937 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T06:24:02.167 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T06:24:02.193 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T06:24:02.199 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-mako. 2024-09-10T06:24:02.226 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T06:24:02.233 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T06:24:02.265 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T06:24:02.503 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webob. 2024-09-10T06:24:02.529 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T06:24:02.570 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T06:24:02.585 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T06:24:02.612 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T06:24:02.652 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T06:24:02.915 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T06:24:02.938 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T06:24:02.941 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T06:24:02.965 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T06:24:02.985 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T06:24:03.004 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T06:24:03.249 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webob. 2024-09-10T06:24:03.276 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T06:24:03.276 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T06:24:03.303 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T06:24:03.315 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T06:24:03.343 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T06:24:03.635 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T06:24:03.646 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-paste. 2024-09-10T06:24:03.662 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T06:24:03.673 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T06:24:03.705 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T06:24:03.712 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T06:24:04.024 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T06:24:04.040 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T06:24:04.055 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T06:24:04.082 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T06:24:04.083 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T06:24:04.121 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T06:24:04.369 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T06:24:04.396 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T06:24:04.424 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-paste. 2024-09-10T06:24:04.435 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T06:24:04.451 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T06:24:04.491 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T06:24:04.705 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T06:24:04.732 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T06:24:04.780 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T06:24:04.894 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T06:24:04.921 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T06:24:04.969 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T06:24:05.067 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T06:24:05.094 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T06:24:05.133 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T06:24:05.280 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T06:24:05.307 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T06:24:05.347 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T06:24:05.497 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T06:24:05.524 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T06:24:05.563 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T06:24:05.650 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T06:24:05.677 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T06:24:05.716 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T06:24:05.875 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-idna. 2024-09-10T06:24:05.902 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T06:24:05.942 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T06:24:06.028 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T06:24:06.054 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T06:24:06.094 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T06:24:06.253 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T06:24:06.269 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T06:24:06.303 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T06:24:06.474 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T06:24:06.501 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T06:24:06.541 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T06:24:06.632 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-requests. 2024-09-10T06:24:06.659 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T06:24:06.698 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T06:24:06.868 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-idna. 2024-09-10T06:24:06.884 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T06:24:06.927 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T06:24:06.951 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T06:24:06.966 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T06:24:07.001 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T06:24:07.197 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T06:24:07.212 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T06:24:07.246 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T06:24:07.271 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T06:24:07.297 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:24:07.337 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:07.525 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests. 2024-09-10T06:24:07.551 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T06:24:07.591 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T06:24:07.743 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T06:24:07.770 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:07.810 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:08.495 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T06:24:08.521 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T06:24:08.895 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T06:24:08.913 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T06:24:08.940 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T06:24:09.130 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T06:24:09.190 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T06:24:09.217 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:24:09.256 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:09.417 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T06:24:09.443 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T06:24:09.483 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T06:24:09.644 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T06:24:09.671 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:09.710 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:09.820 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T06:24:09.846 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:09.886 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:09.964 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T06:24:09.990 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T06:24:10.030 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T06:24:10.281 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T06:24:10.308 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:10.316 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T06:24:10.339 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:10.343 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T06:24:10.383 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T06:24:10.719 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T06:24:10.746 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:10.785 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:10.960 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T06:24:10.987 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:11.026 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:11.214 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T06:24:11.241 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:11.281 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:11.951 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T06:24:11.977 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:12.025 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:12.130 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph. 2024-09-10T06:24:12.145 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:12.188 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:12.475 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T06:24:12.502 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:12.533 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:12.911 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T06:24:12.938 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:12.978 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:13.095 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph. 2024-09-10T06:24:13.111 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:13.153 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:13.373 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package cephadm. 2024-09-10T06:24:13.400 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:13.439 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:13.473 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T06:24:13.500 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:13.540 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:13.751 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T06:24:13.777 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T06:24:13.859 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T06:24:13.986 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T06:24:14.013 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:14.059 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:14.145 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T06:24:14.161 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T06:24:14.195 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T06:24:14.471 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package cephadm. 2024-09-10T06:24:14.498 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:14.537 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:14.849 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T06:24:14.875 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T06:24:14.915 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T06:24:15.217 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-babel. 2024-09-10T06:24:15.218 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T06:24:15.234 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T06:24:15.244 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T06:24:15.276 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T06:24:15.284 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T06:24:15.595 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T06:24:15.622 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T06:24:15.662 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T06:24:16.032 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T06:24:16.059 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:24:16.098 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:16.290 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-babel. 2024-09-10T06:24:16.317 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T06:24:16.356 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T06:24:16.435 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T06:24:16.462 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T06:24:16.502 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T06:24:16.684 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T06:24:16.711 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T06:24:16.750 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T06:24:16.805 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-routes. 2024-09-10T06:24:16.832 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T06:24:16.871 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T06:24:17.070 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T06:24:17.097 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:24:17.137 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:17.217 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T06:24:17.244 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:24:17.283 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:17.474 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T06:24:17.501 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T06:24:17.540 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T06:24:17.868 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-routes. 2024-09-10T06:24:17.895 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T06:24:17.934 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T06:24:18.271 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T06:24:18.298 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:24:18.337 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:20.089 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T06:24:20.107 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T06:24:20.139 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T06:24:20.578 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T06:24:20.606 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T06:24:20.644 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T06:24:20.998 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T06:24:21.026 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T06:24:21.065 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T06:24:21.186 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T06:24:21.215 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T06:24:21.252 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T06:24:21.351 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T06:24:21.367 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T06:24:21.401 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T06:24:21.722 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T06:24:21.738 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T06:24:21.772 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T06:24:21.994 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T06:24:22.010 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:24:22.118 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T06:24:22.129 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:22.145 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T06:24:22.184 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T06:24:22.495 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T06:24:22.523 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T06:24:22.562 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T06:24:23.142 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T06:24:23.170 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T06:24:23.208 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T06:24:23.270 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T06:24:23.298 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:24:23.422 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:23.486 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T06:24:23.514 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T06:24:23.553 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T06:24:23.848 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T06:24:23.877 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T06:24:23.906 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T06:24:24.202 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T06:24:24.231 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-10T06:24:24.268 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T06:24:24.385 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T06:24:24.401 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T06:24:24.434 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T06:24:24.606 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T06:24:24.633 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T06:24:24.672 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T06:24:24.737 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T06:24:24.765 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T06:24:24.804 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T06:24:25.001 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T06:24:25.028 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T06:24:25.076 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T06:24:25.149 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T06:24:25.177 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T06:24:25.216 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T06:24:25.371 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T06:24:25.398 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T06:24:25.437 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T06:24:25.527 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T06:24:25.555 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-10T06:24:25.593 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T06:24:25.724 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T06:24:25.751 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T06:24:25.782 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T06:24:25.872 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T06:24:25.900 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T06:24:25.930 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T06:24:26.242 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T06:24:26.270 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T06:24:26.309 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T06:24:26.355 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T06:24:26.371 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:24:26.404 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:26.620 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T06:24:26.648 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T06:24:26.686 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T06:24:26.699 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T06:24:26.727 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T06:24:26.766 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T06:24:26.998 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T06:24:27.014 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T06:24:27.056 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T06:24:27.086 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T06:24:27.114 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T06:24:27.153 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T06:24:27.405 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package jq. 2024-09-10T06:24:27.421 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T06:24:27.455 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T06:24:27.683 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package socat. 2024-09-10T06:24:27.695 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T06:24:27.699 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T06:24:27.723 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:24:27.741 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T06:24:27.761 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:28.045 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T06:24:28.061 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T06:24:28.073 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T06:24:28.100 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T06:24:28.103 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T06:24:28.139 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T06:24:28.458 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-test. 2024-09-10T06:24:28.468 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T06:24:28.483 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:28.495 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T06:24:28.524 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:28.534 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T06:24:28.803 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package jq. 2024-09-10T06:24:28.819 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T06:24:28.861 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T06:24:29.114 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package socat. 2024-09-10T06:24:29.130 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T06:24:29.172 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T06:24:29.609 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T06:24:29.625 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T06:24:29.667 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T06:24:29.996 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-test. 2024-09-10T06:24:30.013 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:30.055 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:31.121 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T06:24:31.149 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:24:31.179 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:31.450 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T06:24:31.478 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:31.508 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:31.811 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T06:24:31.840 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T06:24:31.869 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T06:24:32.175 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T06:24:32.203 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T06:24:32.241 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T06:24:32.551 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T06:24:32.579 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-10T06:24:32.617 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:32.629 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T06:24:32.657 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T06:24:32.695 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T06:24:32.921 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T06:24:32.949 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:32.988 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:33.143 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package pkg-config. 2024-09-10T06:24:33.170 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T06:24:33.209 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T06:24:33.299 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T06:24:33.327 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T06:24:33.374 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T06:24:33.471 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T06:24:33.498 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T06:24:33.537 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T06:24:33.779 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T06:24:33.806 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T06:24:33.845 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T06:24:33.949 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T06:24:33.977 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T06:24:34.015 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T06:24:34.216 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T06:24:34.243 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T06:24:34.282 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T06:24:34.327 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T06:24:34.355 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T06:24:34.393 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T06:24:34.713 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package pkg-config. 2024-09-10T06:24:34.722 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T06:24:34.740 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T06:24:34.750 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T06:24:34.771 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T06:24:34.817 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T06:24:34.999 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T06:24:35.026 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T06:24:35.065 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T06:24:35.292 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T06:24:35.320 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T06:24:35.350 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T06:24:35.410 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T06:24:35.438 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T06:24:35.468 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T06:24:35.678 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-py. 2024-09-10T06:24:35.706 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-10T06:24:35.744 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T06:24:35.771 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T06:24:35.799 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T06:24:35.838 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T06:24:36.032 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T06:24:36.059 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T06:24:36.090 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T06:24:36.158 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T06:24:36.186 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T06:24:36.224 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T06:24:36.494 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T06:24:36.510 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T06:24:36.511 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T06:24:36.527 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T06:24:36.543 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T06:24:36.569 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T06:24:36.880 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-py. 2024-09-10T06:24:36.897 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-toml. 2024-09-10T06:24:36.908 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-10T06:24:36.925 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-10T06:24:36.954 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T06:24:36.963 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T06:24:37.267 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T06:24:37.275 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T06:24:37.295 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T06:24:37.303 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T06:24:37.333 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T06:24:37.350 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T06:24:37.662 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T06:24:37.690 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T06:24:37.729 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T06:24:37.770 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T06:24:37.798 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T06:24:37.837 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T06:24:37.998 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T06:24:38.014 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T06:24:38.048 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T06:24:38.148 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-toml. 2024-09-10T06:24:38.176 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-10T06:24:38.214 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T06:24:38.517 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T06:24:38.545 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T06:24:38.584 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T06:24:38.753 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package radosgw. 2024-09-10T06:24:38.781 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:38.819 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:38.921 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T06:24:38.949 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T06:24:38.987 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T06:24:39.265 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T06:24:39.293 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T06:24:39.331 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T06:24:39.747 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T06:24:39.764 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:39.805 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:40.002 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package radosgw. 2024-09-10T06:24:40.030 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:40.068 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:40.110 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T06:24:40.361 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T06:24:40.487 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T06:24:40.758 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T06:24:40.963 INFO:teuthology.orchestra.run.smithi112.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T06:24:40.979 INFO:teuthology.orchestra.run.smithi112.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-10T06:24:41.021 INFO:teuthology.orchestra.run.smithi112.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:41.125 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T06:24:41.554 INFO:teuthology.orchestra.run.smithi120.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T06:24:41.584 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T06:24:41.630 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:41.827 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T06:24:41.953 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T06:24:42.164 INFO:teuthology.orchestra.run.smithi120.stdout:Adding system user cephadm....done 2024-09-10T06:24:42.187 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T06:24:42.312 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T06:24:42.494 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T06:24:42.580 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T06:24:42.848 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T06:24:42.896 INFO:teuthology.orchestra.run.smithi112.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T06:24:42.962 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:42.974 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T06:24:43.234 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T06:24:43.463 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user cephadm....done 2024-09-10T06:24:43.493 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T06:24:43.619 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T06:24:43.620 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T06:24:43.920 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T06:24:43.921 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T06:24:44.171 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T06:24:44.281 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T06:24:44.290 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T06:24:44.532 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T06:24:44.566 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T06:24:44.783 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T06:24:44.826 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T06:24:44.917 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T06:24:45.078 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T06:24:45.227 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T06:24:45.321 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T06:24:45.580 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T06:24:45.588 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T06:24:45.831 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T06:24:45.915 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:46.115 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T06:24:46.166 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T06:24:46.284 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T06:24:46.375 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T06:24:46.410 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T06:24:46.544 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T06:24:46.635 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T06:24:46.804 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T06:24:46.886 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T06:24:47.137 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:47.198 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T06:24:47.228 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T06:24:47.299 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T06:24:47.388 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T06:24:47.400 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T06:24:47.514 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T06:24:47.640 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T06:24:47.751 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T06:24:47.757 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T06:24:47.878 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T06:24:48.034 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T06:24:48.154 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T06:24:48.422 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T06:24:48.426 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T06:24:48.456 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T06:24:48.520 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T06:24:48.621 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T06:24:48.765 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T06:24:48.891 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T06:24:48.973 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T06:24:49.098 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T06:24:49.358 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T06:24:49.559 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T06:24:49.642 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T06:24:49.827 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T06:24:49.944 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T06:24:49.953 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T06:24:50.069 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T06:24:50.079 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T06:24:50.498 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T06:24:50.721 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T06:24:50.857 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T06:24:50.972 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T06:24:51.091 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T06:24:51.123 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T06:24:51.249 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T06:24:51.460 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T06:24:51.534 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T06:24:51.762 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T06:24:51.919 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T06:24:52.130 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T06:24:52.170 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T06:24:52.406 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T06:24:52.507 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:52.538 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T06:24:52.814 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T06:24:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T06:24:53.118 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T06:24:53.165 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T06:24:53.408 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T06:24:53.518 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:24:53.827 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T06:24:54.153 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T06:24:54.291 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T06:24:54.534 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:24:54.677 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T06:24:54.937 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T06:24:55.079 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T06:24:55.197 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T06:24:55.368 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T06:24:55.474 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T06:24:55.619 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:24:55.733 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T06:24:55.753 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T06:24:55.984 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:24:56.021 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T06:24:56.136 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T06:24:56.147 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T06:24:56.273 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T06:24:56.437 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T06:24:56.558 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T06:24:56.697 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T06:24:56.801 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T06:24:56.948 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T06:24:57.060 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:24:57.186 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T06:24:57.433 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T06:24:57.442 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T06:24:57.487 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T06:24:57.710 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T06:24:57.730 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T06:24:57.844 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T06:24:58.015 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T06:24:58.121 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T06:24:58.247 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T06:24:58.266 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T06:24:58.517 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T06:24:58.531 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T06:24:58.793 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T06:24:58.824 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T06:24:58.919 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T06:24:59.067 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T06:24:59.176 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T06:24:59.195 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T06:24:59.302 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T06:24:59.329 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T06:24:59.393 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T06:24:59.629 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T06:24:59.630 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T06:24:59.755 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T06:24:59.940 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T06:25:00.132 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T06:25:00.191 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T06:25:00.317 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T06:25:00.383 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T06:25:00.443 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T06:25:00.509 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T06:25:00.531 INFO:teuthology.orchestra.run.smithi112.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T06:25:00.769 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:25:00.770 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T06:25:00.895 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T06:25:00.896 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T06:25:01.213 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T06:25:01.281 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T06:25:01.524 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T06:25:01.566 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T06:25:01.676 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T06:25:01.800 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T06:25:01.926 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T06:25:01.935 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T06:25:02.053 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T06:25:02.211 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T06:25:02.379 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T06:25:02.487 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T06:25:02.672 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T06:25:02.833 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T06:25:02.949 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T06:25:03.049 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T06:25:03.193 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T06:25:03.301 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T06:25:03.478 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T06:25:03.560 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T06:25:03.839 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T06:25:03.889 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T06:25:03.948 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:04.058 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:04.184 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T06:25:04.282 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T06:25:04.521 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:04.559 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T06:25:04.647 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:04.773 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T06:25:04.895 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T06:25:05.004 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:05.033 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:05.114 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:05.159 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:05.239 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T06:25:05.296 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:05.512 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T06:25:05.512 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T06:25:05.578 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:05.704 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:05.805 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T06:25:06.006 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:06.082 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:06.115 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:06.191 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:06.216 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:06.292 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:06.342 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T06:25:06.504 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T06:25:06.505 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T06:25:07.293 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:07.420 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:07.537 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:07.546 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:07.647 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T06:25:07.688 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:07.814 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:07.924 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:08.025 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:08.543 INFO:teuthology.orchestra.run.smithi120.stdout:Adding group ceph....done 2024-09-10T06:25:08.901 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:08.910 INFO:teuthology.orchestra.run.smithi120.stdout:Adding system user ceph....done 2024-09-10T06:25:09.043 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:09.096 INFO:teuthology.orchestra.run.smithi120.stdout:Setting system user ceph properties....done 2024-09-10T06:25:09.110 INFO:teuthology.orchestra.run.smithi120.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T06:25:09.178 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:09.243 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T06:25:09.304 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:09.430 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:09.557 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T06:25:09.940 INFO:teuthology.orchestra.run.smithi112.stdout:Adding group ceph....done 2024-09-10T06:25:10.017 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:10.144 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:10.308 INFO:teuthology.orchestra.run.smithi112.stdout:Adding system user ceph....done 2024-09-10T06:25:10.426 INFO:teuthology.orchestra.run.smithi112.stdout:Setting system user ceph properties....done 2024-09-10T06:25:10.439 INFO:teuthology.orchestra.run.smithi112.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T06:25:10.582 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T06:25:10.618 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T06:25:10.618 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T06:25:10.897 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T06:25:11.070 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:11.438 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T06:25:11.687 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:11.892 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:11.897 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:12.122 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T06:25:12.122 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T06:25:12.335 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T06:25:12.335 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T06:25:12.582 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:12.775 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T06:25:12.775 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T06:25:12.890 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:13.235 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T06:25:13.258 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:13.518 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T06:25:13.518 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T06:25:13.700 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:13.940 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T06:25:13.940 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T06:25:13.993 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:14.119 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:14.270 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:14.427 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:14.492 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T06:25:14.493 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T06:25:14.653 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T06:25:14.653 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T06:25:14.971 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:15.106 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:15.111 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:15.215 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:15.374 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:15.378 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T06:25:15.379 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T06:25:15.752 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T06:25:15.855 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:15.861 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T06:25:15.981 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:16.013 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T06:25:16.132 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:16.343 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T06:25:16.343 INFO:teuthology.orchestra.run.smithi112.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T06:25:16.791 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:16.942 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:17.022 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T06:25:17.068 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:17.228 INFO:teuthology.orchestra.run.smithi112.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-10T06:25:17.590 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T06:25:17.656 INFO:teuthology.orchestra.run.smithi120.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T06:25:17.838 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T06:25:17.843 DEBUG:teuthology.parallel:result is None 2024-09-10T06:25:17.860 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T06:25:18.952 INFO:teuthology.orchestra.run.smithi112.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T06:25:19.582 INFO:teuthology.orchestra.run.smithi112.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T06:25:19.587 DEBUG:teuthology.parallel:result is None 2024-09-10T06:25:19.588 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T06:25:19.728 DEBUG:teuthology.orchestra.run.smithi112:> dpkg-query -W -f '${Version}' ceph 2024-09-10T06:25:19.747 INFO:teuthology.orchestra.run.smithi112.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-10T06:25:19.747 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-10T06:25:19.747 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-10T06:25:19.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T06:25:19.886 DEBUG:teuthology.orchestra.run.smithi120:> dpkg-query -W -f '${Version}' ceph 2024-09-10T06:25:19.905 INFO:teuthology.orchestra.run.smithi120.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-10T06:25:19.906 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-10T06:25:19.906 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-10T06:25:19.907 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T06:25:19.908 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:19.908 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T06:25:19.922 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:25:19.922 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T06:25:19.959 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T06:25:19.959 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:19.959 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T06:25:19.977 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T06:25:20.033 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:25:20.033 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T06:25:20.047 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T06:25:20.100 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T06:25:20.100 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:20.100 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T06:25:20.113 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T06:25:20.168 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:25:20.169 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T06:25:20.181 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T06:25:20.235 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T06:25:20.236 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:20.236 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T06:25:20.249 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T06:25:20.304 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:25:20.304 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T06:25:20.317 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T06:25:20.371 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T06:25:20.447 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T06:25:20.447 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 777 /var/log/ceph 2024-09-10T06:25:20.449 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2024-09-10T06:25:20.461 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T06:25:20.462 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T06:25:20.502 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T06:25:20.516 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T06:25:20.516 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T06:25:20.558 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T06:25:20.581 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T06:25:20.581 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T06:25:20.581 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898794', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota}', 'email': None, 'first_in_suite': False, 'job_id': '7898794', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cls-rgw-busy-resharding', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4606, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cls-rgw-busy-resharding', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'targets': {'smithi112.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGHJUhgGjoh0MV3nFiMaQVpelLKTUsdUvO34e4xrAVEasacT2+NFyqNZKvP/w/IbVhHVyRvDIiZlyy8OcjnSAfA=', 'smithi120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPTpTGIPyc6HBtCuLeUnz89paKwWE6HMVjHkuZ7MNSI1jOdABe49Dg6j8qBBBwTW+f4rfSNkE95C1xXoWad5pUM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_user_quota.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_03:24:22', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T06:25:20.582 DEBUG:teuthology.orchestra.run.smithi112:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T06:25:20.614 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T06:25:20.620 DEBUG:teuthology.orchestra.run.smithi112:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T06:25:20.662 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T06:25:20.677 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:20.677 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T06:25:20.726 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T06:25:20.726 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_1 2024-09-10T06:25:20.773 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T06:25:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:25:20.774 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-10T06:25:20.774 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:25:20.774 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-10 06:19:54.477438460 +0000 2024-09-10T06:25:20.774 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-10 06:19:54.205440890 +0000 2024-09-10T06:25:20.774 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-10 06:19:54.205440890 +0000 2024-09-10T06:25:20.774 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-10T06:25:20.774 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T06:25:20.828 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-10T06:25:20.828 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-10T06:25:20.828 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000448817 s, 1.1 MB/s 2024-09-10T06:25:20.830 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T06:25:20.878 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_2 2024-09-10T06:25:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T06:25:20.925 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:25:20.926 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-09-10T06:25:20.926 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:25:20.926 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-10 06:19:54.965434101 +0000 2024-09-10T06:25:20.926 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-10 06:19:54.721436281 +0000 2024-09-10T06:25:20.926 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-10 06:19:54.721436281 +0000 2024-09-10T06:25:20.926 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-10T06:25:20.926 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T06:25:20.980 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-10T06:25:20.980 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-10T06:25:20.980 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000372545 s, 1.4 MB/s 2024-09-10T06:25:20.981 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T06:25:21.035 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_3 2024-09-10T06:25:21.085 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T06:25:21.085 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:25:21.085 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-09-10T06:25:21.085 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:25:21.085 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-10 06:19:55.493429386 +0000 2024-09-10T06:25:21.085 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-10 06:19:55.221431815 +0000 2024-09-10T06:25:21.086 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-10 06:19:55.221431815 +0000 2024-09-10T06:25:21.086 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-10T06:25:21.086 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T06:25:21.139 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-10T06:25:21.139 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-10T06:25:21.139 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000334336 s, 1.5 MB/s 2024-09-10T06:25:21.140 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T06:25:21.186 DEBUG:teuthology.orchestra.run.smithi112:> stat /dev/vg_nvme/lv_4 2024-09-10T06:25:21.233 INFO:teuthology.orchestra.run.smithi112.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T06:25:21.233 INFO:teuthology.orchestra.run.smithi112.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:25:21.233 INFO:teuthology.orchestra.run.smithi112.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-09-10T06:25:21.233 INFO:teuthology.orchestra.run.smithi112.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:25:21.233 INFO:teuthology.orchestra.run.smithi112.stdout:Access: 2024-09-10 06:19:55.993424919 +0000 2024-09-10T06:25:21.233 INFO:teuthology.orchestra.run.smithi112.stdout:Modify: 2024-09-10 06:19:55.729427278 +0000 2024-09-10T06:25:21.234 INFO:teuthology.orchestra.run.smithi112.stdout:Change: 2024-09-10 06:19:55.729427278 +0000 2024-09-10T06:25:21.234 INFO:teuthology.orchestra.run.smithi112.stdout: Birth: - 2024-09-10T06:25:21.234 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T06:25:21.288 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records in 2024-09-10T06:25:21.288 INFO:teuthology.orchestra.run.smithi112.stderr:1+0 records out 2024-09-10T06:25:21.288 INFO:teuthology.orchestra.run.smithi112.stderr:512 bytes copied, 0.000351398 s, 1.5 MB/s 2024-09-10T06:25:21.289 DEBUG:teuthology.orchestra.run.smithi112:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T06:25:21.338 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T06:25:21.338 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:25:21.338 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T06:25:21.344 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T06:25:21.344 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-09-10T06:25:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T06:25:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:25:21.397 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-10T06:25:21.397 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:25:21.397 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-10 06:19:53.022266713 +0000 2024-09-10T06:25:21.397 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-10 06:19:52.778268892 +0000 2024-09-10T06:25:21.397 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-10 06:19:52.778268892 +0000 2024-09-10T06:25:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-10T06:25:21.397 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T06:25:21.455 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-10T06:25:21.455 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-10T06:25:21.455 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000414127 s, 1.2 MB/s 2024-09-10T06:25:21.456 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T06:25:21.505 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-09-10T06:25:21.553 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T06:25:21.553 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:25:21.553 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-10T06:25:21.553 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:25:21.553 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-10 06:19:53.530262176 +0000 2024-09-10T06:25:21.553 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-10 06:19:53.282264391 +0000 2024-09-10T06:25:21.554 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-10 06:19:53.282264391 +0000 2024-09-10T06:25:21.554 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-10T06:25:21.554 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T06:25:21.606 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-10T06:25:21.607 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-10T06:25:21.607 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000420317 s, 1.2 MB/s 2024-09-10T06:25:21.608 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T06:25:21.657 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-09-10T06:25:21.704 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T06:25:21.704 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:25:21.704 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-09-10T06:25:21.704 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:25:21.704 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-10 06:19:54.034257673 +0000 2024-09-10T06:25:21.705 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-10 06:19:53.766260068 +0000 2024-09-10T06:25:21.705 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-10 06:19:53.766260068 +0000 2024-09-10T06:25:21.705 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-10T06:25:21.705 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T06:25:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-10T06:25:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-10T06:25:21.759 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000413296 s, 1.2 MB/s 2024-09-10T06:25:21.760 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T06:25:21.810 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-09-10T06:25:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T06:25:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T06:25:21.857 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 943 Links: 1 2024-09-10T06:25:21.857 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T06:25:21.857 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-09-10 06:19:54.534253208 +0000 2024-09-10T06:25:21.857 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-09-10 06:19:54.278255494 +0000 2024-09-10T06:25:21.857 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-09-10 06:19:54.278255494 +0000 2024-09-10T06:25:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-09-10T06:25:21.857 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T06:25:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-09-10T06:25:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-09-10T06:25:21.910 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000268608 s, 1.9 MB/s 2024-09-10T06:25:21.911 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T06:25:21.962 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T06:25:21.962 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T06:25:21.962 INFO:tasks.ceph:Generating config... 2024-09-10T06:25:21.963 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-09-10T06:25:21.963 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T06:25:21.963 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T06:25:21.963 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T06:25:21.963 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T06:25:21.963 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T06:25:21.963 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T06:25:21.963 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T06:25:21.964 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T06:25:21.964 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T06:25:21.964 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T06:25:21.964 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T06:25:21.964 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T06:25:21.964 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T06:25:21.964 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T06:25:21.964 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T06:25:21.964 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T06:25:21.964 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T06:25:21.964 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T06:25:21.964 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-10T06:25:21.964 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T06:25:21.964 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-10T06:25:21.965 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T06:25:21.965 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-10T06:25:21.965 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T06:25:21.965 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T06:25:22.000 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T06:25:22.017 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T06:25:22.095 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T06:25:22.148 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.112'), ('mon.c', '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]'), ('mon.b', '172.21.15.120')] 2024-09-10T06:25:22.149 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790],172.21.15.120'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-10T06:25:22.150 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:22.150 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T06:25:22.198 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.112 --addv c '[v2:172.21.15.112:3301,v1:172.21.15.112:6790]' --add b 172.21.15.120 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:25:22.283 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:25:22.283 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: generated fsid be773357-a22c-4a27-af42-3fbac58c722b 2024-09-10T06:25:22.283 INFO:teuthology.orchestra.run.smithi112.stdout:setting min_mon_release = quincy 2024-09-10T06:25:22.283 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 0 2024-09-10T06:25:22.283 INFO:teuthology.orchestra.run.smithi112.stdout:fsid be773357-a22c-4a27-af42-3fbac58c722b 2024-09-10T06:25:22.283 INFO:teuthology.orchestra.run.smithi112.stdout:last_changed 2024-09-10T06:25:22.284509+0000 2024-09-10T06:25:22.283 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-10T06:25:22.284509+0000 2024-09-10T06:25:22.283 INFO:teuthology.orchestra.run.smithi112.stdout:min_mon_release 17 (quincy) 2024-09-10T06:25:22.283 INFO:teuthology.orchestra.run.smithi112.stdout:election_strategy: 1 2024-09-10T06:25:22.283 INFO:teuthology.orchestra.run.smithi112.stdout:0: [v2:172.21.15.112:3300/0,v1:172.21.15.112:6789/0] mon.a 2024-09-10T06:25:22.283 INFO:teuthology.orchestra.run.smithi112.stdout:1: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.b 2024-09-10T06:25:22.283 INFO:teuthology.orchestra.run.smithi112.stdout:2: [v2:172.21.15.112:3301/0,v1:172.21.15.112:6790/0] mon.c 2024-09-10T06:25:22.284 INFO:teuthology.orchestra.run.smithi112.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T06:25:22.285 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T06:25:22.333 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID be773357-a22c-4a27-af42-3fbac58c722b... 2024-09-10T06:25:22.334 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T06:25:22.378 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T06:25:22.407 INFO:teuthology.orchestra.run.smithi112.stdout:[global] 2024-09-10T06:25:22.407 INFO:teuthology.orchestra.run.smithi112.stdout: chdir = "" 2024-09-10T06:25:22.407 INFO:teuthology.orchestra.run.smithi112.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T06:25:22.407 INFO:teuthology.orchestra.run.smithi112.stdout: auth supported = cephx 2024-09-10T06:25:22.407 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.408 INFO:teuthology.orchestra.run.smithi112.stdout: filestore xattr use omap = true 2024-09-10T06:25:22.408 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.408 INFO:teuthology.orchestra.run.smithi112.stdout: mon clock drift allowed = 1.000 2024-09-10T06:25:22.408 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.408 INFO:teuthology.orchestra.run.smithi112.stdout: osd crush chooseleaf type = 0 2024-09-10T06:25:22.408 INFO:teuthology.orchestra.run.smithi112.stdout: auth debug = true 2024-09-10T06:25:22.408 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.408 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on old message = true 2024-09-10T06:25:22.408 INFO:teuthology.orchestra.run.smithi112.stdout: ms die on bug = true 2024-09-10T06:25:22.408 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.408 INFO:teuthology.orchestra.run.smithi112.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T06:25:22.408 INFO:teuthology.orchestra.run.smithi112.stdout: mon pg warn max object skew = 0 2024-09-10T06:25:22.408 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T06:25:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T06:25:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default size = 2 2024-09-10T06:25:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow primary affinity = true 2024-09-10T06:25:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd allow pg remap = true 2024-09-10T06:25:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on legacy crush tunables = false 2024-09-10T06:25:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on crush straw calc version zero = false 2024-09-10T06:25:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on no sortbitwise = false 2024-09-10T06:25:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on osd down out interval zero = false 2024-09-10T06:25:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: mon warn on too few osds = false 2024-09-10T06:25:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T06:25:22.409 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T06:25:22.410 INFO:teuthology.orchestra.run.smithi112.stdout: mon_allow_pool_size_one = true 2024-09-10T06:25:22.410 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.410 INFO:teuthology.orchestra.run.smithi112.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T06:25:22.410 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.410 INFO:teuthology.orchestra.run.smithi112.stdout: osd default data pool replay window = 5 2024-09-10T06:25:22.410 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.410 INFO:teuthology.orchestra.run.smithi112.stdout: mon allow pool delete = true 2024-09-10T06:25:22.410 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.410 INFO:teuthology.orchestra.run.smithi112.stdout: mon cluster log file level = debug 2024-09-10T06:25:22.410 INFO:teuthology.orchestra.run.smithi112.stdout: debug asserts on shutdown = true 2024-09-10T06:25:22.410 INFO:teuthology.orchestra.run.smithi112.stdout: mon health detail to clog = false 2024-09-10T06:25:22.410 INFO:teuthology.orchestra.run.smithi112.stdout: mon host = "172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790],172.21.15.120" 2024-09-10T06:25:22.410 INFO:teuthology.orchestra.run.smithi112.stdout: fsid = be773357-a22c-4a27-af42-3fbac58c722b 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout:[osd] 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: osd journal size = 100 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub load threshold = 5.0 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: osd scrub max interval = 600 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: osd mclock profile = high_recovery_ops 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: osd recover clone overlap = true 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: osd recovery max chunk = 1048576 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug shutdown = true 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug op order = true 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug verify stray on activate = true 2024-09-10T06:25:22.411 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug trim objects = true 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: osd open classes on start = true 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug pg log writeout = true 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: osd deep scrub update digest min age = 30 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: osd map max advance = 10 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: journal zero on create = true 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: filestore ondisk finisher threads = 3 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: filestore apply finisher threads = 3 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: bdev debug aio = true 2024-09-10T06:25:22.412 INFO:teuthology.orchestra.run.smithi112.stdout: osd debug misdirected ops = true 2024-09-10T06:25:22.413 INFO:teuthology.orchestra.run.smithi112.stdout: bdev async discard = True 2024-09-10T06:25:22.413 INFO:teuthology.orchestra.run.smithi112.stdout: bdev enable discard = True 2024-09-10T06:25:22.413 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore allocator = bitmap 2024-09-10T06:25:22.413 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore block size = 96636764160 2024-09-10T06:25:22.413 INFO:teuthology.orchestra.run.smithi112.stdout: bluestore fsck on mount = True 2024-09-10T06:25:22.413 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluefs = 1/20 2024-09-10T06:25:22.413 INFO:teuthology.orchestra.run.smithi112.stdout: debug bluestore = 1/20 2024-09-10T06:25:22.413 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-10T06:25:22.413 INFO:teuthology.orchestra.run.smithi112.stdout: debug osd = 20 2024-09-10T06:25:22.413 INFO:teuthology.orchestra.run.smithi112.stdout: debug rocksdb = 4/10 2024-09-10T06:25:22.413 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T06:25:22.413 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd full ratio = 0.9 2024-09-10T06:25:22.413 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd nearfull ratio = 0.8 2024-09-10T06:25:22.413 INFO:teuthology.orchestra.run.smithi112.stdout: osd blocked scrub grace period = 3600 2024-09-10T06:25:22.414 INFO:teuthology.orchestra.run.smithi112.stdout: osd failsafe full ratio = 0.95 2024-09-10T06:25:22.414 INFO:teuthology.orchestra.run.smithi112.stdout: osd max markdown count = 1000 2024-09-10T06:25:22.414 INFO:teuthology.orchestra.run.smithi112.stdout: osd objectstore = bluestore 2024-09-10T06:25:22.414 INFO:teuthology.orchestra.run.smithi112.stdout: osd shutdown pgref assert = True 2024-09-10T06:25:22.414 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.414 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr] 2024-09-10T06:25:22.414 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-10T06:25:22.414 INFO:teuthology.orchestra.run.smithi112.stdout: debug mgr = 20 2024-09-10T06:25:22.414 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-10T06:25:22.414 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-10T06:25:22.414 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-10T06:25:22.414 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-10T06:25:22.414 INFO:teuthology.orchestra.run.smithi112.stdout: mgr/telemetry/nag = false 2024-09-10T06:25:22.414 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.415 INFO:teuthology.orchestra.run.smithi112.stdout:[mon] 2024-09-10T06:25:22.415 INFO:teuthology.orchestra.run.smithi112.stdout: debug ms = 1 2024-09-10T06:25:22.415 INFO:teuthology.orchestra.run.smithi112.stdout: debug mon = 20 2024-09-10T06:25:22.415 INFO:teuthology.orchestra.run.smithi112.stdout: debug paxos = 20 2024-09-10T06:25:22.415 INFO:teuthology.orchestra.run.smithi112.stdout: debug auth = 20 2024-09-10T06:25:22.415 INFO:teuthology.orchestra.run.smithi112.stdout: mon data avail warn = 5 2024-09-10T06:25:22.415 INFO:teuthology.orchestra.run.smithi112.stdout: mon mgr mkfs grace = 240 2024-09-10T06:25:22.415 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min pgs per osd = 4 2024-09-10T06:25:22.415 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd reporter subtree level = osd 2024-09-10T06:25:22.415 INFO:teuthology.orchestra.run.smithi112.stdout: mon osd prime pg temp = true 2024-09-10T06:25:22.415 INFO:teuthology.orchestra.run.smithi112.stdout: mon reweight min bytes per osd = 10 2024-09-10T06:25:22.415 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.415 INFO:teuthology.orchestra.run.smithi112.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T06:25:22.415 INFO:teuthology.orchestra.run.smithi112.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T06:25:22.416 INFO:teuthology.orchestra.run.smithi112.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T06:25:22.416 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.416 INFO:teuthology.orchestra.run.smithi112.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T06:25:22.416 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T06:25:22.416 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T06:25:22.416 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.416 INFO:teuthology.orchestra.run.smithi112.stdout: # 1m isn't quite enough 2024-09-10T06:25:22.416 INFO:teuthology.orchestra.run.smithi112.stdout: mon_down_mkfs_grace = 2m 2024-09-10T06:25:22.416 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.416 INFO:teuthology.orchestra.run.smithi112.stdout: mon_warn_on_filestore_osds = false 2024-09-10T06:25:22.416 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:25:22.416 INFO:teuthology.orchestra.run.smithi112.stdout:[client] 2024-09-10T06:25:22.416 INFO:teuthology.orchestra.run.smithi112.stdout: rgw cache enabled = true 2024-09-10T06:25:22.417 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable ops log = true 2024-09-10T06:25:22.417 INFO:teuthology.orchestra.run.smithi112.stdout: rgw enable usage log = true 2024-09-10T06:25:22.417 INFO:teuthology.orchestra.run.smithi112.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T06:25:22.417 INFO:teuthology.orchestra.run.smithi112.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T06:25:22.417 INFO:teuthology.orchestra.run.smithi112.stdout: rgw relaxed s3 bucket names = True 2024-09-10T06:25:22.417 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.a] 2024-09-10T06:25:22.417 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.c] 2024-09-10T06:25:22.417 INFO:teuthology.orchestra.run.smithi112.stdout:[mon.b] 2024-09-10T06:25:22.417 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2024-09-10T06:25:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2024-09-10T06:25:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T06:25:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2024-09-10T06:25:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2024-09-10T06:25:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2024-09-10T06:25:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2024-09-10T06:25:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2024-09-10T06:25:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2024-09-10T06:25:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2024-09-10T06:25:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T06:25:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2024-09-10T06:25:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T06:25:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T06:25:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2024-09-10T06:25:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2024-09-10T06:25:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2024-09-10T06:25:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2024-09-10T06:25:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: mon_allow_pool_size_one = true 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2024-09-10T06:25:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2024-09-10T06:25:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2024-09-10T06:25:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = "172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790],172.21.15.120" 2024-09-10T06:25:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = be773357-a22c-4a27-af42-3fbac58c722b 2024-09-10T06:25:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.421 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2024-09-10T06:25:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2024-09-10T06:25:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2024-09-10T06:25:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2024-09-10T06:25:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: osd mclock profile = high_recovery_ops 2024-09-10T06:25:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2024-09-10T06:25:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2024-09-10T06:25:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2024-09-10T06:25:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2024-09-10T06:25:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2024-09-10T06:25:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug trim objects = true 2024-09-10T06:25:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2024-09-10T06:25:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2024-09-10T06:25:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2024-09-10T06:25:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2024-09-10T06:25:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2024-09-10T06:25:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2024-09-10T06:25:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2024-09-10T06:25:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2024-09-10T06:25:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2024-09-10T06:25:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: bdev async discard = True 2024-09-10T06:25:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: bdev enable discard = True 2024-09-10T06:25:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore allocator = bitmap 2024-09-10T06:25:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2024-09-10T06:25:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2024-09-10T06:25:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 1/20 2024-09-10T06:25:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 1/20 2024-09-10T06:25:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-10T06:25:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2024-09-10T06:25:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 4/10 2024-09-10T06:25:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T06:25:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2024-09-10T06:25:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2024-09-10T06:25:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: osd blocked scrub grace period = 3600 2024-09-10T06:25:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2024-09-10T06:25:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: osd max markdown count = 1000 2024-09-10T06:25:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2024-09-10T06:25:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: osd shutdown pgref assert = True 2024-09-10T06:25:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.425 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2024-09-10T06:25:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-10T06:25:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2024-09-10T06:25:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-10T06:25:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-10T06:25:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-10T06:25:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-10T06:25:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: mgr/telemetry/nag = false 2024-09-10T06:25:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.425 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2024-09-10T06:25:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-09-10T06:25:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T06:25:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: # 1m isn't quite enough 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: mon_down_mkfs_grace = 2m 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_filestore_osds = false 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = true 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: rgw relaxed s3 bucket names = True 2024-09-10T06:25:22.427 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2024-09-10T06:25:22.428 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.c] 2024-09-10T06:25:22.428 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.b] 2024-09-10T06:25:22.429 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T06:25:22.429 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T06:25:22.520 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T06:25:22.520 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:22.520 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T06:25:22.526 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:22.526 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T06:25:22.573 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T06:25:22.574 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:22.574 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T06:25:22.574 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T06:25:22.638 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:22.638 DEBUG:teuthology.orchestra.run.smithi112:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:25:22.685 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2024-09-10T06:25:22.685 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:25:22.686 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T06:25:22.686 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T06:25:22.709 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:25:22.709 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:25:22.757 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T06:25:22.757 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T06:25:22.757 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T06:25:22.801 INFO:teuthology.orchestra.run.smithi112.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T06:25:22.804 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T06:25:22.849 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T06:25:22.859 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T06:25:22.859 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T06:25:22.859 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T06:25:22.894 INFO:teuthology.orchestra.run.smithi112.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T06:25:22.905 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T06:25:22.939 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T06:25:22.951 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T06:25:22.951 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi112.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T06:25:22.951 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T06:25:22.966 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T06:25:22.966 INFO:tasks.ceph:role: osd.0 2024-09-10T06:25:22.966 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T06:25:22.967 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T06:25:23.030 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T06:25:23.030 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T06:25:23.030 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T06:25:23.031 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T06:25:23.031 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T06:25:23.031 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-10T06:25:23.031 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T06:25:23.031 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T06:25:23.031 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T06:25:23.031 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T06:25:23.477 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-10T06:25:23.480 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-10T06:25:23.480 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T06:25:23.581 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T06:25:23.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:25:23.592 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T06:25:23.593 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T06:25:23.648 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T06:25:23.648 INFO:tasks.ceph:role: osd.1 2024-09-10T06:25:23.648 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T06:25:23.648 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T06:25:23.709 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T06:25:23.709 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T06:25:23.709 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T06:25:23.709 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T06:25:23.709 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T06:25:23.710 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-10T06:25:23.710 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T06:25:23.710 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T06:25:23.710 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T06:25:23.710 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T06:25:24.174 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-10T06:25:24.177 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-10T06:25:24.177 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T06:25:24.346 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T06:25:24.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:25:24.359 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T06:25:24.359 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T06:25:24.412 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T06:25:24.412 INFO:tasks.ceph:role: osd.2 2024-09-10T06:25:24.412 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T06:25:24.413 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T06:25:24.477 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T06:25:24.477 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T06:25:24.477 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T06:25:24.477 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T06:25:24.477 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T06:25:24.477 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-10T06:25:24.477 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T06:25:24.477 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T06:25:24.477 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T06:25:24.477 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T06:25:24.960 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-10T06:25:24.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-10T06:25:24.961 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T06:25:25.099 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T06:25:25.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:25:25.111 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T06:25:25.111 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T06:25:25.164 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T06:25:25.165 INFO:tasks.ceph:role: osd.3 2024-09-10T06:25:25.165 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T06:25:25.165 DEBUG:teuthology.orchestra.run.smithi112:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T06:25:25.231 INFO:teuthology.orchestra.run.smithi112.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T06:25:25.231 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T06:25:25.231 INFO:teuthology.orchestra.run.smithi112.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T06:25:25.231 INFO:teuthology.orchestra.run.smithi112.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T06:25:25.231 INFO:teuthology.orchestra.run.smithi112.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T06:25:25.231 INFO:teuthology.orchestra.run.smithi112.stdout: = sunit=0 swidth=0 blks 2024-09-10T06:25:25.231 INFO:teuthology.orchestra.run.smithi112.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T06:25:25.231 INFO:teuthology.orchestra.run.smithi112.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T06:25:25.232 INFO:teuthology.orchestra.run.smithi112.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T06:25:25.232 INFO:teuthology.orchestra.run.smithi112.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T06:25:25.665 INFO:teuthology.orchestra.run.smithi112.stdout:Discarding blocks...Done. 2024-09-10T06:25:25.667 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi112.front.sepia.ceph.com -o noatime 2024-09-10T06:25:25.667 DEBUG:teuthology.orchestra.run.smithi112:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T06:25:25.747 DEBUG:teuthology.orchestra.run.smithi112:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T06:25:25.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:25:25.798 INFO:teuthology.orchestra.run.smithi112.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T06:25:25.799 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:25:25.912 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:25.909+0000 7f3c6d7be7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T06:25:25.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:25.909+0000 7f3c6d7be7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T06:25:25.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:25.909+0000 7f3c6d7be7c0 -1 bdev(0x55f89e56f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T06:25:25.913 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:25.909+0000 7f3c6d7be7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T06:25:29.045 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T06:25:29.058 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:25:29.140 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:29.137+0000 7f0e7efe57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T06:25:29.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:29.141+0000 7f0e7efe57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T06:25:29.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:29.141+0000 7f0e7efe57c0 -1 bdev(0x55c1ff663800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T06:25:29.141 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:29.141+0000 7f0e7efe57c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T06:25:32.304 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T06:25:32.361 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:25:32.444 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:32.445+0000 7f0b591117c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T06:25:32.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:32.445+0000 7f0b591117c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T06:25:32.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:32.445+0000 7f0b591117c0 -1 bdev(0x55f5a759f800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T06:25:32.445 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:32.445+0000 7f0b591117c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T06:25:35.596 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T06:25:35.654 DEBUG:teuthology.orchestra.run.smithi112:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:25:35.735 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:35.733+0000 7f0c0b6777c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T06:25:35.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:35.733+0000 7f0c0b6777c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T06:25:35.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:35.733+0000 7f0c0b6777c0 -1 bdev(0x555a5b0f5800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T06:25:35.736 INFO:teuthology.orchestra.run.smithi112.stderr:2024-09-10T06:25:35.733+0000 7f0c0b6777c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T06:25:38.908 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T06:25:38.965 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T06:25:38.980 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T06:25:38.980 INFO:tasks.ceph:role: osd.4 2024-09-10T06:25:38.980 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-10T06:25:38.980 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T06:25:39.043 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T06:25:39.043 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T06:25:39.043 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T06:25:39.043 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T06:25:39.043 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T06:25:39.043 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-10T06:25:39.043 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T06:25:39.043 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T06:25:39.043 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T06:25:39.043 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T06:25:39.528 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-10T06:25:39.530 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-10T06:25:39.530 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T06:25:39.667 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T06:25:39.679 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T06:25:39.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:25:39.680 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T06:25:39.735 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T06:25:39.735 INFO:tasks.ceph:role: osd.5 2024-09-10T06:25:39.735 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-10T06:25:39.736 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T06:25:39.800 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T06:25:39.800 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T06:25:39.800 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T06:25:39.800 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T06:25:39.800 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T06:25:39.800 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-10T06:25:39.800 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T06:25:39.800 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T06:25:39.800 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T06:25:39.800 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T06:25:40.256 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-10T06:25:40.258 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-10T06:25:40.258 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T06:25:40.341 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T06:25:40.395 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T06:25:40.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:25:40.396 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T06:25:40.449 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T06:25:40.449 INFO:tasks.ceph:role: osd.6 2024-09-10T06:25:40.449 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-10T06:25:40.450 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T06:25:40.510 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T06:25:40.510 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T06:25:40.510 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T06:25:40.510 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T06:25:40.510 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T06:25:40.510 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-10T06:25:40.510 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T06:25:40.510 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T06:25:40.510 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T06:25:40.510 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T06:25:40.969 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-10T06:25:40.971 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-10T06:25:40.971 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T06:25:41.104 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T06:25:41.115 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T06:25:41.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:25:41.116 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T06:25:41.171 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T06:25:41.171 INFO:tasks.ceph:role: osd.7 2024-09-10T06:25:41.172 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-10T06:25:41.172 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T06:25:41.236 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T06:25:41.236 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T06:25:41.236 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T06:25:41.236 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T06:25:41.236 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T06:25:41.236 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-09-10T06:25:41.237 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T06:25:41.237 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T06:25:41.237 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T06:25:41.237 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T06:25:41.754 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2024-09-10T06:25:41.756 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-09-10T06:25:41.756 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T06:25:41.881 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T06:25:41.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:25:41.891 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T06:25:41.891 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:25:42.121 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:42.120+0000 7f55bb5f07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T06:25:42.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:42.124+0000 7f55bb5f07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T06:25:42.125 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:42.124+0000 7f55bb5f07c0 -1 bdev(0x55f26a057800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T06:25:42.126 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:42.124+0000 7f55bb5f07c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T06:25:45.319 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T06:25:45.333 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:25:45.414 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:45.412+0000 7f32a99c37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T06:25:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:45.412+0000 7f32a99c37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T06:25:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:45.412+0000 7f32a99c37c0 -1 bdev(0x555bf69d1800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T06:25:45.415 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:45.416+0000 7f32a99c37c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T06:25:48.546 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T06:25:48.601 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:25:48.682 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:48.680+0000 7f2e23fcf7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T06:25:48.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:48.680+0000 7f2e23fcf7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T06:25:48.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:48.680+0000 7f2e23fcf7c0 -1 bdev(0x558d69303800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T06:25:48.683 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:48.680+0000 7f2e23fcf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T06:25:51.824 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T06:25:51.880 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:25:51.960 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:51.960+0000 7f08de66b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T06:25:51.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:51.960+0000 7f08de66b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T06:25:51.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:51.960+0000 7f08de66b7c0 -1 bdev(0x55d77a4ed800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T06:25:51.961 INFO:teuthology.orchestra.run.smithi120.stderr:2024-09-10T06:25:51.960+0000 7f08de66b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T06:25:55.111 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T06:25:55.167 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T06:25:55.168 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:55.168 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T06:25:55.186 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:55.186 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T06:25:55.240 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:55.240 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T06:25:55.295 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:55.296 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T06:25:55.352 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:55.352 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T06:25:55.409 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:25:55.409 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T06:25:55.422 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:25:55.422 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T06:25:55.475 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:25:55.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T06:25:55.531 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:25:55.531 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T06:25:55.587 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:25:55.588 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T06:25:55.644 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:25:55.644 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T06:25:55.650 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:25:55.650 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T06:25:55.692 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T06:25:55.692 DEBUG:teuthology.orchestra.run.smithi112:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T06:25:55.694 DEBUG:teuthology.orchestra.run.smithi120:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T06:25:55.737 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.y] 2024-09-10T06:25:55.738 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBS5t9mWTreLxAA1dgEFMKc5necKqiobudraw== 2024-09-10T06:25:55.738 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.0] 2024-09-10T06:25:55.738 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBV5t9m8JhVNhAALMYIg1klLxhgqtGazRTqgA== 2024-09-10T06:25:55.738 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.1] 2024-09-10T06:25:55.738 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBZ5t9mpEJ7CBAAfVAcs1G1BuJzaYcUO+huWQ== 2024-09-10T06:25:55.738 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.2] 2024-09-10T06:25:55.738 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBc5t9mIn+eGhAAmnphvchvMMyhfRzsX5RsNA== 2024-09-10T06:25:55.738 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.3] 2024-09-10T06:25:55.738 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBf5t9m3znwKxAAbceykxBKl2zwL4vbw2GpPw== 2024-09-10T06:25:55.738 INFO:teuthology.orchestra.run.smithi112.stdout:[mgr.x] 2024-09-10T06:25:55.738 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBS5t9mbq6+MhAAE5mrhvy+d7BJO1Gr9hO3rA== 2024-09-10T06:25:55.738 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.4] 2024-09-10T06:25:55.739 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBm5t9mUgpjBxAASpxFZDljZxIFAbtk6hzZ1Q== 2024-09-10T06:25:55.739 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.5] 2024-09-10T06:25:55.739 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBp5t9mzzXbGBAA3aA888PSzmEIc4el7BQf5w== 2024-09-10T06:25:55.739 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.6] 2024-09-10T06:25:55.739 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBs5t9m29bRKBAAixNB+R8XjAfB0aIMqdgyBg== 2024-09-10T06:25:55.739 INFO:teuthology.orchestra.run.smithi112.stdout:[osd.7] 2024-09-10T06:25:55.739 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBv5t9m2+tiORAA6RK8GR5/RqS7WBE1bFrYmw== 2024-09-10T06:25:55.739 INFO:teuthology.orchestra.run.smithi112.stdout:[client.0] 2024-09-10T06:25:55.739 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBS5t9m2KRwNRAAabs/syhOWErRPjdonlA/0A== 2024-09-10T06:25:55.739 INFO:teuthology.orchestra.run.smithi112.stdout:[client.1] 2024-09-10T06:25:55.739 INFO:teuthology.orchestra.run.smithi112.stdout: key = AQBS5t9mXiskOBAAPnKKfv0wCpXzftjlvR8lRA== 2024-09-10T06:25:55.745 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.y] 2024-09-10T06:25:55.745 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBS5t9mWTreLxAA1dgEFMKc5necKqiobudraw== 2024-09-10T06:25:55.746 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.0] 2024-09-10T06:25:55.746 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBV5t9m8JhVNhAALMYIg1klLxhgqtGazRTqgA== 2024-09-10T06:25:55.746 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.1] 2024-09-10T06:25:55.746 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBZ5t9mpEJ7CBAAfVAcs1G1BuJzaYcUO+huWQ== 2024-09-10T06:25:55.746 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.2] 2024-09-10T06:25:55.746 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBc5t9mIn+eGhAAmnphvchvMMyhfRzsX5RsNA== 2024-09-10T06:25:55.746 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.3] 2024-09-10T06:25:55.746 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBf5t9m3znwKxAAbceykxBKl2zwL4vbw2GpPw== 2024-09-10T06:25:55.746 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.x] 2024-09-10T06:25:55.746 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBS5t9mbq6+MhAAE5mrhvy+d7BJO1Gr9hO3rA== 2024-09-10T06:25:55.746 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.4] 2024-09-10T06:25:55.746 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBm5t9mUgpjBxAASpxFZDljZxIFAbtk6hzZ1Q== 2024-09-10T06:25:55.746 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.5] 2024-09-10T06:25:55.746 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBp5t9mzzXbGBAA3aA888PSzmEIc4el7BQf5w== 2024-09-10T06:25:55.747 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.6] 2024-09-10T06:25:55.747 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBs5t9m29bRKBAAixNB+R8XjAfB0aIMqdgyBg== 2024-09-10T06:25:55.747 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.7] 2024-09-10T06:25:55.747 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBv5t9m2+tiORAA6RK8GR5/RqS7WBE1bFrYmw== 2024-09-10T06:25:55.747 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-09-10T06:25:55.747 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBS5t9m2KRwNRAAabs/syhOWErRPjdonlA/0A== 2024-09-10T06:25:55.747 INFO:teuthology.orchestra.run.smithi120.stdout:[client.1] 2024-09-10T06:25:55.747 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBS5t9mXiskOBAAPnKKfv0wCpXzftjlvR8lRA== 2024-09-10T06:25:55.748 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T06:25:55.786 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T06:25:55.836 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:55.838 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:55.880 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:55.925 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:55.970 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:56.009 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:56.052 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:56.097 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:56.141 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T06:25:56.143 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T06:25:56.219 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:56.221 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:56.307 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:56.310 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:56.395 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:56.398 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:56.484 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:56.486 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T06:25:56.568 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T06:25:56.570 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T06:25:56.659 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T06:25:56.661 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T06:25:56.707 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T06:25:56.707 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T06:25:56.718 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T06:25:56.809 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T06:25:56.819 DEBUG:teuthology.orchestra.run.smithi112:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T06:25:56.869 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T06:25:56.959 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T06:25:56.969 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T06:25:56.983 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T06:25:57.079 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T06:25:57.090 DEBUG:teuthology.orchestra.run.smithi112:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:25:57.093 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T06:25:57.138 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T06:25:57.139 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T06:25:57.139 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T06:25:57.141 INFO:tasks.ceph.mon.a:Started 2024-09-10T06:25:57.141 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T06:25:57.141 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T06:25:57.144 INFO:tasks.ceph.mon.c:Started 2024-09-10T06:25:57.144 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T06:25:57.144 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T06:25:57.185 INFO:tasks.ceph.mon.b:Started 2024-09-10T06:25:57.185 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T06:25:57.185 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T06:25:57.185 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T06:25:57.187 INFO:tasks.ceph.mgr.y:Started 2024-09-10T06:25:57.188 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T06:25:57.188 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T06:25:57.190 INFO:tasks.ceph.mgr.x:Started 2024-09-10T06:25:57.190 DEBUG:tasks.ceph:set 0 configs 2024-09-10T06:25:57.190 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T06:25:57.190 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T06:26:03.387 INFO:teuthology.orchestra.run.smithi112.stderr:adjusted tunables profile to default 2024-09-10T06:26:03.404 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T06:26:03.404 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T06:26:03.405 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:26:03.405 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T06:26:03.415 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:26:03.415 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T06:26:03.465 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:26:03.465 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T06:26:03.516 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:26:03.517 DEBUG:teuthology.orchestra.run.smithi112:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T06:26:03.569 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:26:03.569 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T06:26:03.583 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:26:03.583 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T06:26:03.638 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:26:03.638 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T06:26:03.690 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-09-10T06:26:03.691 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T06:26:03.743 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 27b822ad-8298-4dd0-be44-f898fd6b155b 0 2024-09-10T06:26:04.013 INFO:teuthology.orchestra.run.smithi120.stdout:0 2024-09-10T06:26:04.032 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 68108054-a914-4f7c-a6dd-1e8a2775cff0 1 2024-09-10T06:26:04.246 INFO:teuthology.orchestra.run.smithi120.stdout:1 2024-09-10T06:26:04.263 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 0b12ab6c-743b-446a-92de-3d7722320117 2 2024-09-10T06:26:04.463 INFO:teuthology.orchestra.run.smithi120.stdout:2 2024-09-10T06:26:04.479 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new a468aa3a-22fb-414c-9e7c-fbe79ae3eafd 3 2024-09-10T06:26:04.671 INFO:teuthology.orchestra.run.smithi120.stdout:3 2024-09-10T06:26:04.687 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new e64b5d77-9d7c-4d5f-8ad6-91d3e77d5479 4 2024-09-10T06:26:04.883 INFO:teuthology.orchestra.run.smithi120.stdout:4 2024-09-10T06:26:04.900 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new bdcce7db-9a36-423b-9a96-368a4a6b6270 5 2024-09-10T06:26:05.100 INFO:teuthology.orchestra.run.smithi120.stdout:5 2024-09-10T06:26:05.116 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 8eedb98d-014b-4f07-a704-a4b01e8002cb 6 2024-09-10T06:26:05.304 INFO:teuthology.orchestra.run.smithi120.stdout:6 2024-09-10T06:26:05.321 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd new 72eece21-94cd-4ed1-9f02-4d2d1edaf136 7 2024-09-10T06:26:05.500 INFO:tasks.ceph.mgr.y.smithi112.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T06:26:05.500 INFO:tasks.ceph.mgr.y.smithi112.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T06:26:05.500 INFO:tasks.ceph.mgr.y.smithi112.stderr: from numpy import show_config as show_numpy_config 2024-09-10T06:26:05.515 INFO:teuthology.orchestra.run.smithi120.stdout:7 2024-09-10T06:26:05.531 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T06:26:05.531 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T06:26:05.533 INFO:tasks.ceph.osd.0:Started 2024-09-10T06:26:05.534 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T06:26:05.534 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T06:26:05.536 INFO:tasks.ceph.osd.1:Started 2024-09-10T06:26:05.536 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T06:26:05.536 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T06:26:05.539 INFO:tasks.ceph.osd.2:Started 2024-09-10T06:26:05.539 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T06:26:05.539 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T06:26:05.542 INFO:tasks.ceph.osd.3:Started 2024-09-10T06:26:05.542 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T06:26:05.542 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T06:26:05.544 INFO:tasks.ceph.osd.4:Started 2024-09-10T06:26:05.544 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T06:26:05.544 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T06:26:05.546 INFO:tasks.ceph.osd.5:Started 2024-09-10T06:26:05.546 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T06:26:05.546 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T06:26:05.550 INFO:tasks.ceph.osd.6:Started 2024-09-10T06:26:05.550 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T06:26:05.550 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T06:26:05.552 INFO:tasks.ceph.osd.7:Started 2024-09-10T06:26:05.552 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T06:26:05.758 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:26:05.758 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":10,"fsid":"be773357-a22c-4a27-af42-3fbac58c722b","created":"2024-09-10T06:26:02.514361+0000","modified":"2024-09-10T06:26:05.513752+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T06:26:05.513752+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"27b822ad-8298-4dd0-be44-f898fd6b155b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"68108054-a914-4f7c-a6dd-1e8a2775cff0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0b12ab6c-743b-446a-92de-3d7722320117","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a468aa3a-22fb-414c-9e7c-fbe79ae3eafd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e64b5d77-9d7c-4d5f-8ad6-91d3e77d5479","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bdcce7db-9a36-423b-9a96-368a4a6b6270","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8eedb98d-014b-4f07-a704-a4b01e8002cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"72eece21-94cd-4ed1-9f02-4d2d1edaf136","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:26:05.774 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T06:26:05.774 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T06:26:06.265 INFO:tasks.ceph.mgr.x.smithi120.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T06:26:06.265 INFO:tasks.ceph.mgr.x.smithi120.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T06:26:06.265 INFO:tasks.ceph.mgr.x.smithi120.stderr: from numpy import show_config as show_numpy_config 2024-09-10T06:26:06.581 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T06:26:06.708 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:06.708+0000 7fa7af2747c0 -1 Falling back to public interface 2024-09-10T06:26:06.762 INFO:teuthology.misc.health.smithi112.stdout: 2024-09-10T06:26:06.763 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":10,"fsid":"be773357-a22c-4a27-af42-3fbac58c722b","created":"2024-09-10T06:26:02.514361+0000","modified":"2024-09-10T06:26:05.513752+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T06:26:05.513752+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"27b822ad-8298-4dd0-be44-f898fd6b155b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"68108054-a914-4f7c-a6dd-1e8a2775cff0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0b12ab6c-743b-446a-92de-3d7722320117","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a468aa3a-22fb-414c-9e7c-fbe79ae3eafd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e64b5d77-9d7c-4d5f-8ad6-91d3e77d5479","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bdcce7db-9a36-423b-9a96-368a4a6b6270","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8eedb98d-014b-4f07-a704-a4b01e8002cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"72eece21-94cd-4ed1-9f02-4d2d1edaf136","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:26:06.778 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T06:26:06.914 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:06.912+0000 7fab12a777c0 -1 Falling back to public interface 2024-09-10T06:26:06.936 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:26:06.936+0000 7f9839f6f7c0 -1 Falling back to public interface 2024-09-10T06:26:06.984 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:26:06.984+0000 7fba19eeb7c0 -1 Falling back to public interface 2024-09-10T06:26:07.008 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:07.008+0000 7fee72d0f7c0 -1 Falling back to public interface 2024-09-10T06:26:07.202 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:07.200+0000 7f4e257637c0 -1 Falling back to public interface 2024-09-10T06:26:07.236 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:26:07.236+0000 7fae30e6d7c0 -1 Falling back to public interface 2024-09-10T06:26:07.244 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:26:07.244+0000 7f939dcd27c0 -1 Falling back to public interface 2024-09-10T06:26:08.419 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-10T06:26:08.416+0000 7f00aadd0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T06:26:08.419 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-10T06:26:08.416+0000 7f00aadd0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T06:26:10.705 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:10.704+0000 7fa7af2747c0 -1 osd.5 0 log_to_monitors true 2024-09-10T06:26:11.046 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:11.044+0000 7fee72d0f7c0 -1 osd.6 0 log_to_monitors true 2024-09-10T06:26:11.050 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:26:11.048+0000 7f9839f6f7c0 -1 osd.2 0 log_to_monitors true 2024-09-10T06:26:11.063 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:26:11.064+0000 7fba19eeb7c0 -1 osd.4 0 log_to_monitors true 2024-09-10T06:26:11.213 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:11.212+0000 7f4e257637c0 -1 osd.0 0 log_to_monitors true 2024-09-10T06:26:11.239 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:26:11.240+0000 7f939dcd27c0 -1 osd.7 0 log_to_monitors true 2024-09-10T06:26:11.327 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:11.324+0000 7fab12a777c0 -1 osd.3 0 log_to_monitors true 2024-09-10T06:26:11.668 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:26:11.668+0000 7fae30e6d7c0 -1 osd.1 0 log_to_monitors true 2024-09-10T06:26:13.585 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T06:26:14.252 INFO:teuthology.misc.health.smithi112.stdout: 2024-09-10T06:26:14.252 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":13,"fsid":"be773357-a22c-4a27-af42-3fbac58c722b","created":"2024-09-10T06:26:02.514361+0000","modified":"2024-09-10T06:26:13.570432+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T06:26:05.513752+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"27b822ad-8298-4dd0-be44-f898fd6b155b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"68108054-a914-4f7c-a6dd-1e8a2775cff0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0b12ab6c-743b-446a-92de-3d7722320117","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a468aa3a-22fb-414c-9e7c-fbe79ae3eafd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e64b5d77-9d7c-4d5f-8ad6-91d3e77d5479","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bdcce7db-9a36-423b-9a96-368a4a6b6270","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8eedb98d-014b-4f07-a704-a4b01e8002cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"72eece21-94cd-4ed1-9f02-4d2d1edaf136","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:26:14.277 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T06:26:14.389 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:14.388+0000 7f4e2170c640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T06:26:14.414 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:26:14.412+0000 7f9835f18640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T06:26:14.419 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:14.416+0000 7f4e1953e640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T06:26:14.457 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:26:14.456+0000 7f982dd4a640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T06:26:14.459 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:14.456+0000 7fab0ea20640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T06:26:14.502 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:14.500+0000 7fab06852640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T06:26:14.709 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:14.708+0000 7fee6f4ca640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T06:26:14.719 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:14.720+0000 7fa7aba2f640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T06:26:14.722 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:26:14.720+0000 7f9399c7b640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T06:26:14.728 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:26:14.728+0000 7fba166a6640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T06:26:14.735 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:14.736+0000 7fee66aea640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T06:26:14.747 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:26:14.748+0000 7f9391aad640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T06:26:14.759 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:26:14.760+0000 7fba0dcc6640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T06:26:14.759 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:14.760+0000 7fa7a304f640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T06:26:14.817 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:26:14.816+0000 7fae2ce16640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T06:26:14.836 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:26:14.836+0000 7fae24c48640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T06:26:21.084 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T06:26:21.388 INFO:teuthology.misc.health.smithi112.stdout: 2024-09-10T06:26:21.388 INFO:teuthology.misc.health.smithi112.stdout:{"epoch":17,"fsid":"be773357-a22c-4a27-af42-3fbac58c722b","created":"2024-09-10T06:26:02.514361+0000","modified":"2024-09-10T06:26:18.435860+0000","last_up_change":"2024-09-10T06:26:15.419770+0000","last_in_change":"2024-09-10T06:26:05.513752+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T06:26:15.461819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27b822ad-8298-4dd0-be44-f898fd6b155b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6817","nonce":1694936705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6819","nonce":1694936705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6823","nonce":1694936705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6821","nonce":1694936705}]},"public_addr":"172.21.15.112:6817/1694936705","cluster_addr":"172.21.15.112:6819/1694936705","heartbeat_back_addr":"172.21.15.112:6823/1694936705","heartbeat_front_addr":"172.21.15.112:6821/1694936705","state":["exists","up"]},{"osd":1,"uuid":"68108054-a914-4f7c-a6dd-1e8a2775cff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6825","nonce":3700063340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6827","nonce":3700063340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6831","nonce":3700063340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6829","nonce":3700063340}]},"public_addr":"172.21.15.112:6825/3700063340","cluster_addr":"172.21.15.112:6827/3700063340","heartbeat_back_addr":"172.21.15.112:6831/3700063340","heartbeat_front_addr":"172.21.15.112:6829/3700063340","state":["exists","up"]},{"osd":2,"uuid":"0b12ab6c-743b-446a-92de-3d7722320117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6809","nonce":3923792425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6811","nonce":3923792425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6815","nonce":3923792425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6813","nonce":3923792425}]},"public_addr":"172.21.15.112:6809/3923792425","cluster_addr":"172.21.15.112:6811/3923792425","heartbeat_back_addr":"172.21.15.112:6815/3923792425","heartbeat_front_addr":"172.21.15.112:6813/3923792425","state":["exists","up"]},{"osd":3,"uuid":"a468aa3a-22fb-414c-9e7c-fbe79ae3eafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6801","nonce":3428884615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6803","nonce":3428884615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6807","nonce":3428884615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6805","nonce":3428884615}]},"public_addr":"172.21.15.112:6801/3428884615","cluster_addr":"172.21.15.112:6803/3428884615","heartbeat_back_addr":"172.21.15.112:6807/3428884615","heartbeat_front_addr":"172.21.15.112:6805/3428884615","state":["exists","up"]},{"osd":4,"uuid":"e64b5d77-9d7c-4d5f-8ad6-91d3e77d5479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6809","nonce":4200633864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6811","nonce":4200633864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6815","nonce":4200633864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6813","nonce":4200633864}]},"public_addr":"172.21.15.120:6809/4200633864","cluster_addr":"172.21.15.120:6811/4200633864","heartbeat_back_addr":"172.21.15.120:6815/4200633864","heartbeat_front_addr":"172.21.15.120:6813/4200633864","state":["exists","up"]},{"osd":5,"uuid":"bdcce7db-9a36-423b-9a96-368a4a6b6270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6801","nonce":1878513652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6803","nonce":1878513652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6807","nonce":1878513652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6805","nonce":1878513652}]},"public_addr":"172.21.15.120:6801/1878513652","cluster_addr":"172.21.15.120:6803/1878513652","heartbeat_back_addr":"172.21.15.120:6807/1878513652","heartbeat_front_addr":"172.21.15.120:6805/1878513652","state":["exists","up"]},{"osd":6,"uuid":"8eedb98d-014b-4f07-a704-a4b01e8002cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6817","nonce":663776414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6819","nonce":663776414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6823","nonce":663776414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6821","nonce":663776414}]},"public_addr":"172.21.15.120:6817/663776414","cluster_addr":"172.21.15.120:6819/663776414","heartbeat_back_addr":"172.21.15.120:6823/663776414","heartbeat_front_addr":"172.21.15.120:6821/663776414","state":["exists","up"]},{"osd":7,"uuid":"72eece21-94cd-4ed1-9f02-4d2d1edaf136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6825","nonce":4213847863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6827","nonce":4213847863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6831","nonce":4213847863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6829","nonce":4213847863}]},"public_addr":"172.21.15.120:6825/4213847863","cluster_addr":"172.21.15.120:6827/4213847863","heartbeat_back_addr":"172.21.15.120:6831/4213847863","heartbeat_front_addr":"172.21.15.120:6829/4213847863","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.186913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.656858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.014588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.353407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.086903+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:11.731547+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.034165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.207613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:26:21.406 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T06:26:21.406 INFO:tasks.ceph:Creating RBD pool 2024-09-10T06:26:21.406 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-10T06:26:22.479 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'rbd' created 2024-09-10T06:26:22.503 DEBUG:teuthology.orchestra.run.smithi112:> rbd --cluster ceph pool init rbd 2024-09-10T06:26:25.553 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T06:26:25.554 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T06:26:25.555 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T06:26:25.868 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:26:25.885 INFO:teuthology.orchestra.run.smithi112.stdout:[{"version":9,"timestamp":"2024-09-10T06:26:14.819294+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"6846.924007"}]}] 2024-09-10T06:26:25.887 INFO:tasks.ceph_manager:config epoch is 9 2024-09-10T06:26:25.888 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T06:26:25.888 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T06:26:25.888 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T06:26:26.241 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:26:26.257 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6832","nonce":3978252680},{"type":"v1","addr":"172.21.15.112:6833","nonce":3978252680}]},"active_addr":"172.21.15.112:6833/3978252680","active_change":"2024-09-10T06:26:07.397200+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":2051673516}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":4234701950}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":1944388585}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.112:0","nonce":4175809086}]}]} 2024-09-10T06:26:26.261 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T06:26:26.261 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T06:26:26.261 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T06:26:26.565 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:26:26.565 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":21,"fsid":"be773357-a22c-4a27-af42-3fbac58c722b","created":"2024-09-10T06:26:02.514361+0000","modified":"2024-09-10T06:26:25.511823+0000","last_up_change":"2024-09-10T06:26:15.419770+0000","last_in_change":"2024-09-10T06:26:05.513752+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T06:26:15.461819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T06:26:21.721813+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27b822ad-8298-4dd0-be44-f898fd6b155b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6817","nonce":1694936705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6819","nonce":1694936705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6823","nonce":1694936705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6821","nonce":1694936705}]},"public_addr":"172.21.15.112:6817/1694936705","cluster_addr":"172.21.15.112:6819/1694936705","heartbeat_back_addr":"172.21.15.112:6823/1694936705","heartbeat_front_addr":"172.21.15.112:6821/1694936705","state":["exists","up"]},{"osd":1,"uuid":"68108054-a914-4f7c-a6dd-1e8a2775cff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6825","nonce":3700063340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6827","nonce":3700063340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6831","nonce":3700063340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6829","nonce":3700063340}]},"public_addr":"172.21.15.112:6825/3700063340","cluster_addr":"172.21.15.112:6827/3700063340","heartbeat_back_addr":"172.21.15.112:6831/3700063340","heartbeat_front_addr":"172.21.15.112:6829/3700063340","state":["exists","up"]},{"osd":2,"uuid":"0b12ab6c-743b-446a-92de-3d7722320117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6809","nonce":3923792425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6811","nonce":3923792425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6815","nonce":3923792425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6813","nonce":3923792425}]},"public_addr":"172.21.15.112:6809/3923792425","cluster_addr":"172.21.15.112:6811/3923792425","heartbeat_back_addr":"172.21.15.112:6815/3923792425","heartbeat_front_addr":"172.21.15.112:6813/3923792425","state":["exists","up"]},{"osd":3,"uuid":"a468aa3a-22fb-414c-9e7c-fbe79ae3eafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6801","nonce":3428884615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6803","nonce":3428884615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6807","nonce":3428884615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6805","nonce":3428884615}]},"public_addr":"172.21.15.112:6801/3428884615","cluster_addr":"172.21.15.112:6803/3428884615","heartbeat_back_addr":"172.21.15.112:6807/3428884615","heartbeat_front_addr":"172.21.15.112:6805/3428884615","state":["exists","up"]},{"osd":4,"uuid":"e64b5d77-9d7c-4d5f-8ad6-91d3e77d5479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6809","nonce":4200633864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6811","nonce":4200633864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6815","nonce":4200633864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6813","nonce":4200633864}]},"public_addr":"172.21.15.120:6809/4200633864","cluster_addr":"172.21.15.120:6811/4200633864","heartbeat_back_addr":"172.21.15.120:6815/4200633864","heartbeat_front_addr":"172.21.15.120:6813/4200633864","state":["exists","up"]},{"osd":5,"uuid":"bdcce7db-9a36-423b-9a96-368a4a6b6270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6801","nonce":1878513652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6803","nonce":1878513652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6807","nonce":1878513652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6805","nonce":1878513652}]},"public_addr":"172.21.15.120:6801/1878513652","cluster_addr":"172.21.15.120:6803/1878513652","heartbeat_back_addr":"172.21.15.120:6807/1878513652","heartbeat_front_addr":"172.21.15.120:6805/1878513652","state":["exists","up"]},{"osd":6,"uuid":"8eedb98d-014b-4f07-a704-a4b01e8002cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6817","nonce":663776414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6819","nonce":663776414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6823","nonce":663776414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6821","nonce":663776414}]},"public_addr":"172.21.15.120:6817/663776414","cluster_addr":"172.21.15.120:6819/663776414","heartbeat_back_addr":"172.21.15.120:6823/663776414","heartbeat_front_addr":"172.21.15.120:6821/663776414","state":["exists","up"]},{"osd":7,"uuid":"72eece21-94cd-4ed1-9f02-4d2d1edaf136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6825","nonce":4213847863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6827","nonce":4213847863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6831","nonce":4213847863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6829","nonce":4213847863}]},"public_addr":"172.21.15.120:6825/4213847863","cluster_addr":"172.21.15.120:6827/4213847863","heartbeat_back_addr":"172.21.15.120:6831/4213847863","heartbeat_front_addr":"172.21.15.120:6829/4213847863","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.186913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.656858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.014588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.353407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.086903+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:11.731547+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.034165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.207613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:26:26.583 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T06:26:26.583 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T06:26:26.874 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:26:26.875 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":21,"fsid":"be773357-a22c-4a27-af42-3fbac58c722b","created":"2024-09-10T06:26:02.514361+0000","modified":"2024-09-10T06:26:25.511823+0000","last_up_change":"2024-09-10T06:26:15.419770+0000","last_in_change":"2024-09-10T06:26:05.513752+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T06:26:15.461819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T06:26:21.721813+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27b822ad-8298-4dd0-be44-f898fd6b155b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6817","nonce":1694936705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6819","nonce":1694936705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6823","nonce":1694936705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6821","nonce":1694936705}]},"public_addr":"172.21.15.112:6817/1694936705","cluster_addr":"172.21.15.112:6819/1694936705","heartbeat_back_addr":"172.21.15.112:6823/1694936705","heartbeat_front_addr":"172.21.15.112:6821/1694936705","state":["exists","up"]},{"osd":1,"uuid":"68108054-a914-4f7c-a6dd-1e8a2775cff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6825","nonce":3700063340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6827","nonce":3700063340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6831","nonce":3700063340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6829","nonce":3700063340}]},"public_addr":"172.21.15.112:6825/3700063340","cluster_addr":"172.21.15.112:6827/3700063340","heartbeat_back_addr":"172.21.15.112:6831/3700063340","heartbeat_front_addr":"172.21.15.112:6829/3700063340","state":["exists","up"]},{"osd":2,"uuid":"0b12ab6c-743b-446a-92de-3d7722320117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6809","nonce":3923792425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6811","nonce":3923792425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6815","nonce":3923792425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6813","nonce":3923792425}]},"public_addr":"172.21.15.112:6809/3923792425","cluster_addr":"172.21.15.112:6811/3923792425","heartbeat_back_addr":"172.21.15.112:6815/3923792425","heartbeat_front_addr":"172.21.15.112:6813/3923792425","state":["exists","up"]},{"osd":3,"uuid":"a468aa3a-22fb-414c-9e7c-fbe79ae3eafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6801","nonce":3428884615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6803","nonce":3428884615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6807","nonce":3428884615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6805","nonce":3428884615}]},"public_addr":"172.21.15.112:6801/3428884615","cluster_addr":"172.21.15.112:6803/3428884615","heartbeat_back_addr":"172.21.15.112:6807/3428884615","heartbeat_front_addr":"172.21.15.112:6805/3428884615","state":["exists","up"]},{"osd":4,"uuid":"e64b5d77-9d7c-4d5f-8ad6-91d3e77d5479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6809","nonce":4200633864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6811","nonce":4200633864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6815","nonce":4200633864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6813","nonce":4200633864}]},"public_addr":"172.21.15.120:6809/4200633864","cluster_addr":"172.21.15.120:6811/4200633864","heartbeat_back_addr":"172.21.15.120:6815/4200633864","heartbeat_front_addr":"172.21.15.120:6813/4200633864","state":["exists","up"]},{"osd":5,"uuid":"bdcce7db-9a36-423b-9a96-368a4a6b6270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6801","nonce":1878513652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6803","nonce":1878513652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6807","nonce":1878513652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6805","nonce":1878513652}]},"public_addr":"172.21.15.120:6801/1878513652","cluster_addr":"172.21.15.120:6803/1878513652","heartbeat_back_addr":"172.21.15.120:6807/1878513652","heartbeat_front_addr":"172.21.15.120:6805/1878513652","state":["exists","up"]},{"osd":6,"uuid":"8eedb98d-014b-4f07-a704-a4b01e8002cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6817","nonce":663776414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6819","nonce":663776414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6823","nonce":663776414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6821","nonce":663776414}]},"public_addr":"172.21.15.120:6817/663776414","cluster_addr":"172.21.15.120:6819/663776414","heartbeat_back_addr":"172.21.15.120:6823/663776414","heartbeat_front_addr":"172.21.15.120:6821/663776414","state":["exists","up"]},{"osd":7,"uuid":"72eece21-94cd-4ed1-9f02-4d2d1edaf136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6825","nonce":4213847863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6827","nonce":4213847863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6831","nonce":4213847863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6829","nonce":4213847863}]},"public_addr":"172.21.15.120:6825/4213847863","cluster_addr":"172.21.15.120:6827/4213847863","heartbeat_back_addr":"172.21.15.120:6831/4213847863","heartbeat_front_addr":"172.21.15.120:6829/4213847863","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.186913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.656858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.014588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.353407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.086903+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:11.731547+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.034165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.207613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:26:26.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T06:26:26.892 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T06:26:26.893 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T06:26:26.893 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T06:26:26.893 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T06:26:26.894 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T06:26:26.894 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T06:26:26.894 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T06:26:27.156 INFO:teuthology.orchestra.run.smithi112.stdout:60129542150 2024-09-10T06:26:27.156 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T06:26:27.158 INFO:teuthology.orchestra.run.smithi112.stdout:60129542149 2024-09-10T06:26:27.158 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T06:26:27.161 INFO:teuthology.orchestra.run.smithi112.stdout:60129542150 2024-09-10T06:26:27.161 INFO:teuthology.orchestra.run.smithi112.stdout:60129542149 2024-09-10T06:26:27.162 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T06:26:27.162 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T06:26:27.164 INFO:teuthology.orchestra.run.smithi112.stdout:60129542150 2024-09-10T06:26:27.164 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T06:26:27.169 INFO:teuthology.orchestra.run.smithi112.stdout:60129542149 2024-09-10T06:26:27.169 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T06:26:27.171 INFO:teuthology.orchestra.run.smithi112.stdout:60129542149 2024-09-10T06:26:27.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T06:26:27.174 INFO:teuthology.orchestra.run.smithi112.stdout:60129542150 2024-09-10T06:26:27.175 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T06:26:27.679 INFO:teuthology.orchestra.run.smithi112.stdout:60129542149 2024-09-10T06:26:27.699 INFO:teuthology.orchestra.run.smithi112.stdout:60129542150 2024-09-10T06:26:27.701 INFO:teuthology.orchestra.run.smithi112.stdout:60129542150 2024-09-10T06:26:27.706 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-09-10T06:26:27.706 DEBUG:teuthology.parallel:result is None 2024-09-10T06:26:27.715 INFO:teuthology.orchestra.run.smithi112.stdout:60129542149 2024-09-10T06:26:27.719 INFO:teuthology.orchestra.run.smithi112.stdout:60129542149 2024-09-10T06:26:27.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-09-10T06:26:27.724 DEBUG:teuthology.parallel:result is None 2024-09-10T06:26:27.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-09-10T06:26:27.728 DEBUG:teuthology.parallel:result is None 2024-09-10T06:26:27.731 INFO:teuthology.orchestra.run.smithi112.stdout:60129542150 2024-09-10T06:26:27.735 INFO:teuthology.orchestra.run.smithi112.stdout:60129542149 2024-09-10T06:26:27.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-09-10T06:26:27.748 DEBUG:teuthology.parallel:result is None 2024-09-10T06:26:27.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-09-10T06:26:27.750 DEBUG:teuthology.parallel:result is None 2024-09-10T06:26:27.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-09-10T06:26:27.754 DEBUG:teuthology.parallel:result is None 2024-09-10T06:26:27.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2024-09-10T06:26:27.757 DEBUG:teuthology.parallel:result is None 2024-09-10T06:26:27.758 INFO:teuthology.orchestra.run.smithi112.stdout:60129542150 2024-09-10T06:26:27.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-09-10T06:26:27.775 DEBUG:teuthology.parallel:result is None 2024-09-10T06:26:27.775 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T06:26:27.775 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:26:28.086 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:26:28.086 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:26:28.103 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-10T06:26:27.412453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219080,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755640,"statfs":{"total":773094113280,"available":772869775360,"internally_reserved":0,"allocated":2899968,"data_stored":1758366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.928748"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.037336+0000","last_change":"2024-09-10T06:26:26.037773+0000","last_active":"2024-09-10T06:26:26.037336+0000","last_peered":"2024-09-10T06:26:26.037336+0000","last_clean":"2024-09-10T06:26:26.037336+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:26:26.037336+0000","last_undegraded":"2024-09-10T06:26:26.037336+0000","last_fullsized":"2024-09-10T06:26:26.037336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:21.949708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.537295+0000","last_change":"2024-09-10T06:26:25.537295+0000","last_active":"2024-09-10T06:26:25.537295+0000","last_peered":"2024-09-10T06:26:25.537295+0000","last_clean":"2024-09-10T06:26:25.537295+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:26:25.537295+0000","last_undegraded":"2024-09-10T06:26:25.537295+0000","last_fullsized":"2024-09-10T06:26:25.537295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:32.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.180406+0000","last_change":"2024-09-10T06:26:26.180820+0000","last_active":"2024-09-10T06:26:26.180406+0000","last_peered":"2024-09-10T06:26:26.180406+0000","last_clean":"2024-09-10T06:26:26.180406+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:26:26.180406+0000","last_undegraded":"2024-09-10T06:26:26.180406+0000","last_fullsized":"2024-09-10T06:26:26.180406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:51.928304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.537497+0000","last_change":"2024-09-10T06:26:25.537497+0000","last_active":"2024-09-10T06:26:25.537497+0000","last_peered":"2024-09-10T06:26:25.537497+0000","last_clean":"2024-09-10T06:26:25.537497+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:26:25.537497+0000","last_undegraded":"2024-09-10T06:26:25.537497+0000","last_fullsized":"2024-09-10T06:26:25.537497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:44.787852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.535368+0000","last_change":"2024-09-10T06:26:25.534289+0000","last_active":"2024-09-10T06:26:25.535368+0000","last_peered":"2024-09-10T06:26:25.535368+0000","last_clean":"2024-09-10T06:26:25.535368+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:26:25.535368+0000","last_undegraded":"2024-09-10T06:26:25.535368+0000","last_fullsized":"2024-09-10T06:26:25.535368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:11.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.979136+0000","last_change":"2024-09-10T06:26:25.979784+0000","last_active":"2024-09-10T06:26:25.979136+0000","last_peered":"2024-09-10T06:26:25.979136+0000","last_clean":"2024-09-10T06:26:25.979136+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:26:25.979136+0000","last_undegraded":"2024-09-10T06:26:25.979136+0000","last_fullsized":"2024-09-10T06:26:25.979136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:42.490682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.180275+0000","last_change":"2024-09-10T06:26:26.180664+0000","last_active":"2024-09-10T06:26:26.180275+0000","last_peered":"2024-09-10T06:26:26.180275+0000","last_clean":"2024-09-10T06:26:26.180275+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:26:26.180275+0000","last_undegraded":"2024-09-10T06:26:26.180275+0000","last_fullsized":"2024-09-10T06:26:26.180275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:28.793045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.532465+0000","last_change":"2024-09-10T06:26:25.532465+0000","last_active":"2024-09-10T06:26:25.532465+0000","last_peered":"2024-09-10T06:26:25.532465+0000","last_clean":"2024-09-10T06:26:25.532465+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:26:25.532465+0000","last_undegraded":"2024-09-10T06:26:25.532465+0000","last_fullsized":"2024-09-10T06:26:25.532465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:10.318844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.179602+0000","last_change":"2024-09-10T06:26:18.153206+0000","last_active":"2024-09-10T06:26:26.179602+0000","last_peered":"2024-09-10T06:26:26.179602+0000","last_clean":"2024-09-10T06:26:26.179602+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:26:26.179602+0000","last_undegraded":"2024-09-10T06:26:26.179602+0000","last_fullsized":"2024-09-10T06:26:26.179602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_clean_scrub_stamp":"2024-09-10T06:26:16.422775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:42.510577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":217088,"data_stored":72218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":72218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:26:28.104 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:26:28.378 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:26:28.378 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:26:28.394 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-10T06:26:27.412453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219080,"kb_used_data":2832,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755640,"statfs":{"total":773094113280,"available":772869775360,"internally_reserved":0,"allocated":2899968,"data_stored":1758366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.928748"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.037336+0000","last_change":"2024-09-10T06:26:26.037773+0000","last_active":"2024-09-10T06:26:26.037336+0000","last_peered":"2024-09-10T06:26:26.037336+0000","last_clean":"2024-09-10T06:26:26.037336+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:26:26.037336+0000","last_undegraded":"2024-09-10T06:26:26.037336+0000","last_fullsized":"2024-09-10T06:26:26.037336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:21.949708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.537295+0000","last_change":"2024-09-10T06:26:25.537295+0000","last_active":"2024-09-10T06:26:25.537295+0000","last_peered":"2024-09-10T06:26:25.537295+0000","last_clean":"2024-09-10T06:26:25.537295+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:26:25.537295+0000","last_undegraded":"2024-09-10T06:26:25.537295+0000","last_fullsized":"2024-09-10T06:26:25.537295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:32.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.180406+0000","last_change":"2024-09-10T06:26:26.180820+0000","last_active":"2024-09-10T06:26:26.180406+0000","last_peered":"2024-09-10T06:26:26.180406+0000","last_clean":"2024-09-10T06:26:26.180406+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:26:26.180406+0000","last_undegraded":"2024-09-10T06:26:26.180406+0000","last_fullsized":"2024-09-10T06:26:26.180406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:51.928304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.537497+0000","last_change":"2024-09-10T06:26:25.537497+0000","last_active":"2024-09-10T06:26:25.537497+0000","last_peered":"2024-09-10T06:26:25.537497+0000","last_clean":"2024-09-10T06:26:25.537497+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:26:25.537497+0000","last_undegraded":"2024-09-10T06:26:25.537497+0000","last_fullsized":"2024-09-10T06:26:25.537497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:44.787852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.535368+0000","last_change":"2024-09-10T06:26:25.534289+0000","last_active":"2024-09-10T06:26:25.535368+0000","last_peered":"2024-09-10T06:26:25.535368+0000","last_clean":"2024-09-10T06:26:25.535368+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:26:25.535368+0000","last_undegraded":"2024-09-10T06:26:25.535368+0000","last_fullsized":"2024-09-10T06:26:25.535368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:11.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.979136+0000","last_change":"2024-09-10T06:26:25.979784+0000","last_active":"2024-09-10T06:26:25.979136+0000","last_peered":"2024-09-10T06:26:25.979136+0000","last_clean":"2024-09-10T06:26:25.979136+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:26:25.979136+0000","last_undegraded":"2024-09-10T06:26:25.979136+0000","last_fullsized":"2024-09-10T06:26:25.979136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:42.490682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.180275+0000","last_change":"2024-09-10T06:26:26.180664+0000","last_active":"2024-09-10T06:26:26.180275+0000","last_peered":"2024-09-10T06:26:26.180275+0000","last_clean":"2024-09-10T06:26:26.180275+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:26:26.180275+0000","last_undegraded":"2024-09-10T06:26:26.180275+0000","last_fullsized":"2024-09-10T06:26:26.180275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:28.793045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:25.532465+0000","last_change":"2024-09-10T06:26:25.532465+0000","last_active":"2024-09-10T06:26:25.532465+0000","last_peered":"2024-09-10T06:26:25.532465+0000","last_clean":"2024-09-10T06:26:25.532465+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:26:25.532465+0000","last_undegraded":"2024-09-10T06:26:25.532465+0000","last_fullsized":"2024-09-10T06:26:25.532465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:10.318844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T06:26:26.179602+0000","last_change":"2024-09-10T06:26:18.153206+0000","last_active":"2024-09-10T06:26:26.179602+0000","last_peered":"2024-09-10T06:26:26.179602+0000","last_clean":"2024-09-10T06:26:26.179602+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:26:26.179602+0000","last_undegraded":"2024-09-10T06:26:26.179602+0000","last_fullsized":"2024-09-10T06:26:26.179602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_clean_scrub_stamp":"2024-09-10T06:26:16.422775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:42.510577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":217088,"data_stored":72218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":72199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":72218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":662567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:26:28.395 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T06:26:28.395 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T06:26:28.396 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T06:26:28.396 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T06:26:28.710 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:26:28.711 INFO:teuthology.orchestra.run.smithi112.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T06:26:28.729 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T06:26:28.730 INFO:teuthology.run_tasks:Running task rgw... 2024-09-10T06:26:28.744 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-10T06:26:28.745 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-10T06:26:28.745 INFO:tasks.rgw:Creating data pools 2024-09-10T06:26:28.745 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-10T06:26:28.745 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-10T06:26:29.553 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'default.rgw.buckets.data' created 2024-09-10T06:26:29.586 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-10T06:26:30.544 INFO:teuthology.orchestra.run.smithi112.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-10T06:26:30.577 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-10T06:26:31.548 INFO:teuthology.orchestra.run.smithi112.stderr:pool 'default.rgw.buckets.index' created 2024-09-10T06:26:31.585 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-10T06:26:32.232 INFO:teuthology.orchestra.run.smithi112.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-10T06:26:32.283 DEBUG:tasks.rgw:Pools created 2024-09-10T06:26:32.283 INFO:tasks.rgw:Starting rgw... 2024-09-10T06:26:32.283 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-10T06:26:32.283 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-10T06:26:32.284 DEBUG:teuthology.orchestra.run.smithi112:> sudo echo -n http://smithi112.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-10T06:26:32.295 INFO:teuthology.orchestra.run.smithi112.stdout:http://smithi112.front.sepia.ceph.com:80 2024-09-10T06:26:32.295 DEBUG:teuthology.orchestra.run.smithi112:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-10T06:26:32.349 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-10T06:26:32.349 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-10T06:26:32.393 INFO:tasks.rgw.client.0:Started 2024-09-10T06:26:32.393 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi112.front.sepia.ceph.com:80/ 2024-09-10T06:26:32.393 DEBUG:teuthology.orchestra.run.smithi112:> curl http://smithi112.front.sepia.ceph.com:80/ 2024-09-10T06:26:32.518 INFO:teuthology.orchestra.run.smithi112.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T06:26:32.518 INFO:teuthology.orchestra.run.smithi112.stderr: Dload Upload Total Spent Left Speed 2024-09-10T06:26:32.518 INFO:teuthology.orchestra.run.smithi112.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T06:26:32.518 INFO:teuthology.orchestra.run.smithi112.stderr:curl: (7) Failed to connect to smithi112.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T06:26:32.519 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T06:26:33.520 DEBUG:teuthology.orchestra.run.smithi112:> curl http://smithi112.front.sepia.ceph.com:80/ 2024-09-10T06:26:33.531 INFO:teuthology.orchestra.run.smithi112.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T06:26:33.532 INFO:teuthology.orchestra.run.smithi112.stderr: Dload Upload Total Spent Left Speed 2024-09-10T06:26:33.532 INFO:teuthology.orchestra.run.smithi112.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T06:26:33.532 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T06:26:33.533 INFO:teuthology.orchestra.run.smithi112.stderr:curl: (7) Failed to connect to smithi112.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T06:26:35.534 DEBUG:teuthology.orchestra.run.smithi112:> curl http://smithi112.front.sepia.ceph.com:80/ 2024-09-10T06:26:35.546 INFO:teuthology.orchestra.run.smithi112.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T06:26:35.546 INFO:teuthology.orchestra.run.smithi112.stderr: Dload Upload Total Spent Left Speed 2024-09-10T06:26:35.546 INFO:teuthology.orchestra.run.smithi112.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T06:26:35.546 INFO:teuthology.orchestra.run.smithi112.stderr:curl: (7) Failed to connect to smithi112.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T06:26:35.547 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T06:26:39.548 DEBUG:teuthology.orchestra.run.smithi112:> curl http://smithi112.front.sepia.ceph.com:80/ 2024-09-10T06:26:39.559 INFO:teuthology.orchestra.run.smithi112.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T06:26:39.560 INFO:teuthology.orchestra.run.smithi112.stderr: Dload Upload Total Spent Left Speed 2024-09-10T06:26:39.560 INFO:teuthology.orchestra.run.smithi112.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T06:26:39.560 INFO:teuthology.orchestra.run.smithi112.stderr:curl: (7) Failed to connect to smithi112.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T06:26:39.560 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T06:26:47.562 DEBUG:teuthology.orchestra.run.smithi112:> curl http://smithi112.front.sepia.ceph.com:80/ 2024-09-10T06:26:47.573 INFO:teuthology.orchestra.run.smithi112.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T06:26:47.573 INFO:teuthology.orchestra.run.smithi112.stderr: Dload Upload Total Spent Left Speed 2024-09-10T06:26:47.576 INFO:teuthology.orchestra.run.smithi112.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 59687 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-10T06:26:47.577 INFO:teuthology.orchestra.run.smithi112.stdout:anonymous 2024-09-10T06:26:47.577 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-10T06:26:47.589 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-10T06:26:47.589 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cls-rgw-busy-resharding', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-10T06:26:47.589 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-10T06:26:47.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-10T06:26:47.960 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-10T06:26:47.960 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T06:26:47.960 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:26:48.308 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:26:48.314 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:26:48.330 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-09-10T06:26:47.419107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":526,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224796,"kb_used_data":4400,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749924,"statfs":{"total":773094113280,"available":772863922176,"internally_reserved":0,"allocated":4505600,"data_stored":2527700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002729"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313023+0000","last_change":"2024-09-10T06:26:30.604655+0000","last_active":"2024-09-10T06:26:41.313023+0000","last_peered":"2024-09-10T06:26:41.313023+0000","last_clean":"2024-09-10T06:26:41.313023+0000","last_became_active":"2024-09-10T06:26:30.601308+0000","last_became_peered":"2024-09-10T06:26:30.601308+0000","last_unstale":"2024-09-10T06:26:41.313023+0000","last_undegraded":"2024-09-10T06:26:41.313023+0000","last_fullsized":"2024-09-10T06:26:41.313023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:35.326017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.321390+0000","last_change":"2024-09-10T06:26:32.279882+0000","last_active":"2024-09-10T06:26:41.321390+0000","last_peered":"2024-09-10T06:26:41.321390+0000","last_clean":"2024-09-10T06:26:41.321390+0000","last_became_active":"2024-09-10T06:26:32.279098+0000","last_became_peered":"2024-09-10T06:26:32.279098+0000","last_unstale":"2024-09-10T06:26:41.321390+0000","last_undegraded":"2024-09-10T06:26:41.321390+0000","last_fullsized":"2024-09-10T06:26:41.321390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316645+0000","last_change":"2024-09-10T06:26:30.573148+0000","last_active":"2024-09-10T06:26:41.316645+0000","last_peered":"2024-09-10T06:26:41.316645+0000","last_clean":"2024-09-10T06:26:41.316645+0000","last_became_active":"2024-09-10T06:26:30.572798+0000","last_became_peered":"2024-09-10T06:26:30.572798+0000","last_unstale":"2024-09-10T06:26:41.316645+0000","last_undegraded":"2024-09-10T06:26:41.316645+0000","last_fullsized":"2024-09-10T06:26:41.316645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:38.833715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311387+0000","last_change":"2024-09-10T06:26:32.276811+0000","last_active":"2024-09-10T06:26:41.311387+0000","last_peered":"2024-09-10T06:26:41.311387+0000","last_clean":"2024-09-10T06:26:41.311387+0000","last_became_active":"2024-09-10T06:26:32.275990+0000","last_became_peered":"2024-09-10T06:26:32.275990+0000","last_unstale":"2024-09-10T06:26:41.311387+0000","last_undegraded":"2024-09-10T06:26:41.311387+0000","last_fullsized":"2024-09-10T06:26:41.311387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330063+0000","last_change":"2024-09-10T06:26:30.578068+0000","last_active":"2024-09-10T06:26:41.330063+0000","last_peered":"2024-09-10T06:26:41.330063+0000","last_clean":"2024-09-10T06:26:41.330063+0000","last_became_active":"2024-09-10T06:26:30.577688+0000","last_became_peered":"2024-09-10T06:26:30.577688+0000","last_unstale":"2024-09-10T06:26:41.330063+0000","last_undegraded":"2024-09-10T06:26:41.330063+0000","last_fullsized":"2024-09-10T06:26:41.330063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:34.137079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293797+0000","last_change":"2024-09-10T06:26:32.256939+0000","last_active":"2024-09-10T06:26:41.293797+0000","last_peered":"2024-09-10T06:26:41.293797+0000","last_clean":"2024-09-10T06:26:41.293797+0000","last_became_active":"2024-09-10T06:26:32.256117+0000","last_became_peered":"2024-09-10T06:26:32.256117+0000","last_unstale":"2024-09-10T06:26:41.293797+0000","last_undegraded":"2024-09-10T06:26:41.293797+0000","last_fullsized":"2024-09-10T06:26:41.293797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:51.879604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323729+0000","last_change":"2024-09-10T06:26:30.593697+0000","last_active":"2024-09-10T06:26:41.323729+0000","last_peered":"2024-09-10T06:26:41.323729+0000","last_clean":"2024-09-10T06:26:41.323729+0000","last_became_active":"2024-09-10T06:26:30.591807+0000","last_became_peered":"2024-09-10T06:26:30.591807+0000","last_unstale":"2024-09-10T06:26:41.323729+0000","last_undegraded":"2024-09-10T06:26:41.323729+0000","last_fullsized":"2024-09-10T06:26:41.323729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329661+0000","last_change":"2024-09-10T06:26:32.264685+0000","last_active":"2024-09-10T06:26:41.329661+0000","last_peered":"2024-09-10T06:26:41.329661+0000","last_clean":"2024-09-10T06:26:41.329661+0000","last_became_active":"2024-09-10T06:26:32.264199+0000","last_became_peered":"2024-09-10T06:26:32.264199+0000","last_unstale":"2024-09-10T06:26:41.329661+0000","last_undegraded":"2024-09-10T06:26:41.329661+0000","last_fullsized":"2024-09-10T06:26:41.329661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:20.713066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312113+0000","last_change":"2024-09-10T06:26:30.584856+0000","last_active":"2024-09-10T06:26:41.312113+0000","last_peered":"2024-09-10T06:26:41.312113+0000","last_clean":"2024-09-10T06:26:41.312113+0000","last_became_active":"2024-09-10T06:26:30.584149+0000","last_became_peered":"2024-09-10T06:26:30.584149+0000","last_unstale":"2024-09-10T06:26:41.312113+0000","last_undegraded":"2024-09-10T06:26:41.312113+0000","last_fullsized":"2024-09-10T06:26:41.312113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:35.688897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326995+0000","last_change":"2024-09-10T06:26:32.290741+0000","last_active":"2024-09-10T06:26:41.326995+0000","last_peered":"2024-09-10T06:26:41.326995+0000","last_clean":"2024-09-10T06:26:41.326995+0000","last_became_active":"2024-09-10T06:26:32.289840+0000","last_became_peered":"2024-09-10T06:26:32.289840+0000","last_unstale":"2024-09-10T06:26:41.326995+0000","last_undegraded":"2024-09-10T06:26:41.326995+0000","last_fullsized":"2024-09-10T06:26:41.326995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.322706+0000","last_change":"2024-09-10T06:26:30.609817+0000","last_active":"2024-09-10T06:26:41.322706+0000","last_peered":"2024-09-10T06:26:41.322706+0000","last_clean":"2024-09-10T06:26:41.322706+0000","last_became_active":"2024-09-10T06:26:30.603330+0000","last_became_peered":"2024-09-10T06:26:30.603330+0000","last_unstale":"2024-09-10T06:26:41.322706+0000","last_undegraded":"2024-09-10T06:26:41.322706+0000","last_fullsized":"2024-09-10T06:26:41.322706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:09.523045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295048+0000","last_change":"2024-09-10T06:26:32.257050+0000","last_active":"2024-09-10T06:26:41.295048+0000","last_peered":"2024-09-10T06:26:41.295048+0000","last_clean":"2024-09-10T06:26:41.295048+0000","last_became_active":"2024-09-10T06:26:32.254437+0000","last_became_peered":"2024-09-10T06:26:32.254437+0000","last_unstale":"2024-09-10T06:26:41.295048+0000","last_undegraded":"2024-09-10T06:26:41.295048+0000","last_fullsized":"2024-09-10T06:26:41.295048+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311564+0000","last_change":"2024-09-10T06:26:30.579756+0000","last_active":"2024-09-10T06:26:41.311564+0000","last_peered":"2024-09-10T06:26:41.311564+0000","last_clean":"2024-09-10T06:26:41.311564+0000","last_became_active":"2024-09-10T06:26:30.578033+0000","last_became_peered":"2024-09-10T06:26:30.578033+0000","last_unstale":"2024-09-10T06:26:41.311564+0000","last_undegraded":"2024-09-10T06:26:41.311564+0000","last_fullsized":"2024-09-10T06:26:41.311564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323677+0000","last_change":"2024-09-10T06:26:32.281248+0000","last_active":"2024-09-10T06:26:41.323677+0000","last_peered":"2024-09-10T06:26:41.323677+0000","last_clean":"2024-09-10T06:26:41.323677+0000","last_became_active":"2024-09-10T06:26:32.280480+0000","last_became_peered":"2024-09-10T06:26:32.280480+0000","last_unstale":"2024-09-10T06:26:41.323677+0000","last_undegraded":"2024-09-10T06:26:41.323677+0000","last_fullsized":"2024-09-10T06:26:41.323677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294752+0000","last_change":"2024-09-10T06:26:30.593213+0000","last_active":"2024-09-10T06:26:41.294752+0000","last_peered":"2024-09-10T06:26:41.294752+0000","last_clean":"2024-09-10T06:26:41.294752+0000","last_became_active":"2024-09-10T06:26:30.592770+0000","last_became_peered":"2024-09-10T06:26:30.592770+0000","last_unstale":"2024-09-10T06:26:41.294752+0000","last_undegraded":"2024-09-10T06:26:41.294752+0000","last_fullsized":"2024-09-10T06:26:41.294752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298876+0000","last_change":"2024-09-10T06:26:32.267430+0000","last_active":"2024-09-10T06:26:41.298876+0000","last_peered":"2024-09-10T06:26:41.298876+0000","last_clean":"2024-09-10T06:26:41.298876+0000","last_became_active":"2024-09-10T06:26:32.265788+0000","last_became_peered":"2024-09-10T06:26:32.265788+0000","last_unstale":"2024-09-10T06:26:41.298876+0000","last_undegraded":"2024-09-10T06:26:41.298876+0000","last_fullsized":"2024-09-10T06:26:41.298876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:19.180142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293160+0000","last_change":"2024-09-10T06:26:32.255038+0000","last_active":"2024-09-10T06:26:41.293160+0000","last_peered":"2024-09-10T06:26:41.293160+0000","last_clean":"2024-09-10T06:26:41.293160+0000","last_became_active":"2024-09-10T06:26:32.254281+0000","last_became_peered":"2024-09-10T06:26:32.254281+0000","last_unstale":"2024-09-10T06:26:41.293160+0000","last_undegraded":"2024-09-10T06:26:41.293160+0000","last_fullsized":"2024-09-10T06:26:41.293160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:46.363171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313120+0000","last_change":"2024-09-10T06:26:30.607280+0000","last_active":"2024-09-10T06:26:41.313120+0000","last_peered":"2024-09-10T06:26:41.313120+0000","last_clean":"2024-09-10T06:26:41.313120+0000","last_became_active":"2024-09-10T06:26:30.605602+0000","last_became_peered":"2024-09-10T06:26:30.605602+0000","last_unstale":"2024-09-10T06:26:41.313120+0000","last_undegraded":"2024-09-10T06:26:41.313120+0000","last_fullsized":"2024-09-10T06:26:41.313120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:49.865234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311489+0000","last_change":"2024-09-10T06:26:32.275913+0000","last_active":"2024-09-10T06:26:41.311489+0000","last_peered":"2024-09-10T06:26:41.311489+0000","last_clean":"2024-09-10T06:26:41.311489+0000","last_became_active":"2024-09-10T06:26:32.274264+0000","last_became_peered":"2024-09-10T06:26:32.274264+0000","last_unstale":"2024-09-10T06:26:41.311489+0000","last_undegraded":"2024-09-10T06:26:41.311489+0000","last_fullsized":"2024-09-10T06:26:41.311489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327581+0000","last_change":"2024-09-10T06:26:30.598756+0000","last_active":"2024-09-10T06:26:41.327581+0000","last_peered":"2024-09-10T06:26:41.327581+0000","last_clean":"2024-09-10T06:26:41.327581+0000","last_became_active":"2024-09-10T06:26:30.597001+0000","last_became_peered":"2024-09-10T06:26:30.597001+0000","last_unstale":"2024-09-10T06:26:41.327581+0000","last_undegraded":"2024-09-10T06:26:41.327581+0000","last_fullsized":"2024-09-10T06:26:41.327581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:17.165772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.322864+0000","last_change":"2024-09-10T06:26:32.279079+0000","last_active":"2024-09-10T06:26:41.322864+0000","last_peered":"2024-09-10T06:26:41.322864+0000","last_clean":"2024-09-10T06:26:41.322864+0000","last_became_active":"2024-09-10T06:26:32.278407+0000","last_became_peered":"2024-09-10T06:26:32.278407+0000","last_unstale":"2024-09-10T06:26:41.322864+0000","last_undegraded":"2024-09-10T06:26:41.322864+0000","last_fullsized":"2024-09-10T06:26:41.322864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327960+0000","last_change":"2024-09-10T06:26:30.607368+0000","last_active":"2024-09-10T06:26:41.327960+0000","last_peered":"2024-09-10T06:26:41.327960+0000","last_clean":"2024-09-10T06:26:41.327960+0000","last_became_active":"2024-09-10T06:26:30.606807+0000","last_became_peered":"2024-09-10T06:26:30.606807+0000","last_unstale":"2024-09-10T06:26:41.327960+0000","last_undegraded":"2024-09-10T06:26:41.327960+0000","last_fullsized":"2024-09-10T06:26:41.327960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293669+0000","last_change":"2024-09-10T06:26:32.265468+0000","last_active":"2024-09-10T06:26:41.293669+0000","last_peered":"2024-09-10T06:26:41.293669+0000","last_clean":"2024-09-10T06:26:41.293669+0000","last_became_active":"2024-09-10T06:26:32.265045+0000","last_became_peered":"2024-09-10T06:26:32.265045+0000","last_unstale":"2024-09-10T06:26:41.293669+0000","last_undegraded":"2024-09-10T06:26:41.293669+0000","last_fullsized":"2024-09-10T06:26:41.293669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:04.146927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294552+0000","last_change":"2024-09-10T06:26:30.598381+0000","last_active":"2024-09-10T06:26:41.294552+0000","last_peered":"2024-09-10T06:26:41.294552+0000","last_clean":"2024-09-10T06:26:41.294552+0000","last_became_active":"2024-09-10T06:26:30.597271+0000","last_became_peered":"2024-09-10T06:26:30.597271+0000","last_unstale":"2024-09-10T06:26:41.294552+0000","last_undegraded":"2024-09-10T06:26:41.294552+0000","last_fullsized":"2024-09-10T06:26:41.294552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:59.908548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.297874+0000","last_change":"2024-09-10T06:26:32.247492+0000","last_active":"2024-09-10T06:26:41.297874+0000","last_peered":"2024-09-10T06:26:41.297874+0000","last_clean":"2024-09-10T06:26:41.297874+0000","last_became_active":"2024-09-10T06:26:32.246938+0000","last_became_peered":"2024-09-10T06:26:32.246938+0000","last_unstale":"2024-09-10T06:26:41.297874+0000","last_undegraded":"2024-09-10T06:26:41.297874+0000","last_fullsized":"2024-09-10T06:26:41.297874+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:01.766868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294574+0000","last_change":"2024-09-10T06:26:30.592866+0000","last_active":"2024-09-10T06:26:41.294574+0000","last_peered":"2024-09-10T06:26:41.294574+0000","last_clean":"2024-09-10T06:26:41.294574+0000","last_became_active":"2024-09-10T06:26:30.592550+0000","last_became_peered":"2024-09-10T06:26:30.592550+0000","last_unstale":"2024-09-10T06:26:41.294574+0000","last_undegraded":"2024-09-10T06:26:41.294574+0000","last_fullsized":"2024-09-10T06:26:41.294574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:02.132556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295199+0000","last_change":"2024-09-10T06:26:32.278347+0000","last_active":"2024-09-10T06:26:41.295199+0000","last_peered":"2024-09-10T06:26:41.295199+0000","last_clean":"2024-09-10T06:26:41.295199+0000","last_became_active":"2024-09-10T06:26:32.275206+0000","last_became_peered":"2024-09-10T06:26:32.275206+0000","last_unstale":"2024-09-10T06:26:41.295199+0000","last_undegraded":"2024-09-10T06:26:41.295199+0000","last_fullsized":"2024-09-10T06:26:41.295199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329581+0000","last_change":"2024-09-10T06:26:30.572734+0000","last_active":"2024-09-10T06:26:41.329581+0000","last_peered":"2024-09-10T06:26:41.329581+0000","last_clean":"2024-09-10T06:26:41.329581+0000","last_became_active":"2024-09-10T06:26:30.572043+0000","last_became_peered":"2024-09-10T06:26:30.572043+0000","last_unstale":"2024-09-10T06:26:41.329581+0000","last_undegraded":"2024-09-10T06:26:41.329581+0000","last_fullsized":"2024-09-10T06:26:41.329581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.292732+0000","last_change":"2024-09-10T06:26:40.323476+0000","last_active":"2024-09-10T06:26:41.292732+0000","last_peered":"2024-09-10T06:26:41.292732+0000","last_clean":"2024-09-10T06:26:41.292732+0000","last_became_active":"2024-09-10T06:26:40.322711+0000","last_became_peered":"2024-09-10T06:26:40.322711+0000","last_unstale":"2024-09-10T06:26:41.292732+0000","last_undegraded":"2024-09-10T06:26:41.292732+0000","last_fullsized":"2024-09-10T06:26:41.292732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.296855+0000","last_change":"2024-09-10T06:26:32.276274+0000","last_active":"2024-09-10T06:26:41.296855+0000","last_peered":"2024-09-10T06:26:41.296855+0000","last_clean":"2024-09-10T06:26:41.296855+0000","last_became_active":"2024-09-10T06:26:32.275889+0000","last_became_peered":"2024-09-10T06:26:32.275889+0000","last_unstale":"2024-09-10T06:26:41.296855+0000","last_undegraded":"2024-09-10T06:26:41.296855+0000","last_fullsized":"2024-09-10T06:26:41.296855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312375+0000","last_change":"2024-09-10T06:26:30.595738+0000","last_active":"2024-09-10T06:26:41.312375+0000","last_peered":"2024-09-10T06:26:41.312375+0000","last_clean":"2024-09-10T06:26:41.312375+0000","last_became_active":"2024-09-10T06:26:30.595128+0000","last_became_peered":"2024-09-10T06:26:30.595128+0000","last_unstale":"2024-09-10T06:26:41.312375+0000","last_undegraded":"2024-09-10T06:26:41.312375+0000","last_fullsized":"2024-09-10T06:26:41.312375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.324613+0000","last_change":"2024-09-10T06:26:34.279824+0000","last_active":"2024-09-10T06:26:41.324613+0000","last_peered":"2024-09-10T06:26:41.324613+0000","last_clean":"2024-09-10T06:26:41.324613+0000","last_became_active":"2024-09-10T06:26:34.279074+0000","last_became_peered":"2024-09-10T06:26:34.279074+0000","last_unstale":"2024-09-10T06:26:41.324613+0000","last_undegraded":"2024-09-10T06:26:41.324613+0000","last_fullsized":"2024-09-10T06:26:41.324613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:40.507467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.709008+0000","last_change":"2024-09-10T06:26:36.296703+0000","last_active":"2024-09-10T06:26:41.709008+0000","last_peered":"2024-09-10T06:26:41.709008+0000","last_clean":"2024-09-10T06:26:41.709008+0000","last_became_active":"2024-09-10T06:26:36.295786+0000","last_became_peered":"2024-09-10T06:26:36.295786+0000","last_unstale":"2024-09-10T06:26:41.709008+0000","last_undegraded":"2024-09-10T06:26:41.709008+0000","last_fullsized":"2024-09-10T06:26:41.709008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:31.699855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312714+0000","last_change":"2024-09-10T06:26:38.305468+0000","last_active":"2024-09-10T06:26:41.312714+0000","last_peered":"2024-09-10T06:26:41.312714+0000","last_clean":"2024-09-10T06:26:41.312714+0000","last_became_active":"2024-09-10T06:26:38.304847+0000","last_became_peered":"2024-09-10T06:26:38.304847+0000","last_unstale":"2024-09-10T06:26:41.312714+0000","last_undegraded":"2024-09-10T06:26:41.312714+0000","last_fullsized":"2024-09-10T06:26:41.312714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:36.499856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.322051+0000","last_change":"2024-09-10T06:26:40.331389+0000","last_active":"2024-09-10T06:26:41.322051+0000","last_peered":"2024-09-10T06:26:41.322051+0000","last_clean":"2024-09-10T06:26:41.322051+0000","last_became_active":"2024-09-10T06:26:40.330777+0000","last_became_peered":"2024-09-10T06:26:40.330777+0000","last_unstale":"2024-09-10T06:26:41.322051+0000","last_undegraded":"2024-09-10T06:26:41.322051+0000","last_fullsized":"2024-09-10T06:26:41.322051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:22.792159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325044+0000","last_change":"2024-09-10T06:26:32.283112+0000","last_active":"2024-09-10T06:26:41.325044+0000","last_peered":"2024-09-10T06:26:41.325044+0000","last_clean":"2024-09-10T06:26:41.325044+0000","last_became_active":"2024-09-10T06:26:32.282263+0000","last_became_peered":"2024-09-10T06:26:32.282263+0000","last_unstale":"2024-09-10T06:26:41.325044+0000","last_undegraded":"2024-09-10T06:26:41.325044+0000","last_fullsized":"2024-09-10T06:26:41.325044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:02.124800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329604+0000","last_change":"2024-09-10T06:26:30.576489+0000","last_active":"2024-09-10T06:26:41.329604+0000","last_peered":"2024-09-10T06:26:41.329604+0000","last_clean":"2024-09-10T06:26:41.329604+0000","last_became_active":"2024-09-10T06:26:30.576039+0000","last_became_peered":"2024-09-10T06:26:30.576039+0000","last_unstale":"2024-09-10T06:26:41.329604+0000","last_undegraded":"2024-09-10T06:26:41.329604+0000","last_fullsized":"2024-09-10T06:26:41.329604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.296471+0000","last_change":"2024-09-10T06:26:34.268758+0000","last_active":"2024-09-10T06:26:41.296471+0000","last_peered":"2024-09-10T06:26:41.296471+0000","last_clean":"2024-09-10T06:26:41.296471+0000","last_became_active":"2024-09-10T06:26:34.268279+0000","last_became_peered":"2024-09-10T06:26:34.268279+0000","last_unstale":"2024-09-10T06:26:41.296471+0000","last_undegraded":"2024-09-10T06:26:41.296471+0000","last_fullsized":"2024-09-10T06:26:41.296471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:42.052702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.088525+0000","last_change":"2024-09-10T06:26:36.273991+0000","last_active":"2024-09-10T06:26:42.088525+0000","last_peered":"2024-09-10T06:26:42.088525+0000","last_clean":"2024-09-10T06:26:42.088525+0000","last_became_active":"2024-09-10T06:26:36.273138+0000","last_became_peered":"2024-09-10T06:26:36.273138+0000","last_unstale":"2024-09-10T06:26:42.088525+0000","last_undegraded":"2024-09-10T06:26:42.088525+0000","last_fullsized":"2024-09-10T06:26:42.088525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295041+0000","last_change":"2024-09-10T06:26:38.294543+0000","last_active":"2024-09-10T06:26:41.295041+0000","last_peered":"2024-09-10T06:26:41.295041+0000","last_clean":"2024-09-10T06:26:41.295041+0000","last_became_active":"2024-09-10T06:26:38.293754+0000","last_became_peered":"2024-09-10T06:26:38.293754+0000","last_unstale":"2024-09-10T06:26:41.295041+0000","last_undegraded":"2024-09-10T06:26:41.295041+0000","last_fullsized":"2024-09-10T06:26:41.295041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329177+0000","last_change":"2024-09-10T06:26:40.326998+0000","last_active":"2024-09-10T06:26:41.329177+0000","last_peered":"2024-09-10T06:26:41.329177+0000","last_clean":"2024-09-10T06:26:41.329177+0000","last_became_active":"2024-09-10T06:26:40.322648+0000","last_became_peered":"2024-09-10T06:26:40.322648+0000","last_unstale":"2024-09-10T06:26:41.329177+0000","last_undegraded":"2024-09-10T06:26:41.329177+0000","last_fullsized":"2024-09-10T06:26:41.329177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:19.837495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331907+0000","last_change":"2024-09-10T06:26:32.256959+0000","last_active":"2024-09-10T06:26:41.331907+0000","last_peered":"2024-09-10T06:26:41.331907+0000","last_clean":"2024-09-10T06:26:41.331907+0000","last_became_active":"2024-09-10T06:26:32.256701+0000","last_became_peered":"2024-09-10T06:26:32.256701+0000","last_unstale":"2024-09-10T06:26:41.331907+0000","last_undegraded":"2024-09-10T06:26:41.331907+0000","last_fullsized":"2024-09-10T06:26:41.331907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311702+0000","last_change":"2024-09-10T06:26:30.598409+0000","last_active":"2024-09-10T06:26:41.311702+0000","last_peered":"2024-09-10T06:26:41.311702+0000","last_clean":"2024-09-10T06:26:41.311702+0000","last_became_active":"2024-09-10T06:26:30.597703+0000","last_became_peered":"2024-09-10T06:26:30.597703+0000","last_unstale":"2024-09-10T06:26:41.311702+0000","last_undegraded":"2024-09-10T06:26:41.311702+0000","last_fullsized":"2024-09-10T06:26:41.311702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.299939+0000","last_change":"2024-09-10T06:26:34.268741+0000","last_active":"2024-09-10T06:26:41.299939+0000","last_peered":"2024-09-10T06:26:41.299939+0000","last_clean":"2024-09-10T06:26:41.299939+0000","last_became_active":"2024-09-10T06:26:34.268192+0000","last_became_peered":"2024-09-10T06:26:34.268192+0000","last_unstale":"2024-09-10T06:26:41.299939+0000","last_undegraded":"2024-09-10T06:26:41.299939+0000","last_fullsized":"2024-09-10T06:26:41.299939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:42:10.110645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.142367+0000","last_change":"2024-09-10T06:26:36.275955+0000","last_active":"2024-09-10T06:26:42.142367+0000","last_peered":"2024-09-10T06:26:42.142367+0000","last_clean":"2024-09-10T06:26:42.142367+0000","last_became_active":"2024-09-10T06:26:36.275306+0000","last_became_peered":"2024-09-10T06:26:36.275306+0000","last_unstale":"2024-09-10T06:26:42.142367+0000","last_undegraded":"2024-09-10T06:26:42.142367+0000","last_fullsized":"2024-09-10T06:26:42.142367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:03.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312359+0000","last_change":"2024-09-10T06:26:38.302764+0000","last_active":"2024-09-10T06:26:41.312359+0000","last_peered":"2024-09-10T06:26:41.312359+0000","last_clean":"2024-09-10T06:26:41.312359+0000","last_became_active":"2024-09-10T06:26:38.300326+0000","last_became_peered":"2024-09-10T06:26:38.300326+0000","last_unstale":"2024-09-10T06:26:41.312359+0000","last_undegraded":"2024-09-10T06:26:41.312359+0000","last_fullsized":"2024-09-10T06:26:41.312359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:29.851085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293767+0000","last_change":"2024-09-10T06:26:40.297893+0000","last_active":"2024-09-10T06:26:41.293767+0000","last_peered":"2024-09-10T06:26:41.293767+0000","last_clean":"2024-09-10T06:26:41.293767+0000","last_became_active":"2024-09-10T06:26:40.297296+0000","last_became_peered":"2024-09-10T06:26:40.297296+0000","last_unstale":"2024-09-10T06:26:41.293767+0000","last_undegraded":"2024-09-10T06:26:41.293767+0000","last_fullsized":"2024-09-10T06:26:41.293767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298579+0000","last_change":"2024-09-10T06:26:32.265005+0000","last_active":"2024-09-10T06:26:41.298579+0000","last_peered":"2024-09-10T06:26:41.298579+0000","last_clean":"2024-09-10T06:26:41.298579+0000","last_became_active":"2024-09-10T06:26:32.264334+0000","last_became_peered":"2024-09-10T06:26:32.264334+0000","last_unstale":"2024-09-10T06:26:41.298579+0000","last_undegraded":"2024-09-10T06:26:41.298579+0000","last_fullsized":"2024-09-10T06:26:41.298579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325847+0000","last_change":"2024-09-10T06:26:30.576242+0000","last_active":"2024-09-10T06:26:41.325847+0000","last_peered":"2024-09-10T06:26:41.325847+0000","last_clean":"2024-09-10T06:26:41.325847+0000","last_became_active":"2024-09-10T06:26:30.575433+0000","last_became_peered":"2024-09-10T06:26:30.575433+0000","last_unstale":"2024-09-10T06:26:41.325847+0000","last_undegraded":"2024-09-10T06:26:41.325847+0000","last_fullsized":"2024-09-10T06:26:41.325847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323607+0000","last_change":"2024-09-10T06:26:34.283701+0000","last_active":"2024-09-10T06:26:41.323607+0000","last_peered":"2024-09-10T06:26:41.323607+0000","last_clean":"2024-09-10T06:26:41.323607+0000","last_became_active":"2024-09-10T06:26:34.282941+0000","last_became_peered":"2024-09-10T06:26:34.282941+0000","last_unstale":"2024-09-10T06:26:41.323607+0000","last_undegraded":"2024-09-10T06:26:41.323607+0000","last_fullsized":"2024-09-10T06:26:41.323607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:29.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.149521+0000","last_change":"2024-09-10T06:26:36.298510+0000","last_active":"2024-09-10T06:26:42.149521+0000","last_peered":"2024-09-10T06:26:42.149521+0000","last_clean":"2024-09-10T06:26:42.149521+0000","last_became_active":"2024-09-10T06:26:36.297309+0000","last_became_peered":"2024-09-10T06:26:36.297309+0000","last_unstale":"2024-09-10T06:26:42.149521+0000","last_undegraded":"2024-09-10T06:26:42.149521+0000","last_fullsized":"2024-09-10T06:26:42.149521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295876+0000","last_change":"2024-09-10T06:26:38.300228+0000","last_active":"2024-09-10T06:26:41.295876+0000","last_peered":"2024-09-10T06:26:41.295876+0000","last_clean":"2024-09-10T06:26:41.295876+0000","last_became_active":"2024-09-10T06:26:38.299355+0000","last_became_peered":"2024-09-10T06:26:38.299355+0000","last_unstale":"2024-09-10T06:26:41.295876+0000","last_undegraded":"2024-09-10T06:26:41.295876+0000","last_fullsized":"2024-09-10T06:26:41.295876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:20.050096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.321782+0000","last_change":"2024-09-10T06:26:32.271283+0000","last_active":"2024-09-10T06:26:41.321782+0000","last_peered":"2024-09-10T06:26:41.321782+0000","last_clean":"2024-09-10T06:26:41.321782+0000","last_became_active":"2024-09-10T06:26:32.270496+0000","last_became_peered":"2024-09-10T06:26:32.270496+0000","last_unstale":"2024-09-10T06:26:41.321782+0000","last_undegraded":"2024-09-10T06:26:41.321782+0000","last_fullsized":"2024-09-10T06:26:41.321782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313228+0000","last_change":"2024-09-10T06:26:30.607373+0000","last_active":"2024-09-10T06:26:41.313228+0000","last_peered":"2024-09-10T06:26:41.313228+0000","last_clean":"2024-09-10T06:26:41.313228+0000","last_became_active":"2024-09-10T06:26:30.606685+0000","last_became_peered":"2024-09-10T06:26:30.606685+0000","last_unstale":"2024-09-10T06:26:41.313228+0000","last_undegraded":"2024-09-10T06:26:41.313228+0000","last_fullsized":"2024-09-10T06:26:41.313228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:35.705564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.310960+0000","last_change":"2024-09-10T06:26:34.286925+0000","last_active":"2024-09-10T06:26:41.310960+0000","last_peered":"2024-09-10T06:26:41.310960+0000","last_clean":"2024-09-10T06:26:41.310960+0000","last_became_active":"2024-09-10T06:26:34.285787+0000","last_became_peered":"2024-09-10T06:26:34.285787+0000","last_unstale":"2024-09-10T06:26:41.310960+0000","last_undegraded":"2024-09-10T06:26:41.310960+0000","last_fullsized":"2024-09-10T06:26:41.310960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"34'19","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.247172+0000","last_change":"2024-09-10T06:26:36.293988+0000","last_active":"2024-09-10T06:26:42.247172+0000","last_peered":"2024-09-10T06:26:42.247172+0000","last_clean":"2024-09-10T06:26:42.247172+0000","last_became_active":"2024-09-10T06:26:36.293226+0000","last_became_peered":"2024-09-10T06:26:36.293226+0000","last_unstale":"2024-09-10T06:26:42.247172+0000","last_undegraded":"2024-09-10T06:26:42.247172+0000","last_fullsized":"2024-09-10T06:26:42.247172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.314893+0000","last_change":"2024-09-10T06:26:38.305826+0000","last_active":"2024-09-10T06:26:41.314893+0000","last_peered":"2024-09-10T06:26:41.314893+0000","last_clean":"2024-09-10T06:26:41.314893+0000","last_became_active":"2024-09-10T06:26:38.304601+0000","last_became_peered":"2024-09-10T06:26:38.304601+0000","last_unstale":"2024-09-10T06:26:41.314893+0000","last_undegraded":"2024-09-10T06:26:41.314893+0000","last_fullsized":"2024-09-10T06:26:41.314893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:12.545261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323269+0000","last_change":"2024-09-10T06:26:40.332286+0000","last_active":"2024-09-10T06:26:41.323269+0000","last_peered":"2024-09-10T06:26:41.323269+0000","last_clean":"2024-09-10T06:26:41.323269+0000","last_became_active":"2024-09-10T06:26:40.331262+0000","last_became_peered":"2024-09-10T06:26:40.331262+0000","last_unstale":"2024-09-10T06:26:41.323269+0000","last_undegraded":"2024-09-10T06:26:41.323269+0000","last_fullsized":"2024-09-10T06:26:41.323269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293198+0000","last_change":"2024-09-10T06:26:32.262320+0000","last_active":"2024-09-10T06:26:41.293198+0000","last_peered":"2024-09-10T06:26:41.293198+0000","last_clean":"2024-09-10T06:26:41.293198+0000","last_became_active":"2024-09-10T06:26:32.261423+0000","last_became_peered":"2024-09-10T06:26:32.261423+0000","last_unstale":"2024-09-10T06:26:41.293198+0000","last_undegraded":"2024-09-10T06:26:41.293198+0000","last_fullsized":"2024-09-10T06:26:41.293198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312990+0000","last_change":"2024-09-10T06:26:30.595879+0000","last_active":"2024-09-10T06:26:41.312990+0000","last_peered":"2024-09-10T06:26:41.312990+0000","last_clean":"2024-09-10T06:26:41.312990+0000","last_became_active":"2024-09-10T06:26:30.595269+0000","last_became_peered":"2024-09-10T06:26:30.595269+0000","last_unstale":"2024-09-10T06:26:41.312990+0000","last_undegraded":"2024-09-10T06:26:41.312990+0000","last_fullsized":"2024-09-10T06:26:41.312990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.292695+0000","last_change":"2024-09-10T06:26:34.266906+0000","last_active":"2024-09-10T06:26:41.292695+0000","last_peered":"2024-09-10T06:26:41.292695+0000","last_clean":"2024-09-10T06:26:41.292695+0000","last_became_active":"2024-09-10T06:26:34.266017+0000","last_became_peered":"2024-09-10T06:26:34.266017+0000","last_unstale":"2024-09-10T06:26:41.292695+0000","last_undegraded":"2024-09-10T06:26:41.292695+0000","last_fullsized":"2024-09-10T06:26:41.292695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:24.366166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.122083+0000","last_change":"2024-09-10T06:26:36.297020+0000","last_active":"2024-09-10T06:26:42.122083+0000","last_peered":"2024-09-10T06:26:42.122083+0000","last_clean":"2024-09-10T06:26:42.122083+0000","last_became_active":"2024-09-10T06:26:36.295796+0000","last_became_peered":"2024-09-10T06:26:36.295796+0000","last_unstale":"2024-09-10T06:26:42.122083+0000","last_undegraded":"2024-09-10T06:26:42.122083+0000","last_fullsized":"2024-09-10T06:26:42.122083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294336+0000","last_change":"2024-09-10T06:26:38.297273+0000","last_active":"2024-09-10T06:26:41.294336+0000","last_peered":"2024-09-10T06:26:41.294336+0000","last_clean":"2024-09-10T06:26:41.294336+0000","last_became_active":"2024-09-10T06:26:38.296455+0000","last_became_peered":"2024-09-10T06:26:38.296455+0000","last_unstale":"2024-09-10T06:26:41.294336+0000","last_undegraded":"2024-09-10T06:26:41.294336+0000","last_fullsized":"2024-09-10T06:26:41.294336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:26.766702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327224+0000","last_change":"2024-09-10T06:26:40.328294+0000","last_active":"2024-09-10T06:26:41.327224+0000","last_peered":"2024-09-10T06:26:41.327224+0000","last_clean":"2024-09-10T06:26:41.327224+0000","last_became_active":"2024-09-10T06:26:40.327585+0000","last_became_peered":"2024-09-10T06:26:40.327585+0000","last_unstale":"2024-09-10T06:26:41.327224+0000","last_undegraded":"2024-09-10T06:26:41.327224+0000","last_fullsized":"2024-09-10T06:26:41.327224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.537210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326793+0000","last_change":"2024-09-10T06:26:32.286363+0000","last_active":"2024-09-10T06:26:41.326793+0000","last_peered":"2024-09-10T06:26:41.326793+0000","last_clean":"2024-09-10T06:26:41.326793+0000","last_became_active":"2024-09-10T06:26:32.283607+0000","last_became_peered":"2024-09-10T06:26:32.283607+0000","last_unstale":"2024-09-10T06:26:41.326793+0000","last_undegraded":"2024-09-10T06:26:41.326793+0000","last_fullsized":"2024-09-10T06:26:41.326793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:59.437136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313347+0000","last_change":"2024-09-10T06:26:30.611704+0000","last_active":"2024-09-10T06:26:41.313347+0000","last_peered":"2024-09-10T06:26:41.313347+0000","last_clean":"2024-09-10T06:26:41.313347+0000","last_became_active":"2024-09-10T06:26:30.611039+0000","last_became_peered":"2024-09-10T06:26:30.611039+0000","last_unstale":"2024-09-10T06:26:41.313347+0000","last_undegraded":"2024-09-10T06:26:41.313347+0000","last_fullsized":"2024-09-10T06:26:41.313347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294418+0000","last_change":"2024-09-10T06:26:34.263514+0000","last_active":"2024-09-10T06:26:41.294418+0000","last_peered":"2024-09-10T06:26:41.294418+0000","last_clean":"2024-09-10T06:26:41.294418+0000","last_became_active":"2024-09-10T06:26:34.262793+0000","last_became_peered":"2024-09-10T06:26:34.262793+0000","last_unstale":"2024-09-10T06:26:41.294418+0000","last_undegraded":"2024-09-10T06:26:41.294418+0000","last_fullsized":"2024-09-10T06:26:41.294418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:31.501738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.040994+0000","last_change":"2024-09-10T06:26:36.299923+0000","last_active":"2024-09-10T06:26:42.040994+0000","last_peered":"2024-09-10T06:26:42.040994+0000","last_clean":"2024-09-10T06:26:42.040994+0000","last_became_active":"2024-09-10T06:26:36.299140+0000","last_became_peered":"2024-09-10T06:26:36.299140+0000","last_unstale":"2024-09-10T06:26:42.040994+0000","last_undegraded":"2024-09-10T06:26:42.040994+0000","last_fullsized":"2024-09-10T06:26:42.040994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:12.246303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328275+0000","last_change":"2024-09-10T06:26:38.292019+0000","last_active":"2024-09-10T06:26:41.328275+0000","last_peered":"2024-09-10T06:26:41.328275+0000","last_clean":"2024-09-10T06:26:41.328275+0000","last_became_active":"2024-09-10T06:26:38.291322+0000","last_became_peered":"2024-09-10T06:26:38.291322+0000","last_unstale":"2024-09-10T06:26:41.328275+0000","last_undegraded":"2024-09-10T06:26:41.328275+0000","last_fullsized":"2024-09-10T06:26:41.328275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330919+0000","last_change":"2024-09-10T06:26:40.328427+0000","last_active":"2024-09-10T06:26:41.330919+0000","last_peered":"2024-09-10T06:26:41.330919+0000","last_clean":"2024-09-10T06:26:41.330919+0000","last_became_active":"2024-09-10T06:26:40.323249+0000","last_became_peered":"2024-09-10T06:26:40.323249+0000","last_unstale":"2024-09-10T06:26:41.330919+0000","last_undegraded":"2024-09-10T06:26:41.330919+0000","last_fullsized":"2024-09-10T06:26:41.330919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:50.823195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330386+0000","last_change":"2024-09-10T06:26:32.274824+0000","last_active":"2024-09-10T06:26:41.330386+0000","last_peered":"2024-09-10T06:26:41.330386+0000","last_clean":"2024-09-10T06:26:41.330386+0000","last_became_active":"2024-09-10T06:26:32.274496+0000","last_became_peered":"2024-09-10T06:26:32.274496+0000","last_unstale":"2024-09-10T06:26:41.330386+0000","last_undegraded":"2024-09-10T06:26:41.330386+0000","last_fullsized":"2024-09-10T06:26:41.330386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:39.513476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.324293+0000","last_change":"2024-09-10T06:26:30.604684+0000","last_active":"2024-09-10T06:26:41.324293+0000","last_peered":"2024-09-10T06:26:41.324293+0000","last_clean":"2024-09-10T06:26:41.324293+0000","last_became_active":"2024-09-10T06:26:30.593432+0000","last_became_peered":"2024-09-10T06:26:30.593432+0000","last_unstale":"2024-09-10T06:26:41.324293+0000","last_undegraded":"2024-09-10T06:26:41.324293+0000","last_fullsized":"2024-09-10T06:26:41.324293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293897+0000","last_change":"2024-09-10T06:26:34.256662+0000","last_active":"2024-09-10T06:26:41.293897+0000","last_peered":"2024-09-10T06:26:41.293897+0000","last_clean":"2024-09-10T06:26:41.293897+0000","last_became_active":"2024-09-10T06:26:34.256256+0000","last_became_peered":"2024-09-10T06:26:34.256256+0000","last_unstale":"2024-09-10T06:26:41.293897+0000","last_undegraded":"2024-09-10T06:26:41.293897+0000","last_fullsized":"2024-09-10T06:26:41.293897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:35.549063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'12","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.672303+0000","last_change":"2024-09-10T06:26:36.296631+0000","last_active":"2024-09-10T06:26:41.672303+0000","last_peered":"2024-09-10T06:26:41.672303+0000","last_clean":"2024-09-10T06:26:41.672303+0000","last_became_active":"2024-09-10T06:26:36.295838+0000","last_became_peered":"2024-09-10T06:26:36.295838+0000","last_unstale":"2024-09-10T06:26:41.672303+0000","last_undegraded":"2024-09-10T06:26:41.672303+0000","last_fullsized":"2024-09-10T06:26:41.672303+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:04.271824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.291766+0000","last_change":"2024-09-10T06:26:38.308698+0000","last_active":"2024-09-10T06:26:41.291766+0000","last_peered":"2024-09-10T06:26:41.291766+0000","last_clean":"2024-09-10T06:26:41.291766+0000","last_became_active":"2024-09-10T06:26:38.307965+0000","last_became_peered":"2024-09-10T06:26:38.307965+0000","last_unstale":"2024-09-10T06:26:41.291766+0000","last_undegraded":"2024-09-10T06:26:41.291766+0000","last_fullsized":"2024-09-10T06:26:41.291766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:04.566221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.317226+0000","last_change":"2024-09-10T06:26:40.326474+0000","last_active":"2024-09-10T06:26:41.317226+0000","last_peered":"2024-09-10T06:26:41.317226+0000","last_clean":"2024-09-10T06:26:41.317226+0000","last_became_active":"2024-09-10T06:26:40.325731+0000","last_became_peered":"2024-09-10T06:26:40.325731+0000","last_unstale":"2024-09-10T06:26:41.317226+0000","last_undegraded":"2024-09-10T06:26:41.317226+0000","last_fullsized":"2024-09-10T06:26:41.317226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:19.400355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294928+0000","last_change":"2024-09-10T06:26:32.254177+0000","last_active":"2024-09-10T06:26:41.294928+0000","last_peered":"2024-09-10T06:26:41.294928+0000","last_clean":"2024-09-10T06:26:41.294928+0000","last_became_active":"2024-09-10T06:26:32.253154+0000","last_became_peered":"2024-09-10T06:26:32.253154+0000","last_unstale":"2024-09-10T06:26:41.294928+0000","last_undegraded":"2024-09-10T06:26:41.294928+0000","last_fullsized":"2024-09-10T06:26:41.294928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293961+0000","last_change":"2024-09-10T06:26:30.572406+0000","last_active":"2024-09-10T06:26:41.293961+0000","last_peered":"2024-09-10T06:26:41.293961+0000","last_clean":"2024-09-10T06:26:41.293961+0000","last_became_active":"2024-09-10T06:26:30.571829+0000","last_became_peered":"2024-09-10T06:26:30.571829+0000","last_unstale":"2024-09-10T06:26:41.293961+0000","last_undegraded":"2024-09-10T06:26:41.293961+0000","last_fullsized":"2024-09-10T06:26:41.293961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.297974+0000","last_change":"2024-09-10T06:26:34.285406+0000","last_active":"2024-09-10T06:26:41.297974+0000","last_peered":"2024-09-10T06:26:41.297974+0000","last_clean":"2024-09-10T06:26:41.297974+0000","last_became_active":"2024-09-10T06:26:34.285004+0000","last_became_peered":"2024-09-10T06:26:34.285004+0000","last_unstale":"2024-09-10T06:26:41.297974+0000","last_undegraded":"2024-09-10T06:26:41.297974+0000","last_fullsized":"2024-09-10T06:26:41.297974+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:03.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.183676+0000","last_change":"2024-09-10T06:26:36.293191+0000","last_active":"2024-09-10T06:26:42.183676+0000","last_peered":"2024-09-10T06:26:42.183676+0000","last_clean":"2024-09-10T06:26:42.183676+0000","last_became_active":"2024-09-10T06:26:36.292423+0000","last_became_peered":"2024-09-10T06:26:36.292423+0000","last_unstale":"2024-09-10T06:26:42.183676+0000","last_undegraded":"2024-09-10T06:26:42.183676+0000","last_fullsized":"2024-09-10T06:26:42.183676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331144+0000","last_change":"2024-09-10T06:26:38.293667+0000","last_active":"2024-09-10T06:26:41.331144+0000","last_peered":"2024-09-10T06:26:41.331144+0000","last_clean":"2024-09-10T06:26:41.331144+0000","last_became_active":"2024-09-10T06:26:38.292918+0000","last_became_peered":"2024-09-10T06:26:38.292918+0000","last_unstale":"2024-09-10T06:26:41.331144+0000","last_undegraded":"2024-09-10T06:26:41.331144+0000","last_fullsized":"2024-09-10T06:26:41.331144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:57.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293062+0000","last_change":"2024-09-10T06:26:40.327061+0000","last_active":"2024-09-10T06:26:41.293062+0000","last_peered":"2024-09-10T06:26:41.293062+0000","last_clean":"2024-09-10T06:26:41.293062+0000","last_became_active":"2024-09-10T06:26:40.326431+0000","last_became_peered":"2024-09-10T06:26:40.326431+0000","last_unstale":"2024-09-10T06:26:41.293062+0000","last_undegraded":"2024-09-10T06:26:41.293062+0000","last_fullsized":"2024-09-10T06:26:41.293062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:27.631214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295317+0000","last_change":"2024-09-10T06:26:32.255139+0000","last_active":"2024-09-10T06:26:41.295317+0000","last_peered":"2024-09-10T06:26:41.295317+0000","last_clean":"2024-09-10T06:26:41.295317+0000","last_became_active":"2024-09-10T06:26:32.253524+0000","last_became_peered":"2024-09-10T06:26:32.253524+0000","last_unstale":"2024-09-10T06:26:41.295317+0000","last_undegraded":"2024-09-10T06:26:41.295317+0000","last_fullsized":"2024-09-10T06:26:41.295317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326951+0000","last_change":"2024-09-10T06:26:30.591838+0000","last_active":"2024-09-10T06:26:41.326951+0000","last_peered":"2024-09-10T06:26:41.326951+0000","last_clean":"2024-09-10T06:26:41.326951+0000","last_became_active":"2024-09-10T06:26:30.591125+0000","last_became_peered":"2024-09-10T06:26:30.591125+0000","last_unstale":"2024-09-10T06:26:41.326951+0000","last_undegraded":"2024-09-10T06:26:41.326951+0000","last_fullsized":"2024-09-10T06:26:41.326951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.314952+0000","last_change":"2024-09-10T06:26:34.280391+0000","last_active":"2024-09-10T06:26:41.314952+0000","last_peered":"2024-09-10T06:26:41.314952+0000","last_clean":"2024-09-10T06:26:41.314952+0000","last_became_active":"2024-09-10T06:26:34.280058+0000","last_became_peered":"2024-09-10T06:26:34.280058+0000","last_unstale":"2024-09-10T06:26:41.314952+0000","last_undegraded":"2024-09-10T06:26:41.314952+0000","last_fullsized":"2024-09-10T06:26:41.314952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.461857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.254333+0000","last_change":"2024-09-10T06:26:36.277547+0000","last_active":"2024-09-10T06:26:42.254333+0000","last_peered":"2024-09-10T06:26:42.254333+0000","last_clean":"2024-09-10T06:26:42.254333+0000","last_became_active":"2024-09-10T06:26:36.276965+0000","last_became_peered":"2024-09-10T06:26:36.276965+0000","last_unstale":"2024-09-10T06:26:42.254333+0000","last_undegraded":"2024-09-10T06:26:42.254333+0000","last_fullsized":"2024-09-10T06:26:42.254333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:43.212945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298573+0000","last_change":"2024-09-10T06:26:38.306134+0000","last_active":"2024-09-10T06:26:41.298573+0000","last_peered":"2024-09-10T06:26:41.298573+0000","last_clean":"2024-09-10T06:26:41.298573+0000","last_became_active":"2024-09-10T06:26:38.299012+0000","last_became_peered":"2024-09-10T06:26:38.299012+0000","last_unstale":"2024-09-10T06:26:41.298573+0000","last_undegraded":"2024-09-10T06:26:41.298573+0000","last_fullsized":"2024-09-10T06:26:41.298573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:37.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315050+0000","last_change":"2024-09-10T06:26:40.336036+0000","last_active":"2024-09-10T06:26:41.315050+0000","last_peered":"2024-09-10T06:26:41.315050+0000","last_clean":"2024-09-10T06:26:41.315050+0000","last_became_active":"2024-09-10T06:26:40.335302+0000","last_became_peered":"2024-09-10T06:26:40.335302+0000","last_unstale":"2024-09-10T06:26:41.315050+0000","last_undegraded":"2024-09-10T06:26:41.315050+0000","last_fullsized":"2024-09-10T06:26:41.315050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:24.024562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295633+0000","last_change":"2024-09-10T06:26:32.287897+0000","last_active":"2024-09-10T06:26:41.295633+0000","last_peered":"2024-09-10T06:26:41.295633+0000","last_clean":"2024-09-10T06:26:41.295633+0000","last_became_active":"2024-09-10T06:26:32.287315+0000","last_became_peered":"2024-09-10T06:26:32.287315+0000","last_unstale":"2024-09-10T06:26:41.295633+0000","last_undegraded":"2024-09-10T06:26:41.295633+0000","last_fullsized":"2024-09-10T06:26:41.295633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293886+0000","last_change":"2024-09-10T06:26:30.569192+0000","last_active":"2024-09-10T06:26:41.293886+0000","last_peered":"2024-09-10T06:26:41.293886+0000","last_clean":"2024-09-10T06:26:41.293886+0000","last_became_active":"2024-09-10T06:26:30.568464+0000","last_became_peered":"2024-09-10T06:26:30.568464+0000","last_unstale":"2024-09-10T06:26:41.293886+0000","last_undegraded":"2024-09-10T06:26:41.293886+0000","last_fullsized":"2024-09-10T06:26:41.293886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:58.987914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.324472+0000","last_change":"2024-09-10T06:26:34.279935+0000","last_active":"2024-09-10T06:26:41.324472+0000","last_peered":"2024-09-10T06:26:41.324472+0000","last_clean":"2024-09-10T06:26:41.324472+0000","last_became_active":"2024-09-10T06:26:34.279192+0000","last_became_peered":"2024-09-10T06:26:34.279192+0000","last_unstale":"2024-09-10T06:26:41.324472+0000","last_undegraded":"2024-09-10T06:26:41.324472+0000","last_fullsized":"2024-09-10T06:26:41.324472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:18.753175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.048507+0000","last_change":"2024-09-10T06:26:36.290330+0000","last_active":"2024-09-10T06:26:42.048507+0000","last_peered":"2024-09-10T06:26:42.048507+0000","last_clean":"2024-09-10T06:26:42.048507+0000","last_became_active":"2024-09-10T06:26:36.289527+0000","last_became_peered":"2024-09-10T06:26:36.289527+0000","last_unstale":"2024-09-10T06:26:42.048507+0000","last_undegraded":"2024-09-10T06:26:42.048507+0000","last_fullsized":"2024-09-10T06:26:42.048507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327437+0000","last_change":"2024-09-10T06:26:38.288663+0000","last_active":"2024-09-10T06:26:41.327437+0000","last_peered":"2024-09-10T06:26:41.327437+0000","last_clean":"2024-09-10T06:26:41.327437+0000","last_became_active":"2024-09-10T06:26:38.287740+0000","last_became_peered":"2024-09-10T06:26:38.287740+0000","last_unstale":"2024-09-10T06:26:41.327437+0000","last_undegraded":"2024-09-10T06:26:41.327437+0000","last_fullsized":"2024-09-10T06:26:41.327437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:22.078943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293869+0000","last_change":"2024-09-10T06:26:40.329737+0000","last_active":"2024-09-10T06:26:41.293869+0000","last_peered":"2024-09-10T06:26:41.293869+0000","last_clean":"2024-09-10T06:26:41.293869+0000","last_became_active":"2024-09-10T06:26:40.328952+0000","last_became_peered":"2024-09-10T06:26:40.328952+0000","last_unstale":"2024-09-10T06:26:41.293869+0000","last_undegraded":"2024-09-10T06:26:41.293869+0000","last_fullsized":"2024-09-10T06:26:41.293869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.317001+0000","last_change":"2024-09-10T06:26:32.270997+0000","last_active":"2024-09-10T06:26:41.317001+0000","last_peered":"2024-09-10T06:26:41.317001+0000","last_clean":"2024-09-10T06:26:41.317001+0000","last_became_active":"2024-09-10T06:26:32.270265+0000","last_became_peered":"2024-09-10T06:26:32.270265+0000","last_unstale":"2024-09-10T06:26:41.317001+0000","last_undegraded":"2024-09-10T06:26:41.317001+0000","last_fullsized":"2024-09-10T06:26:41.317001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:33.067523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295104+0000","last_change":"2024-09-10T06:26:30.563666+0000","last_active":"2024-09-10T06:26:41.295104+0000","last_peered":"2024-09-10T06:26:41.295104+0000","last_clean":"2024-09-10T06:26:41.295104+0000","last_became_active":"2024-09-10T06:26:30.563244+0000","last_became_peered":"2024-09-10T06:26:30.563244+0000","last_unstale":"2024-09-10T06:26:41.295104+0000","last_undegraded":"2024-09-10T06:26:41.295104+0000","last_fullsized":"2024-09-10T06:26:41.295104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:17.165772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295380+0000","last_change":"2024-09-10T06:26:34.286497+0000","last_active":"2024-09-10T06:26:41.295380+0000","last_peered":"2024-09-10T06:26:41.295380+0000","last_clean":"2024-09-10T06:26:41.295380+0000","last_became_active":"2024-09-10T06:26:34.285334+0000","last_became_peered":"2024-09-10T06:26:34.285334+0000","last_unstale":"2024-09-10T06:26:41.295380+0000","last_undegraded":"2024-09-10T06:26:41.295380+0000","last_fullsized":"2024-09-10T06:26:41.295380+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:54.506182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'17","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.176727+0000","last_change":"2024-09-10T06:26:36.288213+0000","last_active":"2024-09-10T06:26:42.176727+0000","last_peered":"2024-09-10T06:26:42.176727+0000","last_clean":"2024-09-10T06:26:42.176727+0000","last_became_active":"2024-09-10T06:26:36.287468+0000","last_became_peered":"2024-09-10T06:26:36.287468+0000","last_unstale":"2024-09-10T06:26:42.176727+0000","last_undegraded":"2024-09-10T06:26:42.176727+0000","last_fullsized":"2024-09-10T06:26:42.176727+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326731+0000","last_change":"2024-09-10T06:26:38.291943+0000","last_active":"2024-09-10T06:26:41.326731+0000","last_peered":"2024-09-10T06:26:41.326731+0000","last_clean":"2024-09-10T06:26:41.326731+0000","last_became_active":"2024-09-10T06:26:38.291214+0000","last_became_peered":"2024-09-10T06:26:38.291214+0000","last_unstale":"2024-09-10T06:26:41.326731+0000","last_undegraded":"2024-09-10T06:26:41.326731+0000","last_fullsized":"2024-09-10T06:26:41.326731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:56.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315089+0000","last_change":"2024-09-10T06:26:40.331977+0000","last_active":"2024-09-10T06:26:41.315089+0000","last_peered":"2024-09-10T06:26:41.315089+0000","last_clean":"2024-09-10T06:26:41.315089+0000","last_became_active":"2024-09-10T06:26:40.331502+0000","last_became_peered":"2024-09-10T06:26:40.331502+0000","last_unstale":"2024-09-10T06:26:41.315089+0000","last_undegraded":"2024-09-10T06:26:41.315089+0000","last_fullsized":"2024-09-10T06:26:41.315089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:43.572813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327789+0000","last_change":"2024-09-10T06:26:32.274623+0000","last_active":"2024-09-10T06:26:41.327789+0000","last_peered":"2024-09-10T06:26:41.327789+0000","last_clean":"2024-09-10T06:26:41.327789+0000","last_became_active":"2024-09-10T06:26:32.273727+0000","last_became_peered":"2024-09-10T06:26:32.273727+0000","last_unstale":"2024-09-10T06:26:41.327789+0000","last_undegraded":"2024-09-10T06:26:41.327789+0000","last_fullsized":"2024-09-10T06:26:41.327789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:15.364938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":137,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311709+0000","last_change":"2024-09-10T06:26:18.153206+0000","last_active":"2024-09-10T06:26:41.311709+0000","last_peered":"2024-09-10T06:26:41.311709+0000","last_clean":"2024-09-10T06:26:41.311709+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:26:41.311709+0000","last_undegraded":"2024-09-10T06:26:41.311709+0000","last_fullsized":"2024-09-10T06:26:41.311709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_clean_scrub_stamp":"2024-09-10T06:26:16.422775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:42.510577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323062+0000","last_change":"2024-09-10T06:26:25.532465+0000","last_active":"2024-09-10T06:26:41.323062+0000","last_peered":"2024-09-10T06:26:41.323062+0000","last_clean":"2024-09-10T06:26:41.323062+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:26:41.323062+0000","last_undegraded":"2024-09-10T06:26:41.323062+0000","last_fullsized":"2024-09-10T06:26:41.323062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:10.318844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295321+0000","last_change":"2024-09-10T06:26:30.606630+0000","last_active":"2024-09-10T06:26:41.295321+0000","last_peered":"2024-09-10T06:26:41.295321+0000","last_clean":"2024-09-10T06:26:41.295321+0000","last_became_active":"2024-09-10T06:26:30.606348+0000","last_became_peered":"2024-09-10T06:26:30.606348+0000","last_unstale":"2024-09-10T06:26:41.295321+0000","last_undegraded":"2024-09-10T06:26:41.295321+0000","last_fullsized":"2024-09-10T06:26:41.295321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312606+0000","last_change":"2024-09-10T06:26:34.287201+0000","last_active":"2024-09-10T06:26:41.312606+0000","last_peered":"2024-09-10T06:26:41.312606+0000","last_clean":"2024-09-10T06:26:41.312606+0000","last_became_active":"2024-09-10T06:26:34.285248+0000","last_became_peered":"2024-09-10T06:26:34.285248+0000","last_unstale":"2024-09-10T06:26:41.312606+0000","last_undegraded":"2024-09-10T06:26:41.312606+0000","last_fullsized":"2024-09-10T06:26:41.312606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:43.907684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'13","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.980582+0000","last_change":"2024-09-10T06:26:36.296684+0000","last_active":"2024-09-10T06:26:41.980582+0000","last_peered":"2024-09-10T06:26:41.980582+0000","last_clean":"2024-09-10T06:26:41.980582+0000","last_became_active":"2024-09-10T06:26:36.295901+0000","last_became_peered":"2024-09-10T06:26:36.295901+0000","last_unstale":"2024-09-10T06:26:41.980582+0000","last_undegraded":"2024-09-10T06:26:41.980582+0000","last_fullsized":"2024-09-10T06:26:41.980582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330922+0000","last_change":"2024-09-10T06:26:38.306412+0000","last_active":"2024-09-10T06:26:41.330922+0000","last_peered":"2024-09-10T06:26:41.330922+0000","last_clean":"2024-09-10T06:26:41.330922+0000","last_became_active":"2024-09-10T06:26:38.305496+0000","last_became_peered":"2024-09-10T06:26:38.305496+0000","last_unstale":"2024-09-10T06:26:41.330922+0000","last_undegraded":"2024-09-10T06:26:41.330922+0000","last_fullsized":"2024-09-10T06:26:41.330922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.370035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325879+0000","last_change":"2024-09-10T06:26:40.331981+0000","last_active":"2024-09-10T06:26:41.325879+0000","last_peered":"2024-09-10T06:26:41.325879+0000","last_clean":"2024-09-10T06:26:41.325879+0000","last_became_active":"2024-09-10T06:26:40.331294+0000","last_became_peered":"2024-09-10T06:26:40.331294+0000","last_unstale":"2024-09-10T06:26:41.325879+0000","last_undegraded":"2024-09-10T06:26:41.325879+0000","last_fullsized":"2024-09-10T06:26:41.325879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:00.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331674+0000","last_change":"2024-09-10T06:26:32.278733+0000","last_active":"2024-09-10T06:26:41.331674+0000","last_peered":"2024-09-10T06:26:41.331674+0000","last_clean":"2024-09-10T06:26:41.331674+0000","last_became_active":"2024-09-10T06:26:32.278118+0000","last_became_peered":"2024-09-10T06:26:32.278118+0000","last_unstale":"2024-09-10T06:26:41.331674+0000","last_undegraded":"2024-09-10T06:26:41.331674+0000","last_fullsized":"2024-09-10T06:26:41.331674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:58.860666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311444+0000","last_change":"2024-09-10T06:26:26.180664+0000","last_active":"2024-09-10T06:26:41.311444+0000","last_peered":"2024-09-10T06:26:41.311444+0000","last_clean":"2024-09-10T06:26:41.311444+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:26:41.311444+0000","last_undegraded":"2024-09-10T06:26:41.311444+0000","last_fullsized":"2024-09-10T06:26:41.311444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:28.793045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328668+0000","last_change":"2024-09-10T06:26:30.594315+0000","last_active":"2024-09-10T06:26:41.328668+0000","last_peered":"2024-09-10T06:26:41.328668+0000","last_clean":"2024-09-10T06:26:41.328668+0000","last_became_active":"2024-09-10T06:26:30.593978+0000","last_became_peered":"2024-09-10T06:26:30.593978+0000","last_unstale":"2024-09-10T06:26:41.328668+0000","last_undegraded":"2024-09-10T06:26:41.328668+0000","last_fullsized":"2024-09-10T06:26:41.328668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:41.851632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325045+0000","last_change":"2024-09-10T06:26:34.279889+0000","last_active":"2024-09-10T06:26:41.325045+0000","last_peered":"2024-09-10T06:26:41.325045+0000","last_clean":"2024-09-10T06:26:41.325045+0000","last_became_active":"2024-09-10T06:26:34.279147+0000","last_became_peered":"2024-09-10T06:26:34.279147+0000","last_unstale":"2024-09-10T06:26:41.325045+0000","last_undegraded":"2024-09-10T06:26:41.325045+0000","last_fullsized":"2024-09-10T06:26:41.325045+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:02.260309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"34'23","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.165762+0000","last_change":"2024-09-10T06:26:36.290005+0000","last_active":"2024-09-10T06:26:42.165762+0000","last_peered":"2024-09-10T06:26:42.165762+0000","last_clean":"2024-09-10T06:26:42.165762+0000","last_became_active":"2024-09-10T06:26:36.289232+0000","last_became_peered":"2024-09-10T06:26:36.289232+0000","last_unstale":"2024-09-10T06:26:42.165762+0000","last_undegraded":"2024-09-10T06:26:42.165762+0000","last_fullsized":"2024-09-10T06:26:42.165762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:51.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312447+0000","last_change":"2024-09-10T06:26:38.302505+0000","last_active":"2024-09-10T06:26:41.312447+0000","last_peered":"2024-09-10T06:26:41.312447+0000","last_clean":"2024-09-10T06:26:41.312447+0000","last_became_active":"2024-09-10T06:26:38.301104+0000","last_became_peered":"2024-09-10T06:26:38.301104+0000","last_unstale":"2024-09-10T06:26:41.312447+0000","last_undegraded":"2024-09-10T06:26:41.312447+0000","last_fullsized":"2024-09-10T06:26:41.312447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.863622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.314704+0000","last_change":"2024-09-10T06:26:40.320079+0000","last_active":"2024-09-10T06:26:41.314704+0000","last_peered":"2024-09-10T06:26:41.314704+0000","last_clean":"2024-09-10T06:26:41.314704+0000","last_became_active":"2024-09-10T06:26:40.319266+0000","last_became_peered":"2024-09-10T06:26:40.319266+0000","last_unstale":"2024-09-10T06:26:41.314704+0000","last_undegraded":"2024-09-10T06:26:41.314704+0000","last_fullsized":"2024-09-10T06:26:41.314704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:57.937745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.317130+0000","last_change":"2024-09-10T06:26:32.282679+0000","last_active":"2024-09-10T06:26:41.317130+0000","last_peered":"2024-09-10T06:26:41.317130+0000","last_clean":"2024-09-10T06:26:41.317130+0000","last_became_active":"2024-09-10T06:26:32.282235+0000","last_became_peered":"2024-09-10T06:26:32.282235+0000","last_unstale":"2024-09-10T06:26:41.317130+0000","last_undegraded":"2024-09-10T06:26:41.317130+0000","last_fullsized":"2024-09-10T06:26:41.317130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:27.994318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293174+0000","last_change":"2024-09-10T06:26:25.979784+0000","last_active":"2024-09-10T06:26:41.293174+0000","last_peered":"2024-09-10T06:26:41.293174+0000","last_clean":"2024-09-10T06:26:41.293174+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:26:41.293174+0000","last_undegraded":"2024-09-10T06:26:41.293174+0000","last_fullsized":"2024-09-10T06:26:41.293174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:42.490682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.314384+0000","last_change":"2024-09-10T06:26:30.570558+0000","last_active":"2024-09-10T06:26:41.314384+0000","last_peered":"2024-09-10T06:26:41.314384+0000","last_clean":"2024-09-10T06:26:41.314384+0000","last_became_active":"2024-09-10T06:26:30.570037+0000","last_became_peered":"2024-09-10T06:26:30.570037+0000","last_unstale":"2024-09-10T06:26:41.314384+0000","last_undegraded":"2024-09-10T06:26:41.314384+0000","last_fullsized":"2024-09-10T06:26:41.314384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:46.692143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298840+0000","last_change":"2024-09-10T06:26:34.284394+0000","last_active":"2024-09-10T06:26:41.298840+0000","last_peered":"2024-09-10T06:26:41.298840+0000","last_clean":"2024-09-10T06:26:41.298840+0000","last_became_active":"2024-09-10T06:26:34.283980+0000","last_became_peered":"2024-09-10T06:26:34.283980+0000","last_unstale":"2024-09-10T06:26:41.298840+0000","last_undegraded":"2024-09-10T06:26:41.298840+0000","last_fullsized":"2024-09-10T06:26:41.298840+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:38.061123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'15","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.172694+0000","last_change":"2024-09-10T06:26:36.302835+0000","last_active":"2024-09-10T06:26:42.172694+0000","last_peered":"2024-09-10T06:26:42.172694+0000","last_clean":"2024-09-10T06:26:42.172694+0000","last_became_active":"2024-09-10T06:26:36.299434+0000","last_became_peered":"2024-09-10T06:26:36.299434+0000","last_unstale":"2024-09-10T06:26:42.172694+0000","last_undegraded":"2024-09-10T06:26:42.172694+0000","last_fullsized":"2024-09-10T06:26:42.172694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329312+0000","last_change":"2024-09-10T06:26:38.292411+0000","last_active":"2024-09-10T06:26:41.329312+0000","last_peered":"2024-09-10T06:26:41.329312+0000","last_clean":"2024-09-10T06:26:41.329312+0000","last_became_active":"2024-09-10T06:26:38.291623+0000","last_became_peered":"2024-09-10T06:26:38.291623+0000","last_unstale":"2024-09-10T06:26:41.329312+0000","last_undegraded":"2024-09-10T06:26:41.329312+0000","last_fullsized":"2024-09-10T06:26:41.329312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.297347+0000","last_change":"2024-09-10T06:26:40.303598+0000","last_active":"2024-09-10T06:26:41.297347+0000","last_peered":"2024-09-10T06:26:41.297347+0000","last_clean":"2024-09-10T06:26:41.297347+0000","last_became_active":"2024-09-10T06:26:40.302898+0000","last_became_peered":"2024-09-10T06:26:40.302898+0000","last_unstale":"2024-09-10T06:26:41.297347+0000","last_undegraded":"2024-09-10T06:26:41.297347+0000","last_fullsized":"2024-09-10T06:26:41.297347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:49.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315696+0000","last_change":"2024-09-10T06:26:32.273484+0000","last_active":"2024-09-10T06:26:41.315696+0000","last_peered":"2024-09-10T06:26:41.315696+0000","last_clean":"2024-09-10T06:26:41.315696+0000","last_became_active":"2024-09-10T06:26:32.273183+0000","last_became_peered":"2024-09-10T06:26:32.273183+0000","last_unstale":"2024-09-10T06:26:41.315696+0000","last_undegraded":"2024-09-10T06:26:41.315696+0000","last_fullsized":"2024-09-10T06:26:41.315696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:32.410538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323412+0000","last_change":"2024-09-10T06:26:25.534289+0000","last_active":"2024-09-10T06:26:41.323412+0000","last_peered":"2024-09-10T06:26:41.323412+0000","last_clean":"2024-09-10T06:26:41.323412+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:26:41.323412+0000","last_undegraded":"2024-09-10T06:26:41.323412+0000","last_fullsized":"2024-09-10T06:26:41.323412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:11.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294737+0000","last_change":"2024-09-10T06:26:30.579693+0000","last_active":"2024-09-10T06:26:41.294737+0000","last_peered":"2024-09-10T06:26:41.294737+0000","last_clean":"2024-09-10T06:26:41.294737+0000","last_became_active":"2024-09-10T06:26:30.577934+0000","last_became_peered":"2024-09-10T06:26:30.577934+0000","last_unstale":"2024-09-10T06:26:41.294737+0000","last_undegraded":"2024-09-10T06:26:41.294737+0000","last_fullsized":"2024-09-10T06:26:41.294737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:35.852655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329789+0000","last_change":"2024-09-10T06:26:34.275458+0000","last_active":"2024-09-10T06:26:41.329789+0000","last_peered":"2024-09-10T06:26:41.329789+0000","last_clean":"2024-09-10T06:26:41.329789+0000","last_became_active":"2024-09-10T06:26:34.274705+0000","last_became_peered":"2024-09-10T06:26:34.274705+0000","last_unstale":"2024-09-10T06:26:41.329789+0000","last_undegraded":"2024-09-10T06:26:41.329789+0000","last_fullsized":"2024-09-10T06:26:41.329789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:20.624872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.013816+0000","last_change":"2024-09-10T06:26:36.266077+0000","last_active":"2024-09-10T06:26:42.013816+0000","last_peered":"2024-09-10T06:26:42.013816+0000","last_clean":"2024-09-10T06:26:42.013816+0000","last_became_active":"2024-09-10T06:26:36.265322+0000","last_became_peered":"2024-09-10T06:26:36.265322+0000","last_unstale":"2024-09-10T06:26:42.013816+0000","last_undegraded":"2024-09-10T06:26:42.013816+0000","last_fullsized":"2024-09-10T06:26:42.013816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327890+0000","last_change":"2024-09-10T06:26:38.296115+0000","last_active":"2024-09-10T06:26:41.327890+0000","last_peered":"2024-09-10T06:26:41.327890+0000","last_clean":"2024-09-10T06:26:41.327890+0000","last_became_active":"2024-09-10T06:26:38.295264+0000","last_became_peered":"2024-09-10T06:26:38.295264+0000","last_unstale":"2024-09-10T06:26:41.327890+0000","last_undegraded":"2024-09-10T06:26:41.327890+0000","last_fullsized":"2024-09-10T06:26:41.327890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:52:33.108384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.320969+0000","last_change":"2024-09-10T06:26:40.326887+0000","last_active":"2024-09-10T06:26:41.320969+0000","last_peered":"2024-09-10T06:26:41.320969+0000","last_clean":"2024-09-10T06:26:41.320969+0000","last_became_active":"2024-09-10T06:26:40.326130+0000","last_became_peered":"2024-09-10T06:26:40.326130+0000","last_unstale":"2024-09-10T06:26:41.320969+0000","last_undegraded":"2024-09-10T06:26:41.320969+0000","last_fullsized":"2024-09-10T06:26:41.320969+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:28.237428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315129+0000","last_change":"2024-09-10T06:26:32.282586+0000","last_active":"2024-09-10T06:26:41.315129+0000","last_peered":"2024-09-10T06:26:41.315129+0000","last_clean":"2024-09-10T06:26:41.315129+0000","last_became_active":"2024-09-10T06:26:32.282086+0000","last_became_peered":"2024-09-10T06:26:32.282086+0000","last_unstale":"2024-09-10T06:26:41.315129+0000","last_undegraded":"2024-09-10T06:26:41.315129+0000","last_fullsized":"2024-09-10T06:26:41.315129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:44.269917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325241+0000","last_change":"2024-09-10T06:26:30.591913+0000","last_active":"2024-09-10T06:26:41.325241+0000","last_peered":"2024-09-10T06:26:41.325241+0000","last_clean":"2024-09-10T06:26:41.325241+0000","last_became_active":"2024-09-10T06:26:30.591140+0000","last_became_peered":"2024-09-10T06:26:30.591140+0000","last_unstale":"2024-09-10T06:26:41.325241+0000","last_undegraded":"2024-09-10T06:26:41.325241+0000","last_fullsized":"2024-09-10T06:26:41.325241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316228+0000","last_change":"2024-09-10T06:26:25.537497+0000","last_active":"2024-09-10T06:26:41.316228+0000","last_peered":"2024-09-10T06:26:41.316228+0000","last_clean":"2024-09-10T06:26:41.316228+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:26:41.316228+0000","last_undegraded":"2024-09-10T06:26:41.316228+0000","last_fullsized":"2024-09-10T06:26:41.316228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:44.787852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329915+0000","last_change":"2024-09-10T06:26:34.276099+0000","last_active":"2024-09-10T06:26:41.329915+0000","last_peered":"2024-09-10T06:26:41.329915+0000","last_clean":"2024-09-10T06:26:41.329915+0000","last_became_active":"2024-09-10T06:26:34.273984+0000","last_became_peered":"2024-09-10T06:26:34.273984+0000","last_unstale":"2024-09-10T06:26:41.329915+0000","last_undegraded":"2024-09-10T06:26:41.329915+0000","last_fullsized":"2024-09-10T06:26:41.329915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'18","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.101905+0000","last_change":"2024-09-10T06:26:36.272589+0000","last_active":"2024-09-10T06:26:42.101905+0000","last_peered":"2024-09-10T06:26:42.101905+0000","last_clean":"2024-09-10T06:26:42.101905+0000","last_became_active":"2024-09-10T06:26:36.270914+0000","last_became_peered":"2024-09-10T06:26:36.270914+0000","last_unstale":"2024-09-10T06:26:42.101905+0000","last_undegraded":"2024-09-10T06:26:42.101905+0000","last_fullsized":"2024-09-10T06:26:42.101905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:20.764690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.292750+0000","last_change":"2024-09-10T06:26:38.278069+0000","last_active":"2024-09-10T06:26:41.292750+0000","last_peered":"2024-09-10T06:26:41.292750+0000","last_clean":"2024-09-10T06:26:41.292750+0000","last_became_active":"2024-09-10T06:26:38.277261+0000","last_became_peered":"2024-09-10T06:26:38.277261+0000","last_unstale":"2024-09-10T06:26:41.292750+0000","last_undegraded":"2024-09-10T06:26:41.292750+0000","last_fullsized":"2024-09-10T06:26:41.292750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330320+0000","last_change":"2024-09-10T06:26:40.333741+0000","last_active":"2024-09-10T06:26:41.330320+0000","last_peered":"2024-09-10T06:26:41.330320+0000","last_clean":"2024-09-10T06:26:41.330320+0000","last_became_active":"2024-09-10T06:26:40.329701+0000","last_became_peered":"2024-09-10T06:26:40.329701+0000","last_unstale":"2024-09-10T06:26:41.330320+0000","last_undegraded":"2024-09-10T06:26:41.330320+0000","last_fullsized":"2024-09-10T06:26:41.330320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:53.704790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330374+0000","last_change":"2024-09-10T06:26:32.275551+0000","last_active":"2024-09-10T06:26:41.330374+0000","last_peered":"2024-09-10T06:26:41.330374+0000","last_clean":"2024-09-10T06:26:41.330374+0000","last_became_active":"2024-09-10T06:26:32.274946+0000","last_became_peered":"2024-09-10T06:26:32.274946+0000","last_unstale":"2024-09-10T06:26:41.330374+0000","last_undegraded":"2024-09-10T06:26:41.330374+0000","last_fullsized":"2024-09-10T06:26:41.330374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315843+0000","last_change":"2024-09-10T06:26:30.565595+0000","last_active":"2024-09-10T06:26:41.315843+0000","last_peered":"2024-09-10T06:26:41.315843+0000","last_clean":"2024-09-10T06:26:41.315843+0000","last_became_active":"2024-09-10T06:26:30.565220+0000","last_became_peered":"2024-09-10T06:26:30.565220+0000","last_unstale":"2024-09-10T06:26:41.315843+0000","last_undegraded":"2024-09-10T06:26:41.315843+0000","last_fullsized":"2024-09-10T06:26:41.315843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:14.600216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313727+0000","last_change":"2024-09-10T06:26:26.180820+0000","last_active":"2024-09-10T06:26:41.313727+0000","last_peered":"2024-09-10T06:26:41.313727+0000","last_clean":"2024-09-10T06:26:41.313727+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:26:41.313727+0000","last_undegraded":"2024-09-10T06:26:41.313727+0000","last_fullsized":"2024-09-10T06:26:41.313727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:51.928304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326429+0000","last_change":"2024-09-10T06:26:34.272915+0000","last_active":"2024-09-10T06:26:41.326429+0000","last_peered":"2024-09-10T06:26:41.326429+0000","last_clean":"2024-09-10T06:26:41.326429+0000","last_became_active":"2024-09-10T06:26:34.272192+0000","last_became_peered":"2024-09-10T06:26:34.272192+0000","last_unstale":"2024-09-10T06:26:41.326429+0000","last_undegraded":"2024-09-10T06:26:41.326429+0000","last_fullsized":"2024-09-10T06:26:41.326429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:07.874348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.197351+0000","last_change":"2024-09-10T06:26:36.291431+0000","last_active":"2024-09-10T06:26:42.197351+0000","last_peered":"2024-09-10T06:26:42.197351+0000","last_clean":"2024-09-10T06:26:42.197351+0000","last_became_active":"2024-09-10T06:26:36.290570+0000","last_became_peered":"2024-09-10T06:26:36.290570+0000","last_unstale":"2024-09-10T06:26:42.197351+0000","last_undegraded":"2024-09-10T06:26:42.197351+0000","last_fullsized":"2024-09-10T06:26:42.197351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:10.565531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.321604+0000","last_change":"2024-09-10T06:26:38.312069+0000","last_active":"2024-09-10T06:26:41.321604+0000","last_peered":"2024-09-10T06:26:41.321604+0000","last_clean":"2024-09-10T06:26:41.321604+0000","last_became_active":"2024-09-10T06:26:38.310450+0000","last_became_peered":"2024-09-10T06:26:38.310450+0000","last_unstale":"2024-09-10T06:26:41.321604+0000","last_undegraded":"2024-09-10T06:26:41.321604+0000","last_fullsized":"2024-09-10T06:26:41.321604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.299157+0000","last_change":"2024-09-10T06:26:40.312990+0000","last_active":"2024-09-10T06:26:41.299157+0000","last_peered":"2024-09-10T06:26:41.299157+0000","last_clean":"2024-09-10T06:26:41.299157+0000","last_became_active":"2024-09-10T06:26:40.312266+0000","last_became_peered":"2024-09-10T06:26:40.312266+0000","last_unstale":"2024-09-10T06:26:41.299157+0000","last_undegraded":"2024-09-10T06:26:41.299157+0000","last_fullsized":"2024-09-10T06:26:41.299157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:15.777105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294155+0000","last_change":"2024-09-10T06:26:32.258874+0000","last_active":"2024-09-10T06:26:41.294155+0000","last_peered":"2024-09-10T06:26:41.294155+0000","last_clean":"2024-09-10T06:26:41.294155+0000","last_became_active":"2024-09-10T06:26:32.258337+0000","last_became_peered":"2024-09-10T06:26:32.258337+0000","last_unstale":"2024-09-10T06:26:41.294155+0000","last_undegraded":"2024-09-10T06:26:41.294155+0000","last_fullsized":"2024-09-10T06:26:41.294155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298309+0000","last_change":"2024-09-10T06:26:30.581501+0000","last_active":"2024-09-10T06:26:41.298309+0000","last_peered":"2024-09-10T06:26:41.298309+0000","last_clean":"2024-09-10T06:26:41.298309+0000","last_became_active":"2024-09-10T06:26:30.581115+0000","last_became_peered":"2024-09-10T06:26:30.581115+0000","last_unstale":"2024-09-10T06:26:41.298309+0000","last_undegraded":"2024-09-10T06:26:41.298309+0000","last_fullsized":"2024-09-10T06:26:41.298309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316754+0000","last_change":"2024-09-10T06:26:25.537295+0000","last_active":"2024-09-10T06:26:41.316754+0000","last_peered":"2024-09-10T06:26:41.316754+0000","last_clean":"2024-09-10T06:26:41.316754+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:26:41.316754+0000","last_undegraded":"2024-09-10T06:26:41.316754+0000","last_fullsized":"2024-09-10T06:26:41.316754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:32.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293011+0000","last_change":"2024-09-10T06:26:34.258956+0000","last_active":"2024-09-10T06:26:41.293011+0000","last_peered":"2024-09-10T06:26:41.293011+0000","last_clean":"2024-09-10T06:26:41.293011+0000","last_became_active":"2024-09-10T06:26:34.257739+0000","last_became_peered":"2024-09-10T06:26:34.257739+0000","last_unstale":"2024-09-10T06:26:41.293011+0000","last_undegraded":"2024-09-10T06:26:41.293011+0000","last_fullsized":"2024-09-10T06:26:41.293011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:18.547827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'10","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.156251+0000","last_change":"2024-09-10T06:26:36.271096+0000","last_active":"2024-09-10T06:26:42.156251+0000","last_peered":"2024-09-10T06:26:42.156251+0000","last_clean":"2024-09-10T06:26:42.156251+0000","last_became_active":"2024-09-10T06:26:36.270325+0000","last_became_peered":"2024-09-10T06:26:36.270325+0000","last_unstale":"2024-09-10T06:26:42.156251+0000","last_undegraded":"2024-09-10T06:26:42.156251+0000","last_fullsized":"2024-09-10T06:26:42.156251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.296422+0000","last_change":"2024-09-10T06:26:38.300795+0000","last_active":"2024-09-10T06:26:41.296422+0000","last_peered":"2024-09-10T06:26:41.296422+0000","last_clean":"2024-09-10T06:26:41.296422+0000","last_became_active":"2024-09-10T06:26:38.299466+0000","last_became_peered":"2024-09-10T06:26:38.299466+0000","last_unstale":"2024-09-10T06:26:41.296422+0000","last_undegraded":"2024-09-10T06:26:41.296422+0000","last_fullsized":"2024-09-10T06:26:41.296422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:38.641500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329298+0000","last_change":"2024-09-10T06:26:40.329688+0000","last_active":"2024-09-10T06:26:41.329298+0000","last_peered":"2024-09-10T06:26:41.329298+0000","last_clean":"2024-09-10T06:26:41.329298+0000","last_became_active":"2024-09-10T06:26:40.329009+0000","last_became_peered":"2024-09-10T06:26:40.329009+0000","last_unstale":"2024-09-10T06:26:41.329298+0000","last_undegraded":"2024-09-10T06:26:41.329298+0000","last_fullsized":"2024-09-10T06:26:41.329298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293341+0000","last_change":"2024-09-10T06:26:32.283524+0000","last_active":"2024-09-10T06:26:41.293341+0000","last_peered":"2024-09-10T06:26:41.293341+0000","last_clean":"2024-09-10T06:26:41.293341+0000","last_became_active":"2024-09-10T06:26:32.282794+0000","last_became_peered":"2024-09-10T06:26:32.282794+0000","last_unstale":"2024-09-10T06:26:41.293341+0000","last_undegraded":"2024-09-10T06:26:41.293341+0000","last_fullsized":"2024-09-10T06:26:41.293341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:11.537416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331957+0000","last_change":"2024-09-10T06:26:30.578273+0000","last_active":"2024-09-10T06:26:41.331957+0000","last_peered":"2024-09-10T06:26:41.331957+0000","last_clean":"2024-09-10T06:26:41.331957+0000","last_became_active":"2024-09-10T06:26:30.577985+0000","last_became_peered":"2024-09-10T06:26:30.577985+0000","last_unstale":"2024-09-10T06:26:41.331957+0000","last_undegraded":"2024-09-10T06:26:41.331957+0000","last_fullsized":"2024-09-10T06:26:41.331957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328384+0000","last_change":"2024-09-10T06:26:26.037773+0000","last_active":"2024-09-10T06:26:41.328384+0000","last_peered":"2024-09-10T06:26:41.328384+0000","last_clean":"2024-09-10T06:26:41.328384+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:26:41.328384+0000","last_undegraded":"2024-09-10T06:26:41.328384+0000","last_fullsized":"2024-09-10T06:26:41.328384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:21.949708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293814+0000","last_change":"2024-09-10T06:26:34.268710+0000","last_active":"2024-09-10T06:26:41.293814+0000","last_peered":"2024-09-10T06:26:41.293814+0000","last_clean":"2024-09-10T06:26:41.293814+0000","last_became_active":"2024-09-10T06:26:34.268359+0000","last_became_peered":"2024-09-10T06:26:34.268359+0000","last_unstale":"2024-09-10T06:26:41.293814+0000","last_undegraded":"2024-09-10T06:26:41.293814+0000","last_fullsized":"2024-09-10T06:26:41.293814+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:27.191787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'19","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.135721+0000","last_change":"2024-09-10T06:26:36.299700+0000","last_active":"2024-09-10T06:26:42.135721+0000","last_peered":"2024-09-10T06:26:42.135721+0000","last_clean":"2024-09-10T06:26:42.135721+0000","last_became_active":"2024-09-10T06:26:36.297606+0000","last_became_peered":"2024-09-10T06:26:36.297606+0000","last_unstale":"2024-09-10T06:26:42.135721+0000","last_undegraded":"2024-09-10T06:26:42.135721+0000","last_fullsized":"2024-09-10T06:26:42.135721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294640+0000","last_change":"2024-09-10T06:26:38.290601+0000","last_active":"2024-09-10T06:26:41.294640+0000","last_peered":"2024-09-10T06:26:41.294640+0000","last_clean":"2024-09-10T06:26:41.294640+0000","last_became_active":"2024-09-10T06:26:38.289589+0000","last_became_peered":"2024-09-10T06:26:38.289589+0000","last_unstale":"2024-09-10T06:26:41.294640+0000","last_undegraded":"2024-09-10T06:26:41.294640+0000","last_fullsized":"2024-09-10T06:26:41.294640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:22.625936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323911+0000","last_change":"2024-09-10T06:26:40.332819+0000","last_active":"2024-09-10T06:26:41.323911+0000","last_peered":"2024-09-10T06:26:41.323911+0000","last_clean":"2024-09-10T06:26:41.323911+0000","last_became_active":"2024-09-10T06:26:40.332160+0000","last_became_peered":"2024-09-10T06:26:40.332160+0000","last_unstale":"2024-09-10T06:26:41.323911+0000","last_undegraded":"2024-09-10T06:26:41.323911+0000","last_fullsized":"2024-09-10T06:26:41.323911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.784870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330669+0000","last_change":"2024-09-10T06:26:40.334393+0000","last_active":"2024-09-10T06:26:41.330669+0000","last_peered":"2024-09-10T06:26:41.330669+0000","last_clean":"2024-09-10T06:26:41.330669+0000","last_became_active":"2024-09-10T06:26:40.333474+0000","last_became_peered":"2024-09-10T06:26:40.333474+0000","last_unstale":"2024-09-10T06:26:41.330669+0000","last_undegraded":"2024-09-10T06:26:41.330669+0000","last_fullsized":"2024-09-10T06:26:41.330669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:35.031954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294179+0000","last_change":"2024-09-10T06:26:32.272914+0000","last_active":"2024-09-10T06:26:41.294179+0000","last_peered":"2024-09-10T06:26:41.294179+0000","last_clean":"2024-09-10T06:26:41.294179+0000","last_became_active":"2024-09-10T06:26:32.272178+0000","last_became_peered":"2024-09-10T06:26:32.272178+0000","last_unstale":"2024-09-10T06:26:41.294179+0000","last_undegraded":"2024-09-10T06:26:41.294179+0000","last_fullsized":"2024-09-10T06:26:41.294179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294481+0000","last_change":"2024-09-10T06:26:30.593531+0000","last_active":"2024-09-10T06:26:41.294481+0000","last_peered":"2024-09-10T06:26:41.294481+0000","last_clean":"2024-09-10T06:26:41.294481+0000","last_became_active":"2024-09-10T06:26:30.592753+0000","last_became_peered":"2024-09-10T06:26:30.592753+0000","last_unstale":"2024-09-10T06:26:41.294481+0000","last_undegraded":"2024-09-10T06:26:41.294481+0000","last_fullsized":"2024-09-10T06:26:41.294481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:14.506864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315234+0000","last_change":"2024-09-10T06:26:34.282877+0000","last_active":"2024-09-10T06:26:41.315234+0000","last_peered":"2024-09-10T06:26:41.315234+0000","last_clean":"2024-09-10T06:26:41.315234+0000","last_became_active":"2024-09-10T06:26:34.282281+0000","last_became_peered":"2024-09-10T06:26:34.282281+0000","last_unstale":"2024-09-10T06:26:41.315234+0000","last_undegraded":"2024-09-10T06:26:41.315234+0000","last_fullsized":"2024-09-10T06:26:41.315234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:41.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.204043+0000","last_change":"2024-09-10T06:26:36.273166+0000","last_active":"2024-09-10T06:26:42.204043+0000","last_peered":"2024-09-10T06:26:42.204043+0000","last_clean":"2024-09-10T06:26:42.204043+0000","last_became_active":"2024-09-10T06:26:36.272386+0000","last_became_peered":"2024-09-10T06:26:36.272386+0000","last_unstale":"2024-09-10T06:26:42.204043+0000","last_undegraded":"2024-09-10T06:26:42.204043+0000","last_fullsized":"2024-09-10T06:26:42.204043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293458+0000","last_change":"2024-09-10T06:26:38.297347+0000","last_active":"2024-09-10T06:26:41.293458+0000","last_peered":"2024-09-10T06:26:41.293458+0000","last_clean":"2024-09-10T06:26:41.293458+0000","last_became_active":"2024-09-10T06:26:38.296600+0000","last_became_peered":"2024-09-10T06:26:38.296600+0000","last_unstale":"2024-09-10T06:26:41.293458+0000","last_undegraded":"2024-09-10T06:26:41.293458+0000","last_fullsized":"2024-09-10T06:26:41.293458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:08.758126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.296637+0000","last_change":"2024-09-10T06:26:40.321844+0000","last_active":"2024-09-10T06:26:41.296637+0000","last_peered":"2024-09-10T06:26:41.296637+0000","last_clean":"2024-09-10T06:26:41.296637+0000","last_became_active":"2024-09-10T06:26:40.321097+0000","last_became_peered":"2024-09-10T06:26:40.321097+0000","last_unstale":"2024-09-10T06:26:41.296637+0000","last_undegraded":"2024-09-10T06:26:41.296637+0000","last_fullsized":"2024-09-10T06:26:41.296637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:10.004849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.314995+0000","last_change":"2024-09-10T06:26:32.286989+0000","last_active":"2024-09-10T06:26:41.314995+0000","last_peered":"2024-09-10T06:26:41.314995+0000","last_clean":"2024-09-10T06:26:41.314995+0000","last_became_active":"2024-09-10T06:26:32.286519+0000","last_became_peered":"2024-09-10T06:26:32.286519+0000","last_unstale":"2024-09-10T06:26:41.314995+0000","last_undegraded":"2024-09-10T06:26:41.314995+0000","last_fullsized":"2024-09-10T06:26:41.314995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:31.592472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313322+0000","last_change":"2024-09-10T06:26:30.587315+0000","last_active":"2024-09-10T06:26:41.313322+0000","last_peered":"2024-09-10T06:26:41.313322+0000","last_clean":"2024-09-10T06:26:41.313322+0000","last_became_active":"2024-09-10T06:26:30.586611+0000","last_became_peered":"2024-09-10T06:26:30.586611+0000","last_unstale":"2024-09-10T06:26:41.313322+0000","last_undegraded":"2024-09-10T06:26:41.313322+0000","last_fullsized":"2024-09-10T06:26:41.313322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"27'1","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294803+0000","last_change":"2024-09-10T06:26:34.271770+0000","last_active":"2024-09-10T06:26:41.294803+0000","last_peered":"2024-09-10T06:26:41.294803+0000","last_clean":"2024-09-10T06:26:41.294803+0000","last_became_active":"2024-09-10T06:26:34.269875+0000","last_became_peered":"2024-09-10T06:26:34.269875+0000","last_unstale":"2024-09-10T06:26:41.294803+0000","last_undegraded":"2024-09-10T06:26:41.294803+0000","last_fullsized":"2024-09-10T06:26:41.294803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:09.570079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'4","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.676760+0000","last_change":"2024-09-10T06:26:36.289140+0000","last_active":"2024-09-10T06:26:41.676760+0000","last_peered":"2024-09-10T06:26:41.676760+0000","last_clean":"2024-09-10T06:26:41.676760+0000","last_became_active":"2024-09-10T06:26:36.288355+0000","last_became_peered":"2024-09-10T06:26:36.288355+0000","last_unstale":"2024-09-10T06:26:41.676760+0000","last_undegraded":"2024-09-10T06:26:41.676760+0000","last_fullsized":"2024-09-10T06:26:41.676760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:42.518982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311231+0000","last_change":"2024-09-10T06:26:38.302040+0000","last_active":"2024-09-10T06:26:41.311231+0000","last_peered":"2024-09-10T06:26:41.311231+0000","last_clean":"2024-09-10T06:26:41.311231+0000","last_became_active":"2024-09-10T06:26:38.301064+0000","last_became_peered":"2024-09-10T06:26:38.301064+0000","last_unstale":"2024-09-10T06:26:41.311231+0000","last_undegraded":"2024-09-10T06:26:41.311231+0000","last_fullsized":"2024-09-10T06:26:41.311231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:41.513255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329245+0000","last_change":"2024-09-10T06:26:40.322368+0000","last_active":"2024-09-10T06:26:41.329245+0000","last_peered":"2024-09-10T06:26:41.329245+0000","last_clean":"2024-09-10T06:26:41.329245+0000","last_became_active":"2024-09-10T06:26:40.321592+0000","last_became_peered":"2024-09-10T06:26:40.321592+0000","last_unstale":"2024-09-10T06:26:41.329245+0000","last_undegraded":"2024-09-10T06:26:41.329245+0000","last_fullsized":"2024-09-10T06:26:41.329245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:03.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293640+0000","last_change":"2024-09-10T06:26:32.259666+0000","last_active":"2024-09-10T06:26:41.293640+0000","last_peered":"2024-09-10T06:26:41.293640+0000","last_clean":"2024-09-10T06:26:41.293640+0000","last_became_active":"2024-09-10T06:26:32.258775+0000","last_became_peered":"2024-09-10T06:26:32.258775+0000","last_unstale":"2024-09-10T06:26:41.293640+0000","last_undegraded":"2024-09-10T06:26:41.293640+0000","last_fullsized":"2024-09-10T06:26:41.293640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.324105+0000","last_change":"2024-09-10T06:26:30.592773+0000","last_active":"2024-09-10T06:26:41.324105+0000","last_peered":"2024-09-10T06:26:41.324105+0000","last_clean":"2024-09-10T06:26:41.324105+0000","last_became_active":"2024-09-10T06:26:30.590566+0000","last_became_peered":"2024-09-10T06:26:30.590566+0000","last_unstale":"2024-09-10T06:26:41.324105+0000","last_undegraded":"2024-09-10T06:26:41.324105+0000","last_fullsized":"2024-09-10T06:26:41.324105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:35.688897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.310615+0000","last_change":"2024-09-10T06:26:34.281690+0000","last_active":"2024-09-10T06:26:41.310615+0000","last_peered":"2024-09-10T06:26:41.310615+0000","last_clean":"2024-09-10T06:26:41.310615+0000","last_became_active":"2024-09-10T06:26:34.281008+0000","last_became_peered":"2024-09-10T06:26:34.281008+0000","last_unstale":"2024-09-10T06:26:41.310615+0000","last_undegraded":"2024-09-10T06:26:41.310615+0000","last_fullsized":"2024-09-10T06:26:41.310615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.114796+0000","last_change":"2024-09-10T06:26:36.277028+0000","last_active":"2024-09-10T06:26:42.114796+0000","last_peered":"2024-09-10T06:26:42.114796+0000","last_clean":"2024-09-10T06:26:42.114796+0000","last_became_active":"2024-09-10T06:26:36.276248+0000","last_became_peered":"2024-09-10T06:26:36.276248+0000","last_unstale":"2024-09-10T06:26:42.114796+0000","last_undegraded":"2024-09-10T06:26:42.114796+0000","last_fullsized":"2024-09-10T06:26:42.114796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:53.521681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326363+0000","last_change":"2024-09-10T06:26:38.294889+0000","last_active":"2024-09-10T06:26:41.326363+0000","last_peered":"2024-09-10T06:26:41.326363+0000","last_clean":"2024-09-10T06:26:41.326363+0000","last_became_active":"2024-09-10T06:26:38.294124+0000","last_became_peered":"2024-09-10T06:26:38.294124+0000","last_unstale":"2024-09-10T06:26:41.326363+0000","last_undegraded":"2024-09-10T06:26:41.326363+0000","last_fullsized":"2024-09-10T06:26:41.326363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:42.905517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323061+0000","last_change":"2024-09-10T06:26:40.331445+0000","last_active":"2024-09-10T06:26:41.323061+0000","last_peered":"2024-09-10T06:26:41.323061+0000","last_clean":"2024-09-10T06:26:41.323061+0000","last_became_active":"2024-09-10T06:26:40.330707+0000","last_became_peered":"2024-09-10T06:26:40.330707+0000","last_unstale":"2024-09-10T06:26:41.323061+0000","last_undegraded":"2024-09-10T06:26:41.323061+0000","last_fullsized":"2024-09-10T06:26:41.323061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.822687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294508+0000","last_change":"2024-09-10T06:26:32.266221+0000","last_active":"2024-09-10T06:26:41.294508+0000","last_peered":"2024-09-10T06:26:41.294508+0000","last_clean":"2024-09-10T06:26:41.294508+0000","last_became_active":"2024-09-10T06:26:32.265705+0000","last_became_peered":"2024-09-10T06:26:32.265705+0000","last_unstale":"2024-09-10T06:26:41.294508+0000","last_undegraded":"2024-09-10T06:26:41.294508+0000","last_fullsized":"2024-09-10T06:26:41.294508+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331669+0000","last_change":"2024-09-10T06:26:30.594335+0000","last_active":"2024-09-10T06:26:41.331669+0000","last_peered":"2024-09-10T06:26:41.331669+0000","last_clean":"2024-09-10T06:26:41.331669+0000","last_became_active":"2024-09-10T06:26:30.593326+0000","last_became_peered":"2024-09-10T06:26:30.593326+0000","last_unstale":"2024-09-10T06:26:41.331669+0000","last_undegraded":"2024-09-10T06:26:41.331669+0000","last_fullsized":"2024-09-10T06:26:41.331669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:37.297722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326384+0000","last_change":"2024-09-10T06:26:34.281915+0000","last_active":"2024-09-10T06:26:41.326384+0000","last_peered":"2024-09-10T06:26:41.326384+0000","last_clean":"2024-09-10T06:26:41.326384+0000","last_became_active":"2024-09-10T06:26:34.281147+0000","last_became_peered":"2024-09-10T06:26:34.281147+0000","last_unstale":"2024-09-10T06:26:41.326384+0000","last_undegraded":"2024-09-10T06:26:41.326384+0000","last_fullsized":"2024-09-10T06:26:41.326384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:41.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.901249+0000","last_change":"2024-09-10T06:26:36.298537+0000","last_active":"2024-09-10T06:26:41.901249+0000","last_peered":"2024-09-10T06:26:41.901249+0000","last_clean":"2024-09-10T06:26:41.901249+0000","last_became_active":"2024-09-10T06:26:36.297372+0000","last_became_peered":"2024-09-10T06:26:36.297372+0000","last_unstale":"2024-09-10T06:26:41.901249+0000","last_undegraded":"2024-09-10T06:26:41.901249+0000","last_fullsized":"2024-09-10T06:26:41.901249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328599+0000","last_change":"2024-09-10T06:26:38.301461+0000","last_active":"2024-09-10T06:26:41.328599+0000","last_peered":"2024-09-10T06:26:41.328599+0000","last_clean":"2024-09-10T06:26:41.328599+0000","last_became_active":"2024-09-10T06:26:38.300580+0000","last_became_peered":"2024-09-10T06:26:38.300580+0000","last_unstale":"2024-09-10T06:26:41.328599+0000","last_undegraded":"2024-09-10T06:26:41.328599+0000","last_fullsized":"2024-09-10T06:26:41.328599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328213+0000","last_change":"2024-09-10T06:26:32.285276+0000","last_active":"2024-09-10T06:26:41.328213+0000","last_peered":"2024-09-10T06:26:41.328213+0000","last_clean":"2024-09-10T06:26:41.328213+0000","last_became_active":"2024-09-10T06:26:32.284457+0000","last_became_peered":"2024-09-10T06:26:32.284457+0000","last_unstale":"2024-09-10T06:26:41.328213+0000","last_undegraded":"2024-09-10T06:26:41.328213+0000","last_fullsized":"2024-09-10T06:26:41.328213+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:37.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294982+0000","last_change":"2024-09-10T06:26:30.573339+0000","last_active":"2024-09-10T06:26:41.294982+0000","last_peered":"2024-09-10T06:26:41.294982+0000","last_clean":"2024-09-10T06:26:41.294982+0000","last_became_active":"2024-09-10T06:26:30.571377+0000","last_became_peered":"2024-09-10T06:26:30.571377+0000","last_unstale":"2024-09-10T06:26:41.294982+0000","last_undegraded":"2024-09-10T06:26:41.294982+0000","last_fullsized":"2024-09-10T06:26:41.294982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:59.752497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331292+0000","last_change":"2024-09-10T06:26:34.269013+0000","last_active":"2024-09-10T06:26:41.331292+0000","last_peered":"2024-09-10T06:26:41.331292+0000","last_clean":"2024-09-10T06:26:41.331292+0000","last_became_active":"2024-09-10T06:26:34.268677+0000","last_became_peered":"2024-09-10T06:26:34.268677+0000","last_unstale":"2024-09-10T06:26:41.331292+0000","last_undegraded":"2024-09-10T06:26:41.331292+0000","last_fullsized":"2024-09-10T06:26:41.331292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'12","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.233388+0000","last_change":"2024-09-10T06:26:36.300362+0000","last_active":"2024-09-10T06:26:42.233388+0000","last_peered":"2024-09-10T06:26:42.233388+0000","last_clean":"2024-09-10T06:26:42.233388+0000","last_became_active":"2024-09-10T06:26:36.299645+0000","last_became_peered":"2024-09-10T06:26:36.299645+0000","last_unstale":"2024-09-10T06:26:42.233388+0000","last_undegraded":"2024-09-10T06:26:42.233388+0000","last_fullsized":"2024-09-10T06:26:42.233388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:17.424354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323485+0000","last_change":"2024-09-10T06:26:38.299751+0000","last_active":"2024-09-10T06:26:41.323485+0000","last_peered":"2024-09-10T06:26:41.323485+0000","last_clean":"2024-09-10T06:26:41.323485+0000","last_became_active":"2024-09-10T06:26:38.298414+0000","last_became_peered":"2024-09-10T06:26:38.298414+0000","last_unstale":"2024-09-10T06:26:41.323485+0000","last_undegraded":"2024-09-10T06:26:41.323485+0000","last_fullsized":"2024-09-10T06:26:41.323485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293578+0000","last_change":"2024-09-10T06:26:40.312752+0000","last_active":"2024-09-10T06:26:41.293578+0000","last_peered":"2024-09-10T06:26:41.293578+0000","last_clean":"2024-09-10T06:26:41.293578+0000","last_became_active":"2024-09-10T06:26:40.312026+0000","last_became_peered":"2024-09-10T06:26:40.312026+0000","last_unstale":"2024-09-10T06:26:41.293578+0000","last_undegraded":"2024-09-10T06:26:41.293578+0000","last_fullsized":"2024-09-10T06:26:41.293578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:50.071224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331658+0000","last_change":"2024-09-10T06:26:32.266934+0000","last_active":"2024-09-10T06:26:41.331658+0000","last_peered":"2024-09-10T06:26:41.331658+0000","last_clean":"2024-09-10T06:26:41.331658+0000","last_became_active":"2024-09-10T06:26:32.266682+0000","last_became_peered":"2024-09-10T06:26:32.266682+0000","last_unstale":"2024-09-10T06:26:41.331658+0000","last_undegraded":"2024-09-10T06:26:41.331658+0000","last_fullsized":"2024-09-10T06:26:41.331658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315625+0000","last_change":"2024-09-10T06:26:30.579097+0000","last_active":"2024-09-10T06:26:41.315625+0000","last_peered":"2024-09-10T06:26:41.315625+0000","last_clean":"2024-09-10T06:26:41.315625+0000","last_became_active":"2024-09-10T06:26:30.578692+0000","last_became_peered":"2024-09-10T06:26:30.578692+0000","last_unstale":"2024-09-10T06:26:41.315625+0000","last_undegraded":"2024-09-10T06:26:41.315625+0000","last_fullsized":"2024-09-10T06:26:41.315625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:15.878123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"27'1","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328026+0000","last_change":"2024-09-10T06:26:34.282356+0000","last_active":"2024-09-10T06:26:41.328026+0000","last_peered":"2024-09-10T06:26:41.328026+0000","last_clean":"2024-09-10T06:26:41.328026+0000","last_became_active":"2024-09-10T06:26:34.281167+0000","last_became_peered":"2024-09-10T06:26:34.281167+0000","last_unstale":"2024-09-10T06:26:41.328026+0000","last_undegraded":"2024-09-10T06:26:41.328026+0000","last_fullsized":"2024-09-10T06:26:41.328026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:59.042394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.020639+0000","last_change":"2024-09-10T06:26:36.301277+0000","last_active":"2024-09-10T06:26:42.020639+0000","last_peered":"2024-09-10T06:26:42.020639+0000","last_clean":"2024-09-10T06:26:42.020639+0000","last_became_active":"2024-09-10T06:26:36.300501+0000","last_became_peered":"2024-09-10T06:26:36.300501+0000","last_unstale":"2024-09-10T06:26:42.020639+0000","last_undegraded":"2024-09-10T06:26:42.020639+0000","last_fullsized":"2024-09-10T06:26:42.020639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:38.477946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316366+0000","last_change":"2024-09-10T06:26:38.305737+0000","last_active":"2024-09-10T06:26:41.316366+0000","last_peered":"2024-09-10T06:26:41.316366+0000","last_clean":"2024-09-10T06:26:41.316366+0000","last_became_active":"2024-09-10T06:26:38.303318+0000","last_became_peered":"2024-09-10T06:26:38.303318+0000","last_unstale":"2024-09-10T06:26:41.316366+0000","last_undegraded":"2024-09-10T06:26:41.316366+0000","last_fullsized":"2024-09-10T06:26:41.316366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:52.587622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326063+0000","last_change":"2024-09-10T06:26:40.318587+0000","last_active":"2024-09-10T06:26:41.326063+0000","last_peered":"2024-09-10T06:26:41.326063+0000","last_clean":"2024-09-10T06:26:41.326063+0000","last_became_active":"2024-09-10T06:26:40.317695+0000","last_became_peered":"2024-09-10T06:26:40.317695+0000","last_unstale":"2024-09-10T06:26:41.326063+0000","last_undegraded":"2024-09-10T06:26:41.326063+0000","last_fullsized":"2024-09-10T06:26:41.326063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:48.298686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.296270+0000","last_change":"2024-09-10T06:26:32.276218+0000","last_active":"2024-09-10T06:26:41.296270+0000","last_peered":"2024-09-10T06:26:41.296270+0000","last_clean":"2024-09-10T06:26:41.296270+0000","last_became_active":"2024-09-10T06:26:32.275805+0000","last_became_peered":"2024-09-10T06:26:32.275805+0000","last_unstale":"2024-09-10T06:26:41.296270+0000","last_undegraded":"2024-09-10T06:26:41.296270+0000","last_fullsized":"2024-09-10T06:26:41.296270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294640+0000","last_change":"2024-09-10T06:26:30.568731+0000","last_active":"2024-09-10T06:26:41.294640+0000","last_peered":"2024-09-10T06:26:41.294640+0000","last_clean":"2024-09-10T06:26:41.294640+0000","last_became_active":"2024-09-10T06:26:30.567937+0000","last_became_peered":"2024-09-10T06:26:30.567937+0000","last_unstale":"2024-09-10T06:26:41.294640+0000","last_undegraded":"2024-09-10T06:26:41.294640+0000","last_fullsized":"2024-09-10T06:26:41.294640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:18.974865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295519+0000","last_change":"2024-09-10T06:26:34.266227+0000","last_active":"2024-09-10T06:26:41.295519+0000","last_peered":"2024-09-10T06:26:41.295519+0000","last_clean":"2024-09-10T06:26:41.295519+0000","last_became_active":"2024-09-10T06:26:34.262443+0000","last_became_peered":"2024-09-10T06:26:34.262443+0000","last_unstale":"2024-09-10T06:26:41.295519+0000","last_undegraded":"2024-09-10T06:26:41.295519+0000","last_fullsized":"2024-09-10T06:26:41.295519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.918813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.212755+0000","last_change":"2024-09-10T06:26:36.292958+0000","last_active":"2024-09-10T06:26:42.212755+0000","last_peered":"2024-09-10T06:26:42.212755+0000","last_clean":"2024-09-10T06:26:42.212755+0000","last_became_active":"2024-09-10T06:26:36.292149+0000","last_became_peered":"2024-09-10T06:26:36.292149+0000","last_unstale":"2024-09-10T06:26:42.212755+0000","last_undegraded":"2024-09-10T06:26:42.212755+0000","last_fullsized":"2024-09-10T06:26:42.212755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316146+0000","last_change":"2024-09-10T06:26:38.302991+0000","last_active":"2024-09-10T06:26:41.316146+0000","last_peered":"2024-09-10T06:26:41.316146+0000","last_clean":"2024-09-10T06:26:41.316146+0000","last_became_active":"2024-09-10T06:26:38.289306+0000","last_became_peered":"2024-09-10T06:26:38.289306+0000","last_unstale":"2024-09-10T06:26:41.316146+0000","last_undegraded":"2024-09-10T06:26:41.316146+0000","last_fullsized":"2024-09-10T06:26:41.316146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:57.625329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.321564+0000","last_change":"2024-09-10T06:26:40.327627+0000","last_active":"2024-09-10T06:26:41.321564+0000","last_peered":"2024-09-10T06:26:41.321564+0000","last_clean":"2024-09-10T06:26:41.321564+0000","last_became_active":"2024-09-10T06:26:40.326888+0000","last_became_peered":"2024-09-10T06:26:40.326888+0000","last_unstale":"2024-09-10T06:26:41.321564+0000","last_undegraded":"2024-09-10T06:26:41.321564+0000","last_fullsized":"2024-09-10T06:26:41.321564+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:41.122562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298033+0000","last_change":"2024-09-10T06:26:32.275071+0000","last_active":"2024-09-10T06:26:41.298033+0000","last_peered":"2024-09-10T06:26:41.298033+0000","last_clean":"2024-09-10T06:26:41.298033+0000","last_became_active":"2024-09-10T06:26:32.274395+0000","last_became_peered":"2024-09-10T06:26:32.274395+0000","last_unstale":"2024-09-10T06:26:41.298033+0000","last_undegraded":"2024-09-10T06:26:41.298033+0000","last_fullsized":"2024-09-10T06:26:41.298033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:51.369493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329412+0000","last_change":"2024-09-10T06:26:30.594599+0000","last_active":"2024-09-10T06:26:41.329412+0000","last_peered":"2024-09-10T06:26:41.329412+0000","last_clean":"2024-09-10T06:26:41.329412+0000","last_became_active":"2024-09-10T06:26:30.594058+0000","last_became_peered":"2024-09-10T06:26:30.594058+0000","last_unstale":"2024-09-10T06:26:41.329412+0000","last_undegraded":"2024-09-10T06:26:41.329412+0000","last_fullsized":"2024-09-10T06:26:41.329412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:18.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316623+0000","last_change":"2024-09-10T06:26:34.279538+0000","last_active":"2024-09-10T06:26:41.316623+0000","last_peered":"2024-09-10T06:26:41.316623+0000","last_clean":"2024-09-10T06:26:41.316623+0000","last_became_active":"2024-09-10T06:26:34.278871+0000","last_became_peered":"2024-09-10T06:26:34.278871+0000","last_unstale":"2024-09-10T06:26:41.316623+0000","last_undegraded":"2024-09-10T06:26:41.316623+0000","last_fullsized":"2024-09-10T06:26:41.316623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:13.203357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'10","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.190937+0000","last_change":"2024-09-10T06:26:36.290976+0000","last_active":"2024-09-10T06:26:42.190937+0000","last_peered":"2024-09-10T06:26:42.190937+0000","last_clean":"2024-09-10T06:26:42.190937+0000","last_became_active":"2024-09-10T06:26:36.290265+0000","last_became_peered":"2024-09-10T06:26:36.290265+0000","last_unstale":"2024-09-10T06:26:42.190937+0000","last_undegraded":"2024-09-10T06:26:42.190937+0000","last_fullsized":"2024-09-10T06:26:42.190937+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327681+0000","last_change":"2024-09-10T06:26:38.292031+0000","last_active":"2024-09-10T06:26:41.327681+0000","last_peered":"2024-09-10T06:26:41.327681+0000","last_clean":"2024-09-10T06:26:41.327681+0000","last_became_active":"2024-09-10T06:26:38.288791+0000","last_became_peered":"2024-09-10T06:26:38.288791+0000","last_unstale":"2024-09-10T06:26:41.327681+0000","last_undegraded":"2024-09-10T06:26:41.327681+0000","last_fullsized":"2024-09-10T06:26:41.327681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:07.830355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.310765+0000","last_change":"2024-09-10T06:26:40.336448+0000","last_active":"2024-09-10T06:26:41.310765+0000","last_peered":"2024-09-10T06:26:41.310765+0000","last_clean":"2024-09-10T06:26:41.310765+0000","last_became_active":"2024-09-10T06:26:40.335771+0000","last_became_peered":"2024-09-10T06:26:40.335771+0000","last_unstale":"2024-09-10T06:26:41.310765+0000","last_undegraded":"2024-09-10T06:26:41.310765+0000","last_fullsized":"2024-09-10T06:26:41.310765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294185+0000","last_change":"2024-09-10T06:26:32.262176+0000","last_active":"2024-09-10T06:26:41.294185+0000","last_peered":"2024-09-10T06:26:41.294185+0000","last_clean":"2024-09-10T06:26:41.294185+0000","last_became_active":"2024-09-10T06:26:32.261250+0000","last_became_peered":"2024-09-10T06:26:32.261250+0000","last_unstale":"2024-09-10T06:26:41.294185+0000","last_undegraded":"2024-09-10T06:26:41.294185+0000","last_fullsized":"2024-09-10T06:26:41.294185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323961+0000","last_change":"2024-09-10T06:26:30.604587+0000","last_active":"2024-09-10T06:26:41.323961+0000","last_peered":"2024-09-10T06:26:41.323961+0000","last_clean":"2024-09-10T06:26:41.323961+0000","last_became_active":"2024-09-10T06:26:30.603175+0000","last_became_peered":"2024-09-10T06:26:30.603175+0000","last_unstale":"2024-09-10T06:26:41.323961+0000","last_undegraded":"2024-09-10T06:26:41.323961+0000","last_fullsized":"2024-09-10T06:26:41.323961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311194+0000","last_change":"2024-09-10T06:26:34.286028+0000","last_active":"2024-09-10T06:26:41.311194+0000","last_peered":"2024-09-10T06:26:41.311194+0000","last_clean":"2024-09-10T06:26:41.311194+0000","last_became_active":"2024-09-10T06:26:34.285169+0000","last_became_peered":"2024-09-10T06:26:34.285169+0000","last_unstale":"2024-09-10T06:26:41.311194+0000","last_undegraded":"2024-09-10T06:26:41.311194+0000","last_fullsized":"2024-09-10T06:26:41.311194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:24.146088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.226082+0000","last_change":"2024-09-10T06:26:36.292679+0000","last_active":"2024-09-10T06:26:42.226082+0000","last_peered":"2024-09-10T06:26:42.226082+0000","last_clean":"2024-09-10T06:26:42.226082+0000","last_became_active":"2024-09-10T06:26:36.288780+0000","last_became_peered":"2024-09-10T06:26:36.288780+0000","last_unstale":"2024-09-10T06:26:42.226082+0000","last_undegraded":"2024-09-10T06:26:42.226082+0000","last_fullsized":"2024-09-10T06:26:42.226082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327851+0000","last_change":"2024-09-10T06:26:38.293015+0000","last_active":"2024-09-10T06:26:41.327851+0000","last_peered":"2024-09-10T06:26:41.327851+0000","last_clean":"2024-09-10T06:26:41.327851+0000","last_became_active":"2024-09-10T06:26:38.292185+0000","last_became_peered":"2024-09-10T06:26:38.292185+0000","last_unstale":"2024-09-10T06:26:41.327851+0000","last_undegraded":"2024-09-10T06:26:41.327851+0000","last_fullsized":"2024-09-10T06:26:41.327851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:32.694777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313475+0000","last_change":"2024-09-10T06:26:40.336074+0000","last_active":"2024-09-10T06:26:41.313475+0000","last_peered":"2024-09-10T06:26:41.313475+0000","last_clean":"2024-09-10T06:26:41.313475+0000","last_became_active":"2024-09-10T06:26:40.335339+0000","last_became_peered":"2024-09-10T06:26:40.335339+0000","last_unstale":"2024-09-10T06:26:41.313475+0000","last_undegraded":"2024-09-10T06:26:41.313475+0000","last_fullsized":"2024-09-10T06:26:41.313475+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294322+0000","last_change":"2024-09-10T06:26:32.262823+0000","last_active":"2024-09-10T06:26:41.294322+0000","last_peered":"2024-09-10T06:26:41.294322+0000","last_clean":"2024-09-10T06:26:41.294322+0000","last_became_active":"2024-09-10T06:26:32.262041+0000","last_became_peered":"2024-09-10T06:26:32.262041+0000","last_unstale":"2024-09-10T06:26:41.294322+0000","last_undegraded":"2024-09-10T06:26:41.294322+0000","last_fullsized":"2024-09-10T06:26:41.294322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:48.768083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325116+0000","last_change":"2024-09-10T06:26:30.609104+0000","last_active":"2024-09-10T06:26:41.325116+0000","last_peered":"2024-09-10T06:26:41.325116+0000","last_clean":"2024-09-10T06:26:41.325116+0000","last_became_active":"2024-09-10T06:26:30.604546+0000","last_became_peered":"2024-09-10T06:26:30.604546+0000","last_unstale":"2024-09-10T06:26:41.325116+0000","last_undegraded":"2024-09-10T06:26:41.325116+0000","last_fullsized":"2024-09-10T06:26:41.325116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:35.326017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.322859+0000","last_change":"2024-09-10T06:26:34.282651+0000","last_active":"2024-09-10T06:26:41.322859+0000","last_peered":"2024-09-10T06:26:41.322859+0000","last_clean":"2024-09-10T06:26:41.322859+0000","last_became_active":"2024-09-10T06:26:34.281777+0000","last_became_peered":"2024-09-10T06:26:34.281777+0000","last_unstale":"2024-09-10T06:26:41.322859+0000","last_undegraded":"2024-09-10T06:26:41.322859+0000","last_fullsized":"2024-09-10T06:26:41.322859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:42.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.628411+0000","last_change":"2024-09-10T06:26:36.285192+0000","last_active":"2024-09-10T06:26:41.628411+0000","last_peered":"2024-09-10T06:26:41.628411+0000","last_clean":"2024-09-10T06:26:41.628411+0000","last_became_active":"2024-09-10T06:26:36.284470+0000","last_became_peered":"2024-09-10T06:26:36.284470+0000","last_unstale":"2024-09-10T06:26:41.628411+0000","last_undegraded":"2024-09-10T06:26:41.628411+0000","last_fullsized":"2024-09-10T06:26:41.628411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:44.280458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325893+0000","last_change":"2024-09-10T06:26:38.303425+0000","last_active":"2024-09-10T06:26:41.325893+0000","last_peered":"2024-09-10T06:26:41.325893+0000","last_clean":"2024-09-10T06:26:41.325893+0000","last_became_active":"2024-09-10T06:26:38.302606+0000","last_became_peered":"2024-09-10T06:26:38.302606+0000","last_unstale":"2024-09-10T06:26:41.325893+0000","last_undegraded":"2024-09-10T06:26:41.325893+0000","last_fullsized":"2024-09-10T06:26:41.325893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:14.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.296749+0000","last_change":"2024-09-10T06:26:40.311253+0000","last_active":"2024-09-10T06:26:41.296749+0000","last_peered":"2024-09-10T06:26:41.296749+0000","last_clean":"2024-09-10T06:26:41.296749+0000","last_became_active":"2024-09-10T06:26:40.310414+0000","last_became_peered":"2024-09-10T06:26:40.310414+0000","last_unstale":"2024-09-10T06:26:41.296749+0000","last_undegraded":"2024-09-10T06:26:41.296749+0000","last_fullsized":"2024-09-10T06:26:41.296749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:20.868195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294016+0000","last_change":"2024-09-10T06:26:32.262972+0000","last_active":"2024-09-10T06:26:41.294016+0000","last_peered":"2024-09-10T06:26:41.294016+0000","last_clean":"2024-09-10T06:26:41.294016+0000","last_became_active":"2024-09-10T06:26:32.262469+0000","last_became_peered":"2024-09-10T06:26:32.262469+0000","last_unstale":"2024-09-10T06:26:41.294016+0000","last_undegraded":"2024-09-10T06:26:41.294016+0000","last_fullsized":"2024-09-10T06:26:41.294016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.297461+0000","last_change":"2024-09-10T06:26:30.602013+0000","last_active":"2024-09-10T06:26:41.297461+0000","last_peered":"2024-09-10T06:26:41.297461+0000","last_clean":"2024-09-10T06:26:41.297461+0000","last_became_active":"2024-09-10T06:26:30.601672+0000","last_became_peered":"2024-09-10T06:26:30.601672+0000","last_unstale":"2024-09-10T06:26:41.297461+0000","last_undegraded":"2024-09-10T06:26:41.297461+0000","last_fullsized":"2024-09-10T06:26:41.297461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:52.012063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.292604+0000","last_change":"2024-09-10T06:26:34.277010+0000","last_active":"2024-09-10T06:26:41.292604+0000","last_peered":"2024-09-10T06:26:41.292604+0000","last_clean":"2024-09-10T06:26:41.292604+0000","last_became_active":"2024-09-10T06:26:34.276197+0000","last_became_peered":"2024-09-10T06:26:34.276197+0000","last_unstale":"2024-09-10T06:26:41.292604+0000","last_undegraded":"2024-09-10T06:26:41.292604+0000","last_fullsized":"2024-09-10T06:26:41.292604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:32.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'5","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.855880+0000","last_change":"2024-09-10T06:26:36.297514+0000","last_active":"2024-09-10T06:26:41.855880+0000","last_peered":"2024-09-10T06:26:41.855880+0000","last_clean":"2024-09-10T06:26:41.855880+0000","last_became_active":"2024-09-10T06:26:36.296615+0000","last_became_peered":"2024-09-10T06:26:36.296615+0000","last_unstale":"2024-09-10T06:26:41.855880+0000","last_undegraded":"2024-09-10T06:26:41.855880+0000","last_fullsized":"2024-09-10T06:26:41.855880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293008+0000","last_change":"2024-09-10T06:26:38.288794+0000","last_active":"2024-09-10T06:26:41.293008+0000","last_peered":"2024-09-10T06:26:41.293008+0000","last_clean":"2024-09-10T06:26:41.293008+0000","last_became_active":"2024-09-10T06:26:38.288055+0000","last_became_peered":"2024-09-10T06:26:38.288055+0000","last_unstale":"2024-09-10T06:26:41.293008+0000","last_undegraded":"2024-09-10T06:26:41.293008+0000","last_fullsized":"2024-09-10T06:26:41.293008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312860+0000","last_change":"2024-09-10T06:26:40.318067+0000","last_active":"2024-09-10T06:26:41.312860+0000","last_peered":"2024-09-10T06:26:41.312860+0000","last_clean":"2024-09-10T06:26:41.312860+0000","last_became_active":"2024-09-10T06:26:40.317244+0000","last_became_peered":"2024-09-10T06:26:40.317244+0000","last_unstale":"2024-09-10T06:26:41.312860+0000","last_undegraded":"2024-09-10T06:26:41.312860+0000","last_fullsized":"2024-09-10T06:26:41.312860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293197+0000","last_change":"2024-09-10T06:26:32.277908+0000","last_active":"2024-09-10T06:26:41.293197+0000","last_peered":"2024-09-10T06:26:41.293197+0000","last_clean":"2024-09-10T06:26:41.293197+0000","last_became_active":"2024-09-10T06:26:32.274812+0000","last_became_peered":"2024-09-10T06:26:32.274812+0000","last_unstale":"2024-09-10T06:26:41.293197+0000","last_undegraded":"2024-09-10T06:26:41.293197+0000","last_fullsized":"2024-09-10T06:26:41.293197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:37.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331609+0000","last_change":"2024-09-10T06:26:30.594013+0000","last_active":"2024-09-10T06:26:41.331609+0000","last_peered":"2024-09-10T06:26:41.331609+0000","last_clean":"2024-09-10T06:26:41.331609+0000","last_became_active":"2024-09-10T06:26:30.593687+0000","last_became_peered":"2024-09-10T06:26:30.593687+0000","last_unstale":"2024-09-10T06:26:41.331609+0000","last_undegraded":"2024-09-10T06:26:41.331609+0000","last_fullsized":"2024-09-10T06:26:41.331609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:37.375037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.314524+0000","last_change":"2024-09-10T06:26:34.283392+0000","last_active":"2024-09-10T06:26:41.314524+0000","last_peered":"2024-09-10T06:26:41.314524+0000","last_clean":"2024-09-10T06:26:41.314524+0000","last_became_active":"2024-09-10T06:26:34.282931+0000","last_became_peered":"2024-09-10T06:26:34.282931+0000","last_unstale":"2024-09-10T06:26:41.314524+0000","last_undegraded":"2024-09-10T06:26:41.314524+0000","last_fullsized":"2024-09-10T06:26:41.314524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:01.310719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.920981+0000","last_change":"2024-09-10T06:26:36.289834+0000","last_active":"2024-09-10T06:26:41.920981+0000","last_peered":"2024-09-10T06:26:41.920981+0000","last_clean":"2024-09-10T06:26:41.920981+0000","last_became_active":"2024-09-10T06:26:36.289033+0000","last_became_peered":"2024-09-10T06:26:36.289033+0000","last_unstale":"2024-09-10T06:26:41.920981+0000","last_undegraded":"2024-09-10T06:26:41.920981+0000","last_fullsized":"2024-09-10T06:26:41.920981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328499+0000","last_change":"2024-09-10T06:26:38.299568+0000","last_active":"2024-09-10T06:26:41.328499+0000","last_peered":"2024-09-10T06:26:41.328499+0000","last_clean":"2024-09-10T06:26:41.328499+0000","last_became_active":"2024-09-10T06:26:38.298779+0000","last_became_peered":"2024-09-10T06:26:38.298779+0000","last_unstale":"2024-09-10T06:26:41.328499+0000","last_undegraded":"2024-09-10T06:26:41.328499+0000","last_fullsized":"2024-09-10T06:26:41.328499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295833+0000","last_change":"2024-09-10T06:26:40.336329+0000","last_active":"2024-09-10T06:26:41.295833+0000","last_peered":"2024-09-10T06:26:41.295833+0000","last_clean":"2024-09-10T06:26:41.295833+0000","last_became_active":"2024-09-10T06:26:40.335348+0000","last_became_peered":"2024-09-10T06:26:40.335348+0000","last_unstale":"2024-09-10T06:26:41.295833+0000","last_undegraded":"2024-09-10T06:26:41.295833+0000","last_fullsized":"2024-09-10T06:26:41.295833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:40.653642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316871+0000","last_change":"2024-09-10T06:26:32.276392+0000","last_active":"2024-09-10T06:26:41.316871+0000","last_peered":"2024-09-10T06:26:41.316871+0000","last_clean":"2024-09-10T06:26:41.316871+0000","last_became_active":"2024-09-10T06:26:32.275855+0000","last_became_peered":"2024-09-10T06:26:32.275855+0000","last_unstale":"2024-09-10T06:26:41.316871+0000","last_undegraded":"2024-09-10T06:26:41.316871+0000","last_fullsized":"2024-09-10T06:26:41.316871+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:34.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325634+0000","last_change":"2024-09-10T06:26:30.591577+0000","last_active":"2024-09-10T06:26:41.325634+0000","last_peered":"2024-09-10T06:26:41.325634+0000","last_clean":"2024-09-10T06:26:41.325634+0000","last_became_active":"2024-09-10T06:26:30.590801+0000","last_became_peered":"2024-09-10T06:26:30.590801+0000","last_unstale":"2024-09-10T06:26:41.325634+0000","last_undegraded":"2024-09-10T06:26:41.325634+0000","last_fullsized":"2024-09-10T06:26:41.325634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:16.066664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316453+0000","last_change":"2024-09-10T06:26:32.268621+0000","last_active":"2024-09-10T06:26:41.316453+0000","last_peered":"2024-09-10T06:26:41.316453+0000","last_clean":"2024-09-10T06:26:41.316453+0000","last_became_active":"2024-09-10T06:26:32.267915+0000","last_became_peered":"2024-09-10T06:26:32.267915+0000","last_unstale":"2024-09-10T06:26:41.316453+0000","last_undegraded":"2024-09-10T06:26:41.316453+0000","last_fullsized":"2024-09-10T06:26:41.316453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:10.670492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.292642+0000","last_change":"2024-09-10T06:26:30.593794+0000","last_active":"2024-09-10T06:26:41.292642+0000","last_peered":"2024-09-10T06:26:41.292642+0000","last_clean":"2024-09-10T06:26:41.292642+0000","last_became_active":"2024-09-10T06:26:30.593506+0000","last_became_peered":"2024-09-10T06:26:30.593506+0000","last_unstale":"2024-09-10T06:26:41.292642+0000","last_undegraded":"2024-09-10T06:26:41.292642+0000","last_fullsized":"2024-09-10T06:26:41.292642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:29.521578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.324746+0000","last_change":"2024-09-10T06:26:32.288497+0000","last_active":"2024-09-10T06:26:41.324746+0000","last_peered":"2024-09-10T06:26:41.324746+0000","last_clean":"2024-09-10T06:26:41.324746+0000","last_became_active":"2024-09-10T06:26:32.287839+0000","last_became_peered":"2024-09-10T06:26:32.287839+0000","last_unstale":"2024-09-10T06:26:41.324746+0000","last_undegraded":"2024-09-10T06:26:41.324746+0000","last_fullsized":"2024-09-10T06:26:41.324746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323153+0000","last_change":"2024-09-10T06:26:30.610172+0000","last_active":"2024-09-10T06:26:41.323153+0000","last_peered":"2024-09-10T06:26:41.323153+0000","last_clean":"2024-09-10T06:26:41.323153+0000","last_became_active":"2024-09-10T06:26:30.602685+0000","last_became_peered":"2024-09-10T06:26:30.602685+0000","last_unstale":"2024-09-10T06:26:41.323153+0000","last_undegraded":"2024-09-10T06:26:41.323153+0000","last_fullsized":"2024-09-10T06:26:41.323153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:35.705564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315994+0000","last_change":"2024-09-10T06:26:32.272921+0000","last_active":"2024-09-10T06:26:41.315994+0000","last_peered":"2024-09-10T06:26:41.315994+0000","last_clean":"2024-09-10T06:26:41.315994+0000","last_became_active":"2024-09-10T06:26:32.272279+0000","last_became_peered":"2024-09-10T06:26:32.272279+0000","last_unstale":"2024-09-10T06:26:41.315994+0000","last_undegraded":"2024-09-10T06:26:41.315994+0000","last_fullsized":"2024-09-10T06:26:41.315994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:11.951551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329920+0000","last_change":"2024-09-10T06:26:30.579541+0000","last_active":"2024-09-10T06:26:41.329920+0000","last_peered":"2024-09-10T06:26:41.329920+0000","last_clean":"2024-09-10T06:26:41.329920+0000","last_became_active":"2024-09-10T06:26:30.579189+0000","last_became_peered":"2024-09-10T06:26:30.579189+0000","last_unstale":"2024-09-10T06:26:41.329920+0000","last_undegraded":"2024-09-10T06:26:41.329920+0000","last_fullsized":"2024-09-10T06:26:41.329920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:18.099885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295255+0000","last_change":"2024-09-10T06:26:32.260098+0000","last_active":"2024-09-10T06:26:41.295255+0000","last_peered":"2024-09-10T06:26:41.295255+0000","last_clean":"2024-09-10T06:26:41.295255+0000","last_became_active":"2024-09-10T06:26:32.259644+0000","last_became_peered":"2024-09-10T06:26:32.259644+0000","last_unstale":"2024-09-10T06:26:41.295255+0000","last_undegraded":"2024-09-10T06:26:41.295255+0000","last_fullsized":"2024-09-10T06:26:41.295255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.297454+0000","last_change":"2024-09-10T06:26:30.576146+0000","last_active":"2024-09-10T06:26:41.297454+0000","last_peered":"2024-09-10T06:26:41.297454+0000","last_clean":"2024-09-10T06:26:41.297454+0000","last_became_active":"2024-09-10T06:26:30.575605+0000","last_became_peered":"2024-09-10T06:26:30.575605+0000","last_unstale":"2024-09-10T06:26:41.297454+0000","last_undegraded":"2024-09-10T06:26:41.297454+0000","last_fullsized":"2024-09-10T06:26:41.297454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294437+0000","last_change":"2024-09-10T06:26:32.277577+0000","last_active":"2024-09-10T06:26:41.294437+0000","last_peered":"2024-09-10T06:26:41.294437+0000","last_clean":"2024-09-10T06:26:41.294437+0000","last_became_active":"2024-09-10T06:26:32.272454+0000","last_became_peered":"2024-09-10T06:26:32.272454+0000","last_unstale":"2024-09-10T06:26:41.294437+0000","last_undegraded":"2024-09-10T06:26:41.294437+0000","last_fullsized":"2024-09-10T06:26:41.294437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.317102+0000","last_change":"2024-09-10T06:26:30.579134+0000","last_active":"2024-09-10T06:26:41.317102+0000","last_peered":"2024-09-10T06:26:41.317102+0000","last_clean":"2024-09-10T06:26:41.317102+0000","last_became_active":"2024-09-10T06:26:30.578732+0000","last_became_peered":"2024-09-10T06:26:30.578732+0000","last_unstale":"2024-09-10T06:26:41.317102+0000","last_undegraded":"2024-09-10T06:26:41.317102+0000","last_fullsized":"2024-09-10T06:26:41.317102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:08.832907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293379+0000","last_change":"2024-09-10T06:26:32.270804+0000","last_active":"2024-09-10T06:26:41.293379+0000","last_peered":"2024-09-10T06:26:41.293379+0000","last_clean":"2024-09-10T06:26:41.293379+0000","last_became_active":"2024-09-10T06:26:32.270327+0000","last_became_peered":"2024-09-10T06:26:32.270327+0000","last_unstale":"2024-09-10T06:26:41.293379+0000","last_undegraded":"2024-09-10T06:26:41.293379+0000","last_fullsized":"2024-09-10T06:26:41.293379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327759+0000","last_change":"2024-09-10T06:26:30.598004+0000","last_active":"2024-09-10T06:26:41.327759+0000","last_peered":"2024-09-10T06:26:41.327759+0000","last_clean":"2024-09-10T06:26:41.327759+0000","last_became_active":"2024-09-10T06:26:30.596254+0000","last_became_peered":"2024-09-10T06:26:30.596254+0000","last_unstale":"2024-09-10T06:26:41.327759+0000","last_undegraded":"2024-09-10T06:26:41.327759+0000","last_fullsized":"2024-09-10T06:26:41.327759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325553+0000","last_change":"2024-09-10T06:26:32.284215+0000","last_active":"2024-09-10T06:26:41.325553+0000","last_peered":"2024-09-10T06:26:41.325553+0000","last_clean":"2024-09-10T06:26:41.325553+0000","last_became_active":"2024-09-10T06:26:32.275133+0000","last_became_peered":"2024-09-10T06:26:32.275133+0000","last_unstale":"2024-09-10T06:26:41.325553+0000","last_undegraded":"2024-09-10T06:26:41.325553+0000","last_fullsized":"2024-09-10T06:26:41.325553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:37.703268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298799+0000","last_change":"2024-09-10T06:26:30.580586+0000","last_active":"2024-09-10T06:26:41.298799+0000","last_peered":"2024-09-10T06:26:41.298799+0000","last_clean":"2024-09-10T06:26:41.298799+0000","last_became_active":"2024-09-10T06:26:30.580134+0000","last_became_peered":"2024-09-10T06:26:30.580134+0000","last_unstale":"2024-09-10T06:26:41.298799+0000","last_undegraded":"2024-09-10T06:26:41.298799+0000","last_fullsized":"2024-09-10T06:26:41.298799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331373+0000","last_change":"2024-09-10T06:26:32.256538+0000","last_active":"2024-09-10T06:26:41.331373+0000","last_peered":"2024-09-10T06:26:41.331373+0000","last_clean":"2024-09-10T06:26:41.331373+0000","last_became_active":"2024-09-10T06:26:32.256052+0000","last_became_peered":"2024-09-10T06:26:32.256052+0000","last_unstale":"2024-09-10T06:26:41.331373+0000","last_undegraded":"2024-09-10T06:26:41.331373+0000","last_fullsized":"2024-09-10T06:26:41.331373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:14.620472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.322062+0000","last_change":"2024-09-10T06:26:30.585220+0000","last_active":"2024-09-10T06:26:41.322062+0000","last_peered":"2024-09-10T06:26:41.322062+0000","last_clean":"2024-09-10T06:26:41.322062+0000","last_became_active":"2024-09-10T06:26:30.584443+0000","last_became_peered":"2024-09-10T06:26:30.584443+0000","last_unstale":"2024-09-10T06:26:41.322062+0000","last_undegraded":"2024-09-10T06:26:41.322062+0000","last_fullsized":"2024-09-10T06:26:41.322062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295560+0000","last_change":"2024-09-10T06:26:32.259306+0000","last_active":"2024-09-10T06:26:41.295560+0000","last_peered":"2024-09-10T06:26:41.295560+0000","last_clean":"2024-09-10T06:26:41.295560+0000","last_became_active":"2024-09-10T06:26:32.258513+0000","last_became_peered":"2024-09-10T06:26:32.258513+0000","last_unstale":"2024-09-10T06:26:41.295560+0000","last_undegraded":"2024-09-10T06:26:41.295560+0000","last_fullsized":"2024-09-10T06:26:41.295560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294236+0000","last_change":"2024-09-10T06:26:30.581285+0000","last_active":"2024-09-10T06:26:41.294236+0000","last_peered":"2024-09-10T06:26:41.294236+0000","last_clean":"2024-09-10T06:26:41.294236+0000","last_became_active":"2024-09-10T06:26:30.580913+0000","last_became_peered":"2024-09-10T06:26:30.580913+0000","last_unstale":"2024-09-10T06:26:41.294236+0000","last_undegraded":"2024-09-10T06:26:41.294236+0000","last_fullsized":"2024-09-10T06:26:41.294236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298301+0000","last_change":"2024-09-10T06:26:32.274773+0000","last_active":"2024-09-10T06:26:41.298301+0000","last_peered":"2024-09-10T06:26:41.298301+0000","last_clean":"2024-09-10T06:26:41.298301+0000","last_became_active":"2024-09-10T06:26:32.274327+0000","last_became_peered":"2024-09-10T06:26:32.274327+0000","last_unstale":"2024-09-10T06:26:41.298301+0000","last_undegraded":"2024-09-10T06:26:41.298301+0000","last_fullsized":"2024-09-10T06:26:41.298301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:54.026434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.322980+0000","last_change":"2024-09-10T06:26:30.614052+0000","last_active":"2024-09-10T06:26:41.322980+0000","last_peered":"2024-09-10T06:26:41.322980+0000","last_clean":"2024-09-10T06:26:41.322980+0000","last_became_active":"2024-09-10T06:26:30.608992+0000","last_became_peered":"2024-09-10T06:26:30.608992+0000","last_unstale":"2024-09-10T06:26:41.322980+0000","last_undegraded":"2024-09-10T06:26:41.322980+0000","last_fullsized":"2024-09-10T06:26:41.322980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:49.865234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295267+0000","last_change":"2024-09-10T06:26:32.279474+0000","last_active":"2024-09-10T06:26:41.295267+0000","last_peered":"2024-09-10T06:26:41.295267+0000","last_clean":"2024-09-10T06:26:41.295267+0000","last_became_active":"2024-09-10T06:26:32.278461+0000","last_became_peered":"2024-09-10T06:26:32.278461+0000","last_unstale":"2024-09-10T06:26:41.295267+0000","last_undegraded":"2024-09-10T06:26:41.295267+0000","last_fullsized":"2024-09-10T06:26:41.295267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330098+0000","last_change":"2024-09-10T06:26:30.605519+0000","last_active":"2024-09-10T06:26:41.330098+0000","last_peered":"2024-09-10T06:26:41.330098+0000","last_clean":"2024-09-10T06:26:41.330098+0000","last_became_active":"2024-09-10T06:26:30.605225+0000","last_became_peered":"2024-09-10T06:26:30.605225+0000","last_unstale":"2024-09-10T06:26:41.330098+0000","last_undegraded":"2024-09-10T06:26:41.330098+0000","last_fullsized":"2024-09-10T06:26:41.330098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311968+0000","last_change":"2024-09-10T06:26:32.267201+0000","last_active":"2024-09-10T06:26:41.311968+0000","last_peered":"2024-09-10T06:26:41.311968+0000","last_clean":"2024-09-10T06:26:41.311968+0000","last_became_active":"2024-09-10T06:26:32.266234+0000","last_became_peered":"2024-09-10T06:26:32.266234+0000","last_unstale":"2024-09-10T06:26:41.311968+0000","last_undegraded":"2024-09-10T06:26:41.311968+0000","last_fullsized":"2024-09-10T06:26:41.311968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327215+0000","last_change":"2024-09-10T06:26:30.596647+0000","last_active":"2024-09-10T06:26:41.327215+0000","last_peered":"2024-09-10T06:26:41.327215+0000","last_clean":"2024-09-10T06:26:41.327215+0000","last_became_active":"2024-09-10T06:26:30.593598+0000","last_became_peered":"2024-09-10T06:26:30.593598+0000","last_unstale":"2024-09-10T06:26:41.327215+0000","last_undegraded":"2024-09-10T06:26:41.327215+0000","last_fullsized":"2024-09-10T06:26:41.327215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328490+0000","last_change":"2024-09-10T06:26:32.278317+0000","last_active":"2024-09-10T06:26:41.328490+0000","last_peered":"2024-09-10T06:26:41.328490+0000","last_clean":"2024-09-10T06:26:41.328490+0000","last_became_active":"2024-09-10T06:26:32.278032+0000","last_became_peered":"2024-09-10T06:26:32.278032+0000","last_unstale":"2024-09-10T06:26:41.328490+0000","last_undegraded":"2024-09-10T06:26:41.328490+0000","last_fullsized":"2024-09-10T06:26:41.328490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:00.200118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313590+0000","last_change":"2024-09-10T06:26:30.580552+0000","last_active":"2024-09-10T06:26:41.313590+0000","last_peered":"2024-09-10T06:26:41.313590+0000","last_clean":"2024-09-10T06:26:41.313590+0000","last_became_active":"2024-09-10T06:26:30.579319+0000","last_became_peered":"2024-09-10T06:26:30.579319+0000","last_unstale":"2024-09-10T06:26:41.313590+0000","last_undegraded":"2024-09-10T06:26:41.313590+0000","last_fullsized":"2024-09-10T06:26:41.313590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:59.885311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293379+0000","last_change":"2024-09-10T06:26:32.257601+0000","last_active":"2024-09-10T06:26:41.293379+0000","last_peered":"2024-09-10T06:26:41.293379+0000","last_clean":"2024-09-10T06:26:41.293379+0000","last_became_active":"2024-09-10T06:26:32.256851+0000","last_became_peered":"2024-09-10T06:26:32.256851+0000","last_unstale":"2024-09-10T06:26:41.293379+0000","last_undegraded":"2024-09-10T06:26:41.293379+0000","last_fullsized":"2024-09-10T06:26:41.293379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.299399+0000","last_change":"2024-09-10T06:26:30.601996+0000","last_active":"2024-09-10T06:26:41.299399+0000","last_peered":"2024-09-10T06:26:41.299399+0000","last_clean":"2024-09-10T06:26:41.299399+0000","last_became_active":"2024-09-10T06:26:30.601686+0000","last_became_peered":"2024-09-10T06:26:30.601686+0000","last_unstale":"2024-09-10T06:26:41.299399+0000","last_undegraded":"2024-09-10T06:26:41.299399+0000","last_fullsized":"2024-09-10T06:26:41.299399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:11.953454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311286+0000","last_change":"2024-09-10T06:26:32.266768+0000","last_active":"2024-09-10T06:26:41.311286+0000","last_peered":"2024-09-10T06:26:41.311286+0000","last_clean":"2024-09-10T06:26:41.311286+0000","last_became_active":"2024-09-10T06:26:32.266000+0000","last_became_peered":"2024-09-10T06:26:32.266000+0000","last_unstale":"2024-09-10T06:26:41.311286+0000","last_undegraded":"2024-09-10T06:26:41.311286+0000","last_fullsized":"2024-09-10T06:26:41.311286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325331+0000","last_change":"2024-09-10T06:26:30.610309+0000","last_active":"2024-09-10T06:26:41.325331+0000","last_peered":"2024-09-10T06:26:41.325331+0000","last_clean":"2024-09-10T06:26:41.325331+0000","last_became_active":"2024-09-10T06:26:30.609674+0000","last_became_peered":"2024-09-10T06:26:30.609674+0000","last_unstale":"2024-09-10T06:26:41.325331+0000","last_undegraded":"2024-09-10T06:26:41.325331+0000","last_fullsized":"2024-09-10T06:26:41.325331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.321785+0000","last_change":"2024-09-10T06:26:30.591365+0000","last_active":"2024-09-10T06:26:41.321785+0000","last_peered":"2024-09-10T06:26:41.321785+0000","last_clean":"2024-09-10T06:26:41.321785+0000","last_became_active":"2024-09-10T06:26:30.590640+0000","last_became_peered":"2024-09-10T06:26:30.590640+0000","last_unstale":"2024-09-10T06:26:41.321785+0000","last_undegraded":"2024-09-10T06:26:41.321785+0000","last_fullsized":"2024-09-10T06:26:41.321785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331291+0000","last_change":"2024-09-10T06:26:32.267333+0000","last_active":"2024-09-10T06:26:41.331291+0000","last_peered":"2024-09-10T06:26:41.331291+0000","last_clean":"2024-09-10T06:26:41.331291+0000","last_became_active":"2024-09-10T06:26:32.266876+0000","last_became_peered":"2024-09-10T06:26:32.266876+0000","last_unstale":"2024-09-10T06:26:41.331291+0000","last_undegraded":"2024-09-10T06:26:41.331291+0000","last_fullsized":"2024-09-10T06:26:41.331291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:02.483639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315323+0000","last_change":"2024-09-10T06:26:30.590924+0000","last_active":"2024-09-10T06:26:41.315323+0000","last_peered":"2024-09-10T06:26:41.315323+0000","last_clean":"2024-09-10T06:26:41.315323+0000","last_became_active":"2024-09-10T06:26:30.590415+0000","last_became_peered":"2024-09-10T06:26:30.590415+0000","last_unstale":"2024-09-10T06:26:41.315323+0000","last_undegraded":"2024-09-10T06:26:41.315323+0000","last_fullsized":"2024-09-10T06:26:41.315323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:32.460291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323926+0000","last_change":"2024-09-10T06:26:32.283339+0000","last_active":"2024-09-10T06:26:41.323926+0000","last_peered":"2024-09-10T06:26:41.323926+0000","last_clean":"2024-09-10T06:26:41.323926+0000","last_became_active":"2024-09-10T06:26:32.282581+0000","last_became_peered":"2024-09-10T06:26:32.282581+0000","last_unstale":"2024-09-10T06:26:41.323926+0000","last_undegraded":"2024-09-10T06:26:41.323926+0000","last_fullsized":"2024-09-10T06:26:41.323926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1019904,"data_stored":758879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":405504,"data_stored":168844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":168698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":393216,"data_stored":168342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":168683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":167413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":421888,"data_stored":168120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1003520,"data_stored":758721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:26:48.343 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:26:48.709 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:26:48.716 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:26:48.731 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-09-10T06:26:47.419107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":526,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224796,"kb_used_data":4400,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749924,"statfs":{"total":773094113280,"available":772863922176,"internally_reserved":0,"allocated":4505600,"data_stored":2527700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002729"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313023+0000","last_change":"2024-09-10T06:26:30.604655+0000","last_active":"2024-09-10T06:26:41.313023+0000","last_peered":"2024-09-10T06:26:41.313023+0000","last_clean":"2024-09-10T06:26:41.313023+0000","last_became_active":"2024-09-10T06:26:30.601308+0000","last_became_peered":"2024-09-10T06:26:30.601308+0000","last_unstale":"2024-09-10T06:26:41.313023+0000","last_undegraded":"2024-09-10T06:26:41.313023+0000","last_fullsized":"2024-09-10T06:26:41.313023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:35.326017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.321390+0000","last_change":"2024-09-10T06:26:32.279882+0000","last_active":"2024-09-10T06:26:41.321390+0000","last_peered":"2024-09-10T06:26:41.321390+0000","last_clean":"2024-09-10T06:26:41.321390+0000","last_became_active":"2024-09-10T06:26:32.279098+0000","last_became_peered":"2024-09-10T06:26:32.279098+0000","last_unstale":"2024-09-10T06:26:41.321390+0000","last_undegraded":"2024-09-10T06:26:41.321390+0000","last_fullsized":"2024-09-10T06:26:41.321390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316645+0000","last_change":"2024-09-10T06:26:30.573148+0000","last_active":"2024-09-10T06:26:41.316645+0000","last_peered":"2024-09-10T06:26:41.316645+0000","last_clean":"2024-09-10T06:26:41.316645+0000","last_became_active":"2024-09-10T06:26:30.572798+0000","last_became_peered":"2024-09-10T06:26:30.572798+0000","last_unstale":"2024-09-10T06:26:41.316645+0000","last_undegraded":"2024-09-10T06:26:41.316645+0000","last_fullsized":"2024-09-10T06:26:41.316645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:38.833715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311387+0000","last_change":"2024-09-10T06:26:32.276811+0000","last_active":"2024-09-10T06:26:41.311387+0000","last_peered":"2024-09-10T06:26:41.311387+0000","last_clean":"2024-09-10T06:26:41.311387+0000","last_became_active":"2024-09-10T06:26:32.275990+0000","last_became_peered":"2024-09-10T06:26:32.275990+0000","last_unstale":"2024-09-10T06:26:41.311387+0000","last_undegraded":"2024-09-10T06:26:41.311387+0000","last_fullsized":"2024-09-10T06:26:41.311387+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330063+0000","last_change":"2024-09-10T06:26:30.578068+0000","last_active":"2024-09-10T06:26:41.330063+0000","last_peered":"2024-09-10T06:26:41.330063+0000","last_clean":"2024-09-10T06:26:41.330063+0000","last_became_active":"2024-09-10T06:26:30.577688+0000","last_became_peered":"2024-09-10T06:26:30.577688+0000","last_unstale":"2024-09-10T06:26:41.330063+0000","last_undegraded":"2024-09-10T06:26:41.330063+0000","last_fullsized":"2024-09-10T06:26:41.330063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:34.137079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293797+0000","last_change":"2024-09-10T06:26:32.256939+0000","last_active":"2024-09-10T06:26:41.293797+0000","last_peered":"2024-09-10T06:26:41.293797+0000","last_clean":"2024-09-10T06:26:41.293797+0000","last_became_active":"2024-09-10T06:26:32.256117+0000","last_became_peered":"2024-09-10T06:26:32.256117+0000","last_unstale":"2024-09-10T06:26:41.293797+0000","last_undegraded":"2024-09-10T06:26:41.293797+0000","last_fullsized":"2024-09-10T06:26:41.293797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:51.879604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323729+0000","last_change":"2024-09-10T06:26:30.593697+0000","last_active":"2024-09-10T06:26:41.323729+0000","last_peered":"2024-09-10T06:26:41.323729+0000","last_clean":"2024-09-10T06:26:41.323729+0000","last_became_active":"2024-09-10T06:26:30.591807+0000","last_became_peered":"2024-09-10T06:26:30.591807+0000","last_unstale":"2024-09-10T06:26:41.323729+0000","last_undegraded":"2024-09-10T06:26:41.323729+0000","last_fullsized":"2024-09-10T06:26:41.323729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329661+0000","last_change":"2024-09-10T06:26:32.264685+0000","last_active":"2024-09-10T06:26:41.329661+0000","last_peered":"2024-09-10T06:26:41.329661+0000","last_clean":"2024-09-10T06:26:41.329661+0000","last_became_active":"2024-09-10T06:26:32.264199+0000","last_became_peered":"2024-09-10T06:26:32.264199+0000","last_unstale":"2024-09-10T06:26:41.329661+0000","last_undegraded":"2024-09-10T06:26:41.329661+0000","last_fullsized":"2024-09-10T06:26:41.329661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:20.713066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312113+0000","last_change":"2024-09-10T06:26:30.584856+0000","last_active":"2024-09-10T06:26:41.312113+0000","last_peered":"2024-09-10T06:26:41.312113+0000","last_clean":"2024-09-10T06:26:41.312113+0000","last_became_active":"2024-09-10T06:26:30.584149+0000","last_became_peered":"2024-09-10T06:26:30.584149+0000","last_unstale":"2024-09-10T06:26:41.312113+0000","last_undegraded":"2024-09-10T06:26:41.312113+0000","last_fullsized":"2024-09-10T06:26:41.312113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:35.688897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326995+0000","last_change":"2024-09-10T06:26:32.290741+0000","last_active":"2024-09-10T06:26:41.326995+0000","last_peered":"2024-09-10T06:26:41.326995+0000","last_clean":"2024-09-10T06:26:41.326995+0000","last_became_active":"2024-09-10T06:26:32.289840+0000","last_became_peered":"2024-09-10T06:26:32.289840+0000","last_unstale":"2024-09-10T06:26:41.326995+0000","last_undegraded":"2024-09-10T06:26:41.326995+0000","last_fullsized":"2024-09-10T06:26:41.326995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.322706+0000","last_change":"2024-09-10T06:26:30.609817+0000","last_active":"2024-09-10T06:26:41.322706+0000","last_peered":"2024-09-10T06:26:41.322706+0000","last_clean":"2024-09-10T06:26:41.322706+0000","last_became_active":"2024-09-10T06:26:30.603330+0000","last_became_peered":"2024-09-10T06:26:30.603330+0000","last_unstale":"2024-09-10T06:26:41.322706+0000","last_undegraded":"2024-09-10T06:26:41.322706+0000","last_fullsized":"2024-09-10T06:26:41.322706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:09.523045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295048+0000","last_change":"2024-09-10T06:26:32.257050+0000","last_active":"2024-09-10T06:26:41.295048+0000","last_peered":"2024-09-10T06:26:41.295048+0000","last_clean":"2024-09-10T06:26:41.295048+0000","last_became_active":"2024-09-10T06:26:32.254437+0000","last_became_peered":"2024-09-10T06:26:32.254437+0000","last_unstale":"2024-09-10T06:26:41.295048+0000","last_undegraded":"2024-09-10T06:26:41.295048+0000","last_fullsized":"2024-09-10T06:26:41.295048+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311564+0000","last_change":"2024-09-10T06:26:30.579756+0000","last_active":"2024-09-10T06:26:41.311564+0000","last_peered":"2024-09-10T06:26:41.311564+0000","last_clean":"2024-09-10T06:26:41.311564+0000","last_became_active":"2024-09-10T06:26:30.578033+0000","last_became_peered":"2024-09-10T06:26:30.578033+0000","last_unstale":"2024-09-10T06:26:41.311564+0000","last_undegraded":"2024-09-10T06:26:41.311564+0000","last_fullsized":"2024-09-10T06:26:41.311564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323677+0000","last_change":"2024-09-10T06:26:32.281248+0000","last_active":"2024-09-10T06:26:41.323677+0000","last_peered":"2024-09-10T06:26:41.323677+0000","last_clean":"2024-09-10T06:26:41.323677+0000","last_became_active":"2024-09-10T06:26:32.280480+0000","last_became_peered":"2024-09-10T06:26:32.280480+0000","last_unstale":"2024-09-10T06:26:41.323677+0000","last_undegraded":"2024-09-10T06:26:41.323677+0000","last_fullsized":"2024-09-10T06:26:41.323677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294752+0000","last_change":"2024-09-10T06:26:30.593213+0000","last_active":"2024-09-10T06:26:41.294752+0000","last_peered":"2024-09-10T06:26:41.294752+0000","last_clean":"2024-09-10T06:26:41.294752+0000","last_became_active":"2024-09-10T06:26:30.592770+0000","last_became_peered":"2024-09-10T06:26:30.592770+0000","last_unstale":"2024-09-10T06:26:41.294752+0000","last_undegraded":"2024-09-10T06:26:41.294752+0000","last_fullsized":"2024-09-10T06:26:41.294752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298876+0000","last_change":"2024-09-10T06:26:32.267430+0000","last_active":"2024-09-10T06:26:41.298876+0000","last_peered":"2024-09-10T06:26:41.298876+0000","last_clean":"2024-09-10T06:26:41.298876+0000","last_became_active":"2024-09-10T06:26:32.265788+0000","last_became_peered":"2024-09-10T06:26:32.265788+0000","last_unstale":"2024-09-10T06:26:41.298876+0000","last_undegraded":"2024-09-10T06:26:41.298876+0000","last_fullsized":"2024-09-10T06:26:41.298876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:19.180142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293160+0000","last_change":"2024-09-10T06:26:32.255038+0000","last_active":"2024-09-10T06:26:41.293160+0000","last_peered":"2024-09-10T06:26:41.293160+0000","last_clean":"2024-09-10T06:26:41.293160+0000","last_became_active":"2024-09-10T06:26:32.254281+0000","last_became_peered":"2024-09-10T06:26:32.254281+0000","last_unstale":"2024-09-10T06:26:41.293160+0000","last_undegraded":"2024-09-10T06:26:41.293160+0000","last_fullsized":"2024-09-10T06:26:41.293160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:46.363171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313120+0000","last_change":"2024-09-10T06:26:30.607280+0000","last_active":"2024-09-10T06:26:41.313120+0000","last_peered":"2024-09-10T06:26:41.313120+0000","last_clean":"2024-09-10T06:26:41.313120+0000","last_became_active":"2024-09-10T06:26:30.605602+0000","last_became_peered":"2024-09-10T06:26:30.605602+0000","last_unstale":"2024-09-10T06:26:41.313120+0000","last_undegraded":"2024-09-10T06:26:41.313120+0000","last_fullsized":"2024-09-10T06:26:41.313120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:49.865234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311489+0000","last_change":"2024-09-10T06:26:32.275913+0000","last_active":"2024-09-10T06:26:41.311489+0000","last_peered":"2024-09-10T06:26:41.311489+0000","last_clean":"2024-09-10T06:26:41.311489+0000","last_became_active":"2024-09-10T06:26:32.274264+0000","last_became_peered":"2024-09-10T06:26:32.274264+0000","last_unstale":"2024-09-10T06:26:41.311489+0000","last_undegraded":"2024-09-10T06:26:41.311489+0000","last_fullsized":"2024-09-10T06:26:41.311489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327581+0000","last_change":"2024-09-10T06:26:30.598756+0000","last_active":"2024-09-10T06:26:41.327581+0000","last_peered":"2024-09-10T06:26:41.327581+0000","last_clean":"2024-09-10T06:26:41.327581+0000","last_became_active":"2024-09-10T06:26:30.597001+0000","last_became_peered":"2024-09-10T06:26:30.597001+0000","last_unstale":"2024-09-10T06:26:41.327581+0000","last_undegraded":"2024-09-10T06:26:41.327581+0000","last_fullsized":"2024-09-10T06:26:41.327581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:17.165772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.322864+0000","last_change":"2024-09-10T06:26:32.279079+0000","last_active":"2024-09-10T06:26:41.322864+0000","last_peered":"2024-09-10T06:26:41.322864+0000","last_clean":"2024-09-10T06:26:41.322864+0000","last_became_active":"2024-09-10T06:26:32.278407+0000","last_became_peered":"2024-09-10T06:26:32.278407+0000","last_unstale":"2024-09-10T06:26:41.322864+0000","last_undegraded":"2024-09-10T06:26:41.322864+0000","last_fullsized":"2024-09-10T06:26:41.322864+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327960+0000","last_change":"2024-09-10T06:26:30.607368+0000","last_active":"2024-09-10T06:26:41.327960+0000","last_peered":"2024-09-10T06:26:41.327960+0000","last_clean":"2024-09-10T06:26:41.327960+0000","last_became_active":"2024-09-10T06:26:30.606807+0000","last_became_peered":"2024-09-10T06:26:30.606807+0000","last_unstale":"2024-09-10T06:26:41.327960+0000","last_undegraded":"2024-09-10T06:26:41.327960+0000","last_fullsized":"2024-09-10T06:26:41.327960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293669+0000","last_change":"2024-09-10T06:26:32.265468+0000","last_active":"2024-09-10T06:26:41.293669+0000","last_peered":"2024-09-10T06:26:41.293669+0000","last_clean":"2024-09-10T06:26:41.293669+0000","last_became_active":"2024-09-10T06:26:32.265045+0000","last_became_peered":"2024-09-10T06:26:32.265045+0000","last_unstale":"2024-09-10T06:26:41.293669+0000","last_undegraded":"2024-09-10T06:26:41.293669+0000","last_fullsized":"2024-09-10T06:26:41.293669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:04.146927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294552+0000","last_change":"2024-09-10T06:26:30.598381+0000","last_active":"2024-09-10T06:26:41.294552+0000","last_peered":"2024-09-10T06:26:41.294552+0000","last_clean":"2024-09-10T06:26:41.294552+0000","last_became_active":"2024-09-10T06:26:30.597271+0000","last_became_peered":"2024-09-10T06:26:30.597271+0000","last_unstale":"2024-09-10T06:26:41.294552+0000","last_undegraded":"2024-09-10T06:26:41.294552+0000","last_fullsized":"2024-09-10T06:26:41.294552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:59.908548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.297874+0000","last_change":"2024-09-10T06:26:32.247492+0000","last_active":"2024-09-10T06:26:41.297874+0000","last_peered":"2024-09-10T06:26:41.297874+0000","last_clean":"2024-09-10T06:26:41.297874+0000","last_became_active":"2024-09-10T06:26:32.246938+0000","last_became_peered":"2024-09-10T06:26:32.246938+0000","last_unstale":"2024-09-10T06:26:41.297874+0000","last_undegraded":"2024-09-10T06:26:41.297874+0000","last_fullsized":"2024-09-10T06:26:41.297874+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:01.766868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294574+0000","last_change":"2024-09-10T06:26:30.592866+0000","last_active":"2024-09-10T06:26:41.294574+0000","last_peered":"2024-09-10T06:26:41.294574+0000","last_clean":"2024-09-10T06:26:41.294574+0000","last_became_active":"2024-09-10T06:26:30.592550+0000","last_became_peered":"2024-09-10T06:26:30.592550+0000","last_unstale":"2024-09-10T06:26:41.294574+0000","last_undegraded":"2024-09-10T06:26:41.294574+0000","last_fullsized":"2024-09-10T06:26:41.294574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:02.132556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295199+0000","last_change":"2024-09-10T06:26:32.278347+0000","last_active":"2024-09-10T06:26:41.295199+0000","last_peered":"2024-09-10T06:26:41.295199+0000","last_clean":"2024-09-10T06:26:41.295199+0000","last_became_active":"2024-09-10T06:26:32.275206+0000","last_became_peered":"2024-09-10T06:26:32.275206+0000","last_unstale":"2024-09-10T06:26:41.295199+0000","last_undegraded":"2024-09-10T06:26:41.295199+0000","last_fullsized":"2024-09-10T06:26:41.295199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329581+0000","last_change":"2024-09-10T06:26:30.572734+0000","last_active":"2024-09-10T06:26:41.329581+0000","last_peered":"2024-09-10T06:26:41.329581+0000","last_clean":"2024-09-10T06:26:41.329581+0000","last_became_active":"2024-09-10T06:26:30.572043+0000","last_became_peered":"2024-09-10T06:26:30.572043+0000","last_unstale":"2024-09-10T06:26:41.329581+0000","last_undegraded":"2024-09-10T06:26:41.329581+0000","last_fullsized":"2024-09-10T06:26:41.329581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.292732+0000","last_change":"2024-09-10T06:26:40.323476+0000","last_active":"2024-09-10T06:26:41.292732+0000","last_peered":"2024-09-10T06:26:41.292732+0000","last_clean":"2024-09-10T06:26:41.292732+0000","last_became_active":"2024-09-10T06:26:40.322711+0000","last_became_peered":"2024-09-10T06:26:40.322711+0000","last_unstale":"2024-09-10T06:26:41.292732+0000","last_undegraded":"2024-09-10T06:26:41.292732+0000","last_fullsized":"2024-09-10T06:26:41.292732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.296855+0000","last_change":"2024-09-10T06:26:32.276274+0000","last_active":"2024-09-10T06:26:41.296855+0000","last_peered":"2024-09-10T06:26:41.296855+0000","last_clean":"2024-09-10T06:26:41.296855+0000","last_became_active":"2024-09-10T06:26:32.275889+0000","last_became_peered":"2024-09-10T06:26:32.275889+0000","last_unstale":"2024-09-10T06:26:41.296855+0000","last_undegraded":"2024-09-10T06:26:41.296855+0000","last_fullsized":"2024-09-10T06:26:41.296855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312375+0000","last_change":"2024-09-10T06:26:30.595738+0000","last_active":"2024-09-10T06:26:41.312375+0000","last_peered":"2024-09-10T06:26:41.312375+0000","last_clean":"2024-09-10T06:26:41.312375+0000","last_became_active":"2024-09-10T06:26:30.595128+0000","last_became_peered":"2024-09-10T06:26:30.595128+0000","last_unstale":"2024-09-10T06:26:41.312375+0000","last_undegraded":"2024-09-10T06:26:41.312375+0000","last_fullsized":"2024-09-10T06:26:41.312375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.324613+0000","last_change":"2024-09-10T06:26:34.279824+0000","last_active":"2024-09-10T06:26:41.324613+0000","last_peered":"2024-09-10T06:26:41.324613+0000","last_clean":"2024-09-10T06:26:41.324613+0000","last_became_active":"2024-09-10T06:26:34.279074+0000","last_became_peered":"2024-09-10T06:26:34.279074+0000","last_unstale":"2024-09-10T06:26:41.324613+0000","last_undegraded":"2024-09-10T06:26:41.324613+0000","last_fullsized":"2024-09-10T06:26:41.324613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:40.507467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.709008+0000","last_change":"2024-09-10T06:26:36.296703+0000","last_active":"2024-09-10T06:26:41.709008+0000","last_peered":"2024-09-10T06:26:41.709008+0000","last_clean":"2024-09-10T06:26:41.709008+0000","last_became_active":"2024-09-10T06:26:36.295786+0000","last_became_peered":"2024-09-10T06:26:36.295786+0000","last_unstale":"2024-09-10T06:26:41.709008+0000","last_undegraded":"2024-09-10T06:26:41.709008+0000","last_fullsized":"2024-09-10T06:26:41.709008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:31.699855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312714+0000","last_change":"2024-09-10T06:26:38.305468+0000","last_active":"2024-09-10T06:26:41.312714+0000","last_peered":"2024-09-10T06:26:41.312714+0000","last_clean":"2024-09-10T06:26:41.312714+0000","last_became_active":"2024-09-10T06:26:38.304847+0000","last_became_peered":"2024-09-10T06:26:38.304847+0000","last_unstale":"2024-09-10T06:26:41.312714+0000","last_undegraded":"2024-09-10T06:26:41.312714+0000","last_fullsized":"2024-09-10T06:26:41.312714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:36.499856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.322051+0000","last_change":"2024-09-10T06:26:40.331389+0000","last_active":"2024-09-10T06:26:41.322051+0000","last_peered":"2024-09-10T06:26:41.322051+0000","last_clean":"2024-09-10T06:26:41.322051+0000","last_became_active":"2024-09-10T06:26:40.330777+0000","last_became_peered":"2024-09-10T06:26:40.330777+0000","last_unstale":"2024-09-10T06:26:41.322051+0000","last_undegraded":"2024-09-10T06:26:41.322051+0000","last_fullsized":"2024-09-10T06:26:41.322051+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:22.792159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325044+0000","last_change":"2024-09-10T06:26:32.283112+0000","last_active":"2024-09-10T06:26:41.325044+0000","last_peered":"2024-09-10T06:26:41.325044+0000","last_clean":"2024-09-10T06:26:41.325044+0000","last_became_active":"2024-09-10T06:26:32.282263+0000","last_became_peered":"2024-09-10T06:26:32.282263+0000","last_unstale":"2024-09-10T06:26:41.325044+0000","last_undegraded":"2024-09-10T06:26:41.325044+0000","last_fullsized":"2024-09-10T06:26:41.325044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:02.124800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329604+0000","last_change":"2024-09-10T06:26:30.576489+0000","last_active":"2024-09-10T06:26:41.329604+0000","last_peered":"2024-09-10T06:26:41.329604+0000","last_clean":"2024-09-10T06:26:41.329604+0000","last_became_active":"2024-09-10T06:26:30.576039+0000","last_became_peered":"2024-09-10T06:26:30.576039+0000","last_unstale":"2024-09-10T06:26:41.329604+0000","last_undegraded":"2024-09-10T06:26:41.329604+0000","last_fullsized":"2024-09-10T06:26:41.329604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.296471+0000","last_change":"2024-09-10T06:26:34.268758+0000","last_active":"2024-09-10T06:26:41.296471+0000","last_peered":"2024-09-10T06:26:41.296471+0000","last_clean":"2024-09-10T06:26:41.296471+0000","last_became_active":"2024-09-10T06:26:34.268279+0000","last_became_peered":"2024-09-10T06:26:34.268279+0000","last_unstale":"2024-09-10T06:26:41.296471+0000","last_undegraded":"2024-09-10T06:26:41.296471+0000","last_fullsized":"2024-09-10T06:26:41.296471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:42.052702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.088525+0000","last_change":"2024-09-10T06:26:36.273991+0000","last_active":"2024-09-10T06:26:42.088525+0000","last_peered":"2024-09-10T06:26:42.088525+0000","last_clean":"2024-09-10T06:26:42.088525+0000","last_became_active":"2024-09-10T06:26:36.273138+0000","last_became_peered":"2024-09-10T06:26:36.273138+0000","last_unstale":"2024-09-10T06:26:42.088525+0000","last_undegraded":"2024-09-10T06:26:42.088525+0000","last_fullsized":"2024-09-10T06:26:42.088525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295041+0000","last_change":"2024-09-10T06:26:38.294543+0000","last_active":"2024-09-10T06:26:41.295041+0000","last_peered":"2024-09-10T06:26:41.295041+0000","last_clean":"2024-09-10T06:26:41.295041+0000","last_became_active":"2024-09-10T06:26:38.293754+0000","last_became_peered":"2024-09-10T06:26:38.293754+0000","last_unstale":"2024-09-10T06:26:41.295041+0000","last_undegraded":"2024-09-10T06:26:41.295041+0000","last_fullsized":"2024-09-10T06:26:41.295041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329177+0000","last_change":"2024-09-10T06:26:40.326998+0000","last_active":"2024-09-10T06:26:41.329177+0000","last_peered":"2024-09-10T06:26:41.329177+0000","last_clean":"2024-09-10T06:26:41.329177+0000","last_became_active":"2024-09-10T06:26:40.322648+0000","last_became_peered":"2024-09-10T06:26:40.322648+0000","last_unstale":"2024-09-10T06:26:41.329177+0000","last_undegraded":"2024-09-10T06:26:41.329177+0000","last_fullsized":"2024-09-10T06:26:41.329177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:19.837495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331907+0000","last_change":"2024-09-10T06:26:32.256959+0000","last_active":"2024-09-10T06:26:41.331907+0000","last_peered":"2024-09-10T06:26:41.331907+0000","last_clean":"2024-09-10T06:26:41.331907+0000","last_became_active":"2024-09-10T06:26:32.256701+0000","last_became_peered":"2024-09-10T06:26:32.256701+0000","last_unstale":"2024-09-10T06:26:41.331907+0000","last_undegraded":"2024-09-10T06:26:41.331907+0000","last_fullsized":"2024-09-10T06:26:41.331907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311702+0000","last_change":"2024-09-10T06:26:30.598409+0000","last_active":"2024-09-10T06:26:41.311702+0000","last_peered":"2024-09-10T06:26:41.311702+0000","last_clean":"2024-09-10T06:26:41.311702+0000","last_became_active":"2024-09-10T06:26:30.597703+0000","last_became_peered":"2024-09-10T06:26:30.597703+0000","last_unstale":"2024-09-10T06:26:41.311702+0000","last_undegraded":"2024-09-10T06:26:41.311702+0000","last_fullsized":"2024-09-10T06:26:41.311702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.299939+0000","last_change":"2024-09-10T06:26:34.268741+0000","last_active":"2024-09-10T06:26:41.299939+0000","last_peered":"2024-09-10T06:26:41.299939+0000","last_clean":"2024-09-10T06:26:41.299939+0000","last_became_active":"2024-09-10T06:26:34.268192+0000","last_became_peered":"2024-09-10T06:26:34.268192+0000","last_unstale":"2024-09-10T06:26:41.299939+0000","last_undegraded":"2024-09-10T06:26:41.299939+0000","last_fullsized":"2024-09-10T06:26:41.299939+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:42:10.110645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.142367+0000","last_change":"2024-09-10T06:26:36.275955+0000","last_active":"2024-09-10T06:26:42.142367+0000","last_peered":"2024-09-10T06:26:42.142367+0000","last_clean":"2024-09-10T06:26:42.142367+0000","last_became_active":"2024-09-10T06:26:36.275306+0000","last_became_peered":"2024-09-10T06:26:36.275306+0000","last_unstale":"2024-09-10T06:26:42.142367+0000","last_undegraded":"2024-09-10T06:26:42.142367+0000","last_fullsized":"2024-09-10T06:26:42.142367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:03.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312359+0000","last_change":"2024-09-10T06:26:38.302764+0000","last_active":"2024-09-10T06:26:41.312359+0000","last_peered":"2024-09-10T06:26:41.312359+0000","last_clean":"2024-09-10T06:26:41.312359+0000","last_became_active":"2024-09-10T06:26:38.300326+0000","last_became_peered":"2024-09-10T06:26:38.300326+0000","last_unstale":"2024-09-10T06:26:41.312359+0000","last_undegraded":"2024-09-10T06:26:41.312359+0000","last_fullsized":"2024-09-10T06:26:41.312359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:29.851085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293767+0000","last_change":"2024-09-10T06:26:40.297893+0000","last_active":"2024-09-10T06:26:41.293767+0000","last_peered":"2024-09-10T06:26:41.293767+0000","last_clean":"2024-09-10T06:26:41.293767+0000","last_became_active":"2024-09-10T06:26:40.297296+0000","last_became_peered":"2024-09-10T06:26:40.297296+0000","last_unstale":"2024-09-10T06:26:41.293767+0000","last_undegraded":"2024-09-10T06:26:41.293767+0000","last_fullsized":"2024-09-10T06:26:41.293767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298579+0000","last_change":"2024-09-10T06:26:32.265005+0000","last_active":"2024-09-10T06:26:41.298579+0000","last_peered":"2024-09-10T06:26:41.298579+0000","last_clean":"2024-09-10T06:26:41.298579+0000","last_became_active":"2024-09-10T06:26:32.264334+0000","last_became_peered":"2024-09-10T06:26:32.264334+0000","last_unstale":"2024-09-10T06:26:41.298579+0000","last_undegraded":"2024-09-10T06:26:41.298579+0000","last_fullsized":"2024-09-10T06:26:41.298579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325847+0000","last_change":"2024-09-10T06:26:30.576242+0000","last_active":"2024-09-10T06:26:41.325847+0000","last_peered":"2024-09-10T06:26:41.325847+0000","last_clean":"2024-09-10T06:26:41.325847+0000","last_became_active":"2024-09-10T06:26:30.575433+0000","last_became_peered":"2024-09-10T06:26:30.575433+0000","last_unstale":"2024-09-10T06:26:41.325847+0000","last_undegraded":"2024-09-10T06:26:41.325847+0000","last_fullsized":"2024-09-10T06:26:41.325847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323607+0000","last_change":"2024-09-10T06:26:34.283701+0000","last_active":"2024-09-10T06:26:41.323607+0000","last_peered":"2024-09-10T06:26:41.323607+0000","last_clean":"2024-09-10T06:26:41.323607+0000","last_became_active":"2024-09-10T06:26:34.282941+0000","last_became_peered":"2024-09-10T06:26:34.282941+0000","last_unstale":"2024-09-10T06:26:41.323607+0000","last_undegraded":"2024-09-10T06:26:41.323607+0000","last_fullsized":"2024-09-10T06:26:41.323607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:29.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.149521+0000","last_change":"2024-09-10T06:26:36.298510+0000","last_active":"2024-09-10T06:26:42.149521+0000","last_peered":"2024-09-10T06:26:42.149521+0000","last_clean":"2024-09-10T06:26:42.149521+0000","last_became_active":"2024-09-10T06:26:36.297309+0000","last_became_peered":"2024-09-10T06:26:36.297309+0000","last_unstale":"2024-09-10T06:26:42.149521+0000","last_undegraded":"2024-09-10T06:26:42.149521+0000","last_fullsized":"2024-09-10T06:26:42.149521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295876+0000","last_change":"2024-09-10T06:26:38.300228+0000","last_active":"2024-09-10T06:26:41.295876+0000","last_peered":"2024-09-10T06:26:41.295876+0000","last_clean":"2024-09-10T06:26:41.295876+0000","last_became_active":"2024-09-10T06:26:38.299355+0000","last_became_peered":"2024-09-10T06:26:38.299355+0000","last_unstale":"2024-09-10T06:26:41.295876+0000","last_undegraded":"2024-09-10T06:26:41.295876+0000","last_fullsized":"2024-09-10T06:26:41.295876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:20.050096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.321782+0000","last_change":"2024-09-10T06:26:32.271283+0000","last_active":"2024-09-10T06:26:41.321782+0000","last_peered":"2024-09-10T06:26:41.321782+0000","last_clean":"2024-09-10T06:26:41.321782+0000","last_became_active":"2024-09-10T06:26:32.270496+0000","last_became_peered":"2024-09-10T06:26:32.270496+0000","last_unstale":"2024-09-10T06:26:41.321782+0000","last_undegraded":"2024-09-10T06:26:41.321782+0000","last_fullsized":"2024-09-10T06:26:41.321782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313228+0000","last_change":"2024-09-10T06:26:30.607373+0000","last_active":"2024-09-10T06:26:41.313228+0000","last_peered":"2024-09-10T06:26:41.313228+0000","last_clean":"2024-09-10T06:26:41.313228+0000","last_became_active":"2024-09-10T06:26:30.606685+0000","last_became_peered":"2024-09-10T06:26:30.606685+0000","last_unstale":"2024-09-10T06:26:41.313228+0000","last_undegraded":"2024-09-10T06:26:41.313228+0000","last_fullsized":"2024-09-10T06:26:41.313228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:35.705564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.310960+0000","last_change":"2024-09-10T06:26:34.286925+0000","last_active":"2024-09-10T06:26:41.310960+0000","last_peered":"2024-09-10T06:26:41.310960+0000","last_clean":"2024-09-10T06:26:41.310960+0000","last_became_active":"2024-09-10T06:26:34.285787+0000","last_became_peered":"2024-09-10T06:26:34.285787+0000","last_unstale":"2024-09-10T06:26:41.310960+0000","last_undegraded":"2024-09-10T06:26:41.310960+0000","last_fullsized":"2024-09-10T06:26:41.310960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"34'19","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.247172+0000","last_change":"2024-09-10T06:26:36.293988+0000","last_active":"2024-09-10T06:26:42.247172+0000","last_peered":"2024-09-10T06:26:42.247172+0000","last_clean":"2024-09-10T06:26:42.247172+0000","last_became_active":"2024-09-10T06:26:36.293226+0000","last_became_peered":"2024-09-10T06:26:36.293226+0000","last_unstale":"2024-09-10T06:26:42.247172+0000","last_undegraded":"2024-09-10T06:26:42.247172+0000","last_fullsized":"2024-09-10T06:26:42.247172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.314893+0000","last_change":"2024-09-10T06:26:38.305826+0000","last_active":"2024-09-10T06:26:41.314893+0000","last_peered":"2024-09-10T06:26:41.314893+0000","last_clean":"2024-09-10T06:26:41.314893+0000","last_became_active":"2024-09-10T06:26:38.304601+0000","last_became_peered":"2024-09-10T06:26:38.304601+0000","last_unstale":"2024-09-10T06:26:41.314893+0000","last_undegraded":"2024-09-10T06:26:41.314893+0000","last_fullsized":"2024-09-10T06:26:41.314893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:12.545261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323269+0000","last_change":"2024-09-10T06:26:40.332286+0000","last_active":"2024-09-10T06:26:41.323269+0000","last_peered":"2024-09-10T06:26:41.323269+0000","last_clean":"2024-09-10T06:26:41.323269+0000","last_became_active":"2024-09-10T06:26:40.331262+0000","last_became_peered":"2024-09-10T06:26:40.331262+0000","last_unstale":"2024-09-10T06:26:41.323269+0000","last_undegraded":"2024-09-10T06:26:41.323269+0000","last_fullsized":"2024-09-10T06:26:41.323269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293198+0000","last_change":"2024-09-10T06:26:32.262320+0000","last_active":"2024-09-10T06:26:41.293198+0000","last_peered":"2024-09-10T06:26:41.293198+0000","last_clean":"2024-09-10T06:26:41.293198+0000","last_became_active":"2024-09-10T06:26:32.261423+0000","last_became_peered":"2024-09-10T06:26:32.261423+0000","last_unstale":"2024-09-10T06:26:41.293198+0000","last_undegraded":"2024-09-10T06:26:41.293198+0000","last_fullsized":"2024-09-10T06:26:41.293198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312990+0000","last_change":"2024-09-10T06:26:30.595879+0000","last_active":"2024-09-10T06:26:41.312990+0000","last_peered":"2024-09-10T06:26:41.312990+0000","last_clean":"2024-09-10T06:26:41.312990+0000","last_became_active":"2024-09-10T06:26:30.595269+0000","last_became_peered":"2024-09-10T06:26:30.595269+0000","last_unstale":"2024-09-10T06:26:41.312990+0000","last_undegraded":"2024-09-10T06:26:41.312990+0000","last_fullsized":"2024-09-10T06:26:41.312990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.292695+0000","last_change":"2024-09-10T06:26:34.266906+0000","last_active":"2024-09-10T06:26:41.292695+0000","last_peered":"2024-09-10T06:26:41.292695+0000","last_clean":"2024-09-10T06:26:41.292695+0000","last_became_active":"2024-09-10T06:26:34.266017+0000","last_became_peered":"2024-09-10T06:26:34.266017+0000","last_unstale":"2024-09-10T06:26:41.292695+0000","last_undegraded":"2024-09-10T06:26:41.292695+0000","last_fullsized":"2024-09-10T06:26:41.292695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:24.366166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.122083+0000","last_change":"2024-09-10T06:26:36.297020+0000","last_active":"2024-09-10T06:26:42.122083+0000","last_peered":"2024-09-10T06:26:42.122083+0000","last_clean":"2024-09-10T06:26:42.122083+0000","last_became_active":"2024-09-10T06:26:36.295796+0000","last_became_peered":"2024-09-10T06:26:36.295796+0000","last_unstale":"2024-09-10T06:26:42.122083+0000","last_undegraded":"2024-09-10T06:26:42.122083+0000","last_fullsized":"2024-09-10T06:26:42.122083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294336+0000","last_change":"2024-09-10T06:26:38.297273+0000","last_active":"2024-09-10T06:26:41.294336+0000","last_peered":"2024-09-10T06:26:41.294336+0000","last_clean":"2024-09-10T06:26:41.294336+0000","last_became_active":"2024-09-10T06:26:38.296455+0000","last_became_peered":"2024-09-10T06:26:38.296455+0000","last_unstale":"2024-09-10T06:26:41.294336+0000","last_undegraded":"2024-09-10T06:26:41.294336+0000","last_fullsized":"2024-09-10T06:26:41.294336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:26.766702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327224+0000","last_change":"2024-09-10T06:26:40.328294+0000","last_active":"2024-09-10T06:26:41.327224+0000","last_peered":"2024-09-10T06:26:41.327224+0000","last_clean":"2024-09-10T06:26:41.327224+0000","last_became_active":"2024-09-10T06:26:40.327585+0000","last_became_peered":"2024-09-10T06:26:40.327585+0000","last_unstale":"2024-09-10T06:26:41.327224+0000","last_undegraded":"2024-09-10T06:26:41.327224+0000","last_fullsized":"2024-09-10T06:26:41.327224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.537210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326793+0000","last_change":"2024-09-10T06:26:32.286363+0000","last_active":"2024-09-10T06:26:41.326793+0000","last_peered":"2024-09-10T06:26:41.326793+0000","last_clean":"2024-09-10T06:26:41.326793+0000","last_became_active":"2024-09-10T06:26:32.283607+0000","last_became_peered":"2024-09-10T06:26:32.283607+0000","last_unstale":"2024-09-10T06:26:41.326793+0000","last_undegraded":"2024-09-10T06:26:41.326793+0000","last_fullsized":"2024-09-10T06:26:41.326793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:59.437136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313347+0000","last_change":"2024-09-10T06:26:30.611704+0000","last_active":"2024-09-10T06:26:41.313347+0000","last_peered":"2024-09-10T06:26:41.313347+0000","last_clean":"2024-09-10T06:26:41.313347+0000","last_became_active":"2024-09-10T06:26:30.611039+0000","last_became_peered":"2024-09-10T06:26:30.611039+0000","last_unstale":"2024-09-10T06:26:41.313347+0000","last_undegraded":"2024-09-10T06:26:41.313347+0000","last_fullsized":"2024-09-10T06:26:41.313347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294418+0000","last_change":"2024-09-10T06:26:34.263514+0000","last_active":"2024-09-10T06:26:41.294418+0000","last_peered":"2024-09-10T06:26:41.294418+0000","last_clean":"2024-09-10T06:26:41.294418+0000","last_became_active":"2024-09-10T06:26:34.262793+0000","last_became_peered":"2024-09-10T06:26:34.262793+0000","last_unstale":"2024-09-10T06:26:41.294418+0000","last_undegraded":"2024-09-10T06:26:41.294418+0000","last_fullsized":"2024-09-10T06:26:41.294418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:31.501738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.040994+0000","last_change":"2024-09-10T06:26:36.299923+0000","last_active":"2024-09-10T06:26:42.040994+0000","last_peered":"2024-09-10T06:26:42.040994+0000","last_clean":"2024-09-10T06:26:42.040994+0000","last_became_active":"2024-09-10T06:26:36.299140+0000","last_became_peered":"2024-09-10T06:26:36.299140+0000","last_unstale":"2024-09-10T06:26:42.040994+0000","last_undegraded":"2024-09-10T06:26:42.040994+0000","last_fullsized":"2024-09-10T06:26:42.040994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:12.246303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328275+0000","last_change":"2024-09-10T06:26:38.292019+0000","last_active":"2024-09-10T06:26:41.328275+0000","last_peered":"2024-09-10T06:26:41.328275+0000","last_clean":"2024-09-10T06:26:41.328275+0000","last_became_active":"2024-09-10T06:26:38.291322+0000","last_became_peered":"2024-09-10T06:26:38.291322+0000","last_unstale":"2024-09-10T06:26:41.328275+0000","last_undegraded":"2024-09-10T06:26:41.328275+0000","last_fullsized":"2024-09-10T06:26:41.328275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330919+0000","last_change":"2024-09-10T06:26:40.328427+0000","last_active":"2024-09-10T06:26:41.330919+0000","last_peered":"2024-09-10T06:26:41.330919+0000","last_clean":"2024-09-10T06:26:41.330919+0000","last_became_active":"2024-09-10T06:26:40.323249+0000","last_became_peered":"2024-09-10T06:26:40.323249+0000","last_unstale":"2024-09-10T06:26:41.330919+0000","last_undegraded":"2024-09-10T06:26:41.330919+0000","last_fullsized":"2024-09-10T06:26:41.330919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:50.823195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330386+0000","last_change":"2024-09-10T06:26:32.274824+0000","last_active":"2024-09-10T06:26:41.330386+0000","last_peered":"2024-09-10T06:26:41.330386+0000","last_clean":"2024-09-10T06:26:41.330386+0000","last_became_active":"2024-09-10T06:26:32.274496+0000","last_became_peered":"2024-09-10T06:26:32.274496+0000","last_unstale":"2024-09-10T06:26:41.330386+0000","last_undegraded":"2024-09-10T06:26:41.330386+0000","last_fullsized":"2024-09-10T06:26:41.330386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:39.513476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.324293+0000","last_change":"2024-09-10T06:26:30.604684+0000","last_active":"2024-09-10T06:26:41.324293+0000","last_peered":"2024-09-10T06:26:41.324293+0000","last_clean":"2024-09-10T06:26:41.324293+0000","last_became_active":"2024-09-10T06:26:30.593432+0000","last_became_peered":"2024-09-10T06:26:30.593432+0000","last_unstale":"2024-09-10T06:26:41.324293+0000","last_undegraded":"2024-09-10T06:26:41.324293+0000","last_fullsized":"2024-09-10T06:26:41.324293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293897+0000","last_change":"2024-09-10T06:26:34.256662+0000","last_active":"2024-09-10T06:26:41.293897+0000","last_peered":"2024-09-10T06:26:41.293897+0000","last_clean":"2024-09-10T06:26:41.293897+0000","last_became_active":"2024-09-10T06:26:34.256256+0000","last_became_peered":"2024-09-10T06:26:34.256256+0000","last_unstale":"2024-09-10T06:26:41.293897+0000","last_undegraded":"2024-09-10T06:26:41.293897+0000","last_fullsized":"2024-09-10T06:26:41.293897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:35.549063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'12","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.672303+0000","last_change":"2024-09-10T06:26:36.296631+0000","last_active":"2024-09-10T06:26:41.672303+0000","last_peered":"2024-09-10T06:26:41.672303+0000","last_clean":"2024-09-10T06:26:41.672303+0000","last_became_active":"2024-09-10T06:26:36.295838+0000","last_became_peered":"2024-09-10T06:26:36.295838+0000","last_unstale":"2024-09-10T06:26:41.672303+0000","last_undegraded":"2024-09-10T06:26:41.672303+0000","last_fullsized":"2024-09-10T06:26:41.672303+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:04.271824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.291766+0000","last_change":"2024-09-10T06:26:38.308698+0000","last_active":"2024-09-10T06:26:41.291766+0000","last_peered":"2024-09-10T06:26:41.291766+0000","last_clean":"2024-09-10T06:26:41.291766+0000","last_became_active":"2024-09-10T06:26:38.307965+0000","last_became_peered":"2024-09-10T06:26:38.307965+0000","last_unstale":"2024-09-10T06:26:41.291766+0000","last_undegraded":"2024-09-10T06:26:41.291766+0000","last_fullsized":"2024-09-10T06:26:41.291766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:04.566221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.317226+0000","last_change":"2024-09-10T06:26:40.326474+0000","last_active":"2024-09-10T06:26:41.317226+0000","last_peered":"2024-09-10T06:26:41.317226+0000","last_clean":"2024-09-10T06:26:41.317226+0000","last_became_active":"2024-09-10T06:26:40.325731+0000","last_became_peered":"2024-09-10T06:26:40.325731+0000","last_unstale":"2024-09-10T06:26:41.317226+0000","last_undegraded":"2024-09-10T06:26:41.317226+0000","last_fullsized":"2024-09-10T06:26:41.317226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:19.400355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294928+0000","last_change":"2024-09-10T06:26:32.254177+0000","last_active":"2024-09-10T06:26:41.294928+0000","last_peered":"2024-09-10T06:26:41.294928+0000","last_clean":"2024-09-10T06:26:41.294928+0000","last_became_active":"2024-09-10T06:26:32.253154+0000","last_became_peered":"2024-09-10T06:26:32.253154+0000","last_unstale":"2024-09-10T06:26:41.294928+0000","last_undegraded":"2024-09-10T06:26:41.294928+0000","last_fullsized":"2024-09-10T06:26:41.294928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293961+0000","last_change":"2024-09-10T06:26:30.572406+0000","last_active":"2024-09-10T06:26:41.293961+0000","last_peered":"2024-09-10T06:26:41.293961+0000","last_clean":"2024-09-10T06:26:41.293961+0000","last_became_active":"2024-09-10T06:26:30.571829+0000","last_became_peered":"2024-09-10T06:26:30.571829+0000","last_unstale":"2024-09-10T06:26:41.293961+0000","last_undegraded":"2024-09-10T06:26:41.293961+0000","last_fullsized":"2024-09-10T06:26:41.293961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.297974+0000","last_change":"2024-09-10T06:26:34.285406+0000","last_active":"2024-09-10T06:26:41.297974+0000","last_peered":"2024-09-10T06:26:41.297974+0000","last_clean":"2024-09-10T06:26:41.297974+0000","last_became_active":"2024-09-10T06:26:34.285004+0000","last_became_peered":"2024-09-10T06:26:34.285004+0000","last_unstale":"2024-09-10T06:26:41.297974+0000","last_undegraded":"2024-09-10T06:26:41.297974+0000","last_fullsized":"2024-09-10T06:26:41.297974+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:03.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.183676+0000","last_change":"2024-09-10T06:26:36.293191+0000","last_active":"2024-09-10T06:26:42.183676+0000","last_peered":"2024-09-10T06:26:42.183676+0000","last_clean":"2024-09-10T06:26:42.183676+0000","last_became_active":"2024-09-10T06:26:36.292423+0000","last_became_peered":"2024-09-10T06:26:36.292423+0000","last_unstale":"2024-09-10T06:26:42.183676+0000","last_undegraded":"2024-09-10T06:26:42.183676+0000","last_fullsized":"2024-09-10T06:26:42.183676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331144+0000","last_change":"2024-09-10T06:26:38.293667+0000","last_active":"2024-09-10T06:26:41.331144+0000","last_peered":"2024-09-10T06:26:41.331144+0000","last_clean":"2024-09-10T06:26:41.331144+0000","last_became_active":"2024-09-10T06:26:38.292918+0000","last_became_peered":"2024-09-10T06:26:38.292918+0000","last_unstale":"2024-09-10T06:26:41.331144+0000","last_undegraded":"2024-09-10T06:26:41.331144+0000","last_fullsized":"2024-09-10T06:26:41.331144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:57.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293062+0000","last_change":"2024-09-10T06:26:40.327061+0000","last_active":"2024-09-10T06:26:41.293062+0000","last_peered":"2024-09-10T06:26:41.293062+0000","last_clean":"2024-09-10T06:26:41.293062+0000","last_became_active":"2024-09-10T06:26:40.326431+0000","last_became_peered":"2024-09-10T06:26:40.326431+0000","last_unstale":"2024-09-10T06:26:41.293062+0000","last_undegraded":"2024-09-10T06:26:41.293062+0000","last_fullsized":"2024-09-10T06:26:41.293062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:27.631214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295317+0000","last_change":"2024-09-10T06:26:32.255139+0000","last_active":"2024-09-10T06:26:41.295317+0000","last_peered":"2024-09-10T06:26:41.295317+0000","last_clean":"2024-09-10T06:26:41.295317+0000","last_became_active":"2024-09-10T06:26:32.253524+0000","last_became_peered":"2024-09-10T06:26:32.253524+0000","last_unstale":"2024-09-10T06:26:41.295317+0000","last_undegraded":"2024-09-10T06:26:41.295317+0000","last_fullsized":"2024-09-10T06:26:41.295317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326951+0000","last_change":"2024-09-10T06:26:30.591838+0000","last_active":"2024-09-10T06:26:41.326951+0000","last_peered":"2024-09-10T06:26:41.326951+0000","last_clean":"2024-09-10T06:26:41.326951+0000","last_became_active":"2024-09-10T06:26:30.591125+0000","last_became_peered":"2024-09-10T06:26:30.591125+0000","last_unstale":"2024-09-10T06:26:41.326951+0000","last_undegraded":"2024-09-10T06:26:41.326951+0000","last_fullsized":"2024-09-10T06:26:41.326951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.314952+0000","last_change":"2024-09-10T06:26:34.280391+0000","last_active":"2024-09-10T06:26:41.314952+0000","last_peered":"2024-09-10T06:26:41.314952+0000","last_clean":"2024-09-10T06:26:41.314952+0000","last_became_active":"2024-09-10T06:26:34.280058+0000","last_became_peered":"2024-09-10T06:26:34.280058+0000","last_unstale":"2024-09-10T06:26:41.314952+0000","last_undegraded":"2024-09-10T06:26:41.314952+0000","last_fullsized":"2024-09-10T06:26:41.314952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.461857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.254333+0000","last_change":"2024-09-10T06:26:36.277547+0000","last_active":"2024-09-10T06:26:42.254333+0000","last_peered":"2024-09-10T06:26:42.254333+0000","last_clean":"2024-09-10T06:26:42.254333+0000","last_became_active":"2024-09-10T06:26:36.276965+0000","last_became_peered":"2024-09-10T06:26:36.276965+0000","last_unstale":"2024-09-10T06:26:42.254333+0000","last_undegraded":"2024-09-10T06:26:42.254333+0000","last_fullsized":"2024-09-10T06:26:42.254333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:43.212945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298573+0000","last_change":"2024-09-10T06:26:38.306134+0000","last_active":"2024-09-10T06:26:41.298573+0000","last_peered":"2024-09-10T06:26:41.298573+0000","last_clean":"2024-09-10T06:26:41.298573+0000","last_became_active":"2024-09-10T06:26:38.299012+0000","last_became_peered":"2024-09-10T06:26:38.299012+0000","last_unstale":"2024-09-10T06:26:41.298573+0000","last_undegraded":"2024-09-10T06:26:41.298573+0000","last_fullsized":"2024-09-10T06:26:41.298573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:37.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315050+0000","last_change":"2024-09-10T06:26:40.336036+0000","last_active":"2024-09-10T06:26:41.315050+0000","last_peered":"2024-09-10T06:26:41.315050+0000","last_clean":"2024-09-10T06:26:41.315050+0000","last_became_active":"2024-09-10T06:26:40.335302+0000","last_became_peered":"2024-09-10T06:26:40.335302+0000","last_unstale":"2024-09-10T06:26:41.315050+0000","last_undegraded":"2024-09-10T06:26:41.315050+0000","last_fullsized":"2024-09-10T06:26:41.315050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:24.024562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295633+0000","last_change":"2024-09-10T06:26:32.287897+0000","last_active":"2024-09-10T06:26:41.295633+0000","last_peered":"2024-09-10T06:26:41.295633+0000","last_clean":"2024-09-10T06:26:41.295633+0000","last_became_active":"2024-09-10T06:26:32.287315+0000","last_became_peered":"2024-09-10T06:26:32.287315+0000","last_unstale":"2024-09-10T06:26:41.295633+0000","last_undegraded":"2024-09-10T06:26:41.295633+0000","last_fullsized":"2024-09-10T06:26:41.295633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293886+0000","last_change":"2024-09-10T06:26:30.569192+0000","last_active":"2024-09-10T06:26:41.293886+0000","last_peered":"2024-09-10T06:26:41.293886+0000","last_clean":"2024-09-10T06:26:41.293886+0000","last_became_active":"2024-09-10T06:26:30.568464+0000","last_became_peered":"2024-09-10T06:26:30.568464+0000","last_unstale":"2024-09-10T06:26:41.293886+0000","last_undegraded":"2024-09-10T06:26:41.293886+0000","last_fullsized":"2024-09-10T06:26:41.293886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:58.987914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.324472+0000","last_change":"2024-09-10T06:26:34.279935+0000","last_active":"2024-09-10T06:26:41.324472+0000","last_peered":"2024-09-10T06:26:41.324472+0000","last_clean":"2024-09-10T06:26:41.324472+0000","last_became_active":"2024-09-10T06:26:34.279192+0000","last_became_peered":"2024-09-10T06:26:34.279192+0000","last_unstale":"2024-09-10T06:26:41.324472+0000","last_undegraded":"2024-09-10T06:26:41.324472+0000","last_fullsized":"2024-09-10T06:26:41.324472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:18.753175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.048507+0000","last_change":"2024-09-10T06:26:36.290330+0000","last_active":"2024-09-10T06:26:42.048507+0000","last_peered":"2024-09-10T06:26:42.048507+0000","last_clean":"2024-09-10T06:26:42.048507+0000","last_became_active":"2024-09-10T06:26:36.289527+0000","last_became_peered":"2024-09-10T06:26:36.289527+0000","last_unstale":"2024-09-10T06:26:42.048507+0000","last_undegraded":"2024-09-10T06:26:42.048507+0000","last_fullsized":"2024-09-10T06:26:42.048507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327437+0000","last_change":"2024-09-10T06:26:38.288663+0000","last_active":"2024-09-10T06:26:41.327437+0000","last_peered":"2024-09-10T06:26:41.327437+0000","last_clean":"2024-09-10T06:26:41.327437+0000","last_became_active":"2024-09-10T06:26:38.287740+0000","last_became_peered":"2024-09-10T06:26:38.287740+0000","last_unstale":"2024-09-10T06:26:41.327437+0000","last_undegraded":"2024-09-10T06:26:41.327437+0000","last_fullsized":"2024-09-10T06:26:41.327437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:22.078943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293869+0000","last_change":"2024-09-10T06:26:40.329737+0000","last_active":"2024-09-10T06:26:41.293869+0000","last_peered":"2024-09-10T06:26:41.293869+0000","last_clean":"2024-09-10T06:26:41.293869+0000","last_became_active":"2024-09-10T06:26:40.328952+0000","last_became_peered":"2024-09-10T06:26:40.328952+0000","last_unstale":"2024-09-10T06:26:41.293869+0000","last_undegraded":"2024-09-10T06:26:41.293869+0000","last_fullsized":"2024-09-10T06:26:41.293869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.317001+0000","last_change":"2024-09-10T06:26:32.270997+0000","last_active":"2024-09-10T06:26:41.317001+0000","last_peered":"2024-09-10T06:26:41.317001+0000","last_clean":"2024-09-10T06:26:41.317001+0000","last_became_active":"2024-09-10T06:26:32.270265+0000","last_became_peered":"2024-09-10T06:26:32.270265+0000","last_unstale":"2024-09-10T06:26:41.317001+0000","last_undegraded":"2024-09-10T06:26:41.317001+0000","last_fullsized":"2024-09-10T06:26:41.317001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:33.067523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295104+0000","last_change":"2024-09-10T06:26:30.563666+0000","last_active":"2024-09-10T06:26:41.295104+0000","last_peered":"2024-09-10T06:26:41.295104+0000","last_clean":"2024-09-10T06:26:41.295104+0000","last_became_active":"2024-09-10T06:26:30.563244+0000","last_became_peered":"2024-09-10T06:26:30.563244+0000","last_unstale":"2024-09-10T06:26:41.295104+0000","last_undegraded":"2024-09-10T06:26:41.295104+0000","last_fullsized":"2024-09-10T06:26:41.295104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:17.165772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295380+0000","last_change":"2024-09-10T06:26:34.286497+0000","last_active":"2024-09-10T06:26:41.295380+0000","last_peered":"2024-09-10T06:26:41.295380+0000","last_clean":"2024-09-10T06:26:41.295380+0000","last_became_active":"2024-09-10T06:26:34.285334+0000","last_became_peered":"2024-09-10T06:26:34.285334+0000","last_unstale":"2024-09-10T06:26:41.295380+0000","last_undegraded":"2024-09-10T06:26:41.295380+0000","last_fullsized":"2024-09-10T06:26:41.295380+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:54.506182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'17","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.176727+0000","last_change":"2024-09-10T06:26:36.288213+0000","last_active":"2024-09-10T06:26:42.176727+0000","last_peered":"2024-09-10T06:26:42.176727+0000","last_clean":"2024-09-10T06:26:42.176727+0000","last_became_active":"2024-09-10T06:26:36.287468+0000","last_became_peered":"2024-09-10T06:26:36.287468+0000","last_unstale":"2024-09-10T06:26:42.176727+0000","last_undegraded":"2024-09-10T06:26:42.176727+0000","last_fullsized":"2024-09-10T06:26:42.176727+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326731+0000","last_change":"2024-09-10T06:26:38.291943+0000","last_active":"2024-09-10T06:26:41.326731+0000","last_peered":"2024-09-10T06:26:41.326731+0000","last_clean":"2024-09-10T06:26:41.326731+0000","last_became_active":"2024-09-10T06:26:38.291214+0000","last_became_peered":"2024-09-10T06:26:38.291214+0000","last_unstale":"2024-09-10T06:26:41.326731+0000","last_undegraded":"2024-09-10T06:26:41.326731+0000","last_fullsized":"2024-09-10T06:26:41.326731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:56.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315089+0000","last_change":"2024-09-10T06:26:40.331977+0000","last_active":"2024-09-10T06:26:41.315089+0000","last_peered":"2024-09-10T06:26:41.315089+0000","last_clean":"2024-09-10T06:26:41.315089+0000","last_became_active":"2024-09-10T06:26:40.331502+0000","last_became_peered":"2024-09-10T06:26:40.331502+0000","last_unstale":"2024-09-10T06:26:41.315089+0000","last_undegraded":"2024-09-10T06:26:41.315089+0000","last_fullsized":"2024-09-10T06:26:41.315089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:43.572813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327789+0000","last_change":"2024-09-10T06:26:32.274623+0000","last_active":"2024-09-10T06:26:41.327789+0000","last_peered":"2024-09-10T06:26:41.327789+0000","last_clean":"2024-09-10T06:26:41.327789+0000","last_became_active":"2024-09-10T06:26:32.273727+0000","last_became_peered":"2024-09-10T06:26:32.273727+0000","last_unstale":"2024-09-10T06:26:41.327789+0000","last_undegraded":"2024-09-10T06:26:41.327789+0000","last_fullsized":"2024-09-10T06:26:41.327789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:15.364938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":137,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311709+0000","last_change":"2024-09-10T06:26:18.153206+0000","last_active":"2024-09-10T06:26:41.311709+0000","last_peered":"2024-09-10T06:26:41.311709+0000","last_clean":"2024-09-10T06:26:41.311709+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:26:41.311709+0000","last_undegraded":"2024-09-10T06:26:41.311709+0000","last_fullsized":"2024-09-10T06:26:41.311709+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_clean_scrub_stamp":"2024-09-10T06:26:16.422775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:42.510577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323062+0000","last_change":"2024-09-10T06:26:25.532465+0000","last_active":"2024-09-10T06:26:41.323062+0000","last_peered":"2024-09-10T06:26:41.323062+0000","last_clean":"2024-09-10T06:26:41.323062+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:26:41.323062+0000","last_undegraded":"2024-09-10T06:26:41.323062+0000","last_fullsized":"2024-09-10T06:26:41.323062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:10.318844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295321+0000","last_change":"2024-09-10T06:26:30.606630+0000","last_active":"2024-09-10T06:26:41.295321+0000","last_peered":"2024-09-10T06:26:41.295321+0000","last_clean":"2024-09-10T06:26:41.295321+0000","last_became_active":"2024-09-10T06:26:30.606348+0000","last_became_peered":"2024-09-10T06:26:30.606348+0000","last_unstale":"2024-09-10T06:26:41.295321+0000","last_undegraded":"2024-09-10T06:26:41.295321+0000","last_fullsized":"2024-09-10T06:26:41.295321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312606+0000","last_change":"2024-09-10T06:26:34.287201+0000","last_active":"2024-09-10T06:26:41.312606+0000","last_peered":"2024-09-10T06:26:41.312606+0000","last_clean":"2024-09-10T06:26:41.312606+0000","last_became_active":"2024-09-10T06:26:34.285248+0000","last_became_peered":"2024-09-10T06:26:34.285248+0000","last_unstale":"2024-09-10T06:26:41.312606+0000","last_undegraded":"2024-09-10T06:26:41.312606+0000","last_fullsized":"2024-09-10T06:26:41.312606+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:43.907684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'13","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.980582+0000","last_change":"2024-09-10T06:26:36.296684+0000","last_active":"2024-09-10T06:26:41.980582+0000","last_peered":"2024-09-10T06:26:41.980582+0000","last_clean":"2024-09-10T06:26:41.980582+0000","last_became_active":"2024-09-10T06:26:36.295901+0000","last_became_peered":"2024-09-10T06:26:36.295901+0000","last_unstale":"2024-09-10T06:26:41.980582+0000","last_undegraded":"2024-09-10T06:26:41.980582+0000","last_fullsized":"2024-09-10T06:26:41.980582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330922+0000","last_change":"2024-09-10T06:26:38.306412+0000","last_active":"2024-09-10T06:26:41.330922+0000","last_peered":"2024-09-10T06:26:41.330922+0000","last_clean":"2024-09-10T06:26:41.330922+0000","last_became_active":"2024-09-10T06:26:38.305496+0000","last_became_peered":"2024-09-10T06:26:38.305496+0000","last_unstale":"2024-09-10T06:26:41.330922+0000","last_undegraded":"2024-09-10T06:26:41.330922+0000","last_fullsized":"2024-09-10T06:26:41.330922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.370035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325879+0000","last_change":"2024-09-10T06:26:40.331981+0000","last_active":"2024-09-10T06:26:41.325879+0000","last_peered":"2024-09-10T06:26:41.325879+0000","last_clean":"2024-09-10T06:26:41.325879+0000","last_became_active":"2024-09-10T06:26:40.331294+0000","last_became_peered":"2024-09-10T06:26:40.331294+0000","last_unstale":"2024-09-10T06:26:41.325879+0000","last_undegraded":"2024-09-10T06:26:41.325879+0000","last_fullsized":"2024-09-10T06:26:41.325879+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:00.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331674+0000","last_change":"2024-09-10T06:26:32.278733+0000","last_active":"2024-09-10T06:26:41.331674+0000","last_peered":"2024-09-10T06:26:41.331674+0000","last_clean":"2024-09-10T06:26:41.331674+0000","last_became_active":"2024-09-10T06:26:32.278118+0000","last_became_peered":"2024-09-10T06:26:32.278118+0000","last_unstale":"2024-09-10T06:26:41.331674+0000","last_undegraded":"2024-09-10T06:26:41.331674+0000","last_fullsized":"2024-09-10T06:26:41.331674+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:58.860666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311444+0000","last_change":"2024-09-10T06:26:26.180664+0000","last_active":"2024-09-10T06:26:41.311444+0000","last_peered":"2024-09-10T06:26:41.311444+0000","last_clean":"2024-09-10T06:26:41.311444+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:26:41.311444+0000","last_undegraded":"2024-09-10T06:26:41.311444+0000","last_fullsized":"2024-09-10T06:26:41.311444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:28.793045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328668+0000","last_change":"2024-09-10T06:26:30.594315+0000","last_active":"2024-09-10T06:26:41.328668+0000","last_peered":"2024-09-10T06:26:41.328668+0000","last_clean":"2024-09-10T06:26:41.328668+0000","last_became_active":"2024-09-10T06:26:30.593978+0000","last_became_peered":"2024-09-10T06:26:30.593978+0000","last_unstale":"2024-09-10T06:26:41.328668+0000","last_undegraded":"2024-09-10T06:26:41.328668+0000","last_fullsized":"2024-09-10T06:26:41.328668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:41.851632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325045+0000","last_change":"2024-09-10T06:26:34.279889+0000","last_active":"2024-09-10T06:26:41.325045+0000","last_peered":"2024-09-10T06:26:41.325045+0000","last_clean":"2024-09-10T06:26:41.325045+0000","last_became_active":"2024-09-10T06:26:34.279147+0000","last_became_peered":"2024-09-10T06:26:34.279147+0000","last_unstale":"2024-09-10T06:26:41.325045+0000","last_undegraded":"2024-09-10T06:26:41.325045+0000","last_fullsized":"2024-09-10T06:26:41.325045+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:02.260309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"34'23","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.165762+0000","last_change":"2024-09-10T06:26:36.290005+0000","last_active":"2024-09-10T06:26:42.165762+0000","last_peered":"2024-09-10T06:26:42.165762+0000","last_clean":"2024-09-10T06:26:42.165762+0000","last_became_active":"2024-09-10T06:26:36.289232+0000","last_became_peered":"2024-09-10T06:26:36.289232+0000","last_unstale":"2024-09-10T06:26:42.165762+0000","last_undegraded":"2024-09-10T06:26:42.165762+0000","last_fullsized":"2024-09-10T06:26:42.165762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:51.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312447+0000","last_change":"2024-09-10T06:26:38.302505+0000","last_active":"2024-09-10T06:26:41.312447+0000","last_peered":"2024-09-10T06:26:41.312447+0000","last_clean":"2024-09-10T06:26:41.312447+0000","last_became_active":"2024-09-10T06:26:38.301104+0000","last_became_peered":"2024-09-10T06:26:38.301104+0000","last_unstale":"2024-09-10T06:26:41.312447+0000","last_undegraded":"2024-09-10T06:26:41.312447+0000","last_fullsized":"2024-09-10T06:26:41.312447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.863622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.314704+0000","last_change":"2024-09-10T06:26:40.320079+0000","last_active":"2024-09-10T06:26:41.314704+0000","last_peered":"2024-09-10T06:26:41.314704+0000","last_clean":"2024-09-10T06:26:41.314704+0000","last_became_active":"2024-09-10T06:26:40.319266+0000","last_became_peered":"2024-09-10T06:26:40.319266+0000","last_unstale":"2024-09-10T06:26:41.314704+0000","last_undegraded":"2024-09-10T06:26:41.314704+0000","last_fullsized":"2024-09-10T06:26:41.314704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:57.937745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.317130+0000","last_change":"2024-09-10T06:26:32.282679+0000","last_active":"2024-09-10T06:26:41.317130+0000","last_peered":"2024-09-10T06:26:41.317130+0000","last_clean":"2024-09-10T06:26:41.317130+0000","last_became_active":"2024-09-10T06:26:32.282235+0000","last_became_peered":"2024-09-10T06:26:32.282235+0000","last_unstale":"2024-09-10T06:26:41.317130+0000","last_undegraded":"2024-09-10T06:26:41.317130+0000","last_fullsized":"2024-09-10T06:26:41.317130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:27.994318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293174+0000","last_change":"2024-09-10T06:26:25.979784+0000","last_active":"2024-09-10T06:26:41.293174+0000","last_peered":"2024-09-10T06:26:41.293174+0000","last_clean":"2024-09-10T06:26:41.293174+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:26:41.293174+0000","last_undegraded":"2024-09-10T06:26:41.293174+0000","last_fullsized":"2024-09-10T06:26:41.293174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:42.490682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.314384+0000","last_change":"2024-09-10T06:26:30.570558+0000","last_active":"2024-09-10T06:26:41.314384+0000","last_peered":"2024-09-10T06:26:41.314384+0000","last_clean":"2024-09-10T06:26:41.314384+0000","last_became_active":"2024-09-10T06:26:30.570037+0000","last_became_peered":"2024-09-10T06:26:30.570037+0000","last_unstale":"2024-09-10T06:26:41.314384+0000","last_undegraded":"2024-09-10T06:26:41.314384+0000","last_fullsized":"2024-09-10T06:26:41.314384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:46.692143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298840+0000","last_change":"2024-09-10T06:26:34.284394+0000","last_active":"2024-09-10T06:26:41.298840+0000","last_peered":"2024-09-10T06:26:41.298840+0000","last_clean":"2024-09-10T06:26:41.298840+0000","last_became_active":"2024-09-10T06:26:34.283980+0000","last_became_peered":"2024-09-10T06:26:34.283980+0000","last_unstale":"2024-09-10T06:26:41.298840+0000","last_undegraded":"2024-09-10T06:26:41.298840+0000","last_fullsized":"2024-09-10T06:26:41.298840+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:38.061123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'15","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.172694+0000","last_change":"2024-09-10T06:26:36.302835+0000","last_active":"2024-09-10T06:26:42.172694+0000","last_peered":"2024-09-10T06:26:42.172694+0000","last_clean":"2024-09-10T06:26:42.172694+0000","last_became_active":"2024-09-10T06:26:36.299434+0000","last_became_peered":"2024-09-10T06:26:36.299434+0000","last_unstale":"2024-09-10T06:26:42.172694+0000","last_undegraded":"2024-09-10T06:26:42.172694+0000","last_fullsized":"2024-09-10T06:26:42.172694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329312+0000","last_change":"2024-09-10T06:26:38.292411+0000","last_active":"2024-09-10T06:26:41.329312+0000","last_peered":"2024-09-10T06:26:41.329312+0000","last_clean":"2024-09-10T06:26:41.329312+0000","last_became_active":"2024-09-10T06:26:38.291623+0000","last_became_peered":"2024-09-10T06:26:38.291623+0000","last_unstale":"2024-09-10T06:26:41.329312+0000","last_undegraded":"2024-09-10T06:26:41.329312+0000","last_fullsized":"2024-09-10T06:26:41.329312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.297347+0000","last_change":"2024-09-10T06:26:40.303598+0000","last_active":"2024-09-10T06:26:41.297347+0000","last_peered":"2024-09-10T06:26:41.297347+0000","last_clean":"2024-09-10T06:26:41.297347+0000","last_became_active":"2024-09-10T06:26:40.302898+0000","last_became_peered":"2024-09-10T06:26:40.302898+0000","last_unstale":"2024-09-10T06:26:41.297347+0000","last_undegraded":"2024-09-10T06:26:41.297347+0000","last_fullsized":"2024-09-10T06:26:41.297347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:49.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315696+0000","last_change":"2024-09-10T06:26:32.273484+0000","last_active":"2024-09-10T06:26:41.315696+0000","last_peered":"2024-09-10T06:26:41.315696+0000","last_clean":"2024-09-10T06:26:41.315696+0000","last_became_active":"2024-09-10T06:26:32.273183+0000","last_became_peered":"2024-09-10T06:26:32.273183+0000","last_unstale":"2024-09-10T06:26:41.315696+0000","last_undegraded":"2024-09-10T06:26:41.315696+0000","last_fullsized":"2024-09-10T06:26:41.315696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:32.410538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323412+0000","last_change":"2024-09-10T06:26:25.534289+0000","last_active":"2024-09-10T06:26:41.323412+0000","last_peered":"2024-09-10T06:26:41.323412+0000","last_clean":"2024-09-10T06:26:41.323412+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:26:41.323412+0000","last_undegraded":"2024-09-10T06:26:41.323412+0000","last_fullsized":"2024-09-10T06:26:41.323412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:11.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294737+0000","last_change":"2024-09-10T06:26:30.579693+0000","last_active":"2024-09-10T06:26:41.294737+0000","last_peered":"2024-09-10T06:26:41.294737+0000","last_clean":"2024-09-10T06:26:41.294737+0000","last_became_active":"2024-09-10T06:26:30.577934+0000","last_became_peered":"2024-09-10T06:26:30.577934+0000","last_unstale":"2024-09-10T06:26:41.294737+0000","last_undegraded":"2024-09-10T06:26:41.294737+0000","last_fullsized":"2024-09-10T06:26:41.294737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:35.852655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329789+0000","last_change":"2024-09-10T06:26:34.275458+0000","last_active":"2024-09-10T06:26:41.329789+0000","last_peered":"2024-09-10T06:26:41.329789+0000","last_clean":"2024-09-10T06:26:41.329789+0000","last_became_active":"2024-09-10T06:26:34.274705+0000","last_became_peered":"2024-09-10T06:26:34.274705+0000","last_unstale":"2024-09-10T06:26:41.329789+0000","last_undegraded":"2024-09-10T06:26:41.329789+0000","last_fullsized":"2024-09-10T06:26:41.329789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:20.624872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.013816+0000","last_change":"2024-09-10T06:26:36.266077+0000","last_active":"2024-09-10T06:26:42.013816+0000","last_peered":"2024-09-10T06:26:42.013816+0000","last_clean":"2024-09-10T06:26:42.013816+0000","last_became_active":"2024-09-10T06:26:36.265322+0000","last_became_peered":"2024-09-10T06:26:36.265322+0000","last_unstale":"2024-09-10T06:26:42.013816+0000","last_undegraded":"2024-09-10T06:26:42.013816+0000","last_fullsized":"2024-09-10T06:26:42.013816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327890+0000","last_change":"2024-09-10T06:26:38.296115+0000","last_active":"2024-09-10T06:26:41.327890+0000","last_peered":"2024-09-10T06:26:41.327890+0000","last_clean":"2024-09-10T06:26:41.327890+0000","last_became_active":"2024-09-10T06:26:38.295264+0000","last_became_peered":"2024-09-10T06:26:38.295264+0000","last_unstale":"2024-09-10T06:26:41.327890+0000","last_undegraded":"2024-09-10T06:26:41.327890+0000","last_fullsized":"2024-09-10T06:26:41.327890+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:52:33.108384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.320969+0000","last_change":"2024-09-10T06:26:40.326887+0000","last_active":"2024-09-10T06:26:41.320969+0000","last_peered":"2024-09-10T06:26:41.320969+0000","last_clean":"2024-09-10T06:26:41.320969+0000","last_became_active":"2024-09-10T06:26:40.326130+0000","last_became_peered":"2024-09-10T06:26:40.326130+0000","last_unstale":"2024-09-10T06:26:41.320969+0000","last_undegraded":"2024-09-10T06:26:41.320969+0000","last_fullsized":"2024-09-10T06:26:41.320969+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:28.237428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315129+0000","last_change":"2024-09-10T06:26:32.282586+0000","last_active":"2024-09-10T06:26:41.315129+0000","last_peered":"2024-09-10T06:26:41.315129+0000","last_clean":"2024-09-10T06:26:41.315129+0000","last_became_active":"2024-09-10T06:26:32.282086+0000","last_became_peered":"2024-09-10T06:26:32.282086+0000","last_unstale":"2024-09-10T06:26:41.315129+0000","last_undegraded":"2024-09-10T06:26:41.315129+0000","last_fullsized":"2024-09-10T06:26:41.315129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:44.269917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325241+0000","last_change":"2024-09-10T06:26:30.591913+0000","last_active":"2024-09-10T06:26:41.325241+0000","last_peered":"2024-09-10T06:26:41.325241+0000","last_clean":"2024-09-10T06:26:41.325241+0000","last_became_active":"2024-09-10T06:26:30.591140+0000","last_became_peered":"2024-09-10T06:26:30.591140+0000","last_unstale":"2024-09-10T06:26:41.325241+0000","last_undegraded":"2024-09-10T06:26:41.325241+0000","last_fullsized":"2024-09-10T06:26:41.325241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316228+0000","last_change":"2024-09-10T06:26:25.537497+0000","last_active":"2024-09-10T06:26:41.316228+0000","last_peered":"2024-09-10T06:26:41.316228+0000","last_clean":"2024-09-10T06:26:41.316228+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:26:41.316228+0000","last_undegraded":"2024-09-10T06:26:41.316228+0000","last_fullsized":"2024-09-10T06:26:41.316228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:44.787852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329915+0000","last_change":"2024-09-10T06:26:34.276099+0000","last_active":"2024-09-10T06:26:41.329915+0000","last_peered":"2024-09-10T06:26:41.329915+0000","last_clean":"2024-09-10T06:26:41.329915+0000","last_became_active":"2024-09-10T06:26:34.273984+0000","last_became_peered":"2024-09-10T06:26:34.273984+0000","last_unstale":"2024-09-10T06:26:41.329915+0000","last_undegraded":"2024-09-10T06:26:41.329915+0000","last_fullsized":"2024-09-10T06:26:41.329915+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'18","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.101905+0000","last_change":"2024-09-10T06:26:36.272589+0000","last_active":"2024-09-10T06:26:42.101905+0000","last_peered":"2024-09-10T06:26:42.101905+0000","last_clean":"2024-09-10T06:26:42.101905+0000","last_became_active":"2024-09-10T06:26:36.270914+0000","last_became_peered":"2024-09-10T06:26:36.270914+0000","last_unstale":"2024-09-10T06:26:42.101905+0000","last_undegraded":"2024-09-10T06:26:42.101905+0000","last_fullsized":"2024-09-10T06:26:42.101905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:20.764690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.292750+0000","last_change":"2024-09-10T06:26:38.278069+0000","last_active":"2024-09-10T06:26:41.292750+0000","last_peered":"2024-09-10T06:26:41.292750+0000","last_clean":"2024-09-10T06:26:41.292750+0000","last_became_active":"2024-09-10T06:26:38.277261+0000","last_became_peered":"2024-09-10T06:26:38.277261+0000","last_unstale":"2024-09-10T06:26:41.292750+0000","last_undegraded":"2024-09-10T06:26:41.292750+0000","last_fullsized":"2024-09-10T06:26:41.292750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330320+0000","last_change":"2024-09-10T06:26:40.333741+0000","last_active":"2024-09-10T06:26:41.330320+0000","last_peered":"2024-09-10T06:26:41.330320+0000","last_clean":"2024-09-10T06:26:41.330320+0000","last_became_active":"2024-09-10T06:26:40.329701+0000","last_became_peered":"2024-09-10T06:26:40.329701+0000","last_unstale":"2024-09-10T06:26:41.330320+0000","last_undegraded":"2024-09-10T06:26:41.330320+0000","last_fullsized":"2024-09-10T06:26:41.330320+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:53.704790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330374+0000","last_change":"2024-09-10T06:26:32.275551+0000","last_active":"2024-09-10T06:26:41.330374+0000","last_peered":"2024-09-10T06:26:41.330374+0000","last_clean":"2024-09-10T06:26:41.330374+0000","last_became_active":"2024-09-10T06:26:32.274946+0000","last_became_peered":"2024-09-10T06:26:32.274946+0000","last_unstale":"2024-09-10T06:26:41.330374+0000","last_undegraded":"2024-09-10T06:26:41.330374+0000","last_fullsized":"2024-09-10T06:26:41.330374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315843+0000","last_change":"2024-09-10T06:26:30.565595+0000","last_active":"2024-09-10T06:26:41.315843+0000","last_peered":"2024-09-10T06:26:41.315843+0000","last_clean":"2024-09-10T06:26:41.315843+0000","last_became_active":"2024-09-10T06:26:30.565220+0000","last_became_peered":"2024-09-10T06:26:30.565220+0000","last_unstale":"2024-09-10T06:26:41.315843+0000","last_undegraded":"2024-09-10T06:26:41.315843+0000","last_fullsized":"2024-09-10T06:26:41.315843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:14.600216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313727+0000","last_change":"2024-09-10T06:26:26.180820+0000","last_active":"2024-09-10T06:26:41.313727+0000","last_peered":"2024-09-10T06:26:41.313727+0000","last_clean":"2024-09-10T06:26:41.313727+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:26:41.313727+0000","last_undegraded":"2024-09-10T06:26:41.313727+0000","last_fullsized":"2024-09-10T06:26:41.313727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:51.928304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326429+0000","last_change":"2024-09-10T06:26:34.272915+0000","last_active":"2024-09-10T06:26:41.326429+0000","last_peered":"2024-09-10T06:26:41.326429+0000","last_clean":"2024-09-10T06:26:41.326429+0000","last_became_active":"2024-09-10T06:26:34.272192+0000","last_became_peered":"2024-09-10T06:26:34.272192+0000","last_unstale":"2024-09-10T06:26:41.326429+0000","last_undegraded":"2024-09-10T06:26:41.326429+0000","last_fullsized":"2024-09-10T06:26:41.326429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:07.874348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.197351+0000","last_change":"2024-09-10T06:26:36.291431+0000","last_active":"2024-09-10T06:26:42.197351+0000","last_peered":"2024-09-10T06:26:42.197351+0000","last_clean":"2024-09-10T06:26:42.197351+0000","last_became_active":"2024-09-10T06:26:36.290570+0000","last_became_peered":"2024-09-10T06:26:36.290570+0000","last_unstale":"2024-09-10T06:26:42.197351+0000","last_undegraded":"2024-09-10T06:26:42.197351+0000","last_fullsized":"2024-09-10T06:26:42.197351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:10.565531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.321604+0000","last_change":"2024-09-10T06:26:38.312069+0000","last_active":"2024-09-10T06:26:41.321604+0000","last_peered":"2024-09-10T06:26:41.321604+0000","last_clean":"2024-09-10T06:26:41.321604+0000","last_became_active":"2024-09-10T06:26:38.310450+0000","last_became_peered":"2024-09-10T06:26:38.310450+0000","last_unstale":"2024-09-10T06:26:41.321604+0000","last_undegraded":"2024-09-10T06:26:41.321604+0000","last_fullsized":"2024-09-10T06:26:41.321604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.299157+0000","last_change":"2024-09-10T06:26:40.312990+0000","last_active":"2024-09-10T06:26:41.299157+0000","last_peered":"2024-09-10T06:26:41.299157+0000","last_clean":"2024-09-10T06:26:41.299157+0000","last_became_active":"2024-09-10T06:26:40.312266+0000","last_became_peered":"2024-09-10T06:26:40.312266+0000","last_unstale":"2024-09-10T06:26:41.299157+0000","last_undegraded":"2024-09-10T06:26:41.299157+0000","last_fullsized":"2024-09-10T06:26:41.299157+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:15.777105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294155+0000","last_change":"2024-09-10T06:26:32.258874+0000","last_active":"2024-09-10T06:26:41.294155+0000","last_peered":"2024-09-10T06:26:41.294155+0000","last_clean":"2024-09-10T06:26:41.294155+0000","last_became_active":"2024-09-10T06:26:32.258337+0000","last_became_peered":"2024-09-10T06:26:32.258337+0000","last_unstale":"2024-09-10T06:26:41.294155+0000","last_undegraded":"2024-09-10T06:26:41.294155+0000","last_fullsized":"2024-09-10T06:26:41.294155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298309+0000","last_change":"2024-09-10T06:26:30.581501+0000","last_active":"2024-09-10T06:26:41.298309+0000","last_peered":"2024-09-10T06:26:41.298309+0000","last_clean":"2024-09-10T06:26:41.298309+0000","last_became_active":"2024-09-10T06:26:30.581115+0000","last_became_peered":"2024-09-10T06:26:30.581115+0000","last_unstale":"2024-09-10T06:26:41.298309+0000","last_undegraded":"2024-09-10T06:26:41.298309+0000","last_fullsized":"2024-09-10T06:26:41.298309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316754+0000","last_change":"2024-09-10T06:26:25.537295+0000","last_active":"2024-09-10T06:26:41.316754+0000","last_peered":"2024-09-10T06:26:41.316754+0000","last_clean":"2024-09-10T06:26:41.316754+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:26:41.316754+0000","last_undegraded":"2024-09-10T06:26:41.316754+0000","last_fullsized":"2024-09-10T06:26:41.316754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:32.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293011+0000","last_change":"2024-09-10T06:26:34.258956+0000","last_active":"2024-09-10T06:26:41.293011+0000","last_peered":"2024-09-10T06:26:41.293011+0000","last_clean":"2024-09-10T06:26:41.293011+0000","last_became_active":"2024-09-10T06:26:34.257739+0000","last_became_peered":"2024-09-10T06:26:34.257739+0000","last_unstale":"2024-09-10T06:26:41.293011+0000","last_undegraded":"2024-09-10T06:26:41.293011+0000","last_fullsized":"2024-09-10T06:26:41.293011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:18.547827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'10","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.156251+0000","last_change":"2024-09-10T06:26:36.271096+0000","last_active":"2024-09-10T06:26:42.156251+0000","last_peered":"2024-09-10T06:26:42.156251+0000","last_clean":"2024-09-10T06:26:42.156251+0000","last_became_active":"2024-09-10T06:26:36.270325+0000","last_became_peered":"2024-09-10T06:26:36.270325+0000","last_unstale":"2024-09-10T06:26:42.156251+0000","last_undegraded":"2024-09-10T06:26:42.156251+0000","last_fullsized":"2024-09-10T06:26:42.156251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.296422+0000","last_change":"2024-09-10T06:26:38.300795+0000","last_active":"2024-09-10T06:26:41.296422+0000","last_peered":"2024-09-10T06:26:41.296422+0000","last_clean":"2024-09-10T06:26:41.296422+0000","last_became_active":"2024-09-10T06:26:38.299466+0000","last_became_peered":"2024-09-10T06:26:38.299466+0000","last_unstale":"2024-09-10T06:26:41.296422+0000","last_undegraded":"2024-09-10T06:26:41.296422+0000","last_fullsized":"2024-09-10T06:26:41.296422+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:38.641500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329298+0000","last_change":"2024-09-10T06:26:40.329688+0000","last_active":"2024-09-10T06:26:41.329298+0000","last_peered":"2024-09-10T06:26:41.329298+0000","last_clean":"2024-09-10T06:26:41.329298+0000","last_became_active":"2024-09-10T06:26:40.329009+0000","last_became_peered":"2024-09-10T06:26:40.329009+0000","last_unstale":"2024-09-10T06:26:41.329298+0000","last_undegraded":"2024-09-10T06:26:41.329298+0000","last_fullsized":"2024-09-10T06:26:41.329298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293341+0000","last_change":"2024-09-10T06:26:32.283524+0000","last_active":"2024-09-10T06:26:41.293341+0000","last_peered":"2024-09-10T06:26:41.293341+0000","last_clean":"2024-09-10T06:26:41.293341+0000","last_became_active":"2024-09-10T06:26:32.282794+0000","last_became_peered":"2024-09-10T06:26:32.282794+0000","last_unstale":"2024-09-10T06:26:41.293341+0000","last_undegraded":"2024-09-10T06:26:41.293341+0000","last_fullsized":"2024-09-10T06:26:41.293341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:11.537416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331957+0000","last_change":"2024-09-10T06:26:30.578273+0000","last_active":"2024-09-10T06:26:41.331957+0000","last_peered":"2024-09-10T06:26:41.331957+0000","last_clean":"2024-09-10T06:26:41.331957+0000","last_became_active":"2024-09-10T06:26:30.577985+0000","last_became_peered":"2024-09-10T06:26:30.577985+0000","last_unstale":"2024-09-10T06:26:41.331957+0000","last_undegraded":"2024-09-10T06:26:41.331957+0000","last_fullsized":"2024-09-10T06:26:41.331957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328384+0000","last_change":"2024-09-10T06:26:26.037773+0000","last_active":"2024-09-10T06:26:41.328384+0000","last_peered":"2024-09-10T06:26:41.328384+0000","last_clean":"2024-09-10T06:26:41.328384+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:26:41.328384+0000","last_undegraded":"2024-09-10T06:26:41.328384+0000","last_fullsized":"2024-09-10T06:26:41.328384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:21.949708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293814+0000","last_change":"2024-09-10T06:26:34.268710+0000","last_active":"2024-09-10T06:26:41.293814+0000","last_peered":"2024-09-10T06:26:41.293814+0000","last_clean":"2024-09-10T06:26:41.293814+0000","last_became_active":"2024-09-10T06:26:34.268359+0000","last_became_peered":"2024-09-10T06:26:34.268359+0000","last_unstale":"2024-09-10T06:26:41.293814+0000","last_undegraded":"2024-09-10T06:26:41.293814+0000","last_fullsized":"2024-09-10T06:26:41.293814+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:27.191787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'19","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.135721+0000","last_change":"2024-09-10T06:26:36.299700+0000","last_active":"2024-09-10T06:26:42.135721+0000","last_peered":"2024-09-10T06:26:42.135721+0000","last_clean":"2024-09-10T06:26:42.135721+0000","last_became_active":"2024-09-10T06:26:36.297606+0000","last_became_peered":"2024-09-10T06:26:36.297606+0000","last_unstale":"2024-09-10T06:26:42.135721+0000","last_undegraded":"2024-09-10T06:26:42.135721+0000","last_fullsized":"2024-09-10T06:26:42.135721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294640+0000","last_change":"2024-09-10T06:26:38.290601+0000","last_active":"2024-09-10T06:26:41.294640+0000","last_peered":"2024-09-10T06:26:41.294640+0000","last_clean":"2024-09-10T06:26:41.294640+0000","last_became_active":"2024-09-10T06:26:38.289589+0000","last_became_peered":"2024-09-10T06:26:38.289589+0000","last_unstale":"2024-09-10T06:26:41.294640+0000","last_undegraded":"2024-09-10T06:26:41.294640+0000","last_fullsized":"2024-09-10T06:26:41.294640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:22.625936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323911+0000","last_change":"2024-09-10T06:26:40.332819+0000","last_active":"2024-09-10T06:26:41.323911+0000","last_peered":"2024-09-10T06:26:41.323911+0000","last_clean":"2024-09-10T06:26:41.323911+0000","last_became_active":"2024-09-10T06:26:40.332160+0000","last_became_peered":"2024-09-10T06:26:40.332160+0000","last_unstale":"2024-09-10T06:26:41.323911+0000","last_undegraded":"2024-09-10T06:26:41.323911+0000","last_fullsized":"2024-09-10T06:26:41.323911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.784870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330669+0000","last_change":"2024-09-10T06:26:40.334393+0000","last_active":"2024-09-10T06:26:41.330669+0000","last_peered":"2024-09-10T06:26:41.330669+0000","last_clean":"2024-09-10T06:26:41.330669+0000","last_became_active":"2024-09-10T06:26:40.333474+0000","last_became_peered":"2024-09-10T06:26:40.333474+0000","last_unstale":"2024-09-10T06:26:41.330669+0000","last_undegraded":"2024-09-10T06:26:41.330669+0000","last_fullsized":"2024-09-10T06:26:41.330669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:35.031954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294179+0000","last_change":"2024-09-10T06:26:32.272914+0000","last_active":"2024-09-10T06:26:41.294179+0000","last_peered":"2024-09-10T06:26:41.294179+0000","last_clean":"2024-09-10T06:26:41.294179+0000","last_became_active":"2024-09-10T06:26:32.272178+0000","last_became_peered":"2024-09-10T06:26:32.272178+0000","last_unstale":"2024-09-10T06:26:41.294179+0000","last_undegraded":"2024-09-10T06:26:41.294179+0000","last_fullsized":"2024-09-10T06:26:41.294179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294481+0000","last_change":"2024-09-10T06:26:30.593531+0000","last_active":"2024-09-10T06:26:41.294481+0000","last_peered":"2024-09-10T06:26:41.294481+0000","last_clean":"2024-09-10T06:26:41.294481+0000","last_became_active":"2024-09-10T06:26:30.592753+0000","last_became_peered":"2024-09-10T06:26:30.592753+0000","last_unstale":"2024-09-10T06:26:41.294481+0000","last_undegraded":"2024-09-10T06:26:41.294481+0000","last_fullsized":"2024-09-10T06:26:41.294481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:14.506864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315234+0000","last_change":"2024-09-10T06:26:34.282877+0000","last_active":"2024-09-10T06:26:41.315234+0000","last_peered":"2024-09-10T06:26:41.315234+0000","last_clean":"2024-09-10T06:26:41.315234+0000","last_became_active":"2024-09-10T06:26:34.282281+0000","last_became_peered":"2024-09-10T06:26:34.282281+0000","last_unstale":"2024-09-10T06:26:41.315234+0000","last_undegraded":"2024-09-10T06:26:41.315234+0000","last_fullsized":"2024-09-10T06:26:41.315234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:41.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.204043+0000","last_change":"2024-09-10T06:26:36.273166+0000","last_active":"2024-09-10T06:26:42.204043+0000","last_peered":"2024-09-10T06:26:42.204043+0000","last_clean":"2024-09-10T06:26:42.204043+0000","last_became_active":"2024-09-10T06:26:36.272386+0000","last_became_peered":"2024-09-10T06:26:36.272386+0000","last_unstale":"2024-09-10T06:26:42.204043+0000","last_undegraded":"2024-09-10T06:26:42.204043+0000","last_fullsized":"2024-09-10T06:26:42.204043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293458+0000","last_change":"2024-09-10T06:26:38.297347+0000","last_active":"2024-09-10T06:26:41.293458+0000","last_peered":"2024-09-10T06:26:41.293458+0000","last_clean":"2024-09-10T06:26:41.293458+0000","last_became_active":"2024-09-10T06:26:38.296600+0000","last_became_peered":"2024-09-10T06:26:38.296600+0000","last_unstale":"2024-09-10T06:26:41.293458+0000","last_undegraded":"2024-09-10T06:26:41.293458+0000","last_fullsized":"2024-09-10T06:26:41.293458+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:08.758126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.296637+0000","last_change":"2024-09-10T06:26:40.321844+0000","last_active":"2024-09-10T06:26:41.296637+0000","last_peered":"2024-09-10T06:26:41.296637+0000","last_clean":"2024-09-10T06:26:41.296637+0000","last_became_active":"2024-09-10T06:26:40.321097+0000","last_became_peered":"2024-09-10T06:26:40.321097+0000","last_unstale":"2024-09-10T06:26:41.296637+0000","last_undegraded":"2024-09-10T06:26:41.296637+0000","last_fullsized":"2024-09-10T06:26:41.296637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:10.004849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.314995+0000","last_change":"2024-09-10T06:26:32.286989+0000","last_active":"2024-09-10T06:26:41.314995+0000","last_peered":"2024-09-10T06:26:41.314995+0000","last_clean":"2024-09-10T06:26:41.314995+0000","last_became_active":"2024-09-10T06:26:32.286519+0000","last_became_peered":"2024-09-10T06:26:32.286519+0000","last_unstale":"2024-09-10T06:26:41.314995+0000","last_undegraded":"2024-09-10T06:26:41.314995+0000","last_fullsized":"2024-09-10T06:26:41.314995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:31.592472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313322+0000","last_change":"2024-09-10T06:26:30.587315+0000","last_active":"2024-09-10T06:26:41.313322+0000","last_peered":"2024-09-10T06:26:41.313322+0000","last_clean":"2024-09-10T06:26:41.313322+0000","last_became_active":"2024-09-10T06:26:30.586611+0000","last_became_peered":"2024-09-10T06:26:30.586611+0000","last_unstale":"2024-09-10T06:26:41.313322+0000","last_undegraded":"2024-09-10T06:26:41.313322+0000","last_fullsized":"2024-09-10T06:26:41.313322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"27'1","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294803+0000","last_change":"2024-09-10T06:26:34.271770+0000","last_active":"2024-09-10T06:26:41.294803+0000","last_peered":"2024-09-10T06:26:41.294803+0000","last_clean":"2024-09-10T06:26:41.294803+0000","last_became_active":"2024-09-10T06:26:34.269875+0000","last_became_peered":"2024-09-10T06:26:34.269875+0000","last_unstale":"2024-09-10T06:26:41.294803+0000","last_undegraded":"2024-09-10T06:26:41.294803+0000","last_fullsized":"2024-09-10T06:26:41.294803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:09.570079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'4","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.676760+0000","last_change":"2024-09-10T06:26:36.289140+0000","last_active":"2024-09-10T06:26:41.676760+0000","last_peered":"2024-09-10T06:26:41.676760+0000","last_clean":"2024-09-10T06:26:41.676760+0000","last_became_active":"2024-09-10T06:26:36.288355+0000","last_became_peered":"2024-09-10T06:26:36.288355+0000","last_unstale":"2024-09-10T06:26:41.676760+0000","last_undegraded":"2024-09-10T06:26:41.676760+0000","last_fullsized":"2024-09-10T06:26:41.676760+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:42.518982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311231+0000","last_change":"2024-09-10T06:26:38.302040+0000","last_active":"2024-09-10T06:26:41.311231+0000","last_peered":"2024-09-10T06:26:41.311231+0000","last_clean":"2024-09-10T06:26:41.311231+0000","last_became_active":"2024-09-10T06:26:38.301064+0000","last_became_peered":"2024-09-10T06:26:38.301064+0000","last_unstale":"2024-09-10T06:26:41.311231+0000","last_undegraded":"2024-09-10T06:26:41.311231+0000","last_fullsized":"2024-09-10T06:26:41.311231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:41.513255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329245+0000","last_change":"2024-09-10T06:26:40.322368+0000","last_active":"2024-09-10T06:26:41.329245+0000","last_peered":"2024-09-10T06:26:41.329245+0000","last_clean":"2024-09-10T06:26:41.329245+0000","last_became_active":"2024-09-10T06:26:40.321592+0000","last_became_peered":"2024-09-10T06:26:40.321592+0000","last_unstale":"2024-09-10T06:26:41.329245+0000","last_undegraded":"2024-09-10T06:26:41.329245+0000","last_fullsized":"2024-09-10T06:26:41.329245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:03.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293640+0000","last_change":"2024-09-10T06:26:32.259666+0000","last_active":"2024-09-10T06:26:41.293640+0000","last_peered":"2024-09-10T06:26:41.293640+0000","last_clean":"2024-09-10T06:26:41.293640+0000","last_became_active":"2024-09-10T06:26:32.258775+0000","last_became_peered":"2024-09-10T06:26:32.258775+0000","last_unstale":"2024-09-10T06:26:41.293640+0000","last_undegraded":"2024-09-10T06:26:41.293640+0000","last_fullsized":"2024-09-10T06:26:41.293640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.324105+0000","last_change":"2024-09-10T06:26:30.592773+0000","last_active":"2024-09-10T06:26:41.324105+0000","last_peered":"2024-09-10T06:26:41.324105+0000","last_clean":"2024-09-10T06:26:41.324105+0000","last_became_active":"2024-09-10T06:26:30.590566+0000","last_became_peered":"2024-09-10T06:26:30.590566+0000","last_unstale":"2024-09-10T06:26:41.324105+0000","last_undegraded":"2024-09-10T06:26:41.324105+0000","last_fullsized":"2024-09-10T06:26:41.324105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:35.688897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.310615+0000","last_change":"2024-09-10T06:26:34.281690+0000","last_active":"2024-09-10T06:26:41.310615+0000","last_peered":"2024-09-10T06:26:41.310615+0000","last_clean":"2024-09-10T06:26:41.310615+0000","last_became_active":"2024-09-10T06:26:34.281008+0000","last_became_peered":"2024-09-10T06:26:34.281008+0000","last_unstale":"2024-09-10T06:26:41.310615+0000","last_undegraded":"2024-09-10T06:26:41.310615+0000","last_fullsized":"2024-09-10T06:26:41.310615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.114796+0000","last_change":"2024-09-10T06:26:36.277028+0000","last_active":"2024-09-10T06:26:42.114796+0000","last_peered":"2024-09-10T06:26:42.114796+0000","last_clean":"2024-09-10T06:26:42.114796+0000","last_became_active":"2024-09-10T06:26:36.276248+0000","last_became_peered":"2024-09-10T06:26:36.276248+0000","last_unstale":"2024-09-10T06:26:42.114796+0000","last_undegraded":"2024-09-10T06:26:42.114796+0000","last_fullsized":"2024-09-10T06:26:42.114796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:53.521681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326363+0000","last_change":"2024-09-10T06:26:38.294889+0000","last_active":"2024-09-10T06:26:41.326363+0000","last_peered":"2024-09-10T06:26:41.326363+0000","last_clean":"2024-09-10T06:26:41.326363+0000","last_became_active":"2024-09-10T06:26:38.294124+0000","last_became_peered":"2024-09-10T06:26:38.294124+0000","last_unstale":"2024-09-10T06:26:41.326363+0000","last_undegraded":"2024-09-10T06:26:41.326363+0000","last_fullsized":"2024-09-10T06:26:41.326363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:42.905517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323061+0000","last_change":"2024-09-10T06:26:40.331445+0000","last_active":"2024-09-10T06:26:41.323061+0000","last_peered":"2024-09-10T06:26:41.323061+0000","last_clean":"2024-09-10T06:26:41.323061+0000","last_became_active":"2024-09-10T06:26:40.330707+0000","last_became_peered":"2024-09-10T06:26:40.330707+0000","last_unstale":"2024-09-10T06:26:41.323061+0000","last_undegraded":"2024-09-10T06:26:41.323061+0000","last_fullsized":"2024-09-10T06:26:41.323061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.822687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294508+0000","last_change":"2024-09-10T06:26:32.266221+0000","last_active":"2024-09-10T06:26:41.294508+0000","last_peered":"2024-09-10T06:26:41.294508+0000","last_clean":"2024-09-10T06:26:41.294508+0000","last_became_active":"2024-09-10T06:26:32.265705+0000","last_became_peered":"2024-09-10T06:26:32.265705+0000","last_unstale":"2024-09-10T06:26:41.294508+0000","last_undegraded":"2024-09-10T06:26:41.294508+0000","last_fullsized":"2024-09-10T06:26:41.294508+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331669+0000","last_change":"2024-09-10T06:26:30.594335+0000","last_active":"2024-09-10T06:26:41.331669+0000","last_peered":"2024-09-10T06:26:41.331669+0000","last_clean":"2024-09-10T06:26:41.331669+0000","last_became_active":"2024-09-10T06:26:30.593326+0000","last_became_peered":"2024-09-10T06:26:30.593326+0000","last_unstale":"2024-09-10T06:26:41.331669+0000","last_undegraded":"2024-09-10T06:26:41.331669+0000","last_fullsized":"2024-09-10T06:26:41.331669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:37.297722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326384+0000","last_change":"2024-09-10T06:26:34.281915+0000","last_active":"2024-09-10T06:26:41.326384+0000","last_peered":"2024-09-10T06:26:41.326384+0000","last_clean":"2024-09-10T06:26:41.326384+0000","last_became_active":"2024-09-10T06:26:34.281147+0000","last_became_peered":"2024-09-10T06:26:34.281147+0000","last_unstale":"2024-09-10T06:26:41.326384+0000","last_undegraded":"2024-09-10T06:26:41.326384+0000","last_fullsized":"2024-09-10T06:26:41.326384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:41.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.901249+0000","last_change":"2024-09-10T06:26:36.298537+0000","last_active":"2024-09-10T06:26:41.901249+0000","last_peered":"2024-09-10T06:26:41.901249+0000","last_clean":"2024-09-10T06:26:41.901249+0000","last_became_active":"2024-09-10T06:26:36.297372+0000","last_became_peered":"2024-09-10T06:26:36.297372+0000","last_unstale":"2024-09-10T06:26:41.901249+0000","last_undegraded":"2024-09-10T06:26:41.901249+0000","last_fullsized":"2024-09-10T06:26:41.901249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328599+0000","last_change":"2024-09-10T06:26:38.301461+0000","last_active":"2024-09-10T06:26:41.328599+0000","last_peered":"2024-09-10T06:26:41.328599+0000","last_clean":"2024-09-10T06:26:41.328599+0000","last_became_active":"2024-09-10T06:26:38.300580+0000","last_became_peered":"2024-09-10T06:26:38.300580+0000","last_unstale":"2024-09-10T06:26:41.328599+0000","last_undegraded":"2024-09-10T06:26:41.328599+0000","last_fullsized":"2024-09-10T06:26:41.328599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328213+0000","last_change":"2024-09-10T06:26:32.285276+0000","last_active":"2024-09-10T06:26:41.328213+0000","last_peered":"2024-09-10T06:26:41.328213+0000","last_clean":"2024-09-10T06:26:41.328213+0000","last_became_active":"2024-09-10T06:26:32.284457+0000","last_became_peered":"2024-09-10T06:26:32.284457+0000","last_unstale":"2024-09-10T06:26:41.328213+0000","last_undegraded":"2024-09-10T06:26:41.328213+0000","last_fullsized":"2024-09-10T06:26:41.328213+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:37.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294982+0000","last_change":"2024-09-10T06:26:30.573339+0000","last_active":"2024-09-10T06:26:41.294982+0000","last_peered":"2024-09-10T06:26:41.294982+0000","last_clean":"2024-09-10T06:26:41.294982+0000","last_became_active":"2024-09-10T06:26:30.571377+0000","last_became_peered":"2024-09-10T06:26:30.571377+0000","last_unstale":"2024-09-10T06:26:41.294982+0000","last_undegraded":"2024-09-10T06:26:41.294982+0000","last_fullsized":"2024-09-10T06:26:41.294982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:59.752497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331292+0000","last_change":"2024-09-10T06:26:34.269013+0000","last_active":"2024-09-10T06:26:41.331292+0000","last_peered":"2024-09-10T06:26:41.331292+0000","last_clean":"2024-09-10T06:26:41.331292+0000","last_became_active":"2024-09-10T06:26:34.268677+0000","last_became_peered":"2024-09-10T06:26:34.268677+0000","last_unstale":"2024-09-10T06:26:41.331292+0000","last_undegraded":"2024-09-10T06:26:41.331292+0000","last_fullsized":"2024-09-10T06:26:41.331292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'12","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.233388+0000","last_change":"2024-09-10T06:26:36.300362+0000","last_active":"2024-09-10T06:26:42.233388+0000","last_peered":"2024-09-10T06:26:42.233388+0000","last_clean":"2024-09-10T06:26:42.233388+0000","last_became_active":"2024-09-10T06:26:36.299645+0000","last_became_peered":"2024-09-10T06:26:36.299645+0000","last_unstale":"2024-09-10T06:26:42.233388+0000","last_undegraded":"2024-09-10T06:26:42.233388+0000","last_fullsized":"2024-09-10T06:26:42.233388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:17.424354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323485+0000","last_change":"2024-09-10T06:26:38.299751+0000","last_active":"2024-09-10T06:26:41.323485+0000","last_peered":"2024-09-10T06:26:41.323485+0000","last_clean":"2024-09-10T06:26:41.323485+0000","last_became_active":"2024-09-10T06:26:38.298414+0000","last_became_peered":"2024-09-10T06:26:38.298414+0000","last_unstale":"2024-09-10T06:26:41.323485+0000","last_undegraded":"2024-09-10T06:26:41.323485+0000","last_fullsized":"2024-09-10T06:26:41.323485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293578+0000","last_change":"2024-09-10T06:26:40.312752+0000","last_active":"2024-09-10T06:26:41.293578+0000","last_peered":"2024-09-10T06:26:41.293578+0000","last_clean":"2024-09-10T06:26:41.293578+0000","last_became_active":"2024-09-10T06:26:40.312026+0000","last_became_peered":"2024-09-10T06:26:40.312026+0000","last_unstale":"2024-09-10T06:26:41.293578+0000","last_undegraded":"2024-09-10T06:26:41.293578+0000","last_fullsized":"2024-09-10T06:26:41.293578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:50.071224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331658+0000","last_change":"2024-09-10T06:26:32.266934+0000","last_active":"2024-09-10T06:26:41.331658+0000","last_peered":"2024-09-10T06:26:41.331658+0000","last_clean":"2024-09-10T06:26:41.331658+0000","last_became_active":"2024-09-10T06:26:32.266682+0000","last_became_peered":"2024-09-10T06:26:32.266682+0000","last_unstale":"2024-09-10T06:26:41.331658+0000","last_undegraded":"2024-09-10T06:26:41.331658+0000","last_fullsized":"2024-09-10T06:26:41.331658+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315625+0000","last_change":"2024-09-10T06:26:30.579097+0000","last_active":"2024-09-10T06:26:41.315625+0000","last_peered":"2024-09-10T06:26:41.315625+0000","last_clean":"2024-09-10T06:26:41.315625+0000","last_became_active":"2024-09-10T06:26:30.578692+0000","last_became_peered":"2024-09-10T06:26:30.578692+0000","last_unstale":"2024-09-10T06:26:41.315625+0000","last_undegraded":"2024-09-10T06:26:41.315625+0000","last_fullsized":"2024-09-10T06:26:41.315625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:15.878123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"27'1","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328026+0000","last_change":"2024-09-10T06:26:34.282356+0000","last_active":"2024-09-10T06:26:41.328026+0000","last_peered":"2024-09-10T06:26:41.328026+0000","last_clean":"2024-09-10T06:26:41.328026+0000","last_became_active":"2024-09-10T06:26:34.281167+0000","last_became_peered":"2024-09-10T06:26:34.281167+0000","last_unstale":"2024-09-10T06:26:41.328026+0000","last_undegraded":"2024-09-10T06:26:41.328026+0000","last_fullsized":"2024-09-10T06:26:41.328026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:59.042394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.020639+0000","last_change":"2024-09-10T06:26:36.301277+0000","last_active":"2024-09-10T06:26:42.020639+0000","last_peered":"2024-09-10T06:26:42.020639+0000","last_clean":"2024-09-10T06:26:42.020639+0000","last_became_active":"2024-09-10T06:26:36.300501+0000","last_became_peered":"2024-09-10T06:26:36.300501+0000","last_unstale":"2024-09-10T06:26:42.020639+0000","last_undegraded":"2024-09-10T06:26:42.020639+0000","last_fullsized":"2024-09-10T06:26:42.020639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:38.477946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316366+0000","last_change":"2024-09-10T06:26:38.305737+0000","last_active":"2024-09-10T06:26:41.316366+0000","last_peered":"2024-09-10T06:26:41.316366+0000","last_clean":"2024-09-10T06:26:41.316366+0000","last_became_active":"2024-09-10T06:26:38.303318+0000","last_became_peered":"2024-09-10T06:26:38.303318+0000","last_unstale":"2024-09-10T06:26:41.316366+0000","last_undegraded":"2024-09-10T06:26:41.316366+0000","last_fullsized":"2024-09-10T06:26:41.316366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:52.587622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.326063+0000","last_change":"2024-09-10T06:26:40.318587+0000","last_active":"2024-09-10T06:26:41.326063+0000","last_peered":"2024-09-10T06:26:41.326063+0000","last_clean":"2024-09-10T06:26:41.326063+0000","last_became_active":"2024-09-10T06:26:40.317695+0000","last_became_peered":"2024-09-10T06:26:40.317695+0000","last_unstale":"2024-09-10T06:26:41.326063+0000","last_undegraded":"2024-09-10T06:26:41.326063+0000","last_fullsized":"2024-09-10T06:26:41.326063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:48.298686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.296270+0000","last_change":"2024-09-10T06:26:32.276218+0000","last_active":"2024-09-10T06:26:41.296270+0000","last_peered":"2024-09-10T06:26:41.296270+0000","last_clean":"2024-09-10T06:26:41.296270+0000","last_became_active":"2024-09-10T06:26:32.275805+0000","last_became_peered":"2024-09-10T06:26:32.275805+0000","last_unstale":"2024-09-10T06:26:41.296270+0000","last_undegraded":"2024-09-10T06:26:41.296270+0000","last_fullsized":"2024-09-10T06:26:41.296270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294640+0000","last_change":"2024-09-10T06:26:30.568731+0000","last_active":"2024-09-10T06:26:41.294640+0000","last_peered":"2024-09-10T06:26:41.294640+0000","last_clean":"2024-09-10T06:26:41.294640+0000","last_became_active":"2024-09-10T06:26:30.567937+0000","last_became_peered":"2024-09-10T06:26:30.567937+0000","last_unstale":"2024-09-10T06:26:41.294640+0000","last_undegraded":"2024-09-10T06:26:41.294640+0000","last_fullsized":"2024-09-10T06:26:41.294640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:18.974865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295519+0000","last_change":"2024-09-10T06:26:34.266227+0000","last_active":"2024-09-10T06:26:41.295519+0000","last_peered":"2024-09-10T06:26:41.295519+0000","last_clean":"2024-09-10T06:26:41.295519+0000","last_became_active":"2024-09-10T06:26:34.262443+0000","last_became_peered":"2024-09-10T06:26:34.262443+0000","last_unstale":"2024-09-10T06:26:41.295519+0000","last_undegraded":"2024-09-10T06:26:41.295519+0000","last_fullsized":"2024-09-10T06:26:41.295519+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.918813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.212755+0000","last_change":"2024-09-10T06:26:36.292958+0000","last_active":"2024-09-10T06:26:42.212755+0000","last_peered":"2024-09-10T06:26:42.212755+0000","last_clean":"2024-09-10T06:26:42.212755+0000","last_became_active":"2024-09-10T06:26:36.292149+0000","last_became_peered":"2024-09-10T06:26:36.292149+0000","last_unstale":"2024-09-10T06:26:42.212755+0000","last_undegraded":"2024-09-10T06:26:42.212755+0000","last_fullsized":"2024-09-10T06:26:42.212755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316146+0000","last_change":"2024-09-10T06:26:38.302991+0000","last_active":"2024-09-10T06:26:41.316146+0000","last_peered":"2024-09-10T06:26:41.316146+0000","last_clean":"2024-09-10T06:26:41.316146+0000","last_became_active":"2024-09-10T06:26:38.289306+0000","last_became_peered":"2024-09-10T06:26:38.289306+0000","last_unstale":"2024-09-10T06:26:41.316146+0000","last_undegraded":"2024-09-10T06:26:41.316146+0000","last_fullsized":"2024-09-10T06:26:41.316146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:57.625329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.321564+0000","last_change":"2024-09-10T06:26:40.327627+0000","last_active":"2024-09-10T06:26:41.321564+0000","last_peered":"2024-09-10T06:26:41.321564+0000","last_clean":"2024-09-10T06:26:41.321564+0000","last_became_active":"2024-09-10T06:26:40.326888+0000","last_became_peered":"2024-09-10T06:26:40.326888+0000","last_unstale":"2024-09-10T06:26:41.321564+0000","last_undegraded":"2024-09-10T06:26:41.321564+0000","last_fullsized":"2024-09-10T06:26:41.321564+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:41.122562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298033+0000","last_change":"2024-09-10T06:26:32.275071+0000","last_active":"2024-09-10T06:26:41.298033+0000","last_peered":"2024-09-10T06:26:41.298033+0000","last_clean":"2024-09-10T06:26:41.298033+0000","last_became_active":"2024-09-10T06:26:32.274395+0000","last_became_peered":"2024-09-10T06:26:32.274395+0000","last_unstale":"2024-09-10T06:26:41.298033+0000","last_undegraded":"2024-09-10T06:26:41.298033+0000","last_fullsized":"2024-09-10T06:26:41.298033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:51.369493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329412+0000","last_change":"2024-09-10T06:26:30.594599+0000","last_active":"2024-09-10T06:26:41.329412+0000","last_peered":"2024-09-10T06:26:41.329412+0000","last_clean":"2024-09-10T06:26:41.329412+0000","last_became_active":"2024-09-10T06:26:30.594058+0000","last_became_peered":"2024-09-10T06:26:30.594058+0000","last_unstale":"2024-09-10T06:26:41.329412+0000","last_undegraded":"2024-09-10T06:26:41.329412+0000","last_fullsized":"2024-09-10T06:26:41.329412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:18.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316623+0000","last_change":"2024-09-10T06:26:34.279538+0000","last_active":"2024-09-10T06:26:41.316623+0000","last_peered":"2024-09-10T06:26:41.316623+0000","last_clean":"2024-09-10T06:26:41.316623+0000","last_became_active":"2024-09-10T06:26:34.278871+0000","last_became_peered":"2024-09-10T06:26:34.278871+0000","last_unstale":"2024-09-10T06:26:41.316623+0000","last_undegraded":"2024-09-10T06:26:41.316623+0000","last_fullsized":"2024-09-10T06:26:41.316623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:13.203357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'10","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.190937+0000","last_change":"2024-09-10T06:26:36.290976+0000","last_active":"2024-09-10T06:26:42.190937+0000","last_peered":"2024-09-10T06:26:42.190937+0000","last_clean":"2024-09-10T06:26:42.190937+0000","last_became_active":"2024-09-10T06:26:36.290265+0000","last_became_peered":"2024-09-10T06:26:36.290265+0000","last_unstale":"2024-09-10T06:26:42.190937+0000","last_undegraded":"2024-09-10T06:26:42.190937+0000","last_fullsized":"2024-09-10T06:26:42.190937+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327681+0000","last_change":"2024-09-10T06:26:38.292031+0000","last_active":"2024-09-10T06:26:41.327681+0000","last_peered":"2024-09-10T06:26:41.327681+0000","last_clean":"2024-09-10T06:26:41.327681+0000","last_became_active":"2024-09-10T06:26:38.288791+0000","last_became_peered":"2024-09-10T06:26:38.288791+0000","last_unstale":"2024-09-10T06:26:41.327681+0000","last_undegraded":"2024-09-10T06:26:41.327681+0000","last_fullsized":"2024-09-10T06:26:41.327681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:07.830355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.310765+0000","last_change":"2024-09-10T06:26:40.336448+0000","last_active":"2024-09-10T06:26:41.310765+0000","last_peered":"2024-09-10T06:26:41.310765+0000","last_clean":"2024-09-10T06:26:41.310765+0000","last_became_active":"2024-09-10T06:26:40.335771+0000","last_became_peered":"2024-09-10T06:26:40.335771+0000","last_unstale":"2024-09-10T06:26:41.310765+0000","last_undegraded":"2024-09-10T06:26:41.310765+0000","last_fullsized":"2024-09-10T06:26:41.310765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294185+0000","last_change":"2024-09-10T06:26:32.262176+0000","last_active":"2024-09-10T06:26:41.294185+0000","last_peered":"2024-09-10T06:26:41.294185+0000","last_clean":"2024-09-10T06:26:41.294185+0000","last_became_active":"2024-09-10T06:26:32.261250+0000","last_became_peered":"2024-09-10T06:26:32.261250+0000","last_unstale":"2024-09-10T06:26:41.294185+0000","last_undegraded":"2024-09-10T06:26:41.294185+0000","last_fullsized":"2024-09-10T06:26:41.294185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323961+0000","last_change":"2024-09-10T06:26:30.604587+0000","last_active":"2024-09-10T06:26:41.323961+0000","last_peered":"2024-09-10T06:26:41.323961+0000","last_clean":"2024-09-10T06:26:41.323961+0000","last_became_active":"2024-09-10T06:26:30.603175+0000","last_became_peered":"2024-09-10T06:26:30.603175+0000","last_unstale":"2024-09-10T06:26:41.323961+0000","last_undegraded":"2024-09-10T06:26:41.323961+0000","last_fullsized":"2024-09-10T06:26:41.323961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311194+0000","last_change":"2024-09-10T06:26:34.286028+0000","last_active":"2024-09-10T06:26:41.311194+0000","last_peered":"2024-09-10T06:26:41.311194+0000","last_clean":"2024-09-10T06:26:41.311194+0000","last_became_active":"2024-09-10T06:26:34.285169+0000","last_became_peered":"2024-09-10T06:26:34.285169+0000","last_unstale":"2024-09-10T06:26:41.311194+0000","last_undegraded":"2024-09-10T06:26:41.311194+0000","last_fullsized":"2024-09-10T06:26:41.311194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:24.146088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:42.226082+0000","last_change":"2024-09-10T06:26:36.292679+0000","last_active":"2024-09-10T06:26:42.226082+0000","last_peered":"2024-09-10T06:26:42.226082+0000","last_clean":"2024-09-10T06:26:42.226082+0000","last_became_active":"2024-09-10T06:26:36.288780+0000","last_became_peered":"2024-09-10T06:26:36.288780+0000","last_unstale":"2024-09-10T06:26:42.226082+0000","last_undegraded":"2024-09-10T06:26:42.226082+0000","last_fullsized":"2024-09-10T06:26:42.226082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327851+0000","last_change":"2024-09-10T06:26:38.293015+0000","last_active":"2024-09-10T06:26:41.327851+0000","last_peered":"2024-09-10T06:26:41.327851+0000","last_clean":"2024-09-10T06:26:41.327851+0000","last_became_active":"2024-09-10T06:26:38.292185+0000","last_became_peered":"2024-09-10T06:26:38.292185+0000","last_unstale":"2024-09-10T06:26:41.327851+0000","last_undegraded":"2024-09-10T06:26:41.327851+0000","last_fullsized":"2024-09-10T06:26:41.327851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:32.694777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313475+0000","last_change":"2024-09-10T06:26:40.336074+0000","last_active":"2024-09-10T06:26:41.313475+0000","last_peered":"2024-09-10T06:26:41.313475+0000","last_clean":"2024-09-10T06:26:41.313475+0000","last_became_active":"2024-09-10T06:26:40.335339+0000","last_became_peered":"2024-09-10T06:26:40.335339+0000","last_unstale":"2024-09-10T06:26:41.313475+0000","last_undegraded":"2024-09-10T06:26:41.313475+0000","last_fullsized":"2024-09-10T06:26:41.313475+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294322+0000","last_change":"2024-09-10T06:26:32.262823+0000","last_active":"2024-09-10T06:26:41.294322+0000","last_peered":"2024-09-10T06:26:41.294322+0000","last_clean":"2024-09-10T06:26:41.294322+0000","last_became_active":"2024-09-10T06:26:32.262041+0000","last_became_peered":"2024-09-10T06:26:32.262041+0000","last_unstale":"2024-09-10T06:26:41.294322+0000","last_undegraded":"2024-09-10T06:26:41.294322+0000","last_fullsized":"2024-09-10T06:26:41.294322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:48.768083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325116+0000","last_change":"2024-09-10T06:26:30.609104+0000","last_active":"2024-09-10T06:26:41.325116+0000","last_peered":"2024-09-10T06:26:41.325116+0000","last_clean":"2024-09-10T06:26:41.325116+0000","last_became_active":"2024-09-10T06:26:30.604546+0000","last_became_peered":"2024-09-10T06:26:30.604546+0000","last_unstale":"2024-09-10T06:26:41.325116+0000","last_undegraded":"2024-09-10T06:26:41.325116+0000","last_fullsized":"2024-09-10T06:26:41.325116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:35.326017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.322859+0000","last_change":"2024-09-10T06:26:34.282651+0000","last_active":"2024-09-10T06:26:41.322859+0000","last_peered":"2024-09-10T06:26:41.322859+0000","last_clean":"2024-09-10T06:26:41.322859+0000","last_became_active":"2024-09-10T06:26:34.281777+0000","last_became_peered":"2024-09-10T06:26:34.281777+0000","last_unstale":"2024-09-10T06:26:41.322859+0000","last_undegraded":"2024-09-10T06:26:41.322859+0000","last_fullsized":"2024-09-10T06:26:41.322859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:42.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.628411+0000","last_change":"2024-09-10T06:26:36.285192+0000","last_active":"2024-09-10T06:26:41.628411+0000","last_peered":"2024-09-10T06:26:41.628411+0000","last_clean":"2024-09-10T06:26:41.628411+0000","last_became_active":"2024-09-10T06:26:36.284470+0000","last_became_peered":"2024-09-10T06:26:36.284470+0000","last_unstale":"2024-09-10T06:26:41.628411+0000","last_undegraded":"2024-09-10T06:26:41.628411+0000","last_fullsized":"2024-09-10T06:26:41.628411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:44.280458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325893+0000","last_change":"2024-09-10T06:26:38.303425+0000","last_active":"2024-09-10T06:26:41.325893+0000","last_peered":"2024-09-10T06:26:41.325893+0000","last_clean":"2024-09-10T06:26:41.325893+0000","last_became_active":"2024-09-10T06:26:38.302606+0000","last_became_peered":"2024-09-10T06:26:38.302606+0000","last_unstale":"2024-09-10T06:26:41.325893+0000","last_undegraded":"2024-09-10T06:26:41.325893+0000","last_fullsized":"2024-09-10T06:26:41.325893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:14.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.296749+0000","last_change":"2024-09-10T06:26:40.311253+0000","last_active":"2024-09-10T06:26:41.296749+0000","last_peered":"2024-09-10T06:26:41.296749+0000","last_clean":"2024-09-10T06:26:41.296749+0000","last_became_active":"2024-09-10T06:26:40.310414+0000","last_became_peered":"2024-09-10T06:26:40.310414+0000","last_unstale":"2024-09-10T06:26:41.296749+0000","last_undegraded":"2024-09-10T06:26:41.296749+0000","last_fullsized":"2024-09-10T06:26:41.296749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:20.868195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294016+0000","last_change":"2024-09-10T06:26:32.262972+0000","last_active":"2024-09-10T06:26:41.294016+0000","last_peered":"2024-09-10T06:26:41.294016+0000","last_clean":"2024-09-10T06:26:41.294016+0000","last_became_active":"2024-09-10T06:26:32.262469+0000","last_became_peered":"2024-09-10T06:26:32.262469+0000","last_unstale":"2024-09-10T06:26:41.294016+0000","last_undegraded":"2024-09-10T06:26:41.294016+0000","last_fullsized":"2024-09-10T06:26:41.294016+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.297461+0000","last_change":"2024-09-10T06:26:30.602013+0000","last_active":"2024-09-10T06:26:41.297461+0000","last_peered":"2024-09-10T06:26:41.297461+0000","last_clean":"2024-09-10T06:26:41.297461+0000","last_became_active":"2024-09-10T06:26:30.601672+0000","last_became_peered":"2024-09-10T06:26:30.601672+0000","last_unstale":"2024-09-10T06:26:41.297461+0000","last_undegraded":"2024-09-10T06:26:41.297461+0000","last_fullsized":"2024-09-10T06:26:41.297461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:52.012063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.292604+0000","last_change":"2024-09-10T06:26:34.277010+0000","last_active":"2024-09-10T06:26:41.292604+0000","last_peered":"2024-09-10T06:26:41.292604+0000","last_clean":"2024-09-10T06:26:41.292604+0000","last_became_active":"2024-09-10T06:26:34.276197+0000","last_became_peered":"2024-09-10T06:26:34.276197+0000","last_unstale":"2024-09-10T06:26:41.292604+0000","last_undegraded":"2024-09-10T06:26:41.292604+0000","last_fullsized":"2024-09-10T06:26:41.292604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:32.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'5","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.855880+0000","last_change":"2024-09-10T06:26:36.297514+0000","last_active":"2024-09-10T06:26:41.855880+0000","last_peered":"2024-09-10T06:26:41.855880+0000","last_clean":"2024-09-10T06:26:41.855880+0000","last_became_active":"2024-09-10T06:26:36.296615+0000","last_became_peered":"2024-09-10T06:26:36.296615+0000","last_unstale":"2024-09-10T06:26:41.855880+0000","last_undegraded":"2024-09-10T06:26:41.855880+0000","last_fullsized":"2024-09-10T06:26:41.855880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293008+0000","last_change":"2024-09-10T06:26:38.288794+0000","last_active":"2024-09-10T06:26:41.293008+0000","last_peered":"2024-09-10T06:26:41.293008+0000","last_clean":"2024-09-10T06:26:41.293008+0000","last_became_active":"2024-09-10T06:26:38.288055+0000","last_became_peered":"2024-09-10T06:26:38.288055+0000","last_unstale":"2024-09-10T06:26:41.293008+0000","last_undegraded":"2024-09-10T06:26:41.293008+0000","last_fullsized":"2024-09-10T06:26:41.293008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.312860+0000","last_change":"2024-09-10T06:26:40.318067+0000","last_active":"2024-09-10T06:26:41.312860+0000","last_peered":"2024-09-10T06:26:41.312860+0000","last_clean":"2024-09-10T06:26:41.312860+0000","last_became_active":"2024-09-10T06:26:40.317244+0000","last_became_peered":"2024-09-10T06:26:40.317244+0000","last_unstale":"2024-09-10T06:26:41.312860+0000","last_undegraded":"2024-09-10T06:26:41.312860+0000","last_fullsized":"2024-09-10T06:26:41.312860+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293197+0000","last_change":"2024-09-10T06:26:32.277908+0000","last_active":"2024-09-10T06:26:41.293197+0000","last_peered":"2024-09-10T06:26:41.293197+0000","last_clean":"2024-09-10T06:26:41.293197+0000","last_became_active":"2024-09-10T06:26:32.274812+0000","last_became_peered":"2024-09-10T06:26:32.274812+0000","last_unstale":"2024-09-10T06:26:41.293197+0000","last_undegraded":"2024-09-10T06:26:41.293197+0000","last_fullsized":"2024-09-10T06:26:41.293197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:37.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331609+0000","last_change":"2024-09-10T06:26:30.594013+0000","last_active":"2024-09-10T06:26:41.331609+0000","last_peered":"2024-09-10T06:26:41.331609+0000","last_clean":"2024-09-10T06:26:41.331609+0000","last_became_active":"2024-09-10T06:26:30.593687+0000","last_became_peered":"2024-09-10T06:26:30.593687+0000","last_unstale":"2024-09-10T06:26:41.331609+0000","last_undegraded":"2024-09-10T06:26:41.331609+0000","last_fullsized":"2024-09-10T06:26:41.331609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:37.375037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.314524+0000","last_change":"2024-09-10T06:26:34.283392+0000","last_active":"2024-09-10T06:26:41.314524+0000","last_peered":"2024-09-10T06:26:41.314524+0000","last_clean":"2024-09-10T06:26:41.314524+0000","last_became_active":"2024-09-10T06:26:34.282931+0000","last_became_peered":"2024-09-10T06:26:34.282931+0000","last_unstale":"2024-09-10T06:26:41.314524+0000","last_undegraded":"2024-09-10T06:26:41.314524+0000","last_fullsized":"2024-09-10T06:26:41.314524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:01.310719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.920981+0000","last_change":"2024-09-10T06:26:36.289834+0000","last_active":"2024-09-10T06:26:41.920981+0000","last_peered":"2024-09-10T06:26:41.920981+0000","last_clean":"2024-09-10T06:26:41.920981+0000","last_became_active":"2024-09-10T06:26:36.289033+0000","last_became_peered":"2024-09-10T06:26:36.289033+0000","last_unstale":"2024-09-10T06:26:41.920981+0000","last_undegraded":"2024-09-10T06:26:41.920981+0000","last_fullsized":"2024-09-10T06:26:41.920981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328499+0000","last_change":"2024-09-10T06:26:38.299568+0000","last_active":"2024-09-10T06:26:41.328499+0000","last_peered":"2024-09-10T06:26:41.328499+0000","last_clean":"2024-09-10T06:26:41.328499+0000","last_became_active":"2024-09-10T06:26:38.298779+0000","last_became_peered":"2024-09-10T06:26:38.298779+0000","last_unstale":"2024-09-10T06:26:41.328499+0000","last_undegraded":"2024-09-10T06:26:41.328499+0000","last_fullsized":"2024-09-10T06:26:41.328499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295833+0000","last_change":"2024-09-10T06:26:40.336329+0000","last_active":"2024-09-10T06:26:41.295833+0000","last_peered":"2024-09-10T06:26:41.295833+0000","last_clean":"2024-09-10T06:26:41.295833+0000","last_became_active":"2024-09-10T06:26:40.335348+0000","last_became_peered":"2024-09-10T06:26:40.335348+0000","last_unstale":"2024-09-10T06:26:41.295833+0000","last_undegraded":"2024-09-10T06:26:41.295833+0000","last_fullsized":"2024-09-10T06:26:41.295833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:40.653642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316871+0000","last_change":"2024-09-10T06:26:32.276392+0000","last_active":"2024-09-10T06:26:41.316871+0000","last_peered":"2024-09-10T06:26:41.316871+0000","last_clean":"2024-09-10T06:26:41.316871+0000","last_became_active":"2024-09-10T06:26:32.275855+0000","last_became_peered":"2024-09-10T06:26:32.275855+0000","last_unstale":"2024-09-10T06:26:41.316871+0000","last_undegraded":"2024-09-10T06:26:41.316871+0000","last_fullsized":"2024-09-10T06:26:41.316871+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:34.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325634+0000","last_change":"2024-09-10T06:26:30.591577+0000","last_active":"2024-09-10T06:26:41.325634+0000","last_peered":"2024-09-10T06:26:41.325634+0000","last_clean":"2024-09-10T06:26:41.325634+0000","last_became_active":"2024-09-10T06:26:30.590801+0000","last_became_peered":"2024-09-10T06:26:30.590801+0000","last_unstale":"2024-09-10T06:26:41.325634+0000","last_undegraded":"2024-09-10T06:26:41.325634+0000","last_fullsized":"2024-09-10T06:26:41.325634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:16.066664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.316453+0000","last_change":"2024-09-10T06:26:32.268621+0000","last_active":"2024-09-10T06:26:41.316453+0000","last_peered":"2024-09-10T06:26:41.316453+0000","last_clean":"2024-09-10T06:26:41.316453+0000","last_became_active":"2024-09-10T06:26:32.267915+0000","last_became_peered":"2024-09-10T06:26:32.267915+0000","last_unstale":"2024-09-10T06:26:41.316453+0000","last_undegraded":"2024-09-10T06:26:41.316453+0000","last_fullsized":"2024-09-10T06:26:41.316453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:10.670492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.292642+0000","last_change":"2024-09-10T06:26:30.593794+0000","last_active":"2024-09-10T06:26:41.292642+0000","last_peered":"2024-09-10T06:26:41.292642+0000","last_clean":"2024-09-10T06:26:41.292642+0000","last_became_active":"2024-09-10T06:26:30.593506+0000","last_became_peered":"2024-09-10T06:26:30.593506+0000","last_unstale":"2024-09-10T06:26:41.292642+0000","last_undegraded":"2024-09-10T06:26:41.292642+0000","last_fullsized":"2024-09-10T06:26:41.292642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:29.521578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.324746+0000","last_change":"2024-09-10T06:26:32.288497+0000","last_active":"2024-09-10T06:26:41.324746+0000","last_peered":"2024-09-10T06:26:41.324746+0000","last_clean":"2024-09-10T06:26:41.324746+0000","last_became_active":"2024-09-10T06:26:32.287839+0000","last_became_peered":"2024-09-10T06:26:32.287839+0000","last_unstale":"2024-09-10T06:26:41.324746+0000","last_undegraded":"2024-09-10T06:26:41.324746+0000","last_fullsized":"2024-09-10T06:26:41.324746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323153+0000","last_change":"2024-09-10T06:26:30.610172+0000","last_active":"2024-09-10T06:26:41.323153+0000","last_peered":"2024-09-10T06:26:41.323153+0000","last_clean":"2024-09-10T06:26:41.323153+0000","last_became_active":"2024-09-10T06:26:30.602685+0000","last_became_peered":"2024-09-10T06:26:30.602685+0000","last_unstale":"2024-09-10T06:26:41.323153+0000","last_undegraded":"2024-09-10T06:26:41.323153+0000","last_fullsized":"2024-09-10T06:26:41.323153+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:35.705564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315994+0000","last_change":"2024-09-10T06:26:32.272921+0000","last_active":"2024-09-10T06:26:41.315994+0000","last_peered":"2024-09-10T06:26:41.315994+0000","last_clean":"2024-09-10T06:26:41.315994+0000","last_became_active":"2024-09-10T06:26:32.272279+0000","last_became_peered":"2024-09-10T06:26:32.272279+0000","last_unstale":"2024-09-10T06:26:41.315994+0000","last_undegraded":"2024-09-10T06:26:41.315994+0000","last_fullsized":"2024-09-10T06:26:41.315994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:11.951551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.329920+0000","last_change":"2024-09-10T06:26:30.579541+0000","last_active":"2024-09-10T06:26:41.329920+0000","last_peered":"2024-09-10T06:26:41.329920+0000","last_clean":"2024-09-10T06:26:41.329920+0000","last_became_active":"2024-09-10T06:26:30.579189+0000","last_became_peered":"2024-09-10T06:26:30.579189+0000","last_unstale":"2024-09-10T06:26:41.329920+0000","last_undegraded":"2024-09-10T06:26:41.329920+0000","last_fullsized":"2024-09-10T06:26:41.329920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:18.099885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295255+0000","last_change":"2024-09-10T06:26:32.260098+0000","last_active":"2024-09-10T06:26:41.295255+0000","last_peered":"2024-09-10T06:26:41.295255+0000","last_clean":"2024-09-10T06:26:41.295255+0000","last_became_active":"2024-09-10T06:26:32.259644+0000","last_became_peered":"2024-09-10T06:26:32.259644+0000","last_unstale":"2024-09-10T06:26:41.295255+0000","last_undegraded":"2024-09-10T06:26:41.295255+0000","last_fullsized":"2024-09-10T06:26:41.295255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.297454+0000","last_change":"2024-09-10T06:26:30.576146+0000","last_active":"2024-09-10T06:26:41.297454+0000","last_peered":"2024-09-10T06:26:41.297454+0000","last_clean":"2024-09-10T06:26:41.297454+0000","last_became_active":"2024-09-10T06:26:30.575605+0000","last_became_peered":"2024-09-10T06:26:30.575605+0000","last_unstale":"2024-09-10T06:26:41.297454+0000","last_undegraded":"2024-09-10T06:26:41.297454+0000","last_fullsized":"2024-09-10T06:26:41.297454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294437+0000","last_change":"2024-09-10T06:26:32.277577+0000","last_active":"2024-09-10T06:26:41.294437+0000","last_peered":"2024-09-10T06:26:41.294437+0000","last_clean":"2024-09-10T06:26:41.294437+0000","last_became_active":"2024-09-10T06:26:32.272454+0000","last_became_peered":"2024-09-10T06:26:32.272454+0000","last_unstale":"2024-09-10T06:26:41.294437+0000","last_undegraded":"2024-09-10T06:26:41.294437+0000","last_fullsized":"2024-09-10T06:26:41.294437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.317102+0000","last_change":"2024-09-10T06:26:30.579134+0000","last_active":"2024-09-10T06:26:41.317102+0000","last_peered":"2024-09-10T06:26:41.317102+0000","last_clean":"2024-09-10T06:26:41.317102+0000","last_became_active":"2024-09-10T06:26:30.578732+0000","last_became_peered":"2024-09-10T06:26:30.578732+0000","last_unstale":"2024-09-10T06:26:41.317102+0000","last_undegraded":"2024-09-10T06:26:41.317102+0000","last_fullsized":"2024-09-10T06:26:41.317102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:08.832907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293379+0000","last_change":"2024-09-10T06:26:32.270804+0000","last_active":"2024-09-10T06:26:41.293379+0000","last_peered":"2024-09-10T06:26:41.293379+0000","last_clean":"2024-09-10T06:26:41.293379+0000","last_became_active":"2024-09-10T06:26:32.270327+0000","last_became_peered":"2024-09-10T06:26:32.270327+0000","last_unstale":"2024-09-10T06:26:41.293379+0000","last_undegraded":"2024-09-10T06:26:41.293379+0000","last_fullsized":"2024-09-10T06:26:41.293379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327759+0000","last_change":"2024-09-10T06:26:30.598004+0000","last_active":"2024-09-10T06:26:41.327759+0000","last_peered":"2024-09-10T06:26:41.327759+0000","last_clean":"2024-09-10T06:26:41.327759+0000","last_became_active":"2024-09-10T06:26:30.596254+0000","last_became_peered":"2024-09-10T06:26:30.596254+0000","last_unstale":"2024-09-10T06:26:41.327759+0000","last_undegraded":"2024-09-10T06:26:41.327759+0000","last_fullsized":"2024-09-10T06:26:41.327759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325553+0000","last_change":"2024-09-10T06:26:32.284215+0000","last_active":"2024-09-10T06:26:41.325553+0000","last_peered":"2024-09-10T06:26:41.325553+0000","last_clean":"2024-09-10T06:26:41.325553+0000","last_became_active":"2024-09-10T06:26:32.275133+0000","last_became_peered":"2024-09-10T06:26:32.275133+0000","last_unstale":"2024-09-10T06:26:41.325553+0000","last_undegraded":"2024-09-10T06:26:41.325553+0000","last_fullsized":"2024-09-10T06:26:41.325553+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:37.703268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298799+0000","last_change":"2024-09-10T06:26:30.580586+0000","last_active":"2024-09-10T06:26:41.298799+0000","last_peered":"2024-09-10T06:26:41.298799+0000","last_clean":"2024-09-10T06:26:41.298799+0000","last_became_active":"2024-09-10T06:26:30.580134+0000","last_became_peered":"2024-09-10T06:26:30.580134+0000","last_unstale":"2024-09-10T06:26:41.298799+0000","last_undegraded":"2024-09-10T06:26:41.298799+0000","last_fullsized":"2024-09-10T06:26:41.298799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331373+0000","last_change":"2024-09-10T06:26:32.256538+0000","last_active":"2024-09-10T06:26:41.331373+0000","last_peered":"2024-09-10T06:26:41.331373+0000","last_clean":"2024-09-10T06:26:41.331373+0000","last_became_active":"2024-09-10T06:26:32.256052+0000","last_became_peered":"2024-09-10T06:26:32.256052+0000","last_unstale":"2024-09-10T06:26:41.331373+0000","last_undegraded":"2024-09-10T06:26:41.331373+0000","last_fullsized":"2024-09-10T06:26:41.331373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:14.620472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.322062+0000","last_change":"2024-09-10T06:26:30.585220+0000","last_active":"2024-09-10T06:26:41.322062+0000","last_peered":"2024-09-10T06:26:41.322062+0000","last_clean":"2024-09-10T06:26:41.322062+0000","last_became_active":"2024-09-10T06:26:30.584443+0000","last_became_peered":"2024-09-10T06:26:30.584443+0000","last_unstale":"2024-09-10T06:26:41.322062+0000","last_undegraded":"2024-09-10T06:26:41.322062+0000","last_fullsized":"2024-09-10T06:26:41.322062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295560+0000","last_change":"2024-09-10T06:26:32.259306+0000","last_active":"2024-09-10T06:26:41.295560+0000","last_peered":"2024-09-10T06:26:41.295560+0000","last_clean":"2024-09-10T06:26:41.295560+0000","last_became_active":"2024-09-10T06:26:32.258513+0000","last_became_peered":"2024-09-10T06:26:32.258513+0000","last_unstale":"2024-09-10T06:26:41.295560+0000","last_undegraded":"2024-09-10T06:26:41.295560+0000","last_fullsized":"2024-09-10T06:26:41.295560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.294236+0000","last_change":"2024-09-10T06:26:30.581285+0000","last_active":"2024-09-10T06:26:41.294236+0000","last_peered":"2024-09-10T06:26:41.294236+0000","last_clean":"2024-09-10T06:26:41.294236+0000","last_became_active":"2024-09-10T06:26:30.580913+0000","last_became_peered":"2024-09-10T06:26:30.580913+0000","last_unstale":"2024-09-10T06:26:41.294236+0000","last_undegraded":"2024-09-10T06:26:41.294236+0000","last_fullsized":"2024-09-10T06:26:41.294236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.298301+0000","last_change":"2024-09-10T06:26:32.274773+0000","last_active":"2024-09-10T06:26:41.298301+0000","last_peered":"2024-09-10T06:26:41.298301+0000","last_clean":"2024-09-10T06:26:41.298301+0000","last_became_active":"2024-09-10T06:26:32.274327+0000","last_became_peered":"2024-09-10T06:26:32.274327+0000","last_unstale":"2024-09-10T06:26:41.298301+0000","last_undegraded":"2024-09-10T06:26:41.298301+0000","last_fullsized":"2024-09-10T06:26:41.298301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:54.026434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.322980+0000","last_change":"2024-09-10T06:26:30.614052+0000","last_active":"2024-09-10T06:26:41.322980+0000","last_peered":"2024-09-10T06:26:41.322980+0000","last_clean":"2024-09-10T06:26:41.322980+0000","last_became_active":"2024-09-10T06:26:30.608992+0000","last_became_peered":"2024-09-10T06:26:30.608992+0000","last_unstale":"2024-09-10T06:26:41.322980+0000","last_undegraded":"2024-09-10T06:26:41.322980+0000","last_fullsized":"2024-09-10T06:26:41.322980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:49.865234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.295267+0000","last_change":"2024-09-10T06:26:32.279474+0000","last_active":"2024-09-10T06:26:41.295267+0000","last_peered":"2024-09-10T06:26:41.295267+0000","last_clean":"2024-09-10T06:26:41.295267+0000","last_became_active":"2024-09-10T06:26:32.278461+0000","last_became_peered":"2024-09-10T06:26:32.278461+0000","last_unstale":"2024-09-10T06:26:41.295267+0000","last_undegraded":"2024-09-10T06:26:41.295267+0000","last_fullsized":"2024-09-10T06:26:41.295267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.330098+0000","last_change":"2024-09-10T06:26:30.605519+0000","last_active":"2024-09-10T06:26:41.330098+0000","last_peered":"2024-09-10T06:26:41.330098+0000","last_clean":"2024-09-10T06:26:41.330098+0000","last_became_active":"2024-09-10T06:26:30.605225+0000","last_became_peered":"2024-09-10T06:26:30.605225+0000","last_unstale":"2024-09-10T06:26:41.330098+0000","last_undegraded":"2024-09-10T06:26:41.330098+0000","last_fullsized":"2024-09-10T06:26:41.330098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311968+0000","last_change":"2024-09-10T06:26:32.267201+0000","last_active":"2024-09-10T06:26:41.311968+0000","last_peered":"2024-09-10T06:26:41.311968+0000","last_clean":"2024-09-10T06:26:41.311968+0000","last_became_active":"2024-09-10T06:26:32.266234+0000","last_became_peered":"2024-09-10T06:26:32.266234+0000","last_unstale":"2024-09-10T06:26:41.311968+0000","last_undegraded":"2024-09-10T06:26:41.311968+0000","last_fullsized":"2024-09-10T06:26:41.311968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.327215+0000","last_change":"2024-09-10T06:26:30.596647+0000","last_active":"2024-09-10T06:26:41.327215+0000","last_peered":"2024-09-10T06:26:41.327215+0000","last_clean":"2024-09-10T06:26:41.327215+0000","last_became_active":"2024-09-10T06:26:30.593598+0000","last_became_peered":"2024-09-10T06:26:30.593598+0000","last_unstale":"2024-09-10T06:26:41.327215+0000","last_undegraded":"2024-09-10T06:26:41.327215+0000","last_fullsized":"2024-09-10T06:26:41.327215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.328490+0000","last_change":"2024-09-10T06:26:32.278317+0000","last_active":"2024-09-10T06:26:41.328490+0000","last_peered":"2024-09-10T06:26:41.328490+0000","last_clean":"2024-09-10T06:26:41.328490+0000","last_became_active":"2024-09-10T06:26:32.278032+0000","last_became_peered":"2024-09-10T06:26:32.278032+0000","last_unstale":"2024-09-10T06:26:41.328490+0000","last_undegraded":"2024-09-10T06:26:41.328490+0000","last_fullsized":"2024-09-10T06:26:41.328490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:00.200118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.313590+0000","last_change":"2024-09-10T06:26:30.580552+0000","last_active":"2024-09-10T06:26:41.313590+0000","last_peered":"2024-09-10T06:26:41.313590+0000","last_clean":"2024-09-10T06:26:41.313590+0000","last_became_active":"2024-09-10T06:26:30.579319+0000","last_became_peered":"2024-09-10T06:26:30.579319+0000","last_unstale":"2024-09-10T06:26:41.313590+0000","last_undegraded":"2024-09-10T06:26:41.313590+0000","last_fullsized":"2024-09-10T06:26:41.313590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:59.885311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.293379+0000","last_change":"2024-09-10T06:26:32.257601+0000","last_active":"2024-09-10T06:26:41.293379+0000","last_peered":"2024-09-10T06:26:41.293379+0000","last_clean":"2024-09-10T06:26:41.293379+0000","last_became_active":"2024-09-10T06:26:32.256851+0000","last_became_peered":"2024-09-10T06:26:32.256851+0000","last_unstale":"2024-09-10T06:26:41.293379+0000","last_undegraded":"2024-09-10T06:26:41.293379+0000","last_fullsized":"2024-09-10T06:26:41.293379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.299399+0000","last_change":"2024-09-10T06:26:30.601996+0000","last_active":"2024-09-10T06:26:41.299399+0000","last_peered":"2024-09-10T06:26:41.299399+0000","last_clean":"2024-09-10T06:26:41.299399+0000","last_became_active":"2024-09-10T06:26:30.601686+0000","last_became_peered":"2024-09-10T06:26:30.601686+0000","last_unstale":"2024-09-10T06:26:41.299399+0000","last_undegraded":"2024-09-10T06:26:41.299399+0000","last_fullsized":"2024-09-10T06:26:41.299399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:11.953454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.311286+0000","last_change":"2024-09-10T06:26:32.266768+0000","last_active":"2024-09-10T06:26:41.311286+0000","last_peered":"2024-09-10T06:26:41.311286+0000","last_clean":"2024-09-10T06:26:41.311286+0000","last_became_active":"2024-09-10T06:26:32.266000+0000","last_became_peered":"2024-09-10T06:26:32.266000+0000","last_unstale":"2024-09-10T06:26:41.311286+0000","last_undegraded":"2024-09-10T06:26:41.311286+0000","last_fullsized":"2024-09-10T06:26:41.311286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.325331+0000","last_change":"2024-09-10T06:26:30.610309+0000","last_active":"2024-09-10T06:26:41.325331+0000","last_peered":"2024-09-10T06:26:41.325331+0000","last_clean":"2024-09-10T06:26:41.325331+0000","last_became_active":"2024-09-10T06:26:30.609674+0000","last_became_peered":"2024-09-10T06:26:30.609674+0000","last_unstale":"2024-09-10T06:26:41.325331+0000","last_undegraded":"2024-09-10T06:26:41.325331+0000","last_fullsized":"2024-09-10T06:26:41.325331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.321785+0000","last_change":"2024-09-10T06:26:30.591365+0000","last_active":"2024-09-10T06:26:41.321785+0000","last_peered":"2024-09-10T06:26:41.321785+0000","last_clean":"2024-09-10T06:26:41.321785+0000","last_became_active":"2024-09-10T06:26:30.590640+0000","last_became_peered":"2024-09-10T06:26:30.590640+0000","last_unstale":"2024-09-10T06:26:41.321785+0000","last_undegraded":"2024-09-10T06:26:41.321785+0000","last_fullsized":"2024-09-10T06:26:41.321785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.331291+0000","last_change":"2024-09-10T06:26:32.267333+0000","last_active":"2024-09-10T06:26:41.331291+0000","last_peered":"2024-09-10T06:26:41.331291+0000","last_clean":"2024-09-10T06:26:41.331291+0000","last_became_active":"2024-09-10T06:26:32.266876+0000","last_became_peered":"2024-09-10T06:26:32.266876+0000","last_unstale":"2024-09-10T06:26:41.331291+0000","last_undegraded":"2024-09-10T06:26:41.331291+0000","last_fullsized":"2024-09-10T06:26:41.331291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:02.483639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.315323+0000","last_change":"2024-09-10T06:26:30.590924+0000","last_active":"2024-09-10T06:26:41.315323+0000","last_peered":"2024-09-10T06:26:41.315323+0000","last_clean":"2024-09-10T06:26:41.315323+0000","last_became_active":"2024-09-10T06:26:30.590415+0000","last_became_peered":"2024-09-10T06:26:30.590415+0000","last_unstale":"2024-09-10T06:26:41.315323+0000","last_undegraded":"2024-09-10T06:26:41.315323+0000","last_fullsized":"2024-09-10T06:26:41.315323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:32.460291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-10T06:26:41.323926+0000","last_change":"2024-09-10T06:26:32.283339+0000","last_active":"2024-09-10T06:26:41.323926+0000","last_peered":"2024-09-10T06:26:41.323926+0000","last_clean":"2024-09-10T06:26:41.323926+0000","last_became_active":"2024-09-10T06:26:32.282581+0000","last_became_peered":"2024-09-10T06:26:32.282581+0000","last_unstale":"2024-09-10T06:26:41.323926+0000","last_undegraded":"2024-09-10T06:26:41.323926+0000","last_fullsized":"2024-09-10T06:26:41.323926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1019904,"data_stored":758879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":405504,"data_stored":168844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":168698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":393216,"data_stored":168342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":168683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":389120,"data_stored":167413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":421888,"data_stored":168120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1003520,"data_stored":758721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:26:48.742 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T06:26:48.742 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-10T06:26:49.070 INFO:teuthology.orchestra.run.smithi112.stdout:epoch 34 2024-09-10T06:26:49.070 INFO:teuthology.orchestra.run.smithi112.stdout:fsid be773357-a22c-4a27-af42-3fbac58c722b 2024-09-10T06:26:49.070 INFO:teuthology.orchestra.run.smithi112.stdout:created 2024-09-10T06:26:02.514361+0000 2024-09-10T06:26:49.070 INFO:teuthology.orchestra.run.smithi112.stdout:modified 2024-09-10T06:26:41.284715+0000 2024-09-10T06:26:49.071 INFO:teuthology.orchestra.run.smithi112.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T06:26:49.071 INFO:teuthology.orchestra.run.smithi112.stdout:crush_version 5 2024-09-10T06:26:49.071 INFO:teuthology.orchestra.run.smithi112.stdout:full_ratio 0.95 2024-09-10T06:26:49.071 INFO:teuthology.orchestra.run.smithi112.stdout:backfillfull_ratio 0.9 2024-09-10T06:26:49.071 INFO:teuthology.orchestra.run.smithi112.stdout:nearfull_ratio 0.85 2024-09-10T06:26:49.071 INFO:teuthology.orchestra.run.smithi112.stdout:require_min_compat_client luminous 2024-09-10T06:26:49.071 INFO:teuthology.orchestra.run.smithi112.stdout:min_compat_client jewel 2024-09-10T06:26:49.071 INFO:teuthology.orchestra.run.smithi112.stdout:require_osd_release squid 2024-09-10T06:26:49.071 INFO:teuthology.orchestra.run.smithi112.stdout:stretch_mode_enabled false 2024-09-10T06:26:49.071 INFO:teuthology.orchestra.run.smithi112.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-10T06:26:49.071 INFO:teuthology.orchestra.run.smithi112.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 21 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-10T06:26:49.071 INFO:teuthology.orchestra.run.smithi112.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 24 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-09-10T06:26:49.071 INFO:teuthology.orchestra.run.smithi112.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 26 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-09-10T06:26:49.072 INFO:teuthology.orchestra.run.smithi112.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 28 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-09-10T06:26:49.072 INFO:teuthology.orchestra.run.smithi112.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 30 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-09-10T06:26:49.072 INFO:teuthology.orchestra.run.smithi112.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 32 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-09-10T06:26:49.072 INFO:teuthology.orchestra.run.smithi112.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 34 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-09-10T06:26:49.072 INFO:teuthology.orchestra.run.smithi112.stdout:max_osd 8 2024-09-10T06:26:49.072 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6816/1694936705,v1:172.21.15.112:6817/1694936705] [v2:172.21.15.112:6818/1694936705,v1:172.21.15.112:6819/1694936705] exists,up 27b822ad-8298-4dd0-be44-f898fd6b155b 2024-09-10T06:26:49.072 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6824/3700063340,v1:172.21.15.112:6825/3700063340] [v2:172.21.15.112:6826/3700063340,v1:172.21.15.112:6827/3700063340] exists,up 68108054-a914-4f7c-a6dd-1e8a2775cff0 2024-09-10T06:26:49.072 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2 up in weight 1 up_from 14 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6808/3923792425,v1:172.21.15.112:6809/3923792425] [v2:172.21.15.112:6810/3923792425,v1:172.21.15.112:6811/3923792425] exists,up 0b12ab6c-743b-446a-92de-3d7722320117 2024-09-10T06:26:49.072 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6800/3428884615,v1:172.21.15.112:6801/3428884615] [v2:172.21.15.112:6802/3428884615,v1:172.21.15.112:6803/3428884615] exists,up a468aa3a-22fb-414c-9e7c-fbe79ae3eafd 2024-09-10T06:26:49.072 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6808/4200633864,v1:172.21.15.120:6809/4200633864] [v2:172.21.15.120:6810/4200633864,v1:172.21.15.120:6811/4200633864] exists,up e64b5d77-9d7c-4d5f-8ad6-91d3e77d5479 2024-09-10T06:26:49.072 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6800/1878513652,v1:172.21.15.120:6801/1878513652] [v2:172.21.15.120:6802/1878513652,v1:172.21.15.120:6803/1878513652] exists,up bdcce7db-9a36-423b-9a96-368a4a6b6270 2024-09-10T06:26:49.072 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6816/663776414,v1:172.21.15.120:6817/663776414] [v2:172.21.15.120:6818/663776414,v1:172.21.15.120:6819/663776414] exists,up 8eedb98d-014b-4f07-a704-a4b01e8002cb 2024-09-10T06:26:49.073 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6824/4213847863,v1:172.21.15.120:6825/4213847863] [v2:172.21.15.120:6826/4213847863,v1:172.21.15.120:6827/4213847863] exists,up 72eece21-94cd-4ed1-9f02-4d2d1edaf136 2024-09-10T06:26:49.088 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6816/1694936705,v1:172.21.15.112:6817/1694936705] [v2:172.21.15.112:6818/1694936705,v1:172.21.15.112:6819/1694936705] exists,up 27b822ad-8298-4dd0-be44-f898fd6b155b', 'osd.1 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6824/3700063340,v1:172.21.15.112:6825/3700063340] [v2:172.21.15.112:6826/3700063340,v1:172.21.15.112:6827/3700063340] exists,up 68108054-a914-4f7c-a6dd-1e8a2775cff0', 'osd.2 up in weight 1 up_from 14 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6808/3923792425,v1:172.21.15.112:6809/3923792425] [v2:172.21.15.112:6810/3923792425,v1:172.21.15.112:6811/3923792425] exists,up 0b12ab6c-743b-446a-92de-3d7722320117', 'osd.3 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.112:6800/3428884615,v1:172.21.15.112:6801/3428884615] [v2:172.21.15.112:6802/3428884615,v1:172.21.15.112:6803/3428884615] exists,up a468aa3a-22fb-414c-9e7c-fbe79ae3eafd', 'osd.4 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6808/4200633864,v1:172.21.15.120:6809/4200633864] [v2:172.21.15.120:6810/4200633864,v1:172.21.15.120:6811/4200633864] exists,up e64b5d77-9d7c-4d5f-8ad6-91d3e77d5479', 'osd.5 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6800/1878513652,v1:172.21.15.120:6801/1878513652] [v2:172.21.15.120:6802/1878513652,v1:172.21.15.120:6803/1878513652] exists,up bdcce7db-9a36-423b-9a96-368a4a6b6270', 'osd.6 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6816/663776414,v1:172.21.15.120:6817/663776414] [v2:172.21.15.120:6818/663776414,v1:172.21.15.120:6819/663776414] exists,up 8eedb98d-014b-4f07-a704-a4b01e8002cb', 'osd.7 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6824/4213847863,v1:172.21.15.120:6825/4213847863] [v2:172.21.15.120:6826/4213847863,v1:172.21.15.120:6827/4213847863] exists,up 72eece21-94cd-4ed1-9f02-4d2d1edaf136'] 2024-09-10T06:26:49.089 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-10T06:26:49.191 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:26:49.191 INFO:teuthology.orchestra.run.smithi112.stdout: "name": "mon.a", 2024-09-10T06:26:49.191 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster": "ceph", 2024-09-10T06:26:49.191 INFO:teuthology.orchestra.run.smithi112.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-10T06:26:49.191 INFO:teuthology.orchestra.run.smithi112.stdout: "admin_socket_mode": "", 2024-09-10T06:26:49.192 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-10T06:26:49.192 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_client_required": "cephx, none", 2024-09-10T06:26:49.192 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_cluster_required": "cephx", 2024-09-10T06:26:49.192 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_debug": "true", 2024-09-10T06:26:49.192 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-10T06:26:49.192 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-10T06:26:49.193 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_service_required": "cephx", 2024-09-10T06:26:49.193 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-10T06:26:49.193 INFO:teuthology.orchestra.run.smithi112.stdout: "auth_supported": "cephx", 2024-09-10T06:26:49.193 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_aio": "true", 2024-09-10T06:26:49.193 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-10T06:26:49.194 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_aio_poll_ms": "250", 2024-09-10T06:26:49.194 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_aio_reap_max": "16", 2024-09-10T06:26:49.194 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_async_discard_threads": "0", 2024-09-10T06:26:49.194 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_block_size": "4096", 2024-09-10T06:26:49.194 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_debug_aio": "false", 2024-09-10T06:26:49.194 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-10T06:26:49.195 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-10T06:26:49.195 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_debug_inflight_ios": "false", 2024-09-10T06:26:49.195 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_enable_discard": "false", 2024-09-10T06:26:49.195 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_flock_retry": "3", 2024-09-10T06:26:49.195 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-10T06:26:49.195 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_inject_crash": "0", 2024-09-10T06:26:49.196 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-10T06:26:49.196 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_ioring": "false", 2024-09-10T06:26:49.196 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_ioring_hipri": "false", 2024-09-10T06:26:49.196 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-10T06:26:49.196 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-10T06:26:49.197 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-10T06:26:49.197 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-10T06:26:49.197 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-10T06:26:49.197 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-10T06:26:49.197 INFO:teuthology.orchestra.run.smithi112.stdout: "bdev_type": "", 2024-09-10T06:26:49.198 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_alloc_size": "1048576", 2024-09-10T06:26:49.198 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_allocator": "hybrid", 2024-09-10T06:26:49.198 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_buffered_io": "true", 2024-09-10T06:26:49.198 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_check_for_zeros": "false", 2024-09-10T06:26:49.198 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-10T06:26:49.198 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-10T06:26:49.199 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_compact_log_sync": "false", 2024-09-10T06:26:49.199 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-10T06:26:49.199 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-10T06:26:49.199 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-10T06:26:49.199 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-10T06:26:49.200 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_max_log_runway": "4194304", 2024-09-10T06:26:49.200 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_max_prefetch": "1048576", 2024-09-10T06:26:49.200 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_min_flush_size": "524288", 2024-09-10T06:26:49.200 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_min_log_runway": "1048576", 2024-09-10T06:26:49.200 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_replay_recovery": "false", 2024-09-10T06:26:49.200 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-10T06:26:49.201 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-10T06:26:49.201 INFO:teuthology.orchestra.run.smithi112.stdout: "bluefs_sync_write": "false", 2024-09-10T06:26:49.201 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-10T06:26:49.201 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-10T06:26:49.201 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-10T06:26:49.202 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_allocation_from_file": "true", 2024-09-10T06:26:49.202 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_allocator": "hybrid", 2024-09-10T06:26:49.202 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_async_db_compaction": "true", 2024-09-10T06:26:49.202 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-10T06:26:49.202 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-10T06:26:49.202 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-10T06:26:49.203 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-10T06:26:49.203 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bdev_label_multi": "true", 2024-09-10T06:26:49.203 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-10T06:26:49.203 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-10T06:26:49.203 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-10T06:26:49.203 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-10T06:26:49.204 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-10T06:26:49.204 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_create": "true", 2024-09-10T06:26:49.204 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_db_create": "false", 2024-09-10T06:26:49.204 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_db_path": "", 2024-09-10T06:26:49.204 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_db_size": "0", 2024-09-10T06:26:49.204 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_path": "", 2024-09-10T06:26:49.204 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_preallocate_file": "false", 2024-09-10T06:26:49.205 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_size": "107374182400", 2024-09-10T06:26:49.205 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_wal_create": "false", 2024-09-10T06:26:49.205 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_wal_path": "", 2024-09-10T06:26:49.205 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_block_wal_size": "100663296", 2024-09-10T06:26:49.205 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bluefs": "true", 2024-09-10T06:26:49.205 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-10T06:26:49.205 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-10T06:26:49.205 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-10T06:26:49.206 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-10T06:26:49.206 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-10T06:26:49.206 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-10T06:26:49.206 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-10T06:26:49.206 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-10T06:26:49.206 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-10T06:26:49.206 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_autotune": "true", 2024-09-10T06:26:49.207 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-10T06:26:49.207 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-10T06:26:49.207 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-10T06:26:49.207 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-10T06:26:49.207 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_size": "0", 2024-09-10T06:26:49.207 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-10T06:26:49.207 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-10T06:26:49.207 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-10T06:26:49.208 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-10T06:26:49.208 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cache_type": "2q", 2024-09-10T06:26:49.208 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-10T06:26:49.208 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_clone_cow": "true", 2024-09-10T06:26:49.208 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-10T06:26:49.208 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-10T06:26:49.208 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-10T06:26:49.208 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-10T06:26:49.208 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-10T06:26:49.208 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-10T06:26:49.209 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-10T06:26:49.209 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_mode": "none", 2024-09-10T06:26:49.209 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-10T06:26:49.209 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_csum_type": "crc32c", 2024-09-10T06:26:49.209 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-10T06:26:49.209 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-10T06:26:49.209 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_freelist": "false", 2024-09-10T06:26:49.209 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-10T06:26:49.209 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-10T06:26:49.209 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-10T06:26:49.209 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-10T06:26:49.209 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-10T06:26:49.209 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-10T06:26:49.210 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-10T06:26:49.210 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-10T06:26:49.210 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-10T06:26:49.210 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-10T06:26:49.210 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-10T06:26:49.210 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-10T06:26:49.210 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_small_allocations": "0", 2024-09-10T06:26:49.210 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-10T06:26:49.210 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_default_buffered_read": "true", 2024-09-10T06:26:49.210 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_default_buffered_write": "false", 2024-09-10T06:26:49.210 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-10T06:26:49.210 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-10T06:26:49.210 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-10T06:26:49.211 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-10T06:26:49.211 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-10T06:26:49.211 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-10T06:26:49.211 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-10T06:26:49.211 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-10T06:26:49.211 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-10T06:26:49.211 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fail_eio": "false", 2024-09-10T06:26:49.211 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-10T06:26:49.211 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-10T06:26:49.211 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-10T06:26:49.211 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-10T06:26:49.211 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-10T06:26:49.211 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-10T06:26:49.212 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_on_mount": "false", 2024-09-10T06:26:49.212 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-10T06:26:49.212 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_on_umount": "false", 2024-09-10T06:26:49.212 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-10T06:26:49.212 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-10T06:26:49.212 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-10T06:26:49.212 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-10T06:26:49.212 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-10T06:26:49.212 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-10T06:26:49.212 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-10T06:26:49.212 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-10T06:26:49.212 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_ignore_data_csum": "false", 2024-09-10T06:26:49.212 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-10T06:26:49.213 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-10T06:26:49.213 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-10T06:26:49.213 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-10T06:26:49.213 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_log_op_age": "5.000000", 2024-09-10T06:26:49.213 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_max_alloc_size": "0", 2024-09-10T06:26:49.213 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_max_blob_size": "0", 2024-09-10T06:26:49.213 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-10T06:26:49.213 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-10T06:26:49.213 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-10T06:26:49.213 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_max_deferred_txc": "32", 2024-09-10T06:26:49.213 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_min_alloc_size": "0", 2024-09-10T06:26:49.213 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-10T06:26:49.213 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-10T06:26:49.214 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_nid_prealloc": "1024", 2024-09-10T06:26:49.214 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-10T06:26:49.214 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-10T06:26:49.214 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-10T06:26:49.214 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-10T06:26:49.214 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_retry_disk_reads": "3", 2024-09-10T06:26:49.214 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_rocksdb_cf": "true", 2024-09-10T06:26:49.214 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-10T06:26:49.214 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-10T06:26:49.214 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-10T06:26:49.214 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-10T06:26:49.214 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-10T06:26:49.215 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-10T06:26:49.215 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-10T06:26:49.215 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-10T06:26:49.215 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_spdk_mem": "512", 2024-09-10T06:26:49.215 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-10T06:26:49.215 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-10T06:26:49.215 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-10T06:26:49.215 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-10T06:26:49.215 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-10T06:26:49.215 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-10T06:26:49.215 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-10T06:26:49.215 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_tracing": "false", 2024-09-10T06:26:49.216 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-10T06:26:49.216 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-10T06:26:49.216 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-10T06:26:49.216 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-10T06:26:49.216 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-10T06:26:49.216 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-10T06:26:49.216 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-10T06:26:49.216 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-10T06:26:49.216 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-10T06:26:49.216 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_write_v2": "false", 2024-09-10T06:26:49.216 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_write_v2_random": "false", 2024-09-10T06:26:49.216 INFO:teuthology.orchestra.run.smithi112.stdout: "bluestore_zero_block_detection": "false", 2024-09-10T06:26:49.216 INFO:teuthology.orchestra.run.smithi112.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-10T06:26:49.217 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-10T06:26:49.217 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-10T06:26:49.217 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-10T06:26:49.217 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-10T06:26:49.217 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-10T06:26:49.217 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-10T06:26:49.217 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-10T06:26:49.217 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-10T06:26:49.217 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-10T06:26:49.217 INFO:teuthology.orchestra.run.smithi112.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-10T06:26:49.217 INFO:teuthology.orchestra.run.smithi112.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-10T06:26:49.217 INFO:teuthology.orchestra.run.smithi112.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-10T06:26:49.217 INFO:teuthology.orchestra.run.smithi112.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-10T06:26:49.217 INFO:teuthology.orchestra.run.smithi112.stdout: "cephx_cluster_require_signatures": "false", 2024-09-10T06:26:49.218 INFO:teuthology.orchestra.run.smithi112.stdout: "cephx_cluster_require_version": "2", 2024-09-10T06:26:49.218 INFO:teuthology.orchestra.run.smithi112.stdout: "cephx_require_signatures": "false", 2024-09-10T06:26:49.218 INFO:teuthology.orchestra.run.smithi112.stdout: "cephx_require_version": "2", 2024-09-10T06:26:49.218 INFO:teuthology.orchestra.run.smithi112.stdout: "cephx_service_require_signatures": "false", 2024-09-10T06:26:49.218 INFO:teuthology.orchestra.run.smithi112.stdout: "cephx_service_require_version": "2", 2024-09-10T06:26:49.218 INFO:teuthology.orchestra.run.smithi112.stdout: "cephx_sign_messages": "true", 2024-09-10T06:26:49.218 INFO:teuthology.orchestra.run.smithi112.stdout: "chdir": "", 2024-09-10T06:26:49.218 INFO:teuthology.orchestra.run.smithi112.stdout: "client_acl_type": "", 2024-09-10T06:26:49.218 INFO:teuthology.orchestra.run.smithi112.stdout: "client_asio_thread_count": "2", 2024-09-10T06:26:49.218 INFO:teuthology.orchestra.run.smithi112.stdout: "client_cache_mid": "0.750000", 2024-09-10T06:26:49.218 INFO:teuthology.orchestra.run.smithi112.stdout: "client_cache_size": "16384", 2024-09-10T06:26:49.218 INFO:teuthology.orchestra.run.smithi112.stdout: "client_caps_release_delay": "5", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_check_pool_perm": "true", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_debug_force_sync_read": "false", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_debug_getattr_caps": "false", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_debug_inject_features": "", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_debug_inject_tick_delay": "0", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_die_on_failed_remount": "false", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_dirsize_rbytes": "true", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_force_lazyio": "false", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_fs": "", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_inject_release_failure": "false", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_max_inline_size": "4096", 2024-09-10T06:26:49.219 INFO:teuthology.orchestra.run.smithi112.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-10T06:26:49.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_mds_namespace": "", 2024-09-10T06:26:49.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_metadata": "", 2024-09-10T06:26:49.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_mount_gid": "-1", 2024-09-10T06:26:49.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_mount_timeout": "300", 2024-09-10T06:26:49.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_mount_uid": "-1", 2024-09-10T06:26:49.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_mountpoint": "/", 2024-09-10T06:26:49.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_notify_timeout": "10", 2024-09-10T06:26:49.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_oc": "true", 2024-09-10T06:26:49.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_oc_max_dirty": "104857600", 2024-09-10T06:26:49.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-10T06:26:49.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_oc_max_objects": "1000", 2024-09-10T06:26:49.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_oc_size": "209715200", 2024-09-10T06:26:49.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_oc_target_dirty": "8388608", 2024-09-10T06:26:49.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_permissions": "true", 2024-09-10T06:26:49.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_quota": "true", 2024-09-10T06:26:49.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_quota_df": "true", 2024-09-10T06:26:49.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_readahead_max_bytes": "0", 2024-09-10T06:26:49.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_readahead_max_periods": "4", 2024-09-10T06:26:49.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_readahead_min": "131072", 2024-09-10T06:26:49.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_reconnect_stale": "false", 2024-09-10T06:26:49.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_shutdown_timeout": "30", 2024-09-10T06:26:49.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_snapdir": ".snap", 2024-09-10T06:26:49.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_tick_interval": "1", 2024-09-10T06:26:49.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_trace": "", 2024-09-10T06:26:49.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_try_dentry_invalidate": "false", 2024-09-10T06:26:49.221 INFO:teuthology.orchestra.run.smithi112.stdout: "client_use_faked_inos": "false", 2024-09-10T06:26:49.222 INFO:teuthology.orchestra.run.smithi112.stdout: "client_use_random_mds": "false", 2024-09-10T06:26:49.222 INFO:teuthology.orchestra.run.smithi112.stdout: "clog_to_graylog": "false", 2024-09-10T06:26:49.222 INFO:teuthology.orchestra.run.smithi112.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-10T06:26:49.222 INFO:teuthology.orchestra.run.smithi112.stdout: "clog_to_graylog_port": "12201", 2024-09-10T06:26:49.222 INFO:teuthology.orchestra.run.smithi112.stdout: "clog_to_monitors": "default=true", 2024-09-10T06:26:49.222 INFO:teuthology.orchestra.run.smithi112.stdout: "clog_to_syslog": "false", 2024-09-10T06:26:49.222 INFO:teuthology.orchestra.run.smithi112.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-10T06:26:49.222 INFO:teuthology.orchestra.run.smithi112.stdout: "clog_to_syslog_level": "info", 2024-09-10T06:26:49.222 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_addr": "-", 2024-09-10T06:26:49.222 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_network": "", 2024-09-10T06:26:49.222 INFO:teuthology.orchestra.run.smithi112.stdout: "cluster_network_interface": "", 2024-09-10T06:26:49.222 INFO:teuthology.orchestra.run.smithi112.stdout: "compressor_zlib_isal": "false", 2024-09-10T06:26:49.222 INFO:teuthology.orchestra.run.smithi112.stdout: "compressor_zlib_level": "5", 2024-09-10T06:26:49.223 INFO:teuthology.orchestra.run.smithi112.stdout: "compressor_zlib_winsize": "-15", 2024-09-10T06:26:49.223 INFO:teuthology.orchestra.run.smithi112.stdout: "compressor_zstd_level": "1", 2024-09-10T06:26:49.223 INFO:teuthology.orchestra.run.smithi112.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-10T06:26:49.223 INFO:teuthology.orchestra.run.smithi112.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-10T06:26:49.223 INFO:teuthology.orchestra.run.smithi112.stdout: "crimson_alien_op_num_threads": "6", 2024-09-10T06:26:49.223 INFO:teuthology.orchestra.run.smithi112.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-10T06:26:49.223 INFO:teuthology.orchestra.run.smithi112.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-10T06:26:49.223 INFO:teuthology.orchestra.run.smithi112.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-10T06:26:49.223 INFO:teuthology.orchestra.run.smithi112.stdout: "crimson_osd_stat_interval": "0", 2024-09-10T06:26:49.223 INFO:teuthology.orchestra.run.smithi112.stdout: "crimson_seastar_cpu_cores": "", 2024-09-10T06:26:49.223 INFO:teuthology.orchestra.run.smithi112.stdout: "crimson_seastar_num_threads": "0", 2024-09-10T06:26:49.223 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_location": "", 2024-09-10T06:26:49.223 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_location_hook": "", 2024-09-10T06:26:49.223 INFO:teuthology.orchestra.run.smithi112.stdout: "crush_location_hook_timeout": "10", 2024-09-10T06:26:49.224 INFO:teuthology.orchestra.run.smithi112.stdout: "daemonize": "false", 2024-09-10T06:26:49.224 INFO:teuthology.orchestra.run.smithi112.stdout: "daos_pool": "tank", 2024-09-10T06:26:49.224 INFO:teuthology.orchestra.run.smithi112.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-10T06:26:49.224 INFO:teuthology.orchestra.run.smithi112.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-10T06:26:49.224 INFO:teuthology.orchestra.run.smithi112.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-10T06:26:49.224 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_alienstore": "0/5", 2024-09-10T06:26:49.224 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_allow_any_pool_priority": "false", 2024-09-10T06:26:49.224 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_asok": "1/5", 2024-09-10T06:26:49.224 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_asok_assert_abort": "false", 2024-09-10T06:26:49.224 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_asserts_on_shutdown": "true", 2024-09-10T06:26:49.224 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_auth": "20/20", 2024-09-10T06:26:49.225 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_bdev": "1/3", 2024-09-10T06:26:49.225 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_bluefs": "1/5", 2024-09-10T06:26:49.225 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_bluestore": "1/5", 2024-09-10T06:26:49.225 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_buffer": "0/1", 2024-09-10T06:26:49.225 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_ceph_dedup": "0/5", 2024-09-10T06:26:49.225 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_ceph_exporter": "1/5", 2024-09-10T06:26:49.225 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_cephfs_mirror": "0/5", 2024-09-10T06:26:49.225 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_cephsqlite": "0/5", 2024-09-10T06:26:49.225 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_client": "0/5", 2024-09-10T06:26:49.225 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_compressor": "1/5", 2024-09-10T06:26:49.225 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_context": "0/1", 2024-09-10T06:26:49.225 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_crimson_interrupt": "0/5", 2024-09-10T06:26:49.225 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_crush": "1/1", 2024-09-10T06:26:49.226 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_crypto": "1/5", 2024-09-10T06:26:49.226 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_cyanstore": "0/5", 2024-09-10T06:26:49.226 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_deliberately_leak_memory": "false", 2024-09-10T06:26:49.226 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_disable_randomized_ping": "false", 2024-09-10T06:26:49.226 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_dpdk": "1/5", 2024-09-10T06:26:49.226 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_eventtrace": "1/5", 2024-09-10T06:26:49.226 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_filer": "0/1", 2024-09-10T06:26:49.226 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_filestore": "1/3", 2024-09-10T06:26:49.226 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_finisher": "1/1", 2024-09-10T06:26:49.226 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_fuse": "1/5", 2024-09-10T06:26:49.226 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_heartbeat_testing_span": "0", 2024-09-10T06:26:49.226 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_heartbeatmap": "1/5", 2024-09-10T06:26:49.226 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-10T06:26:49.226 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_javaclient": "1/5", 2024-09-10T06:26:49.227 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_journal": "1/3", 2024-09-10T06:26:49.227 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_journaler": "0/5", 2024-09-10T06:26:49.227 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_kstore": "1/5", 2024-09-10T06:26:49.227 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_lockdep": "0/1", 2024-09-10T06:26:49.227 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mclock": "1/5", 2024-09-10T06:26:49.227 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mds": "1/5", 2024-09-10T06:26:49.227 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mds_balancer": "1/5", 2024-09-10T06:26:49.227 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mds_locker": "1/5", 2024-09-10T06:26:49.227 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mds_log": "1/5", 2024-09-10T06:26:49.227 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mds_log_expire": "1/5", 2024-09-10T06:26:49.227 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mds_migrator": "1/5", 2024-09-10T06:26:49.227 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mds_quiesce": "3/5", 2024-09-10T06:26:49.227 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_memstore": "1/5", 2024-09-10T06:26:49.227 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mgr": "2/5", 2024-09-10T06:26:49.228 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mgrc": "1/5", 2024-09-10T06:26:49.228 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_mon": "20/20", 2024-09-10T06:26:49.228 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_monc": "0/10", 2024-09-10T06:26:49.228 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_ms": "1/1", 2024-09-10T06:26:49.228 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_none": "0/5", 2024-09-10T06:26:49.228 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_objclass": "0/5", 2024-09-10T06:26:49.228 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_objectcacher": "0/5", 2024-09-10T06:26:49.228 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_objecter": "0/1", 2024-09-10T06:26:49.228 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_optracker": "0/5", 2024-09-10T06:26:49.228 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_osd": "1/5", 2024-09-10T06:26:49.228 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_paxos": "20/20", 2024-09-10T06:26:49.228 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_perfcounter": "1/5", 2024-09-10T06:26:49.228 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_prioritycache": "1/5", 2024-09-10T06:26:49.228 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rados": "0/5", 2024-09-10T06:26:49.229 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rbd": "0/5", 2024-09-10T06:26:49.229 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rbd_mirror": "0/5", 2024-09-10T06:26:49.229 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rbd_pwl": "0/5", 2024-09-10T06:26:49.229 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rbd_replay": "0/5", 2024-09-10T06:26:49.229 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_refs": "0/0", 2024-09-10T06:26:49.229 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_reserver": "1/1", 2024-09-10T06:26:49.229 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw": "1/5", 2024-09-10T06:26:49.229 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw_access": "1/5", 2024-09-10T06:26:49.229 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw_datacache": "1/5", 2024-09-10T06:26:49.229 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw_dbstore": "1/5", 2024-09-10T06:26:49.229 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw_flight": "1/5", 2024-09-10T06:26:49.229 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-10T06:26:49.229 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw_notification": "1/5", 2024-09-10T06:26:49.230 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rgw_sync": "1/5", 2024-09-10T06:26:49.230 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_rocksdb": "4/5", 2024-09-10T06:26:49.230 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore": "0/5", 2024-09-10T06:26:49.230 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_backref": "0/5", 2024-09-10T06:26:49.230 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_cache": "0/5", 2024-09-10T06:26:49.230 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_cleaner": "0/5", 2024-09-10T06:26:49.230 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_device": "0/5", 2024-09-10T06:26:49.230 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_epm": "0/5", 2024-09-10T06:26:49.230 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-10T06:26:49.230 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_journal": "0/5", 2024-09-10T06:26:49.230 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_lba": "0/5", 2024-09-10T06:26:49.230 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_odata": "0/5", 2024-09-10T06:26:49.230 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_omap": "0/5", 2024-09-10T06:26:49.231 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_onode": "0/5", 2024-09-10T06:26:49.231 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_t": "0/5", 2024-09-10T06:26:49.231 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_seastore_tm": "0/5", 2024-09-10T06:26:49.231 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_striper": "0/1", 2024-09-10T06:26:49.231 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_test": "0/5", 2024-09-10T06:26:49.231 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_throttle": "1/1", 2024-09-10T06:26:49.231 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_timer": "0/1", 2024-09-10T06:26:49.231 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_tp": "0/5", 2024-09-10T06:26:49.231 INFO:teuthology.orchestra.run.smithi112.stdout: "debug_trace": "1/5", 2024-09-10T06:26:49.232 INFO:teuthology.orchestra.run.smithi112.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-10T06:26:49.232 INFO:teuthology.orchestra.run.smithi112.stdout: "device_failure_prediction_mode": "none", 2024-09-10T06:26:49.232 INFO:teuthology.orchestra.run.smithi112.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-10T06:26:49.232 INFO:teuthology.orchestra.run.smithi112.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-10T06:26:49.232 INFO:teuthology.orchestra.run.smithi112.stdout: "err_to_graylog": "false", 2024-09-10T06:26:49.232 INFO:teuthology.orchestra.run.smithi112.stdout: "err_to_journald": "false", 2024-09-10T06:26:49.233 INFO:teuthology.orchestra.run.smithi112.stdout: "err_to_stderr": "true", 2024-09-10T06:26:49.233 INFO:teuthology.orchestra.run.smithi112.stdout: "err_to_syslog": "false", 2024-09-10T06:26:49.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event_tracing": "false", 2024-09-10T06:26:49.233 INFO:teuthology.orchestra.run.smithi112.stdout: "exporter_addr": "0.0.0.0", 2024-09-10T06:26:49.233 INFO:teuthology.orchestra.run.smithi112.stdout: "exporter_cert_file": "", 2024-09-10T06:26:49.233 INFO:teuthology.orchestra.run.smithi112.stdout: "exporter_http_port": "9926", 2024-09-10T06:26:49.234 INFO:teuthology.orchestra.run.smithi112.stdout: "exporter_key_file": "", 2024-09-10T06:26:49.234 INFO:teuthology.orchestra.run.smithi112.stdout: "exporter_prio_limit": "5", 2024-09-10T06:26:49.234 INFO:teuthology.orchestra.run.smithi112.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-10T06:26:49.234 INFO:teuthology.orchestra.run.smithi112.stdout: "exporter_sort_metrics": "true", 2024-09-10T06:26:49.234 INFO:teuthology.orchestra.run.smithi112.stdout: "exporter_stats_period": "5", 2024-09-10T06:26:49.234 INFO:teuthology.orchestra.run.smithi112.stdout: "fake_statfs_for_testing": "0", 2024-09-10T06:26:49.234 INFO:teuthology.orchestra.run.smithi112.stdout: "fatal_signal_handlers": "true", 2024-09-10T06:26:49.235 INFO:teuthology.orchestra.run.smithi112.stdout: "filer_max_purge_ops": "10", 2024-09-10T06:26:49.235 INFO:teuthology.orchestra.run.smithi112.stdout: "filer_max_truncate_ops": "128", 2024-09-10T06:26:49.235 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_apply_finisher_threads": "1", 2024-09-10T06:26:49.235 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_blackhole": "false", 2024-09-10T06:26:49.236 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_btrfs_clone_range": "true", 2024-09-10T06:26:49.236 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_btrfs_snap": "true", 2024-09-10T06:26:49.236 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_caller_concurrency": "10", 2024-09-10T06:26:49.236 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_collect_device_partition_information": "true", 2024-09-10T06:26:49.236 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_commit_timeout": "600.000000", 2024-09-10T06:26:49.236 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_debug_inject_read_err": "false", 2024-09-10T06:26:49.237 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_debug_omap_check": "false", 2024-09-10T06:26:49.237 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_debug_verify_split": "false", 2024-09-10T06:26:49.237 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_dump_file": "", 2024-09-10T06:26:49.237 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-10T06:26:49.237 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-10T06:26:49.237 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_fadvise": "true", 2024-09-10T06:26:49.238 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_fail_eio": "true", 2024-09-10T06:26:49.238 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_fd_cache_shards": "16", 2024-09-10T06:26:49.238 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_fd_cache_size": "128", 2024-09-10T06:26:49.238 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_fiemap": "false", 2024-09-10T06:26:49.238 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_fiemap_threshold": "4096", 2024-09-10T06:26:49.238 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-10T06:26:49.238 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-10T06:26:49.239 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_inject_stall": "0", 2024-09-10T06:26:49.239 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_journal_parallel": "false", 2024-09-10T06:26:49.239 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_journal_trailing": "false", 2024-09-10T06:26:49.239 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_journal_writeahead": "false", 2024-09-10T06:26:49.239 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_kill_at": "0", 2024-09-10T06:26:49.239 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-10T06:26:49.239 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-10T06:26:49.239 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-10T06:26:49.239 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-10T06:26:49.239 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-10T06:26:49.240 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattrs": "0", 2024-09-10T06:26:49.240 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-10T06:26:49.240 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-10T06:26:49.240 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-10T06:26:49.240 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-10T06:26:49.240 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_xattr_value_size": "0", 2024-09-10T06:26:49.240 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-10T06:26:49.240 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-10T06:26:49.240 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-10T06:26:49.240 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_merge_threshold": "-10", 2024-09-10T06:26:49.240 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-10T06:26:49.240 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_odsync_write": "false", 2024-09-10T06:26:49.240 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_omap_backend": "rocksdb", 2024-09-10T06:26:49.241 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_omap_backend_path": "", 2024-09-10T06:26:49.241 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-10T06:26:49.241 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-10T06:26:49.241 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-10T06:26:49.241 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_op_thread_timeout": "60", 2024-09-10T06:26:49.241 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_op_threads": "2", 2024-09-10T06:26:49.241 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_punch_hole": "false", 2024-09-10T06:26:49.241 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-10T06:26:49.241 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-10T06:26:49.241 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-10T06:26:49.241 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-10T06:26:49.241 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-10T06:26:49.242 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-10T06:26:49.242 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-10T06:26:49.242 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-10T06:26:49.242 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-10T06:26:49.242 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_queue_max_ops": "50", 2024-09-10T06:26:49.242 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-10T06:26:49.242 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_seek_data_hole": "false", 2024-09-10T06:26:49.242 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_sloppy_crc": "false", 2024-09-10T06:26:49.242 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-10T06:26:49.242 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_splice": "false", 2024-09-10T06:26:49.242 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_split_multiple": "2", 2024-09-10T06:26:49.242 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_split_rand_factor": "20", 2024-09-10T06:26:49.242 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_update_to": "1000", 2024-09-10T06:26:49.243 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-10T06:26:49.243 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-10T06:26:49.243 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-10T06:26:49.243 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-10T06:26:49.243 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-10T06:26:49.243 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-10T06:26:49.243 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_enable": "true", 2024-09-10T06:26:49.243 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-10T06:26:49.243 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-10T06:26:49.243 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-10T06:26:49.243 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-10T06:26:49.243 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-10T06:26:49.243 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-10T06:26:49.244 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_xfs_extsize": "false", 2024-09-10T06:26:49.244 INFO:teuthology.orchestra.run.smithi112.stdout: "filestore_zfs_snap": "false", 2024-09-10T06:26:49.244 INFO:teuthology.orchestra.run.smithi112.stdout: "fio_dir": "/tmp/fio", 2024-09-10T06:26:49.244 INFO:teuthology.orchestra.run.smithi112.stdout: "fsid": "be773357-a22c-4a27-af42-3fbac58c722b", 2024-09-10T06:26:49.244 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_allow_other": "true", 2024-09-10T06:26:49.244 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_atomic_o_trunc": "true", 2024-09-10T06:26:49.244 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_big_writes": "true", 2024-09-10T06:26:49.244 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_debug": "false", 2024-09-10T06:26:49.244 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_default_permissions": "false", 2024-09-10T06:26:49.244 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_disable_pagecache": "false", 2024-09-10T06:26:49.244 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_max_write": "0", 2024-09-10T06:26:49.245 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_multithreaded": "true", 2024-09-10T06:26:49.245 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_require_active_mds": "true", 2024-09-10T06:26:49.245 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_set_user_groups": "true", 2024-09-10T06:26:49.245 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_splice_move": "true", 2024-09-10T06:26:49.245 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_splice_read": "true", 2024-09-10T06:26:49.245 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_splice_write": "true", 2024-09-10T06:26:49.248 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-10T06:26:49.248 INFO:teuthology.orchestra.run.smithi112.stdout: "fuse_use_invalidate_cb": "true", 2024-09-10T06:26:49.248 INFO:teuthology.orchestra.run.smithi112.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-10T06:26:49.248 INFO:teuthology.orchestra.run.smithi112.stdout: "gss_target_name": "ceph", 2024-09-10T06:26:49.248 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_file": "", 2024-09-10T06:26:49.248 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_inject_failure": "0", 2024-09-10T06:26:49.249 INFO:teuthology.orchestra.run.smithi112.stdout: "heartbeat_interval": "5", 2024-09-10T06:26:49.249 INFO:teuthology.orchestra.run.smithi112.stdout: "host": "smithi112", 2024-09-10T06:26:49.249 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-10T06:26:49.249 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-10T06:26:49.249 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-10T06:26:49.249 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-10T06:26:49.249 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-10T06:26:49.249 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-10T06:26:49.249 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-10T06:26:49.249 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-10T06:26:49.249 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-10T06:26:49.249 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-10T06:26:49.249 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-10T06:26:49.250 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-10T06:26:49.250 INFO:teuthology.orchestra.run.smithi112.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-10T06:26:49.250 INFO:teuthology.orchestra.run.smithi112.stdout: "inject_early_sigterm": "false", 2024-09-10T06:26:49.250 INFO:teuthology.orchestra.run.smithi112.stdout: "jaeger_agent_port": "6799", 2024-09-10T06:26:49.250 INFO:teuthology.orchestra.run.smithi112.stdout: "jaeger_tracing_enable": "false", 2024-09-10T06:26:49.250 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_aio": "true", 2024-09-10T06:26:49.250 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_align_min_size": "65536", 2024-09-10T06:26:49.250 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_block_align": "true", 2024-09-10T06:26:49.250 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_block_size": "4096", 2024-09-10T06:26:49.250 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_dio": "true", 2024-09-10T06:26:49.250 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_discard": "false", 2024-09-10T06:26:49.250 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_force_aio": "false", 2024-09-10T06:26:49.250 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_ignore_corruption": "false", 2024-09-10T06:26:49.250 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_max_write_bytes": "10485760", 2024-09-10T06:26:49.251 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_max_write_entries": "100", 2024-09-10T06:26:49.251 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_replay_from": "0", 2024-09-10T06:26:49.251 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-10T06:26:49.251 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-10T06:26:49.251 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-10T06:26:49.251 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-10T06:26:49.251 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_write_header_frequency": "0", 2024-09-10T06:26:49.251 INFO:teuthology.orchestra.run.smithi112.stdout: "journal_zero_on_create": "false", 2024-09-10T06:26:49.251 INFO:teuthology.orchestra.run.smithi112.stdout: "journaler_prefetch_periods": "10", 2024-09-10T06:26:49.251 INFO:teuthology.orchestra.run.smithi112.stdout: "journaler_prezero_periods": "5", 2024-09-10T06:26:49.251 INFO:teuthology.orchestra.run.smithi112.stdout: "journaler_write_head_interval": "15", 2024-09-10T06:26:49.251 INFO:teuthology.orchestra.run.smithi112.stdout: "key": "", 2024-09-10T06:26:49.252 INFO:teuthology.orchestra.run.smithi112.stdout: "keyfile": "", 2024-09-10T06:26:49.252 INFO:teuthology.orchestra.run.smithi112.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-10T06:26:49.252 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_backend": "rocksdb", 2024-09-10T06:26:49.252 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_default_stripe_size": "65536", 2024-09-10T06:26:49.252 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_fsck_on_mount": "false", 2024-09-10T06:26:49.252 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-10T06:26:49.252 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_max_bytes": "67108864", 2024-09-10T06:26:49.252 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_max_ops": "512", 2024-09-10T06:26:49.252 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_nid_prealloc": "1024", 2024-09-10T06:26:49.252 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_onode_map_size": "1024", 2024-09-10T06:26:49.252 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-10T06:26:49.252 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_sync_submit_transaction": "false", 2024-09-10T06:26:49.253 INFO:teuthology.orchestra.run.smithi112.stdout: "kstore_sync_transaction": "false", 2024-09-10T06:26:49.253 INFO:teuthology.orchestra.run.smithi112.stdout: "librados_thread_count": "2", 2024-09-10T06:26:49.253 INFO:teuthology.orchestra.run.smithi112.stdout: "lockdep": "false", 2024-09-10T06:26:49.253 INFO:teuthology.orchestra.run.smithi112.stdout: "lockdep_force_backtrace": "false", 2024-09-10T06:26:49.253 INFO:teuthology.orchestra.run.smithi112.stdout: "log_coarse_timestamps": "true", 2024-09-10T06:26:49.253 INFO:teuthology.orchestra.run.smithi112.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-10T06:26:49.253 INFO:teuthology.orchestra.run.smithi112.stdout: "log_flush_on_exit": "false", 2024-09-10T06:26:49.253 INFO:teuthology.orchestra.run.smithi112.stdout: "log_graylog_host": "127.0.0.1", 2024-09-10T06:26:49.253 INFO:teuthology.orchestra.run.smithi112.stdout: "log_graylog_port": "12201", 2024-09-10T06:26:49.253 INFO:teuthology.orchestra.run.smithi112.stdout: "log_max_new": "1000", 2024-09-10T06:26:49.253 INFO:teuthology.orchestra.run.smithi112.stdout: "log_max_recent": "10000", 2024-09-10T06:26:49.254 INFO:teuthology.orchestra.run.smithi112.stdout: "log_stderr_prefix": "", 2024-09-10T06:26:49.254 INFO:teuthology.orchestra.run.smithi112.stdout: "log_stop_at_utilization": "0.970000", 2024-09-10T06:26:49.254 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_file": "true", 2024-09-10T06:26:49.254 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_graylog": "false", 2024-09-10T06:26:49.254 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_journald": "false", 2024-09-10T06:26:49.254 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_stderr": "false", 2024-09-10T06:26:49.254 INFO:teuthology.orchestra.run.smithi112.stdout: "log_to_syslog": "false", 2024-09-10T06:26:49.254 INFO:teuthology.orchestra.run.smithi112.stdout: "max_rotating_auth_attempts": "10", 2024-09-10T06:26:49.254 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-10T06:26:49.254 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_action_on_write_error": "1", 2024-09-10T06:26:49.254 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_alternate_name_max": "8192", 2024-09-10T06:26:49.254 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_asio_thread_count": "2", 2024-09-10T06:26:49.255 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_export_pin": "true", 2024-09-10T06:26:49.255 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_fragment_dirs": "true", 2024-09-10T06:26:49.255 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-10T06:26:49.255 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_fragment_interval": "5", 2024-09-10T06:26:49.255 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-10T06:26:49.255 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-10T06:26:49.255 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_interval": "10", 2024-09-10T06:26:49.255 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_max": "-1", 2024-09-10T06:26:49.255 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_max_until": "-1", 2024-09-10T06:26:49.255 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_merge_size": "50", 2024-09-10T06:26:49.255 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_midchunk": "0.300000", 2024-09-10T06:26:49.255 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-10T06:26:49.255 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_min_start": "0.200000", 2024-09-10T06:26:49.255 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_minchunk": "0.001000", 2024-09-10T06:26:49.256 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_mode": "0", 2024-09-10T06:26:49.256 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_need_max": "1.200000", 2024-09-10T06:26:49.256 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_need_min": "0.800000", 2024-09-10T06:26:49.256 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_overload_epochs": "2", 2024-09-10T06:26:49.256 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-10T06:26:49.256 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-10T06:26:49.256 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_split_bits": "3", 2024-09-10T06:26:49.256 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-10T06:26:49.256 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_split_size": "10000", 2024-09-10T06:26:49.256 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-10T06:26:49.256 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_target_decay": "10.000000", 2024-09-10T06:26:49.256 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-10T06:26:49.256 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_beacon_grace": "15.000000", 2024-09-10T06:26:49.256 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_beacon_interval": "4.000000", 2024-09-10T06:26:49.257 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-10T06:26:49.257 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-10T06:26:49.257 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_mid": "0.700000", 2024-09-10T06:26:49.257 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-10T06:26:49.257 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_quiesce_delay": "0", 2024-09-10T06:26:49.257 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-10T06:26:49.257 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-10T06:26:49.257 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-10T06:26:49.257 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_release_free_interval": "10", 2024-09-10T06:26:49.257 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_reservation": "0.050000", 2024-09-10T06:26:49.258 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-10T06:26:49.258 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_trim_interval": "1", 2024-09-10T06:26:49.258 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cache_trim_threshold": "262144", 2024-09-10T06:26:49.258 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-10T06:26:49.258 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-10T06:26:49.258 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-10T06:26:49.258 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_client_prealloc_inos": "1000", 2024-09-10T06:26:49.258 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-10T06:26:49.258 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_connect_bootstrapping": "false", 2024-09-10T06:26:49.258 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_damage_table_max_entries": "10000", 2024-09-10T06:26:49.258 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-10T06:26:49.258 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_debug_auth_pins": "false", 2024-09-10T06:26:49.259 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_debug_frag": "false", 2024-09-10T06:26:49.259 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_debug_scatterstat": "false", 2024-09-10T06:26:49.259 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_debug_subtrees": "false", 2024-09-10T06:26:49.259 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_decay_halflife": "5.000000", 2024-09-10T06:26:49.259 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_default_dir_hash": "2", 2024-09-10T06:26:49.259 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_defer_session_stale": "true", 2024-09-10T06:26:49.259 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_deny_all_reconnect": "false", 2024-09-10T06:26:49.259 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dir_keys_per_op": "16384", 2024-09-10T06:26:49.259 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dir_max_commit_size": "10", 2024-09-10T06:26:49.259 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dir_max_entries": "0", 2024-09-10T06:26:49.259 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dir_prefetch": "true", 2024-09-10T06:26:49.259 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-10T06:26:49.259 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-10T06:26:49.259 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dump_cache_on_map": "false", 2024-09-10T06:26:49.260 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-10T06:26:49.260 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-10T06:26:49.260 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_early_reply": "true", 2024-09-10T06:26:49.260 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_enable_op_tracker": "true", 2024-09-10T06:26:49.260 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_enforce_unique_name": "true", 2024-09-10T06:26:49.260 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-10T06:26:49.260 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-10T06:26:49.260 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_export_ephemeral_random": "true", 2024-09-10T06:26:49.260 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-10T06:26:49.260 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-10T06:26:49.260 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-10T06:26:49.260 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-10T06:26:49.261 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-10T06:26:49.261 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-10T06:26:49.261 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-10T06:26:49.261 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-10T06:26:49.261 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_health_summarize_threshold": "10", 2024-09-10T06:26:49.261 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-10T06:26:49.261 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-10T06:26:49.261 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_inject_health_dummy": "false", 2024-09-10T06:26:49.261 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-10T06:26:49.261 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_inject_migrator_session_race": "false", 2024-09-10T06:26:49.262 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-10T06:26:49.262 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-10T06:26:49.262 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-10T06:26:49.262 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_join_fs": "", 2024-09-10T06:26:49.262 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_journal_format": "1", 2024-09-10T06:26:49.262 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-10T06:26:49.262 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_create_at": "0", 2024-09-10T06:26:49.262 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_dirfrag_at": "0", 2024-09-10T06:26:49.263 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_export_at": "0", 2024-09-10T06:26:49.263 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_import_at": "0", 2024-09-10T06:26:49.263 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_journal_at": "0", 2024-09-10T06:26:49.263 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_journal_expire_at": "0", 2024-09-10T06:26:49.263 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_journal_replay_at": "0", 2024-09-10T06:26:49.263 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_link_at": "0", 2024-09-10T06:26:49.263 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_mdstable_at": "0", 2024-09-10T06:26:49.263 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_openc_at": "0", 2024-09-10T06:26:49.263 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_rename_at": "0", 2024-09-10T06:26:49.263 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_kill_shutdown_at": "0", 2024-09-10T06:26:49.263 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_event_large_threshold": "524288", 2024-09-10T06:26:49.264 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_events_per_segment": "1024", 2024-09-10T06:26:49.264 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-10T06:26:49.264 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_max_events": "-1", 2024-09-10T06:26:49.264 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_max_segments": "128", 2024-09-10T06:26:49.264 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_pause": "false", 2024-09-10T06:26:49.264 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_segment_size": "0", 2024-09-10T06:26:49.264 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-10T06:26:49.264 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-10T06:26:49.264 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-10T06:26:49.264 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_trim_threshold": "128", 2024-09-10T06:26:49.264 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-10T06:26:49.264 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_log_warn_factor": "2.000000", 2024-09-10T06:26:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_caps_per_client": "1048576", 2024-09-10T06:26:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_completed_flushes": "100000", 2024-09-10T06:26:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_completed_requests": "100000", 2024-09-10T06:26:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_export_size": "20971520", 2024-09-10T06:26:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_file_recover": "32", 2024-09-10T06:26:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_purge_files": "64", 2024-09-10T06:26:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_purge_ops": "8192", 2024-09-10T06:26:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-10T06:26:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-10T06:26:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_max_snaps_per_dir": "100", 2024-09-10T06:26:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_metrics_update_interval": "2", 2024-09-10T06:26:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_min_caps_per_client": "100", 2024-09-10T06:26:49.265 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_min_caps_working_set": "10000", 2024-09-10T06:26:49.266 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-10T06:26:49.266 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_numa_node": "-1", 2024-09-10T06:26:49.266 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-10T06:26:49.266 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_op_complaint_time": "30.000000", 2024-09-10T06:26:49.266 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_op_history_duration": "600", 2024-09-10T06:26:49.266 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_op_history_size": "20", 2024-09-10T06:26:49.266 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_op_history_slow_op_size": "20", 2024-09-10T06:26:49.266 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-10T06:26:49.266 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_op_log_threshold": "5", 2024-09-10T06:26:49.266 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_ping_grace": "15", 2024-09-10T06:26:49.266 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_ping_interval": "5", 2024-09-10T06:26:49.266 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-10T06:26:49.266 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-10T06:26:49.267 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_recall_max_caps": "30000", 2024-09-10T06:26:49.267 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-10T06:26:49.267 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-10T06:26:49.267 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-10T06:26:49.267 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_recall_warning_threshold": "262144", 2024-09-10T06:26:49.267 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-10T06:26:49.267 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_replay_interval": "1.000000", 2024-09-10T06:26:49.267 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-10T06:26:49.268 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-10T06:26:49.268 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_root_ino_gid": "0", 2024-09-10T06:26:49.268 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_root_ino_uid": "0", 2024-09-10T06:26:49.268 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-10T06:26:49.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-10T06:26:49.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-10T06:26:49.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-10T06:26:49.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-10T06:26:49.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-10T06:26:49.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-10T06:26:49.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-10T06:26:49.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-10T06:26:49.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-10T06:26:49.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-10T06:26:49.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-10T06:26:49.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_shutdown_check": "0", 2024-09-10T06:26:49.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_skip_ino": "0", 2024-09-10T06:26:49.269 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-10T06:26:49.270 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_snap_max_uid": "4294967294", 2024-09-10T06:26:49.270 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_snap_min_uid": "0", 2024-09-10T06:26:49.270 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_snap_rstat": "false", 2024-09-10T06:26:49.270 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_standby_replay_damaged": "false", 2024-09-10T06:26:49.270 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_symlink_recovery": "true", 2024-09-10T06:26:49.270 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-10T06:26:49.270 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_thrash_exports": "0", 2024-09-10T06:26:49.270 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_thrash_fragments": "0", 2024-09-10T06:26:49.270 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_tick_interval": "5.000000", 2024-09-10T06:26:49.270 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_valgrind_exit": "false", 2024-09-10T06:26:49.270 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_verify_backtrace": "1", 2024-09-10T06:26:49.270 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_verify_scatter": "false", 2024-09-10T06:26:49.270 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-10T06:26:49.271 INFO:teuthology.orchestra.run.smithi112.stdout: "mds_wipe_sessions": "false", 2024-09-10T06:26:49.271 INFO:teuthology.orchestra.run.smithi112.stdout: "mempool_debug": "false", 2024-09-10T06:26:49.271 INFO:teuthology.orchestra.run.smithi112.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-10T06:26:49.271 INFO:teuthology.orchestra.run.smithi112.stdout: "memstore_device_bytes": "1073741824", 2024-09-10T06:26:49.271 INFO:teuthology.orchestra.run.smithi112.stdout: "memstore_page_set": "false", 2024-09-10T06:26:49.271 INFO:teuthology.orchestra.run.smithi112.stdout: "memstore_page_size": "65536", 2024-09-10T06:26:49.271 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_client_bytes": "134217728", 2024-09-10T06:26:49.271 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_client_messages": "512", 2024-09-10T06:26:49.271 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-10T06:26:49.271 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-10T06:26:49.271 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-10T06:26:49.271 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-10T06:26:49.271 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_disabled_modules": "", 2024-09-10T06:26:49.272 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_enable_op_tracker": "true", 2024-09-10T06:26:49.272 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-10T06:26:49.272 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_max_pg_creating": "1024", 2024-09-10T06:26:49.272 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_max_pg_num_change": "128", 2024-09-10T06:26:49.272 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_mds_bytes": "134217728", 2024-09-10T06:26:49.272 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_mds_messages": "128", 2024-09-10T06:26:49.272 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-10T06:26:49.273 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_mon_bytes": "134217728", 2024-09-10T06:26:49.273 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_mon_messages": "128", 2024-09-10T06:26:49.273 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-10T06:26:49.273 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-10T06:26:49.273 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_op_history_duration": "600", 2024-09-10T06:26:49.273 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_op_history_size": "20", 2024-09-10T06:26:49.273 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-10T06:26:49.273 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-10T06:26:49.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_op_log_threshold": "5", 2024-09-10T06:26:49.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_osd_bytes": "536870912", 2024-09-10T06:26:49.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_osd_messages": "8192", 2024-09-10T06:26:49.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_pool": "true", 2024-09-10T06:26:49.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-10T06:26:49.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_standby_modules": "true", 2024-09-10T06:26:49.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_stats_period": "5", 2024-09-10T06:26:49.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_stats_threshold": "5", 2024-09-10T06:26:49.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_tick_period": "2", 2024-09-10T06:26:49.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-10T06:26:49.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-10T06:26:49.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_allow_pool_delete": "true", 2024-09-10T06:26:49.274 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_allow_pool_size_one": "true", 2024-09-10T06:26:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_auth_validate_all_caps": "true", 2024-09-10T06:26:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-10T06:26:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-10T06:26:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_bytes": "104857600", 2024-09-10T06:26:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_directed_command_retry": "2", 2024-09-10T06:26:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-10T06:26:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-10T06:26:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-10T06:26:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-10T06:26:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_hunt_parallel": "3", 2024-09-10T06:26:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_log_interval": "1.000000", 2024-09-10T06:26:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-10T06:26:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_ping_interval": "10.000000", 2024-09-10T06:26:49.275 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-10T06:26:49.276 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_client_target_rank": "-1", 2024-09-10T06:26:49.276 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-10T06:26:49.276 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-10T06:26:49.276 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-10T06:26:49.276 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_level": "debug", 2024-09-10T06:26:49.276 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_file": "true", 2024-09-10T06:26:49.276 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-10T06:26:49.276 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-10T06:26:49.276 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-10T06:26:49.276 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_journald": "false", 2024-09-10T06:26:49.276 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-10T06:26:49.276 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-10T06:26:49.277 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-10T06:26:49.277 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_compact_on_bootstrap": "false", 2024-09-10T06:26:49.277 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_compact_on_start": "false", 2024-09-10T06:26:49.277 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_compact_on_trim": "true", 2024-09-10T06:26:49.277 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-10T06:26:49.277 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-10T06:26:49.277 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-10T06:26:49.277 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_cpu_threads": "4", 2024-09-10T06:26:49.277 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_crush_min_required_version": "hammer", 2024-09-10T06:26:49.277 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_daemon_bytes": "419430400", 2024-09-10T06:26:49.278 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-10T06:26:49.278 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_data_avail_crit": "5", 2024-09-10T06:26:49.278 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_data_avail_warn": "5", 2024-09-10T06:26:49.278 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_data_size_warn": "16106127360", 2024-09-10T06:26:49.278 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-10T06:26:49.278 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-10T06:26:49.278 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_dump_json": "false", 2024-09-10T06:26:49.279 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-10T06:26:49.279 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_dump_transactions": "false", 2024-09-10T06:26:49.279 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_extra_checks": "false", 2024-09-10T06:26:49.279 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-10T06:26:49.279 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-10T06:26:49.279 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_no_require_reef": "false", 2024-09-10T06:26:49.279 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_no_require_squid": "false", 2024-09-10T06:26:49.280 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-10T06:26:49.280 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-10T06:26:49.280 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-10T06:26:49.280 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_down_mkfs_grace": "120", 2024-09-10T06:26:49.280 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_down_uptime_grace": "60", 2024-09-10T06:26:49.280 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_election_default_strategy": "1", 2024-09-10T06:26:49.280 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_election_timeout": "5.000000", 2024-09-10T06:26:49.280 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-10T06:26:49.280 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_elector_ping_divisor": "2", 2024-09-10T06:26:49.281 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-10T06:26:49.281 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_enable_op_tracker": "true", 2024-09-10T06:26:49.281 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_fake_pool_delete": "false", 2024-09-10T06:26:49.281 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_force_quorum_join": "false", 2024-09-10T06:26:49.281 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-10T06:26:49.282 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_globalid_prealloc": "10000", 2024-09-10T06:26:49.282 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_health_detail_to_clog": "false", 2024-09-10T06:26:49.282 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_health_log_update_period": "5", 2024-09-10T06:26:49.282 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_health_max_detail": "50", 2024-09-10T06:26:49.282 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_health_to_clog": "true", 2024-09-10T06:26:49.282 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_health_to_clog_interval": "600", 2024-09-10T06:26:49.283 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-10T06:26:49.283 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_host": "172.21.15.112,[v2:172.21.15.112:3301,v1:172.21.15.112:6790],172.21.15.120", 2024-09-10T06:26:49.283 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_host_override": "", 2024-09-10T06:26:49.283 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_initial_members": "", 2024-09-10T06:26:49.283 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-10T06:26:49.284 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-10T06:26:49.284 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-10T06:26:49.284 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-10T06:26:49.284 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-10T06:26:49.284 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_lease": "5.000000", 2024-09-10T06:26:49.284 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-10T06:26:49.284 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-10T06:26:49.284 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_log_full_interval": "50", 2024-09-10T06:26:49.285 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_log_max": "10000", 2024-09-10T06:26:49.285 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_log_max_summary": "50", 2024-09-10T06:26:49.285 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-10T06:26:49.285 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_log_epochs": "500", 2024-09-10T06:26:49.285 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-10T06:26:49.285 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-10T06:26:49.285 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-10T06:26:49.286 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_osd": "10000", 2024-09-10T06:26:49.286 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_pg_per_osd": "10000", 2024-09-10T06:26:49.286 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_pool_pg_num": "65536", 2024-09-10T06:26:49.286 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-10T06:26:49.286 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-10T06:26:49.286 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mds_force_trim_to": "0", 2024-09-10T06:26:49.286 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mds_skip_sanity": "false", 2024-09-10T06:26:49.286 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_memory_autotune": "true", 2024-09-10T06:26:49.286 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_memory_target": "2147483648", 2024-09-10T06:26:49.287 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mgr_beacon_grace": "30", 2024-09-10T06:26:49.287 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-10T06:26:49.287 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mgr_digest_period": "5", 2024-09-10T06:26:49.287 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mgr_inactive_grace": "60", 2024-09-10T06:26:49.287 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-10T06:26:49.287 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-10T06:26:49.287 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_min_osdmap_epochs": "500", 2024-09-10T06:26:49.287 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-10T06:26:49.287 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-10T06:26:49.287 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_op_complaint_time": "30", 2024-09-10T06:26:49.287 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_op_history_duration": "600", 2024-09-10T06:26:49.288 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_op_history_size": "20", 2024-09-10T06:26:49.288 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_op_history_slow_op_size": "20", 2024-09-10T06:26:49.288 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-10T06:26:49.288 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_op_log_threshold": "5", 2024-09-10T06:26:49.288 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-10T06:26:49.288 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-10T06:26:49.288 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-10T06:26:49.288 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_auto_mark_in": "false", 2024-09-10T06:26:49.288 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-10T06:26:49.288 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-10T06:26:49.288 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-10T06:26:49.289 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_cache_size": "500", 2024-09-10T06:26:49.289 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-10T06:26:49.289 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-10T06:26:49.289 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-10T06:26:49.289 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_down_out_interval": "600", 2024-09-10T06:26:49.289 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-10T06:26:49.289 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-10T06:26:49.289 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_force_trim_to": "0", 2024-09-10T06:26:49.289 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-10T06:26:49.289 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-10T06:26:49.289 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-10T06:26:49.289 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-10T06:26:49.289 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-10T06:26:49.289 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-10T06:26:49.290 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-10T06:26:49.290 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_min_down_reporters": "2", 2024-09-10T06:26:49.290 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-10T06:26:49.290 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-10T06:26:49.290 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-10T06:26:49.290 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-10T06:26:49.290 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-10T06:26:49.290 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-10T06:26:49.290 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_report_timeout": "900", 2024-09-10T06:26:49.290 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-10T06:26:49.290 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-10T06:26:49.290 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-10T06:26:49.290 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-10T06:26:49.291 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-10T06:26:49.291 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-10T06:26:49.291 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-10T06:26:49.291 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-10T06:26:49.291 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-10T06:26:49.291 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pg_stuck_threshold": "60", 2024-09-10T06:26:49.291 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-10T06:26:49.291 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-10T06:26:49.291 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-10T06:26:49.291 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-10T06:26:49.291 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-10T06:26:49.292 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-10T06:26:49.292 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_probe_timeout": "2.000000", 2024-09-10T06:26:49.292 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_reweight_max_change": "0.050000", 2024-09-10T06:26:49.292 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_reweight_max_osds": "4", 2024-09-10T06:26:49.292 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-10T06:26:49.292 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-10T06:26:49.292 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-10T06:26:49.292 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-10T06:26:49.292 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-10T06:26:49.292 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_scrub_interval": "86400", 2024-09-10T06:26:49.292 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_scrub_max_keys": "100", 2024-09-10T06:26:49.293 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_scrub_timeout": "300", 2024-09-10T06:26:49.293 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_session_timeout": "300", 2024-09-10T06:26:49.293 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_smart_report_timeout": "5", 2024-09-10T06:26:49.293 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_stat_smooth_intervals": "6", 2024-09-10T06:26:49.293 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-10T06:26:49.293 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_stretch_pool_min_size": "2", 2024-09-10T06:26:49.293 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_stretch_pool_size": "4", 2024-09-10T06:26:49.293 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-10T06:26:49.293 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-10T06:26:49.293 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_sync_debug": "false", 2024-09-10T06:26:49.293 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-10T06:26:49.293 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-10T06:26:49.293 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_sync_provider_kill_at": "0", 2024-09-10T06:26:49.293 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_sync_requester_kill_at": "0", 2024-09-10T06:26:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_sync_timeout": "60.000000", 2024-09-10T06:26:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_target_pg_per_osd": "100", 2024-09-10T06:26:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_tick_interval": "5", 2024-09-10T06:26:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_timecheck_interval": "300.000000", 2024-09-10T06:26:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-10T06:26:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_use_min_delay_socket": "false", 2024-09-10T06:26:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_older_version_delay": "604800", 2024-09-10T06:26:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-10T06:26:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-10T06:26:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-10T06:26:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-10T06:26:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-10T06:26:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-10T06:26:49.294 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-10T06:26:49.295 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_misplaced": "false", 2024-09-10T06:26:49.295 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-10T06:26:49.295 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_older_version": "true", 2024-09-10T06:26:49.295 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-10T06:26:49.295 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-10T06:26:49.295 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-10T06:26:49.295 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-10T06:26:49.295 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-10T06:26:49.295 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-10T06:26:49.295 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-10T06:26:49.295 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-10T06:26:49.295 INFO:teuthology.orchestra.run.smithi112.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-10T06:26:49.295 INFO:teuthology.orchestra.run.smithi112.stdout: "monmap": "", 2024-09-10T06:26:49.296 INFO:teuthology.orchestra.run.smithi112.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-10T06:26:49.296 INFO:teuthology.orchestra.run.smithi112.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-10T06:26:49.296 INFO:teuthology.orchestra.run.smithi112.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-10T06:26:49.296 INFO:teuthology.orchestra.run.smithi112.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-10T06:26:49.296 INFO:teuthology.orchestra.run.smithi112.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-10T06:26:49.296 INFO:teuthology.orchestra.run.smithi112.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-10T06:26:49.296 INFO:teuthology.orchestra.run.smithi112.stdout: "motr_tracing_enabled": "false", 2024-09-10T06:26:49.296 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_op_threads": "3", 2024-09-10T06:26:49.297 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-10T06:26:49.297 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_cm": "false", 2024-09-10T06:26:49.297 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_device_name": "", 2024-09-10T06:26:49.297 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_dscp": "96", 2024-09-10T06:26:49.297 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-10T06:26:49.297 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-10T06:26:49.297 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_local_gid": "", 2024-09-10T06:26:49.297 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-10T06:26:49.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_port_num": "1", 2024-09-10T06:26:49.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-10T06:26:49.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-10T06:26:49.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-10T06:26:49.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-10T06:26:49.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_sl": "3", 2024-09-10T06:26:49.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_support_srq": "true", 2024-09-10T06:26:49.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_rdma_type": "ib", 2024-09-10T06:26:49.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_async_reap_threshold": "5", 2024-09-10T06:26:49.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_before_connect": "false", 2024-09-10T06:26:49.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_ipv4": "true", 2024-09-10T06:26:49.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_ipv6": "false", 2024-09-10T06:26:49.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_msgr1": "true", 2024-09-10T06:26:49.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_msgr2": "true", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_port_max": "7568", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_port_min": "6800", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_retry_count": "3", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_bind_retry_delay": "5", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_blackhole_client": "false", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_blackhole_mds": "false", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_blackhole_mgr": "false", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_blackhole_mon": "false", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_blackhole_osd": "false", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_client_mode": "crc secure", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_cluster_mode": "crc secure", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_cluster_type": "", 2024-09-10T06:26:49.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_compress_secure": "false", 2024-09-10T06:26:49.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_connection_idle_timeout": "900", 2024-09-10T06:26:49.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_connection_ready_timeout": "10", 2024-09-10T06:26:49.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_crc_data": "true", 2024-09-10T06:26:49.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_crc_header": "true", 2024-09-10T06:26:49.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_die_on_bad_msg": "false", 2024-09-10T06:26:49.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_die_on_bug": "true", 2024-09-10T06:26:49.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_die_on_old_message": "true", 2024-09-10T06:26:49.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_die_on_skipped_message": "false", 2024-09-10T06:26:49.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-10T06:26:49.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-10T06:26:49.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_coremask": "0xF", 2024-09-10T06:26:49.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-10T06:26:49.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-10T06:26:49.300 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_enable_tso": "true", 2024-09-10T06:26:49.301 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-10T06:26:49.301 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-10T06:26:49.301 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_hugepages": "", 2024-09-10T06:26:49.301 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-10T06:26:49.301 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-10T06:26:49.301 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_lro": "true", 2024-09-10T06:26:49.301 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_memory_channel": "4", 2024-09-10T06:26:49.301 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-10T06:26:49.301 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_pmd": "", 2024-09-10T06:26:49.301 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_port_id": "0", 2024-09-10T06:26:49.301 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-10T06:26:49.301 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-10T06:26:49.302 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_dump_on_send": "false", 2024-09-10T06:26:49.302 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_initial_backoff": "0.200000", 2024-09-10T06:26:49.302 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_inject_delay_max": "1.000000", 2024-09-10T06:26:49.302 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-10T06:26:49.302 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_inject_delay_type": "", 2024-09-10T06:26:49.302 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-10T06:26:49.302 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_inject_network_congestion": "0", 2024-09-10T06:26:49.302 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_inject_socket_failures": "0", 2024-09-10T06:26:49.302 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_learn_addr_from_peer": "true", 2024-09-10T06:26:49.302 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_max_accept_failures": "4", 2024-09-10T06:26:49.302 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_max_backoff": "15.000000", 2024-09-10T06:26:49.302 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_mon_client_mode": "secure crc", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_mon_service_mode": "secure crc", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_osd_compress_min_size": "1024", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_osd_compress_mode": "none", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_pq_min_cost": "65536", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_public_type": "", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_service_mode": "crc secure", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_tcp_listen_backlog": "512", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_tcp_nodelay": "true", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_tcp_rcvbuf": "0", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "ms_type": "async+posix", 2024-09-10T06:26:49.303 INFO:teuthology.orchestra.run.smithi112.stdout: "no_config_file": "false", 2024-09-10T06:26:49.304 INFO:teuthology.orchestra.run.smithi112.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-10T06:26:49.304 INFO:teuthology.orchestra.run.smithi112.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-10T06:26:49.304 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_completion_locks_per_session": "32", 2024-09-10T06:26:49.304 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-10T06:26:49.304 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-10T06:26:49.304 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_inflight_ops": "1024", 2024-09-10T06:26:49.304 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-10T06:26:49.304 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-10T06:26:49.304 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_tick_interval": "5.000000", 2024-09-10T06:26:49.304 INFO:teuthology.orchestra.run.smithi112.stdout: "objecter_timeout": "10.000000", 2024-09-10T06:26:49.304 INFO:teuthology.orchestra.run.smithi112.stdout: "objectstore_blackhole": "false", 2024-09-10T06:26:49.304 INFO:teuthology.orchestra.run.smithi112.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-10T06:26:49.304 INFO:teuthology.orchestra.run.smithi112.stdout: "openssl_engine_opts": "", 2024-09-10T06:26:49.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_agent_delay_time": "5.000000", 2024-09-10T06:26:49.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_agent_hist_halflife": "1000", 2024-09-10T06:26:49.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_agent_max_low_ops": "2", 2024-09-10T06:26:49.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_agent_max_ops": "4", 2024-09-10T06:26:49.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-10T06:26:49.305 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-10T06:26:49.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_agent_slop": "0.020000", 2024-09-10T06:26:49.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-10T06:26:49.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-10T06:26:49.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_asio_thread_count": "2", 2024-09-10T06:26:49.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_async_recovery_min_cost": "100", 2024-09-10T06:26:49.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-10T06:26:49.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-10T06:26:49.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_backfill_scan_max": "512", 2024-09-10T06:26:49.306 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_backfill_scan_min": "64", 2024-09-10T06:26:49.307 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_backoff_on_degraded": "false", 2024-09-10T06:26:49.307 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_backoff_on_peering": "false", 2024-09-10T06:26:49.307 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_backoff_on_unfound": "true", 2024-09-10T06:26:49.307 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_beacon_report_interval": "300", 2024-09-10T06:26:49.307 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bench_duration": "30", 2024-09-10T06:26:49.307 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-10T06:26:49.307 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bench_max_block_size": "67108864", 2024-09-10T06:26:49.307 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-10T06:26:49.307 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_blkin_trace_all": "false", 2024-09-10T06:26:49.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-10T06:26:49.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-10T06:26:49.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-10T06:26:49.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-10T06:26:49.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_check_for_log_corruption": "false", 2024-09-10T06:26:49.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-10T06:26:49.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-10T06:26:49.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-10T06:26:49.308 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-10T06:26:49.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_class_update_on_start": "true", 2024-09-10T06:26:49.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_client_message_cap": "256", 2024-09-10T06:26:49.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_client_message_size_cap": "524288000", 2024-09-10T06:26:49.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_client_op_priority": "63", 2024-09-10T06:26:49.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_client_watch_timeout": "30", 2024-09-10T06:26:49.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_command_max_records": "256", 2024-09-10T06:26:49.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_compact_on_start": "false", 2024-09-10T06:26:49.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-10T06:26:49.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-10T06:26:49.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-10T06:26:49.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_crush_update_on_start": "true", 2024-09-10T06:26:49.309 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_crush_update_weight_set": "true", 2024-09-10T06:26:49.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-10T06:26:49.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-10T06:26:49.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-10T06:26:49.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-10T06:26:49.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-10T06:26:49.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_feed_pullee": "-1", 2024-09-10T06:26:49.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-10T06:26:49.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-10T06:26:49.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-10T06:26:49.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_misdirected_ops": "false", 2024-09-10T06:26:49.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_no_acting_change": "false", 2024-09-10T06:26:49.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_no_purge_strays": "false", 2024-09-10T06:26:49.310 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_op_order": "false", 2024-09-10T06:26:49.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-10T06:26:49.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-10T06:26:49.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-10T06:26:49.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-10T06:26:49.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_shutdown": "false", 2024-09-10T06:26:49.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-10T06:26:49.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-10T06:26:49.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_trim_objects": "false", 2024-09-10T06:26:49.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-10T06:26:49.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-10T06:26:49.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_verify_snaps": "false", 2024-09-10T06:26:49.311 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-10T06:26:49.312 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-10T06:26:49.312 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_deep_scrub_keys": "1024", 2024-09-10T06:26:49.312 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-10T06:26:49.312 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-10T06:26:49.312 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-10T06:26:49.312 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_deep_scrub_stride": "524288", 2024-09-10T06:26:49.312 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-10T06:26:49.312 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-10T06:26:49.312 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_default_notify_timeout": "30", 2024-09-10T06:26:49.312 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_delete_sleep": "0.000000", 2024-09-10T06:26:49.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-10T06:26:49.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-10T06:26:49.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-10T06:26:49.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_discard_disconnected_ops": "true", 2024-09-10T06:26:49.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ec_partial_reads": "true", 2024-09-10T06:26:49.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_enable_op_tracker": "true", 2024-09-10T06:26:49.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-10T06:26:49.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-10T06:26:49.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-10T06:26:49.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-10T06:26:49.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_fast_info": "true", 2024-09-10T06:26:49.313 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_fast_shutdown": "true", 2024-09-10T06:26:49.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-10T06:26:49.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-10T06:26:49.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-10T06:26:49.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-10T06:26:49.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-10T06:26:49.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_function_tracing": "false", 2024-09-10T06:26:49.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_heartbeat_grace": "20", 2024-09-10T06:26:49.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_heartbeat_interval": "6", 2024-09-10T06:26:49.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-10T06:26:49.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_heartbeat_min_peers": "10", 2024-09-10T06:26:49.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_heartbeat_min_size": "2000", 2024-09-10T06:26:49.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_heartbeat_stale": "600", 2024-09-10T06:26:49.314 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-10T06:26:49.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_hit_set_max_size": "100000", 2024-09-10T06:26:49.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_hit_set_min_size": "1000", 2024-09-10T06:26:49.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-10T06:26:49.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-10T06:26:49.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-10T06:26:49.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-10T06:26:49.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-10T06:26:49.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-10T06:26:49.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_journal_size": "5120", 2024-09-10T06:26:49.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_kill_backfill_at": "0", 2024-09-10T06:26:49.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-10T06:26:49.315 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_map_cache_size": "50", 2024-09-10T06:26:49.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_map_dedup": "true", 2024-09-10T06:26:49.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_map_message_max": "40", 2024-09-10T06:26:49.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-10T06:26:49.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_map_share_max_epochs": "40", 2024-09-10T06:26:49.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_attr_name_len": "100", 2024-09-10T06:26:49.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_attr_size": "0", 2024-09-10T06:26:49.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_backfills": "1", 2024-09-10T06:26:49.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_markdown_count": "5", 2024-09-10T06:26:49.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_markdown_period": "600", 2024-09-10T06:26:49.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_object_name_len": "2048", 2024-09-10T06:26:49.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_object_namespace_len": "256", 2024-09-10T06:26:49.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_object_size": "134217728", 2024-09-10T06:26:49.316 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-10T06:26:49.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-10T06:26:49.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_pg_blocked_by": "16", 2024-09-10T06:26:49.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_pg_log_entries": "10000", 2024-09-10T06:26:49.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-10T06:26:49.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_pgls": "1024", 2024-09-10T06:26:49.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_push_cost": "8388608", 2024-09-10T06:26:49.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_push_objects": "10", 2024-09-10T06:26:49.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_scrubs": "3", 2024-09-10T06:26:49.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-10T06:26:49.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_trimming_pgs": "2", 2024-09-10T06:26:49.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_write_op_reply_len": "64", 2024-09-10T06:26:49.317 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_max_write_size": "90", 2024-09-10T06:26:49.318 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-10T06:26:49.318 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-10T06:26:49.318 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-10T06:26:49.318 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-10T06:26:49.318 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-10T06:26:49.318 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-10T06:26:49.318 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-10T06:26:49.318 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-10T06:26:49.318 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_profile": "balanced", 2024-09-10T06:26:49.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-10T06:26:49.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-10T06:26:49.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-10T06:26:49.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-10T06:26:49.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-10T06:26:49.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-10T06:26:49.319 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-10T06:26:49.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-10T06:26:49.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-10T06:26:49.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-10T06:26:49.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-10T06:26:49.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_memory_base": "805306368", 2024-09-10T06:26:49.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_memory_cache_min": "134217728", 2024-09-10T06:26:49.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-10T06:26:49.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-10T06:26:49.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_memory_target": "4294967296", 2024-09-10T06:26:49.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_memory_target_autotune": "false", 2024-09-10T06:26:49.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-10T06:26:49.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_min_pg_log_entries": "250", 2024-09-10T06:26:49.320 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_min_recovery_priority": "0", 2024-09-10T06:26:49.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-10T06:26:49.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-10T06:26:49.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mon_report_interval": "5", 2024-09-10T06:26:49.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-10T06:26:49.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-10T06:26:49.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_num_cache_shards": "32", 2024-09-10T06:26:49.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_num_op_tracker_shard": "32", 2024-09-10T06:26:49.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_numa_auto_affinity": "true", 2024-09-10T06:26:49.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_numa_node": "-1", 2024-09-10T06:26:49.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_numa_prefer_iface": "true", 2024-09-10T06:26:49.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-10T06:26:49.321 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_objecter_finishers": "1", 2024-09-10T06:26:49.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_objectstore": "bluestore", 2024-09-10T06:26:49.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_objectstore_fuse": "false", 2024-09-10T06:26:49.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-10T06:26:49.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_objectstore_tracing": "false", 2024-09-10T06:26:49.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_complaint_time": "30.000000", 2024-09-10T06:26:49.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_history_duration": "600", 2024-09-10T06:26:49.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_history_size": "20", 2024-09-10T06:26:49.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_history_slow_op_size": "20", 2024-09-10T06:26:49.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-10T06:26:49.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_log_threshold": "5", 2024-09-10T06:26:49.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_num_shards": "0", 2024-09-10T06:26:49.322 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_num_shards_hdd": "5", 2024-09-10T06:26:49.323 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_num_shards_ssd": "8", 2024-09-10T06:26:49.323 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-10T06:26:49.323 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-10T06:26:49.323 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-10T06:26:49.323 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-10T06:26:49.323 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_pq_min_cost": "65536", 2024-09-10T06:26:49.323 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-10T06:26:49.323 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_queue_cut_off": "high", 2024-09-10T06:26:49.323 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-10T06:26:49.323 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_op_thread_timeout": "15", 2024-09-10T06:26:49.323 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_open_classes_on_start": "true", 2024-09-10T06:26:49.323 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_os_flags": "0", 2024-09-10T06:26:49.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_peering_op_priority": "255", 2024-09-10T06:26:49.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_delete_cost": "1048576", 2024-09-10T06:26:49.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_delete_priority": "5", 2024-09-10T06:26:49.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-10T06:26:49.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-10T06:26:49.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-10T06:26:49.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_log_trim_max": "10000", 2024-09-10T06:26:49.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_log_trim_min": "100", 2024-09-10T06:26:49.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-10T06:26:49.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-10T06:26:49.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-10T06:26:49.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-10T06:26:49.324 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-10T06:26:49.325 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-10T06:26:49.325 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-10T06:26:49.325 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-10T06:26:49.325 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-10T06:26:49.325 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-10T06:26:49.325 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_crimson": "false", 2024-09-10T06:26:49.325 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-10T06:26:49.325 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-10T06:26:49.325 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-10T06:26:49.325 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-10T06:26:49.326 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-10T06:26:49.326 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-10T06:26:49.326 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-10T06:26:49.326 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-10T06:26:49.326 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_flags": "0", 2024-09-10T06:26:49.326 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-10T06:26:49.326 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_min_size": "0", 2024-09-10T06:26:49.326 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-10T06:26:49.326 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_pg_num": "32", 2024-09-10T06:26:49.326 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_pgp_num": "0", 2024-09-10T06:26:49.326 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-10T06:26:49.326 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_read_ratio": "70", 2024-09-10T06:26:49.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_size": "2", 2024-09-10T06:26:49.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_default_type": "replicated", 2024-09-10T06:26:49.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-10T06:26:49.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-10T06:26:49.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_push_per_object_cost": "1000", 2024-09-10T06:26:49.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-10T06:26:49.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recover_clone_overlap": "true", 2024-09-10T06:26:49.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-10T06:26:49.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_cost": "20971520", 2024-09-10T06:26:49.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-10T06:26:49.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_max_active": "0", 2024-09-10T06:26:49.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-10T06:26:49.327 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-10T06:26:49.328 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-10T06:26:49.328 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-10T06:26:49.328 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_max_single_start": "1", 2024-09-10T06:26:49.328 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_op_priority": "3", 2024-09-10T06:26:49.328 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-10T06:26:49.328 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_priority": "5", 2024-09-10T06:26:49.328 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-10T06:26:49.328 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_sleep": "0.000000", 2024-09-10T06:26:49.328 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-10T06:26:49.328 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-10T06:26:49.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-10T06:26:49.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_repair_during_recovery": "false", 2024-09-10T06:26:49.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_requested_scrub_priority": "120", 2024-09-10T06:26:49.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-10T06:26:49.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-10T06:26:49.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_auto_repair": "false", 2024-09-10T06:26:49.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-10T06:26:49.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-10T06:26:49.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_begin_hour": "0", 2024-09-10T06:26:49.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_begin_week_day": "0", 2024-09-10T06:26:49.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_chunk_max": "25", 2024-09-10T06:26:49.329 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_chunk_min": "5", 2024-09-10T06:26:49.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_cost": "52428800", 2024-09-10T06:26:49.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-10T06:26:49.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_during_recovery": "false", 2024-09-10T06:26:49.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_end_hour": "0", 2024-09-10T06:26:49.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_end_week_day": "0", 2024-09-10T06:26:49.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_event_cost": "4096", 2024-09-10T06:26:49.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-10T06:26:49.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-10T06:26:49.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_invalid_stats": "true", 2024-09-10T06:26:49.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-10T06:26:49.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-10T06:26:49.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_max_preemptions": "5", 2024-09-10T06:26:49.330 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_priority": "5", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_scrub_sleep": "0.000000", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_skip_data_digest": "false", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_smart_report_timeout": "5", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_snap_trim_cost": "1048576", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_snap_trim_priority": "5", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-10T06:26:49.331 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-10T06:26:49.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-10T06:26:49.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-10T06:26:49.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_target_transaction_size": "30", 2024-09-10T06:26:49.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-10T06:26:49.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-10T06:26:49.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-10T06:26:49.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-10T06:26:49.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-10T06:26:49.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-10T06:26:49.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-10T06:26:49.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-10T06:26:49.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-10T06:26:49.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-10T06:26:49.332 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_tracing": "false", 2024-09-10T06:26:49.333 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_use_stale_snap": "false", 2024-09-10T06:26:49.333 INFO:teuthology.orchestra.run.smithi112.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T06:26:49.333 INFO:teuthology.orchestra.run.smithi112.stdout: "osdc_blkin_trace_all": "false", 2024-09-10T06:26:49.333 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_kill_at": "0", 2024-09-10T06:26:49.333 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_max_join_drift": "10", 2024-09-10T06:26:49.333 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_min": "500", 2024-09-10T06:26:49.333 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_min_wait": "0.050000", 2024-09-10T06:26:49.333 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_propose_interval": "1.000000", 2024-09-10T06:26:49.333 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_service_trim_max": "500", 2024-09-10T06:26:49.333 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-10T06:26:49.334 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_service_trim_min": "250", 2024-09-10T06:26:49.334 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_stash_full_interval": "25", 2024-09-10T06:26:49.334 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_trim_max": "500", 2024-09-10T06:26:49.334 INFO:teuthology.orchestra.run.smithi112.stdout: "paxos_trim_min": "250", 2024-09-10T06:26:49.334 INFO:teuthology.orchestra.run.smithi112.stdout: "perf": "true", 2024-09-10T06:26:49.334 INFO:teuthology.orchestra.run.smithi112.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-10T06:26:49.334 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-10T06:26:49.334 INFO:teuthology.orchestra.run.smithi112.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-10T06:26:49.334 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addr": "-", 2024-09-10T06:26:49.334 INFO:teuthology.orchestra.run.smithi112.stdout: "public_addrv": "", 2024-09-10T06:26:49.334 INFO:teuthology.orchestra.run.smithi112.stdout: "public_bind_addr": "-", 2024-09-10T06:26:49.334 INFO:teuthology.orchestra.run.smithi112.stdout: "public_network": "", 2024-09-10T06:26:49.334 INFO:teuthology.orchestra.run.smithi112.stdout: "public_network_interface": "", 2024-09-10T06:26:49.334 INFO:teuthology.orchestra.run.smithi112.stdout: "qat_compressor_busy_polling": "false", 2024-09-10T06:26:49.335 INFO:teuthology.orchestra.run.smithi112.stdout: "qat_compressor_enabled": "false", 2024-09-10T06:26:49.335 INFO:teuthology.orchestra.run.smithi112.stdout: "qat_compressor_session_max_number": "256", 2024-09-10T06:26:49.335 INFO:teuthology.orchestra.run.smithi112.stdout: "rados_mon_op_timeout": "0", 2024-09-10T06:26:49.335 INFO:teuthology.orchestra.run.smithi112.stdout: "rados_osd_op_timeout": "0", 2024-09-10T06:26:49.335 INFO:teuthology.orchestra.run.smithi112.stdout: "rados_tracing": "false", 2024-09-10T06:26:49.335 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_atime_update_interval": "60", 2024-09-10T06:26:49.335 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-10T06:26:49.335 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_balance_parent_reads": "false", 2024-09-10T06:26:49.335 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_balance_snap_reads": "false", 2024-09-10T06:26:49.335 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_blkin_trace_all": "false", 2024-09-10T06:26:49.336 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-10T06:26:49.336 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-10T06:26:49.336 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache": "true", 2024-09-10T06:26:49.336 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-10T06:26:49.336 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-10T06:26:49.336 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-10T06:26:49.336 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-10T06:26:49.336 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_policy": "writearound", 2024-09-10T06:26:49.336 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_size": "33554432", 2024-09-10T06:26:49.336 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-10T06:26:49.336 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-10T06:26:49.337 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_clone_copy_on_read": "false", 2024-09-10T06:26:49.337 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_compression_hint": "none", 2024-09-10T06:26:49.337 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_concurrent_management_ops": "10", 2024-09-10T06:26:49.337 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-10T06:26:49.337 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_clone_format": "auto", 2024-09-10T06:26:49.337 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_data_pool": "", 2024-09-10T06:26:49.337 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_features": "61", 2024-09-10T06:26:49.337 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_format": "2", 2024-09-10T06:26:49.337 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_map_options": "", 2024-09-10T06:26:49.337 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_order": "22", 2024-09-10T06:26:49.337 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_pool": "rbd", 2024-09-10T06:26:49.337 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-10T06:26:49.338 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_stripe_count": "0", 2024-09-10T06:26:49.338 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_default_stripe_unit": "0", 2024-09-10T06:26:49.338 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-10T06:26:49.338 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-10T06:26:49.338 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-10T06:26:49.338 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_enable_alloc_hint": "true", 2024-09-10T06:26:49.338 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-10T06:26:49.338 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_io_scheduler": "simple", 2024-09-10T06:26:49.338 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-10T06:26:49.338 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-10T06:26:49.338 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-10T06:26:49.338 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-10T06:26:49.338 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-10T06:26:49.338 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-10T06:26:49.339 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-10T06:26:49.339 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-10T06:26:49.339 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-10T06:26:49.339 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_order": "24", 2024-09-10T06:26:49.339 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_pool": "", 2024-09-10T06:26:49.339 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_journal_splay_width": "4", 2024-09-10T06:26:49.339 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_localize_parent_reads": "false", 2024-09-10T06:26:49.339 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_localize_snap_reads": "false", 2024-09-10T06:26:49.339 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-10T06:26:49.339 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-10T06:26:49.339 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-10T06:26:49.339 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-10T06:26:49.339 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-10T06:26:49.340 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-10T06:26:49.340 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-10T06:26:49.340 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-10T06:26:49.340 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-10T06:26:49.340 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-10T06:26:49.340 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-10T06:26:49.340 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-10T06:26:49.340 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-10T06:26:49.340 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-10T06:26:49.340 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-10T06:26:49.340 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-10T06:26:49.340 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-10T06:26:49.341 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-10T06:26:49.341 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-10T06:26:49.341 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-10T06:26:49.341 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-10T06:26:49.341 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-10T06:26:49.341 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-10T06:26:49.341 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-10T06:26:49.341 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-10T06:26:49.341 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-10T06:26:49.341 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-10T06:26:49.341 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-10T06:26:49.341 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-10T06:26:49.341 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-10T06:26:49.342 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-10T06:26:49.342 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_mtime_update_interval": "60", 2024-09-10T06:26:49.342 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_non_blocking_aio": "true", 2024-09-10T06:26:49.342 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_op_thread_timeout": "60", 2024-09-10T06:26:49.342 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_op_threads": "1", 2024-09-10T06:26:49.342 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_parent_cache_enabled": "false", 2024-09-10T06:26:49.342 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-10T06:26:49.342 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-10T06:26:49.342 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-10T06:26:49.342 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_plugins": "", 2024-09-10T06:26:49.342 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_bps_burst": "0", 2024-09-10T06:26:49.342 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-10T06:26:49.343 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_bps_limit": "0", 2024-09-10T06:26:49.343 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_exclude_ops": "0", 2024-09-10T06:26:49.343 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_iops_burst": "0", 2024-09-10T06:26:49.343 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-10T06:26:49.343 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_iops_limit": "0", 2024-09-10T06:26:49.343 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-10T06:26:49.343 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-10T06:26:49.343 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-10T06:26:49.344 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-10T06:26:49.344 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-10T06:26:49.344 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-10T06:26:49.344 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-10T06:26:49.344 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-10T06:26:49.344 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-10T06:26:49.344 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-10T06:26:49.344 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-10T06:26:49.344 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-10T06:26:49.344 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-10T06:26:49.344 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-10T06:26:49.344 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_read_from_replica_policy": "default", 2024-09-10T06:26:49.344 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-10T06:26:49.345 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-10T06:26:49.345 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-10T06:26:49.345 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-10T06:26:49.345 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_skip_partial_discard": "true", 2024-09-10T06:26:49.345 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-10T06:26:49.345 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_tracing": "false", 2024-09-10T06:26:49.345 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_validate_names": "true", 2024-09-10T06:26:49.345 INFO:teuthology.orchestra.run.smithi112.stdout: "rbd_validate_pool": "true", 2024-09-10T06:26:49.345 INFO:teuthology.orchestra.run.smithi112.stdout: "restapi_base_url": "", 2024-09-10T06:26:49.345 INFO:teuthology.orchestra.run.smithi112.stdout: "restapi_log_level": "", 2024-09-10T06:26:49.345 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-10T06:26:49.346 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-10T06:26:49.346 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_acl_grants_max_num": "100", 2024-09-10T06:26:49.346 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_admin_entry": "admin", 2024-09-10T06:26:49.346 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-10T06:26:49.346 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_asio_assert_yielding": "false", 2024-09-10T06:26:49.346 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_backend_store": "rados", 2024-09-10T06:26:49.346 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_barbican_url": "", 2024-09-10T06:26:49.346 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_beast_enable_async": "true", 2024-09-10T06:26:49.346 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_counters_cache": "false", 2024-09-10T06:26:49.346 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-10T06:26:49.346 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-10T06:26:49.346 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-10T06:26:49.346 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-10T06:26:49.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-10T06:26:49.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-10T06:26:49.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-10T06:26:49.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-10T06:26:49.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_cache_enabled": "true", 2024-09-10T06:26:49.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_cache_expiry_interval": "900", 2024-09-10T06:26:49.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_cache_lru_size": "25000", 2024-09-10T06:26:49.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_config_store": "rados", 2024-09-10T06:26:49.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_content_length_compat": "false", 2024-09-10T06:26:49.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_copy_obj_progress": "true", 2024-09-10T06:26:49.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-10T06:26:49.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_cors_rules_max_num": "100", 2024-09-10T06:26:49.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_cross_domain_policy": "", 2024-09-10T06:26:49.347 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-10T06:26:49.348 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_addr": "", 2024-09-10T06:26:49.348 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-10T06:26:49.348 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-10T06:26:49.348 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-10T06:26:49.348 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-10T06:26:49.348 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_password": "", 2024-09-10T06:26:49.348 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-10T06:26:49.348 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_kmip_username": "", 2024-09-10T06:26:49.348 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_require_ssl": "true", 2024-09-10T06:26:49.348 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-10T06:26:49.348 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-10T06:26:49.348 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-10T06:26:49.348 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-10T06:26:49.349 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-10T06:26:49.349 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-10T06:26:49.349 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-10T06:26:49.349 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-10T06:26:49.349 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-10T06:26:49.349 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-10T06:26:49.349 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-10T06:26:49.349 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-10T06:26:49.349 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-10T06:26:49.349 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-10T06:26:49.350 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-10T06:26:49.350 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_addr": "", 2024-09-10T06:26:49.350 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_auth": "token", 2024-09-10T06:26:49.350 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_namespace": "", 2024-09-10T06:26:49.350 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_prefix": "", 2024-09-10T06:26:49.350 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-10T06:26:49.350 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-10T06:26:49.350 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-10T06:26:49.350 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-10T06:26:49.350 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_token_file": "", 2024-09-10T06:26:49.350 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-10T06:26:49.350 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_curl_buffersize": "524288", 2024-09-10T06:26:49.350 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-10T06:26:49.351 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_curl_low_speed_time": "300", 2024-09-10T06:26:49.351 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-10T06:26:49.351 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-10T06:26:49.351 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-10T06:26:49.351 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-10T06:26:49.351 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-10T06:26:49.351 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-10T06:26:49.351 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-10T06:26:49.351 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-10T06:26:49.351 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-10T06:26:49.351 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-10T06:26:49.351 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-10T06:26:49.352 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-10T06:26:49.352 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-10T06:26:49.352 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-10T06:26:49.352 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-10T06:26:49.352 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-10T06:26:49.352 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-10T06:26:49.352 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-10T06:26:49.352 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-10T06:26:49.352 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data_log_changes_size": "1000", 2024-09-10T06:26:49.352 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data_log_num_shards": "128", 2024-09-10T06:26:49.352 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-10T06:26:49.352 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data_log_window": "30", 2024-09-10T06:26:49.353 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-10T06:26:49.353 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-10T06:26:49.353 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-10T06:26:49.353 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-10T06:26:49.353 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-10T06:26:49.353 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-10T06:26:49.353 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-10T06:26:49.353 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-10T06:26:49.353 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-10T06:26:49.353 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-10T06:26:49.353 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-10T06:26:49.354 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-10T06:26:49.354 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-10T06:26:49.354 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_disable_s3select": "false", 2024-09-10T06:26:49.354 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-10T06:26:49.354 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-10T06:26:49.354 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-10T06:26:49.354 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-10T06:26:49.354 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-10T06:26:49.354 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-10T06:26:49.354 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-10T06:26:49.354 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-10T06:26:49.355 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-10T06:26:49.355 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-10T06:26:49.355 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-10T06:26:49.355 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-10T06:26:49.355 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dns_name": "", 2024-09-10T06:26:49.355 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dns_s3website_name": "", 2024-09-10T06:26:49.355 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dynamic_resharding": "true", 2024-09-10T06:26:49.355 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-10T06:26:49.355 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-10T06:26:49.355 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-10T06:26:49.355 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_gc_threads": "true", 2024-09-10T06:26:49.355 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_lc_threads": "true", 2024-09-10T06:26:49.355 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_mdsearch": "true", 2024-09-10T06:26:49.356 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_ops_log": "false", 2024-09-10T06:26:49.356 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_quota_threads": "true", 2024-09-10T06:26:49.356 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_static_website": "false", 2024-09-10T06:26:49.356 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enable_usage_log": "false", 2024-09-10T06:26:49.356 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_enforce_swift_acls": "true", 2024-09-10T06:26:49.356 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_exit_timeout_secs": "120", 2024-09-10T06:26:49.356 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_expose_bucket": "false", 2024-09-10T06:26:49.356 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_extended_http_attrs": "", 2024-09-10T06:26:49.356 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_filter": "none", 2024-09-10T06:26:49.356 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-10T06:26:49.356 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_frontends": "beast port=7480", 2024-09-10T06:26:49.356 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-10T06:26:49.356 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_max_deferred": "50", 2024-09-10T06:26:49.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-10T06:26:49.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_max_objs": "32", 2024-09-10T06:26:49.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-10T06:26:49.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-10T06:26:49.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-10T06:26:49.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-10T06:26:49.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_gc_processor_period": "3600", 2024-09-10T06:26:49.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-10T06:26:49.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-10T06:26:49.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-10T06:26:49.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-10T06:26:49.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_init_timeout": "300", 2024-09-10T06:26:49.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-10T06:26:49.357 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-10T06:26:49.358 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_kafka_connection_idle": "300", 2024-09-10T06:26:49.358 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-10T06:26:49.358 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-10T06:26:49.358 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-10T06:26:49.358 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-10T06:26:49.358 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-10T06:26:49.358 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_domain": "", 2024-09-10T06:26:49.358 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_password": "", 2024-09-10T06:26:49.358 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_password_path": "", 2024-09-10T06:26:49.358 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_project": "", 2024-09-10T06:26:49.358 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_tenant": "", 2024-09-10T06:26:49.358 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_token": "", 2024-09-10T06:26:49.358 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_token_path": "", 2024-09-10T06:26:49.358 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_admin_user": "", 2024-09-10T06:26:49.359 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_barbican_domain": "", 2024-09-10T06:26:49.359 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_barbican_password": "", 2024-09-10T06:26:49.359 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_barbican_project": "", 2024-09-10T06:26:49.359 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-10T06:26:49.359 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_barbican_user": "", 2024-09-10T06:26:49.359 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-10T06:26:49.359 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-10T06:26:49.359 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-10T06:26:49.359 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-10T06:26:49.359 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-10T06:26:49.359 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_url": "", 2024-09-10T06:26:49.360 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-10T06:26:49.360 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lc_debug_interval": "-1", 2024-09-10T06:26:49.360 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lc_lock_max_time": "90", 2024-09-10T06:26:49.360 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lc_max_objs": "32", 2024-09-10T06:26:49.360 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lc_max_rules": "1000", 2024-09-10T06:26:49.360 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lc_max_worker": "3", 2024-09-10T06:26:49.360 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-10T06:26:49.360 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lc_thread_delay": "0", 2024-09-10T06:26:49.360 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-10T06:26:49.360 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ldap_dnattr": "uid", 2024-09-10T06:26:49.360 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-10T06:26:49.360 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ldap_searchfilter": "", 2024-09-10T06:26:49.360 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-10T06:26:49.361 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ldap_uri": "", 2024-09-10T06:26:49.361 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-10T06:26:49.361 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-10T06:26:49.361 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-10T06:26:49.361 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-10T06:26:49.361 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_log_http_headers": "", 2024-09-10T06:26:49.361 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-10T06:26:49.361 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-10T06:26:49.361 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_log_object_name_utc": "false", 2024-09-10T06:26:49.361 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-10T06:26:49.362 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-10T06:26:49.362 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_attr_name_len": "0", 2024-09-10T06:26:49.362 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_attr_size": "0", 2024-09-10T06:26:49.362 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-10T06:26:49.362 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_chunk_size": "4194304", 2024-09-10T06:26:49.362 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-10T06:26:49.363 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-10T06:26:49.363 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-10T06:26:49.363 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_listing_results": "1000", 2024-09-10T06:26:49.363 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_notify_retries": "10", 2024-09-10T06:26:49.363 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-10T06:26:49.363 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_put_param_size": "1048576", 2024-09-10T06:26:49.363 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_put_size": "5368709120", 2024-09-10T06:26:49.363 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_max_slo_entries": "1000", 2024-09-10T06:26:49.364 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_md_log_max_shards": "64", 2024-09-10T06:26:49.364 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-10T06:26:49.364 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-10T06:26:49.364 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-10T06:26:49.364 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-10T06:26:49.364 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_mp_lock_max_time": "600", 2024-09-10T06:26:49.364 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-10T06:26:49.364 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-10T06:26:49.364 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-10T06:26:49.364 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-10T06:26:49.365 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-10T06:26:49.365 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-10T06:26:49.365 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-10T06:26:49.365 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-10T06:26:49.365 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_max_gc": "300", 2024-09-10T06:26:49.365 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-10T06:26:49.365 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-10T06:26:49.365 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-10T06:26:49.365 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-10T06:26:49.365 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-10T06:26:49.365 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-10T06:26:49.365 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-10T06:26:49.365 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_num_async_rados_threads": "32", 2024-09-10T06:26:49.366 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_num_control_oids": "8", 2024-09-10T06:26:49.366 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_numa_node": "-1", 2024-09-10T06:26:49.366 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-10T06:26:49.366 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-10T06:26:49.366 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_objexp_chunk_size": "100", 2024-09-10T06:26:49.366 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_objexp_gc_interval": "600", 2024-09-10T06:26:49.366 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-10T06:26:49.366 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-10T06:26:49.366 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-10T06:26:49.366 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_op_thread_timeout": "600", 2024-09-10T06:26:49.366 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_op_tracing": "false", 2024-09-10T06:26:49.366 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_opa_token": "", 2024-09-10T06:26:49.366 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_opa_url": "", 2024-09-10T06:26:49.366 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_opa_verify_ssl": "true", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ops_log_rados": "false", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_ops_log_socket_path": "", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_period_push_interval": "2.000000", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_posix_cache_lanes": "3", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-10T06:26:49.367 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-10T06:26:49.368 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_posix_cache_partitions": "3", 2024-09-10T06:26:49.368 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-10T06:26:49.368 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_print_continue": "true", 2024-09-10T06:26:49.368 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-10T06:26:49.368 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-10T06:26:49.368 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-10T06:26:49.368 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-10T06:26:49.368 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-10T06:26:49.368 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_rados_tracing": "false", 2024-09-10T06:26:49.368 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_realm": "", 2024-09-10T06:26:49.368 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_realm_id": "", 2024-09-10T06:26:49.368 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-10T06:26:49.368 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_region": "", 2024-09-10T06:26:49.368 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_request_uri": "", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_reshard_batch_size": "64", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_reshard_max_aio": "128", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_reshard_num_logs": "16", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_reshard_thread_interval": "600", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_resolve_cname": "false", 2024-09-10T06:26:49.369 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_run_sync_thread": "true", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_scheduler_type": "throttler", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_script_uri": "", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_service_provider_name": "", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-10T06:26:49.370 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sts_client_id": "", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sts_client_secret": "", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sts_entry": "sts", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sts_key": "sts", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sts_min_session_duration": "900", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sts_token_introspection_url": "", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_account_in_url": "false", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_auth_entry": "auth", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_auth_url": "", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_custom_header": "", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_need_stats": "true", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_tenant_name": "", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_token_expiration": "86400", 2024-09-10T06:26:49.371 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_url": "", 2024-09-10T06:26:49.372 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_url_prefix": "swift", 2024-09-10T06:26:49.372 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-10T06:26:49.372 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-10T06:26:49.372 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-10T06:26:49.372 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_lease_period": "120", 2024-09-10T06:26:49.372 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-10T06:26:49.372 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-10T06:26:49.372 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-10T06:26:49.372 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-10T06:26:49.372 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-10T06:26:49.372 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-10T06:26:49.372 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-10T06:26:49.372 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-10T06:26:49.372 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-10T06:26:49.373 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_thread_pool_size": "512", 2024-09-10T06:26:49.373 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-10T06:26:49.373 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-10T06:26:49.373 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-10T06:26:49.373 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-10T06:26:49.373 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_comment": "", 2024-09-10T06:26:49.373 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_createby": "", 2024-09-10T06:26:49.373 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_encoding": "", 2024-09-10T06:26:49.373 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_flag": "false", 2024-09-10T06:26:49.373 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-10T06:26:49.373 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_origin": "", 2024-09-10T06:26:49.373 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-10T06:26:49.373 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_torrent_tracker": "", 2024-09-10T06:26:49.373 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_trust_forwarded_https": "false", 2024-09-10T06:26:49.374 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-10T06:26:49.374 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-10T06:26:49.374 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_usage_max_shards": "32", 2024-09-10T06:26:49.374 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_usage_max_user_shards": "1", 2024-09-10T06:26:49.374 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_use_opa_authz": "false", 2024-09-10T06:26:49.374 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_counters_cache": "false", 2024-09-10T06:26:49.374 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-10T06:26:49.374 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-10T06:26:49.374 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-10T06:26:49.374 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_max_buckets": "1000", 2024-09-10T06:26:49.374 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_policies_max_num": "100", 2024-09-10T06:26:49.374 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-10T06:26:49.375 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-10T06:26:49.375 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-10T06:26:49.375 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-10T06:26:49.375 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_user_unique_email": "true", 2024-09-10T06:26:49.375 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_verify_ssl": "true", 2024-09-10T06:26:49.375 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-10T06:26:49.375 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_zone": "", 2024-09-10T06:26:49.375 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_zone_id": "", 2024-09-10T06:26:49.375 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-10T06:26:49.375 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_zonegroup": "", 2024-09-10T06:26:49.375 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_zonegroup_id": "", 2024-09-10T06:26:49.375 INFO:teuthology.orchestra.run.smithi112.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-10T06:26:49.375 INFO:teuthology.orchestra.run.smithi112.stdout: "rgwlc_auto_session_clear": "true", 2024-09-10T06:26:49.376 INFO:teuthology.orchestra.run.smithi112.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-10T06:26:49.376 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_block_size": "4096", 2024-09-10T06:26:49.376 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-10T06:26:49.376 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-10T06:26:49.376 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-10T06:26:49.376 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-10T06:26:49.376 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-10T06:26:49.376 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cache_size": "536870912", 2024-09-10T06:26:49.376 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-10T06:26:49.376 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-10T06:26:49.376 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-10T06:26:49.376 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-10T06:26:49.376 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-10T06:26:49.376 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-10T06:26:49.377 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-10T06:26:49.377 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-10T06:26:49.377 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_index_type": "binary_search", 2024-09-10T06:26:49.377 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-10T06:26:49.377 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-10T06:26:49.377 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_partition_filters": "false", 2024-09-10T06:26:49.377 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_perf": "false", 2024-09-10T06:26:49.377 INFO:teuthology.orchestra.run.smithi112.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-10T06:26:49.377 INFO:teuthology.orchestra.run.smithi112.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-10T06:26:49.377 INFO:teuthology.orchestra.run.smithi112.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-10T06:26:49.377 INFO:teuthology.orchestra.run.smithi112.stdout: "run_dir": "/var/run/ceph", 2024-09-10T06:26:49.378 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_block_create": "true", 2024-09-10T06:26:49.378 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_cache_lru_size": "67108864", 2024-09-10T06:26:49.378 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-10T06:26:49.378 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-10T06:26:49.378 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_default_max_object_size": "16777216", 2024-09-10T06:26:49.378 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-10T06:26:49.378 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_device_size": "53687091200", 2024-09-10T06:26:49.378 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-10T06:26:49.378 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_full_integrity_check": "false", 2024-09-10T06:26:49.378 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_journal_batch_capacity": "16", 2024-09-10T06:26:49.378 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-10T06:26:49.378 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-10T06:26:49.379 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-10T06:26:49.379 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_main_device_type": "SSD", 2024-09-10T06:26:49.379 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-10T06:26:49.379 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-10T06:26:49.379 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-10T06:26:49.379 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-10T06:26:49.379 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-10T06:26:49.379 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-10T06:26:49.379 INFO:teuthology.orchestra.run.smithi112.stdout: "seastore_segment_size": "67108864", 2024-09-10T06:26:49.380 INFO:teuthology.orchestra.run.smithi112.stdout: "set_keepcaps": "false", 2024-09-10T06:26:49.380 INFO:teuthology.orchestra.run.smithi112.stdout: "setgroup": "", 2024-09-10T06:26:49.380 INFO:teuthology.orchestra.run.smithi112.stdout: "setuser": "", 2024-09-10T06:26:49.380 INFO:teuthology.orchestra.run.smithi112.stdout: "setuser_match_path": "", 2024-09-10T06:26:49.380 INFO:teuthology.orchestra.run.smithi112.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-10T06:26:49.380 INFO:teuthology.orchestra.run.smithi112.stdout: "thp": "false", 2024-09-10T06:26:49.380 INFO:teuthology.orchestra.run.smithi112.stdout: "threadpool_default_timeout": "60", 2024-09-10T06:26:49.380 INFO:teuthology.orchestra.run.smithi112.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-10T06:26:49.381 INFO:teuthology.orchestra.run.smithi112.stdout: "throttler_perf_counter": "true", 2024-09-10T06:26:49.381 INFO:teuthology.orchestra.run.smithi112.stdout: "tmp_dir": "/tmp", 2024-09-10T06:26:49.381 INFO:teuthology.orchestra.run.smithi112.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-10T06:26:49.381 INFO:teuthology.orchestra.run.smithi112.stdout: "uadk_compressor_enabled": "false", 2024-09-10T06:26:49.381 INFO:teuthology.orchestra.run.smithi112.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-10T06:26:49.381 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:26:49.383 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-10T06:26:49.526 INFO:teuthology.orchestra.run.smithi112.stdout:mon.a: {} 2024-09-10T06:26:49.527 INFO:teuthology.orchestra.run.smithi112.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T06:26:49.539 INFO:teuthology.orchestra.run.smithi112.stdout:mon.b: {} 2024-09-10T06:26:49.539 INFO:teuthology.orchestra.run.smithi112.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T06:26:49.548 INFO:teuthology.orchestra.run.smithi112.stdout:mon.c: {} 2024-09-10T06:26:49.548 INFO:teuthology.orchestra.run.smithi112.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T06:26:49.564 DEBUG:teuthology.orchestra.run.smithi112:> type ceph-objectstore-tool 2024-09-10T06:26:49.568 INFO:teuthology.orchestra.run.smithi112.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-10T06:26:49.568 DEBUG:teuthology.orchestra.run.smithi120:> type ceph-objectstore-tool 2024-09-10T06:26:49.573 INFO:teuthology.orchestra.run.smithi120.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-10T06:26:49.574 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T06:26:49.587 INFO:tasks.workunit:Pulling workunits from ref d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T06:26:49.588 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T06:26:49.588 DEBUG:teuthology.orchestra.run.smithi112:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T06:26:49.588 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-10T06:26:49.588 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-10T06:26:49.588 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-10T06:26:49.589 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-10T06:26:49.589 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-10T06:26:49.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:26:49.590 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-10T06:26:49.590 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:26:49.590 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-10T06:26:49.590 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T06:26:49.615 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:49.615+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:49.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:26:49.616 INFO:teuthology.orchestra.run.smithi112.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-10T06:26:49.616 DEBUG:teuthology.orchestra.run.smithi112:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-10T06:26:49.660 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-10T06:26:49.660 DEBUG:teuthology.orchestra.run.smithi112:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-10T06:26:49.703 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:49.704+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:26:49.707 INFO:tasks.workunit:timeout=3h 2024-09-10T06:26:49.707 INFO:tasks.workunit:cleanup=True 2024-09-10T06:26:49.708 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-10T06:26:49.728 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:26:49.728 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:26:49.729 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:26:49.729 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:26:49.733 INFO:tasks.workunit.client.0.smithi112.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T06:26:49.745 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:26:49.774 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:26:49.774 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:26:49.792 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:49.791+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:26:49.805 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:26:49.806 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:26:49.826 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:26:49.826 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:26:49.845 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:26:49.846 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:26:49.866 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:26:49.867 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:26:49.885 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:49.885 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:49.886 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:26:49.887 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:26:49.894 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:49.891+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:26:49.898 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:26:49.908 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:26:49.908 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:26:49.937 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:26:49.937 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:26:49.994 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:49.995+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:26:50.039 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:50.039 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:50.052 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:26:50.096 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:50.095+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:26:50.160 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:50.160 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:50.173 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:26:50.219 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:50.220+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:26:50.283 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:50.283 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:50.296 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:26:50.297 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:50.295+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:50.398 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:26:50.396+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:26:50.460 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:50.461 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:50.474 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:26:50.487 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-10T06:26:50.499 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:50.499+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:50.600 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:50.600+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:26:50.601 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:50.601 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:50.614 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:26:50.701 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:50.699+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:26:50.777 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:50.777 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:50.791 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:26:50.836 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:26:50.836+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:26:50.902 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:50.903+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:50.909 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:50.909 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:50.923 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:26:51.007 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:51.008+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:26:51.088 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:51.088 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:51.102 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:26:51.103 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:51.103+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:51.204 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:51.203+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:51.264 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:51.264 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:51.278 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:26:51.304 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:51.303+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:26:51.400 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:51.400 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:51.405 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:26:51.404+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:26:51.414 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:26:51.507 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:51.507+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:51.548 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:51.548 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:51.562 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:26:51.607 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:26:51.608+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:26:51.709 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:26:51.708+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:26:51.726 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:51.726 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:51.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:26:51.809 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:51.807+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:51.859 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:51.860 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:51.873 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:26:51.910 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:26:51.908+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:26:51.962 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:26:52.011 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:52.011+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:26:52.039 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:52.040 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:52.054 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:26:52.121 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:26:52.121 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:26:52.137 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:26:52.138 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:26:52.138 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:52.139+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:26:52.157 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:26:52.157 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:26:52.174 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:26:52.175 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:26:52.195 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:26:52.196 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:26:52.211 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:52.211 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:52.212 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:26:52.211+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:26:52.215 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:26:52.215 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:26:52.225 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:26:52.233 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:26:52.233 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:26:52.252 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:26:52.253 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:26:52.313 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:52.312+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:26:52.392 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:26:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:26:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:26:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:26:52.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4236.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-10T06:26:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:23.499464+0000", 2024-09-10T06:26:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.890923015999999, 2024-09-10T06:26:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013449099000000001, 2024-09-10T06:26:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4236", 2024-09-10T06:26:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1622831300", 2024-09-10T06:26:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1 2024-09-10T06:26:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499464+0000", 2024-09-10T06:26:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499464+0000", 2024-09-10T06:26:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499474+0000", 2024-09-10T06:26:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.004e-05 2024-09-10T06:26:52.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499488+0000", 2024-09-10T06:26:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3516000000000001e-05 2024-09-10T06:26:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499514+0000", 2024-09-10T06:26:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6310000000000001e-05 2024-09-10T06:26:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499538+0000", 2024-09-10T06:26:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3589000000000001e-05 2024-09-10T06:26:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.500297+0000", 2024-09-10T06:26:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000759908 2024-09-10T06:26:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:26:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.500351+0000", 2024-09-10T06:26:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3285999999999998e-05 2024-09-10T06:26:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.506506+0000", 2024-09-10T06:26:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061553090000000003 2024-09-10T06:26:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.506862+0000", 2024-09-10T06:26:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035549099999999999 2024-09-10T06:26:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:26:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.507143+0000", 2024-09-10T06:26:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000281964 2024-09-10T06:26:52.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.509394+0000", 2024-09-10T06:26:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022506700000000002 2024-09-10T06:26:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.512769+0000", 2024-09-10T06:26:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033745899999999998 2024-09-10T06:26:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.512850+0000", 2024-09-10T06:26:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1446000000000006e-05 2024-09-10T06:26:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.512913+0000", 2024-09-10T06:26:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2979999999999997e-05 2024-09-10T06:26:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4236.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-10T06:26:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:24.509270+0000", 2024-09-10T06:26:52.399 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.881117214, 2024-09-10T06:26:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068216769999999999, 2024-09-10T06:26:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4236", 2024-09-10T06:26:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1622831300", 2024-09-10T06:26:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5 2024-09-10T06:26:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509270+0000", 2024-09-10T06:26:52.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509270+0000", 2024-09-10T06:26:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509273+0000", 2024-09-10T06:26:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4199999999999999e-06 2024-09-10T06:26:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509288+0000", 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4732999999999999e-05 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509322+0000", 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3596000000000002e-05 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509345+0000", 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3767000000000001e-05 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509475+0000", 2024-09-10T06:26:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130099 2024-09-10T06:26:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:26:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509486+0000", 2024-09-10T06:26:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.083e-05 2024-09-10T06:26:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.512854+0000", 2024-09-10T06:26:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00336748 2024-09-10T06:26:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.513079+0000", 2024-09-10T06:26:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225565 2024-09-10T06:26:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:26:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.513291+0000", 2024-09-10T06:26:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021120199999999999 2024-09-10T06:26:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.514873+0000", 2024-09-10T06:26:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001582841 2024-09-10T06:26:52.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.515896+0000", 2024-09-10T06:26:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010226619999999999 2024-09-10T06:26:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.515976+0000", 2024-09-10T06:26:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0055999999999994e-05 2024-09-10T06:26:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.516092+0000", 2024-09-10T06:26:52.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115426 2024-09-10T06:26:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4236.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T06:26:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:25.528375+0000", 2024-09-10T06:26:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.862011698, 2024-09-10T06:26:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070604630000000003, 2024-09-10T06:26:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.406 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4236", 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1622831300", 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528375+0000", 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528375+0000", 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528379+0000", 2024-09-10T06:26:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.19e-06 2024-09-10T06:26:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528393+0000", 2024-09-10T06:26:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4474000000000001e-05 2024-09-10T06:26:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528429+0000", 2024-09-10T06:26:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6273000000000003e-05 2024-09-10T06:26:52.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528448+0000", 2024-09-10T06:26:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.827e-05 2024-09-10T06:26:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528578+0000", 2024-09-10T06:26:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013027899999999999 2024-09-10T06:26:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:26:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528588+0000", 2024-09-10T06:26:52.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.042e-05 2024-09-10T06:26:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.532249+0000", 2024-09-10T06:26:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003660955 2024-09-10T06:26:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.532448+0000", 2024-09-10T06:26:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019897799999999999 2024-09-10T06:26:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:26:52.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.532832+0000", 2024-09-10T06:26:52.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038408399999999998 2024-09-10T06:26:52.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.534422+0000", 2024-09-10T06:26:52.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001589708 2024-09-10T06:26:52.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.535279+0000", 2024-09-10T06:26:52.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00085695599999999997 2024-09-10T06:26:52.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.535365+0000", 2024-09-10T06:26:52.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6348999999999996e-05 2024-09-10T06:26:52.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.535436+0000", 2024-09-10T06:26:52.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0526999999999997e-05 2024-09-10T06:26:52.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.412 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.412 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4349.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:26:52.413 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:34.327633+0000", 2024-09-10T06:26:52.413 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.062754204000001, 2024-09-10T06:26:52.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031482849999999998, 2024-09-10T06:26:52.413 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.413 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.413 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4349", 2024-09-10T06:26:52.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:26:52.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 41 2024-09-10T06:26:52.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.413 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327633+0000", 2024-09-10T06:26:52.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327633+0000", 2024-09-10T06:26:52.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327635+0000", 2024-09-10T06:26:52.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4559999999999999e-06 2024-09-10T06:26:52.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327649+0000", 2024-09-10T06:26:52.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3380000000000001e-05 2024-09-10T06:26:52.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327680+0000", 2024-09-10T06:26:52.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1253e-05 2024-09-10T06:26:52.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327696+0000", 2024-09-10T06:26:52.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5736999999999999e-05 2024-09-10T06:26:52.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327890+0000", 2024-09-10T06:26:52.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000194468 2024-09-10T06:26:52.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.328116+0000", 2024-09-10T06:26:52.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225746 2024-09-10T06:26:52.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:26:52.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.328401+0000", 2024-09-10T06:26:52.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028469699999999999 2024-09-10T06:26:52.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.329688+0000", 2024-09-10T06:26:52.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001287327 2024-09-10T06:26:52.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.330628+0000", 2024-09-10T06:26:52.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094027599999999998 2024-09-10T06:26:52.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.330718+0000", 2024-09-10T06:26:52.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9676e-05 2024-09-10T06:26:52.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.330781+0000", 2024-09-10T06:26:52.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3268999999999993e-05 2024-09-10T06:26:52.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.418 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.419 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:26:52.419 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.297889+0000", 2024-09-10T06:26:52.419 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.092498496999999, 2024-09-10T06:26:52.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015273603, 2024-09-10T06:26:52.419 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.419 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.419 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:52.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:52.419 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48 2024-09-10T06:26:52.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.419 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297889+0000", 2024-09-10T06:26:52.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297889+0000", 2024-09-10T06:26:52.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297892+0000", 2024-09-10T06:26:52.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.703e-06 2024-09-10T06:26:52.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297905+0000", 2024-09-10T06:26:52.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2874000000000001e-05 2024-09-10T06:26:52.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297930+0000", 2024-09-10T06:26:52.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5029999999999999e-05 2024-09-10T06:26:52.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297946+0000", 2024-09-10T06:26:52.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5336e-05 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298133+0000", 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187725 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298154+0000", 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0953000000000001e-05 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.310851+0000", 2024-09-10T06:26:52.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012696522999999999 2024-09-10T06:26:52.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.311061+0000", 2024-09-10T06:26:52.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021023799999999999 2024-09-10T06:26:52.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:26:52.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.311247+0000", 2024-09-10T06:26:52.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018557900000000001 2024-09-10T06:26:52.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.312771+0000", 2024-09-10T06:26:52.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015244119999999999 2024-09-10T06:26:52.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.312957+0000", 2024-09-10T06:26:52.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000185885 2024-09-10T06:26:52.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313037+0000", 2024-09-10T06:26:52.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9802999999999995e-05 2024-09-10T06:26:52.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313162+0000", 2024-09-10T06:26:52.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000125542 2024-09-10T06:26:52.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.425 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.425 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94143734762752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:26:52.425 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.313369+0000", 2024-09-10T06:26:52.425 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.077017579, 2024-09-10T06:26:52.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034352330000000002, 2024-09-10T06:26:52.425 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.425 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:52.426 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:52.426 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49 2024-09-10T06:26:52.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.426 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313369+0000", 2024-09-10T06:26:52.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313369+0000", 2024-09-10T06:26:52.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313372+0000", 2024-09-10T06:26:52.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4830000000000002e-06 2024-09-10T06:26:52.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313384+0000", 2024-09-10T06:26:52.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2150000000000001e-05 2024-09-10T06:26:52.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313410+0000", 2024-09-10T06:26:52.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6356999999999999e-05 2024-09-10T06:26:52.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313425+0000", 2024-09-10T06:26:52.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.437e-05 2024-09-10T06:26:52.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313540+0000", 2024-09-10T06:26:52.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115555 2024-09-10T06:26:52.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313739+0000", 2024-09-10T06:26:52.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019832199999999999 2024-09-10T06:26:52.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:26:52.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.314101+0000", 2024-09-10T06:26:52.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036192499999999997 2024-09-10T06:26:52.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.315569+0000", 2024-09-10T06:26:52.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014680089999999999 2024-09-10T06:26:52.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.316489+0000", 2024-09-10T06:26:52.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00092051299999999997 2024-09-10T06:26:52.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.316623+0000", 2024-09-10T06:26:52.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013342399999999999 2024-09-10T06:26:52.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.316805+0000", 2024-09-10T06:26:52.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182125 2024-09-10T06:26:52.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.431 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.431 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:26:52.431 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.297211+0000", 2024-09-10T06:26:52.431 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.093175747, 2024-09-10T06:26:52.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041349439999999998, 2024-09-10T06:26:52.431 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.431 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.431 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297211+0000", 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297211+0000", 2024-09-10T06:26:52.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297215+0000", 2024-09-10T06:26:52.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1930000000000002e-06 2024-09-10T06:26:52.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297229+0000", 2024-09-10T06:26:52.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.472e-05 2024-09-10T06:26:52.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297265+0000", 2024-09-10T06:26:52.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5407000000000002e-05 2024-09-10T06:26:52.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297290+0000", 2024-09-10T06:26:52.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5153000000000001e-05 2024-09-10T06:26:52.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297482+0000", 2024-09-10T06:26:52.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019209199999999999 2024-09-10T06:26:52.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297721+0000", 2024-09-10T06:26:52.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023919499999999999 2024-09-10T06:26:52.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:26:52.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.298183+0000", 2024-09-10T06:26:52.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046180899999999998 2024-09-10T06:26:52.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.299918+0000", 2024-09-10T06:26:52.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001734827 2024-09-10T06:26:52.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.301183+0000", 2024-09-10T06:26:52.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001265347 2024-09-10T06:26:52.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.301273+0000", 2024-09-10T06:26:52.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0031999999999995e-05 2024-09-10T06:26:52.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.301346+0000", 2024-09-10T06:26:52.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3169000000000004e-05 2024-09-10T06:26:52.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.437 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.437 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:52.437 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.364287+0000", 2024-09-10T06:26:52.437 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.026100268, 2024-09-10T06:26:52.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003215922, 2024-09-10T06:26:52.437 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.437 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.437 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.437 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:52.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:52.438 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 220 2024-09-10T06:26:52.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.438 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364287+0000", 2024-09-10T06:26:52.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364287+0000", 2024-09-10T06:26:52.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364290+0000", 2024-09-10T06:26:52.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3340000000000002e-06 2024-09-10T06:26:52.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364305+0000", 2024-09-10T06:26:52.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4790000000000001e-05 2024-09-10T06:26:52.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364337+0000", 2024-09-10T06:26:52.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2425999999999998e-05 2024-09-10T06:26:52.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364353+0000", 2024-09-10T06:26:52.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5213e-05 2024-09-10T06:26:52.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364463+0000", 2024-09-10T06:26:52.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110126 2024-09-10T06:26:52.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364668+0000", 2024-09-10T06:26:52.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020534199999999999 2024-09-10T06:26:52.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:26:52.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.365077+0000", 2024-09-10T06:26:52.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040907999999999998 2024-09-10T06:26:52.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.366652+0000", 2024-09-10T06:26:52.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015746239999999999 2024-09-10T06:26:52.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.367350+0000", 2024-09-10T06:26:52.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069806100000000004 2024-09-10T06:26:52.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.367434+0000", 2024-09-10T06:26:52.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3819999999999994e-05 2024-09-10T06:26:52.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.367503+0000", 2024-09-10T06:26:52.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-10T06:26:52.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.443 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.443 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:52.443 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.374400+0000", 2024-09-10T06:26:52.443 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.015987146000001, 2024-09-10T06:26:52.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033158279999999998, 2024-09-10T06:26:52.443 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.443 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.443 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:52.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:52.444 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223 2024-09-10T06:26:52.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.444 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374400+0000", 2024-09-10T06:26:52.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374400+0000", 2024-09-10T06:26:52.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374402+0000", 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4030000000000001e-06 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374414+0000", 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1260000000000001e-05 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374447+0000", 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3149999999999999e-05 2024-09-10T06:26:52.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374462+0000", 2024-09-10T06:26:52.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5495999999999999e-05 2024-09-10T06:26:52.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374582+0000", 2024-09-10T06:26:52.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119999 2024-09-10T06:26:52.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374775+0000", 2024-09-10T06:26:52.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192556 2024-09-10T06:26:52.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:26:52.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.375157+0000", 2024-09-10T06:26:52.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038242700000000002 2024-09-10T06:26:52.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.376482+0000", 2024-09-10T06:26:52.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013249329999999999 2024-09-10T06:26:52.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.377533+0000", 2024-09-10T06:26:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010505759999999999 2024-09-10T06:26:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.377610+0000", 2024-09-10T06:26:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7179000000000001e-05 2024-09-10T06:26:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.377716+0000", 2024-09-10T06:26:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105849 2024-09-10T06:26:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.449 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:52.449 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.385071+0000", 2024-09-10T06:26:52.449 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.005316105, 2024-09-10T06:26:52.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034290969999999999, 2024-09-10T06:26:52.449 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.449 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.449 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:52.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:52.449 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 226 2024-09-10T06:26:52.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.450 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385071+0000", 2024-09-10T06:26:52.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385071+0000", 2024-09-10T06:26:52.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385073+0000", 2024-09-10T06:26:52.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4329999999999998e-06 2024-09-10T06:26:52.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385085+0000", 2024-09-10T06:26:52.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1372999999999999e-05 2024-09-10T06:26:52.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385117+0000", 2024-09-10T06:26:52.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1874e-05 2024-09-10T06:26:52.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385135+0000", 2024-09-10T06:26:52.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8419000000000001e-05 2024-09-10T06:26:52.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385263+0000", 2024-09-10T06:26:52.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012800600000000001 2024-09-10T06:26:52.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385459+0000", 2024-09-10T06:26:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000196128 2024-09-10T06:26:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:26:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385870+0000", 2024-09-10T06:26:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000410417 2024-09-10T06:26:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.387503+0000", 2024-09-10T06:26:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001633671 2024-09-10T06:26:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.388349+0000", 2024-09-10T06:26:52.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00084602400000000002 2024-09-10T06:26:52.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.388436+0000", 2024-09-10T06:26:52.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6706000000000006e-05 2024-09-10T06:26:52.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.388500+0000", 2024-09-10T06:26:52.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4046000000000003e-05 2024-09-10T06:26:52.455 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.455 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.455 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.455 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:52.455 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.413140+0000", 2024-09-10T06:26:52.455 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.977247122, 2024-09-10T06:26:52.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003240962, 2024-09-10T06:26:52.455 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.455 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.455 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413140+0000", 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413140+0000", 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413142+0000", 2024-09-10T06:26:52.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3999999999999999e-06 2024-09-10T06:26:52.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413153+0000", 2024-09-10T06:26:52.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.076e-05 2024-09-10T06:26:52.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413180+0000", 2024-09-10T06:26:52.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6746000000000001e-05 2024-09-10T06:26:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413195+0000", 2024-09-10T06:26:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4674e-05 2024-09-10T06:26:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413367+0000", 2024-09-10T06:26:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017253200000000001 2024-09-10T06:26:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413594+0000", 2024-09-10T06:26:52.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022710499999999999 2024-09-10T06:26:52.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:26:52.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.414064+0000", 2024-09-10T06:26:52.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046966599999999999 2024-09-10T06:26:52.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.415286+0000", 2024-09-10T06:26:52.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001222281 2024-09-10T06:26:52.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.416233+0000", 2024-09-10T06:26:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094718600000000003 2024-09-10T06:26:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.416320+0000", 2024-09-10T06:26:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6521999999999996e-05 2024-09-10T06:26:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.416381+0000", 2024-09-10T06:26:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.109e-05 2024-09-10T06:26:52.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.461 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.461 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.461 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:353 6.4 e34/28 6:25ca39bb:::obj_delete_at_hint.0000000005:head v 34'6, mlcod=34'4)", 2024-09-10T06:26:52.461 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.451186+0000", 2024-09-10T06:26:52.461 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.939201409000001, 2024-09-10T06:26:52.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050475579999999997, 2024-09-10T06:26:52.461 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.461 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.461 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.461 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451186+0000", 2024-09-10T06:26:52.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451186+0000", 2024-09-10T06:26:52.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451191+0000", 2024-09-10T06:26:52.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.677e-06 2024-09-10T06:26:52.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451202+0000", 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0777e-05 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451225+0000", 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3329999999999999e-05 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451237+0000", 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1226000000000001e-05 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451356+0000", 2024-09-10T06:26:52.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118989 2024-09-10T06:26:52.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451405+0000", 2024-09-10T06:26:52.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9395999999999999e-05 2024-09-10T06:26:52.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.456155+0000", 2024-09-10T06:26:52.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047504239999999996 2024-09-10T06:26:52.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.456233+0000", 2024-09-10T06:26:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7738999999999995e-05 2024-09-10T06:26:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:362 6.4 e34/28 6:25ca39bb:::obj_delete_at_hint.0000000005:head v 34'7, mlcod=34'5)", 2024-09-10T06:26:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.457483+0000", 2024-09-10T06:26:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.93290365, 2024-09-10T06:26:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036278249999999999, 2024-09-10T06:26:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457483+0000", 2024-09-10T06:26:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457483+0000", 2024-09-10T06:26:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457485+0000", 2024-09-10T06:26:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.573e-06 2024-09-10T06:26:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457496+0000", 2024-09-10T06:26:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1066999999999999e-05 2024-09-10T06:26:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457520+0000", 2024-09-10T06:26:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4108999999999999e-05 2024-09-10T06:26:52.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457533+0000", 2024-09-10T06:26:52.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.288e-05 2024-09-10T06:26:52.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457637+0000", 2024-09-10T06:26:52.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103836 2024-09-10T06:26:52.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457668+0000", 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1507000000000002e-05 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461014+0000", 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033451069999999999 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461111+0000", 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7745999999999996e-05 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.470 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:441 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:52.470 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.481408+0000", 2024-09-10T06:26:52.470 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.908979519000001, 2024-09-10T06:26:52.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076439680000000001, 2024-09-10T06:26:52.470 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.470 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.470 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:52.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:52.470 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 441 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481408+0000", 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481408+0000", 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481410+0000", 2024-09-10T06:26:52.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6539999999999999e-06 2024-09-10T06:26:52.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481428+0000", 2024-09-10T06:26:52.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7336000000000001e-05 2024-09-10T06:26:52.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481468+0000", 2024-09-10T06:26:52.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0062999999999999e-05 2024-09-10T06:26:52.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481494+0000", 2024-09-10T06:26:52.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6616999999999999e-05 2024-09-10T06:26:52.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481625+0000", 2024-09-10T06:26:52.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013042800000000001 2024-09-10T06:26:52.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481867+0000", 2024-09-10T06:26:52.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024220399999999999 2024-09-10T06:26:52.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.482325+0000", 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045814199999999998 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483548+0000", 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012227900000000001 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488857+0000", 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053088120000000004 2024-09-10T06:26:52.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488959+0000", 2024-09-10T06:26:52.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102787 2024-09-10T06:26:52.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489052+0000", 2024-09-10T06:26:52.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2134999999999998e-05 2024-09-10T06:26:52.475 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.475 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.475 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.476 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:444 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:52.476 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.483111+0000", 2024-09-10T06:26:52.476 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.907276332, 2024-09-10T06:26:52.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055206379999999996, 2024-09-10T06:26:52.476 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.476 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.476 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:52.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:52.476 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 444 2024-09-10T06:26:52.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.477 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483111+0000", 2024-09-10T06:26:52.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483111+0000", 2024-09-10T06:26:52.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483114+0000", 2024-09-10T06:26:52.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1300000000000001e-06 2024-09-10T06:26:52.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483128+0000", 2024-09-10T06:26:52.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4032999999999999e-05 2024-09-10T06:26:52.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483161+0000", 2024-09-10T06:26:52.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3062999999999998e-05 2024-09-10T06:26:52.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483181+0000", 2024-09-10T06:26:52.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0486999999999999e-05 2024-09-10T06:26:52.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483316+0000", 2024-09-10T06:26:52.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013411099999999999 2024-09-10T06:26:52.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483642+0000", 2024-09-10T06:26:52.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032656299999999998 2024-09-10T06:26:52.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:26:52.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484153+0000", 2024-09-10T06:26:52.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00051090200000000004 2024-09-10T06:26:52.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.485759+0000", 2024-09-10T06:26:52.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001606215 2024-09-10T06:26:52.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488482+0000", 2024-09-10T06:26:52.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027225079999999998 2024-09-10T06:26:52.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488569+0000", 2024-09-10T06:26:52.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7602999999999995e-05 2024-09-10T06:26:52.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488631+0000", 2024-09-10T06:26:52.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2022999999999999e-05 2024-09-10T06:26:52.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.481 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:453 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.489376+0000", 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.901011179999999, 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052737419999999997, 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 453 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.482 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489376+0000", 2024-09-10T06:26:52.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489376+0000", 2024-09-10T06:26:52.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489378+0000", 2024-09-10T06:26:52.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9470000000000002e-06 2024-09-10T06:26:52.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489385+0000", 2024-09-10T06:26:52.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5830000000000001e-06 2024-09-10T06:26:52.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489408+0000", 2024-09-10T06:26:52.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2739999999999999e-05 2024-09-10T06:26:52.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489418+0000", 2024-09-10T06:26:52.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8730000000000002e-06 2024-09-10T06:26:52.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.490351+0000", 2024-09-10T06:26:52.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093270600000000005 2024-09-10T06:26:52.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.490602+0000", 2024-09-10T06:26:52.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025102499999999999 2024-09-10T06:26:52.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.490955+0000", 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035311000000000001 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494256+0000", 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003301109 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494417+0000", 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016123799999999999 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494571+0000", 2024-09-10T06:26:52.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000153425 2024-09-10T06:26:52.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494650+0000", 2024-09-10T06:26:52.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8986000000000006e-05 2024-09-10T06:26:52.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.487 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.487 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:457 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:52.487 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.492971+0000", 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.897416118000001, 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038003139999999999, 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 457 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492971+0000", 2024-09-10T06:26:52.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492971+0000", 2024-09-10T06:26:52.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492973+0000", 2024-09-10T06:26:52.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0499999999999999e-06 2024-09-10T06:26:52.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492981+0000", 2024-09-10T06:26:52.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1200000000000002e-06 2024-09-10T06:26:52.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493005+0000", 2024-09-10T06:26:52.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4125999999999999e-05 2024-09-10T06:26:52.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493017+0000", 2024-09-10T06:26:52.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.148e-05 2024-09-10T06:26:52.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493092+0000", 2024-09-10T06:26:52.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5112999999999997e-05 2024-09-10T06:26:52.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493294+0000", 2024-09-10T06:26:52.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020212100000000001 2024-09-10T06:26:52.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:26:52.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493743+0000", 2024-09-10T06:26:52.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000449436 2024-09-10T06:26:52.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494855+0000", 2024-09-10T06:26:52.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00111181 2024-09-10T06:26:52.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.496621+0000", 2024-09-10T06:26:52.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017657090000000001 2024-09-10T06:26:52.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.496701+0000", 2024-09-10T06:26:52.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0259000000000005e-05 2024-09-10T06:26:52.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.496771+0000", 2024-09-10T06:26:52.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0090000000000001e-05 2024-09-10T06:26:52.493 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.493 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.493 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.493 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:477 6.4 e34/28 6:264a8785:::obj_delete_at_hint.0000000011:head v 34'11, mlcod=34'9)", 2024-09-10T06:26:52.493 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.505151+0000", 2024-09-10T06:26:52.493 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.885235711, 2024-09-10T06:26:52.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033063839999999999, 2024-09-10T06:26:52.494 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.494 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.494 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.494 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505151+0000", 2024-09-10T06:26:52.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505151+0000", 2024-09-10T06:26:52.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505153+0000", 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.697e-06 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505164+0000", 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1369000000000001e-05 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505185+0000", 2024-09-10T06:26:52.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0387999999999999e-05 2024-09-10T06:26:52.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505195+0000", 2024-09-10T06:26:52.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166000000000001e-05 2024-09-10T06:26:52.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505281+0000", 2024-09-10T06:26:52.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5605000000000005e-05 2024-09-10T06:26:52.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505314+0000", 2024-09-10T06:26:52.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3433000000000003e-05 2024-09-10T06:26:52.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.508336+0000", 2024-09-10T06:26:52.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003022313 2024-09-10T06:26:52.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.508458+0000", 2024-09-10T06:26:52.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121413 2024-09-10T06:26:52.497 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.498 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.498 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:513 6.1a e34/28 6:5c7e8a6d:reshard::reshard.0000000015:head v 34'2, mlcod=0'0)", 2024-09-10T06:26:52.498 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.532129+0000", 2024-09-10T06:26:52.498 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.85825767, 2024-09-10T06:26:52.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036491039999999998, 2024-09-10T06:26:52.498 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.498 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.498 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.498 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532129+0000", 2024-09-10T06:26:52.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532129+0000", 2024-09-10T06:26:52.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532132+0000", 2024-09-10T06:26:52.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2800000000000002e-06 2024-09-10T06:26:52.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532146+0000", 2024-09-10T06:26:52.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.452e-05 2024-09-10T06:26:52.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532190+0000", 2024-09-10T06:26:52.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3485999999999997e-05 2024-09-10T06:26:52.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532208+0000", 2024-09-10T06:26:52.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8450000000000001e-05 2024-09-10T06:26:52.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532338+0000", 2024-09-10T06:26:52.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129727 2024-09-10T06:26:52.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532382+0000", 2024-09-10T06:26:52.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4598999999999998e-05 2024-09-10T06:26:52.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535696+0000", 2024-09-10T06:26:52.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033139369999999999 2024-09-10T06:26:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535779+0000", 2024-09-10T06:26:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2105000000000001e-05 2024-09-10T06:26:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.243071+0000", 2024-09-10T06:26:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.147316127, 2024-09-10T06:26:52.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033924269999999999, 2024-09-10T06:26:52.503 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:52.503 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:52.503 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:52.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:52.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:52.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:52.503 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 952 2024-09-10T06:26:52.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.503 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:52.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:52.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243071+0000", 2024-09-10T06:26:52.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243071+0000", 2024-09-10T06:26:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243073+0000", 2024-09-10T06:26:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3659999999999999e-06 2024-09-10T06:26:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:52.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243085+0000", 2024-09-10T06:26:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1440000000000001e-05 2024-09-10T06:26:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243113+0000", 2024-09-10T06:26:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8717e-05 2024-09-10T06:26:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243130+0000", 2024-09-10T06:26:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6796999999999999e-05 2024-09-10T06:26:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:52.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243281+0000", 2024-09-10T06:26:52.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151228 2024-09-10T06:26:52.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:52.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243625+0000", 2024-09-10T06:26:52.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034360400000000001 2024-09-10T06:26:52.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:26:52.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.244161+0000", 2024-09-10T06:26:52.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00053615300000000004 2024-09-10T06:26:52.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.245360+0000", 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011983740000000001 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.246315+0000", 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095580299999999997 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.246400+0000", 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4075999999999999e-05 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:52.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:52.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:52.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.246463+0000", 2024-09-10T06:26:52.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3868999999999994e-05 2024-09-10T06:26:52.508 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.508 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.508 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.508 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:52.508 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:52.508 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:26:52.509 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:26:52.510 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:52.508+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:26:52.511 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T06:26:52.610 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:52.611+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:52.637 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:26:52.637 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:26:52.637 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:26:52.637 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:26:52.652 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:26:52.739 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:52.739+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:52.812 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:26:52.812+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:26:52.816 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:26:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:26:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:26:52.816 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:26:52.817 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:26:52.830 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:26:52.914 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:52.915+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:26:53.001 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:26:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:26:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:26:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:26:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4349.0:36 5.1f 5:ff606e21:::zone_info.dfef714d-986b-43cb-b095-512e386c9309:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:26:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:34.314860+0000", 2024-09-10T06:26:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.685605622000001, 2024-09-10T06:26:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003107603, 2024-09-10T06:26:53.001 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4349", 2024-09-10T06:26:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:26:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 36 2024-09-10T06:26:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314860+0000", 2024-09-10T06:26:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314860+0000", 2024-09-10T06:26:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314861+0000", 2024-09-10T06:26:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9069999999999999e-06 2024-09-10T06:26:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314871+0000", 2024-09-10T06:26:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2969999999999992e-06 2024-09-10T06:26:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314892+0000", 2024-09-10T06:26:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1443000000000001e-05 2024-09-10T06:26:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314904+0000", 2024-09-10T06:26:53.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2072999999999999e-05 2024-09-10T06:26:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.315021+0000", 2024-09-10T06:26:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117019 2024-09-10T06:26:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.315390+0000", 2024-09-10T06:26:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036879700000000003 2024-09-10T06:26:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:26:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.315847+0000", 2024-09-10T06:26:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045647599999999998 2024-09-10T06:26:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317460+0000", 2024-09-10T06:26:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001613172 2024-09-10T06:26:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317782+0000", 2024-09-10T06:26:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032208300000000003 2024-09-10T06:26:53.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317899+0000", 2024-09-10T06:26:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117549 2024-09-10T06:26:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317967+0000", 2024-09-10T06:26:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7787000000000007e-05 2024-09-10T06:26:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:26:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:26:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.720448115, 2024-09-10T06:26:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016848367, 2024-09-10T06:26:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 46 2024-09-10T06:26:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.008 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:26:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:26:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280021+0000", 2024-09-10T06:26:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0069999999999999e-06 2024-09-10T06:26:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280036+0000", 2024-09-10T06:26:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.483e-05 2024-09-10T06:26:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280070+0000", 2024-09-10T06:26:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4106000000000002e-05 2024-09-10T06:26:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280094+0000", 2024-09-10T06:26:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4037e-05 2024-09-10T06:26:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280246+0000", 2024-09-10T06:26:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000152199 2024-09-10T06:26:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:26:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280271+0000", 2024-09-10T06:26:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4581999999999999e-05 2024-09-10T06:26:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.289388+0000", 2024-09-10T06:26:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091175639999999999 2024-09-10T06:26:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.290774+0000", 2024-09-10T06:26:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013859860000000001 2024-09-10T06:26:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:26:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291069+0000", 2024-09-10T06:26:53.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000294534 2024-09-10T06:26:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295828+0000", 2024-09-10T06:26:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047595729999999996 2024-09-10T06:26:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296614+0000", 2024-09-10T06:26:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00078534700000000004 2024-09-10T06:26:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296759+0000", 2024-09-10T06:26:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014571300000000001 2024-09-10T06:26:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296865+0000", 2024-09-10T06:26:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105889 2024-09-10T06:26:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94143734761600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:26:53.014 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.297713+0000", 2024-09-10T06:26:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.702751924999999, 2024-09-10T06:26:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007058847, 2024-09-10T06:26:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47 2024-09-10T06:26:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297713+0000", 2024-09-10T06:26:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297713+0000", 2024-09-10T06:26:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297718+0000", 2024-09-10T06:26:53.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3329999999999998e-06 2024-09-10T06:26:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297733+0000", 2024-09-10T06:26:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5477000000000001e-05 2024-09-10T06:26:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297767+0000", 2024-09-10T06:26:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3859999999999998e-05 2024-09-10T06:26:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297793+0000", 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6455999999999999e-05 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297941+0000", 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014803599999999999 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298148+0000", 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020703299999999999 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298513+0000", 2024-09-10T06:26:53.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036422599999999999 2024-09-10T06:26:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304449+0000", 2024-09-10T06:26:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059367029999999998 2024-09-10T06:26:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304478+0000", 2024-09-10T06:26:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8836999999999999e-05 2024-09-10T06:26:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304599+0000", 2024-09-10T06:26:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012068100000000001 2024-09-10T06:26:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304772+0000", 2024-09-10T06:26:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017320500000000001 2024-09-10T06:26:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4358.0:47 7.1f e31/30 ondisk, result = 0)", 2024-09-10T06:26:53.020 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.300682+0000", 2024-09-10T06:26:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.699783447, 2024-09-10T06:26:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00409582, 2024-09-10T06:26:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-10T06:26:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300682+0000", 2024-09-10T06:26:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300682+0000", 2024-09-10T06:26:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300684+0000", 2024-09-10T06:26:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9829999999999999e-06 2024-09-10T06:26:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300695+0000", 2024-09-10T06:26:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1347e-05 2024-09-10T06:26:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300722+0000", 2024-09-10T06:26:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-05 2024-09-10T06:26:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300742+0000", 2024-09-10T06:26:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9772999999999999e-05 2024-09-10T06:26:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304416+0000", 2024-09-10T06:26:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036739339999999998 2024-09-10T06:26:53.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304436+0000", 2024-09-10T06:26:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9953999999999999e-05 2024-09-10T06:26:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304777+0000", 2024-09-10T06:26:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034188900000000001 2024-09-10T06:26:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94143734766208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:26:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.321434+0000", 2024-09-10T06:26:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.679030747000001, 2024-09-10T06:26:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002454211, 2024-09-10T06:26:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 55 2024-09-10T06:26:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.025 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321434+0000", 2024-09-10T06:26:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321434+0000", 2024-09-10T06:26:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321436+0000", 2024-09-10T06:26:53.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0490000000000002e-06 2024-09-10T06:26:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321446+0000", 2024-09-10T06:26:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5279999999999992e-06 2024-09-10T06:26:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321470+0000", 2024-09-10T06:26:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4377000000000001e-05 2024-09-10T06:26:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321485+0000", 2024-09-10T06:26:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4803e-05 2024-09-10T06:26:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321570+0000", 2024-09-10T06:26:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4926000000000006e-05 2024-09-10T06:26:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321665+0000", 2024-09-10T06:26:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4777000000000004e-05 2024-09-10T06:26:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321861+0000", 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000196658 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.322806+0000", 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094434399999999996 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.323736+0000", 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000930079 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.323796+0000", 2024-09-10T06:26:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9845e-05 2024-09-10T06:26:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.323889+0000", 2024-09-10T06:26:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2825000000000007e-05 2024-09-10T06:26:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.030 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:209 6.3 e34/28 6:c60da066:gc::gc.4:head v 34'1, mlcod=0'0)", 2024-09-10T06:26:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.320703+0000", 2024-09-10T06:26:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.679761831, 2024-09-10T06:26:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026023930000000002, 2024-09-10T06:26:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320703+0000", 2024-09-10T06:26:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320703+0000", 2024-09-10T06:26:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320704+0000", 2024-09-10T06:26:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7300000000000005e-07 2024-09-10T06:26:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320714+0000", 2024-09-10T06:26:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.041e-05 2024-09-10T06:26:53.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320762+0000", 2024-09-10T06:26:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7537000000000002e-05 2024-09-10T06:26:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320784+0000", 2024-09-10T06:26:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2243e-05 2024-09-10T06:26:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320934+0000", 2024-09-10T06:26:53.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014941499999999999 2024-09-10T06:26:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320982+0000", 2024-09-10T06:26:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8162999999999999e-05 2024-09-10T06:26:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.323191+0000", 2024-09-10T06:26:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002209253 2024-09-10T06:26:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.323306+0000", 2024-09-10T06:26:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011459900000000001 2024-09-10T06:26:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:354 6.3 e34/28 6:c3a682d4:reshard::reshard.0000000004:head v 34'4, mlcod=34'2)", 2024-09-10T06:26:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.453134+0000", 2024-09-10T06:26:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.547330643, 2024-09-10T06:26:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025721730000000001, 2024-09-10T06:26:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.035 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453134+0000", 2024-09-10T06:26:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453134+0000", 2024-09-10T06:26:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453137+0000", 2024-09-10T06:26:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.243e-06 2024-09-10T06:26:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453154+0000", 2024-09-10T06:26:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6906999999999999e-05 2024-09-10T06:26:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453193+0000", 2024-09-10T06:26:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9096e-05 2024-09-10T06:26:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453213+0000", 2024-09-10T06:26:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0233000000000001e-05 2024-09-10T06:26:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453362+0000", 2024-09-10T06:26:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921199999999999 2024-09-10T06:26:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453426+0000", 2024-09-10T06:26:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3410000000000004e-05 2024-09-10T06:26:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.455601+0000", 2024-09-10T06:26:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021758799999999998 2024-09-10T06:26:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.455707+0000", 2024-09-10T06:26:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010519200000000001 2024-09-10T06:26:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.039 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:363 6.3 e34/28 6:c3a682d4:reshard::reshard.0000000004:head v 34'5, mlcod=34'3)", 2024-09-10T06:26:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.458414+0000", 2024-09-10T06:26:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.542051447, 2024-09-10T06:26:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026506300000000002, 2024-09-10T06:26:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458414+0000", 2024-09-10T06:26:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458414+0000", 2024-09-10T06:26:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458416+0000", 2024-09-10T06:26:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1969999999999999e-06 2024-09-10T06:26:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458448+0000", 2024-09-10T06:26:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2298999999999997e-05 2024-09-10T06:26:53.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458482+0000", 2024-09-10T06:26:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3510000000000003e-05 2024-09-10T06:26:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458500+0000", 2024-09-10T06:26:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8216999999999999e-05 2024-09-10T06:26:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458649+0000", 2024-09-10T06:26:53.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000148839 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458708+0000", 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9045999999999997e-05 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.460969+0000", 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022612660000000001 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461064+0000", 2024-09-10T06:26:53.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5255999999999997e-05 2024-09-10T06:26:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:372 6.5 e34/28 6:a60f9269:lc::lua_package_allowlist:head v 34'2, mlcod=0'0)", 2024-09-10T06:26:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.461552+0000", 2024-09-10T06:26:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.538913601000001, 2024-09-10T06:26:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025753500000000001, 2024-09-10T06:26:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.044 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461552+0000", 2024-09-10T06:26:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461552+0000", 2024-09-10T06:26:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461553+0000", 2024-09-10T06:26:53.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7600000000000001e-06 2024-09-10T06:26:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461566+0000", 2024-09-10T06:26:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2986000000000001e-05 2024-09-10T06:26:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461598+0000", 2024-09-10T06:26:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2163999999999999e-05 2024-09-10T06:26:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461626+0000", 2024-09-10T06:26:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7883000000000001e-05 2024-09-10T06:26:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461752+0000", 2024-09-10T06:26:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012603500000000001 2024-09-10T06:26:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461801+0000", 2024-09-10T06:26:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8875999999999998e-05 2024-09-10T06:26:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.464036+0000", 2024-09-10T06:26:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022345730000000001 2024-09-10T06:26:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.464127+0000", 2024-09-10T06:26:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1073e-05 2024-09-10T06:26:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.048 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:377 6.c e34/28 6:3677c228:::obj_delete_at_hint.0000000006:head v 34'1, mlcod=0'0)", 2024-09-10T06:26:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.462034+0000", 2024-09-10T06:26:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.538430802000001, 2024-09-10T06:26:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050687509999999998, 2024-09-10T06:26:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462034+0000", 2024-09-10T06:26:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462034+0000", 2024-09-10T06:26:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462036+0000", 2024-09-10T06:26:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.827e-06 2024-09-10T06:26:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462048+0000", 2024-09-10T06:26:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1636e-05 2024-09-10T06:26:53.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462068+0000", 2024-09-10T06:26:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0463999999999999e-05 2024-09-10T06:26:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462082+0000", 2024-09-10T06:26:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4086e-05 2024-09-10T06:26:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462200+0000", 2024-09-10T06:26:53.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117769 2024-09-10T06:26:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462250+0000", 2024-09-10T06:26:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9790000000000003e-05 2024-09-10T06:26:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.466985+0000", 2024-09-10T06:26:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047353370000000001 2024-09-10T06:26:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.467103+0000", 2024-09-10T06:26:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117842 2024-09-10T06:26:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:436 6.c e34/28 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 34'4, mlcod=34'2)", 2024-09-10T06:26:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.479435+0000", 2024-09-10T06:26:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.521030096, 2024-09-10T06:26:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028578980000000002, 2024-09-10T06:26:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.053 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479435+0000", 2024-09-10T06:26:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479435+0000", 2024-09-10T06:26:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479437+0000", 2024-09-10T06:26:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.903e-06 2024-09-10T06:26:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479448+0000", 2024-09-10T06:26:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0654e-05 2024-09-10T06:26:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479472+0000", 2024-09-10T06:26:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4258999999999999e-05 2024-09-10T06:26:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479485+0000", 2024-09-10T06:26:53.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2904e-05 2024-09-10T06:26:53.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479622+0000", 2024-09-10T06:26:53.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013714200000000001 2024-09-10T06:26:53.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479674+0000", 2024-09-10T06:26:53.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2392999999999998e-05 2024-09-10T06:26:53.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.482187+0000", 2024-09-10T06:26:53.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025123039999999999 2024-09-10T06:26:53.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.482293+0000", 2024-09-10T06:26:53.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106339 2024-09-10T06:26:53.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.057 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.058 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:444 6.a e34/28 6:50d64734:::obj_delete_at_hint.0000000009:head v 34'2, mlcod=0'0)", 2024-09-10T06:26:53.058 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.484329+0000", 2024-09-10T06:26:53.058 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.516135976999999, 2024-09-10T06:26:53.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038926529999999998, 2024-09-10T06:26:53.058 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.058 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.058 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.058 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484329+0000", 2024-09-10T06:26:53.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484329+0000", 2024-09-10T06:26:53.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484331+0000", 2024-09-10T06:26:53.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.66e-06 2024-09-10T06:26:53.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484342+0000", 2024-09-10T06:26:53.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0986e-05 2024-09-10T06:26:53.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484366+0000", 2024-09-10T06:26:53.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4026999999999999e-05 2024-09-10T06:26:53.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484384+0000", 2024-09-10T06:26:53.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8147000000000001e-05 2024-09-10T06:26:53.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484525+0000", 2024-09-10T06:26:53.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014151499999999999 2024-09-10T06:26:53.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484595+0000", 2024-09-10T06:26:53.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9085999999999996e-05 2024-09-10T06:26:53.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488044+0000", 2024-09-10T06:26:53.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034494040000000001 2024-09-10T06:26:53.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488222+0000", 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017782799999999999 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:453 6.a e34/28 6:50d64734:::obj_delete_at_hint.0000000009:head v 34'4, mlcod=34'1)", 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.491119+0000", 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.509346403, 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026832829999999998, 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.063 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.063 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491119+0000", 2024-09-10T06:26:53.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491119+0000", 2024-09-10T06:26:53.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491121+0000", 2024-09-10T06:26:53.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2139999999999999e-06 2024-09-10T06:26:53.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491151+0000", 2024-09-10T06:26:53.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0499999999999999e-05 2024-09-10T06:26:53.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491178+0000", 2024-09-10T06:26:53.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6996999999999999e-05 2024-09-10T06:26:53.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491194+0000", 2024-09-10T06:26:53.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5831000000000001e-05 2024-09-10T06:26:53.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491325+0000", 2024-09-10T06:26:53.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013072600000000001 2024-09-10T06:26:53.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491377+0000", 2024-09-10T06:26:53.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1944000000000003e-05 2024-09-10T06:26:53.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493723+0000", 2024-09-10T06:26:53.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023455749999999999 2024-09-10T06:26:53.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493802+0000", 2024-09-10T06:26:53.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9495999999999999e-05 2024-09-10T06:26:53.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.066 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.067 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:478 6.1 e34/28 6:80b6fe23:reshard::reshard.0000000011:head v 34'3, mlcod=34'1)", 2024-09-10T06:26:53.067 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.505492+0000", 2024-09-10T06:26:53.067 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.494973175, 2024-09-10T06:26:53.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030300840000000002, 2024-09-10T06:26:53.067 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.067 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.067 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505492+0000", 2024-09-10T06:26:53.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505492+0000", 2024-09-10T06:26:53.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505494+0000", 2024-09-10T06:26:53.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.762e-06 2024-09-10T06:26:53.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505505+0000", 2024-09-10T06:26:53.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0998e-05 2024-09-10T06:26:53.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505528+0000", 2024-09-10T06:26:53.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3339000000000001e-05 2024-09-10T06:26:53.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505545+0000", 2024-09-10T06:26:53.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6991999999999999e-05 2024-09-10T06:26:53.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505697+0000", 2024-09-10T06:26:53.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015241500000000001 2024-09-10T06:26:53.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505746+0000", 2024-09-10T06:26:53.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8433000000000002e-05 2024-09-10T06:26:53.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.508413+0000", 2024-09-10T06:26:53.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026673360000000002 2024-09-10T06:26:53.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.508522+0000", 2024-09-10T06:26:53.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010880899999999999 2024-09-10T06:26:53.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.071 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.071 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:480 6.5 e34/28 6:a4a56432:::obj_delete_at_hint.0000000012:head v 34'4, mlcod=34'2)", 2024-09-10T06:26:53.071 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.509954+0000", 2024-09-10T06:26:53.071 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.490510936, 2024-09-10T06:26:53.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038074789999999999, 2024-09-10T06:26:53.071 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.072 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509954+0000", 2024-09-10T06:26:53.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509954+0000", 2024-09-10T06:26:53.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509955+0000", 2024-09-10T06:26:53.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.266e-06 2024-09-10T06:26:53.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509966+0000", 2024-09-10T06:26:53.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0900000000000001e-05 2024-09-10T06:26:53.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509993+0000", 2024-09-10T06:26:53.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6633999999999999e-05 2024-09-10T06:26:53.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.510011+0000", 2024-09-10T06:26:53.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-10T06:26:53.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.510141+0000", 2024-09-10T06:26:53.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130063 2024-09-10T06:26:53.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.510193+0000", 2024-09-10T06:26:53.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2011000000000001e-05 2024-09-10T06:26:53.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.513634+0000", 2024-09-10T06:26:53.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034407119999999999 2024-09-10T06:26:53.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.513762+0000", 2024-09-10T06:26:53.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012751599999999999 2024-09-10T06:26:53.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.075 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.076 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:485 6.5 e34/28 6:a7f90313:reshard::reshard.0000000012:head v 34'5, mlcod=34'2)", 2024-09-10T06:26:53.076 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.512302+0000", 2024-09-10T06:26:53.076 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.488162656, 2024-09-10T06:26:53.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041747709999999999, 2024-09-10T06:26:53.076 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.076 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.076 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.076 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512302+0000", 2024-09-10T06:26:53.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512302+0000", 2024-09-10T06:26:53.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512304+0000", 2024-09-10T06:26:53.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6929999999999999e-06 2024-09-10T06:26:53.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512318+0000", 2024-09-10T06:26:53.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.344e-05 2024-09-10T06:26:53.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512342+0000", 2024-09-10T06:26:53.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4456000000000001e-05 2024-09-10T06:26:53.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512354+0000", 2024-09-10T06:26:53.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2414e-05 2024-09-10T06:26:53.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512484+0000", 2024-09-10T06:26:53.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012974500000000001 2024-09-10T06:26:53.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512523+0000", 2024-09-10T06:26:53.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9124e-05 2024-09-10T06:26:53.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.516392+0000", 2024-09-10T06:26:53.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038686060000000001 2024-09-10T06:26:53.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.516477+0000", 2024-09-10T06:26:53.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5292999999999998e-05 2024-09-10T06:26:53.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.080 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.080 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:490 6.5 e34/28 6:a4a56432:::obj_delete_at_hint.0000000012:head v 34'6, mlcod=34'3)", 2024-09-10T06:26:53.080 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.515761+0000", 2024-09-10T06:26:53.080 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.484703629, 2024-09-10T06:26:53.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034429859999999999, 2024-09-10T06:26:53.080 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515761+0000", 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515761+0000", 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515764+0000", 2024-09-10T06:26:53.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2699999999999999e-06 2024-09-10T06:26:53.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515779+0000", 2024-09-10T06:26:53.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4973e-05 2024-09-10T06:26:53.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515812+0000", 2024-09-10T06:26:53.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3713000000000001e-05 2024-09-10T06:26:53.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515832+0000", 2024-09-10T06:26:53.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9176000000000001e-05 2024-09-10T06:26:53.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515956+0000", 2024-09-10T06:26:53.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123881 2024-09-10T06:26:53.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.516008+0000", 2024-09-10T06:26:53.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2703e-05 2024-09-10T06:26:53.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.519125+0000", 2024-09-10T06:26:53.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003117098 2024-09-10T06:26:53.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.519204+0000", 2024-09-10T06:26:53.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9171999999999993e-05 2024-09-10T06:26:53.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.084 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.085 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:493 6.5 e34/28 6:a7f90313:reshard::reshard.0000000012:head v 34'7, mlcod=34'4)", 2024-09-10T06:26:53.085 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.518455+0000", 2024-09-10T06:26:53.085 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.48200963, 2024-09-10T06:26:53.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027670849999999999, 2024-09-10T06:26:53.085 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.085 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.085 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.085 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518455+0000", 2024-09-10T06:26:53.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518455+0000", 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518458+0000", 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0159999999999998e-06 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518471+0000", 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.323e-05 2024-09-10T06:26:53.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518509+0000", 2024-09-10T06:26:53.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7942999999999999e-05 2024-09-10T06:26:53.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518528+0000", 2024-09-10T06:26:53.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9553000000000001e-05 2024-09-10T06:26:53.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518675+0000", 2024-09-10T06:26:53.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014679600000000001 2024-09-10T06:26:53.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518731+0000", 2024-09-10T06:26:53.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6302999999999999e-05 2024-09-10T06:26:53.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.521141+0000", 2024-09-10T06:26:53.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024091780000000001 2024-09-10T06:26:53.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.521223+0000", 2024-09-10T06:26:53.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2065999999999997e-05 2024-09-10T06:26:53.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.089 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.089 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:517 6.3 e34/28 6:c31f41d7:gc::gc.10:head v 34'11, mlcod=34'9)", 2024-09-10T06:26:53.089 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.533260+0000", 2024-09-10T06:26:53.089 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.467205408, 2024-09-10T06:26:53.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025463880000000001, 2024-09-10T06:26:53.089 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.089 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.089 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.090 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533260+0000", 2024-09-10T06:26:53.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533260+0000", 2024-09-10T06:26:53.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533261+0000", 2024-09-10T06:26:53.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.725e-06 2024-09-10T06:26:53.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533272+0000", 2024-09-10T06:26:53.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0569e-05 2024-09-10T06:26:53.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533300+0000", 2024-09-10T06:26:53.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7763000000000002e-05 2024-09-10T06:26:53.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533318+0000", 2024-09-10T06:26:53.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7805e-05 2024-09-10T06:26:53.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533457+0000", 2024-09-10T06:26:53.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139763 2024-09-10T06:26:53.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533493+0000", 2024-09-10T06:26:53.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6087000000000002e-05 2024-09-10T06:26:53.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535679+0000", 2024-09-10T06:26:53.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021851029999999999 2024-09-10T06:26:53.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535806+0000", 2024-09-10T06:26:53.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012757299999999999 2024-09-10T06:26:53.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.093 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.094 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:937 6.1f e34/28 6:fd6b5df8:::obj_delete_at_hint.0000000120:head v 34'10, mlcod=34'8)", 2024-09-10T06:26:53.094 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.208068+0000", 2024-09-10T06:26:53.094 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.792396963, 2024-09-10T06:26:53.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036467819999999999, 2024-09-10T06:26:53.094 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.094 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.094 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.094 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208068+0000", 2024-09-10T06:26:53.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208068+0000", 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208070+0000", 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.283e-06 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208083+0000", 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2303999999999999e-05 2024-09-10T06:26:53.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208111+0000", 2024-09-10T06:26:53.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8473e-05 2024-09-10T06:26:53.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208124+0000", 2024-09-10T06:26:53.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2866e-05 2024-09-10T06:26:53.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208273+0000", 2024-09-10T06:26:53.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014932300000000001 2024-09-10T06:26:53.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208312+0000", 2024-09-10T06:26:53.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8442999999999998e-05 2024-09-10T06:26:53.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.211643+0000", 2024-09-10T06:26:53.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033307609999999998 2024-09-10T06:26:53.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.211715+0000", 2024-09-10T06:26:53.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2329000000000005e-05 2024-09-10T06:26:53.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.098 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.098 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.098 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:26:53.100 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:26:53.100 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:26:53.099+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:26:53.200 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:26:53.199+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:26:53.269 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:26:53.269 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:26:53.269 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:26:53.269 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:26:53.285 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:26:53.331 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:53.331+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:53.402 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:53.403+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:26:53.453 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:26:53.454 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:26:53.454 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:26:53.454 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:26:53.454 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:26:53.467 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:26:53.514 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-10T06:26:53.519 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:26:53.519+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:26:53.593 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:26:53.594 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:26:53.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:26:53.594 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:26:53.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.594 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.594 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:26:53.594 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.147513596000003, 2024-09-10T06:26:53.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70775834699999995, 2024-09-10T06:26:53.594 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.594 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.595 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1 2024-09-10T06:26:53.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.595 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:26:53.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:26:53.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446852+0000", 2024-09-10T06:26:53.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.117e-06 2024-09-10T06:26:53.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446870+0000", 2024-09-10T06:26:53.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7569999999999999e-05 2024-09-10T06:26:53.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446892+0000", 2024-09-10T06:26:53.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2036e-05 2024-09-10T06:26:53.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446908+0000", 2024-09-10T06:26:53.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6719999999999999e-05 2024-09-10T06:26:53.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447040+0000", 2024-09-10T06:26:53.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013118299999999999 2024-09-10T06:26:53.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:26:53.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447054+0000", 2024-09-10T06:26:53.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4343e-05 2024-09-10T06:26:53.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.151730+0000", 2024-09-10T06:26:53.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70467560600000001 2024-09-10T06:26:53.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152054+0000", 2024-09-10T06:26:53.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032444100000000002 2024-09-10T06:26:53.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152404+0000", 2024-09-10T06:26:53.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000349938 2024-09-10T06:26:53.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.153773+0000", 2024-09-10T06:26:53.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013693620000000001 2024-09-10T06:26:53.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154454+0000", 2024-09-10T06:26:53.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068035800000000005 2024-09-10T06:26:53.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154544+0000", 2024-09-10T06:26:53.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0623000000000003e-05 2024-09-10T06:26:53.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154607+0000", 2024-09-10T06:26:53.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3050000000000001e-05 2024-09-10T06:26:53.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.601 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.601 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.601 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.601 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.283936+0000", 2024-09-10T06:26:53.601 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.310426061000001, 2024-09-10T06:26:53.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010619014, 2024-09-10T06:26:53.601 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.601 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.601 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 42 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283936+0000", 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283936+0000", 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283937+0000", 2024-09-10T06:26:53.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1699999999999997e-07 2024-09-10T06:26:53.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283943+0000", 2024-09-10T06:26:53.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.716e-06 2024-09-10T06:26:53.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283957+0000", 2024-09-10T06:26:53.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.438e-05 2024-09-10T06:26:53.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283966+0000", 2024-09-10T06:26:53.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1629999999999996e-06 2024-09-10T06:26:53.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.288081+0000", 2024-09-10T06:26:53.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041155260000000004 2024-09-10T06:26:53.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.288243+0000", 2024-09-10T06:26:53.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016151800000000001 2024-09-10T06:26:53.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.288447+0000", 2024-09-10T06:26:53.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000204009 2024-09-10T06:26:53.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.291733+0000", 2024-09-10T06:26:53.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032862970000000001 2024-09-10T06:26:53.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294272+0000", 2024-09-10T06:26:53.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025391910000000001 2024-09-10T06:26:53.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294437+0000", 2024-09-10T06:26:53.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016503500000000001 2024-09-10T06:26:53.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294555+0000", 2024-09-10T06:26:53.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118262 2024-09-10T06:26:53.606 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284185+0000", 2024-09-10T06:26:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.310177113000002, 2024-09-10T06:26:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010770666, 2024-09-10T06:26:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.607 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.608 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 43 2024-09-10T06:26:53.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.608 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284185+0000", 2024-09-10T06:26:53.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284185+0000", 2024-09-10T06:26:53.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284187+0000", 2024-09-10T06:26:53.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.424e-06 2024-09-10T06:26:53.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284194+0000", 2024-09-10T06:26:53.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5100000000000001e-06 2024-09-10T06:26:53.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284207+0000", 2024-09-10T06:26:53.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2173e-05 2024-09-10T06:26:53.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284214+0000", 2024-09-10T06:26:53.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9160000000000001e-06 2024-09-10T06:26:53.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.289407+0000", 2024-09-10T06:26:53.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005192543 2024-09-10T06:26:53.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.289526+0000", 2024-09-10T06:26:53.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119156 2024-09-10T06:26:53.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.289722+0000", 2024-09-10T06:26:53.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019601199999999999 2024-09-10T06:26:53.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294577+0000", 2024-09-10T06:26:53.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048552719999999999 2024-09-10T06:26:53.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294689+0000", 2024-09-10T06:26:53.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111859 2024-09-10T06:26:53.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294841+0000", 2024-09-10T06:26:53.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015141899999999999 2024-09-10T06:26:53.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294956+0000", 2024-09-10T06:26:53.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115382 2024-09-10T06:26:53.613 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.613 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.613 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.613 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.613 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284355+0000", 2024-09-10T06:26:53.613 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.310007517999999, 2024-09-10T06:26:53.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010886453000000001, 2024-09-10T06:26:53.613 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.614 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44 2024-09-10T06:26:53.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.614 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284355+0000", 2024-09-10T06:26:53.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284355+0000", 2024-09-10T06:26:53.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284356+0000", 2024-09-10T06:26:53.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.387e-06 2024-09-10T06:26:53.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284491+0000", 2024-09-10T06:26:53.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414899999999999 2024-09-10T06:26:53.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284524+0000", 2024-09-10T06:26:53.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3019999999999999e-05 2024-09-10T06:26:53.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284534+0000", 2024-09-10T06:26:53.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0682999999999999e-05 2024-09-10T06:26:53.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.290328+0000", 2024-09-10T06:26:53.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057935419999999996 2024-09-10T06:26:53.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.290474+0000", 2024-09-10T06:26:53.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014634500000000001 2024-09-10T06:26:53.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.290686+0000", 2024-09-10T06:26:53.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021220599999999999 2024-09-10T06:26:53.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294993+0000", 2024-09-10T06:26:53.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043067160000000004 2024-09-10T06:26:53.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295116+0000", 2024-09-10T06:26:53.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123416 2024-09-10T06:26:53.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295190+0000", 2024-09-10T06:26:53.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3325999999999996e-05 2024-09-10T06:26:53.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295241+0000", 2024-09-10T06:26:53.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1663000000000003e-05 2024-09-10T06:26:53.619 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.619 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.619 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.619 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.619 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284582+0000", 2024-09-10T06:26:53.619 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.309780242000002, 2024-09-10T06:26:53.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013156691, 2024-09-10T06:26:53.619 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.619 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.620 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.620 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.620 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.620 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45 2024-09-10T06:26:53.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.620 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284582+0000", 2024-09-10T06:26:53.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284582+0000", 2024-09-10T06:26:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284584+0000", 2024-09-10T06:26:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.443e-06 2024-09-10T06:26:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284614+0000", 2024-09-10T06:26:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9839999999999999e-05 2024-09-10T06:26:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284633+0000", 2024-09-10T06:26:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9446e-05 2024-09-10T06:26:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284642+0000", 2024-09-10T06:26:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0899999999999994e-06 2024-09-10T06:26:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.291833+0000", 2024-09-10T06:26:53.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071913380000000002 2024-09-10T06:26:53.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.291959+0000", 2024-09-10T06:26:53.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012549499999999999 2024-09-10T06:26:53.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.292160+0000", 2024-09-10T06:26:53.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020070900000000001 2024-09-10T06:26:53.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295013+0000", 2024-09-10T06:26:53.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028534509999999999 2024-09-10T06:26:53.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297598+0000", 2024-09-10T06:26:53.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025848400000000001 2024-09-10T06:26:53.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297674+0000", 2024-09-10T06:26:53.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6515999999999997e-05 2024-09-10T06:26:53.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297739+0000", 2024-09-10T06:26:53.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4523000000000005e-05 2024-09-10T06:26:53.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.625 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.625 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.625 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284661+0000", 2024-09-10T06:26:53.625 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.309701863000001, 2024-09-10T06:26:53.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015677505000000001, 2024-09-10T06:26:53.625 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.626 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.626 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.626 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 46 2024-09-10T06:26:53.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.626 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284661+0000", 2024-09-10T06:26:53.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284661+0000", 2024-09-10T06:26:53.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284662+0000", 2024-09-10T06:26:53.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4e-07 2024-09-10T06:26:53.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284668+0000", 2024-09-10T06:26:53.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-10T06:26:53.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284681+0000", 2024-09-10T06:26:53.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3644e-05 2024-09-10T06:26:53.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284689+0000", 2024-09-10T06:26:53.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4159999999999998e-06 2024-09-10T06:26:53.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.292881+0000", 2024-09-10T06:26:53.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081926929999999992 2024-09-10T06:26:53.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.293129+0000", 2024-09-10T06:26:53.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024731900000000002 2024-09-10T06:26:53.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.293518+0000", 2024-09-10T06:26:53.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038924700000000001 2024-09-10T06:26:53.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297510+0000", 2024-09-10T06:26:53.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039916220000000002 2024-09-10T06:26:53.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300194+0000", 2024-09-10T06:26:53.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002684053 2024-09-10T06:26:53.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300275+0000", 2024-09-10T06:26:53.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1369e-05 2024-09-10T06:26:53.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300338+0000", 2024-09-10T06:26:53.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3225999999999994e-05 2024-09-10T06:26:53.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.631 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.631 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.631 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284708+0000", 2024-09-10T06:26:53.632 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.309654217000002, 2024-09-10T06:26:53.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015911141, 2024-09-10T06:26:53.632 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.632 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.632 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.632 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47 2024-09-10T06:26:53.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.632 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284708+0000", 2024-09-10T06:26:53.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284708+0000", 2024-09-10T06:26:53.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284709+0000", 2024-09-10T06:26:53.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7400000000000003e-07 2024-09-10T06:26:53.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284790+0000", 2024-09-10T06:26:53.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1151999999999998e-05 2024-09-10T06:26:53.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284801+0000", 2024-09-10T06:26:53.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.115e-05 2024-09-10T06:26:53.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284809+0000", 2024-09-10T06:26:53.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-09-10T06:26:53.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295333+0000", 2024-09-10T06:26:53.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010523858000000001 2024-09-10T06:26:53.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295456+0000", 2024-09-10T06:26:53.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123492 2024-09-10T06:26:53.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295692+0000", 2024-09-10T06:26:53.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023550900000000001 2024-09-10T06:26:53.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298813+0000", 2024-09-10T06:26:53.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031209190000000002 2024-09-10T06:26:53.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300487+0000", 2024-09-10T06:26:53.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001673997 2024-09-10T06:26:53.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300564+0000", 2024-09-10T06:26:53.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7522999999999996e-05 2024-09-10T06:26:53.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300619+0000", 2024-09-10T06:26:53.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5189999999999998e-05 2024-09-10T06:26:53.637 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.638 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.638 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.638 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.638 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:26:53.638 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.309517927999998, 2024-09-10T06:26:53.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015989453000000001, 2024-09-10T06:26:53.638 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.638 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.638 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.638 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.638 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.638 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.639 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48 2024-09-10T06:26:53.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.639 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:26:53.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:26:53.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:26:53.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8400000000000003e-07 2024-09-10T06:26:53.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284851+0000", 2024-09-10T06:26:53.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.993e-06 2024-09-10T06:26:53.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284873+0000", 2024-09-10T06:26:53.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1319999999999999e-05 2024-09-10T06:26:53.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284894+0000", 2024-09-10T06:26:53.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1265999999999999e-05 2024-09-10T06:26:53.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.296618+0000", 2024-09-10T06:26:53.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011724106 2024-09-10T06:26:53.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.296750+0000", 2024-09-10T06:26:53.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013185200000000001 2024-09-10T06:26:53.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.296946+0000", 2024-09-10T06:26:53.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000195832 2024-09-10T06:26:53.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300394+0000", 2024-09-10T06:26:53.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034477570000000001 2024-09-10T06:26:53.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300717+0000", 2024-09-10T06:26:53.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032347399999999997 2024-09-10T06:26:53.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300783+0000", 2024-09-10T06:26:53.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6093000000000006e-05 2024-09-10T06:26:53.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300834+0000", 2024-09-10T06:26:53.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0976000000000001e-05 2024-09-10T06:26:53.644 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.644 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.644 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.644 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.644 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284913+0000", 2024-09-10T06:26:53.644 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.309449942000001, 2024-09-10T06:26:53.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017983938000000001, 2024-09-10T06:26:53.644 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.644 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.644 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.645 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.645 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.645 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.645 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49 2024-09-10T06:26:53.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.645 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284913+0000", 2024-09-10T06:26:53.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284913+0000", 2024-09-10T06:26:53.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284914+0000", 2024-09-10T06:26:53.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300000000000001e-06 2024-09-10T06:26:53.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284920+0000", 2024-09-10T06:26:53.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5100000000000004e-06 2024-09-10T06:26:53.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284931+0000", 2024-09-10T06:26:53.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0857e-05 2024-09-10T06:26:53.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284938+0000", 2024-09-10T06:26:53.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1130000000000003e-06 2024-09-10T06:26:53.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297873+0000", 2024-09-10T06:26:53.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012934863 2024-09-10T06:26:53.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298041+0000", 2024-09-10T06:26:53.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016838899999999999 2024-09-10T06:26:53.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298237+0000", 2024-09-10T06:26:53.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019565199999999999 2024-09-10T06:26:53.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300859+0000", 2024-09-10T06:26:53.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026216099999999999 2024-09-10T06:26:53.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302759+0000", 2024-09-10T06:26:53.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019006819999999999 2024-09-10T06:26:53.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302835+0000", 2024-09-10T06:26:53.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5636000000000006e-05 2024-09-10T06:26:53.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302897+0000", 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1595999999999998e-05 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.309407925000002, 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019245090999999999, 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.650 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.651 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.651 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.651 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.651 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 50 2024-09-10T06:26:53.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.651 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:26:53.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:26:53.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:26:53.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3e-07 2024-09-10T06:26:53.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285037+0000", 2024-09-10T06:26:53.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2008999999999994e-05 2024-09-10T06:26:53.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285049+0000", 2024-09-10T06:26:53.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1816e-05 2024-09-10T06:26:53.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285057+0000", 2024-09-10T06:26:53.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8639999999999996e-06 2024-09-10T06:26:53.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298896+0000", 2024-09-10T06:26:53.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013838743000000001 2024-09-10T06:26:53.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.299025+0000", 2024-09-10T06:26:53.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129352 2024-09-10T06:26:53.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.299222+0000", 2024-09-10T06:26:53.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019682200000000001 2024-09-10T06:26:53.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302676+0000", 2024-09-10T06:26:53.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00345371 2024-09-10T06:26:53.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304050+0000", 2024-09-10T06:26:53.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001374779 2024-09-10T06:26:53.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304135+0000", 2024-09-10T06:26:53.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4640000000000003e-05 2024-09-10T06:26:53.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304200+0000", 2024-09-10T06:26:53.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4626000000000001e-05 2024-09-10T06:26:53.656 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.656 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.656 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.656 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.656 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:26:53.656 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.309285676000002, 2024-09-10T06:26:53.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021819150999999998, 2024-09-10T06:26:53.657 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.657 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.657 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.657 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 51 2024-09-10T06:26:53.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.657 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:26:53.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:26:53.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285078+0000", 2024-09-10T06:26:53.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000001e-07 2024-09-10T06:26:53.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285083+0000", 2024-09-10T06:26:53.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6099999999999997e-06 2024-09-10T06:26:53.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285092+0000", 2024-09-10T06:26:53.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2399999999999996e-06 2024-09-10T06:26:53.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285100+0000", 2024-09-10T06:26:53.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8739999999999995e-06 2024-09-10T06:26:53.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300938+0000", 2024-09-10T06:26:53.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015837527000000001 2024-09-10T06:26:53.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301058+0000", 2024-09-10T06:26:53.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012032300000000001 2024-09-10T06:26:53.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301251+0000", 2024-09-10T06:26:53.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192828 2024-09-10T06:26:53.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302937+0000", 2024-09-10T06:26:53.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016857339999999999 2024-09-10T06:26:53.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306745+0000", 2024-09-10T06:26:53.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038078729999999998 2024-09-10T06:26:53.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306830+0000", 2024-09-10T06:26:53.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5432999999999993e-05 2024-09-10T06:26:53.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306896+0000", 2024-09-10T06:26:53.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5993000000000003e-05 2024-09-10T06:26:53.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.662 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.662 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.663 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:26:53.663 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.309245799999999, 2024-09-10T06:26:53.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021995553000000001, 2024-09-10T06:26:53.663 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.663 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.663 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.663 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 52 2024-09-10T06:26:53.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.663 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:26:53.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:26:53.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:26:53.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4000000000000001e-07 2024-09-10T06:26:53.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285123+0000", 2024-09-10T06:26:53.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6969999999999998e-06 2024-09-10T06:26:53.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285132+0000", 2024-09-10T06:26:53.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1560000000000001e-06 2024-09-10T06:26:53.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285139+0000", 2024-09-10T06:26:53.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1539999999999996e-06 2024-09-10T06:26:53.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301865+0000", 2024-09-10T06:26:53.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016725173999999999 2024-09-10T06:26:53.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301995+0000", 2024-09-10T06:26:53.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130739 2024-09-10T06:26:53.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302195+0000", 2024-09-10T06:26:53.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000199965 2024-09-10T06:26:53.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.303135+0000", 2024-09-10T06:26:53.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093978300000000002 2024-09-10T06:26:53.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306979+0000", 2024-09-10T06:26:53.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038437459999999999 2024-09-10T06:26:53.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307057+0000", 2024-09-10T06:26:53.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7766e-05 2024-09-10T06:26:53.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307112+0000", 2024-09-10T06:26:53.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5733000000000003e-05 2024-09-10T06:26:53.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.668 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.668 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.669 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529402+0000", 2024-09-10T06:26:53.669 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.064960491999997, 2024-09-10T06:26:53.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011777342, 2024-09-10T06:26:53.669 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.669 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.669 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.669 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.669 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.669 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.669 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 69 2024-09-10T06:26:53.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.669 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529402+0000", 2024-09-10T06:26:53.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529402+0000", 2024-09-10T06:26:53.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529403+0000", 2024-09-10T06:26:53.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0499999999999999e-06 2024-09-10T06:26:53.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529550+0000", 2024-09-10T06:26:53.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146549 2024-09-10T06:26:53.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529564+0000", 2024-09-10T06:26:53.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4572999999999999e-05 2024-09-10T06:26:53.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529573+0000", 2024-09-10T06:26:53.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0429999999999996e-06 2024-09-10T06:26:53.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532154+0000", 2024-09-10T06:26:53.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025812209999999999 2024-09-10T06:26:53.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532208+0000", 2024-09-10T06:26:53.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3127000000000001e-05 2024-09-10T06:26:53.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532301+0000", 2024-09-10T06:26:53.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3567999999999996e-05 2024-09-10T06:26:53.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533640+0000", 2024-09-10T06:26:53.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001338679 2024-09-10T06:26:53.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541107+0000", 2024-09-10T06:26:53.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074675660000000001 2024-09-10T06:26:53.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541144+0000", 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6196999999999999e-05 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541179+0000", 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5769000000000003e-05 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.674 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529592+0000", 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.064770443, 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011685376000000001, 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529592+0000", 2024-09-10T06:26:53.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529592+0000", 2024-09-10T06:26:53.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529593+0000", 2024-09-10T06:26:53.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9600000000000008e-07 2024-09-10T06:26:53.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529600+0000", 2024-09-10T06:26:53.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9870000000000002e-06 2024-09-10T06:26:53.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529610+0000", 2024-09-10T06:26:53.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9399999999999997e-06 2024-09-10T06:26:53.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529617+0000", 2024-09-10T06:26:53.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2370000000000003e-06 2024-09-10T06:26:53.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532907+0000", 2024-09-10T06:26:53.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032897930000000001 2024-09-10T06:26:53.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532977+0000", 2024-09-10T06:26:53.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0308999999999994e-05 2024-09-10T06:26:53.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533073+0000", 2024-09-10T06:26:53.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5461e-05 2024-09-10T06:26:53.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536700+0000", 2024-09-10T06:26:53.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036268329999999999 2024-09-10T06:26:53.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541212+0000", 2024-09-10T06:26:53.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045119679999999999 2024-09-10T06:26:53.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541252+0000", 2024-09-10T06:26:53.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0472000000000001e-05 2024-09-10T06:26:53.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541277+0000", 2024-09-10T06:26:53.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5380000000000001e-05 2024-09-10T06:26:53.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.680 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.681 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.681 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529632+0000", 2024-09-10T06:26:53.681 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.06473072, 2024-09-10T06:26:53.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011740044999999999, 2024-09-10T06:26:53.681 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.681 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.681 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.681 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529632+0000", 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529632+0000", 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529633+0000", 2024-09-10T06:26:53.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9299999999999997e-07 2024-09-10T06:26:53.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529638+0000", 2024-09-10T06:26:53.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4559999999999999e-06 2024-09-10T06:26:53.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529648+0000", 2024-09-10T06:26:53.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5170000000000005e-06 2024-09-10T06:26:53.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529654+0000", 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6669999999999999e-06 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533778+0000", 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041238220000000001 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533846+0000", 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7448999999999997e-05 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533939+0000", 2024-09-10T06:26:53.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-10T06:26:53.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537278+0000", 2024-09-10T06:26:53.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033388580000000001 2024-09-10T06:26:53.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541309+0000", 2024-09-10T06:26:53.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040306389999999999 2024-09-10T06:26:53.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541348+0000", 2024-09-10T06:26:53.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9536000000000002e-05 2024-09-10T06:26:53.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541372+0000", 2024-09-10T06:26:53.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3587e-05 2024-09-10T06:26:53.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.686 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.064689831000003, 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011791240999999999, 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:26:53.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:26:53.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:26:53.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8700000000000005e-07 2024-09-10T06:26:53.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529846+0000", 2024-09-10T06:26:53.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017278199999999999 2024-09-10T06:26:53.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529890+0000", 2024-09-10T06:26:53.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3466e-05 2024-09-10T06:26:53.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529903+0000", 2024-09-10T06:26:53.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3327e-05 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.534254+0000", 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043508389999999996 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.534311+0000", 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7405999999999999e-05 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.534406+0000", 2024-09-10T06:26:53.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4671000000000002e-05 2024-09-10T06:26:53.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537284+0000", 2024-09-10T06:26:53.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002878027 2024-09-10T06:26:53.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541411+0000", 2024-09-10T06:26:53.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041269790000000002 2024-09-10T06:26:53.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541441+0000", 2024-09-10T06:26:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0385000000000001e-05 2024-09-10T06:26:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541464+0000", 2024-09-10T06:26:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2671999999999999e-05 2024-09-10T06:26:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529930+0000", 2024-09-10T06:26:53.693 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.06443256, 2024-09-10T06:26:53.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011624766999999999, 2024-09-10T06:26:53.693 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.693 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.693 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.693 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 73 2024-09-10T06:26:53.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.693 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529930+0000", 2024-09-10T06:26:53.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529930+0000", 2024-09-10T06:26:53.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529931+0000", 2024-09-10T06:26:53.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0470000000000001e-06 2024-09-10T06:26:53.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529938+0000", 2024-09-10T06:26:53.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0770000000000002e-06 2024-09-10T06:26:53.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529975+0000", 2024-09-10T06:26:53.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7366000000000001e-05 2024-09-10T06:26:53.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529989+0000", 2024-09-10T06:26:53.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3617e-05 2024-09-10T06:26:53.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536230+0000", 2024-09-10T06:26:53.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062414089999999998 2024-09-10T06:26:53.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536286+0000", 2024-09-10T06:26:53.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5077999999999997e-05 2024-09-10T06:26:53.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536383+0000", 2024-09-10T06:26:53.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7656000000000001e-05 2024-09-10T06:26:53.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539732+0000", 2024-09-10T06:26:53.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003348635 2024-09-10T06:26:53.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541501+0000", 2024-09-10T06:26:53.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017696249999999999 2024-09-10T06:26:53.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541531+0000", 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9057999999999999e-05 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541555+0000", 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4199e-05 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.530006+0000", 2024-09-10T06:26:53.698 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.064356459999999, 2024-09-10T06:26:53.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011638819, 2024-09-10T06:26:53.699 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.699 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.699 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.699 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.699 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.699 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.699 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74 2024-09-10T06:26:53.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.699 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530006+0000", 2024-09-10T06:26:53.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530006+0000", 2024-09-10T06:26:53.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530007+0000", 2024-09-10T06:26:53.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0400000000000005e-07 2024-09-10T06:26:53.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530013+0000", 2024-09-10T06:26:53.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7459999999999997e-06 2024-09-10T06:26:53.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530023+0000", 2024-09-10T06:26:53.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.058e-05 2024-09-10T06:26:53.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530037+0000", 2024-09-10T06:26:53.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3380000000000001e-05 2024-09-10T06:26:53.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536855+0000", 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006818419 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536910+0000", 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5188000000000001e-05 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537006+0000", 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5622e-05 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539737+0000", 2024-09-10T06:26:53.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027316060000000001 2024-09-10T06:26:53.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541593+0000", 2024-09-10T06:26:53.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018553879999999999 2024-09-10T06:26:53.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541623+0000", 2024-09-10T06:26:53.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0397999999999999e-05 2024-09-10T06:26:53.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541645+0000", 2024-09-10T06:26:53.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1688e-05 2024-09-10T06:26:53.704 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.704 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.704 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.704 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.704 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:26:53.704 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.064311930999999, 2024-09-10T06:26:53.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011680293, 2024-09-10T06:26:53.705 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.705 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.705 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.705 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.705 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 75 2024-09-10T06:26:53.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.705 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:26:53.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:26:53.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:26:53.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4700000000000001e-07 2024-09-10T06:26:53.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530158+0000", 2024-09-10T06:26:53.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010655299999999999 2024-09-10T06:26:53.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530170+0000", 2024-09-10T06:26:53.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2403e-05 2024-09-10T06:26:53.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530178+0000", 2024-09-10T06:26:53.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-10T06:26:53.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537326+0000", 2024-09-10T06:26:53.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071483170000000004 2024-09-10T06:26:53.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537381+0000", 2024-09-10T06:26:53.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4666999999999997e-05 2024-09-10T06:26:53.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537476+0000", 2024-09-10T06:26:53.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4813000000000002e-05 2024-09-10T06:26:53.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539753+0000", 2024-09-10T06:26:53.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022772410000000002 2024-09-10T06:26:53.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541675+0000", 2024-09-10T06:26:53.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001922586 2024-09-10T06:26:53.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541706+0000", 2024-09-10T06:26:53.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0210999999999999e-05 2024-09-10T06:26:53.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541731+0000", 2024-09-10T06:26:53.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5275000000000001e-05 2024-09-10T06:26:53.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.710 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.711 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:53.711 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:26:53.711 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.064166954999997, 2024-09-10T06:26:53.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012563269, 2024-09-10T06:26:53.711 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:53.711 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:53.711 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:53.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:53.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:53.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:53.712 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 76 2024-09-10T06:26:53.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.712 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:53.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:53.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:26:53.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:53.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:26:53.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:53.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:53.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:26:53.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7300000000000005e-07 2024-09-10T06:26:53.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:53.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530202+0000", 2024-09-10T06:26:53.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.57e-06 2024-09-10T06:26:53.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530211+0000", 2024-09-10T06:26:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4769999999999992e-06 2024-09-10T06:26:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530222+0000", 2024-09-10T06:26:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0139999999999999e-05 2024-09-10T06:26:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539284+0000", 2024-09-10T06:26:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090626879999999993 2024-09-10T06:26:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539353+0000", 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8397000000000003e-05 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539451+0000", 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8621000000000003e-05 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.540129+0000", 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00067820900000000004 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.542706+0000", 2024-09-10T06:26:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025768760000000001 2024-09-10T06:26:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.542736+0000", 2024-09-10T06:26:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0125e-05 2024-09-10T06:26:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.542759+0000", 2024-09-10T06:26:53.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2393000000000001e-05 2024-09-10T06:26:53.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.717 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:53.717 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:53.717 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:26:53.718 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:26:53.719 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:26:53.719+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:26:53.820 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:26:53.819+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:26:53.848 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:26:53.848 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:26:53.849 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:26:53.849 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:26:53.863 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:26:53.952 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:53.951+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:26:54.021 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:26:54.019+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:26:54.028 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:26:54.028 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:26:54.028 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:26:54.028 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:26:54.028 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:26:54.042 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:26:54.121 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:54.119+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:54.209 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:26:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:26:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:26:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:26:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:46 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'28, mlcod=16'22)", 2024-09-10T06:26:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:26:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.916626260000001, 2024-09-10T06:26:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042526789999999997, 2024-09-10T06:26:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:26:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:26:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293571+0000", 2024-09-10T06:26:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1119999999999999e-06 2024-09-10T06:26:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293577+0000", 2024-09-10T06:26:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2179999999999996e-06 2024-09-10T06:26:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293596+0000", 2024-09-10T06:26:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9170000000000001e-05 2024-09-10T06:26:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293605+0000", 2024-09-10T06:26:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4060000000000005e-06 2024-09-10T06:26:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293654+0000", 2024-09-10T06:26:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9116999999999997e-05 2024-09-10T06:26:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293671+0000", 2024-09-10T06:26:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7110999999999999e-05 2024-09-10T06:26:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.297783+0000", 2024-09-10T06:26:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041121409999999997 2024-09-10T06:26:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.297822+0000", 2024-09-10T06:26:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9403999999999997e-05 2024-09-10T06:26:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:50 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'26)", 2024-09-10T06:26:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:26:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.910837761000003, 2024-09-10T06:26:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042664490000000003, 2024-09-10T06:26:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:26:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:26:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299359+0000", 2024-09-10T06:26:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1100000000000004e-07 2024-09-10T06:26:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299425+0000", 2024-09-10T06:26:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5994999999999994e-05 2024-09-10T06:26:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299440+0000", 2024-09-10T06:26:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4552999999999999e-05 2024-09-10T06:26:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299448+0000", 2024-09-10T06:26:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7469999999999994e-06 2024-09-10T06:26:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299504+0000", 2024-09-10T06:26:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5257999999999998e-05 2024-09-10T06:26:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299518+0000", 2024-09-10T06:26:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4037e-05 2024-09-10T06:26:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.303578+0000", 2024-09-10T06:26:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040603439999999996 2024-09-10T06:26:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.303625+0000", 2024-09-10T06:26:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6604000000000003e-05 2024-09-10T06:26:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:51 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.908831180999996, 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048711279999999997, 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:26:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301366+0000", 2024-09-10T06:26:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079999999999999e-06 2024-09-10T06:26:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301400+0000", 2024-09-10T06:26:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3816000000000003e-05 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301419+0000", 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9032e-05 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301427+0000", 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301475+0000", 2024-09-10T06:26:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8201999999999997e-05 2024-09-10T06:26:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301494+0000", 2024-09-10T06:26:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8791e-05 2024-09-10T06:26:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306182+0000", 2024-09-10T06:26:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046878379999999997 2024-09-10T06:26:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306236+0000", 2024-09-10T06:26:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3764999999999998e-05 2024-09-10T06:26:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:52 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'34, mlcod=16'29)", 2024-09-10T06:26:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:26:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.907841826000002, 2024-09-10T06:26:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039365659999999999, 2024-09-10T06:26:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:26:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:26:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302355+0000", 2024-09-10T06:26:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.009e-06 2024-09-10T06:26:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302373+0000", 2024-09-10T06:26:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8232000000000001e-05 2024-09-10T06:26:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302388+0000", 2024-09-10T06:26:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4246999999999999e-05 2024-09-10T06:26:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302400+0000", 2024-09-10T06:26:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2054e-05 2024-09-10T06:26:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302449+0000", 2024-09-10T06:26:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9119000000000002e-05 2024-09-10T06:26:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302461+0000", 2024-09-10T06:26:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2206e-05 2024-09-10T06:26:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306238+0000", 2024-09-10T06:26:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037773889999999999 2024-09-10T06:26:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306291+0000", 2024-09-10T06:26:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2309999999999999e-05 2024-09-10T06:26:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:55 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'37, mlcod=16'33)", 2024-09-10T06:26:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:26:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.899536124999997, 2024-09-10T06:26:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041116740000000001, 2024-09-10T06:26:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:26:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:26:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310661+0000", 2024-09-10T06:26:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3600000000000003e-07 2024-09-10T06:26:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310724+0000", 2024-09-10T06:26:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3706000000000003e-05 2024-09-10T06:26:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310734+0000", 2024-09-10T06:26:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0207000000000001e-05 2024-09-10T06:26:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310740+0000", 2024-09-10T06:26:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8760000000000002e-06 2024-09-10T06:26:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310796+0000", 2024-09-10T06:26:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6206999999999999e-05 2024-09-10T06:26:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310813+0000", 2024-09-10T06:26:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6385999999999999e-05 2024-09-10T06:26:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.314729+0000", 2024-09-10T06:26:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039157469999999998 2024-09-10T06:26:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.314771+0000", 2024-09-10T06:26:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2809000000000003e-05 2024-09-10T06:26:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'47, mlcod=16'41)", 2024-09-10T06:26:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:26:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.677798779, 2024-09-10T06:26:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0084590540000000006, 2024-09-10T06:26:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:26:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:26:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532398+0000", 2024-09-10T06:26:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599999999999999e-07 2024-09-10T06:26:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532437+0000", 2024-09-10T06:26:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8711000000000003e-05 2024-09-10T06:26:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532449+0000", 2024-09-10T06:26:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2075999999999999e-05 2024-09-10T06:26:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532455+0000", 2024-09-10T06:26:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2110000000000003e-06 2024-09-10T06:26:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533257+0000", 2024-09-10T06:26:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080233799999999999 2024-09-10T06:26:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533318+0000", 2024-09-10T06:26:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1033000000000003e-05 2024-09-10T06:26:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540718+0000", 2024-09-10T06:26:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073998529999999996 2024-09-10T06:26:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540856+0000", 2024-09-10T06:26:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013792599999999999 2024-09-10T06:26:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:70 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'48, mlcod=16'41)", 2024-09-10T06:26:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:26:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.677092764000001, 2024-09-10T06:26:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0078483679999999997, 2024-09-10T06:26:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:26:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:26:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533104+0000", 2024-09-10T06:26:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3799999999999997e-07 2024-09-10T06:26:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533109+0000", 2024-09-10T06:26:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1100000000000002e-06 2024-09-10T06:26:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533117+0000", 2024-09-10T06:26:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7260000000000002e-06 2024-09-10T06:26:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533125+0000", 2024-09-10T06:26:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8170000000000005e-06 2024-09-10T06:26:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534794+0000", 2024-09-10T06:26:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016687760000000001 2024-09-10T06:26:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534808+0000", 2024-09-10T06:26:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4293e-05 2024-09-10T06:26:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540863+0000", 2024-09-10T06:26:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060549549999999999 2024-09-10T06:26:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540951+0000", 2024-09-10T06:26:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8152999999999994e-05 2024-09-10T06:26:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:71 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'49, mlcod=16'44)", 2024-09-10T06:26:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:26:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.676219615999997, 2024-09-10T06:26:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070511530000000001, 2024-09-10T06:26:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:26:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:26:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533978+0000", 2024-09-10T06:26:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5799999999999999e-06 2024-09-10T06:26:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533987+0000", 2024-09-10T06:26:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4460000000000007e-06 2024-09-10T06:26:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534017+0000", 2024-09-10T06:26:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9524000000000001e-05 2024-09-10T06:26:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534027+0000", 2024-09-10T06:26:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0593e-05 2024-09-10T06:26:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535082+0000", 2024-09-10T06:26:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001054609 2024-09-10T06:26:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535095+0000", 2024-09-10T06:26:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2870999999999999e-05 2024-09-10T06:26:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540955+0000", 2024-09-10T06:26:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058596270000000001 2024-09-10T06:26:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541027+0000", 2024-09-10T06:26:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2903000000000003e-05 2024-09-10T06:26:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:72 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'50, mlcod=16'44)", 2024-09-10T06:26:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:26:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.675607454000001, 2024-09-10T06:26:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0065158799999999999, 2024-09-10T06:26:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:26:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:26:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534591+0000", 2024-09-10T06:26:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0729999999999999e-06 2024-09-10T06:26:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534722+0000", 2024-09-10T06:26:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013124299999999999 2024-09-10T06:26:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534746+0000", 2024-09-10T06:26:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3903000000000001e-05 2024-09-10T06:26:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534758+0000", 2024-09-10T06:26:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2449000000000001e-05 2024-09-10T06:26:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535408+0000", 2024-09-10T06:26:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00064971199999999999 2024-09-10T06:26:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535465+0000", 2024-09-10T06:26:54.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6892999999999999e-05 2024-09-10T06:26:54.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541030+0000", 2024-09-10T06:26:54.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055649209999999996 2024-09-10T06:26:54.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541104+0000", 2024-09-10T06:26:54.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4685999999999996e-05 2024-09-10T06:26:54.251 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.251 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.251 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.251 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:73 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'51, mlcod=16'44)", 2024-09-10T06:26:54.251 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:26:54.251 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.673727132000003, 2024-09-10T06:26:54.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047149710000000001, 2024-09-10T06:26:54.251 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.251 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.251 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.251 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:26:54.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:26:54.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536471+0000", 2024-09-10T06:26:54.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.934e-06 2024-09-10T06:26:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536482+0000", 2024-09-10T06:26:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1542999999999999e-05 2024-09-10T06:26:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536511+0000", 2024-09-10T06:26:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8649999999999998e-05 2024-09-10T06:26:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536527+0000", 2024-09-10T06:26:54.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.649e-05 2024-09-10T06:26:54.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536776+0000", 2024-09-10T06:26:54.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024814800000000001 2024-09-10T06:26:54.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536811+0000", 2024-09-10T06:26:54.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5716000000000002e-05 2024-09-10T06:26:54.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541107+0000", 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042952770000000001 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541184+0000", 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7212999999999994e-05 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:74 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'52, mlcod=16'45)", 2024-09-10T06:26:54.255 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:26:54.256 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.673164559, 2024-09-10T06:26:54.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042018239999999998, 2024-09-10T06:26:54.256 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.256 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.256 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.256 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:26:54.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:26:54.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537033+0000", 2024-09-10T06:26:54.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.533e-06 2024-09-10T06:26:54.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537043+0000", 2024-09-10T06:26:54.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0000000000000001e-05 2024-09-10T06:26:54.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537062+0000", 2024-09-10T06:26:54.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8686999999999999e-05 2024-09-10T06:26:54.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537072+0000", 2024-09-10T06:26:54.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0746e-05 2024-09-10T06:26:54.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537359+0000", 2024-09-10T06:26:54.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000286908 2024-09-10T06:26:54.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537415+0000", 2024-09-10T06:26:54.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5389000000000001e-05 2024-09-10T06:26:54.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541186+0000", 2024-09-10T06:26:54.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037710550000000002 2024-09-10T06:26:54.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541233+0000", 2024-09-10T06:26:54.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7506000000000002e-05 2024-09-10T06:26:54.260 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.260 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.260 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.260 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:75 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'53, mlcod=16'45)", 2024-09-10T06:26:54.260 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:26:54.260 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.672550821000002, 2024-09-10T06:26:54.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036309760000000002, 2024-09-10T06:26:54.260 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.260 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.261 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.261 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:26:54.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:26:54.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537647+0000", 2024-09-10T06:26:54.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8369999999999999e-06 2024-09-10T06:26:54.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537767+0000", 2024-09-10T06:26:54.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119826 2024-09-10T06:26:54.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537798+0000", 2024-09-10T06:26:54.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0775999999999998e-05 2024-09-10T06:26:54.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537811+0000", 2024-09-10T06:26:54.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.327e-05 2024-09-10T06:26:54.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.538148+0000", 2024-09-10T06:26:54.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033750799999999998 2024-09-10T06:26:54.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.538189+0000", 2024-09-10T06:26:54.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0713000000000001e-05 2024-09-10T06:26:54.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541238+0000", 2024-09-10T06:26:54.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030488500000000001 2024-09-10T06:26:54.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541276+0000", 2024-09-10T06:26:54.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8195999999999998e-05 2024-09-10T06:26:54.264 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.265 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.265 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.265 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:77 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'55, mlcod=16'53)", 2024-09-10T06:26:54.265 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:26:54.265 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.666379300999999, 2024-09-10T06:26:54.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041185240000000001, 2024-09-10T06:26:54.265 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.265 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.265 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.265 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:26:54.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:26:54.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543818+0000", 2024-09-10T06:26:54.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8029999999999999e-06 2024-09-10T06:26:54.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543948+0000", 2024-09-10T06:26:54.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129369 2024-09-10T06:26:54.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543977+0000", 2024-09-10T06:26:54.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8813e-05 2024-09-10T06:26:54.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543989+0000", 2024-09-10T06:26:54.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2886e-05 2024-09-10T06:26:54.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544115+0000", 2024-09-10T06:26:54.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012526900000000001 2024-09-10T06:26:54.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544174+0000", 2024-09-10T06:26:54.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9166999999999998e-05 2024-09-10T06:26:54.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547867+0000", 2024-09-10T06:26:54.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036934340000000002 2024-09-10T06:26:54.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547935+0000", 2024-09-10T06:26:54.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7782999999999998e-05 2024-09-10T06:26:54.269 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.269 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.269 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.270 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:78 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'56, mlcod=16'53)", 2024-09-10T06:26:54.270 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:26:54.270 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.6658106, 2024-09-10T06:26:54.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035960359999999999, 2024-09-10T06:26:54.270 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.270 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.270 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.270 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:26:54.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:26:54.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544386+0000", 2024-09-10T06:26:54.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1399999999999995e-07 2024-09-10T06:26:54.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544510+0000", 2024-09-10T06:26:54.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124265 2024-09-10T06:26:54.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544528+0000", 2024-09-10T06:26:54.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7706999999999998e-05 2024-09-10T06:26:54.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544538+0000", 2024-09-10T06:26:54.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7799999999999995e-06 2024-09-10T06:26:54.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545067+0000", 2024-09-10T06:26:54.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052855600000000001 2024-09-10T06:26:54.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545125+0000", 2024-09-10T06:26:54.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8313000000000002e-05 2024-09-10T06:26:54.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547942+0000", 2024-09-10T06:26:54.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028174749999999998 2024-09-10T06:26:54.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547981+0000", 2024-09-10T06:26:54.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9026000000000002e-05 2024-09-10T06:26:54.274 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.274 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.274 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.274 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:79 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'57, mlcod=16'53)", 2024-09-10T06:26:54.274 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:26:54.275 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.665271879999999, 2024-09-10T06:26:54.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044068620000000001, 2024-09-10T06:26:54.275 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.275 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.275 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.275 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:26:54.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:26:54.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544925+0000", 2024-09-10T06:26:54.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8000000000000004e-07 2024-09-10T06:26:54.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545047+0000", 2024-09-10T06:26:54.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121779 2024-09-10T06:26:54.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545077+0000", 2024-09-10T06:26:54.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0463e-05 2024-09-10T06:26:54.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545087+0000", 2024-09-10T06:26:54.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0067e-05 2024-09-10T06:26:54.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.546104+0000", 2024-09-10T06:26:54.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001017088 2024-09-10T06:26:54.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.546157+0000", 2024-09-10T06:26:54.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2886000000000002e-05 2024-09-10T06:26:54.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549219+0000", 2024-09-10T06:26:54.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030620539999999998 2024-09-10T06:26:54.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549331+0000", 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011164500000000001 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:80 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'58, mlcod=16'53)", 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.664674091999998, 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042652369999999998, 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.279 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:26:54.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:26:54.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545523+0000", 2024-09-10T06:26:54.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2399999999999997e-07 2024-09-10T06:26:54.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545646+0000", 2024-09-10T06:26:54.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123662 2024-09-10T06:26:54.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545664+0000", 2024-09-10T06:26:54.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8e-05 2024-09-10T06:26:54.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545673+0000", 2024-09-10T06:26:54.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9930000000000001e-06 2024-09-10T06:26:54.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547057+0000", 2024-09-10T06:26:54.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013834629999999999 2024-09-10T06:26:54.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547129+0000", 2024-09-10T06:26:54.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1759000000000002e-05 2024-09-10T06:26:54.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549724+0000", 2024-09-10T06:26:54.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002595834 2024-09-10T06:26:54.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549787+0000", 2024-09-10T06:26:54.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2701999999999997e-05 2024-09-10T06:26:54.283 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.284 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.284 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.284 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:26:54.284 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:26:54.284 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.90853077, 2024-09-10T06:26:54.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040313359999999999, 2024-09-10T06:26:54.284 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.284 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.284 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.284 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:54.284 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:54.285 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:54.285 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 206 2024-09-10T06:26:54.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.285 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:26:54.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:26:54.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301670+0000", 2024-09-10T06:26:54.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5669999999999996e-06 2024-09-10T06:26:54.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301690+0000", 2024-09-10T06:26:54.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0636999999999999e-05 2024-09-10T06:26:54.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301735+0000", 2024-09-10T06:26:54.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4298999999999997e-05 2024-09-10T06:26:54.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301759+0000", 2024-09-10T06:26:54.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4769999999999998e-05 2024-09-10T06:26:54.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301938+0000", 2024-09-10T06:26:54.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017901899999999999 2024-09-10T06:26:54.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.302305+0000", 2024-09-10T06:26:54.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036679699999999998 2024-09-10T06:26:54.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-10T06:26:54.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.303069+0000", 2024-09-10T06:26:54.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076360999999999996 2024-09-10T06:26:54.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:54.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.304549+0000", 2024-09-10T06:26:54.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014798229999999999 2024-09-10T06:26:54.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:54.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305530+0000", 2024-09-10T06:26:54.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098141200000000008 2024-09-10T06:26:54.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305610+0000", 2024-09-10T06:26:54.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9785999999999998e-05 2024-09-10T06:26:54.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305696+0000", 2024-09-10T06:26:54.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6615999999999999e-05 2024-09-10T06:26:54.290 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.290 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.290 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.290 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:54.290 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:26:54.290 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.885926158, 2024-09-10T06:26:54.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0081512240000000003, 2024-09-10T06:26:54.290 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.290 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.290 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.290 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:54.291 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:54.291 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:54.291 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 210 2024-09-10T06:26:54.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.291 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:26:54.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:26:54.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324273+0000", 2024-09-10T06:26:54.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1240000000000001e-06 2024-09-10T06:26:54.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324285+0000", 2024-09-10T06:26:54.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2463000000000001e-05 2024-09-10T06:26:54.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324319+0000", 2024-09-10T06:26:54.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3309999999999998e-05 2024-09-10T06:26:54.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324342+0000", 2024-09-10T06:26:54.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3672999999999998e-05 2024-09-10T06:26:54.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324476+0000", 2024-09-10T06:26:54.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013378199999999999 2024-09-10T06:26:54.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:26:54.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324489+0000", 2024-09-10T06:26:54.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3127e-05 2024-09-10T06:26:54.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.328893+0000", 2024-09-10T06:26:54.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044040190000000003 2024-09-10T06:26:54.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.329211+0000", 2024-09-10T06:26:54.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031762799999999998 2024-09-10T06:26:54.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:26:54.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.329880+0000", 2024-09-10T06:26:54.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066933800000000001 2024-09-10T06:26:54.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:54.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.331727+0000", 2024-09-10T06:26:54.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018466120000000001 2024-09-10T06:26:54.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:54.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332287+0000", 2024-09-10T06:26:54.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056016599999999996 2024-09-10T06:26:54.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332363+0000", 2024-09-10T06:26:54.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5748999999999996e-05 2024-09-10T06:26:54.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332421+0000", 2024-09-10T06:26:54.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8233000000000003e-05 2024-09-10T06:26:54.296 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.297 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.297 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.297 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:469 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:54.297 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:26:54.297 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.71107524, 2024-09-10T06:26:54.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0056131189999999997, 2024-09-10T06:26:54.297 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.297 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.297 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:54.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:54.297 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:54.298 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 469 2024-09-10T06:26:54.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.298 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:26:54.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:26:54.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:26:54.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8400000000000003e-07 2024-09-10T06:26:54.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499125+0000", 2024-09-10T06:26:54.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.692e-06 2024-09-10T06:26:54.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499135+0000", 2024-09-10T06:26:54.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5310000000000007e-06 2024-09-10T06:26:54.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499140+0000", 2024-09-10T06:26:54.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9640000000000002e-06 2024-09-10T06:26:54.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499200+0000", 2024-09-10T06:26:54.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0874e-05 2024-09-10T06:26:54.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499303+0000", 2024-09-10T06:26:54.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102395 2024-09-10T06:26:54.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:26:54.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499518+0000", 2024-09-10T06:26:54.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021481500000000001 2024-09-10T06:26:54.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:54.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.500112+0000", 2024-09-10T06:26:54.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059408699999999998 2024-09-10T06:26:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504614+0000", 2024-09-10T06:26:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045017859999999998 2024-09-10T06:26:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504688+0000", 2024-09-10T06:26:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4528000000000002e-05 2024-09-10T06:26:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504734+0000", 2024-09-10T06:26:54.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5663e-05 2024-09-10T06:26:54.303 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.303 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.303 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.303 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:621 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:54.303 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:26:54.303 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 12.605845178999999, 2024-09-10T06:26:54.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039399250000000004, 2024-09-10T06:26:54.303 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:54.303 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:54.303 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:54.304 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:54.304 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:54.304 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:54.304 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 621 2024-09-10T06:26:54.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.304 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:54.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:54.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:26:54.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:54.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:26:54.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:54.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:54.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604353+0000", 2024-09-10T06:26:54.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.537e-06 2024-09-10T06:26:54.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:54.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604364+0000", 2024-09-10T06:26:54.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0923e-05 2024-09-10T06:26:54.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604394+0000", 2024-09-10T06:26:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0176999999999999e-05 2024-09-10T06:26:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604409+0000", 2024-09-10T06:26:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4666e-05 2024-09-10T06:26:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604505+0000", 2024-09-10T06:26:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5914000000000004e-05 2024-09-10T06:26:54.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604588+0000", 2024-09-10T06:26:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3127999999999994e-05 2024-09-10T06:26:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:26:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604709+0000", 2024-09-10T06:26:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121344 2024-09-10T06:26:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.605312+0000", 2024-09-10T06:26:54.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00060259599999999995 2024-09-10T06:26:54.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:54.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608229+0000", 2024-09-10T06:26:54.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029169600000000001 2024-09-10T06:26:54.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:54.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608264+0000", 2024-09-10T06:26:54.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4756999999999999e-05 2024-09-10T06:26:54.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:54.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:54.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:54.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608291+0000", 2024-09-10T06:26:54.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6923e-05 2024-09-10T06:26:54.309 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.309 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.309 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.309 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:54.309 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:54.309 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:26:54.310 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:26:54.311 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:26:54.311+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:26:54.312 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:26:54.412 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:54.411+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:26:54.480 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:26:54.480 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:26:54.480 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:26:54.481 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:26:54.497 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:26:54.504 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:26:54.505 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:26:54.513 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:26:54.511+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:26:54.522 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:26:54.522 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:26:54.539 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:26:54.539 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:26:54.555 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:26:54.555 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:26:54.577 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:26:54.577 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:26:54.599 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:26:54.599 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:26:54.614 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:26:54.611+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:26:54.620 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:26:54.621 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:26:54.622 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:54.622 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:54.637 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:26:54.642 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:26:54.642 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:26:54.716 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:54.715+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:54.762 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:54.762 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:54.776 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:26:54.817 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:54.815+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:26:54.900 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:54.901 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:54.914 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:26:54.917 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:54.915+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:26:55.033 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:55.019+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:55.293 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:55.293 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:55.296 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:26:55.297 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:55.295+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:26:55.394 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:26:55.391+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:26:55.471 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:55.471 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:55.485 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:26:55.494 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:26:55.495+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:26:55.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T06:26:55.595 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:26:55.595+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:26:55.609 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:55.610 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:55.625 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:26:55.697 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:55.695+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:26:55.759 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:55.760 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:55.774 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:26:55.798 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:55.795+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:55.889 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:55.890 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:55.898 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:26:55.895+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:26:55.902 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:26:55.999 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:55.999+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:26:56.033 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:56.033 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:56.046 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:26:56.100 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:26:56.099+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:26:56.201 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:56.203+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:26:56.216 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:56.216 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:56.230 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:26:56.302 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:26:56.299+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:26:56.355 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:56.355 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:56.370 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:26:56.415 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:56.415+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:56.494 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:56.494 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:56.504 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:26:56.503+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:26:56.508 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:26:56.519 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-10T06:26:56.605 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:26:56.603+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:26:56.660 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:26:56.677 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:56.677 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:56.691 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:26:56.739 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:26:56.739+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:26:56.806 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:26:56.803+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:26:56.818 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:56.818 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:56.818 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:26:56.819 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:26:56.832 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:26:56.835 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:26:56.835 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:26:56.853 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:26:56.853 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:26:56.871 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:26:56.871 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:26:56.890 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:26:56.890 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:26:56.907 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:26:56.903+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:26:56.908 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:26:56.908 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:26:56.927 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:26:56.927 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:26:56.945 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:26:56.946 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:26:56.993 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:26:56.993 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:26:56.993 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:26:56.993 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:26:57.008 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:57.007+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:26:57.009 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:26:57.109 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:57.107+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:57.131 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:26:57.131 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:26:57.131 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:26:57.131 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:26:57.131 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:26:57.147 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:26:57.243 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:57.243+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:57.311 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:57.307+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:26:57.320 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:26:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:26:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:26:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:26:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4349.0:36 5.1f 5:ff606e21:::zone_info.dfef714d-986b-43cb-b095-512e386c9309:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:26:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:34.314860+0000", 2024-09-10T06:26:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.005151940000001, 2024-09-10T06:26:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003107603, 2024-09-10T06:26:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4349", 2024-09-10T06:26:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:26:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 36 2024-09-10T06:26:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314860+0000", 2024-09-10T06:26:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314860+0000", 2024-09-10T06:26:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314861+0000", 2024-09-10T06:26:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9069999999999999e-06 2024-09-10T06:26:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314871+0000", 2024-09-10T06:26:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2969999999999992e-06 2024-09-10T06:26:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314892+0000", 2024-09-10T06:26:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1443000000000001e-05 2024-09-10T06:26:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314904+0000", 2024-09-10T06:26:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2072999999999999e-05 2024-09-10T06:26:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.315021+0000", 2024-09-10T06:26:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117019 2024-09-10T06:26:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.315390+0000", 2024-09-10T06:26:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036879700000000003 2024-09-10T06:26:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:26:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.315847+0000", 2024-09-10T06:26:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045647599999999998 2024-09-10T06:26:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317460+0000", 2024-09-10T06:26:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001613172 2024-09-10T06:26:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317782+0000", 2024-09-10T06:26:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032208300000000003 2024-09-10T06:26:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317899+0000", 2024-09-10T06:26:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117549 2024-09-10T06:26:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317967+0000", 2024-09-10T06:26:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7787000000000007e-05 2024-09-10T06:26:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:26:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:26:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.039994433, 2024-09-10T06:26:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016848367, 2024-09-10T06:26:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 46 2024-09-10T06:26:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:26:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:26:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280021+0000", 2024-09-10T06:26:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0069999999999999e-06 2024-09-10T06:26:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280036+0000", 2024-09-10T06:26:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.483e-05 2024-09-10T06:26:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280070+0000", 2024-09-10T06:26:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4106000000000002e-05 2024-09-10T06:26:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280094+0000", 2024-09-10T06:26:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4037e-05 2024-09-10T06:26:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280246+0000", 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000152199 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280271+0000", 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4581999999999999e-05 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.289388+0000", 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091175639999999999 2024-09-10T06:26:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.290774+0000", 2024-09-10T06:26:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013859860000000001 2024-09-10T06:26:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:26:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291069+0000", 2024-09-10T06:26:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000294534 2024-09-10T06:26:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295828+0000", 2024-09-10T06:26:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047595729999999996 2024-09-10T06:26:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296614+0000", 2024-09-10T06:26:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00078534700000000004 2024-09-10T06:26:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296759+0000", 2024-09-10T06:26:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014571300000000001 2024-09-10T06:26:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296865+0000", 2024-09-10T06:26:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105889 2024-09-10T06:26:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94143734761600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:26:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.297713+0000", 2024-09-10T06:26:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.022298243000002, 2024-09-10T06:26:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007058847, 2024-09-10T06:26:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47 2024-09-10T06:26:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297713+0000", 2024-09-10T06:26:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297713+0000", 2024-09-10T06:26:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297718+0000", 2024-09-10T06:26:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3329999999999998e-06 2024-09-10T06:26:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297733+0000", 2024-09-10T06:26:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5477000000000001e-05 2024-09-10T06:26:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297767+0000", 2024-09-10T06:26:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3859999999999998e-05 2024-09-10T06:26:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297793+0000", 2024-09-10T06:26:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6455999999999999e-05 2024-09-10T06:26:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297941+0000", 2024-09-10T06:26:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014803599999999999 2024-09-10T06:26:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298148+0000", 2024-09-10T06:26:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020703299999999999 2024-09-10T06:26:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:26:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298513+0000", 2024-09-10T06:26:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036422599999999999 2024-09-10T06:26:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304449+0000", 2024-09-10T06:26:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059367029999999998 2024-09-10T06:26:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304478+0000", 2024-09-10T06:26:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8836999999999999e-05 2024-09-10T06:26:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304599+0000", 2024-09-10T06:26:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012068100000000001 2024-09-10T06:26:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304772+0000", 2024-09-10T06:26:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017320500000000001 2024-09-10T06:26:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4358.0:47 7.1f e31/30 ondisk, result = 0)", 2024-09-10T06:26:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.300682+0000", 2024-09-10T06:26:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.019329764999998, 2024-09-10T06:26:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00409582, 2024-09-10T06:26:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-10T06:26:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300682+0000", 2024-09-10T06:26:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300682+0000", 2024-09-10T06:26:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300684+0000", 2024-09-10T06:26:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9829999999999999e-06 2024-09-10T06:26:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300695+0000", 2024-09-10T06:26:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1347e-05 2024-09-10T06:26:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300722+0000", 2024-09-10T06:26:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-05 2024-09-10T06:26:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300742+0000", 2024-09-10T06:26:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9772999999999999e-05 2024-09-10T06:26:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304416+0000", 2024-09-10T06:26:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036739339999999998 2024-09-10T06:26:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304436+0000", 2024-09-10T06:26:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9953999999999999e-05 2024-09-10T06:26:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304777+0000", 2024-09-10T06:26:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034188900000000001 2024-09-10T06:26:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94143734766208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:26:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.321434+0000", 2024-09-10T06:26:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.998577064999999, 2024-09-10T06:26:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002454211, 2024-09-10T06:26:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:26:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 55 2024-09-10T06:26:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321434+0000", 2024-09-10T06:26:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321434+0000", 2024-09-10T06:26:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321436+0000", 2024-09-10T06:26:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0490000000000002e-06 2024-09-10T06:26:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321446+0000", 2024-09-10T06:26:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5279999999999992e-06 2024-09-10T06:26:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321470+0000", 2024-09-10T06:26:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4377000000000001e-05 2024-09-10T06:26:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321485+0000", 2024-09-10T06:26:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4803e-05 2024-09-10T06:26:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321570+0000", 2024-09-10T06:26:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4926000000000006e-05 2024-09-10T06:26:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321665+0000", 2024-09-10T06:26:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4777000000000004e-05 2024-09-10T06:26:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:26:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321861+0000", 2024-09-10T06:26:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000196658 2024-09-10T06:26:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.322806+0000", 2024-09-10T06:26:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094434399999999996 2024-09-10T06:26:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.323736+0000", 2024-09-10T06:26:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000930079 2024-09-10T06:26:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.323796+0000", 2024-09-10T06:26:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9845e-05 2024-09-10T06:26:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.323889+0000", 2024-09-10T06:26:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2825000000000007e-05 2024-09-10T06:26:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:209 6.3 e34/28 6:c60da066:gc::gc.4:head v 34'1, mlcod=0'0)", 2024-09-10T06:26:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.320703+0000", 2024-09-10T06:26:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.999308149000001, 2024-09-10T06:26:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026023930000000002, 2024-09-10T06:26:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320703+0000", 2024-09-10T06:26:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320703+0000", 2024-09-10T06:26:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320704+0000", 2024-09-10T06:26:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7300000000000005e-07 2024-09-10T06:26:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320714+0000", 2024-09-10T06:26:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.041e-05 2024-09-10T06:26:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320762+0000", 2024-09-10T06:26:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7537000000000002e-05 2024-09-10T06:26:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320784+0000", 2024-09-10T06:26:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2243e-05 2024-09-10T06:26:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320934+0000", 2024-09-10T06:26:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014941499999999999 2024-09-10T06:26:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320982+0000", 2024-09-10T06:26:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8162999999999999e-05 2024-09-10T06:26:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.323191+0000", 2024-09-10T06:26:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002209253 2024-09-10T06:26:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.323306+0000", 2024-09-10T06:26:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011459900000000001 2024-09-10T06:26:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:354 6.3 e34/28 6:c3a682d4:reshard::reshard.0000000004:head v 34'4, mlcod=34'2)", 2024-09-10T06:26:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.453134+0000", 2024-09-10T06:26:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.866876960999999, 2024-09-10T06:26:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025721730000000001, 2024-09-10T06:26:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453134+0000", 2024-09-10T06:26:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453134+0000", 2024-09-10T06:26:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453137+0000", 2024-09-10T06:26:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.243e-06 2024-09-10T06:26:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453154+0000", 2024-09-10T06:26:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6906999999999999e-05 2024-09-10T06:26:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453193+0000", 2024-09-10T06:26:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9096e-05 2024-09-10T06:26:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453213+0000", 2024-09-10T06:26:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0233000000000001e-05 2024-09-10T06:26:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453362+0000", 2024-09-10T06:26:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921199999999999 2024-09-10T06:26:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453426+0000", 2024-09-10T06:26:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3410000000000004e-05 2024-09-10T06:26:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.455601+0000", 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021758799999999998 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.455707+0000", 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010519200000000001 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:363 6.3 e34/28 6:c3a682d4:reshard::reshard.0000000004:head v 34'5, mlcod=34'3)", 2024-09-10T06:26:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.458414+0000", 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.861597764999999, 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026506300000000002, 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458414+0000", 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458414+0000", 2024-09-10T06:26:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458416+0000", 2024-09-10T06:26:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1969999999999999e-06 2024-09-10T06:26:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458448+0000", 2024-09-10T06:26:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2298999999999997e-05 2024-09-10T06:26:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458482+0000", 2024-09-10T06:26:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3510000000000003e-05 2024-09-10T06:26:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458500+0000", 2024-09-10T06:26:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8216999999999999e-05 2024-09-10T06:26:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458649+0000", 2024-09-10T06:26:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000148839 2024-09-10T06:26:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458708+0000", 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9045999999999997e-05 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.460969+0000", 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022612660000000001 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461064+0000", 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5255999999999997e-05 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:372 6.5 e34/28 6:a60f9269:lc::lua_package_allowlist:head v 34'2, mlcod=0'0)", 2024-09-10T06:26:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.461552+0000", 2024-09-10T06:26:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.858459919, 2024-09-10T06:26:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025753500000000001, 2024-09-10T06:26:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461552+0000", 2024-09-10T06:26:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461552+0000", 2024-09-10T06:26:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461553+0000", 2024-09-10T06:26:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7600000000000001e-06 2024-09-10T06:26:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461566+0000", 2024-09-10T06:26:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2986000000000001e-05 2024-09-10T06:26:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461598+0000", 2024-09-10T06:26:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2163999999999999e-05 2024-09-10T06:26:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461626+0000", 2024-09-10T06:26:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7883000000000001e-05 2024-09-10T06:26:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461752+0000", 2024-09-10T06:26:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012603500000000001 2024-09-10T06:26:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461801+0000", 2024-09-10T06:26:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8875999999999998e-05 2024-09-10T06:26:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.464036+0000", 2024-09-10T06:26:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022345730000000001 2024-09-10T06:26:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.464127+0000", 2024-09-10T06:26:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1073e-05 2024-09-10T06:26:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:377 6.c e34/28 6:3677c228:::obj_delete_at_hint.0000000006:head v 34'1, mlcod=0'0)", 2024-09-10T06:26:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.462034+0000", 2024-09-10T06:26:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.857977119999999, 2024-09-10T06:26:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050687509999999998, 2024-09-10T06:26:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462034+0000", 2024-09-10T06:26:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462034+0000", 2024-09-10T06:26:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462036+0000", 2024-09-10T06:26:57.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.827e-06 2024-09-10T06:26:57.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462048+0000", 2024-09-10T06:26:57.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1636e-05 2024-09-10T06:26:57.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462068+0000", 2024-09-10T06:26:57.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0463999999999999e-05 2024-09-10T06:26:57.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462082+0000", 2024-09-10T06:26:57.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4086e-05 2024-09-10T06:26:57.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462200+0000", 2024-09-10T06:26:57.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117769 2024-09-10T06:26:57.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462250+0000", 2024-09-10T06:26:57.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9790000000000003e-05 2024-09-10T06:26:57.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.466985+0000", 2024-09-10T06:26:57.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047353370000000001 2024-09-10T06:26:57.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.467103+0000", 2024-09-10T06:26:57.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117842 2024-09-10T06:26:57.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.372 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.373 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:436 6.c e34/28 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 34'4, mlcod=34'2)", 2024-09-10T06:26:57.373 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.479435+0000", 2024-09-10T06:26:57.373 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.840576414000001, 2024-09-10T06:26:57.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028578980000000002, 2024-09-10T06:26:57.373 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.373 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.373 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.373 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479435+0000", 2024-09-10T06:26:57.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479435+0000", 2024-09-10T06:26:57.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479437+0000", 2024-09-10T06:26:57.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.903e-06 2024-09-10T06:26:57.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479448+0000", 2024-09-10T06:26:57.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0654e-05 2024-09-10T06:26:57.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479472+0000", 2024-09-10T06:26:57.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4258999999999999e-05 2024-09-10T06:26:57.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479485+0000", 2024-09-10T06:26:57.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2904e-05 2024-09-10T06:26:57.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479622+0000", 2024-09-10T06:26:57.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013714200000000001 2024-09-10T06:26:57.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479674+0000", 2024-09-10T06:26:57.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2392999999999998e-05 2024-09-10T06:26:57.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.482187+0000", 2024-09-10T06:26:57.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025123039999999999 2024-09-10T06:26:57.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.482293+0000", 2024-09-10T06:26:57.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106339 2024-09-10T06:26:57.377 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:444 6.a e34/28 6:50d64734:::obj_delete_at_hint.0000000009:head v 34'2, mlcod=0'0)", 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.484329+0000", 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.835682295, 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038926529999999998, 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484329+0000", 2024-09-10T06:26:57.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484329+0000", 2024-09-10T06:26:57.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484331+0000", 2024-09-10T06:26:57.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.66e-06 2024-09-10T06:26:57.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484342+0000", 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0986e-05 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484366+0000", 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4026999999999999e-05 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484384+0000", 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8147000000000001e-05 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484525+0000", 2024-09-10T06:26:57.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014151499999999999 2024-09-10T06:26:57.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484595+0000", 2024-09-10T06:26:57.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9085999999999996e-05 2024-09-10T06:26:57.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488044+0000", 2024-09-10T06:26:57.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034494040000000001 2024-09-10T06:26:57.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488222+0000", 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017782799999999999 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:453 6.a e34/28 6:50d64734:::obj_delete_at_hint.0000000009:head v 34'4, mlcod=34'1)", 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.491119+0000", 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.828892721000001, 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026832829999999998, 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.382 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.383 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491119+0000", 2024-09-10T06:26:57.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491119+0000", 2024-09-10T06:26:57.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491121+0000", 2024-09-10T06:26:57.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2139999999999999e-06 2024-09-10T06:26:57.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491151+0000", 2024-09-10T06:26:57.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0499999999999999e-05 2024-09-10T06:26:57.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491178+0000", 2024-09-10T06:26:57.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6996999999999999e-05 2024-09-10T06:26:57.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491194+0000", 2024-09-10T06:26:57.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5831000000000001e-05 2024-09-10T06:26:57.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491325+0000", 2024-09-10T06:26:57.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013072600000000001 2024-09-10T06:26:57.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491377+0000", 2024-09-10T06:26:57.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1944000000000003e-05 2024-09-10T06:26:57.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493723+0000", 2024-09-10T06:26:57.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023455749999999999 2024-09-10T06:26:57.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493802+0000", 2024-09-10T06:26:57.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9495999999999999e-05 2024-09-10T06:26:57.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.386 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.387 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:478 6.1 e34/28 6:80b6fe23:reshard::reshard.0000000011:head v 34'3, mlcod=34'1)", 2024-09-10T06:26:57.387 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.505492+0000", 2024-09-10T06:26:57.387 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.814519493000001, 2024-09-10T06:26:57.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030300840000000002, 2024-09-10T06:26:57.387 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.387 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.387 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.387 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505492+0000", 2024-09-10T06:26:57.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505492+0000", 2024-09-10T06:26:57.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505494+0000", 2024-09-10T06:26:57.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.762e-06 2024-09-10T06:26:57.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505505+0000", 2024-09-10T06:26:57.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0998e-05 2024-09-10T06:26:57.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505528+0000", 2024-09-10T06:26:57.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3339000000000001e-05 2024-09-10T06:26:57.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505545+0000", 2024-09-10T06:26:57.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6991999999999999e-05 2024-09-10T06:26:57.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505697+0000", 2024-09-10T06:26:57.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015241500000000001 2024-09-10T06:26:57.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505746+0000", 2024-09-10T06:26:57.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8433000000000002e-05 2024-09-10T06:26:57.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.508413+0000", 2024-09-10T06:26:57.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026673360000000002 2024-09-10T06:26:57.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.508522+0000", 2024-09-10T06:26:57.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010880899999999999 2024-09-10T06:26:57.391 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.391 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.391 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.391 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:480 6.5 e34/28 6:a4a56432:::obj_delete_at_hint.0000000012:head v 34'4, mlcod=34'2)", 2024-09-10T06:26:57.391 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.509954+0000", 2024-09-10T06:26:57.391 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.810057254, 2024-09-10T06:26:57.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038074789999999999, 2024-09-10T06:26:57.391 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.391 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.392 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.392 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509954+0000", 2024-09-10T06:26:57.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509954+0000", 2024-09-10T06:26:57.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509955+0000", 2024-09-10T06:26:57.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.266e-06 2024-09-10T06:26:57.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509966+0000", 2024-09-10T06:26:57.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0900000000000001e-05 2024-09-10T06:26:57.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509993+0000", 2024-09-10T06:26:57.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6633999999999999e-05 2024-09-10T06:26:57.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.510011+0000", 2024-09-10T06:26:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-10T06:26:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.510141+0000", 2024-09-10T06:26:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130063 2024-09-10T06:26:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.510193+0000", 2024-09-10T06:26:57.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2011000000000001e-05 2024-09-10T06:26:57.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.513634+0000", 2024-09-10T06:26:57.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034407119999999999 2024-09-10T06:26:57.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.513762+0000", 2024-09-10T06:26:57.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012751599999999999 2024-09-10T06:26:57.395 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.395 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.395 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.396 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:485 6.5 e34/28 6:a7f90313:reshard::reshard.0000000012:head v 34'5, mlcod=34'2)", 2024-09-10T06:26:57.396 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.512302+0000", 2024-09-10T06:26:57.396 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.807708974000001, 2024-09-10T06:26:57.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041747709999999999, 2024-09-10T06:26:57.396 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.396 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.396 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.396 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512302+0000", 2024-09-10T06:26:57.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512302+0000", 2024-09-10T06:26:57.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512304+0000", 2024-09-10T06:26:57.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6929999999999999e-06 2024-09-10T06:26:57.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512318+0000", 2024-09-10T06:26:57.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.344e-05 2024-09-10T06:26:57.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512342+0000", 2024-09-10T06:26:57.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4456000000000001e-05 2024-09-10T06:26:57.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512354+0000", 2024-09-10T06:26:57.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2414e-05 2024-09-10T06:26:57.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512484+0000", 2024-09-10T06:26:57.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012974500000000001 2024-09-10T06:26:57.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512523+0000", 2024-09-10T06:26:57.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9124e-05 2024-09-10T06:26:57.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.516392+0000", 2024-09-10T06:26:57.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038686060000000001 2024-09-10T06:26:57.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.516477+0000", 2024-09-10T06:26:57.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5292999999999998e-05 2024-09-10T06:26:57.400 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.400 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.400 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.400 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:490 6.5 e34/28 6:a4a56432:::obj_delete_at_hint.0000000012:head v 34'6, mlcod=34'3)", 2024-09-10T06:26:57.400 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.515761+0000", 2024-09-10T06:26:57.400 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.804249947000001, 2024-09-10T06:26:57.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034429859999999999, 2024-09-10T06:26:57.400 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.400 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.401 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.401 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515761+0000", 2024-09-10T06:26:57.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515761+0000", 2024-09-10T06:26:57.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515764+0000", 2024-09-10T06:26:57.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2699999999999999e-06 2024-09-10T06:26:57.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515779+0000", 2024-09-10T06:26:57.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4973e-05 2024-09-10T06:26:57.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515812+0000", 2024-09-10T06:26:57.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3713000000000001e-05 2024-09-10T06:26:57.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515832+0000", 2024-09-10T06:26:57.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9176000000000001e-05 2024-09-10T06:26:57.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515956+0000", 2024-09-10T06:26:57.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123881 2024-09-10T06:26:57.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.516008+0000", 2024-09-10T06:26:57.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2703e-05 2024-09-10T06:26:57.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.519125+0000", 2024-09-10T06:26:57.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003117098 2024-09-10T06:26:57.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.519204+0000", 2024-09-10T06:26:57.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9171999999999993e-05 2024-09-10T06:26:57.404 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.405 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.405 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.405 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:493 6.5 e34/28 6:a7f90313:reshard::reshard.0000000012:head v 34'7, mlcod=34'4)", 2024-09-10T06:26:57.405 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.518455+0000", 2024-09-10T06:26:57.405 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.801555948000001, 2024-09-10T06:26:57.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027670849999999999, 2024-09-10T06:26:57.405 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.405 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.405 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.405 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518455+0000", 2024-09-10T06:26:57.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518455+0000", 2024-09-10T06:26:57.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518458+0000", 2024-09-10T06:26:57.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0159999999999998e-06 2024-09-10T06:26:57.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518471+0000", 2024-09-10T06:26:57.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.323e-05 2024-09-10T06:26:57.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518509+0000", 2024-09-10T06:26:57.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7942999999999999e-05 2024-09-10T06:26:57.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518528+0000", 2024-09-10T06:26:57.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9553000000000001e-05 2024-09-10T06:26:57.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518675+0000", 2024-09-10T06:26:57.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014679600000000001 2024-09-10T06:26:57.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518731+0000", 2024-09-10T06:26:57.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6302999999999999e-05 2024-09-10T06:26:57.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.521141+0000", 2024-09-10T06:26:57.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024091780000000001 2024-09-10T06:26:57.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.521223+0000", 2024-09-10T06:26:57.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2065999999999997e-05 2024-09-10T06:26:57.409 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.409 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.409 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.410 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:517 6.3 e34/28 6:c31f41d7:gc::gc.10:head v 34'11, mlcod=34'9)", 2024-09-10T06:26:57.410 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.533260+0000", 2024-09-10T06:26:57.410 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.786751726, 2024-09-10T06:26:57.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025463880000000001, 2024-09-10T06:26:57.410 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.410 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.410 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.410 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533260+0000", 2024-09-10T06:26:57.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533260+0000", 2024-09-10T06:26:57.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533261+0000", 2024-09-10T06:26:57.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.725e-06 2024-09-10T06:26:57.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533272+0000", 2024-09-10T06:26:57.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0569e-05 2024-09-10T06:26:57.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533300+0000", 2024-09-10T06:26:57.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7763000000000002e-05 2024-09-10T06:26:57.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533318+0000", 2024-09-10T06:26:57.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7805e-05 2024-09-10T06:26:57.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533457+0000", 2024-09-10T06:26:57.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139763 2024-09-10T06:26:57.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533493+0000", 2024-09-10T06:26:57.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6087000000000002e-05 2024-09-10T06:26:57.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535679+0000", 2024-09-10T06:26:57.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021851029999999999 2024-09-10T06:26:57.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535806+0000", 2024-09-10T06:26:57.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012757299999999999 2024-09-10T06:26:57.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.414 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.414 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:937 6.1f e34/28 6:fd6b5df8:::obj_delete_at_hint.0000000120:head v 34'10, mlcod=34'8)", 2024-09-10T06:26:57.414 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.208068+0000", 2024-09-10T06:26:57.414 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.111943281, 2024-09-10T06:26:57.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036467819999999999, 2024-09-10T06:26:57.414 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.414 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.414 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.414 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208068+0000", 2024-09-10T06:26:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208068+0000", 2024-09-10T06:26:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208070+0000", 2024-09-10T06:26:57.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.283e-06 2024-09-10T06:26:57.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208083+0000", 2024-09-10T06:26:57.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2303999999999999e-05 2024-09-10T06:26:57.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208111+0000", 2024-09-10T06:26:57.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8473e-05 2024-09-10T06:26:57.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208124+0000", 2024-09-10T06:26:57.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2866e-05 2024-09-10T06:26:57.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208273+0000", 2024-09-10T06:26:57.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014932300000000001 2024-09-10T06:26:57.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208312+0000", 2024-09-10T06:26:57.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8442999999999998e-05 2024-09-10T06:26:57.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.211643+0000", 2024-09-10T06:26:57.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033307609999999998 2024-09-10T06:26:57.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.211715+0000", 2024-09-10T06:26:57.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2329000000000005e-05 2024-09-10T06:26:57.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.418 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.418 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.418 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:26:57.420 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:26:57.420 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:57.419+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:57.521 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:57.519+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:26:57.590 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:26:57.590 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:26:57.590 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:26:57.590 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:26:57.606 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:26:57.623 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:57.623+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:26:57.723 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:26:57.723+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:26:57.727 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:26:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:26:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:26:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:26:57.728 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:26:57.742 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:26:57.824 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:57.823+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:26:57.911 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:26:57.912 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:26:57.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:26:57.912 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:26:57.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.912 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.912 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:26:57.912 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.463917715000001, 2024-09-10T06:26:57.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70775834699999995, 2024-09-10T06:26:57.912 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.912 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.913 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.913 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1 2024-09-10T06:26:57.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.913 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:26:57.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:26:57.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446852+0000", 2024-09-10T06:26:57.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.117e-06 2024-09-10T06:26:57.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446870+0000", 2024-09-10T06:26:57.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7569999999999999e-05 2024-09-10T06:26:57.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446892+0000", 2024-09-10T06:26:57.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2036e-05 2024-09-10T06:26:57.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446908+0000", 2024-09-10T06:26:57.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6719999999999999e-05 2024-09-10T06:26:57.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447040+0000", 2024-09-10T06:26:57.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013118299999999999 2024-09-10T06:26:57.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:26:57.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447054+0000", 2024-09-10T06:26:57.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4343e-05 2024-09-10T06:26:57.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.151730+0000", 2024-09-10T06:26:57.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70467560600000001 2024-09-10T06:26:57.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152054+0000", 2024-09-10T06:26:57.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032444100000000002 2024-09-10T06:26:57.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:57.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152404+0000", 2024-09-10T06:26:57.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000349938 2024-09-10T06:26:57.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.153773+0000", 2024-09-10T06:26:57.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013693620000000001 2024-09-10T06:26:57.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154454+0000", 2024-09-10T06:26:57.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068035800000000005 2024-09-10T06:26:57.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154544+0000", 2024-09-10T06:26:57.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0623000000000003e-05 2024-09-10T06:26:57.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154607+0000", 2024-09-10T06:26:57.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3050000000000001e-05 2024-09-10T06:26:57.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.919 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.919 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.919 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.283936+0000", 2024-09-10T06:26:57.919 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.626830179999999, 2024-09-10T06:26:57.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010619014, 2024-09-10T06:26:57.919 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.919 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.920 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 42 2024-09-10T06:26:57.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.920 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283936+0000", 2024-09-10T06:26:57.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283936+0000", 2024-09-10T06:26:57.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283937+0000", 2024-09-10T06:26:57.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1699999999999997e-07 2024-09-10T06:26:57.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283943+0000", 2024-09-10T06:26:57.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.716e-06 2024-09-10T06:26:57.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283957+0000", 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.438e-05 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283966+0000", 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1629999999999996e-06 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.288081+0000", 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041155260000000004 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.288243+0000", 2024-09-10T06:26:57.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016151800000000001 2024-09-10T06:26:57.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:57.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.288447+0000", 2024-09-10T06:26:57.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000204009 2024-09-10T06:26:57.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.291733+0000", 2024-09-10T06:26:57.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032862970000000001 2024-09-10T06:26:57.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294272+0000", 2024-09-10T06:26:57.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025391910000000001 2024-09-10T06:26:57.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294437+0000", 2024-09-10T06:26:57.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016503500000000001 2024-09-10T06:26:57.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294555+0000", 2024-09-10T06:26:57.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118262 2024-09-10T06:26:57.925 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.925 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.925 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.925 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.925 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284185+0000", 2024-09-10T06:26:57.925 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.626581231999999, 2024-09-10T06:26:57.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010770666, 2024-09-10T06:26:57.925 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.925 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.925 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.926 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 43 2024-09-10T06:26:57.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.926 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284185+0000", 2024-09-10T06:26:57.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284185+0000", 2024-09-10T06:26:57.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284187+0000", 2024-09-10T06:26:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.424e-06 2024-09-10T06:26:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284194+0000", 2024-09-10T06:26:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5100000000000001e-06 2024-09-10T06:26:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284207+0000", 2024-09-10T06:26:57.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2173e-05 2024-09-10T06:26:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284214+0000", 2024-09-10T06:26:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9160000000000001e-06 2024-09-10T06:26:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.289407+0000", 2024-09-10T06:26:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005192543 2024-09-10T06:26:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.289526+0000", 2024-09-10T06:26:57.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119156 2024-09-10T06:26:57.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:57.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.289722+0000", 2024-09-10T06:26:57.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019601199999999999 2024-09-10T06:26:57.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294577+0000", 2024-09-10T06:26:57.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048552719999999999 2024-09-10T06:26:57.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294689+0000", 2024-09-10T06:26:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111859 2024-09-10T06:26:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294841+0000", 2024-09-10T06:26:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015141899999999999 2024-09-10T06:26:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294956+0000", 2024-09-10T06:26:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115382 2024-09-10T06:26:57.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.931 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.931 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.931 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.931 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284355+0000", 2024-09-10T06:26:57.931 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.626411636999997, 2024-09-10T06:26:57.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010886453000000001, 2024-09-10T06:26:57.931 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.932 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.932 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44 2024-09-10T06:26:57.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.932 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284355+0000", 2024-09-10T06:26:57.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284355+0000", 2024-09-10T06:26:57.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284356+0000", 2024-09-10T06:26:57.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.387e-06 2024-09-10T06:26:57.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284491+0000", 2024-09-10T06:26:57.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414899999999999 2024-09-10T06:26:57.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284524+0000", 2024-09-10T06:26:57.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3019999999999999e-05 2024-09-10T06:26:57.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284534+0000", 2024-09-10T06:26:57.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0682999999999999e-05 2024-09-10T06:26:57.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.290328+0000", 2024-09-10T06:26:57.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057935419999999996 2024-09-10T06:26:57.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.290474+0000", 2024-09-10T06:26:57.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014634500000000001 2024-09-10T06:26:57.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:57.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.290686+0000", 2024-09-10T06:26:57.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021220599999999999 2024-09-10T06:26:57.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294993+0000", 2024-09-10T06:26:57.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043067160000000004 2024-09-10T06:26:57.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295116+0000", 2024-09-10T06:26:57.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123416 2024-09-10T06:26:57.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295190+0000", 2024-09-10T06:26:57.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3325999999999996e-05 2024-09-10T06:26:57.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295241+0000", 2024-09-10T06:26:57.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1663000000000003e-05 2024-09-10T06:26:57.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.937 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.937 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.937 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284582+0000", 2024-09-10T06:26:57.937 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.626184361, 2024-09-10T06:26:57.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013156691, 2024-09-10T06:26:57.937 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.937 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.937 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284582+0000", 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284582+0000", 2024-09-10T06:26:57.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284584+0000", 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.443e-06 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284614+0000", 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9839999999999999e-05 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284633+0000", 2024-09-10T06:26:57.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9446e-05 2024-09-10T06:26:57.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284642+0000", 2024-09-10T06:26:57.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0899999999999994e-06 2024-09-10T06:26:57.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.291833+0000", 2024-09-10T06:26:57.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071913380000000002 2024-09-10T06:26:57.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.291959+0000", 2024-09-10T06:26:57.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012549499999999999 2024-09-10T06:26:57.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:57.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.292160+0000", 2024-09-10T06:26:57.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020070900000000001 2024-09-10T06:26:57.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295013+0000", 2024-09-10T06:26:57.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028534509999999999 2024-09-10T06:26:57.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297598+0000", 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025848400000000001 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297674+0000", 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6515999999999997e-05 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297739+0000", 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4523000000000005e-05 2024-09-10T06:26:57.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284661+0000", 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.626105981999999, 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015677505000000001, 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.943 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 46 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284661+0000", 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284661+0000", 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284662+0000", 2024-09-10T06:26:57.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4e-07 2024-09-10T06:26:57.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284668+0000", 2024-09-10T06:26:57.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-10T06:26:57.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284681+0000", 2024-09-10T06:26:57.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3644e-05 2024-09-10T06:26:57.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284689+0000", 2024-09-10T06:26:57.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4159999999999998e-06 2024-09-10T06:26:57.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.292881+0000", 2024-09-10T06:26:57.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081926929999999992 2024-09-10T06:26:57.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.293129+0000", 2024-09-10T06:26:57.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024731900000000002 2024-09-10T06:26:57.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:57.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.293518+0000", 2024-09-10T06:26:57.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038924700000000001 2024-09-10T06:26:57.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297510+0000", 2024-09-10T06:26:57.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039916220000000002 2024-09-10T06:26:57.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300194+0000", 2024-09-10T06:26:57.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002684053 2024-09-10T06:26:57.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300275+0000", 2024-09-10T06:26:57.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1369e-05 2024-09-10T06:26:57.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300338+0000", 2024-09-10T06:26:57.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3225999999999994e-05 2024-09-10T06:26:57.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.948 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.949 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.949 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284708+0000", 2024-09-10T06:26:57.949 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.626058336, 2024-09-10T06:26:57.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015911141, 2024-09-10T06:26:57.949 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.949 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.949 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.949 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47 2024-09-10T06:26:57.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.949 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284708+0000", 2024-09-10T06:26:57.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284708+0000", 2024-09-10T06:26:57.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284709+0000", 2024-09-10T06:26:57.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7400000000000003e-07 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284790+0000", 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1151999999999998e-05 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284801+0000", 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.115e-05 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284809+0000", 2024-09-10T06:26:57.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295333+0000", 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010523858000000001 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295456+0000", 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123492 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295692+0000", 2024-09-10T06:26:57.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023550900000000001 2024-09-10T06:26:57.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298813+0000", 2024-09-10T06:26:57.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031209190000000002 2024-09-10T06:26:57.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300487+0000", 2024-09-10T06:26:57.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001673997 2024-09-10T06:26:57.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300564+0000", 2024-09-10T06:26:57.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7522999999999996e-05 2024-09-10T06:26:57.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300619+0000", 2024-09-10T06:26:57.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5189999999999998e-05 2024-09-10T06:26:57.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.954 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.954 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.954 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:26:57.955 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.625922047000003, 2024-09-10T06:26:57.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015989453000000001, 2024-09-10T06:26:57.955 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.955 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.955 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48 2024-09-10T06:26:57.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.955 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:26:57.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:26:57.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:26:57.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8400000000000003e-07 2024-09-10T06:26:57.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284851+0000", 2024-09-10T06:26:57.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.993e-06 2024-09-10T06:26:57.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284873+0000", 2024-09-10T06:26:57.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1319999999999999e-05 2024-09-10T06:26:57.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284894+0000", 2024-09-10T06:26:57.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1265999999999999e-05 2024-09-10T06:26:57.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.296618+0000", 2024-09-10T06:26:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011724106 2024-09-10T06:26:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.296750+0000", 2024-09-10T06:26:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013185200000000001 2024-09-10T06:26:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.296946+0000", 2024-09-10T06:26:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000195832 2024-09-10T06:26:57.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300394+0000", 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034477570000000001 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300717+0000", 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032347399999999997 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300783+0000", 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6093000000000006e-05 2024-09-10T06:26:57.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300834+0000", 2024-09-10T06:26:57.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0976000000000001e-05 2024-09-10T06:26:57.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.960 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.960 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.960 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284913+0000", 2024-09-10T06:26:57.960 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.625854060999998, 2024-09-10T06:26:57.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017983938000000001, 2024-09-10T06:26:57.960 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49 2024-09-10T06:26:57.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.961 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284913+0000", 2024-09-10T06:26:57.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284913+0000", 2024-09-10T06:26:57.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284914+0000", 2024-09-10T06:26:57.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300000000000001e-06 2024-09-10T06:26:57.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284920+0000", 2024-09-10T06:26:57.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5100000000000004e-06 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284931+0000", 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0857e-05 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284938+0000", 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1130000000000003e-06 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297873+0000", 2024-09-10T06:26:57.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012934863 2024-09-10T06:26:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298041+0000", 2024-09-10T06:26:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016838899999999999 2024-09-10T06:26:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298237+0000", 2024-09-10T06:26:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019565199999999999 2024-09-10T06:26:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300859+0000", 2024-09-10T06:26:57.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026216099999999999 2024-09-10T06:26:57.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302759+0000", 2024-09-10T06:26:57.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019006819999999999 2024-09-10T06:26:57.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302835+0000", 2024-09-10T06:26:57.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5636000000000006e-05 2024-09-10T06:26:57.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302897+0000", 2024-09-10T06:26:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1595999999999998e-05 2024-09-10T06:26:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:26:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.625812044, 2024-09-10T06:26:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019245090999999999, 2024-09-10T06:26:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.966 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.967 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 50 2024-09-10T06:26:57.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.967 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:26:57.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:26:57.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:26:57.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3e-07 2024-09-10T06:26:57.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285037+0000", 2024-09-10T06:26:57.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2008999999999994e-05 2024-09-10T06:26:57.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285049+0000", 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1816e-05 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285057+0000", 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8639999999999996e-06 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298896+0000", 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013838743000000001 2024-09-10T06:26:57.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.299025+0000", 2024-09-10T06:26:57.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129352 2024-09-10T06:26:57.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:57.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.299222+0000", 2024-09-10T06:26:57.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019682200000000001 2024-09-10T06:26:57.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302676+0000", 2024-09-10T06:26:57.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00345371 2024-09-10T06:26:57.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304050+0000", 2024-09-10T06:26:57.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001374779 2024-09-10T06:26:57.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304135+0000", 2024-09-10T06:26:57.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4640000000000003e-05 2024-09-10T06:26:57.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304200+0000", 2024-09-10T06:26:57.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4626000000000001e-05 2024-09-10T06:26:57.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.972 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.972 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.972 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:26:57.972 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.625689795, 2024-09-10T06:26:57.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021819150999999998, 2024-09-10T06:26:57.972 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.972 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 51 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:26:57.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285078+0000", 2024-09-10T06:26:57.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000001e-07 2024-09-10T06:26:57.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285083+0000", 2024-09-10T06:26:57.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6099999999999997e-06 2024-09-10T06:26:57.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285092+0000", 2024-09-10T06:26:57.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2399999999999996e-06 2024-09-10T06:26:57.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285100+0000", 2024-09-10T06:26:57.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8739999999999995e-06 2024-09-10T06:26:57.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300938+0000", 2024-09-10T06:26:57.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015837527000000001 2024-09-10T06:26:57.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301058+0000", 2024-09-10T06:26:57.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012032300000000001 2024-09-10T06:26:57.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:57.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301251+0000", 2024-09-10T06:26:57.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192828 2024-09-10T06:26:57.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302937+0000", 2024-09-10T06:26:57.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016857339999999999 2024-09-10T06:26:57.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306745+0000", 2024-09-10T06:26:57.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038078729999999998 2024-09-10T06:26:57.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306830+0000", 2024-09-10T06:26:57.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5432999999999993e-05 2024-09-10T06:26:57.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306896+0000", 2024-09-10T06:26:57.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5993000000000003e-05 2024-09-10T06:26:57.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.978 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.978 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.978 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:26:57.978 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.625649918999997, 2024-09-10T06:26:57.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021995553000000001, 2024-09-10T06:26:57.979 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.979 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.979 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.979 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.979 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 52 2024-09-10T06:26:57.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.979 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:26:57.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:26:57.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:26:57.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4000000000000001e-07 2024-09-10T06:26:57.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285123+0000", 2024-09-10T06:26:57.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6969999999999998e-06 2024-09-10T06:26:57.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285132+0000", 2024-09-10T06:26:57.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1560000000000001e-06 2024-09-10T06:26:57.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285139+0000", 2024-09-10T06:26:57.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1539999999999996e-06 2024-09-10T06:26:57.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301865+0000", 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016725173999999999 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301995+0000", 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130739 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302195+0000", 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000199965 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.303135+0000", 2024-09-10T06:26:57.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093978300000000002 2024-09-10T06:26:57.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306979+0000", 2024-09-10T06:26:57.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038437459999999999 2024-09-10T06:26:57.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307057+0000", 2024-09-10T06:26:57.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7766e-05 2024-09-10T06:26:57.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307112+0000", 2024-09-10T06:26:57.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5733000000000003e-05 2024-09-10T06:26:57.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.984 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.984 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.984 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529402+0000", 2024-09-10T06:26:57.984 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.381364611000002, 2024-09-10T06:26:57.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011777342, 2024-09-10T06:26:57.985 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.985 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.985 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 69 2024-09-10T06:26:57.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.985 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529402+0000", 2024-09-10T06:26:57.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529402+0000", 2024-09-10T06:26:57.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529403+0000", 2024-09-10T06:26:57.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0499999999999999e-06 2024-09-10T06:26:57.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529550+0000", 2024-09-10T06:26:57.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146549 2024-09-10T06:26:57.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529564+0000", 2024-09-10T06:26:57.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4572999999999999e-05 2024-09-10T06:26:57.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529573+0000", 2024-09-10T06:26:57.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0429999999999996e-06 2024-09-10T06:26:57.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532154+0000", 2024-09-10T06:26:57.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025812209999999999 2024-09-10T06:26:57.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532208+0000", 2024-09-10T06:26:57.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3127000000000001e-05 2024-09-10T06:26:57.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:57.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532301+0000", 2024-09-10T06:26:57.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3567999999999996e-05 2024-09-10T06:26:57.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533640+0000", 2024-09-10T06:26:57.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001338679 2024-09-10T06:26:57.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541107+0000", 2024-09-10T06:26:57.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074675660000000001 2024-09-10T06:26:57.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541144+0000", 2024-09-10T06:26:57.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6196999999999999e-05 2024-09-10T06:26:57.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541179+0000", 2024-09-10T06:26:57.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5769000000000003e-05 2024-09-10T06:26:57.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.990 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.990 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.990 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529592+0000", 2024-09-10T06:26:57.990 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.381174561999998, 2024-09-10T06:26:57.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011685376000000001, 2024-09-10T06:26:57.990 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.991 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.991 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.991 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70 2024-09-10T06:26:57.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.991 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529592+0000", 2024-09-10T06:26:57.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529592+0000", 2024-09-10T06:26:57.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529593+0000", 2024-09-10T06:26:57.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9600000000000008e-07 2024-09-10T06:26:57.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529600+0000", 2024-09-10T06:26:57.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9870000000000002e-06 2024-09-10T06:26:57.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529610+0000", 2024-09-10T06:26:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9399999999999997e-06 2024-09-10T06:26:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529617+0000", 2024-09-10T06:26:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2370000000000003e-06 2024-09-10T06:26:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532907+0000", 2024-09-10T06:26:57.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032897930000000001 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532977+0000", 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0308999999999994e-05 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533073+0000", 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5461e-05 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536700+0000", 2024-09-10T06:26:57.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036268329999999999 2024-09-10T06:26:57.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:57.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541212+0000", 2024-09-10T06:26:57.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045119679999999999 2024-09-10T06:26:57.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:57.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541252+0000", 2024-09-10T06:26:57.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0472000000000001e-05 2024-09-10T06:26:57.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:57.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541277+0000", 2024-09-10T06:26:57.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5380000000000001e-05 2024-09-10T06:26:57.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.996 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:57.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:57.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.996 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:57.996 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529632+0000", 2024-09-10T06:26:57.996 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.381134838999998, 2024-09-10T06:26:57.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011740044999999999, 2024-09-10T06:26:57.996 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:57.996 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:57.996 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:57.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:57.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:57.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:57.997 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71 2024-09-10T06:26:57.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.997 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:57.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:57.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529632+0000", 2024-09-10T06:26:57.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:57.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529632+0000", 2024-09-10T06:26:57.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:57.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:57.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529633+0000", 2024-09-10T06:26:57.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9299999999999997e-07 2024-09-10T06:26:57.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:57.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529638+0000", 2024-09-10T06:26:57.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4559999999999999e-06 2024-09-10T06:26:57.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:57.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529648+0000", 2024-09-10T06:26:57.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5170000000000005e-06 2024-09-10T06:26:57.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:57.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529654+0000", 2024-09-10T06:26:57.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6669999999999999e-06 2024-09-10T06:26:57.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:57.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:57.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533778+0000", 2024-09-10T06:26:57.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041238220000000001 2024-09-10T06:26:57.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:57.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:58.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533846+0000", 2024-09-10T06:26:58.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7448999999999997e-05 2024-09-10T06:26:58.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:58.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533939+0000", 2024-09-10T06:26:58.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-10T06:26:58.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:58.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537278+0000", 2024-09-10T06:26:58.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033388580000000001 2024-09-10T06:26:58.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:58.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541309+0000", 2024-09-10T06:26:58.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040306389999999999 2024-09-10T06:26:58.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:58.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541348+0000", 2024-09-10T06:26:58.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9536000000000002e-05 2024-09-10T06:26:58.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:58.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541372+0000", 2024-09-10T06:26:58.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3587e-05 2024-09-10T06:26:58.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:58.002 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:58.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:58.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.002 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:58.002 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:26:58.002 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.38109395, 2024-09-10T06:26:58.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011791240999999999, 2024-09-10T06:26:58.002 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:58.002 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:58.002 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72 2024-09-10T06:26:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:26:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:26:58.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:26:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8700000000000005e-07 2024-09-10T06:26:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529846+0000", 2024-09-10T06:26:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017278199999999999 2024-09-10T06:26:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:58.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529890+0000", 2024-09-10T06:26:58.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3466e-05 2024-09-10T06:26:58.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529903+0000", 2024-09-10T06:26:58.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3327e-05 2024-09-10T06:26:58.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:58.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.534254+0000", 2024-09-10T06:26:58.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043508389999999996 2024-09-10T06:26:58.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:58.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.534311+0000", 2024-09-10T06:26:58.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7405999999999999e-05 2024-09-10T06:26:58.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:58.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.534406+0000", 2024-09-10T06:26:58.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4671000000000002e-05 2024-09-10T06:26:58.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:58.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537284+0000", 2024-09-10T06:26:58.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002878027 2024-09-10T06:26:58.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541411+0000", 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041269790000000002 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541441+0000", 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0385000000000001e-05 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541464+0000", 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2671999999999999e-05 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:58.007 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:58.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:58.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.008 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:58.008 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529930+0000", 2024-09-10T06:26:58.008 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.380836678999998, 2024-09-10T06:26:58.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011624766999999999, 2024-09-10T06:26:58.008 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:58.008 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:58.008 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:58.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:58.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:58.008 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 73 2024-09-10T06:26:58.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.009 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:58.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:58.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529930+0000", 2024-09-10T06:26:58.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:58.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:58.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529930+0000", 2024-09-10T06:26:58.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:58.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529931+0000", 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0470000000000001e-06 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529938+0000", 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0770000000000002e-06 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529975+0000", 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7366000000000001e-05 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529989+0000", 2024-09-10T06:26:58.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3617e-05 2024-09-10T06:26:58.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:58.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536230+0000", 2024-09-10T06:26:58.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062414089999999998 2024-09-10T06:26:58.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:58.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536286+0000", 2024-09-10T06:26:58.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5077999999999997e-05 2024-09-10T06:26:58.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:58.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536383+0000", 2024-09-10T06:26:58.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7656000000000001e-05 2024-09-10T06:26:58.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:58.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539732+0000", 2024-09-10T06:26:58.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003348635 2024-09-10T06:26:58.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:58.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541501+0000", 2024-09-10T06:26:58.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017696249999999999 2024-09-10T06:26:58.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:58.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541531+0000", 2024-09-10T06:26:58.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9057999999999999e-05 2024-09-10T06:26:58.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:58.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541555+0000", 2024-09-10T06:26:58.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4199e-05 2024-09-10T06:26:58.013 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:58.013 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:58.013 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:58.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.530006+0000", 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.380760578999997, 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011638819, 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:58.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:58.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530006+0000", 2024-09-10T06:26:58.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:58.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:58.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530006+0000", 2024-09-10T06:26:58.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:58.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:58.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530007+0000", 2024-09-10T06:26:58.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0400000000000005e-07 2024-09-10T06:26:58.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:58.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530013+0000", 2024-09-10T06:26:58.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7459999999999997e-06 2024-09-10T06:26:58.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:58.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530023+0000", 2024-09-10T06:26:58.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.058e-05 2024-09-10T06:26:58.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530037+0000", 2024-09-10T06:26:58.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3380000000000001e-05 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536855+0000", 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006818419 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536910+0000", 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5188000000000001e-05 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537006+0000", 2024-09-10T06:26:58.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5622e-05 2024-09-10T06:26:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539737+0000", 2024-09-10T06:26:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027316060000000001 2024-09-10T06:26:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541593+0000", 2024-09-10T06:26:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018553879999999999 2024-09-10T06:26:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:58.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541623+0000", 2024-09-10T06:26:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0397999999999999e-05 2024-09-10T06:26:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541645+0000", 2024-09-10T06:26:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1688e-05 2024-09-10T06:26:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:26:58.019 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.380716049999997, 2024-09-10T06:26:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011680293, 2024-09-10T06:26:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 75 2024-09-10T06:26:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:26:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4700000000000001e-07 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530158+0000", 2024-09-10T06:26:58.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010655299999999999 2024-09-10T06:26:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530170+0000", 2024-09-10T06:26:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2403e-05 2024-09-10T06:26:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530178+0000", 2024-09-10T06:26:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-10T06:26:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537326+0000", 2024-09-10T06:26:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071483170000000004 2024-09-10T06:26:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537381+0000", 2024-09-10T06:26:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4666999999999997e-05 2024-09-10T06:26:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537476+0000", 2024-09-10T06:26:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4813000000000002e-05 2024-09-10T06:26:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:58.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539753+0000", 2024-09-10T06:26:58.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022772410000000002 2024-09-10T06:26:58.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:58.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541675+0000", 2024-09-10T06:26:58.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001922586 2024-09-10T06:26:58.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:58.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541706+0000", 2024-09-10T06:26:58.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0210999999999999e-05 2024-09-10T06:26:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541731+0000", 2024-09-10T06:26:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5275000000000001e-05 2024-09-10T06:26:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:26:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:26:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.380571074000002, 2024-09-10T06:26:58.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012563269, 2024-09-10T06:26:58.026 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:26:58.026 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:26:58.026 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:26:58.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:26:58.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:26:58.026 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 76 2024-09-10T06:26:58.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.026 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:26:58.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:26:58.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:26:58.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:58.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:26:58.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:26:58.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:26:58.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:26:58.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:26:58.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7300000000000005e-07 2024-09-10T06:26:58.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:26:58.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530202+0000", 2024-09-10T06:26:58.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.57e-06 2024-09-10T06:26:58.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:26:58.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530211+0000", 2024-09-10T06:26:58.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4769999999999992e-06 2024-09-10T06:26:58.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530222+0000", 2024-09-10T06:26:58.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0139999999999999e-05 2024-09-10T06:26:58.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:26:58.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539284+0000", 2024-09-10T06:26:58.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090626879999999993 2024-09-10T06:26:58.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:26:58.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539353+0000", 2024-09-10T06:26:58.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8397000000000003e-05 2024-09-10T06:26:58.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:26:58.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539451+0000", 2024-09-10T06:26:58.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8621000000000003e-05 2024-09-10T06:26:58.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:26:58.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.540129+0000", 2024-09-10T06:26:58.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00067820900000000004 2024-09-10T06:26:58.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:58.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.542706+0000", 2024-09-10T06:26:58.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025768760000000001 2024-09-10T06:26:58.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:26:58.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.542736+0000", 2024-09-10T06:26:58.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0125e-05 2024-09-10T06:26:58.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:26:58.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:26:58.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:26:58.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.542759+0000", 2024-09-10T06:26:58.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2393000000000001e-05 2024-09-10T06:26:58.031 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:58.031 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:58.031 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:58.031 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:26:58.031 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:26:58.031 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:26:58.033 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:26:58.033 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:58.031+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:26:58.134 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:58.131+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:26:58.164 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:26:58.164 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:26:58.164 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:26:58.164 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:26:58.178 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:26:58.235 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:26:58.235+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:26:58.337 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:26:58.339+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:26:58.342 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:26:58.342 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:26:58.342 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:26:58.342 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:26:58.342 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:26:58.356 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:26:58.438 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:26:58.435+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:26:58.480 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:26:58.481 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:26:58.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:26:58.481 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:26:58.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.481 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:46 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'28, mlcod=16'22)", 2024-09-10T06:26:58.481 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:26:58.481 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.186140002999998, 2024-09-10T06:26:58.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042526789999999997, 2024-09-10T06:26:58.481 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.481 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.481 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.481 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:26:58.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:26:58.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293571+0000", 2024-09-10T06:26:58.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1119999999999999e-06 2024-09-10T06:26:58.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293577+0000", 2024-09-10T06:26:58.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2179999999999996e-06 2024-09-10T06:26:58.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293596+0000", 2024-09-10T06:26:58.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9170000000000001e-05 2024-09-10T06:26:58.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293605+0000", 2024-09-10T06:26:58.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4060000000000005e-06 2024-09-10T06:26:58.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293654+0000", 2024-09-10T06:26:58.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9116999999999997e-05 2024-09-10T06:26:58.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293671+0000", 2024-09-10T06:26:58.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7110999999999999e-05 2024-09-10T06:26:58.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.297783+0000", 2024-09-10T06:26:58.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041121409999999997 2024-09-10T06:26:58.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.297822+0000", 2024-09-10T06:26:58.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9403999999999997e-05 2024-09-10T06:26:58.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.485 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.486 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:50 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'26)", 2024-09-10T06:26:58.486 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:26:58.486 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.180351504000001, 2024-09-10T06:26:58.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042664490000000003, 2024-09-10T06:26:58.486 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.486 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.486 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.486 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:26:58.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:26:58.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299359+0000", 2024-09-10T06:26:58.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1100000000000004e-07 2024-09-10T06:26:58.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299425+0000", 2024-09-10T06:26:58.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5994999999999994e-05 2024-09-10T06:26:58.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299440+0000", 2024-09-10T06:26:58.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4552999999999999e-05 2024-09-10T06:26:58.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299448+0000", 2024-09-10T06:26:58.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7469999999999994e-06 2024-09-10T06:26:58.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299504+0000", 2024-09-10T06:26:58.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5257999999999998e-05 2024-09-10T06:26:58.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299518+0000", 2024-09-10T06:26:58.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4037e-05 2024-09-10T06:26:58.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.303578+0000", 2024-09-10T06:26:58.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040603439999999996 2024-09-10T06:26:58.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.303625+0000", 2024-09-10T06:26:58.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6604000000000003e-05 2024-09-10T06:26:58.490 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.490 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.490 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.490 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:51 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-10T06:26:58.490 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:26:58.490 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.178344924000001, 2024-09-10T06:26:58.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048711279999999997, 2024-09-10T06:26:58.491 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.491 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.491 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.491 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:26:58.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:26:58.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301366+0000", 2024-09-10T06:26:58.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079999999999999e-06 2024-09-10T06:26:58.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301400+0000", 2024-09-10T06:26:58.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3816000000000003e-05 2024-09-10T06:26:58.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301419+0000", 2024-09-10T06:26:58.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9032e-05 2024-09-10T06:26:58.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301427+0000", 2024-09-10T06:26:58.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-10T06:26:58.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301475+0000", 2024-09-10T06:26:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8201999999999997e-05 2024-09-10T06:26:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301494+0000", 2024-09-10T06:26:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8791e-05 2024-09-10T06:26:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306182+0000", 2024-09-10T06:26:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046878379999999997 2024-09-10T06:26:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306236+0000", 2024-09-10T06:26:58.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3764999999999998e-05 2024-09-10T06:26:58.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.495 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.495 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:52 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'34, mlcod=16'29)", 2024-09-10T06:26:58.495 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:26:58.495 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.177355568999999, 2024-09-10T06:26:58.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039365659999999999, 2024-09-10T06:26:58.495 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.496 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.496 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.496 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:26:58.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:26:58.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302355+0000", 2024-09-10T06:26:58.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.009e-06 2024-09-10T06:26:58.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302373+0000", 2024-09-10T06:26:58.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8232000000000001e-05 2024-09-10T06:26:58.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302388+0000", 2024-09-10T06:26:58.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4246999999999999e-05 2024-09-10T06:26:58.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302400+0000", 2024-09-10T06:26:58.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2054e-05 2024-09-10T06:26:58.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302449+0000", 2024-09-10T06:26:58.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9119000000000002e-05 2024-09-10T06:26:58.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302461+0000", 2024-09-10T06:26:58.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2206e-05 2024-09-10T06:26:58.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306238+0000", 2024-09-10T06:26:58.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037773889999999999 2024-09-10T06:26:58.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306291+0000", 2024-09-10T06:26:58.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2309999999999999e-05 2024-09-10T06:26:58.500 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.500 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.500 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.500 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:55 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'37, mlcod=16'33)", 2024-09-10T06:26:58.500 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:26:58.500 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 40.169049868000002, 2024-09-10T06:26:58.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041116740000000001, 2024-09-10T06:26:58.500 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.500 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.500 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.500 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:26:58.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:26:58.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310661+0000", 2024-09-10T06:26:58.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3600000000000003e-07 2024-09-10T06:26:58.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310724+0000", 2024-09-10T06:26:58.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3706000000000003e-05 2024-09-10T06:26:58.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310734+0000", 2024-09-10T06:26:58.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0207000000000001e-05 2024-09-10T06:26:58.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310740+0000", 2024-09-10T06:26:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8760000000000002e-06 2024-09-10T06:26:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310796+0000", 2024-09-10T06:26:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6206999999999999e-05 2024-09-10T06:26:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310813+0000", 2024-09-10T06:26:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6385999999999999e-05 2024-09-10T06:26:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.314729+0000", 2024-09-10T06:26:58.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039157469999999998 2024-09-10T06:26:58.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.314771+0000", 2024-09-10T06:26:58.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2809000000000003e-05 2024-09-10T06:26:58.504 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.504 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.504 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.505 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'47, mlcod=16'41)", 2024-09-10T06:26:58.505 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:26:58.505 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.947312521999997, 2024-09-10T06:26:58.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0084590540000000006, 2024-09-10T06:26:58.505 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.505 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.505 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.505 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:26:58.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:26:58.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532398+0000", 2024-09-10T06:26:58.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599999999999999e-07 2024-09-10T06:26:58.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532437+0000", 2024-09-10T06:26:58.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8711000000000003e-05 2024-09-10T06:26:58.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532449+0000", 2024-09-10T06:26:58.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2075999999999999e-05 2024-09-10T06:26:58.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532455+0000", 2024-09-10T06:26:58.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2110000000000003e-06 2024-09-10T06:26:58.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533257+0000", 2024-09-10T06:26:58.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080233799999999999 2024-09-10T06:26:58.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533318+0000", 2024-09-10T06:26:58.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1033000000000003e-05 2024-09-10T06:26:58.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540718+0000", 2024-09-10T06:26:58.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073998529999999996 2024-09-10T06:26:58.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540856+0000", 2024-09-10T06:26:58.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013792599999999999 2024-09-10T06:26:58.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.509 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.509 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:70 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'48, mlcod=16'41)", 2024-09-10T06:26:58.509 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:26:58.509 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.946606506999998, 2024-09-10T06:26:58.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0078483679999999997, 2024-09-10T06:26:58.509 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.509 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.510 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.510 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:26:58.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:26:58.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533104+0000", 2024-09-10T06:26:58.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3799999999999997e-07 2024-09-10T06:26:58.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533109+0000", 2024-09-10T06:26:58.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1100000000000002e-06 2024-09-10T06:26:58.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533117+0000", 2024-09-10T06:26:58.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7260000000000002e-06 2024-09-10T06:26:58.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533125+0000", 2024-09-10T06:26:58.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8170000000000005e-06 2024-09-10T06:26:58.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534794+0000", 2024-09-10T06:26:58.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016687760000000001 2024-09-10T06:26:58.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534808+0000", 2024-09-10T06:26:58.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4293e-05 2024-09-10T06:26:58.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540863+0000", 2024-09-10T06:26:58.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060549549999999999 2024-09-10T06:26:58.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540951+0000", 2024-09-10T06:26:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8152999999999994e-05 2024-09-10T06:26:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:71 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'49, mlcod=16'44)", 2024-09-10T06:26:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:26:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.945733359000002, 2024-09-10T06:26:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070511530000000001, 2024-09-10T06:26:58.514 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.515 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.515 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.515 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:26:58.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:26:58.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533978+0000", 2024-09-10T06:26:58.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5799999999999999e-06 2024-09-10T06:26:58.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533987+0000", 2024-09-10T06:26:58.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4460000000000007e-06 2024-09-10T06:26:58.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534017+0000", 2024-09-10T06:26:58.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9524000000000001e-05 2024-09-10T06:26:58.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534027+0000", 2024-09-10T06:26:58.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0593e-05 2024-09-10T06:26:58.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535082+0000", 2024-09-10T06:26:58.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001054609 2024-09-10T06:26:58.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535095+0000", 2024-09-10T06:26:58.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2870999999999999e-05 2024-09-10T06:26:58.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540955+0000", 2024-09-10T06:26:58.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058596270000000001 2024-09-10T06:26:58.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541027+0000", 2024-09-10T06:26:58.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2903000000000003e-05 2024-09-10T06:26:58.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.519 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.519 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:72 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'50, mlcod=16'44)", 2024-09-10T06:26:58.519 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:26:58.519 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.945121196999999, 2024-09-10T06:26:58.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0065158799999999999, 2024-09-10T06:26:58.519 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.519 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.519 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.519 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:26:58.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:26:58.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534591+0000", 2024-09-10T06:26:58.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0729999999999999e-06 2024-09-10T06:26:58.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534722+0000", 2024-09-10T06:26:58.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013124299999999999 2024-09-10T06:26:58.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534746+0000", 2024-09-10T06:26:58.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3903000000000001e-05 2024-09-10T06:26:58.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534758+0000", 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2449000000000001e-05 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535408+0000", 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00064971199999999999 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535465+0000", 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6892999999999999e-05 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541030+0000", 2024-09-10T06:26:58.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055649209999999996 2024-09-10T06:26:58.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541104+0000", 2024-09-10T06:26:58.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4685999999999996e-05 2024-09-10T06:26:58.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.523 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.524 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:73 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'51, mlcod=16'44)", 2024-09-10T06:26:58.524 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:26:58.524 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.943240875000001, 2024-09-10T06:26:58.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047149710000000001, 2024-09-10T06:26:58.526 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.526 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.526 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.526 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:26:58.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:26:58.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536471+0000", 2024-09-10T06:26:58.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.934e-06 2024-09-10T06:26:58.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536482+0000", 2024-09-10T06:26:58.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1542999999999999e-05 2024-09-10T06:26:58.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536511+0000", 2024-09-10T06:26:58.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8649999999999998e-05 2024-09-10T06:26:58.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536527+0000", 2024-09-10T06:26:58.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.649e-05 2024-09-10T06:26:58.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536776+0000", 2024-09-10T06:26:58.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024814800000000001 2024-09-10T06:26:58.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536811+0000", 2024-09-10T06:26:58.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5716000000000002e-05 2024-09-10T06:26:58.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541107+0000", 2024-09-10T06:26:58.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042952770000000001 2024-09-10T06:26:58.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541184+0000", 2024-09-10T06:26:58.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7212999999999994e-05 2024-09-10T06:26:58.530 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.530 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.530 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.530 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:74 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'52, mlcod=16'45)", 2024-09-10T06:26:58.530 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:26:58.531 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.942678301999997, 2024-09-10T06:26:58.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042018239999999998, 2024-09-10T06:26:58.531 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.531 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.531 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.531 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:26:58.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:26:58.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537033+0000", 2024-09-10T06:26:58.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.533e-06 2024-09-10T06:26:58.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537043+0000", 2024-09-10T06:26:58.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0000000000000001e-05 2024-09-10T06:26:58.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537062+0000", 2024-09-10T06:26:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8686999999999999e-05 2024-09-10T06:26:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537072+0000", 2024-09-10T06:26:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0746e-05 2024-09-10T06:26:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537359+0000", 2024-09-10T06:26:58.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000286908 2024-09-10T06:26:58.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537415+0000", 2024-09-10T06:26:58.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5389000000000001e-05 2024-09-10T06:26:58.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541186+0000", 2024-09-10T06:26:58.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037710550000000002 2024-09-10T06:26:58.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541233+0000", 2024-09-10T06:26:58.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7506000000000002e-05 2024-09-10T06:26:58.535 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.535 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.535 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.535 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:75 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'53, mlcod=16'45)", 2024-09-10T06:26:58.535 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:26:58.535 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.942064563999999, 2024-09-10T06:26:58.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036309760000000002, 2024-09-10T06:26:58.536 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.536 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.536 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.536 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:26:58.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:26:58.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537647+0000", 2024-09-10T06:26:58.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8369999999999999e-06 2024-09-10T06:26:58.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537767+0000", 2024-09-10T06:26:58.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119826 2024-09-10T06:26:58.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537798+0000", 2024-09-10T06:26:58.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0775999999999998e-05 2024-09-10T06:26:58.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537811+0000", 2024-09-10T06:26:58.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.327e-05 2024-09-10T06:26:58.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.538148+0000", 2024-09-10T06:26:58.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033750799999999998 2024-09-10T06:26:58.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.538189+0000", 2024-09-10T06:26:58.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0713000000000001e-05 2024-09-10T06:26:58.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541238+0000", 2024-09-10T06:26:58.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030488500000000001 2024-09-10T06:26:58.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541276+0000", 2024-09-10T06:26:58.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8195999999999998e-05 2024-09-10T06:26:58.539 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.540 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.540 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.540 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:77 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'55, mlcod=16'53)", 2024-09-10T06:26:58.540 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:26:58.540 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.935893043999997, 2024-09-10T06:26:58.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041185240000000001, 2024-09-10T06:26:58.540 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.540 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.540 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.540 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:26:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:26:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543818+0000", 2024-09-10T06:26:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8029999999999999e-06 2024-09-10T06:26:58.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543948+0000", 2024-09-10T06:26:58.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129369 2024-09-10T06:26:58.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543977+0000", 2024-09-10T06:26:58.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8813e-05 2024-09-10T06:26:58.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543989+0000", 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2886e-05 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544115+0000", 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012526900000000001 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544174+0000", 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9166999999999998e-05 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547867+0000", 2024-09-10T06:26:58.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036934340000000002 2024-09-10T06:26:58.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547935+0000", 2024-09-10T06:26:58.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7782999999999998e-05 2024-09-10T06:26:58.544 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.544 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.544 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.544 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:78 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'56, mlcod=16'53)", 2024-09-10T06:26:58.544 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:26:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.935324342999998, 2024-09-10T06:26:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035960359999999999, 2024-09-10T06:26:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:26:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:26:58.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544386+0000", 2024-09-10T06:26:58.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1399999999999995e-07 2024-09-10T06:26:58.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544510+0000", 2024-09-10T06:26:58.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124265 2024-09-10T06:26:58.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544528+0000", 2024-09-10T06:26:58.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7706999999999998e-05 2024-09-10T06:26:58.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544538+0000", 2024-09-10T06:26:58.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7799999999999995e-06 2024-09-10T06:26:58.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545067+0000", 2024-09-10T06:26:58.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052855600000000001 2024-09-10T06:26:58.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545125+0000", 2024-09-10T06:26:58.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8313000000000002e-05 2024-09-10T06:26:58.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547942+0000", 2024-09-10T06:26:58.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028174749999999998 2024-09-10T06:26:58.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547981+0000", 2024-09-10T06:26:58.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9026000000000002e-05 2024-09-10T06:26:58.549 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.549 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.549 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.549 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:79 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'57, mlcod=16'53)", 2024-09-10T06:26:58.549 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:26:58.549 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.934785623000003, 2024-09-10T06:26:58.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044068620000000001, 2024-09-10T06:26:58.549 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.549 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.549 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.549 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:26:58.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:26:58.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544925+0000", 2024-09-10T06:26:58.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8000000000000004e-07 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545047+0000", 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121779 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545077+0000", 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0463e-05 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545087+0000", 2024-09-10T06:26:58.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0067e-05 2024-09-10T06:26:58.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.546104+0000", 2024-09-10T06:26:58.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001017088 2024-09-10T06:26:58.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.546157+0000", 2024-09-10T06:26:58.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2886000000000002e-05 2024-09-10T06:26:58.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549219+0000", 2024-09-10T06:26:58.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030620539999999998 2024-09-10T06:26:58.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549331+0000", 2024-09-10T06:26:58.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011164500000000001 2024-09-10T06:26:58.553 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.553 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.553 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.553 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:80 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'58, mlcod=16'53)", 2024-09-10T06:26:58.553 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:26:58.554 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.934187835000003, 2024-09-10T06:26:58.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042652369999999998, 2024-09-10T06:26:58.554 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.554 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.554 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.554 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:26:58.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:26:58.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545523+0000", 2024-09-10T06:26:58.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2399999999999997e-07 2024-09-10T06:26:58.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545646+0000", 2024-09-10T06:26:58.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123662 2024-09-10T06:26:58.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545664+0000", 2024-09-10T06:26:58.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8e-05 2024-09-10T06:26:58.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545673+0000", 2024-09-10T06:26:58.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9930000000000001e-06 2024-09-10T06:26:58.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547057+0000", 2024-09-10T06:26:58.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013834629999999999 2024-09-10T06:26:58.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547129+0000", 2024-09-10T06:26:58.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1759000000000002e-05 2024-09-10T06:26:58.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549724+0000", 2024-09-10T06:26:58.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002595834 2024-09-10T06:26:58.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549787+0000", 2024-09-10T06:26:58.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2701999999999997e-05 2024-09-10T06:26:58.558 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.558 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.558 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.558 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:26:58.558 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:26:58.558 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.178044513, 2024-09-10T06:26:58.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040313359999999999, 2024-09-10T06:26:58.558 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.558 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.558 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.559 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:58.559 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:58.559 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:58.559 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 206 2024-09-10T06:26:58.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.559 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:26:58.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:26:58.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301670+0000", 2024-09-10T06:26:58.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5669999999999996e-06 2024-09-10T06:26:58.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301690+0000", 2024-09-10T06:26:58.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0636999999999999e-05 2024-09-10T06:26:58.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301735+0000", 2024-09-10T06:26:58.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4298999999999997e-05 2024-09-10T06:26:58.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301759+0000", 2024-09-10T06:26:58.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4769999999999998e-05 2024-09-10T06:26:58.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301938+0000", 2024-09-10T06:26:58.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017901899999999999 2024-09-10T06:26:58.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.302305+0000", 2024-09-10T06:26:58.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036679699999999998 2024-09-10T06:26:58.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-10T06:26:58.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.303069+0000", 2024-09-10T06:26:58.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076360999999999996 2024-09-10T06:26:58.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:58.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.304549+0000", 2024-09-10T06:26:58.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014798229999999999 2024-09-10T06:26:58.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:58.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305530+0000", 2024-09-10T06:26:58.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098141200000000008 2024-09-10T06:26:58.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305610+0000", 2024-09-10T06:26:58.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9785999999999998e-05 2024-09-10T06:26:58.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305696+0000", 2024-09-10T06:26:58.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6615999999999999e-05 2024-09-10T06:26:58.564 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.564 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.564 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.564 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:58.564 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:26:58.564 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.155439901000001, 2024-09-10T06:26:58.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0081512240000000003, 2024-09-10T06:26:58.564 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.565 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.565 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:58.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:58.565 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:58.565 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 210 2024-09-10T06:26:58.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.565 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:26:58.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324273+0000", 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1240000000000001e-06 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324285+0000", 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2463000000000001e-05 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324319+0000", 2024-09-10T06:26:58.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3309999999999998e-05 2024-09-10T06:26:58.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324342+0000", 2024-09-10T06:26:58.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3672999999999998e-05 2024-09-10T06:26:58.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324476+0000", 2024-09-10T06:26:58.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013378199999999999 2024-09-10T06:26:58.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:26:58.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324489+0000", 2024-09-10T06:26:58.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3127e-05 2024-09-10T06:26:58.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.328893+0000", 2024-09-10T06:26:58.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044040190000000003 2024-09-10T06:26:58.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.329211+0000", 2024-09-10T06:26:58.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031762799999999998 2024-09-10T06:26:58.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:26:58.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.329880+0000", 2024-09-10T06:26:58.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066933800000000001 2024-09-10T06:26:58.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:58.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.331727+0000", 2024-09-10T06:26:58.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018466120000000001 2024-09-10T06:26:58.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:58.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332287+0000", 2024-09-10T06:26:58.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056016599999999996 2024-09-10T06:26:58.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332363+0000", 2024-09-10T06:26:58.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5748999999999996e-05 2024-09-10T06:26:58.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332421+0000", 2024-09-10T06:26:58.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8233000000000003e-05 2024-09-10T06:26:58.572 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.572 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.572 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.572 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:469 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:58.573 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:26:58.573 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.980588983000001, 2024-09-10T06:26:58.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0056131189999999997, 2024-09-10T06:26:58.573 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.573 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.573 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:58.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:58.573 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:58.573 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 469 2024-09-10T06:26:58.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.573 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:26:58.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:26:58.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:26:58.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8400000000000003e-07 2024-09-10T06:26:58.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499125+0000", 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.692e-06 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499135+0000", 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5310000000000007e-06 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499140+0000", 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9640000000000002e-06 2024-09-10T06:26:58.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499200+0000", 2024-09-10T06:26:58.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0874e-05 2024-09-10T06:26:58.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499303+0000", 2024-09-10T06:26:58.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102395 2024-09-10T06:26:58.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:26:58.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499518+0000", 2024-09-10T06:26:58.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021481500000000001 2024-09-10T06:26:58.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:58.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.500112+0000", 2024-09-10T06:26:58.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059408699999999998 2024-09-10T06:26:58.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:58.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504614+0000", 2024-09-10T06:26:58.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045017859999999998 2024-09-10T06:26:58.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504688+0000", 2024-09-10T06:26:58.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4528000000000002e-05 2024-09-10T06:26:58.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504734+0000", 2024-09-10T06:26:58.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5663e-05 2024-09-10T06:26:58.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.579 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.579 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.579 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:621 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:58.579 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:26:58.579 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.875358922, 2024-09-10T06:26:58.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039399250000000004, 2024-09-10T06:26:58.579 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:58.579 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:58.580 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:58.580 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:58.580 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:58.580 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:58.580 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 621 2024-09-10T06:26:58.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.580 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:58.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:58.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:26:58.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:58.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:26:58.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:58.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:58.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604353+0000", 2024-09-10T06:26:58.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.537e-06 2024-09-10T06:26:58.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:58.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604364+0000", 2024-09-10T06:26:58.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0923e-05 2024-09-10T06:26:58.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:58.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604394+0000", 2024-09-10T06:26:58.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0176999999999999e-05 2024-09-10T06:26:58.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:58.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604409+0000", 2024-09-10T06:26:58.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4666e-05 2024-09-10T06:26:58.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:58.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604505+0000", 2024-09-10T06:26:58.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5914000000000004e-05 2024-09-10T06:26:58.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:58.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604588+0000", 2024-09-10T06:26:58.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3127999999999994e-05 2024-09-10T06:26:58.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:26:58.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604709+0000", 2024-09-10T06:26:58.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121344 2024-09-10T06:26:58.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:58.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.605312+0000", 2024-09-10T06:26:58.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00060259599999999995 2024-09-10T06:26:58.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:58.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608229+0000", 2024-09-10T06:26:58.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029169600000000001 2024-09-10T06:26:58.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:58.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608264+0000", 2024-09-10T06:26:58.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4756999999999999e-05 2024-09-10T06:26:58.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:58.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:58.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:58.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608291+0000", 2024-09-10T06:26:58.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6923e-05 2024-09-10T06:26:58.585 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.585 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.585 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.585 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:58.585 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:58.585 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:26:58.586 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T06:26:58.587 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:26:58.588 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:58.583+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:26:58.687 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:26:58.687+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:26:58.751 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:26:58.752 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:26:58.752 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:26:58.752 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:26:58.767 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:26:58.816 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:58.815+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:26:58.881 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:26:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:26:58.881 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:26:58.882 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:26:58.882 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:26:58.889 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:26:58.887+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:26:58.895 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:26:58.964 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:26:59.028 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:59.027+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:26:59.060 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:26:59.060 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:26:59.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:26:59.061 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:26:59.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.061 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:26:59.061 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:26:59.061 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.782745402, 2024-09-10T06:26:59.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069538480000000003, 2024-09-10T06:26:59.061 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.061 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.061 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-10T06:26:59.061 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.061 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:26:59.062 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:26:59.062 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2 2024-09-10T06:26:59.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.062 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:26:59.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:26:59.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275742+0000", 2024-09-10T06:26:59.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7460000000000001e-06 2024-09-10T06:26:59.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275751+0000", 2024-09-10T06:26:59.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3979999999999999e-06 2024-09-10T06:26:59.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275769+0000", 2024-09-10T06:26:59.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8637000000000001e-05 2024-09-10T06:26:59.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275784+0000", 2024-09-10T06:26:59.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4518000000000001e-05 2024-09-10T06:26:59.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275905+0000", 2024-09-10T06:26:59.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012092899999999999 2024-09-10T06:26:59.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-10T06:26:59.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275920+0000", 2024-09-10T06:26:59.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5325999999999999e-05 2024-09-10T06:26:59.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282541+0000", 2024-09-10T06:26:59.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066208400000000002 2024-09-10T06:26:59.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282693+0000", 2024-09-10T06:26:59.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152454 2024-09-10T06:26:59.065 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.066 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.066 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.066 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:26:59.066 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:26:59.066 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 20.645916841000002, 2024-09-10T06:26:59.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029204980000000001, 2024-09-10T06:26:59.066 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.066 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.066 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.066 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.066 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 193 2024-09-10T06:26:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:26:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:26:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412570+0000", 2024-09-10T06:26:59.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4530000000000001e-06 2024-09-10T06:26:59.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412582+0000", 2024-09-10T06:26:59.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1524e-05 2024-09-10T06:26:59.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412612+0000", 2024-09-10T06:26:59.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0436000000000001e-05 2024-09-10T06:26:59.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412627+0000", 2024-09-10T06:26:59.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4306e-05 2024-09-10T06:26:59.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412723+0000", 2024-09-10T06:26:59.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6075000000000004e-05 2024-09-10T06:26:59.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412831+0000", 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108453 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412972+0000", 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141225 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.414147+0000", 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174989 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415334+0000", 2024-09-10T06:26:59.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:26:59.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415420+0000", 2024-09-10T06:26:59.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6009999999999998e-05 2024-09-10T06:26:59.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415489+0000", 2024-09-10T06:26:59.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8403000000000002e-05 2024-09-10T06:26:59.072 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.072 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.072 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.072 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.072 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:26:59.072 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.748433199000001, 2024-09-10T06:26:59.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092944310000000006, 2024-09-10T06:26:59.072 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.072 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.072 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.073 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.073 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 208 2024-09-10T06:26:59.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.073 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:26:59.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:26:59.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310055+0000", 2024-09-10T06:26:59.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-10T06:26:59.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310066+0000", 2024-09-10T06:26:59.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1739999999999999e-05 2024-09-10T06:26:59.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310096+0000", 2024-09-10T06:26:59.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0159e-05 2024-09-10T06:26:59.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310111+0000", 2024-09-10T06:26:59.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5007e-05 2024-09-10T06:26:59.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310235+0000", 2024-09-10T06:26:59.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123132 2024-09-10T06:26:59.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:26:59.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310246+0000", 2024-09-10T06:26:59.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1487e-05 2024-09-10T06:26:59.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315594+0000", 2024-09-10T06:26:59.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005347592 2024-09-10T06:26:59.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315932+0000", 2024-09-10T06:26:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033789099999999999 2024-09-10T06:26:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.316549+0000", 2024-09-10T06:26:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061698099999999995 2024-09-10T06:26:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.317898+0000", 2024-09-10T06:26:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013498799999999999 2024-09-10T06:26:59.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319207+0000", 2024-09-10T06:26:59.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013086969999999999 2024-09-10T06:26:59.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319289+0000", 2024-09-10T06:26:59.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2259e-05 2024-09-10T06:26:59.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319346+0000", 2024-09-10T06:26:59.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6675999999999997e-05 2024-09-10T06:26:59.081 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.081 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.081 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.081 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.081 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:26:59.081 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.722096476000001, 2024-09-10T06:26:59.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003262778, 2024-09-10T06:26:59.081 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.081 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.081 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.081 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.081 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 212 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336391+0000", 2024-09-10T06:26:59.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5770000000000001e-06 2024-09-10T06:26:59.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336403+0000", 2024-09-10T06:26:59.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2286000000000001e-05 2024-09-10T06:26:59.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336425+0000", 2024-09-10T06:26:59.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2164e-05 2024-09-10T06:26:59.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336440+0000", 2024-09-10T06:26:59.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4222999999999999e-05 2024-09-10T06:26:59.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336621+0000", 2024-09-10T06:26:59.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018136500000000001 2024-09-10T06:26:59.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336830+0000", 2024-09-10T06:26:59.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209125 2024-09-10T06:26:59.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.337206+0000", 2024-09-10T06:26:59.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037553700000000001 2024-09-10T06:26:59.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.338527+0000", 2024-09-10T06:26:59.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00132142 2024-09-10T06:26:59.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339502+0000", 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00097512599999999999 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339585+0000", 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2466000000000006e-05 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339651+0000", 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6489000000000007e-05 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.087 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.087 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:26:59.087 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.697782936999999, 2024-09-10T06:26:59.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032440849999999999, 2024-09-10T06:26:59.087 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.087 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.087 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.087 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.087 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 219 2024-09-10T06:26:59.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.087 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:26:59.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:26:59.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360705+0000", 2024-09-10T06:26:59.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.593e-06 2024-09-10T06:26:59.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360716+0000", 2024-09-10T06:26:59.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1717e-05 2024-09-10T06:26:59.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360746+0000", 2024-09-10T06:26:59.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0233e-05 2024-09-10T06:26:59.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360761+0000", 2024-09-10T06:26:59.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4593000000000001e-05 2024-09-10T06:26:59.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360873+0000", 2024-09-10T06:26:59.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111809 2024-09-10T06:26:59.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361105+0000", 2024-09-10T06:26:59.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023171800000000001 2024-09-10T06:26:59.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361523+0000", 2024-09-10T06:26:59.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000418694 2024-09-10T06:26:59.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.362840+0000", 2024-09-10T06:26:59.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013165570000000001 2024-09-10T06:26:59.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363793+0000", 2024-09-10T06:26:59.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095323200000000004 2024-09-10T06:26:59.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363880+0000", 2024-09-10T06:26:59.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6689999999999998e-05 2024-09-10T06:26:59.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363946+0000", 2024-09-10T06:26:59.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6248999999999995e-05 2024-09-10T06:26:59.092 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.092 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.092 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.093 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.093 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:26:59.093 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.680516084000001, 2024-09-10T06:26:59.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003271422, 2024-09-10T06:26:59.093 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.093 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.093 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.093 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.093 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.093 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.093 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 224 2024-09-10T06:26:59.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.093 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:26:59.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:26:59.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377971+0000", 2024-09-10T06:26:59.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:26:59.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377983+0000", 2024-09-10T06:26:59.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1517e-05 2024-09-10T06:26:59.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378013+0000", 2024-09-10T06:26:59.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0476000000000001e-05 2024-09-10T06:26:59.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378028+0000", 2024-09-10T06:26:59.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5173e-05 2024-09-10T06:26:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378134+0000", 2024-09-10T06:26:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010533 2024-09-10T06:26:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378346+0000", 2024-09-10T06:26:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021175499999999999 2024-09-10T06:26:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378787+0000", 2024-09-10T06:26:59.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044190899999999999 2024-09-10T06:26:59.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.380237+0000", 2024-09-10T06:26:59.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001449093 2024-09-10T06:26:59.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381097+0000", 2024-09-10T06:26:59.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086022300000000002 2024-09-10T06:26:59.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381181+0000", 2024-09-10T06:26:59.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3973000000000004e-05 2024-09-10T06:26:59.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381240+0000", 2024-09-10T06:26:59.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9472999999999998e-05 2024-09-10T06:26:59.098 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.098 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.098 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.098 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.099 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:26:59.099 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.648848631, 2024-09-10T06:26:59.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031998719999999999, 2024-09-10T06:26:59.099 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.099 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.099 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.099 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.099 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.099 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.100 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 233 2024-09-10T06:26:59.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.100 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:26:59.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:26:59.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409639+0000", 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4770000000000002e-06 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409652+0000", 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3692999999999999e-05 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409683+0000", 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1080000000000001e-05 2024-09-10T06:26:59.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409699+0000", 2024-09-10T06:26:59.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5245999999999999e-05 2024-09-10T06:26:59.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409881+0000", 2024-09-10T06:26:59.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000182709 2024-09-10T06:26:59.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410088+0000", 2024-09-10T06:26:59.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020630799999999999 2024-09-10T06:26:59.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410495+0000", 2024-09-10T06:26:59.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00040682700000000001 2024-09-10T06:26:59.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.411805+0000", 2024-09-10T06:26:59.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013101059999999999 2024-09-10T06:26:59.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412672+0000", 2024-09-10T06:26:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086778699999999996 2024-09-10T06:26:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412769+0000", 2024-09-10T06:26:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6565999999999997e-05 2024-09-10T06:26:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412836+0000", 2024-09-10T06:26:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7073e-05 2024-09-10T06:26:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.104 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:353 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:26:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.607941317000002, 2024-09-10T06:26:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059710450000000003, 2024-09-10T06:26:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 353 2024-09-10T06:26:59.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:26:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:26:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450545+0000", 2024-09-10T06:26:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.423e-06 2024-09-10T06:26:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450551+0000", 2024-09-10T06:26:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7370000000000003e-06 2024-09-10T06:26:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450565+0000", 2024-09-10T06:26:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4649e-05 2024-09-10T06:26:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450574+0000", 2024-09-10T06:26:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5129999999999996e-06 2024-09-10T06:26:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450644+0000", 2024-09-10T06:26:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0387000000000002e-05 2024-09-10T06:26:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450818+0000", 2024-09-10T06:26:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017368400000000001 2024-09-10T06:26:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451030+0000", 2024-09-10T06:26:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021189599999999999 2024-09-10T06:26:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451607+0000", 2024-09-10T06:26:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057672599999999995 2024-09-10T06:26:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456437+0000", 2024-09-10T06:26:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048301940000000003 2024-09-10T06:26:59.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456472+0000", 2024-09-10T06:26:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5178000000000001e-05 2024-09-10T06:26:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456515+0000", 2024-09-10T06:26:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2657999999999997e-05 2024-09-10T06:26:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:362 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:26:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.601493795, 2024-09-10T06:26:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044032239999999999, 2024-09-10T06:26:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 362 2024-09-10T06:26:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:26:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:26:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456992+0000", 2024-09-10T06:26:59.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6700000000000002e-07 2024-09-10T06:26:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456997+0000", 2024-09-10T06:26:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6249999999999998e-06 2024-09-10T06:26:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457005+0000", 2024-09-10T06:26:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6719999999999993e-06 2024-09-10T06:26:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457010+0000", 2024-09-10T06:26:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7360000000000001e-06 2024-09-10T06:26:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457054+0000", 2024-09-10T06:26:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4138999999999999e-05 2024-09-10T06:26:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457163+0000", 2024-09-10T06:26:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108558 2024-09-10T06:26:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457340+0000", 2024-09-10T06:26:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017730600000000001 2024-09-10T06:26:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.458065+0000", 2024-09-10T06:26:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00072480400000000001 2024-09-10T06:26:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461294+0000", 2024-09-10T06:26:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032287890000000001 2024-09-10T06:26:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461352+0000", 2024-09-10T06:26:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8502000000000003e-05 2024-09-10T06:26:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461394+0000", 2024-09-10T06:26:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2225999999999999e-05 2024-09-10T06:26:59.116 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:475 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:26:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.555644229999999, 2024-09-10T06:26:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046091930000000001, 2024-09-10T06:26:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.117 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 475 2024-09-10T06:26:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:26:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:26:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:26:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6100000000000001e-07 2024-09-10T06:26:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502844+0000", 2024-09-10T06:26:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0529999999999998e-06 2024-09-10T06:26:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502852+0000", 2024-09-10T06:26:59.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2579999999999995e-06 2024-09-10T06:26:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502857+0000", 2024-09-10T06:26:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3460000000000004e-06 2024-09-10T06:26:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502894+0000", 2024-09-10T06:26:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6884000000000001e-05 2024-09-10T06:26:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502942+0000", 2024-09-10T06:26:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7791999999999999e-05 2024-09-10T06:26:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.503048+0000", 2024-09-10T06:26:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010678799999999999 2024-09-10T06:26:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.506079+0000", 2024-09-10T06:26:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030311510000000002 2024-09-10T06:26:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507361+0000", 2024-09-10T06:26:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001281208 2024-09-10T06:26:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507400+0000", 2024-09-10T06:26:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9483000000000001e-05 2024-09-10T06:26:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507450+0000", 2024-09-10T06:26:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9669000000000002e-05 2024-09-10T06:26:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.122 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:477 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:26:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.553683112999998, 2024-09-10T06:26:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038544, 2024-09-10T06:26:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.123 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 477 2024-09-10T06:26:59.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.124 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:26:59.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:26:59.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504803+0000", 2024-09-10T06:26:59.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9999999999999996e-07 2024-09-10T06:26:59.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504808+0000", 2024-09-10T06:26:59.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1909999999999999e-06 2024-09-10T06:26:59.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504818+0000", 2024-09-10T06:26:59.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0081999999999999e-05 2024-09-10T06:26:59.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504823+0000", 2024-09-10T06:26:59.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9969999999999998e-06 2024-09-10T06:26:59.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504870+0000", 2024-09-10T06:26:59.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6980000000000001e-05 2024-09-10T06:26:59.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504922+0000", 2024-09-10T06:26:59.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869000000000001e-05 2024-09-10T06:26:59.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505020+0000", 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8010999999999994e-05 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507789+0000", 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027690219999999999 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508599+0000", 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081037800000000005 2024-09-10T06:26:59.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508631+0000", 2024-09-10T06:26:59.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.137e-05 2024-09-10T06:26:59.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508656+0000", 2024-09-10T06:26:59.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5599999999999999e-05 2024-09-10T06:26:59.128 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.128 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.128 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.129 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:478 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.129 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:26:59.129 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.553636211000001, 2024-09-10T06:26:59.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039361880000000002, 2024-09-10T06:26:59.129 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.129 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.129 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.129 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.129 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 478 2024-09-10T06:26:59.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.129 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:26:59.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:26:59.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7800000000000001e-07 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504853+0000", 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2780000000000002e-06 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504858+0000", 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7359999999999998e-06 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504862+0000", 2024-09-10T06:26:59.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6650000000000001e-06 2024-09-10T06:26:59.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504938+0000", 2024-09-10T06:26:59.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6286999999999997e-05 2024-09-10T06:26:59.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505091+0000", 2024-09-10T06:26:59.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152385 2024-09-10T06:26:59.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:26:59.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505335+0000", 2024-09-10T06:26:59.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244281 2024-09-10T06:26:59.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507764+0000", 2024-09-10T06:26:59.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002429624 2024-09-10T06:26:59.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508681+0000", 2024-09-10T06:26:59.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00091630100000000001 2024-09-10T06:26:59.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508747+0000", 2024-09-10T06:26:59.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5733000000000002e-05 2024-09-10T06:26:59.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508785+0000", 2024-09-10T06:26:59.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8319999999999999e-05 2024-09-10T06:26:59.134 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.134 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.134 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.135 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.135 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:26:59.135 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.307504291000001, 2024-09-10T06:26:59.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030732350000000001, 2024-09-10T06:26:59.135 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.135 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.135 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.135 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 733 2024-09-10T06:26:59.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.135 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:26:59.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:26:59.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750983+0000", 2024-09-10T06:26:59.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8880000000000001e-06 2024-09-10T06:26:59.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750996+0000", 2024-09-10T06:26:59.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2048999999999999e-05 2024-09-10T06:26:59.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751024+0000", 2024-09-10T06:26:59.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8802e-05 2024-09-10T06:26:59.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751043+0000", 2024-09-10T06:26:59.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8266000000000001e-05 2024-09-10T06:26:59.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751191+0000", 2024-09-10T06:26:59.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014818200000000001 2024-09-10T06:26:59.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751417+0000", 2024-09-10T06:26:59.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022648199999999999 2024-09-10T06:26:59.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751747+0000", 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032945000000000001 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.752752+0000", 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010054790000000001 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753896+0000", 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001143638 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753989+0000", 2024-09-10T06:26:59.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3466000000000003e-05 2024-09-10T06:26:59.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.754054+0000", 2024-09-10T06:26:59.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4533e-05 2024-09-10T06:26:59.140 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.140 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.140 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.140 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.141 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:26:59.141 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.267023744999999, 2024-09-10T06:26:59.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002896722, 2024-09-10T06:26:59.141 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.141 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.141 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.141 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 751 2024-09-10T06:26:59.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.141 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791464+0000", 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7140000000000002e-06 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791475+0000", 2024-09-10T06:26:59.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1535999999999999e-05 2024-09-10T06:26:59.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791501+0000", 2024-09-10T06:26:59.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5276e-05 2024-09-10T06:26:59.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791514+0000", 2024-09-10T06:26:59.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3203e-05 2024-09-10T06:26:59.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791643+0000", 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012961900000000001 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791857+0000", 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021351599999999999 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.792178+0000", 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032090999999999999 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.793281+0000", 2024-09-10T06:26:59.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001103319 2024-09-10T06:26:59.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794209+0000", 2024-09-10T06:26:59.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000927676 2024-09-10T06:26:59.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794295+0000", 2024-09-10T06:26:59.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5682999999999999e-05 2024-09-10T06:26:59.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794358+0000", 2024-09-10T06:26:59.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3269999999999996e-05 2024-09-10T06:26:59.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.146 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.146 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.146 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:26:59.146 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.263136247999999, 2024-09-10T06:26:59.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030558059999999999, 2024-09-10T06:26:59.146 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 753 2024-09-10T06:26:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:26:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:26:59.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795352+0000", 2024-09-10T06:26:59.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0130000000000002e-06 2024-09-10T06:26:59.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795364+0000", 2024-09-10T06:26:59.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1939999999999999e-05 2024-09-10T06:26:59.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795395+0000", 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0976999999999998e-05 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795413+0000", 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7980000000000001e-05 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795533+0000", 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120732 2024-09-10T06:26:59.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795665+0000", 2024-09-10T06:26:59.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013215899999999999 2024-09-10T06:26:59.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795931+0000", 2024-09-10T06:26:59.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026536499999999999 2024-09-10T06:26:59.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.796995+0000", 2024-09-10T06:26:59.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001064611 2024-09-10T06:26:59.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798256+0000", 2024-09-10T06:26:59.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00126022 2024-09-10T06:26:59.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798340+0000", 2024-09-10T06:26:59.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4753000000000007e-05 2024-09-10T06:26:59.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798404+0000", 2024-09-10T06:26:59.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4055999999999998e-05 2024-09-10T06:26:59.152 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.152 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.152 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.152 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.152 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:26:59.152 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.147928007000001, 2024-09-10T06:26:59.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031632380000000001, 2024-09-10T06:26:59.152 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.152 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.152 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 805 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910560+0000", 2024-09-10T06:26:59.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2200000000000001e-06 2024-09-10T06:26:59.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910574+0000", 2024-09-10T06:26:59.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3536000000000001e-05 2024-09-10T06:26:59.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910604+0000", 2024-09-10T06:26:59.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0645999999999998e-05 2024-09-10T06:26:59.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910619+0000", 2024-09-10T06:26:59.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5064e-05 2024-09-10T06:26:59.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910759+0000", 2024-09-10T06:26:59.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013943899999999999 2024-09-10T06:26:59.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910984+0000", 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000225381 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.911312+0000", 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032782800000000001 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.912402+0000", 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010895639999999999 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913576+0000", 2024-09-10T06:26:59.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174591 2024-09-10T06:26:59.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913657+0000", 2024-09-10T06:26:59.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1223000000000005e-05 2024-09-10T06:26:59.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913720+0000", 2024-09-10T06:26:59.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2745999999999999e-05 2024-09-10T06:26:59.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.157 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 17.088150272, 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030680099999999999, 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 832 2024-09-10T06:26:59.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.159 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:26:59.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:26:59.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970337+0000", 2024-09-10T06:26:59.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6230000000000001e-06 2024-09-10T06:26:59.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970349+0000", 2024-09-10T06:26:59.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1557e-05 2024-09-10T06:26:59.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970379+0000", 2024-09-10T06:26:59.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0456000000000001e-05 2024-09-10T06:26:59.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970394+0000", 2024-09-10T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4683e-05 2024-09-10T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970509+0000", 2024-09-10T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114613 2024-09-10T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970753+0000", 2024-09-10T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244295 2024-09-10T06:26:59.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:26:59.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.971078+0000", 2024-09-10T06:26:59.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000325583 2024-09-10T06:26:59.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.972162+0000", 2024-09-10T06:26:59.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010834519999999999 2024-09-10T06:26:59.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973200+0000", 2024-09-10T06:26:59.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010376560000000001 2024-09-10T06:26:59.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973287+0000", 2024-09-10T06:26:59.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7163000000000006e-05 2024-09-10T06:26:59.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973403+0000", 2024-09-10T06:26:59.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011592899999999999 2024-09-10T06:26:59.163 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.163 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.163 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.164 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.164 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:26:59.164 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.933079044999999, 2024-09-10T06:26:59.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030018599999999999, 2024-09-10T06:26:59.164 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.164 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.164 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.164 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 901 2024-09-10T06:26:59.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.164 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:26:59.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:26:59.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125409+0000", 2024-09-10T06:26:59.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.253e-06 2024-09-10T06:26:59.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125425+0000", 2024-09-10T06:26:59.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5636000000000001e-05 2024-09-10T06:26:59.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125456+0000", 2024-09-10T06:26:59.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1130000000000002e-05 2024-09-10T06:26:59.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125470+0000", 2024-09-10T06:26:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.464e-05 2024-09-10T06:26:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125581+0000", 2024-09-10T06:26:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110612 2024-09-10T06:26:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125814+0000", 2024-09-10T06:26:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023266899999999999 2024-09-10T06:26:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.126159+0000", 2024-09-10T06:26:59.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034565399999999998 2024-09-10T06:26:59.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.127161+0000", 2024-09-10T06:26:59.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010020890000000001 2024-09-10T06:26:59.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128202+0000", 2024-09-10T06:26:59.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001040242 2024-09-10T06:26:59.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128288+0000", 2024-09-10T06:26:59.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6156000000000007e-05 2024-09-10T06:26:59.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128408+0000", 2024-09-10T06:26:59.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011977900000000001 2024-09-10T06:26:59.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.169 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.170 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.170 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:26:59.170 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.898986676, 2024-09-10T06:26:59.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029016649999999999, 2024-09-10T06:26:59.170 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.170 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.170 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.170 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 916 2024-09-10T06:26:59.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.170 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:26:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:26:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159501+0000", 2024-09-10T06:26:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:26:59.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159512+0000", 2024-09-10T06:26:59.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1564e-05 2024-09-10T06:26:59.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159543+0000", 2024-09-10T06:26:59.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0942999999999998e-05 2024-09-10T06:26:59.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159558+0000", 2024-09-10T06:26:59.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.436e-05 2024-09-10T06:26:59.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159701+0000", 2024-09-10T06:26:59.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014363599999999999 2024-09-10T06:26:59.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159927+0000", 2024-09-10T06:26:59.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022535099999999999 2024-09-10T06:26:59.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.160260+0000", 2024-09-10T06:26:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033321700000000002 2024-09-10T06:26:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.161312+0000", 2024-09-10T06:26:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001052222 2024-09-10T06:26:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162261+0000", 2024-09-10T06:26:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00094912600000000001 2024-09-10T06:26:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162337+0000", 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6268999999999998e-05 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162400+0000", 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2477000000000005e-05 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:26:59.175 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 16.828677164999998, 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030045179999999999, 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 946 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:26:59.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:26:59.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:26:59.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:26:59.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229810+0000", 2024-09-10T06:26:59.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:26:59.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:26:59.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229838+0000", 2024-09-10T06:26:59.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7776e-05 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229869+0000", 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0766999999999999e-05 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229883+0000", 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4423000000000001e-05 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230005+0000", 2024-09-10T06:26:59.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121919 2024-09-10T06:26:59.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:26:59.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230219+0000", 2024-09-10T06:26:59.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000214098 2024-09-10T06:26:59.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:26:59.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230588+0000", 2024-09-10T06:26:59.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036857099999999999 2024-09-10T06:26:59.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:26:59.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.231707+0000", 2024-09-10T06:26:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011193349999999999 2024-09-10T06:26:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:26:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232662+0000", 2024-09-10T06:26:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095513300000000005 2024-09-10T06:26:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:26:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232748+0000", 2024-09-10T06:26:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6151999999999998e-05 2024-09-10T06:26:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:26:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:26:59.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:26:59.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232812+0000", 2024-09-10T06:26:59.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3876999999999998e-05 2024-09-10T06:26:59.181 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.181 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.181 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.181 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:26:59.181 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:26:59.181 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:26:59.183 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:26:59.183 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:26:59.183 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:26:59.184 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:26:59.184 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:26:59.184 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:26:59.184 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:26:59.185 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:26:59.185 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:26:59.185 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:26:59.186 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:26:59.186 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:59.179+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:59.198 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:26:59.198 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:26:59.219 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:26:59.219 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:26:59.240 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:26:59.240 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:26:59.304 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:26:59.303+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:26:59.313 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:59.313 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:59.326 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:26:59.416 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:26:59.415+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:26:59.486 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:26:59.483+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:26:59.489 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:59.489 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:59.504 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:26:59.553 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-10T06:26:59.586 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:26:59.587+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:26:59.666 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:59.666 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:59.682 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:26:59.728 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:26:59.727+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:26:59.788 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:26:59.787+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:26:59.800 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:59.800 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:59.813 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:26:59.889 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:26:59.891+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:26:59.974 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:26:59.974 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:26:59.990 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:26:59.990 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:26:59.987+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:00.091 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:00.087+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:00.153 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:00.153 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:00.167 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:27:00.215 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:00.215+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:00.292 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:00.292 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:00.293 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:00.291+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:00.306 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:27:00.394 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:00.391+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:00.475 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:00.475 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:00.489 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:27:00.495 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:00.491+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:00.596 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:00.595+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:00.605 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:00.605 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:00.619 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:27:00.697 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:00.695+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:00.782 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:00.782 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:00.796 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:27:00.798 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:00.795+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:00.899 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:00.895+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:00.913 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:00.914 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:00.927 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:27:01.000 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:00.999+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:01.043 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:01.044 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:01.057 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:27:01.101 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:01.099+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:01.202 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:01.199+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:01.222 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:01.222 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:01.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:27:01.258 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:27:01.302 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:01.299+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:01.355 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:01.356 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:01.369 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:27:01.403 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:01.399+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:01.412 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:01.412 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:01.429 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:01.429 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:01.445 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:01.446 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:01.461 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:01.462 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:01.480 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:01.480 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:01.500 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:01.501 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:01.504 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:01.503+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:01.521 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:01.521 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:01.541 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:01.541 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:01.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:01.541 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:01.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.541 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4349.0:36 5.1f 5:ff606e21:::zone_info.dfef714d-986b-43cb-b095-512e386c9309:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:01.541 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:34.314860+0000", 2024-09-10T06:27:01.541 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.225892376000001, 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003107603, 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4349", 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 36 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314860+0000", 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314860+0000", 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314861+0000", 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9069999999999999e-06 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314871+0000", 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2969999999999992e-06 2024-09-10T06:27:01.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314892+0000", 2024-09-10T06:27:01.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1443000000000001e-05 2024-09-10T06:27:01.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314904+0000", 2024-09-10T06:27:01.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2072999999999999e-05 2024-09-10T06:27:01.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.315021+0000", 2024-09-10T06:27:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117019 2024-09-10T06:27:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.315390+0000", 2024-09-10T06:27:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036879700000000003 2024-09-10T06:27:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.315847+0000", 2024-09-10T06:27:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045647599999999998 2024-09-10T06:27:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317460+0000", 2024-09-10T06:27:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001613172 2024-09-10T06:27:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317782+0000", 2024-09-10T06:27:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032208300000000003 2024-09-10T06:27:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317899+0000", 2024-09-10T06:27:01.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117549 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317967+0000", 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7787000000000007e-05 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.260734869, 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016848367, 2024-09-10T06:27:01.547 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.548 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.548 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.548 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:01.548 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:01.548 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:01.548 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 46 2024-09-10T06:27:01.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.548 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:27:01.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:27:01.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280021+0000", 2024-09-10T06:27:01.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0069999999999999e-06 2024-09-10T06:27:01.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280036+0000", 2024-09-10T06:27:01.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.483e-05 2024-09-10T06:27:01.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280070+0000", 2024-09-10T06:27:01.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4106000000000002e-05 2024-09-10T06:27:01.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280094+0000", 2024-09-10T06:27:01.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4037e-05 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280246+0000", 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000152199 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280271+0000", 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4581999999999999e-05 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.289388+0000", 2024-09-10T06:27:01.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091175639999999999 2024-09-10T06:27:01.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.290774+0000", 2024-09-10T06:27:01.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013859860000000001 2024-09-10T06:27:01.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:01.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291069+0000", 2024-09-10T06:27:01.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000294534 2024-09-10T06:27:01.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:01.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295828+0000", 2024-09-10T06:27:01.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047595729999999996 2024-09-10T06:27:01.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:01.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296614+0000", 2024-09-10T06:27:01.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00078534700000000004 2024-09-10T06:27:01.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296759+0000", 2024-09-10T06:27:01.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014571300000000001 2024-09-10T06:27:01.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296865+0000", 2024-09-10T06:27:01.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105889 2024-09-10T06:27:01.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.554 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.554 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94143734761600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:01.554 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.297713+0000", 2024-09-10T06:27:01.554 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.243038679000001, 2024-09-10T06:27:01.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007058847, 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297713+0000", 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297713+0000", 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297718+0000", 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3329999999999998e-06 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297733+0000", 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5477000000000001e-05 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297767+0000", 2024-09-10T06:27:01.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3859999999999998e-05 2024-09-10T06:27:01.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297793+0000", 2024-09-10T06:27:01.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6455999999999999e-05 2024-09-10T06:27:01.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297941+0000", 2024-09-10T06:27:01.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014803599999999999 2024-09-10T06:27:01.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298148+0000", 2024-09-10T06:27:01.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020703299999999999 2024-09-10T06:27:01.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:01.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298513+0000", 2024-09-10T06:27:01.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036422599999999999 2024-09-10T06:27:01.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:01.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304449+0000", 2024-09-10T06:27:01.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059367029999999998 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304478+0000", 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8836999999999999e-05 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304599+0000", 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012068100000000001 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304772+0000", 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017320500000000001 2024-09-10T06:27:01.559 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.560 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.560 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.560 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4358.0:47 7.1f e31/30 ondisk, result = 0)", 2024-09-10T06:27:01.560 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.300682+0000", 2024-09-10T06:27:01.560 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.240070201000002, 2024-09-10T06:27:01.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00409582, 2024-09-10T06:27:01.560 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.560 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.560 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-10T06:27:01.560 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300682+0000", 2024-09-10T06:27:01.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300682+0000", 2024-09-10T06:27:01.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300684+0000", 2024-09-10T06:27:01.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9829999999999999e-06 2024-09-10T06:27:01.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300695+0000", 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1347e-05 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300722+0000", 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-05 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300742+0000", 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9772999999999999e-05 2024-09-10T06:27:01.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304416+0000", 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036739339999999998 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304436+0000", 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9953999999999999e-05 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304777+0000", 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034188900000000001 2024-09-10T06:27:01.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.564 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.564 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.564 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94143734766208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:01.564 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.321434+0000", 2024-09-10T06:27:01.564 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.219317500999999, 2024-09-10T06:27:01.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002454211, 2024-09-10T06:27:01.564 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.564 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.564 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.564 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:01.564 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:01.564 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:01.565 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 55 2024-09-10T06:27:01.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.565 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321434+0000", 2024-09-10T06:27:01.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321434+0000", 2024-09-10T06:27:01.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321436+0000", 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0490000000000002e-06 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321446+0000", 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5279999999999992e-06 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321470+0000", 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4377000000000001e-05 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321485+0000", 2024-09-10T06:27:01.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4803e-05 2024-09-10T06:27:01.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321570+0000", 2024-09-10T06:27:01.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4926000000000006e-05 2024-09-10T06:27:01.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321665+0000", 2024-09-10T06:27:01.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4777000000000004e-05 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.321861+0000", 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000196658 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.322806+0000", 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094434399999999996 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.323736+0000", 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000930079 2024-09-10T06:27:01.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.323796+0000", 2024-09-10T06:27:01.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9845e-05 2024-09-10T06:27:01.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.323889+0000", 2024-09-10T06:27:01.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2825000000000007e-05 2024-09-10T06:27:01.569 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.569 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.569 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:209 6.3 e34/28 6:c60da066:gc::gc.4:head v 34'1, mlcod=0'0)", 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.320703+0000", 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.220048585000001, 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026023930000000002, 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320703+0000", 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320703+0000", 2024-09-10T06:27:01.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320704+0000", 2024-09-10T06:27:01.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7300000000000005e-07 2024-09-10T06:27:01.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320714+0000", 2024-09-10T06:27:01.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.041e-05 2024-09-10T06:27:01.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320762+0000", 2024-09-10T06:27:01.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7537000000000002e-05 2024-09-10T06:27:01.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320784+0000", 2024-09-10T06:27:01.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2243e-05 2024-09-10T06:27:01.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320934+0000", 2024-09-10T06:27:01.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014941499999999999 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.320982+0000", 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8162999999999999e-05 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.323191+0000", 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002209253 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.323306+0000", 2024-09-10T06:27:01.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011459900000000001 2024-09-10T06:27:01.574 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.574 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.574 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.574 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:354 6.3 e34/28 6:c3a682d4:reshard::reshard.0000000004:head v 34'4, mlcod=34'2)", 2024-09-10T06:27:01.574 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.453134+0000", 2024-09-10T06:27:01.574 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.087617396999999, 2024-09-10T06:27:01.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025721730000000001, 2024-09-10T06:27:01.574 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.574 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.574 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453134+0000", 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453134+0000", 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453137+0000", 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.243e-06 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453154+0000", 2024-09-10T06:27:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6906999999999999e-05 2024-09-10T06:27:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453193+0000", 2024-09-10T06:27:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9096e-05 2024-09-10T06:27:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453213+0000", 2024-09-10T06:27:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0233000000000001e-05 2024-09-10T06:27:01.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453362+0000", 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921199999999999 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.453426+0000", 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3410000000000004e-05 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.455601+0000", 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021758799999999998 2024-09-10T06:27:01.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.455707+0000", 2024-09-10T06:27:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010519200000000001 2024-09-10T06:27:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:363 6.3 e34/28 6:c3a682d4:reshard::reshard.0000000004:head v 34'5, mlcod=34'3)", 2024-09-10T06:27:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.458414+0000", 2024-09-10T06:27:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.082338200999999, 2024-09-10T06:27:01.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026506300000000002, 2024-09-10T06:27:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458414+0000", 2024-09-10T06:27:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458414+0000", 2024-09-10T06:27:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458416+0000", 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1969999999999999e-06 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458448+0000", 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2298999999999997e-05 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458482+0000", 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3510000000000003e-05 2024-09-10T06:27:01.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458500+0000", 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8216999999999999e-05 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458649+0000", 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000148839 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.458708+0000", 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9045999999999997e-05 2024-09-10T06:27:01.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.460969+0000", 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022612660000000001 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461064+0000", 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5255999999999997e-05 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.582 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:372 6.5 e34/28 6:a60f9269:lc::lua_package_allowlist:head v 34'2, mlcod=0'0)", 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.461552+0000", 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.079200355000001, 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025753500000000001, 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461552+0000", 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461552+0000", 2024-09-10T06:27:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461553+0000", 2024-09-10T06:27:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7600000000000001e-06 2024-09-10T06:27:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461566+0000", 2024-09-10T06:27:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2986000000000001e-05 2024-09-10T06:27:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461598+0000", 2024-09-10T06:27:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2163999999999999e-05 2024-09-10T06:27:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461626+0000", 2024-09-10T06:27:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7883000000000001e-05 2024-09-10T06:27:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461752+0000", 2024-09-10T06:27:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012603500000000001 2024-09-10T06:27:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461801+0000", 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8875999999999998e-05 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.464036+0000", 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022345730000000001 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.464127+0000", 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1073e-05 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.586 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:377 6.c e34/28 6:3677c228:::obj_delete_at_hint.0000000006:head v 34'1, mlcod=0'0)", 2024-09-10T06:27:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.462034+0000", 2024-09-10T06:27:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.078717556000001, 2024-09-10T06:27:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050687509999999998, 2024-09-10T06:27:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462034+0000", 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462034+0000", 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462036+0000", 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.827e-06 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462048+0000", 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1636e-05 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462068+0000", 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0463999999999999e-05 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462082+0000", 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4086e-05 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462200+0000", 2024-09-10T06:27:01.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117769 2024-09-10T06:27:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462250+0000", 2024-09-10T06:27:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9790000000000003e-05 2024-09-10T06:27:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.466985+0000", 2024-09-10T06:27:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047353370000000001 2024-09-10T06:27:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.467103+0000", 2024-09-10T06:27:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117842 2024-09-10T06:27:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:436 6.c e34/28 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 34'4, mlcod=34'2)", 2024-09-10T06:27:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.479435+0000", 2024-09-10T06:27:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.061316850000001, 2024-09-10T06:27:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028578980000000002, 2024-09-10T06:27:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.591 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479435+0000", 2024-09-10T06:27:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479435+0000", 2024-09-10T06:27:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479437+0000", 2024-09-10T06:27:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.903e-06 2024-09-10T06:27:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479448+0000", 2024-09-10T06:27:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0654e-05 2024-09-10T06:27:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479472+0000", 2024-09-10T06:27:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4258999999999999e-05 2024-09-10T06:27:01.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479485+0000", 2024-09-10T06:27:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2904e-05 2024-09-10T06:27:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479622+0000", 2024-09-10T06:27:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013714200000000001 2024-09-10T06:27:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.479674+0000", 2024-09-10T06:27:01.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2392999999999998e-05 2024-09-10T06:27:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.482187+0000", 2024-09-10T06:27:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025123039999999999 2024-09-10T06:27:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.482293+0000", 2024-09-10T06:27:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106339 2024-09-10T06:27:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:444 6.a e34/28 6:50d64734:::obj_delete_at_hint.0000000009:head v 34'2, mlcod=0'0)", 2024-09-10T06:27:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.484329+0000", 2024-09-10T06:27:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.056422731000001, 2024-09-10T06:27:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038926529999999998, 2024-09-10T06:27:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484329+0000", 2024-09-10T06:27:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484329+0000", 2024-09-10T06:27:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484331+0000", 2024-09-10T06:27:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.66e-06 2024-09-10T06:27:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484342+0000", 2024-09-10T06:27:01.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0986e-05 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484366+0000", 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4026999999999999e-05 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484384+0000", 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8147000000000001e-05 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484525+0000", 2024-09-10T06:27:01.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014151499999999999 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484595+0000", 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9085999999999996e-05 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488044+0000", 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034494040000000001 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488222+0000", 2024-09-10T06:27:01.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017782799999999999 2024-09-10T06:27:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:453 6.a e34/28 6:50d64734:::obj_delete_at_hint.0000000009:head v 34'4, mlcod=34'1)", 2024-09-10T06:27:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.491119+0000", 2024-09-10T06:27:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.049633156999999, 2024-09-10T06:27:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026832829999999998, 2024-09-10T06:27:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.600 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491119+0000", 2024-09-10T06:27:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491119+0000", 2024-09-10T06:27:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491121+0000", 2024-09-10T06:27:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2139999999999999e-06 2024-09-10T06:27:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491151+0000", 2024-09-10T06:27:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0499999999999999e-05 2024-09-10T06:27:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491178+0000", 2024-09-10T06:27:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6996999999999999e-05 2024-09-10T06:27:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491194+0000", 2024-09-10T06:27:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5831000000000001e-05 2024-09-10T06:27:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491325+0000", 2024-09-10T06:27:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013072600000000001 2024-09-10T06:27:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.491377+0000", 2024-09-10T06:27:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1944000000000003e-05 2024-09-10T06:27:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493723+0000", 2024-09-10T06:27:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023455749999999999 2024-09-10T06:27:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493802+0000", 2024-09-10T06:27:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9495999999999999e-05 2024-09-10T06:27:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:478 6.1 e34/28 6:80b6fe23:reshard::reshard.0000000011:head v 34'3, mlcod=34'1)", 2024-09-10T06:27:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.505492+0000", 2024-09-10T06:27:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.035259928999999, 2024-09-10T06:27:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030300840000000002, 2024-09-10T06:27:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505492+0000", 2024-09-10T06:27:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505492+0000", 2024-09-10T06:27:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505494+0000", 2024-09-10T06:27:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.762e-06 2024-09-10T06:27:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505505+0000", 2024-09-10T06:27:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0998e-05 2024-09-10T06:27:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505528+0000", 2024-09-10T06:27:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3339000000000001e-05 2024-09-10T06:27:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505545+0000", 2024-09-10T06:27:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6991999999999999e-05 2024-09-10T06:27:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505697+0000", 2024-09-10T06:27:01.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015241500000000001 2024-09-10T06:27:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505746+0000", 2024-09-10T06:27:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8433000000000002e-05 2024-09-10T06:27:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.508413+0000", 2024-09-10T06:27:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026673360000000002 2024-09-10T06:27:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.508522+0000", 2024-09-10T06:27:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010880899999999999 2024-09-10T06:27:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:480 6.5 e34/28 6:a4a56432:::obj_delete_at_hint.0000000012:head v 34'4, mlcod=34'2)", 2024-09-10T06:27:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.509954+0000", 2024-09-10T06:27:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.03079769, 2024-09-10T06:27:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038074789999999999, 2024-09-10T06:27:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.609 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509954+0000", 2024-09-10T06:27:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509954+0000", 2024-09-10T06:27:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509955+0000", 2024-09-10T06:27:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.266e-06 2024-09-10T06:27:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509966+0000", 2024-09-10T06:27:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0900000000000001e-05 2024-09-10T06:27:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509993+0000", 2024-09-10T06:27:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6633999999999999e-05 2024-09-10T06:27:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.510011+0000", 2024-09-10T06:27:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-10T06:27:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.510141+0000", 2024-09-10T06:27:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130063 2024-09-10T06:27:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.510193+0000", 2024-09-10T06:27:01.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2011000000000001e-05 2024-09-10T06:27:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.513634+0000", 2024-09-10T06:27:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034407119999999999 2024-09-10T06:27:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.513762+0000", 2024-09-10T06:27:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012751599999999999 2024-09-10T06:27:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.613 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:485 6.5 e34/28 6:a7f90313:reshard::reshard.0000000012:head v 34'5, mlcod=34'2)", 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.512302+0000", 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.02844941, 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041747709999999999, 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512302+0000", 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512302+0000", 2024-09-10T06:27:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512304+0000", 2024-09-10T06:27:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6929999999999999e-06 2024-09-10T06:27:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512318+0000", 2024-09-10T06:27:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.344e-05 2024-09-10T06:27:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512342+0000", 2024-09-10T06:27:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4456000000000001e-05 2024-09-10T06:27:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512354+0000", 2024-09-10T06:27:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2414e-05 2024-09-10T06:27:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512484+0000", 2024-09-10T06:27:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012974500000000001 2024-09-10T06:27:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512523+0000", 2024-09-10T06:27:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9124e-05 2024-09-10T06:27:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.516392+0000", 2024-09-10T06:27:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038686060000000001 2024-09-10T06:27:01.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.516477+0000", 2024-09-10T06:27:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5292999999999998e-05 2024-09-10T06:27:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:490 6.5 e34/28 6:a4a56432:::obj_delete_at_hint.0000000012:head v 34'6, mlcod=34'3)", 2024-09-10T06:27:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.515761+0000", 2024-09-10T06:27:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.024990382999999, 2024-09-10T06:27:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034429859999999999, 2024-09-10T06:27:01.618 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515761+0000", 2024-09-10T06:27:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515761+0000", 2024-09-10T06:27:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515764+0000", 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2699999999999999e-06 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515779+0000", 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4973e-05 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515812+0000", 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3713000000000001e-05 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515832+0000", 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9176000000000001e-05 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515956+0000", 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123881 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.516008+0000", 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2703e-05 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.519125+0000", 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003117098 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.519204+0000", 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9171999999999993e-05 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:493 6.5 e34/28 6:a7f90313:reshard::reshard.0000000012:head v 34'7, mlcod=34'4)", 2024-09-10T06:27:01.622 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.518455+0000", 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.022296384000001, 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027670849999999999, 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518455+0000", 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518455+0000", 2024-09-10T06:27:01.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518458+0000", 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0159999999999998e-06 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518471+0000", 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.323e-05 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518509+0000", 2024-09-10T06:27:01.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7942999999999999e-05 2024-09-10T06:27:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518528+0000", 2024-09-10T06:27:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9553000000000001e-05 2024-09-10T06:27:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518675+0000", 2024-09-10T06:27:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014679600000000001 2024-09-10T06:27:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.518731+0000", 2024-09-10T06:27:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6302999999999999e-05 2024-09-10T06:27:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.521141+0000", 2024-09-10T06:27:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024091780000000001 2024-09-10T06:27:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.521223+0000", 2024-09-10T06:27:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2065999999999997e-05 2024-09-10T06:27:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.626 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:517 6.3 e34/28 6:c31f41d7:gc::gc.10:head v 34'11, mlcod=34'9)", 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.533260+0000", 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.007492161999998, 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025463880000000001, 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533260+0000", 2024-09-10T06:27:01.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533260+0000", 2024-09-10T06:27:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533261+0000", 2024-09-10T06:27:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.725e-06 2024-09-10T06:27:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533272+0000", 2024-09-10T06:27:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0569e-05 2024-09-10T06:27:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533300+0000", 2024-09-10T06:27:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7763000000000002e-05 2024-09-10T06:27:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533318+0000", 2024-09-10T06:27:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7805e-05 2024-09-10T06:27:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533457+0000", 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139763 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533493+0000", 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6087000000000002e-05 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535679+0000", 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021851029999999999 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535806+0000", 2024-09-10T06:27:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012757299999999999 2024-09-10T06:27:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:937 6.1f e34/28 6:fd6b5df8:::obj_delete_at_hint.0000000120:head v 34'10, mlcod=34'8)", 2024-09-10T06:27:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.208068+0000", 2024-09-10T06:27:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.332683716999998, 2024-09-10T06:27:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036467819999999999, 2024-09-10T06:27:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:01.631 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208068+0000", 2024-09-10T06:27:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208068+0000", 2024-09-10T06:27:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208070+0000", 2024-09-10T06:27:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.283e-06 2024-09-10T06:27:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208083+0000", 2024-09-10T06:27:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2303999999999999e-05 2024-09-10T06:27:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208111+0000", 2024-09-10T06:27:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8473e-05 2024-09-10T06:27:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208124+0000", 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2866e-05 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208273+0000", 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014932300000000001 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208312+0000", 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8442999999999998e-05 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.211643+0000", 2024-09-10T06:27:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033307609999999998 2024-09-10T06:27:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.211715+0000", 2024-09-10T06:27:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2329000000000005e-05 2024-09-10T06:27:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:01.635 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:01.635 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:01.636 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T06:27:01.637 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:01.638 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:27:01.638 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:01.634+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:01.639 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:01.738 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:01.735+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:01.804 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:01.804 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:01.804 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:01.804 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:01.818 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:27:01.863 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:01.862+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:01.940 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:01.938+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:01.942 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:01.943 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:01.943 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:01.943 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:01.943 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:01.957 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:27:02.041 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:02.039+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:02.124 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:02.124 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:02.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:02.125 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:02.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.125 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.125 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:27:02.125 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.676310295999997, 2024-09-10T06:27:02.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70775834699999995, 2024-09-10T06:27:02.125 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.125 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.125 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1 2024-09-10T06:27:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:27:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:27:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446852+0000", 2024-09-10T06:27:02.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.117e-06 2024-09-10T06:27:02.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446870+0000", 2024-09-10T06:27:02.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7569999999999999e-05 2024-09-10T06:27:02.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446892+0000", 2024-09-10T06:27:02.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2036e-05 2024-09-10T06:27:02.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446908+0000", 2024-09-10T06:27:02.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6719999999999999e-05 2024-09-10T06:27:02.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447040+0000", 2024-09-10T06:27:02.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013118299999999999 2024-09-10T06:27:02.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:27:02.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447054+0000", 2024-09-10T06:27:02.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4343e-05 2024-09-10T06:27:02.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.151730+0000", 2024-09-10T06:27:02.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70467560600000001 2024-09-10T06:27:02.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152054+0000", 2024-09-10T06:27:02.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032444100000000002 2024-09-10T06:27:02.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152404+0000", 2024-09-10T06:27:02.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000349938 2024-09-10T06:27:02.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.153773+0000", 2024-09-10T06:27:02.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013693620000000001 2024-09-10T06:27:02.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154454+0000", 2024-09-10T06:27:02.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068035800000000005 2024-09-10T06:27:02.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154544+0000", 2024-09-10T06:27:02.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0623000000000003e-05 2024-09-10T06:27:02.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154607+0000", 2024-09-10T06:27:02.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3050000000000001e-05 2024-09-10T06:27:02.131 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.131 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.131 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.131 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.131 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.283936+0000", 2024-09-10T06:27:02.132 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.839222761000002, 2024-09-10T06:27:02.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010619014, 2024-09-10T06:27:02.132 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.132 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.132 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.132 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 42 2024-09-10T06:27:02.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.132 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283936+0000", 2024-09-10T06:27:02.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283936+0000", 2024-09-10T06:27:02.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283937+0000", 2024-09-10T06:27:02.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1699999999999997e-07 2024-09-10T06:27:02.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283943+0000", 2024-09-10T06:27:02.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.716e-06 2024-09-10T06:27:02.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283957+0000", 2024-09-10T06:27:02.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.438e-05 2024-09-10T06:27:02.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283966+0000", 2024-09-10T06:27:02.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1629999999999996e-06 2024-09-10T06:27:02.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.288081+0000", 2024-09-10T06:27:02.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041155260000000004 2024-09-10T06:27:02.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.288243+0000", 2024-09-10T06:27:02.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016151800000000001 2024-09-10T06:27:02.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.288447+0000", 2024-09-10T06:27:02.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000204009 2024-09-10T06:27:02.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.291733+0000", 2024-09-10T06:27:02.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032862970000000001 2024-09-10T06:27:02.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294272+0000", 2024-09-10T06:27:02.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025391910000000001 2024-09-10T06:27:02.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294437+0000", 2024-09-10T06:27:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016503500000000001 2024-09-10T06:27:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294555+0000", 2024-09-10T06:27:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118262 2024-09-10T06:27:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284185+0000", 2024-09-10T06:27:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.838973813000003, 2024-09-10T06:27:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010770666, 2024-09-10T06:27:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 43 2024-09-10T06:27:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284185+0000", 2024-09-10T06:27:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284185+0000", 2024-09-10T06:27:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284187+0000", 2024-09-10T06:27:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.424e-06 2024-09-10T06:27:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284194+0000", 2024-09-10T06:27:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5100000000000001e-06 2024-09-10T06:27:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284207+0000", 2024-09-10T06:27:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2173e-05 2024-09-10T06:27:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284214+0000", 2024-09-10T06:27:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9160000000000001e-06 2024-09-10T06:27:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.289407+0000", 2024-09-10T06:27:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005192543 2024-09-10T06:27:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.289526+0000", 2024-09-10T06:27:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119156 2024-09-10T06:27:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.289722+0000", 2024-09-10T06:27:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019601199999999999 2024-09-10T06:27:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294577+0000", 2024-09-10T06:27:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048552719999999999 2024-09-10T06:27:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294689+0000", 2024-09-10T06:27:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111859 2024-09-10T06:27:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294841+0000", 2024-09-10T06:27:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015141899999999999 2024-09-10T06:27:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294956+0000", 2024-09-10T06:27:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115382 2024-09-10T06:27:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284355+0000", 2024-09-10T06:27:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.838804218, 2024-09-10T06:27:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010886453000000001, 2024-09-10T06:27:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44 2024-09-10T06:27:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284355+0000", 2024-09-10T06:27:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284355+0000", 2024-09-10T06:27:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284356+0000", 2024-09-10T06:27:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.387e-06 2024-09-10T06:27:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284491+0000", 2024-09-10T06:27:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414899999999999 2024-09-10T06:27:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284524+0000", 2024-09-10T06:27:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3019999999999999e-05 2024-09-10T06:27:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284534+0000", 2024-09-10T06:27:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0682999999999999e-05 2024-09-10T06:27:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.290328+0000", 2024-09-10T06:27:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057935419999999996 2024-09-10T06:27:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.290474+0000", 2024-09-10T06:27:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014634500000000001 2024-09-10T06:27:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.290686+0000", 2024-09-10T06:27:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021220599999999999 2024-09-10T06:27:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294993+0000", 2024-09-10T06:27:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043067160000000004 2024-09-10T06:27:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295116+0000", 2024-09-10T06:27:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123416 2024-09-10T06:27:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295190+0000", 2024-09-10T06:27:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3325999999999996e-05 2024-09-10T06:27:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295241+0000", 2024-09-10T06:27:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1663000000000003e-05 2024-09-10T06:27:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284582+0000", 2024-09-10T06:27:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.838576942000003, 2024-09-10T06:27:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013156691, 2024-09-10T06:27:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45 2024-09-10T06:27:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284582+0000", 2024-09-10T06:27:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284582+0000", 2024-09-10T06:27:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284584+0000", 2024-09-10T06:27:02.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.443e-06 2024-09-10T06:27:02.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284614+0000", 2024-09-10T06:27:02.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9839999999999999e-05 2024-09-10T06:27:02.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284633+0000", 2024-09-10T06:27:02.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9446e-05 2024-09-10T06:27:02.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284642+0000", 2024-09-10T06:27:02.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0899999999999994e-06 2024-09-10T06:27:02.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.291833+0000", 2024-09-10T06:27:02.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071913380000000002 2024-09-10T06:27:02.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.291959+0000", 2024-09-10T06:27:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012549499999999999 2024-09-10T06:27:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.292160+0000", 2024-09-10T06:27:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020070900000000001 2024-09-10T06:27:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295013+0000", 2024-09-10T06:27:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028534509999999999 2024-09-10T06:27:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297598+0000", 2024-09-10T06:27:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025848400000000001 2024-09-10T06:27:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297674+0000", 2024-09-10T06:27:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6515999999999997e-05 2024-09-10T06:27:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297739+0000", 2024-09-10T06:27:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4523000000000005e-05 2024-09-10T06:27:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284661+0000", 2024-09-10T06:27:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.838498563000002, 2024-09-10T06:27:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015677505000000001, 2024-09-10T06:27:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 46 2024-09-10T06:27:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284661+0000", 2024-09-10T06:27:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284661+0000", 2024-09-10T06:27:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284662+0000", 2024-09-10T06:27:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4e-07 2024-09-10T06:27:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284668+0000", 2024-09-10T06:27:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-10T06:27:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284681+0000", 2024-09-10T06:27:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3644e-05 2024-09-10T06:27:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284689+0000", 2024-09-10T06:27:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4159999999999998e-06 2024-09-10T06:27:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.292881+0000", 2024-09-10T06:27:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081926929999999992 2024-09-10T06:27:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.293129+0000", 2024-09-10T06:27:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024731900000000002 2024-09-10T06:27:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.293518+0000", 2024-09-10T06:27:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038924700000000001 2024-09-10T06:27:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297510+0000", 2024-09-10T06:27:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039916220000000002 2024-09-10T06:27:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300194+0000", 2024-09-10T06:27:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002684053 2024-09-10T06:27:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300275+0000", 2024-09-10T06:27:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1369e-05 2024-09-10T06:27:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300338+0000", 2024-09-10T06:27:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3225999999999994e-05 2024-09-10T06:27:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284708+0000", 2024-09-10T06:27:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.838450917000003, 2024-09-10T06:27:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015911141, 2024-09-10T06:27:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47 2024-09-10T06:27:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284708+0000", 2024-09-10T06:27:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284708+0000", 2024-09-10T06:27:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284709+0000", 2024-09-10T06:27:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7400000000000003e-07 2024-09-10T06:27:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284790+0000", 2024-09-10T06:27:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1151999999999998e-05 2024-09-10T06:27:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284801+0000", 2024-09-10T06:27:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.115e-05 2024-09-10T06:27:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284809+0000", 2024-09-10T06:27:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-09-10T06:27:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295333+0000", 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010523858000000001 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295456+0000", 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123492 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295692+0000", 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023550900000000001 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298813+0000", 2024-09-10T06:27:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031209190000000002 2024-09-10T06:27:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300487+0000", 2024-09-10T06:27:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001673997 2024-09-10T06:27:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300564+0000", 2024-09-10T06:27:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7522999999999996e-05 2024-09-10T06:27:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300619+0000", 2024-09-10T06:27:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5189999999999998e-05 2024-09-10T06:27:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:27:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.838314627999999, 2024-09-10T06:27:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015989453000000001, 2024-09-10T06:27:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48 2024-09-10T06:27:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:27:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:27:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:27:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8400000000000003e-07 2024-09-10T06:27:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284851+0000", 2024-09-10T06:27:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.993e-06 2024-09-10T06:27:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284873+0000", 2024-09-10T06:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1319999999999999e-05 2024-09-10T06:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284894+0000", 2024-09-10T06:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1265999999999999e-05 2024-09-10T06:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.296618+0000", 2024-09-10T06:27:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011724106 2024-09-10T06:27:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.296750+0000", 2024-09-10T06:27:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013185200000000001 2024-09-10T06:27:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.296946+0000", 2024-09-10T06:27:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000195832 2024-09-10T06:27:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300394+0000", 2024-09-10T06:27:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034477570000000001 2024-09-10T06:27:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300717+0000", 2024-09-10T06:27:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032347399999999997 2024-09-10T06:27:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300783+0000", 2024-09-10T06:27:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6093000000000006e-05 2024-09-10T06:27:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300834+0000", 2024-09-10T06:27:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0976000000000001e-05 2024-09-10T06:27:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284913+0000", 2024-09-10T06:27:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.838246642000001, 2024-09-10T06:27:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017983938000000001, 2024-09-10T06:27:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49 2024-09-10T06:27:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284913+0000", 2024-09-10T06:27:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284913+0000", 2024-09-10T06:27:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284914+0000", 2024-09-10T06:27:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300000000000001e-06 2024-09-10T06:27:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284920+0000", 2024-09-10T06:27:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5100000000000004e-06 2024-09-10T06:27:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284931+0000", 2024-09-10T06:27:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0857e-05 2024-09-10T06:27:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284938+0000", 2024-09-10T06:27:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1130000000000003e-06 2024-09-10T06:27:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297873+0000", 2024-09-10T06:27:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012934863 2024-09-10T06:27:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298041+0000", 2024-09-10T06:27:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016838899999999999 2024-09-10T06:27:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298237+0000", 2024-09-10T06:27:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019565199999999999 2024-09-10T06:27:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300859+0000", 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026216099999999999 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302759+0000", 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019006819999999999 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302835+0000", 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5636000000000006e-05 2024-09-10T06:27:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302897+0000", 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1595999999999998e-05 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.838204625000003, 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019245090999999999, 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 50 2024-09-10T06:27:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:27:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3e-07 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285037+0000", 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2008999999999994e-05 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285049+0000", 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1816e-05 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285057+0000", 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8639999999999996e-06 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298896+0000", 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013838743000000001 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.299025+0000", 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129352 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.299222+0000", 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019682200000000001 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302676+0000", 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00345371 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304050+0000", 2024-09-10T06:27:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001374779 2024-09-10T06:27:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304135+0000", 2024-09-10T06:27:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4640000000000003e-05 2024-09-10T06:27:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304200+0000", 2024-09-10T06:27:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4626000000000001e-05 2024-09-10T06:27:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.838082376000003, 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021819150999999998, 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 51 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:27:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:27:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285078+0000", 2024-09-10T06:27:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000001e-07 2024-09-10T06:27:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285083+0000", 2024-09-10T06:27:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6099999999999997e-06 2024-09-10T06:27:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285092+0000", 2024-09-10T06:27:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2399999999999996e-06 2024-09-10T06:27:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285100+0000", 2024-09-10T06:27:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8739999999999995e-06 2024-09-10T06:27:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300938+0000", 2024-09-10T06:27:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015837527000000001 2024-09-10T06:27:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301058+0000", 2024-09-10T06:27:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012032300000000001 2024-09-10T06:27:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301251+0000", 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192828 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302937+0000", 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016857339999999999 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306745+0000", 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038078729999999998 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306830+0000", 2024-09-10T06:27:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5432999999999993e-05 2024-09-10T06:27:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306896+0000", 2024-09-10T06:27:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5993000000000003e-05 2024-09-10T06:27:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:27:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.8380425, 2024-09-10T06:27:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021995553000000001, 2024-09-10T06:27:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 52 2024-09-10T06:27:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:27:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4000000000000001e-07 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285123+0000", 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6969999999999998e-06 2024-09-10T06:27:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285132+0000", 2024-09-10T06:27:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1560000000000001e-06 2024-09-10T06:27:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285139+0000", 2024-09-10T06:27:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1539999999999996e-06 2024-09-10T06:27:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301865+0000", 2024-09-10T06:27:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016725173999999999 2024-09-10T06:27:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301995+0000", 2024-09-10T06:27:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130739 2024-09-10T06:27:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302195+0000", 2024-09-10T06:27:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000199965 2024-09-10T06:27:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.303135+0000", 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093978300000000002 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306979+0000", 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038437459999999999 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307057+0000", 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7766e-05 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307112+0000", 2024-09-10T06:27:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5733000000000003e-05 2024-09-10T06:27:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529402+0000", 2024-09-10T06:27:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.593757191999998, 2024-09-10T06:27:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011777342, 2024-09-10T06:27:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 69 2024-09-10T06:27:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529402+0000", 2024-09-10T06:27:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529402+0000", 2024-09-10T06:27:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529403+0000", 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0499999999999999e-06 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529550+0000", 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146549 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529564+0000", 2024-09-10T06:27:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4572999999999999e-05 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529573+0000", 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0429999999999996e-06 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532154+0000", 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025812209999999999 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532208+0000", 2024-09-10T06:27:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3127000000000001e-05 2024-09-10T06:27:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532301+0000", 2024-09-10T06:27:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3567999999999996e-05 2024-09-10T06:27:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533640+0000", 2024-09-10T06:27:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001338679 2024-09-10T06:27:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541107+0000", 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074675660000000001 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541144+0000", 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6196999999999999e-05 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541179+0000", 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5769000000000003e-05 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529592+0000", 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.593567143000001, 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011685376000000001, 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529592+0000", 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529592+0000", 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529593+0000", 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9600000000000008e-07 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529600+0000", 2024-09-10T06:27:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9870000000000002e-06 2024-09-10T06:27:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529610+0000", 2024-09-10T06:27:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9399999999999997e-06 2024-09-10T06:27:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529617+0000", 2024-09-10T06:27:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2370000000000003e-06 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532907+0000", 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032897930000000001 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532977+0000", 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0308999999999994e-05 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533073+0000", 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5461e-05 2024-09-10T06:27:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536700+0000", 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036268329999999999 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541212+0000", 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045119679999999999 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541252+0000", 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0472000000000001e-05 2024-09-10T06:27:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541277+0000", 2024-09-10T06:27:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5380000000000001e-05 2024-09-10T06:27:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529632+0000", 2024-09-10T06:27:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.593527420000001, 2024-09-10T06:27:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011740044999999999, 2024-09-10T06:27:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71 2024-09-10T06:27:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529632+0000", 2024-09-10T06:27:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529632+0000", 2024-09-10T06:27:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529633+0000", 2024-09-10T06:27:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9299999999999997e-07 2024-09-10T06:27:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529638+0000", 2024-09-10T06:27:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4559999999999999e-06 2024-09-10T06:27:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529648+0000", 2024-09-10T06:27:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5170000000000005e-06 2024-09-10T06:27:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529654+0000", 2024-09-10T06:27:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6669999999999999e-06 2024-09-10T06:27:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533778+0000", 2024-09-10T06:27:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041238220000000001 2024-09-10T06:27:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533846+0000", 2024-09-10T06:27:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7448999999999997e-05 2024-09-10T06:27:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533939+0000", 2024-09-10T06:27:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-10T06:27:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537278+0000", 2024-09-10T06:27:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033388580000000001 2024-09-10T06:27:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541309+0000", 2024-09-10T06:27:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040306389999999999 2024-09-10T06:27:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541348+0000", 2024-09-10T06:27:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9536000000000002e-05 2024-09-10T06:27:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541372+0000", 2024-09-10T06:27:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3587e-05 2024-09-10T06:27:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:27:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.593486531000003, 2024-09-10T06:27:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011791240999999999, 2024-09-10T06:27:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72 2024-09-10T06:27:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:27:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:27:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:27:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8700000000000005e-07 2024-09-10T06:27:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529846+0000", 2024-09-10T06:27:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017278199999999999 2024-09-10T06:27:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529890+0000", 2024-09-10T06:27:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3466e-05 2024-09-10T06:27:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529903+0000", 2024-09-10T06:27:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3327e-05 2024-09-10T06:27:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.534254+0000", 2024-09-10T06:27:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043508389999999996 2024-09-10T06:27:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.534311+0000", 2024-09-10T06:27:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7405999999999999e-05 2024-09-10T06:27:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.534406+0000", 2024-09-10T06:27:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4671000000000002e-05 2024-09-10T06:27:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537284+0000", 2024-09-10T06:27:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002878027 2024-09-10T06:27:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541411+0000", 2024-09-10T06:27:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041269790000000002 2024-09-10T06:27:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541441+0000", 2024-09-10T06:27:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0385000000000001e-05 2024-09-10T06:27:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541464+0000", 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2671999999999999e-05 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529930+0000", 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.593229260000001, 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011624766999999999, 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 73 2024-09-10T06:27:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529930+0000", 2024-09-10T06:27:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529930+0000", 2024-09-10T06:27:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529931+0000", 2024-09-10T06:27:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0470000000000001e-06 2024-09-10T06:27:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529938+0000", 2024-09-10T06:27:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0770000000000002e-06 2024-09-10T06:27:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529975+0000", 2024-09-10T06:27:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7366000000000001e-05 2024-09-10T06:27:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529989+0000", 2024-09-10T06:27:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3617e-05 2024-09-10T06:27:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536230+0000", 2024-09-10T06:27:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062414089999999998 2024-09-10T06:27:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536286+0000", 2024-09-10T06:27:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5077999999999997e-05 2024-09-10T06:27:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536383+0000", 2024-09-10T06:27:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7656000000000001e-05 2024-09-10T06:27:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539732+0000", 2024-09-10T06:27:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003348635 2024-09-10T06:27:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541501+0000", 2024-09-10T06:27:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017696249999999999 2024-09-10T06:27:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541531+0000", 2024-09-10T06:27:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9057999999999999e-05 2024-09-10T06:27:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541555+0000", 2024-09-10T06:27:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4199e-05 2024-09-10T06:27:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.530006+0000", 2024-09-10T06:27:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.59315316, 2024-09-10T06:27:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011638819, 2024-09-10T06:27:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74 2024-09-10T06:27:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530006+0000", 2024-09-10T06:27:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530006+0000", 2024-09-10T06:27:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530007+0000", 2024-09-10T06:27:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0400000000000005e-07 2024-09-10T06:27:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530013+0000", 2024-09-10T06:27:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7459999999999997e-06 2024-09-10T06:27:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530023+0000", 2024-09-10T06:27:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.058e-05 2024-09-10T06:27:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530037+0000", 2024-09-10T06:27:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3380000000000001e-05 2024-09-10T06:27:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536855+0000", 2024-09-10T06:27:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006818419 2024-09-10T06:27:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536910+0000", 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5188000000000001e-05 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537006+0000", 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5622e-05 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539737+0000", 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027316060000000001 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541593+0000", 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018553879999999999 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541623+0000", 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0397999999999999e-05 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541645+0000", 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1688e-05 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:27:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.593108631, 2024-09-10T06:27:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011680293, 2024-09-10T06:27:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 75 2024-09-10T06:27:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4700000000000001e-07 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530158+0000", 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010655299999999999 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530170+0000", 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2403e-05 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530178+0000", 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537326+0000", 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071483170000000004 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537381+0000", 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4666999999999997e-05 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537476+0000", 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4813000000000002e-05 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539753+0000", 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022772410000000002 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541675+0000", 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001922586 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541706+0000", 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0210999999999999e-05 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541731+0000", 2024-09-10T06:27:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5275000000000001e-05 2024-09-10T06:27:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:27:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.592963654999998, 2024-09-10T06:27:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012563269, 2024-09-10T06:27:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 76 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7300000000000005e-07 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530202+0000", 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.57e-06 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530211+0000", 2024-09-10T06:27:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4769999999999992e-06 2024-09-10T06:27:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530222+0000", 2024-09-10T06:27:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0139999999999999e-05 2024-09-10T06:27:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539284+0000", 2024-09-10T06:27:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090626879999999993 2024-09-10T06:27:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539353+0000", 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8397000000000003e-05 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539451+0000", 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8621000000000003e-05 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.540129+0000", 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00067820900000000004 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.542706+0000", 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025768760000000001 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.542736+0000", 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0125e-05 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.542759+0000", 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2393000000000001e-05 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:02.243 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:02.244 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:02.242+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:02.244 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:27:02.346 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:02.342+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:02.375 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:02.375 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:02.375 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:02.389 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:27:02.446 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:02.442+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:02.513 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:02.513 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:02.513 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:02.513 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:02.513 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:02.527 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:27:02.568 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-10T06:27:02.568 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:02.567+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:02.648 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:02.647+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:02.653 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:02.653 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:02.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:02.653 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:02.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.653 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:46 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'28, mlcod=16'22)", 2024-09-10T06:27:02.653 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:27:02.654 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.359512054, 2024-09-10T06:27:02.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042526789999999997, 2024-09-10T06:27:02.654 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.654 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.654 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.654 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:27:02.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293571+0000", 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1119999999999999e-06 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293577+0000", 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2179999999999996e-06 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293596+0000", 2024-09-10T06:27:02.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9170000000000001e-05 2024-09-10T06:27:02.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293605+0000", 2024-09-10T06:27:02.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4060000000000005e-06 2024-09-10T06:27:02.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293654+0000", 2024-09-10T06:27:02.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9116999999999997e-05 2024-09-10T06:27:02.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293671+0000", 2024-09-10T06:27:02.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7110999999999999e-05 2024-09-10T06:27:02.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.297783+0000", 2024-09-10T06:27:02.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041121409999999997 2024-09-10T06:27:02.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.297822+0000", 2024-09-10T06:27:02.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9403999999999997e-05 2024-09-10T06:27:02.657 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.658 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.658 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:50 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'26)", 2024-09-10T06:27:02.658 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:27:02.658 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.353723555000002, 2024-09-10T06:27:02.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042664490000000003, 2024-09-10T06:27:02.658 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.658 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.658 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.658 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:27:02.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:27:02.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299359+0000", 2024-09-10T06:27:02.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1100000000000004e-07 2024-09-10T06:27:02.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299425+0000", 2024-09-10T06:27:02.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5994999999999994e-05 2024-09-10T06:27:02.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299440+0000", 2024-09-10T06:27:02.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4552999999999999e-05 2024-09-10T06:27:02.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299448+0000", 2024-09-10T06:27:02.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7469999999999994e-06 2024-09-10T06:27:02.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299504+0000", 2024-09-10T06:27:02.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5257999999999998e-05 2024-09-10T06:27:02.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299518+0000", 2024-09-10T06:27:02.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4037e-05 2024-09-10T06:27:02.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.303578+0000", 2024-09-10T06:27:02.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040603439999999996 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.303625+0000", 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6604000000000003e-05 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:51 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.351716975000002, 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048711279999999997, 2024-09-10T06:27:02.662 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301366+0000", 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079999999999999e-06 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301400+0000", 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3816000000000003e-05 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301419+0000", 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9032e-05 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301427+0000", 2024-09-10T06:27:02.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-10T06:27:02.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301475+0000", 2024-09-10T06:27:02.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8201999999999997e-05 2024-09-10T06:27:02.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301494+0000", 2024-09-10T06:27:02.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8791e-05 2024-09-10T06:27:02.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306182+0000", 2024-09-10T06:27:02.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046878379999999997 2024-09-10T06:27:02.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306236+0000", 2024-09-10T06:27:02.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3764999999999998e-05 2024-09-10T06:27:02.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.666 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.667 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:52 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'34, mlcod=16'29)", 2024-09-10T06:27:02.667 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:27:02.667 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.350727620000001, 2024-09-10T06:27:02.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039365659999999999, 2024-09-10T06:27:02.667 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.667 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.667 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.667 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:27:02.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:27:02.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302355+0000", 2024-09-10T06:27:02.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.009e-06 2024-09-10T06:27:02.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302373+0000", 2024-09-10T06:27:02.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8232000000000001e-05 2024-09-10T06:27:02.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302388+0000", 2024-09-10T06:27:02.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4246999999999999e-05 2024-09-10T06:27:02.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302400+0000", 2024-09-10T06:27:02.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2054e-05 2024-09-10T06:27:02.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302449+0000", 2024-09-10T06:27:02.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9119000000000002e-05 2024-09-10T06:27:02.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302461+0000", 2024-09-10T06:27:02.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2206e-05 2024-09-10T06:27:02.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306238+0000", 2024-09-10T06:27:02.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037773889999999999 2024-09-10T06:27:02.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306291+0000", 2024-09-10T06:27:02.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2309999999999999e-05 2024-09-10T06:27:02.671 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.671 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.671 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.671 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:55 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'37, mlcod=16'33)", 2024-09-10T06:27:02.671 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:27:02.671 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.342421919000003, 2024-09-10T06:27:02.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041116740000000001, 2024-09-10T06:27:02.672 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.672 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.672 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.672 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:27:02.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:27:02.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310661+0000", 2024-09-10T06:27:02.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3600000000000003e-07 2024-09-10T06:27:02.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310724+0000", 2024-09-10T06:27:02.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3706000000000003e-05 2024-09-10T06:27:02.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310734+0000", 2024-09-10T06:27:02.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0207000000000001e-05 2024-09-10T06:27:02.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310740+0000", 2024-09-10T06:27:02.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8760000000000002e-06 2024-09-10T06:27:02.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310796+0000", 2024-09-10T06:27:02.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6206999999999999e-05 2024-09-10T06:27:02.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310813+0000", 2024-09-10T06:27:02.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6385999999999999e-05 2024-09-10T06:27:02.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.314729+0000", 2024-09-10T06:27:02.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039157469999999998 2024-09-10T06:27:02.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.314771+0000", 2024-09-10T06:27:02.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2809000000000003e-05 2024-09-10T06:27:02.676 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.676 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.676 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.676 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'47, mlcod=16'41)", 2024-09-10T06:27:02.676 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:27:02.676 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.120684572999998, 2024-09-10T06:27:02.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0084590540000000006, 2024-09-10T06:27:02.676 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.676 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:27:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:27:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532398+0000", 2024-09-10T06:27:02.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599999999999999e-07 2024-09-10T06:27:02.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532437+0000", 2024-09-10T06:27:02.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8711000000000003e-05 2024-09-10T06:27:02.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532449+0000", 2024-09-10T06:27:02.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2075999999999999e-05 2024-09-10T06:27:02.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532455+0000", 2024-09-10T06:27:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2110000000000003e-06 2024-09-10T06:27:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533257+0000", 2024-09-10T06:27:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080233799999999999 2024-09-10T06:27:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533318+0000", 2024-09-10T06:27:02.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1033000000000003e-05 2024-09-10T06:27:02.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540718+0000", 2024-09-10T06:27:02.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073998529999999996 2024-09-10T06:27:02.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540856+0000", 2024-09-10T06:27:02.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013792599999999999 2024-09-10T06:27:02.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.680 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.681 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:70 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'48, mlcod=16'41)", 2024-09-10T06:27:02.681 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:27:02.681 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.119978558, 2024-09-10T06:27:02.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0078483679999999997, 2024-09-10T06:27:02.681 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.681 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.681 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:27:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:27:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533104+0000", 2024-09-10T06:27:02.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3799999999999997e-07 2024-09-10T06:27:02.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533109+0000", 2024-09-10T06:27:02.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1100000000000002e-06 2024-09-10T06:27:02.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533117+0000", 2024-09-10T06:27:02.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7260000000000002e-06 2024-09-10T06:27:02.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533125+0000", 2024-09-10T06:27:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8170000000000005e-06 2024-09-10T06:27:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534794+0000", 2024-09-10T06:27:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016687760000000001 2024-09-10T06:27:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534808+0000", 2024-09-10T06:27:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4293e-05 2024-09-10T06:27:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540863+0000", 2024-09-10T06:27:02.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060549549999999999 2024-09-10T06:27:02.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540951+0000", 2024-09-10T06:27:02.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8152999999999994e-05 2024-09-10T06:27:02.685 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.685 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.685 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.685 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:71 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'49, mlcod=16'44)", 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.119105410000003, 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070511530000000001, 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533978+0000", 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5799999999999999e-06 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533987+0000", 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4460000000000007e-06 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534017+0000", 2024-09-10T06:27:02.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9524000000000001e-05 2024-09-10T06:27:02.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534027+0000", 2024-09-10T06:27:02.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0593e-05 2024-09-10T06:27:02.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535082+0000", 2024-09-10T06:27:02.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001054609 2024-09-10T06:27:02.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535095+0000", 2024-09-10T06:27:02.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2870999999999999e-05 2024-09-10T06:27:02.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540955+0000", 2024-09-10T06:27:02.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058596270000000001 2024-09-10T06:27:02.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541027+0000", 2024-09-10T06:27:02.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2903000000000003e-05 2024-09-10T06:27:02.689 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.690 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.690 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:72 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'50, mlcod=16'44)", 2024-09-10T06:27:02.690 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:27:02.690 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.118493248, 2024-09-10T06:27:02.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0065158799999999999, 2024-09-10T06:27:02.690 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.690 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.690 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.690 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534591+0000", 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0729999999999999e-06 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534722+0000", 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013124299999999999 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534746+0000", 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3903000000000001e-05 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534758+0000", 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2449000000000001e-05 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535408+0000", 2024-09-10T06:27:02.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00064971199999999999 2024-09-10T06:27:02.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535465+0000", 2024-09-10T06:27:02.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6892999999999999e-05 2024-09-10T06:27:02.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541030+0000", 2024-09-10T06:27:02.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055649209999999996 2024-09-10T06:27:02.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541104+0000", 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4685999999999996e-05 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:73 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'51, mlcod=16'44)", 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.116612926000002, 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047149710000000001, 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.694 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536471+0000", 2024-09-10T06:27:02.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.934e-06 2024-09-10T06:27:02.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536482+0000", 2024-09-10T06:27:02.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1542999999999999e-05 2024-09-10T06:27:02.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536511+0000", 2024-09-10T06:27:02.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8649999999999998e-05 2024-09-10T06:27:02.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536527+0000", 2024-09-10T06:27:02.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.649e-05 2024-09-10T06:27:02.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536776+0000", 2024-09-10T06:27:02.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024814800000000001 2024-09-10T06:27:02.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536811+0000", 2024-09-10T06:27:02.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5716000000000002e-05 2024-09-10T06:27:02.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541107+0000", 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042952770000000001 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541184+0000", 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7212999999999994e-05 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.698 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:74 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'52, mlcod=16'45)", 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.116050352999999, 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042018239999999998, 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:27:02.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537033+0000", 2024-09-10T06:27:02.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.533e-06 2024-09-10T06:27:02.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537043+0000", 2024-09-10T06:27:02.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0000000000000001e-05 2024-09-10T06:27:02.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537062+0000", 2024-09-10T06:27:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8686999999999999e-05 2024-09-10T06:27:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537072+0000", 2024-09-10T06:27:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0746e-05 2024-09-10T06:27:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537359+0000", 2024-09-10T06:27:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000286908 2024-09-10T06:27:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537415+0000", 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5389000000000001e-05 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541186+0000", 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037710550000000002 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541233+0000", 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7506000000000002e-05 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.702 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:75 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'53, mlcod=16'45)", 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.115436615, 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036309760000000002, 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:27:02.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:27:02.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537647+0000", 2024-09-10T06:27:02.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8369999999999999e-06 2024-09-10T06:27:02.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537767+0000", 2024-09-10T06:27:02.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119826 2024-09-10T06:27:02.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537798+0000", 2024-09-10T06:27:02.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0775999999999998e-05 2024-09-10T06:27:02.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537811+0000", 2024-09-10T06:27:02.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.327e-05 2024-09-10T06:27:02.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.538148+0000", 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033750799999999998 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.538189+0000", 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0713000000000001e-05 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541238+0000", 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030488500000000001 2024-09-10T06:27:02.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541276+0000", 2024-09-10T06:27:02.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8195999999999998e-05 2024-09-10T06:27:02.707 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.707 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.707 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.707 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:77 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'55, mlcod=16'53)", 2024-09-10T06:27:02.707 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:27:02.707 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.109265094999998, 2024-09-10T06:27:02.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041185240000000001, 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543818+0000", 2024-09-10T06:27:02.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8029999999999999e-06 2024-09-10T06:27:02.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543948+0000", 2024-09-10T06:27:02.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129369 2024-09-10T06:27:02.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543977+0000", 2024-09-10T06:27:02.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8813e-05 2024-09-10T06:27:02.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543989+0000", 2024-09-10T06:27:02.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2886e-05 2024-09-10T06:27:02.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544115+0000", 2024-09-10T06:27:02.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012526900000000001 2024-09-10T06:27:02.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544174+0000", 2024-09-10T06:27:02.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9166999999999998e-05 2024-09-10T06:27:02.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547867+0000", 2024-09-10T06:27:02.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036934340000000002 2024-09-10T06:27:02.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547935+0000", 2024-09-10T06:27:02.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7782999999999998e-05 2024-09-10T06:27:02.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.711 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.712 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:78 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'56, mlcod=16'53)", 2024-09-10T06:27:02.712 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:27:02.712 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.108696393999999, 2024-09-10T06:27:02.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035960359999999999, 2024-09-10T06:27:02.712 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.712 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.712 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.712 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:27:02.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544386+0000", 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1399999999999995e-07 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544510+0000", 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124265 2024-09-10T06:27:02.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544528+0000", 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7706999999999998e-05 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544538+0000", 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7799999999999995e-06 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545067+0000", 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052855600000000001 2024-09-10T06:27:02.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545125+0000", 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8313000000000002e-05 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547942+0000", 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028174749999999998 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547981+0000", 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9026000000000002e-05 2024-09-10T06:27:02.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.716 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.716 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.716 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:79 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'57, mlcod=16'53)", 2024-09-10T06:27:02.716 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:27:02.716 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.108157673999997, 2024-09-10T06:27:02.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044068620000000001, 2024-09-10T06:27:02.716 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.716 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.716 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.716 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:27:02.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:27:02.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544925+0000", 2024-09-10T06:27:02.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8000000000000004e-07 2024-09-10T06:27:02.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545047+0000", 2024-09-10T06:27:02.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121779 2024-09-10T06:27:02.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545077+0000", 2024-09-10T06:27:02.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0463e-05 2024-09-10T06:27:02.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545087+0000", 2024-09-10T06:27:02.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0067e-05 2024-09-10T06:27:02.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.546104+0000", 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001017088 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.546157+0000", 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2886000000000002e-05 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549219+0000", 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030620539999999998 2024-09-10T06:27:02.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549331+0000", 2024-09-10T06:27:02.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011164500000000001 2024-09-10T06:27:02.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.720 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.720 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:80 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'58, mlcod=16'53)", 2024-09-10T06:27:02.720 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:27:02.720 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.107559885999997, 2024-09-10T06:27:02.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042652369999999998, 2024-09-10T06:27:02.721 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.721 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.721 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.721 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:27:02.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:27:02.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545523+0000", 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2399999999999997e-07 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545646+0000", 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123662 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545664+0000", 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8e-05 2024-09-10T06:27:02.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545673+0000", 2024-09-10T06:27:02.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9930000000000001e-06 2024-09-10T06:27:02.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547057+0000", 2024-09-10T06:27:02.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013834629999999999 2024-09-10T06:27:02.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547129+0000", 2024-09-10T06:27:02.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1759000000000002e-05 2024-09-10T06:27:02.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549724+0000", 2024-09-10T06:27:02.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002595834 2024-09-10T06:27:02.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549787+0000", 2024-09-10T06:27:02.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2701999999999997e-05 2024-09-10T06:27:02.724 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.724 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.724 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.725 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:02.725 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:27:02.725 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.351416564000001, 2024-09-10T06:27:02.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040313359999999999, 2024-09-10T06:27:02.725 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.725 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.725 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.725 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:02.725 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:02.725 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:02.725 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 206 2024-09-10T06:27:02.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.726 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:27:02.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:27:02.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301670+0000", 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5669999999999996e-06 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301690+0000", 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0636999999999999e-05 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301735+0000", 2024-09-10T06:27:02.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4298999999999997e-05 2024-09-10T06:27:02.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301759+0000", 2024-09-10T06:27:02.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4769999999999998e-05 2024-09-10T06:27:02.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301938+0000", 2024-09-10T06:27:02.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017901899999999999 2024-09-10T06:27:02.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.302305+0000", 2024-09-10T06:27:02.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036679699999999998 2024-09-10T06:27:02.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:02.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.303069+0000", 2024-09-10T06:27:02.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076360999999999996 2024-09-10T06:27:02.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:02.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.304549+0000", 2024-09-10T06:27:02.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014798229999999999 2024-09-10T06:27:02.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305530+0000", 2024-09-10T06:27:02.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098141200000000008 2024-09-10T06:27:02.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305610+0000", 2024-09-10T06:27:02.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9785999999999998e-05 2024-09-10T06:27:02.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305696+0000", 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6615999999999999e-05 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.328811951999999, 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0081512240000000003, 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.731 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.732 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.732 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:02.732 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:02.732 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:02.732 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 210 2024-09-10T06:27:02.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.732 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:27:02.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324273+0000", 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1240000000000001e-06 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324285+0000", 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2463000000000001e-05 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324319+0000", 2024-09-10T06:27:02.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3309999999999998e-05 2024-09-10T06:27:02.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324342+0000", 2024-09-10T06:27:02.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3672999999999998e-05 2024-09-10T06:27:02.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324476+0000", 2024-09-10T06:27:02.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013378199999999999 2024-09-10T06:27:02.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324489+0000", 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3127e-05 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.328893+0000", 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044040190000000003 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.329211+0000", 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031762799999999998 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:02.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.329880+0000", 2024-09-10T06:27:02.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066933800000000001 2024-09-10T06:27:02.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:02.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.331727+0000", 2024-09-10T06:27:02.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018466120000000001 2024-09-10T06:27:02.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332287+0000", 2024-09-10T06:27:02.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056016599999999996 2024-09-10T06:27:02.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332363+0000", 2024-09-10T06:27:02.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5748999999999996e-05 2024-09-10T06:27:02.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332421+0000", 2024-09-10T06:27:02.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8233000000000003e-05 2024-09-10T06:27:02.737 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.737 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.737 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.738 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:469 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:02.738 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:27:02.738 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.153961034000002, 2024-09-10T06:27:02.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0056131189999999997, 2024-09-10T06:27:02.738 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.738 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.738 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.738 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:02.738 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:02.738 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:02.738 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 469 2024-09-10T06:27:02.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.738 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:27:02.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:27:02.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:27:02.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8400000000000003e-07 2024-09-10T06:27:02.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499125+0000", 2024-09-10T06:27:02.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.692e-06 2024-09-10T06:27:02.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499135+0000", 2024-09-10T06:27:02.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5310000000000007e-06 2024-09-10T06:27:02.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499140+0000", 2024-09-10T06:27:02.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9640000000000002e-06 2024-09-10T06:27:02.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499200+0000", 2024-09-10T06:27:02.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0874e-05 2024-09-10T06:27:02.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499303+0000", 2024-09-10T06:27:02.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102395 2024-09-10T06:27:02.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:02.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499518+0000", 2024-09-10T06:27:02.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021481500000000001 2024-09-10T06:27:02.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:02.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.500112+0000", 2024-09-10T06:27:02.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059408699999999998 2024-09-10T06:27:02.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504614+0000", 2024-09-10T06:27:02.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045017859999999998 2024-09-10T06:27:02.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504688+0000", 2024-09-10T06:27:02.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4528000000000002e-05 2024-09-10T06:27:02.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504734+0000", 2024-09-10T06:27:02.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5663e-05 2024-09-10T06:27:02.743 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.743 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.743 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.743 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:621 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:02.743 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:27:02.744 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.048730973000001, 2024-09-10T06:27:02.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039399250000000004, 2024-09-10T06:27:02.744 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:02.744 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:02.744 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:02.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:02.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:02.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:02.744 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 621 2024-09-10T06:27:02.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.744 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:02.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:02.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:27:02.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:02.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:27:02.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:02.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:02.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604353+0000", 2024-09-10T06:27:02.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.537e-06 2024-09-10T06:27:02.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:02.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604364+0000", 2024-09-10T06:27:02.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0923e-05 2024-09-10T06:27:02.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:02.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604394+0000", 2024-09-10T06:27:02.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0176999999999999e-05 2024-09-10T06:27:02.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:02.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604409+0000", 2024-09-10T06:27:02.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4666e-05 2024-09-10T06:27:02.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:02.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604505+0000", 2024-09-10T06:27:02.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5914000000000004e-05 2024-09-10T06:27:02.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:02.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604588+0000", 2024-09-10T06:27:02.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3127999999999994e-05 2024-09-10T06:27:02.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:02.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604709+0000", 2024-09-10T06:27:02.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121344 2024-09-10T06:27:02.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:02.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.605312+0000", 2024-09-10T06:27:02.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00060259599999999995 2024-09-10T06:27:02.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:02.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608229+0000", 2024-09-10T06:27:02.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029169600000000001 2024-09-10T06:27:02.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:02.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608264+0000", 2024-09-10T06:27:02.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4756999999999999e-05 2024-09-10T06:27:02.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:02.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:02.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:02.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608291+0000", 2024-09-10T06:27:02.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6923e-05 2024-09-10T06:27:02.749 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.749 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.749 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.749 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:02.749 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:02.749 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:02.751 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:27:02.751 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:02.750+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:02.852 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:02.847+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:02.916 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:02.916 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:02.916 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:02.916 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:02.930 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:27:02.972 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:02.971+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:03.053 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:03.050+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:03.096 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:03.097 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:03.097 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:03.097 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:03.097 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:03.111 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:27:03.154 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:03.154+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:03.237 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:03.237 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:03.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:03.237 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:03.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.238 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:03.238 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:03.238 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.959803698000002, 2024-09-10T06:27:03.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069538480000000003, 2024-09-10T06:27:03.238 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.238 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.238 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-10T06:27:03.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:03.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:03.238 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2 2024-09-10T06:27:03.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275742+0000", 2024-09-10T06:27:03.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7460000000000001e-06 2024-09-10T06:27:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275751+0000", 2024-09-10T06:27:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3979999999999999e-06 2024-09-10T06:27:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275769+0000", 2024-09-10T06:27:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8637000000000001e-05 2024-09-10T06:27:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275784+0000", 2024-09-10T06:27:03.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4518000000000001e-05 2024-09-10T06:27:03.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275905+0000", 2024-09-10T06:27:03.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012092899999999999 2024-09-10T06:27:03.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-10T06:27:03.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275920+0000", 2024-09-10T06:27:03.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5325999999999999e-05 2024-09-10T06:27:03.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282541+0000", 2024-09-10T06:27:03.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066208400000000002 2024-09-10T06:27:03.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282693+0000", 2024-09-10T06:27:03.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152454 2024-09-10T06:27:03.242 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.242 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.242 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.243 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:03.243 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:03.243 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.822975137, 2024-09-10T06:27:03.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029204980000000001, 2024-09-10T06:27:03.243 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.243 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.243 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.243 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.243 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.243 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.243 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 193 2024-09-10T06:27:03.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.243 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:03.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:03.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412570+0000", 2024-09-10T06:27:03.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4530000000000001e-06 2024-09-10T06:27:03.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412582+0000", 2024-09-10T06:27:03.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1524e-05 2024-09-10T06:27:03.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412612+0000", 2024-09-10T06:27:03.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0436000000000001e-05 2024-09-10T06:27:03.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412627+0000", 2024-09-10T06:27:03.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4306e-05 2024-09-10T06:27:03.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412723+0000", 2024-09-10T06:27:03.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6075000000000004e-05 2024-09-10T06:27:03.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412831+0000", 2024-09-10T06:27:03.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108453 2024-09-10T06:27:03.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412972+0000", 2024-09-10T06:27:03.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141225 2024-09-10T06:27:03.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.414147+0000", 2024-09-10T06:27:03.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174989 2024-09-10T06:27:03.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415334+0000", 2024-09-10T06:27:03.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:03.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415420+0000", 2024-09-10T06:27:03.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6009999999999998e-05 2024-09-10T06:27:03.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415489+0000", 2024-09-10T06:27:03.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8403000000000002e-05 2024-09-10T06:27:03.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.248 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.248 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.249 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.249 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:03.249 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.925491494999999, 2024-09-10T06:27:03.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092944310000000006, 2024-09-10T06:27:03.249 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.249 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.249 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.249 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.249 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 208 2024-09-10T06:27:03.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.249 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310055+0000", 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310066+0000", 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1739999999999999e-05 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310096+0000", 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0159e-05 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310111+0000", 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5007e-05 2024-09-10T06:27:03.251 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310235+0000", 2024-09-10T06:27:03.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123132 2024-09-10T06:27:03.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:27:03.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310246+0000", 2024-09-10T06:27:03.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1487e-05 2024-09-10T06:27:03.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315594+0000", 2024-09-10T06:27:03.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005347592 2024-09-10T06:27:03.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315932+0000", 2024-09-10T06:27:03.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033789099999999999 2024-09-10T06:27:03.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.316549+0000", 2024-09-10T06:27:03.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061698099999999995 2024-09-10T06:27:03.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.317898+0000", 2024-09-10T06:27:03.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013498799999999999 2024-09-10T06:27:03.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319207+0000", 2024-09-10T06:27:03.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013086969999999999 2024-09-10T06:27:03.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319289+0000", 2024-09-10T06:27:03.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2259e-05 2024-09-10T06:27:03.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319346+0000", 2024-09-10T06:27:03.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6675999999999997e-05 2024-09-10T06:27:03.255 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.255 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.255 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.255 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.255 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:03.255 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.899154771999999, 2024-09-10T06:27:03.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003262778, 2024-09-10T06:27:03.255 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.255 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.256 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.256 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.256 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.256 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.256 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 212 2024-09-10T06:27:03.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.256 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:03.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:03.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336391+0000", 2024-09-10T06:27:03.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5770000000000001e-06 2024-09-10T06:27:03.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.257 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.257 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336403+0000", 2024-09-10T06:27:03.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2286000000000001e-05 2024-09-10T06:27:03.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336425+0000", 2024-09-10T06:27:03.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2164e-05 2024-09-10T06:27:03.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336440+0000", 2024-09-10T06:27:03.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4222999999999999e-05 2024-09-10T06:27:03.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336621+0000", 2024-09-10T06:27:03.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018136500000000001 2024-09-10T06:27:03.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336830+0000", 2024-09-10T06:27:03.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209125 2024-09-10T06:27:03.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.337206+0000", 2024-09-10T06:27:03.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037553700000000001 2024-09-10T06:27:03.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.338527+0000", 2024-09-10T06:27:03.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00132142 2024-09-10T06:27:03.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339502+0000", 2024-09-10T06:27:03.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00097512599999999999 2024-09-10T06:27:03.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339585+0000", 2024-09-10T06:27:03.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2466000000000006e-05 2024-09-10T06:27:03.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339651+0000", 2024-09-10T06:27:03.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6489000000000007e-05 2024-09-10T06:27:03.261 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.261 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.261 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.261 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.261 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:03.261 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.874841233000001, 2024-09-10T06:27:03.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032440849999999999, 2024-09-10T06:27:03.261 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.262 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.262 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.262 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.262 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.262 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.262 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 219 2024-09-10T06:27:03.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.262 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:03.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:03.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360705+0000", 2024-09-10T06:27:03.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.593e-06 2024-09-10T06:27:03.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.263 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.263 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360716+0000", 2024-09-10T06:27:03.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1717e-05 2024-09-10T06:27:03.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360746+0000", 2024-09-10T06:27:03.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0233e-05 2024-09-10T06:27:03.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360761+0000", 2024-09-10T06:27:03.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4593000000000001e-05 2024-09-10T06:27:03.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360873+0000", 2024-09-10T06:27:03.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111809 2024-09-10T06:27:03.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361105+0000", 2024-09-10T06:27:03.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023171800000000001 2024-09-10T06:27:03.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361523+0000", 2024-09-10T06:27:03.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000418694 2024-09-10T06:27:03.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.362840+0000", 2024-09-10T06:27:03.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013165570000000001 2024-09-10T06:27:03.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363793+0000", 2024-09-10T06:27:03.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095323200000000004 2024-09-10T06:27:03.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363880+0000", 2024-09-10T06:27:03.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6689999999999998e-05 2024-09-10T06:27:03.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363946+0000", 2024-09-10T06:27:03.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6248999999999995e-05 2024-09-10T06:27:03.267 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.267 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.267 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.267 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.267 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:03.268 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.857574379999999, 2024-09-10T06:27:03.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003271422, 2024-09-10T06:27:03.268 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.268 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.268 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.268 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.268 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.268 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.268 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 224 2024-09-10T06:27:03.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.268 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:03.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:03.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.269 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.269 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377971+0000", 2024-09-10T06:27:03.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:03.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377983+0000", 2024-09-10T06:27:03.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1517e-05 2024-09-10T06:27:03.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378013+0000", 2024-09-10T06:27:03.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0476000000000001e-05 2024-09-10T06:27:03.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378028+0000", 2024-09-10T06:27:03.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5173e-05 2024-09-10T06:27:03.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378134+0000", 2024-09-10T06:27:03.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010533 2024-09-10T06:27:03.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378346+0000", 2024-09-10T06:27:03.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021175499999999999 2024-09-10T06:27:03.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378787+0000", 2024-09-10T06:27:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044190899999999999 2024-09-10T06:27:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.380237+0000", 2024-09-10T06:27:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001449093 2024-09-10T06:27:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381097+0000", 2024-09-10T06:27:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086022300000000002 2024-09-10T06:27:03.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381181+0000", 2024-09-10T06:27:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3973000000000004e-05 2024-09-10T06:27:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381240+0000", 2024-09-10T06:27:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9472999999999998e-05 2024-09-10T06:27:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.274 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.274 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:03.274 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.825906926999998, 2024-09-10T06:27:03.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031998719999999999, 2024-09-10T06:27:03.274 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.274 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.274 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.274 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.274 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 233 2024-09-10T06:27:03.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.274 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:03.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:03.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409639+0000", 2024-09-10T06:27:03.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4770000000000002e-06 2024-09-10T06:27:03.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409652+0000", 2024-09-10T06:27:03.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3692999999999999e-05 2024-09-10T06:27:03.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409683+0000", 2024-09-10T06:27:03.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1080000000000001e-05 2024-09-10T06:27:03.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409699+0000", 2024-09-10T06:27:03.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5245999999999999e-05 2024-09-10T06:27:03.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409881+0000", 2024-09-10T06:27:03.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000182709 2024-09-10T06:27:03.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410088+0000", 2024-09-10T06:27:03.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020630799999999999 2024-09-10T06:27:03.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410495+0000", 2024-09-10T06:27:03.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00040682700000000001 2024-09-10T06:27:03.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.411805+0000", 2024-09-10T06:27:03.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013101059999999999 2024-09-10T06:27:03.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412672+0000", 2024-09-10T06:27:03.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086778699999999996 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412769+0000", 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6565999999999997e-05 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412836+0000", 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7073e-05 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.280 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:353 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.280 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:03.280 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.784999613, 2024-09-10T06:27:03.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059710450000000003, 2024-09-10T06:27:03.280 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.280 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.280 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.280 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.280 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.280 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.280 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 353 2024-09-10T06:27:03.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.281 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:03.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:03.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450545+0000", 2024-09-10T06:27:03.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.423e-06 2024-09-10T06:27:03.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450551+0000", 2024-09-10T06:27:03.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7370000000000003e-06 2024-09-10T06:27:03.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450565+0000", 2024-09-10T06:27:03.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4649e-05 2024-09-10T06:27:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450574+0000", 2024-09-10T06:27:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5129999999999996e-06 2024-09-10T06:27:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450644+0000", 2024-09-10T06:27:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0387000000000002e-05 2024-09-10T06:27:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450818+0000", 2024-09-10T06:27:03.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017368400000000001 2024-09-10T06:27:03.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451030+0000", 2024-09-10T06:27:03.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021189599999999999 2024-09-10T06:27:03.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451607+0000", 2024-09-10T06:27:03.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057672599999999995 2024-09-10T06:27:03.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456437+0000", 2024-09-10T06:27:03.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048301940000000003 2024-09-10T06:27:03.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456472+0000", 2024-09-10T06:27:03.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5178000000000001e-05 2024-09-10T06:27:03.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456515+0000", 2024-09-10T06:27:03.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2657999999999997e-05 2024-09-10T06:27:03.286 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.286 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.286 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.286 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:362 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.286 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:03.286 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.778552091000002, 2024-09-10T06:27:03.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044032239999999999, 2024-09-10T06:27:03.286 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.286 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.286 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.286 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 362 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:03.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456992+0000", 2024-09-10T06:27:03.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6700000000000002e-07 2024-09-10T06:27:03.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456997+0000", 2024-09-10T06:27:03.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6249999999999998e-06 2024-09-10T06:27:03.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457005+0000", 2024-09-10T06:27:03.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6719999999999993e-06 2024-09-10T06:27:03.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457010+0000", 2024-09-10T06:27:03.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7360000000000001e-06 2024-09-10T06:27:03.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457054+0000", 2024-09-10T06:27:03.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4138999999999999e-05 2024-09-10T06:27:03.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457163+0000", 2024-09-10T06:27:03.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108558 2024-09-10T06:27:03.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457340+0000", 2024-09-10T06:27:03.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017730600000000001 2024-09-10T06:27:03.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.458065+0000", 2024-09-10T06:27:03.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00072480400000000001 2024-09-10T06:27:03.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461294+0000", 2024-09-10T06:27:03.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032287890000000001 2024-09-10T06:27:03.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461352+0000", 2024-09-10T06:27:03.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8502000000000003e-05 2024-09-10T06:27:03.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461394+0000", 2024-09-10T06:27:03.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2225999999999999e-05 2024-09-10T06:27:03.292 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.292 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.292 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.292 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:475 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.292 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:03.292 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.732702526000001, 2024-09-10T06:27:03.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046091930000000001, 2024-09-10T06:27:03.293 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.293 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.293 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.293 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.293 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.293 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.293 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 475 2024-09-10T06:27:03.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.293 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:03.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:03.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:03.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6100000000000001e-07 2024-09-10T06:27:03.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502844+0000", 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0529999999999998e-06 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502852+0000", 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2579999999999995e-06 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502857+0000", 2024-09-10T06:27:03.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3460000000000004e-06 2024-09-10T06:27:03.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502894+0000", 2024-09-10T06:27:03.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6884000000000001e-05 2024-09-10T06:27:03.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502942+0000", 2024-09-10T06:27:03.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7791999999999999e-05 2024-09-10T06:27:03.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.503048+0000", 2024-09-10T06:27:03.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010678799999999999 2024-09-10T06:27:03.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.506079+0000", 2024-09-10T06:27:03.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030311510000000002 2024-09-10T06:27:03.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507361+0000", 2024-09-10T06:27:03.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001281208 2024-09-10T06:27:03.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507400+0000", 2024-09-10T06:27:03.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9483000000000001e-05 2024-09-10T06:27:03.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507450+0000", 2024-09-10T06:27:03.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9669000000000002e-05 2024-09-10T06:27:03.298 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.298 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.298 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:477 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.730741409, 2024-09-10T06:27:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038544, 2024-09-10T06:27:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 477 2024-09-10T06:27:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.299 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:03.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:03.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504803+0000", 2024-09-10T06:27:03.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9999999999999996e-07 2024-09-10T06:27:03.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504808+0000", 2024-09-10T06:27:03.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1909999999999999e-06 2024-09-10T06:27:03.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504818+0000", 2024-09-10T06:27:03.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0081999999999999e-05 2024-09-10T06:27:03.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504823+0000", 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9969999999999998e-06 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504870+0000", 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6980000000000001e-05 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504922+0000", 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869000000000001e-05 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505020+0000", 2024-09-10T06:27:03.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8010999999999994e-05 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507789+0000", 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027690219999999999 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508599+0000", 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081037800000000005 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508631+0000", 2024-09-10T06:27:03.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.137e-05 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508656+0000", 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5599999999999999e-05 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:478 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.730694506999999, 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039361880000000002, 2024-09-10T06:27:03.304 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.305 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.305 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.305 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 478 2024-09-10T06:27:03.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.305 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:03.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7800000000000001e-07 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504853+0000", 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2780000000000002e-06 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504858+0000", 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7359999999999998e-06 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504862+0000", 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6650000000000001e-06 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504938+0000", 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6286999999999997e-05 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505091+0000", 2024-09-10T06:27:03.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152385 2024-09-10T06:27:03.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:03.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505335+0000", 2024-09-10T06:27:03.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244281 2024-09-10T06:27:03.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507764+0000", 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002429624 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508681+0000", 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00091630100000000001 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508747+0000", 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5733000000000002e-05 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508785+0000", 2024-09-10T06:27:03.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8319999999999999e-05 2024-09-10T06:27:03.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.310 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.310 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.310 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:03.310 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.484562586999999, 2024-09-10T06:27:03.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030732350000000001, 2024-09-10T06:27:03.310 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.310 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.310 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.311 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 733 2024-09-10T06:27:03.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.311 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:03.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:03.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750983+0000", 2024-09-10T06:27:03.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8880000000000001e-06 2024-09-10T06:27:03.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750996+0000", 2024-09-10T06:27:03.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2048999999999999e-05 2024-09-10T06:27:03.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751024+0000", 2024-09-10T06:27:03.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8802e-05 2024-09-10T06:27:03.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751043+0000", 2024-09-10T06:27:03.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8266000000000001e-05 2024-09-10T06:27:03.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751191+0000", 2024-09-10T06:27:03.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014818200000000001 2024-09-10T06:27:03.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751417+0000", 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022648199999999999 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751747+0000", 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032945000000000001 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.752752+0000", 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010054790000000001 2024-09-10T06:27:03.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753896+0000", 2024-09-10T06:27:03.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001143638 2024-09-10T06:27:03.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753989+0000", 2024-09-10T06:27:03.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3466000000000003e-05 2024-09-10T06:27:03.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.754054+0000", 2024-09-10T06:27:03.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4533e-05 2024-09-10T06:27:03.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.316 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.316 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.316 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:03.316 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.444082041000001, 2024-09-10T06:27:03.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002896722, 2024-09-10T06:27:03.316 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.316 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.316 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.316 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.317 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 751 2024-09-10T06:27:03.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.317 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:03.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:03.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791464+0000", 2024-09-10T06:27:03.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7140000000000002e-06 2024-09-10T06:27:03.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791475+0000", 2024-09-10T06:27:03.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1535999999999999e-05 2024-09-10T06:27:03.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791501+0000", 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5276e-05 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791514+0000", 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3203e-05 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791643+0000", 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012961900000000001 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791857+0000", 2024-09-10T06:27:03.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021351599999999999 2024-09-10T06:27:03.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.792178+0000", 2024-09-10T06:27:03.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032090999999999999 2024-09-10T06:27:03.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.793281+0000", 2024-09-10T06:27:03.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001103319 2024-09-10T06:27:03.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794209+0000", 2024-09-10T06:27:03.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000927676 2024-09-10T06:27:03.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794295+0000", 2024-09-10T06:27:03.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5682999999999999e-05 2024-09-10T06:27:03.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794358+0000", 2024-09-10T06:27:03.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3269999999999996e-05 2024-09-10T06:27:03.321 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.321 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.322 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.322 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.322 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:03.322 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.440194544000001, 2024-09-10T06:27:03.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030558059999999999, 2024-09-10T06:27:03.322 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.322 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.322 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.322 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.322 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.322 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.322 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 753 2024-09-10T06:27:03.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.323 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:03.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:03.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795352+0000", 2024-09-10T06:27:03.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0130000000000002e-06 2024-09-10T06:27:03.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795364+0000", 2024-09-10T06:27:03.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1939999999999999e-05 2024-09-10T06:27:03.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795395+0000", 2024-09-10T06:27:03.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0976999999999998e-05 2024-09-10T06:27:03.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795413+0000", 2024-09-10T06:27:03.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7980000000000001e-05 2024-09-10T06:27:03.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795533+0000", 2024-09-10T06:27:03.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120732 2024-09-10T06:27:03.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795665+0000", 2024-09-10T06:27:03.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013215899999999999 2024-09-10T06:27:03.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795931+0000", 2024-09-10T06:27:03.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026536499999999999 2024-09-10T06:27:03.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.796995+0000", 2024-09-10T06:27:03.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001064611 2024-09-10T06:27:03.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798256+0000", 2024-09-10T06:27:03.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00126022 2024-09-10T06:27:03.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798340+0000", 2024-09-10T06:27:03.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4753000000000007e-05 2024-09-10T06:27:03.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798404+0000", 2024-09-10T06:27:03.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4055999999999998e-05 2024-09-10T06:27:03.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.327 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.328 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.328 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:03.328 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.324986302999999, 2024-09-10T06:27:03.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031632380000000001, 2024-09-10T06:27:03.328 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.328 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.328 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.328 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.328 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.328 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.328 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 805 2024-09-10T06:27:03.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.329 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:03.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:03.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910560+0000", 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2200000000000001e-06 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910574+0000", 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3536000000000001e-05 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910604+0000", 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0645999999999998e-05 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910619+0000", 2024-09-10T06:27:03.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5064e-05 2024-09-10T06:27:03.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910759+0000", 2024-09-10T06:27:03.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013943899999999999 2024-09-10T06:27:03.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910984+0000", 2024-09-10T06:27:03.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000225381 2024-09-10T06:27:03.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.911312+0000", 2024-09-10T06:27:03.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032782800000000001 2024-09-10T06:27:03.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.912402+0000", 2024-09-10T06:27:03.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010895639999999999 2024-09-10T06:27:03.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913576+0000", 2024-09-10T06:27:03.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174591 2024-09-10T06:27:03.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913657+0000", 2024-09-10T06:27:03.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1223000000000005e-05 2024-09-10T06:27:03.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913720+0000", 2024-09-10T06:27:03.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2745999999999999e-05 2024-09-10T06:27:03.334 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.334 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.334 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.334 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.334 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:03.334 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.265208567999998, 2024-09-10T06:27:03.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030680099999999999, 2024-09-10T06:27:03.334 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.334 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.334 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.335 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.335 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.335 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.335 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 832 2024-09-10T06:27:03.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.335 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:03.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:03.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970337+0000", 2024-09-10T06:27:03.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6230000000000001e-06 2024-09-10T06:27:03.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970349+0000", 2024-09-10T06:27:03.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1557e-05 2024-09-10T06:27:03.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970379+0000", 2024-09-10T06:27:03.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0456000000000001e-05 2024-09-10T06:27:03.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970394+0000", 2024-09-10T06:27:03.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4683e-05 2024-09-10T06:27:03.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970509+0000", 2024-09-10T06:27:03.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114613 2024-09-10T06:27:03.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970753+0000", 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244295 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.971078+0000", 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000325583 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.972162+0000", 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010834519999999999 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973200+0000", 2024-09-10T06:27:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010376560000000001 2024-09-10T06:27:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973287+0000", 2024-09-10T06:27:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7163000000000006e-05 2024-09-10T06:27:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973403+0000", 2024-09-10T06:27:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011592899999999999 2024-09-10T06:27:03.339 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.340 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.340 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.340 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.340 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:03.340 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.110137341000001, 2024-09-10T06:27:03.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030018599999999999, 2024-09-10T06:27:03.340 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.340 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.340 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.340 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.340 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.340 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.341 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 901 2024-09-10T06:27:03.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.341 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:03.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:03.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125409+0000", 2024-09-10T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.253e-06 2024-09-10T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125425+0000", 2024-09-10T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5636000000000001e-05 2024-09-10T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125456+0000", 2024-09-10T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1130000000000002e-05 2024-09-10T06:27:03.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125470+0000", 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.464e-05 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125581+0000", 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110612 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125814+0000", 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023266899999999999 2024-09-10T06:27:03.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.126159+0000", 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034565399999999998 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.127161+0000", 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010020890000000001 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128202+0000", 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001040242 2024-09-10T06:27:03.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128288+0000", 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6156000000000007e-05 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128408+0000", 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011977900000000001 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.345 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.346 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:03.346 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.076044971999998, 2024-09-10T06:27:03.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029016649999999999, 2024-09-10T06:27:03.346 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.346 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.346 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.346 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 916 2024-09-10T06:27:03.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.346 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:03.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:03.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159501+0000", 2024-09-10T06:27:03.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:03.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159512+0000", 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1564e-05 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159543+0000", 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0942999999999998e-05 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159558+0000", 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.436e-05 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159701+0000", 2024-09-10T06:27:03.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014363599999999999 2024-09-10T06:27:03.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159927+0000", 2024-09-10T06:27:03.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022535099999999999 2024-09-10T06:27:03.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.160260+0000", 2024-09-10T06:27:03.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033321700000000002 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.161312+0000", 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001052222 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162261+0000", 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00094912600000000001 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162337+0000", 2024-09-10T06:27:03.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6268999999999998e-05 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162400+0000", 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2477000000000005e-05 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 21.005735461, 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030045179999999999, 2024-09-10T06:27:03.351 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:03.352 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:03.352 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:03.352 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:03.352 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:03.352 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:03.352 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 946 2024-09-10T06:27:03.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.352 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:03.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:03.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:03.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229810+0000", 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229838+0000", 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7776e-05 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229869+0000", 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0766999999999999e-05 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229883+0000", 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4423000000000001e-05 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230005+0000", 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121919 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:03.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230219+0000", 2024-09-10T06:27:03.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000214098 2024-09-10T06:27:03.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:03.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230588+0000", 2024-09-10T06:27:03.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036857099999999999 2024-09-10T06:27:03.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:03.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.231707+0000", 2024-09-10T06:27:03.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011193349999999999 2024-09-10T06:27:03.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232662+0000", 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095513300000000005 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232748+0000", 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6151999999999998e-05 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232812+0000", 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3876999999999998e-05 2024-09-10T06:27:03.356 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.357 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.357 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.357 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:03.357 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:03.357 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:03.360 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:27:03.361 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:03.355+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:03.459 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:03.458+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:03.532 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:03.532 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:03.532 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:03.532 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:03.547 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:27:03.560 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:03.558+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:03.640 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:27:03.669 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:03.669 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:03.670 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:03.670 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:03.666+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:03.684 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:27:03.762 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:03.758+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:03.782 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:03.782 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:03.799 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:03.799 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:03.817 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:03.817 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:03.833 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:03.833 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:03.854 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:03.854 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:03.854 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:03.854 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:03.862 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:03.858+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:03.869 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:27:03.875 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:03.875 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:03.895 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:03.895 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:03.916 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:03.917 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:03.964 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:03.962+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:03.989 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:03.989 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:04.003 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:27:04.065 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:04.062+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:04.123 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:04.123 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:04.137 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:27:04.165 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:04.162+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:04.266 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:04.262+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:04.301 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:04.301 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:04.316 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:27:04.367 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:04.362+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:04.446 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:04.446 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:04.460 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:27:04.468 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:04.466+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:04.569 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:04.566+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:04.582 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:04.582 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:04.588 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T06:27:04.597 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:27:04.671 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:04.666+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:04.715 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:04.715 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:04.730 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:27:04.775 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:04.774+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:04.854 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:04.855 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:04.869 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:27:04.911 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:04.910+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:04.972 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:04.970+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:05.035 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:05.036 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:05.049 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:27:05.095 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:05.094+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:05.174 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:05.170+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:05.218 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:05.218 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:05.232 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:27:05.275 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:05.270+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:05.377 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:05.374+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:05.396 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:05.396 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:05.411 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:27:05.503 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:05.502+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:05.579 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:05.574+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:05.579 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:05.580 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:05.583 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-10T06:27:05.595 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:27:05.679 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:05.674+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:05.764 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:05.765 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:05.779 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:27:05.780 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:05.778+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:05.881 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:05.878+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:05.902 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:05.902 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:05.917 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:27:05.936 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:27:05.982 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:05.978+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:06.080 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:06.080 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:06.082 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:06.078+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:06.092 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:06.093 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:06.094 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:27:06.109 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:06.109 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:06.125 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:06.125 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:06.141 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:06.142 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:06.161 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:06.161 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:06.179 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:06.179 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:06.183 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:06.178+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:06.199 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:06.199 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:06.219 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:06.219 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:06.223 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:06.223 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:06.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:06.223 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:06.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.223 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.223 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:27:06.223 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.774828194000001, 2024-09-10T06:27:06.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70775834699999995, 2024-09-10T06:27:06.223 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.224 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.224 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.224 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.224 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.224 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.224 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1 2024-09-10T06:27:06.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.224 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:27:06.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:27:06.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446852+0000", 2024-09-10T06:27:06.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.117e-06 2024-09-10T06:27:06.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446870+0000", 2024-09-10T06:27:06.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7569999999999999e-05 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446892+0000", 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2036e-05 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446908+0000", 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6719999999999999e-05 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447040+0000", 2024-09-10T06:27:06.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013118299999999999 2024-09-10T06:27:06.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:27:06.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447054+0000", 2024-09-10T06:27:06.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4343e-05 2024-09-10T06:27:06.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.151730+0000", 2024-09-10T06:27:06.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70467560600000001 2024-09-10T06:27:06.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152054+0000", 2024-09-10T06:27:06.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032444100000000002 2024-09-10T06:27:06.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152404+0000", 2024-09-10T06:27:06.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000349938 2024-09-10T06:27:06.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.153773+0000", 2024-09-10T06:27:06.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013693620000000001 2024-09-10T06:27:06.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154454+0000", 2024-09-10T06:27:06.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068035800000000005 2024-09-10T06:27:06.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154544+0000", 2024-09-10T06:27:06.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0623000000000003e-05 2024-09-10T06:27:06.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154607+0000", 2024-09-10T06:27:06.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3050000000000001e-05 2024-09-10T06:27:06.229 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.230 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.230 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.230 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.230 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.283936+0000", 2024-09-10T06:27:06.230 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.937740658999999, 2024-09-10T06:27:06.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010619014, 2024-09-10T06:27:06.230 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.230 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.230 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.230 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.230 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.231 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 42 2024-09-10T06:27:06.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.231 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283936+0000", 2024-09-10T06:27:06.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283936+0000", 2024-09-10T06:27:06.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283937+0000", 2024-09-10T06:27:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1699999999999997e-07 2024-09-10T06:27:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283943+0000", 2024-09-10T06:27:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.716e-06 2024-09-10T06:27:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283957+0000", 2024-09-10T06:27:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.438e-05 2024-09-10T06:27:06.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.283966+0000", 2024-09-10T06:27:06.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1629999999999996e-06 2024-09-10T06:27:06.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.288081+0000", 2024-09-10T06:27:06.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041155260000000004 2024-09-10T06:27:06.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.288243+0000", 2024-09-10T06:27:06.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016151800000000001 2024-09-10T06:27:06.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.288447+0000", 2024-09-10T06:27:06.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000204009 2024-09-10T06:27:06.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.291733+0000", 2024-09-10T06:27:06.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032862970000000001 2024-09-10T06:27:06.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294272+0000", 2024-09-10T06:27:06.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025391910000000001 2024-09-10T06:27:06.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294437+0000", 2024-09-10T06:27:06.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016503500000000001 2024-09-10T06:27:06.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294555+0000", 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118262 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284185+0000", 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.937491711, 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010770666, 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.236 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.237 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 43 2024-09-10T06:27:06.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.237 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284185+0000", 2024-09-10T06:27:06.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284185+0000", 2024-09-10T06:27:06.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284187+0000", 2024-09-10T06:27:06.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.424e-06 2024-09-10T06:27:06.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284194+0000", 2024-09-10T06:27:06.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5100000000000001e-06 2024-09-10T06:27:06.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284207+0000", 2024-09-10T06:27:06.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2173e-05 2024-09-10T06:27:06.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284214+0000", 2024-09-10T06:27:06.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9160000000000001e-06 2024-09-10T06:27:06.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.289407+0000", 2024-09-10T06:27:06.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005192543 2024-09-10T06:27:06.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.289526+0000", 2024-09-10T06:27:06.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119156 2024-09-10T06:27:06.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.289722+0000", 2024-09-10T06:27:06.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019601199999999999 2024-09-10T06:27:06.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294577+0000", 2024-09-10T06:27:06.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048552719999999999 2024-09-10T06:27:06.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294689+0000", 2024-09-10T06:27:06.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111859 2024-09-10T06:27:06.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294841+0000", 2024-09-10T06:27:06.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015141899999999999 2024-09-10T06:27:06.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294956+0000", 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115382 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284355+0000", 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.937322115999997, 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010886453000000001, 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.242 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.243 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.243 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 44 2024-09-10T06:27:06.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.243 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284355+0000", 2024-09-10T06:27:06.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284355+0000", 2024-09-10T06:27:06.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284356+0000", 2024-09-10T06:27:06.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.387e-06 2024-09-10T06:27:06.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284491+0000", 2024-09-10T06:27:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414899999999999 2024-09-10T06:27:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284524+0000", 2024-09-10T06:27:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3019999999999999e-05 2024-09-10T06:27:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284534+0000", 2024-09-10T06:27:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0682999999999999e-05 2024-09-10T06:27:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.290328+0000", 2024-09-10T06:27:06.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057935419999999996 2024-09-10T06:27:06.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.290474+0000", 2024-09-10T06:27:06.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014634500000000001 2024-09-10T06:27:06.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.290686+0000", 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021220599999999999 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.294993+0000", 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043067160000000004 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295116+0000", 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123416 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295190+0000", 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3325999999999996e-05 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295241+0000", 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1663000000000003e-05 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.248 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284582+0000", 2024-09-10T06:27:06.249 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.93709484, 2024-09-10T06:27:06.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013156691, 2024-09-10T06:27:06.249 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.249 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.249 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45 2024-09-10T06:27:06.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.249 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284582+0000", 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284582+0000", 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284584+0000", 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.443e-06 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284614+0000", 2024-09-10T06:27:06.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9839999999999999e-05 2024-09-10T06:27:06.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284633+0000", 2024-09-10T06:27:06.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9446e-05 2024-09-10T06:27:06.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284642+0000", 2024-09-10T06:27:06.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0899999999999994e-06 2024-09-10T06:27:06.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.291833+0000", 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071913380000000002 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.291959+0000", 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012549499999999999 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.292160+0000", 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020070900000000001 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295013+0000", 2024-09-10T06:27:06.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028534509999999999 2024-09-10T06:27:06.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297598+0000", 2024-09-10T06:27:06.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025848400000000001 2024-09-10T06:27:06.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297674+0000", 2024-09-10T06:27:06.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6515999999999997e-05 2024-09-10T06:27:06.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297739+0000", 2024-09-10T06:27:06.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4523000000000005e-05 2024-09-10T06:27:06.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.254 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.254 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.254 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284661+0000", 2024-09-10T06:27:06.254 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.937016460999999, 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015677505000000001, 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 46 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284661+0000", 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284661+0000", 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284662+0000", 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4e-07 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284668+0000", 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284681+0000", 2024-09-10T06:27:06.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3644e-05 2024-09-10T06:27:06.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284689+0000", 2024-09-10T06:27:06.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4159999999999998e-06 2024-09-10T06:27:06.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.292881+0000", 2024-09-10T06:27:06.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081926929999999992 2024-09-10T06:27:06.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.293129+0000", 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024731900000000002 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.293518+0000", 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038924700000000001 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297510+0000", 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039916220000000002 2024-09-10T06:27:06.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300194+0000", 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002684053 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300275+0000", 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1369e-05 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300338+0000", 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3225999999999994e-05 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.259 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.260 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.260 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.260 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284708+0000", 2024-09-10T06:27:06.260 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.936968815, 2024-09-10T06:27:06.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015911141, 2024-09-10T06:27:06.260 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.260 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.260 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.260 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.260 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.260 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.260 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47 2024-09-10T06:27:06.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.261 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284708+0000", 2024-09-10T06:27:06.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284708+0000", 2024-09-10T06:27:06.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284709+0000", 2024-09-10T06:27:06.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7400000000000003e-07 2024-09-10T06:27:06.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284790+0000", 2024-09-10T06:27:06.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1151999999999998e-05 2024-09-10T06:27:06.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284801+0000", 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.115e-05 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284809+0000", 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295333+0000", 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010523858000000001 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295456+0000", 2024-09-10T06:27:06.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123492 2024-09-10T06:27:06.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.295692+0000", 2024-09-10T06:27:06.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023550900000000001 2024-09-10T06:27:06.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298813+0000", 2024-09-10T06:27:06.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031209190000000002 2024-09-10T06:27:06.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300487+0000", 2024-09-10T06:27:06.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001673997 2024-09-10T06:27:06.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300564+0000", 2024-09-10T06:27:06.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7522999999999996e-05 2024-09-10T06:27:06.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300619+0000", 2024-09-10T06:27:06.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5189999999999998e-05 2024-09-10T06:27:06.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.936832526000003, 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015989453000000001, 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.266 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284845+0000", 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8400000000000003e-07 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284851+0000", 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.993e-06 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284873+0000", 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1319999999999999e-05 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284894+0000", 2024-09-10T06:27:06.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1265999999999999e-05 2024-09-10T06:27:06.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.296618+0000", 2024-09-10T06:27:06.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011724106 2024-09-10T06:27:06.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.296750+0000", 2024-09-10T06:27:06.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013185200000000001 2024-09-10T06:27:06.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.296946+0000", 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000195832 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300394+0000", 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034477570000000001 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300717+0000", 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032347399999999997 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300783+0000", 2024-09-10T06:27:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6093000000000006e-05 2024-09-10T06:27:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300834+0000", 2024-09-10T06:27:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0976000000000001e-05 2024-09-10T06:27:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.271 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.272 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284913+0000", 2024-09-10T06:27:06.272 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.936764539999999, 2024-09-10T06:27:06.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017983938000000001, 2024-09-10T06:27:06.272 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.272 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.272 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.272 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49 2024-09-10T06:27:06.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284913+0000", 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284913+0000", 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284914+0000", 2024-09-10T06:27:06.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300000000000001e-06 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284920+0000", 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5100000000000004e-06 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284931+0000", 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0857e-05 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284938+0000", 2024-09-10T06:27:06.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1130000000000003e-06 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.297873+0000", 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012934863 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298041+0000", 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016838899999999999 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298237+0000", 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019565199999999999 2024-09-10T06:27:06.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300859+0000", 2024-09-10T06:27:06.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026216099999999999 2024-09-10T06:27:06.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302759+0000", 2024-09-10T06:27:06.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019006819999999999 2024-09-10T06:27:06.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302835+0000", 2024-09-10T06:27:06.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5636000000000006e-05 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302897+0000", 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1595999999999998e-05 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.936722523, 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019245090999999999, 2024-09-10T06:27:06.277 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 50 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:27:06.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:27:06.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3e-07 2024-09-10T06:27:06.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285037+0000", 2024-09-10T06:27:06.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2008999999999994e-05 2024-09-10T06:27:06.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285049+0000", 2024-09-10T06:27:06.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1816e-05 2024-09-10T06:27:06.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285057+0000", 2024-09-10T06:27:06.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8639999999999996e-06 2024-09-10T06:27:06.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298896+0000", 2024-09-10T06:27:06.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013838743000000001 2024-09-10T06:27:06.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.299025+0000", 2024-09-10T06:27:06.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129352 2024-09-10T06:27:06.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.299222+0000", 2024-09-10T06:27:06.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019682200000000001 2024-09-10T06:27:06.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302676+0000", 2024-09-10T06:27:06.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00345371 2024-09-10T06:27:06.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304050+0000", 2024-09-10T06:27:06.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001374779 2024-09-10T06:27:06.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304135+0000", 2024-09-10T06:27:06.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4640000000000003e-05 2024-09-10T06:27:06.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304200+0000", 2024-09-10T06:27:06.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4626000000000001e-05 2024-09-10T06:27:06.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.283 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.284 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.284 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:27:06.284 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.936600274, 2024-09-10T06:27:06.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021819150999999998, 2024-09-10T06:27:06.284 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.284 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.284 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.284 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 51 2024-09-10T06:27:06.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.285 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:27:06.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:27:06.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285078+0000", 2024-09-10T06:27:06.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000001e-07 2024-09-10T06:27:06.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285083+0000", 2024-09-10T06:27:06.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6099999999999997e-06 2024-09-10T06:27:06.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285092+0000", 2024-09-10T06:27:06.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2399999999999996e-06 2024-09-10T06:27:06.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285100+0000", 2024-09-10T06:27:06.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8739999999999995e-06 2024-09-10T06:27:06.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300938+0000", 2024-09-10T06:27:06.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015837527000000001 2024-09-10T06:27:06.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301058+0000", 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012032300000000001 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301251+0000", 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192828 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302937+0000", 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016857339999999999 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306745+0000", 2024-09-10T06:27:06.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038078729999999998 2024-09-10T06:27:06.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306830+0000", 2024-09-10T06:27:06.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5432999999999993e-05 2024-09-10T06:27:06.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306896+0000", 2024-09-10T06:27:06.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5993000000000003e-05 2024-09-10T06:27:06.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.290 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.290 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.290 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:27:06.290 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.936560397999997, 2024-09-10T06:27:06.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021995553000000001, 2024-09-10T06:27:06.290 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.290 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.290 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.291 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 52 2024-09-10T06:27:06.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.291 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:27:06.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:27:06.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:27:06.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4000000000000001e-07 2024-09-10T06:27:06.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285123+0000", 2024-09-10T06:27:06.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6969999999999998e-06 2024-09-10T06:27:06.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285132+0000", 2024-09-10T06:27:06.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1560000000000001e-06 2024-09-10T06:27:06.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285139+0000", 2024-09-10T06:27:06.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1539999999999996e-06 2024-09-10T06:27:06.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301865+0000", 2024-09-10T06:27:06.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016725173999999999 2024-09-10T06:27:06.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301995+0000", 2024-09-10T06:27:06.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130739 2024-09-10T06:27:06.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302195+0000", 2024-09-10T06:27:06.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000199965 2024-09-10T06:27:06.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.303135+0000", 2024-09-10T06:27:06.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093978300000000002 2024-09-10T06:27:06.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306979+0000", 2024-09-10T06:27:06.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038437459999999999 2024-09-10T06:27:06.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307057+0000", 2024-09-10T06:27:06.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7766e-05 2024-09-10T06:27:06.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307112+0000", 2024-09-10T06:27:06.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5733000000000003e-05 2024-09-10T06:27:06.296 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.296 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.296 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.296 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.296 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529402+0000", 2024-09-10T06:27:06.297 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.692275090000003, 2024-09-10T06:27:06.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011777342, 2024-09-10T06:27:06.297 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.297 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.297 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.297 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 69 2024-09-10T06:27:06.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.297 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529402+0000", 2024-09-10T06:27:06.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529402+0000", 2024-09-10T06:27:06.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529403+0000", 2024-09-10T06:27:06.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0499999999999999e-06 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529550+0000", 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146549 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529564+0000", 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4572999999999999e-05 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529573+0000", 2024-09-10T06:27:06.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0429999999999996e-06 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532154+0000", 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025812209999999999 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532208+0000", 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3127000000000001e-05 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532301+0000", 2024-09-10T06:27:06.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3567999999999996e-05 2024-09-10T06:27:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533640+0000", 2024-09-10T06:27:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001338679 2024-09-10T06:27:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541107+0000", 2024-09-10T06:27:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074675660000000001 2024-09-10T06:27:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541144+0000", 2024-09-10T06:27:06.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6196999999999999e-05 2024-09-10T06:27:06.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541179+0000", 2024-09-10T06:27:06.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5769000000000003e-05 2024-09-10T06:27:06.302 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.302 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.302 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.302 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.302 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529592+0000", 2024-09-10T06:27:06.303 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.692085040999999, 2024-09-10T06:27:06.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011685376000000001, 2024-09-10T06:27:06.303 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.303 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.303 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.303 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.303 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.303 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.303 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 70 2024-09-10T06:27:06.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.303 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529592+0000", 2024-09-10T06:27:06.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529592+0000", 2024-09-10T06:27:06.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529593+0000", 2024-09-10T06:27:06.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9600000000000008e-07 2024-09-10T06:27:06.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529600+0000", 2024-09-10T06:27:06.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9870000000000002e-06 2024-09-10T06:27:06.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529610+0000", 2024-09-10T06:27:06.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9399999999999997e-06 2024-09-10T06:27:06.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529617+0000", 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2370000000000003e-06 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532907+0000", 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032897930000000001 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.532977+0000", 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0308999999999994e-05 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533073+0000", 2024-09-10T06:27:06.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5461e-05 2024-09-10T06:27:06.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536700+0000", 2024-09-10T06:27:06.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036268329999999999 2024-09-10T06:27:06.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541212+0000", 2024-09-10T06:27:06.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045119679999999999 2024-09-10T06:27:06.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541252+0000", 2024-09-10T06:27:06.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0472000000000001e-05 2024-09-10T06:27:06.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541277+0000", 2024-09-10T06:27:06.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5380000000000001e-05 2024-09-10T06:27:06.308 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.308 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.308 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.309 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.309 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529632+0000", 2024-09-10T06:27:06.309 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.692045317999998, 2024-09-10T06:27:06.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011740044999999999, 2024-09-10T06:27:06.309 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.309 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.309 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.309 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.309 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.309 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.309 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 71 2024-09-10T06:27:06.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.310 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529632+0000", 2024-09-10T06:27:06.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529632+0000", 2024-09-10T06:27:06.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529633+0000", 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9299999999999997e-07 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529638+0000", 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4559999999999999e-06 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529648+0000", 2024-09-10T06:27:06.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5170000000000005e-06 2024-09-10T06:27:06.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529654+0000", 2024-09-10T06:27:06.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6669999999999999e-06 2024-09-10T06:27:06.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533778+0000", 2024-09-10T06:27:06.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041238220000000001 2024-09-10T06:27:06.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533846+0000", 2024-09-10T06:27:06.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7448999999999997e-05 2024-09-10T06:27:06.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.533939+0000", 2024-09-10T06:27:06.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3721000000000006e-05 2024-09-10T06:27:06.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537278+0000", 2024-09-10T06:27:06.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033388580000000001 2024-09-10T06:27:06.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541309+0000", 2024-09-10T06:27:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040306389999999999 2024-09-10T06:27:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541348+0000", 2024-09-10T06:27:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9536000000000002e-05 2024-09-10T06:27:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541372+0000", 2024-09-10T06:27:06.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3587e-05 2024-09-10T06:27:06.315 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.315 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.315 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.315 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.315 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:27:06.315 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.692004429000001, 2024-09-10T06:27:06.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011791240999999999, 2024-09-10T06:27:06.315 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.315 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:27:06.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529673+0000", 2024-09-10T06:27:06.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8700000000000005e-07 2024-09-10T06:27:06.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529846+0000", 2024-09-10T06:27:06.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017278199999999999 2024-09-10T06:27:06.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529890+0000", 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3466e-05 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529903+0000", 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3327e-05 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.534254+0000", 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043508389999999996 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.534311+0000", 2024-09-10T06:27:06.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7405999999999999e-05 2024-09-10T06:27:06.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.534406+0000", 2024-09-10T06:27:06.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4671000000000002e-05 2024-09-10T06:27:06.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537284+0000", 2024-09-10T06:27:06.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002878027 2024-09-10T06:27:06.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541411+0000", 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041269790000000002 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541441+0000", 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0385000000000001e-05 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541464+0000", 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2671999999999999e-05 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.320 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.321 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.321 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.321 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.529930+0000", 2024-09-10T06:27:06.321 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.691747157999998, 2024-09-10T06:27:06.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011624766999999999, 2024-09-10T06:27:06.321 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.321 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.321 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 73 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529930+0000", 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529930+0000", 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529931+0000", 2024-09-10T06:27:06.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0470000000000001e-06 2024-09-10T06:27:06.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529938+0000", 2024-09-10T06:27:06.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0770000000000002e-06 2024-09-10T06:27:06.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529975+0000", 2024-09-10T06:27:06.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7366000000000001e-05 2024-09-10T06:27:06.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.529989+0000", 2024-09-10T06:27:06.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3617e-05 2024-09-10T06:27:06.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536230+0000", 2024-09-10T06:27:06.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062414089999999998 2024-09-10T06:27:06.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536286+0000", 2024-09-10T06:27:06.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5077999999999997e-05 2024-09-10T06:27:06.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536383+0000", 2024-09-10T06:27:06.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7656000000000001e-05 2024-09-10T06:27:06.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539732+0000", 2024-09-10T06:27:06.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003348635 2024-09-10T06:27:06.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541501+0000", 2024-09-10T06:27:06.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017696249999999999 2024-09-10T06:27:06.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541531+0000", 2024-09-10T06:27:06.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9057999999999999e-05 2024-09-10T06:27:06.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541555+0000", 2024-09-10T06:27:06.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4199e-05 2024-09-10T06:27:06.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.327 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.327 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.327 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.530006+0000", 2024-09-10T06:27:06.327 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.691671057999997, 2024-09-10T06:27:06.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011638819, 2024-09-10T06:27:06.327 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.327 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.327 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74 2024-09-10T06:27:06.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.328 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530006+0000", 2024-09-10T06:27:06.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530006+0000", 2024-09-10T06:27:06.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530007+0000", 2024-09-10T06:27:06.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0400000000000005e-07 2024-09-10T06:27:06.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530013+0000", 2024-09-10T06:27:06.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7459999999999997e-06 2024-09-10T06:27:06.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530023+0000", 2024-09-10T06:27:06.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.058e-05 2024-09-10T06:27:06.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530037+0000", 2024-09-10T06:27:06.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3380000000000001e-05 2024-09-10T06:27:06.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536855+0000", 2024-09-10T06:27:06.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006818419 2024-09-10T06:27:06.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.536910+0000", 2024-09-10T06:27:06.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5188000000000001e-05 2024-09-10T06:27:06.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537006+0000", 2024-09-10T06:27:06.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5622e-05 2024-09-10T06:27:06.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539737+0000", 2024-09-10T06:27:06.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027316060000000001 2024-09-10T06:27:06.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541593+0000", 2024-09-10T06:27:06.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018553879999999999 2024-09-10T06:27:06.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541623+0000", 2024-09-10T06:27:06.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0397999999999999e-05 2024-09-10T06:27:06.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541645+0000", 2024-09-10T06:27:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1688e-05 2024-09-10T06:27:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:27:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.691626528999997, 2024-09-10T06:27:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011680293, 2024-09-10T06:27:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.333 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 75 2024-09-10T06:27:06.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.334 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:27:06.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:27:06.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530051+0000", 2024-09-10T06:27:06.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4700000000000001e-07 2024-09-10T06:27:06.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530158+0000", 2024-09-10T06:27:06.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010655299999999999 2024-09-10T06:27:06.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530170+0000", 2024-09-10T06:27:06.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2403e-05 2024-09-10T06:27:06.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530178+0000", 2024-09-10T06:27:06.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5800000000000003e-06 2024-09-10T06:27:06.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537326+0000", 2024-09-10T06:27:06.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071483170000000004 2024-09-10T06:27:06.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537381+0000", 2024-09-10T06:27:06.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4666999999999997e-05 2024-09-10T06:27:06.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.537476+0000", 2024-09-10T06:27:06.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4813000000000002e-05 2024-09-10T06:27:06.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539753+0000", 2024-09-10T06:27:06.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022772410000000002 2024-09-10T06:27:06.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541675+0000", 2024-09-10T06:27:06.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001922586 2024-09-10T06:27:06.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541706+0000", 2024-09-10T06:27:06.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0210999999999999e-05 2024-09-10T06:27:06.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.541731+0000", 2024-09-10T06:27:06.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5275000000000001e-05 2024-09-10T06:27:06.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.339 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.340 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:27:06.340 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:27:06.340 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.691481553000003, 2024-09-10T06:27:06.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012563269, 2024-09-10T06:27:06.340 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:06.340 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:06.340 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:06.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:27:06.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:27:06.340 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 76 2024-09-10T06:27:06.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.341 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:06.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:06.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:27:06.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:06.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:27:06.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:06.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:06.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530196+0000", 2024-09-10T06:27:06.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7300000000000005e-07 2024-09-10T06:27:06.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:06.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530202+0000", 2024-09-10T06:27:06.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.57e-06 2024-09-10T06:27:06.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:06.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530211+0000", 2024-09-10T06:27:06.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4769999999999992e-06 2024-09-10T06:27:06.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.530222+0000", 2024-09-10T06:27:06.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0139999999999999e-05 2024-09-10T06:27:06.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:06.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539284+0000", 2024-09-10T06:27:06.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090626879999999993 2024-09-10T06:27:06.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:06.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539353+0000", 2024-09-10T06:27:06.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8397000000000003e-05 2024-09-10T06:27:06.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:06.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.539451+0000", 2024-09-10T06:27:06.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8621000000000003e-05 2024-09-10T06:27:06.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:06.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.540129+0000", 2024-09-10T06:27:06.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00067820900000000004 2024-09-10T06:27:06.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.542706+0000", 2024-09-10T06:27:06.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025768760000000001 2024-09-10T06:27:06.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:06.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.542736+0000", 2024-09-10T06:27:06.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0125e-05 2024-09-10T06:27:06.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:06.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:06.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:06.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.542759+0000", 2024-09-10T06:27:06.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2393000000000001e-05 2024-09-10T06:27:06.346 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.346 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.346 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.346 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:06.346 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:06.346 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:06.348 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:06.346+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:06.349 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:27:06.448 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:06.446+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:06.515 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:06.516 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:06.516 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:06.530 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:27:06.549 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:06.550+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:06.652 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:06.646+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:06.699 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:06.699 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:06.699 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:06.699 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:06.699 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:06.714 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:27:06.761 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:06.758+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:06.838 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:06.838 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:06.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:06.839 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:06.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.839 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:46 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'28, mlcod=16'22)", 2024-09-10T06:27:06.839 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:27:06.839 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.544956616999997, 2024-09-10T06:27:06.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042526789999999997, 2024-09-10T06:27:06.839 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.839 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.839 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.839 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:27:06.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:27:06.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293571+0000", 2024-09-10T06:27:06.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1119999999999999e-06 2024-09-10T06:27:06.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293577+0000", 2024-09-10T06:27:06.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2179999999999996e-06 2024-09-10T06:27:06.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293596+0000", 2024-09-10T06:27:06.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9170000000000001e-05 2024-09-10T06:27:06.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293605+0000", 2024-09-10T06:27:06.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4060000000000005e-06 2024-09-10T06:27:06.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293654+0000", 2024-09-10T06:27:06.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9116999999999997e-05 2024-09-10T06:27:06.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293671+0000", 2024-09-10T06:27:06.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7110999999999999e-05 2024-09-10T06:27:06.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.297783+0000", 2024-09-10T06:27:06.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041121409999999997 2024-09-10T06:27:06.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.297822+0000", 2024-09-10T06:27:06.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9403999999999997e-05 2024-09-10T06:27:06.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.843 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.844 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:50 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'26)", 2024-09-10T06:27:06.844 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:27:06.844 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.539168117999999, 2024-09-10T06:27:06.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042664490000000003, 2024-09-10T06:27:06.844 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.844 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.844 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.844 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:27:06.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:27:06.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299359+0000", 2024-09-10T06:27:06.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1100000000000004e-07 2024-09-10T06:27:06.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299425+0000", 2024-09-10T06:27:06.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5994999999999994e-05 2024-09-10T06:27:06.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299440+0000", 2024-09-10T06:27:06.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4552999999999999e-05 2024-09-10T06:27:06.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299448+0000", 2024-09-10T06:27:06.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7469999999999994e-06 2024-09-10T06:27:06.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299504+0000", 2024-09-10T06:27:06.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5257999999999998e-05 2024-09-10T06:27:06.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299518+0000", 2024-09-10T06:27:06.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4037e-05 2024-09-10T06:27:06.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.303578+0000", 2024-09-10T06:27:06.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040603439999999996 2024-09-10T06:27:06.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.303625+0000", 2024-09-10T06:27:06.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6604000000000003e-05 2024-09-10T06:27:06.848 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.848 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.848 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.849 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:51 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-10T06:27:06.849 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:27:06.849 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.537161537999999, 2024-09-10T06:27:06.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048711279999999997, 2024-09-10T06:27:06.849 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.849 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.849 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.849 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:27:06.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:27:06.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301366+0000", 2024-09-10T06:27:06.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079999999999999e-06 2024-09-10T06:27:06.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301400+0000", 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3816000000000003e-05 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301419+0000", 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9032e-05 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301427+0000", 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301475+0000", 2024-09-10T06:27:06.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8201999999999997e-05 2024-09-10T06:27:06.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301494+0000", 2024-09-10T06:27:06.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8791e-05 2024-09-10T06:27:06.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306182+0000", 2024-09-10T06:27:06.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046878379999999997 2024-09-10T06:27:06.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306236+0000", 2024-09-10T06:27:06.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3764999999999998e-05 2024-09-10T06:27:06.853 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.853 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.853 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.853 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:52 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'34, mlcod=16'29)", 2024-09-10T06:27:06.853 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:27:06.853 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.536172182999998, 2024-09-10T06:27:06.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039365659999999999, 2024-09-10T06:27:06.854 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.854 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.854 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.854 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:27:06.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:27:06.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302355+0000", 2024-09-10T06:27:06.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.009e-06 2024-09-10T06:27:06.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302373+0000", 2024-09-10T06:27:06.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8232000000000001e-05 2024-09-10T06:27:06.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302388+0000", 2024-09-10T06:27:06.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4246999999999999e-05 2024-09-10T06:27:06.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302400+0000", 2024-09-10T06:27:06.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2054e-05 2024-09-10T06:27:06.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302449+0000", 2024-09-10T06:27:06.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9119000000000002e-05 2024-09-10T06:27:06.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302461+0000", 2024-09-10T06:27:06.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2206e-05 2024-09-10T06:27:06.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306238+0000", 2024-09-10T06:27:06.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037773889999999999 2024-09-10T06:27:06.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306291+0000", 2024-09-10T06:27:06.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2309999999999999e-05 2024-09-10T06:27:06.858 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.858 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.858 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.858 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:55 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'37, mlcod=16'33)", 2024-09-10T06:27:06.858 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:27:06.858 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.527866482, 2024-09-10T06:27:06.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041116740000000001, 2024-09-10T06:27:06.858 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.858 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.858 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.859 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:27:06.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:27:06.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310661+0000", 2024-09-10T06:27:06.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3600000000000003e-07 2024-09-10T06:27:06.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310724+0000", 2024-09-10T06:27:06.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3706000000000003e-05 2024-09-10T06:27:06.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310734+0000", 2024-09-10T06:27:06.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0207000000000001e-05 2024-09-10T06:27:06.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310740+0000", 2024-09-10T06:27:06.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8760000000000002e-06 2024-09-10T06:27:06.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310796+0000", 2024-09-10T06:27:06.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6206999999999999e-05 2024-09-10T06:27:06.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310813+0000", 2024-09-10T06:27:06.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6385999999999999e-05 2024-09-10T06:27:06.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.314729+0000", 2024-09-10T06:27:06.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039157469999999998 2024-09-10T06:27:06.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.314771+0000", 2024-09-10T06:27:06.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2809000000000003e-05 2024-09-10T06:27:06.862 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.862 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.862 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.863 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'47, mlcod=16'41)", 2024-09-10T06:27:06.863 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:27:06.863 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.306129136000003, 2024-09-10T06:27:06.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0084590540000000006, 2024-09-10T06:27:06.863 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.863 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.863 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.863 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:27:06.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:27:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532398+0000", 2024-09-10T06:27:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599999999999999e-07 2024-09-10T06:27:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532437+0000", 2024-09-10T06:27:06.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8711000000000003e-05 2024-09-10T06:27:06.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532449+0000", 2024-09-10T06:27:06.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2075999999999999e-05 2024-09-10T06:27:06.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532455+0000", 2024-09-10T06:27:06.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2110000000000003e-06 2024-09-10T06:27:06.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533257+0000", 2024-09-10T06:27:06.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080233799999999999 2024-09-10T06:27:06.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533318+0000", 2024-09-10T06:27:06.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1033000000000003e-05 2024-09-10T06:27:06.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540718+0000", 2024-09-10T06:27:06.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073998529999999996 2024-09-10T06:27:06.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540856+0000", 2024-09-10T06:27:06.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013792599999999999 2024-09-10T06:27:06.867 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.867 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.867 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.867 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:70 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'48, mlcod=16'41)", 2024-09-10T06:27:06.867 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:27:06.867 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.305423120999997, 2024-09-10T06:27:06.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0078483679999999997, 2024-09-10T06:27:06.867 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.868 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.868 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.868 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:27:06.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:27:06.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533104+0000", 2024-09-10T06:27:06.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3799999999999997e-07 2024-09-10T06:27:06.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533109+0000", 2024-09-10T06:27:06.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1100000000000002e-06 2024-09-10T06:27:06.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533117+0000", 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7260000000000002e-06 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533125+0000", 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8170000000000005e-06 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534794+0000", 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016687760000000001 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534808+0000", 2024-09-10T06:27:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4293e-05 2024-09-10T06:27:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540863+0000", 2024-09-10T06:27:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060549549999999999 2024-09-10T06:27:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540951+0000", 2024-09-10T06:27:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8152999999999994e-05 2024-09-10T06:27:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.871 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:71 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'49, mlcod=16'44)", 2024-09-10T06:27:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:27:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.304549973, 2024-09-10T06:27:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070511530000000001, 2024-09-10T06:27:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:27:06.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:27:06.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533978+0000", 2024-09-10T06:27:06.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5799999999999999e-06 2024-09-10T06:27:06.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533987+0000", 2024-09-10T06:27:06.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4460000000000007e-06 2024-09-10T06:27:06.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534017+0000", 2024-09-10T06:27:06.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9524000000000001e-05 2024-09-10T06:27:06.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534027+0000", 2024-09-10T06:27:06.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0593e-05 2024-09-10T06:27:06.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535082+0000", 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001054609 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535095+0000", 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2870999999999999e-05 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540955+0000", 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058596270000000001 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541027+0000", 2024-09-10T06:27:06.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2903000000000003e-05 2024-09-10T06:27:06.876 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.876 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.876 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.876 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:72 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'50, mlcod=16'44)", 2024-09-10T06:27:06.876 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:27:06.876 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.303937810999997, 2024-09-10T06:27:06.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0065158799999999999, 2024-09-10T06:27:06.876 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.877 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.877 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.877 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:27:06.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:27:06.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534591+0000", 2024-09-10T06:27:06.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0729999999999999e-06 2024-09-10T06:27:06.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534722+0000", 2024-09-10T06:27:06.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013124299999999999 2024-09-10T06:27:06.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534746+0000", 2024-09-10T06:27:06.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3903000000000001e-05 2024-09-10T06:27:06.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534758+0000", 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2449000000000001e-05 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535408+0000", 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00064971199999999999 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535465+0000", 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6892999999999999e-05 2024-09-10T06:27:06.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541030+0000", 2024-09-10T06:27:06.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055649209999999996 2024-09-10T06:27:06.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541104+0000", 2024-09-10T06:27:06.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4685999999999996e-05 2024-09-10T06:27:06.880 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.880 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.880 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.881 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:73 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'51, mlcod=16'44)", 2024-09-10T06:27:06.881 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:27:06.881 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.302057488999999, 2024-09-10T06:27:06.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047149710000000001, 2024-09-10T06:27:06.881 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.881 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.881 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.881 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:27:06.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:27:06.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536471+0000", 2024-09-10T06:27:06.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.934e-06 2024-09-10T06:27:06.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536482+0000", 2024-09-10T06:27:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1542999999999999e-05 2024-09-10T06:27:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536511+0000", 2024-09-10T06:27:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8649999999999998e-05 2024-09-10T06:27:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536527+0000", 2024-09-10T06:27:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.649e-05 2024-09-10T06:27:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536776+0000", 2024-09-10T06:27:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024814800000000001 2024-09-10T06:27:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536811+0000", 2024-09-10T06:27:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5716000000000002e-05 2024-09-10T06:27:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541107+0000", 2024-09-10T06:27:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042952770000000001 2024-09-10T06:27:06.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541184+0000", 2024-09-10T06:27:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7212999999999994e-05 2024-09-10T06:27:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:74 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'52, mlcod=16'45)", 2024-09-10T06:27:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:27:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.301494916000003, 2024-09-10T06:27:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042018239999999998, 2024-09-10T06:27:06.885 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:27:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:27:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537033+0000", 2024-09-10T06:27:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.533e-06 2024-09-10T06:27:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537043+0000", 2024-09-10T06:27:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0000000000000001e-05 2024-09-10T06:27:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537062+0000", 2024-09-10T06:27:06.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8686999999999999e-05 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537072+0000", 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0746e-05 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537359+0000", 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000286908 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537415+0000", 2024-09-10T06:27:06.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5389000000000001e-05 2024-09-10T06:27:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541186+0000", 2024-09-10T06:27:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037710550000000002 2024-09-10T06:27:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541233+0000", 2024-09-10T06:27:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7506000000000002e-05 2024-09-10T06:27:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:75 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'53, mlcod=16'45)", 2024-09-10T06:27:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:27:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.300881177999997, 2024-09-10T06:27:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036309760000000002, 2024-09-10T06:27:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:27:06.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:27:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537647+0000", 2024-09-10T06:27:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8369999999999999e-06 2024-09-10T06:27:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537767+0000", 2024-09-10T06:27:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119826 2024-09-10T06:27:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537798+0000", 2024-09-10T06:27:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0775999999999998e-05 2024-09-10T06:27:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537811+0000", 2024-09-10T06:27:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.327e-05 2024-09-10T06:27:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.538148+0000", 2024-09-10T06:27:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033750799999999998 2024-09-10T06:27:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.538189+0000", 2024-09-10T06:27:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0713000000000001e-05 2024-09-10T06:27:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541238+0000", 2024-09-10T06:27:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030488500000000001 2024-09-10T06:27:06.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541276+0000", 2024-09-10T06:27:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8195999999999998e-05 2024-09-10T06:27:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:77 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'55, mlcod=16'53)", 2024-09-10T06:27:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:27:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.294709658000002, 2024-09-10T06:27:06.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041185240000000001, 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543818+0000", 2024-09-10T06:27:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8029999999999999e-06 2024-09-10T06:27:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543948+0000", 2024-09-10T06:27:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129369 2024-09-10T06:27:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543977+0000", 2024-09-10T06:27:06.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8813e-05 2024-09-10T06:27:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543989+0000", 2024-09-10T06:27:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2886e-05 2024-09-10T06:27:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544115+0000", 2024-09-10T06:27:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012526900000000001 2024-09-10T06:27:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544174+0000", 2024-09-10T06:27:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9166999999999998e-05 2024-09-10T06:27:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547867+0000", 2024-09-10T06:27:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036934340000000002 2024-09-10T06:27:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547935+0000", 2024-09-10T06:27:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7782999999999998e-05 2024-09-10T06:27:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.898 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:78 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'56, mlcod=16'53)", 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.294140957000003, 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035960359999999999, 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:27:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544386+0000", 2024-09-10T06:27:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1399999999999995e-07 2024-09-10T06:27:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544510+0000", 2024-09-10T06:27:06.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124265 2024-09-10T06:27:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544528+0000", 2024-09-10T06:27:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7706999999999998e-05 2024-09-10T06:27:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544538+0000", 2024-09-10T06:27:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7799999999999995e-06 2024-09-10T06:27:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545067+0000", 2024-09-10T06:27:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052855600000000001 2024-09-10T06:27:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545125+0000", 2024-09-10T06:27:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8313000000000002e-05 2024-09-10T06:27:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547942+0000", 2024-09-10T06:27:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028174749999999998 2024-09-10T06:27:06.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547981+0000", 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9026000000000002e-05 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:79 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'57, mlcod=16'53)", 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.293602237000002, 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044068620000000001, 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.903 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:27:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:27:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544925+0000", 2024-09-10T06:27:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8000000000000004e-07 2024-09-10T06:27:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545047+0000", 2024-09-10T06:27:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121779 2024-09-10T06:27:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545077+0000", 2024-09-10T06:27:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0463e-05 2024-09-10T06:27:06.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545087+0000", 2024-09-10T06:27:06.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0067e-05 2024-09-10T06:27:06.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.546104+0000", 2024-09-10T06:27:06.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001017088 2024-09-10T06:27:06.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.546157+0000", 2024-09-10T06:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2886000000000002e-05 2024-09-10T06:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549219+0000", 2024-09-10T06:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030620539999999998 2024-09-10T06:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549331+0000", 2024-09-10T06:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011164500000000001 2024-09-10T06:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.907 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.908 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:80 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'58, mlcod=16'53)", 2024-09-10T06:27:06.908 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:27:06.908 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.293004449000001, 2024-09-10T06:27:06.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042652369999999998, 2024-09-10T06:27:06.908 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.908 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.908 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.908 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:27:06.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:27:06.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545523+0000", 2024-09-10T06:27:06.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2399999999999997e-07 2024-09-10T06:27:06.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545646+0000", 2024-09-10T06:27:06.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123662 2024-09-10T06:27:06.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545664+0000", 2024-09-10T06:27:06.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8e-05 2024-09-10T06:27:06.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545673+0000", 2024-09-10T06:27:06.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9930000000000001e-06 2024-09-10T06:27:06.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547057+0000", 2024-09-10T06:27:06.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013834629999999999 2024-09-10T06:27:06.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547129+0000", 2024-09-10T06:27:06.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1759000000000002e-05 2024-09-10T06:27:06.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549724+0000", 2024-09-10T06:27:06.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002595834 2024-09-10T06:27:06.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549787+0000", 2024-09-10T06:27:06.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2701999999999997e-05 2024-09-10T06:27:06.912 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.912 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.913 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:06.913 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:27:06.913 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.536861127000002, 2024-09-10T06:27:06.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040313359999999999, 2024-09-10T06:27:06.913 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.913 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.913 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:06.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:06.913 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:06.914 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 206 2024-09-10T06:27:06.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.914 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:27:06.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:27:06.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301670+0000", 2024-09-10T06:27:06.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5669999999999996e-06 2024-09-10T06:27:06.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301690+0000", 2024-09-10T06:27:06.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0636999999999999e-05 2024-09-10T06:27:06.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301735+0000", 2024-09-10T06:27:06.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4298999999999997e-05 2024-09-10T06:27:06.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301759+0000", 2024-09-10T06:27:06.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4769999999999998e-05 2024-09-10T06:27:06.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301938+0000", 2024-09-10T06:27:06.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017901899999999999 2024-09-10T06:27:06.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.302305+0000", 2024-09-10T06:27:06.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036679699999999998 2024-09-10T06:27:06.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:06.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.303069+0000", 2024-09-10T06:27:06.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076360999999999996 2024-09-10T06:27:06.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:06.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.304549+0000", 2024-09-10T06:27:06.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014798229999999999 2024-09-10T06:27:06.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305530+0000", 2024-09-10T06:27:06.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098141200000000008 2024-09-10T06:27:06.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305610+0000", 2024-09-10T06:27:06.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9785999999999998e-05 2024-09-10T06:27:06.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305696+0000", 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6615999999999999e-05 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.514256515, 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0081512240000000003, 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:06.919 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 210 2024-09-10T06:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324273+0000", 2024-09-10T06:27:06.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1240000000000001e-06 2024-09-10T06:27:06.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324285+0000", 2024-09-10T06:27:06.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2463000000000001e-05 2024-09-10T06:27:06.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324319+0000", 2024-09-10T06:27:06.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3309999999999998e-05 2024-09-10T06:27:06.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324342+0000", 2024-09-10T06:27:06.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3672999999999998e-05 2024-09-10T06:27:06.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324476+0000", 2024-09-10T06:27:06.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013378199999999999 2024-09-10T06:27:06.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324489+0000", 2024-09-10T06:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3127e-05 2024-09-10T06:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.328893+0000", 2024-09-10T06:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044040190000000003 2024-09-10T06:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.329211+0000", 2024-09-10T06:27:06.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031762799999999998 2024-09-10T06:27:06.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:06.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.329880+0000", 2024-09-10T06:27:06.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066933800000000001 2024-09-10T06:27:06.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:06.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.331727+0000", 2024-09-10T06:27:06.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018466120000000001 2024-09-10T06:27:06.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332287+0000", 2024-09-10T06:27:06.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056016599999999996 2024-09-10T06:27:06.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332363+0000", 2024-09-10T06:27:06.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5748999999999996e-05 2024-09-10T06:27:06.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332421+0000", 2024-09-10T06:27:06.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8233000000000003e-05 2024-09-10T06:27:06.925 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.925 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.926 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.926 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:469 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:06.926 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:27:06.926 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.339405596999999, 2024-09-10T06:27:06.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0056131189999999997, 2024-09-10T06:27:06.926 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.926 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.926 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:06.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:06.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:06.926 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 469 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:27:06.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8400000000000003e-07 2024-09-10T06:27:06.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499125+0000", 2024-09-10T06:27:06.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.692e-06 2024-09-10T06:27:06.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499135+0000", 2024-09-10T06:27:06.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5310000000000007e-06 2024-09-10T06:27:06.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499140+0000", 2024-09-10T06:27:06.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9640000000000002e-06 2024-09-10T06:27:06.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499200+0000", 2024-09-10T06:27:06.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0874e-05 2024-09-10T06:27:06.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499303+0000", 2024-09-10T06:27:06.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102395 2024-09-10T06:27:06.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:06.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499518+0000", 2024-09-10T06:27:06.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021481500000000001 2024-09-10T06:27:06.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:06.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.500112+0000", 2024-09-10T06:27:06.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059408699999999998 2024-09-10T06:27:06.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504614+0000", 2024-09-10T06:27:06.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045017859999999998 2024-09-10T06:27:06.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504688+0000", 2024-09-10T06:27:06.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4528000000000002e-05 2024-09-10T06:27:06.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504734+0000", 2024-09-10T06:27:06.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5663e-05 2024-09-10T06:27:06.931 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.931 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.931 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.932 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:621 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:06.932 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:27:06.932 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.234175535999999, 2024-09-10T06:27:06.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039399250000000004, 2024-09-10T06:27:06.932 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:06.932 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:06.932 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:06.932 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:06.932 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:06.932 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:06.932 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 621 2024-09-10T06:27:06.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.933 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:06.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:06.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:27:06.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:06.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:27:06.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:06.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:06.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604353+0000", 2024-09-10T06:27:06.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.537e-06 2024-09-10T06:27:06.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:06.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604364+0000", 2024-09-10T06:27:06.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0923e-05 2024-09-10T06:27:06.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:06.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604394+0000", 2024-09-10T06:27:06.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0176999999999999e-05 2024-09-10T06:27:06.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:06.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604409+0000", 2024-09-10T06:27:06.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4666e-05 2024-09-10T06:27:06.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:06.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604505+0000", 2024-09-10T06:27:06.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5914000000000004e-05 2024-09-10T06:27:06.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:06.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604588+0000", 2024-09-10T06:27:06.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3127999999999994e-05 2024-09-10T06:27:06.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:06.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604709+0000", 2024-09-10T06:27:06.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121344 2024-09-10T06:27:06.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:06.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.605312+0000", 2024-09-10T06:27:06.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00060259599999999995 2024-09-10T06:27:06.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:06.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608229+0000", 2024-09-10T06:27:06.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029169600000000001 2024-09-10T06:27:06.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:06.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608264+0000", 2024-09-10T06:27:06.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4756999999999999e-05 2024-09-10T06:27:06.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:06.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:06.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:06.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608291+0000", 2024-09-10T06:27:06.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6923e-05 2024-09-10T06:27:06.937 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.937 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.937 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.938 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:06.938 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:06.938 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:06.939 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:27:06.940 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:06.934+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:07.040 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:07.038+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:07.108 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:07.108 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:07.108 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:07.108 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:07.122 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:27:07.165 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:07.162+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:07.243 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:07.238+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:07.285 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:07.286 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:07.286 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:07.286 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:07.286 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:07.300 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:27:07.344 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:07.342+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:07.445 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:07.442+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:07.463 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:07.464 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:07.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:07.464 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:07.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.464 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:07.464 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:07.464 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 33.187590415000003, 2024-09-10T06:27:07.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069538480000000003, 2024-09-10T06:27:07.464 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.464 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.464 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-10T06:27:07.465 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.465 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:07.465 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:07.465 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2 2024-09-10T06:27:07.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.465 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:07.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:07.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275742+0000", 2024-09-10T06:27:07.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7460000000000001e-06 2024-09-10T06:27:07.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275751+0000", 2024-09-10T06:27:07.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3979999999999999e-06 2024-09-10T06:27:07.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275769+0000", 2024-09-10T06:27:07.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8637000000000001e-05 2024-09-10T06:27:07.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275784+0000", 2024-09-10T06:27:07.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4518000000000001e-05 2024-09-10T06:27:07.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275905+0000", 2024-09-10T06:27:07.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012092899999999999 2024-09-10T06:27:07.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-10T06:27:07.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275920+0000", 2024-09-10T06:27:07.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5325999999999999e-05 2024-09-10T06:27:07.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282541+0000", 2024-09-10T06:27:07.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066208400000000002 2024-09-10T06:27:07.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282693+0000", 2024-09-10T06:27:07.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152454 2024-09-10T06:27:07.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.470 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.470 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:07.470 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:07.470 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.050761854000001, 2024-09-10T06:27:07.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029204980000000001, 2024-09-10T06:27:07.470 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.470 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.470 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.470 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 193 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412570+0000", 2024-09-10T06:27:07.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4530000000000001e-06 2024-09-10T06:27:07.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412582+0000", 2024-09-10T06:27:07.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1524e-05 2024-09-10T06:27:07.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412612+0000", 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0436000000000001e-05 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412627+0000", 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4306e-05 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412723+0000", 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6075000000000004e-05 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412831+0000", 2024-09-10T06:27:07.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108453 2024-09-10T06:27:07.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412972+0000", 2024-09-10T06:27:07.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141225 2024-09-10T06:27:07.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.414147+0000", 2024-09-10T06:27:07.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174989 2024-09-10T06:27:07.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415334+0000", 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415420+0000", 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6009999999999998e-05 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415489+0000", 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8403000000000002e-05 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.475 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.476 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.476 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:07.476 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.153278212, 2024-09-10T06:27:07.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092944310000000006, 2024-09-10T06:27:07.476 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.476 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.476 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.476 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.476 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.476 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.477 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 208 2024-09-10T06:27:07.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.477 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:07.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:07.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310055+0000", 2024-09-10T06:27:07.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-10T06:27:07.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310066+0000", 2024-09-10T06:27:07.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1739999999999999e-05 2024-09-10T06:27:07.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310096+0000", 2024-09-10T06:27:07.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0159e-05 2024-09-10T06:27:07.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310111+0000", 2024-09-10T06:27:07.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5007e-05 2024-09-10T06:27:07.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310235+0000", 2024-09-10T06:27:07.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123132 2024-09-10T06:27:07.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:27:07.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310246+0000", 2024-09-10T06:27:07.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1487e-05 2024-09-10T06:27:07.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315594+0000", 2024-09-10T06:27:07.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005347592 2024-09-10T06:27:07.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315932+0000", 2024-09-10T06:27:07.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033789099999999999 2024-09-10T06:27:07.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.316549+0000", 2024-09-10T06:27:07.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061698099999999995 2024-09-10T06:27:07.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.317898+0000", 2024-09-10T06:27:07.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013498799999999999 2024-09-10T06:27:07.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319207+0000", 2024-09-10T06:27:07.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013086969999999999 2024-09-10T06:27:07.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319289+0000", 2024-09-10T06:27:07.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2259e-05 2024-09-10T06:27:07.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319346+0000", 2024-09-10T06:27:07.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6675999999999997e-05 2024-09-10T06:27:07.482 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.482 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.482 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.126941489, 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003262778, 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 212 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:07.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:07.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336391+0000", 2024-09-10T06:27:07.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5770000000000001e-06 2024-09-10T06:27:07.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336403+0000", 2024-09-10T06:27:07.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2286000000000001e-05 2024-09-10T06:27:07.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336425+0000", 2024-09-10T06:27:07.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2164e-05 2024-09-10T06:27:07.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336440+0000", 2024-09-10T06:27:07.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4222999999999999e-05 2024-09-10T06:27:07.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336621+0000", 2024-09-10T06:27:07.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018136500000000001 2024-09-10T06:27:07.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336830+0000", 2024-09-10T06:27:07.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209125 2024-09-10T06:27:07.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.337206+0000", 2024-09-10T06:27:07.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037553700000000001 2024-09-10T06:27:07.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.338527+0000", 2024-09-10T06:27:07.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00132142 2024-09-10T06:27:07.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339502+0000", 2024-09-10T06:27:07.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00097512599999999999 2024-09-10T06:27:07.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339585+0000", 2024-09-10T06:27:07.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2466000000000006e-05 2024-09-10T06:27:07.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339651+0000", 2024-09-10T06:27:07.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6489000000000007e-05 2024-09-10T06:27:07.489 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.489 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.489 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.489 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.489 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:07.489 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.102627949999999, 2024-09-10T06:27:07.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032440849999999999, 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 219 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360705+0000", 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.593e-06 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360716+0000", 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1717e-05 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360746+0000", 2024-09-10T06:27:07.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0233e-05 2024-09-10T06:27:07.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360761+0000", 2024-09-10T06:27:07.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4593000000000001e-05 2024-09-10T06:27:07.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360873+0000", 2024-09-10T06:27:07.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111809 2024-09-10T06:27:07.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361105+0000", 2024-09-10T06:27:07.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023171800000000001 2024-09-10T06:27:07.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361523+0000", 2024-09-10T06:27:07.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000418694 2024-09-10T06:27:07.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.362840+0000", 2024-09-10T06:27:07.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013165570000000001 2024-09-10T06:27:07.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363793+0000", 2024-09-10T06:27:07.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095323200000000004 2024-09-10T06:27:07.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363880+0000", 2024-09-10T06:27:07.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6689999999999998e-05 2024-09-10T06:27:07.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363946+0000", 2024-09-10T06:27:07.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6248999999999995e-05 2024-09-10T06:27:07.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.495 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.495 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.495 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:07.495 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.085361097, 2024-09-10T06:27:07.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003271422, 2024-09-10T06:27:07.495 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.495 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.495 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.495 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.496 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.496 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.496 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 224 2024-09-10T06:27:07.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.496 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:07.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:07.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377971+0000", 2024-09-10T06:27:07.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:07.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377983+0000", 2024-09-10T06:27:07.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1517e-05 2024-09-10T06:27:07.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378013+0000", 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0476000000000001e-05 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378028+0000", 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5173e-05 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378134+0000", 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010533 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378346+0000", 2024-09-10T06:27:07.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021175499999999999 2024-09-10T06:27:07.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378787+0000", 2024-09-10T06:27:07.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044190899999999999 2024-09-10T06:27:07.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.380237+0000", 2024-09-10T06:27:07.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001449093 2024-09-10T06:27:07.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381097+0000", 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086022300000000002 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381181+0000", 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3973000000000004e-05 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381240+0000", 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9472999999999998e-05 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.500 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.501 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.501 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:07.501 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.053693643999999, 2024-09-10T06:27:07.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031998719999999999, 2024-09-10T06:27:07.501 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.501 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.501 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.501 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 233 2024-09-10T06:27:07.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.502 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:07.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:07.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409639+0000", 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4770000000000002e-06 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409652+0000", 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3692999999999999e-05 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409683+0000", 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1080000000000001e-05 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409699+0000", 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5245999999999999e-05 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409881+0000", 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000182709 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410088+0000", 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020630799999999999 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410495+0000", 2024-09-10T06:27:07.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00040682700000000001 2024-09-10T06:27:07.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.411805+0000", 2024-09-10T06:27:07.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013101059999999999 2024-09-10T06:27:07.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412672+0000", 2024-09-10T06:27:07.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086778699999999996 2024-09-10T06:27:07.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412769+0000", 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6565999999999997e-05 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412836+0000", 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7073e-05 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:353 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:07.506 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.012786330000001, 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059710450000000003, 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 353 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:07.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450545+0000", 2024-09-10T06:27:07.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.423e-06 2024-09-10T06:27:07.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450551+0000", 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7370000000000003e-06 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450565+0000", 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4649e-05 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450574+0000", 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5129999999999996e-06 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450644+0000", 2024-09-10T06:27:07.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0387000000000002e-05 2024-09-10T06:27:07.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450818+0000", 2024-09-10T06:27:07.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017368400000000001 2024-09-10T06:27:07.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451030+0000", 2024-09-10T06:27:07.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021189599999999999 2024-09-10T06:27:07.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451607+0000", 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057672599999999995 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456437+0000", 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048301940000000003 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456472+0000", 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5178000000000001e-05 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456515+0000", 2024-09-10T06:27:07.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2657999999999997e-05 2024-09-10T06:27:07.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.512 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.512 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:362 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.512 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:07.512 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.006338807999999, 2024-09-10T06:27:07.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044032239999999999, 2024-09-10T06:27:07.512 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.512 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.512 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.513 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 362 2024-09-10T06:27:07.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.513 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:07.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:07.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456992+0000", 2024-09-10T06:27:07.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6700000000000002e-07 2024-09-10T06:27:07.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456997+0000", 2024-09-10T06:27:07.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6249999999999998e-06 2024-09-10T06:27:07.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457005+0000", 2024-09-10T06:27:07.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6719999999999993e-06 2024-09-10T06:27:07.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457010+0000", 2024-09-10T06:27:07.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7360000000000001e-06 2024-09-10T06:27:07.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457054+0000", 2024-09-10T06:27:07.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4138999999999999e-05 2024-09-10T06:27:07.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457163+0000", 2024-09-10T06:27:07.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108558 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457340+0000", 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017730600000000001 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.458065+0000", 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00072480400000000001 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461294+0000", 2024-09-10T06:27:07.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032287890000000001 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461352+0000", 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8502000000000003e-05 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461394+0000", 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2225999999999999e-05 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:475 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.960489243000001, 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046091930000000001, 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 475 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:07.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:07.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:07.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6100000000000001e-07 2024-09-10T06:27:07.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502844+0000", 2024-09-10T06:27:07.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0529999999999998e-06 2024-09-10T06:27:07.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502852+0000", 2024-09-10T06:27:07.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2579999999999995e-06 2024-09-10T06:27:07.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502857+0000", 2024-09-10T06:27:07.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3460000000000004e-06 2024-09-10T06:27:07.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502894+0000", 2024-09-10T06:27:07.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6884000000000001e-05 2024-09-10T06:27:07.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502942+0000", 2024-09-10T06:27:07.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7791999999999999e-05 2024-09-10T06:27:07.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.503048+0000", 2024-09-10T06:27:07.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010678799999999999 2024-09-10T06:27:07.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.506079+0000", 2024-09-10T06:27:07.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030311510000000002 2024-09-10T06:27:07.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507361+0000", 2024-09-10T06:27:07.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001281208 2024-09-10T06:27:07.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507400+0000", 2024-09-10T06:27:07.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9483000000000001e-05 2024-09-10T06:27:07.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507450+0000", 2024-09-10T06:27:07.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9669000000000002e-05 2024-09-10T06:27:07.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.524 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.525 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:477 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.525 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:07.525 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.958528126000001, 2024-09-10T06:27:07.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038544, 2024-09-10T06:27:07.525 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.525 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.525 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.525 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 477 2024-09-10T06:27:07.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.526 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:07.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:07.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504803+0000", 2024-09-10T06:27:07.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9999999999999996e-07 2024-09-10T06:27:07.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504808+0000", 2024-09-10T06:27:07.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1909999999999999e-06 2024-09-10T06:27:07.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504818+0000", 2024-09-10T06:27:07.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0081999999999999e-05 2024-09-10T06:27:07.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504823+0000", 2024-09-10T06:27:07.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9969999999999998e-06 2024-09-10T06:27:07.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504870+0000", 2024-09-10T06:27:07.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6980000000000001e-05 2024-09-10T06:27:07.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504922+0000", 2024-09-10T06:27:07.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869000000000001e-05 2024-09-10T06:27:07.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505020+0000", 2024-09-10T06:27:07.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8010999999999994e-05 2024-09-10T06:27:07.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507789+0000", 2024-09-10T06:27:07.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027690219999999999 2024-09-10T06:27:07.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508599+0000", 2024-09-10T06:27:07.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081037800000000005 2024-09-10T06:27:07.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508631+0000", 2024-09-10T06:27:07.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.137e-05 2024-09-10T06:27:07.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508656+0000", 2024-09-10T06:27:07.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5599999999999999e-05 2024-09-10T06:27:07.530 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.531 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.531 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.531 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:478 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.531 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:07.531 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.958481224, 2024-09-10T06:27:07.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039361880000000002, 2024-09-10T06:27:07.531 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.531 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.531 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.532 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 478 2024-09-10T06:27:07.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.532 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:07.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:07.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:07.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7800000000000001e-07 2024-09-10T06:27:07.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504853+0000", 2024-09-10T06:27:07.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2780000000000002e-06 2024-09-10T06:27:07.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504858+0000", 2024-09-10T06:27:07.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7359999999999998e-06 2024-09-10T06:27:07.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504862+0000", 2024-09-10T06:27:07.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6650000000000001e-06 2024-09-10T06:27:07.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504938+0000", 2024-09-10T06:27:07.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6286999999999997e-05 2024-09-10T06:27:07.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505091+0000", 2024-09-10T06:27:07.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152385 2024-09-10T06:27:07.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:07.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505335+0000", 2024-09-10T06:27:07.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244281 2024-09-10T06:27:07.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507764+0000", 2024-09-10T06:27:07.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002429624 2024-09-10T06:27:07.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508681+0000", 2024-09-10T06:27:07.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00091630100000000001 2024-09-10T06:27:07.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508747+0000", 2024-09-10T06:27:07.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5733000000000002e-05 2024-09-10T06:27:07.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508785+0000", 2024-09-10T06:27:07.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8319999999999999e-05 2024-09-10T06:27:07.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.536 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.537 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.537 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:07.537 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.712349304, 2024-09-10T06:27:07.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030732350000000001, 2024-09-10T06:27:07.537 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.537 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.537 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.537 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 733 2024-09-10T06:27:07.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.538 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:07.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:07.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750983+0000", 2024-09-10T06:27:07.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8880000000000001e-06 2024-09-10T06:27:07.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750996+0000", 2024-09-10T06:27:07.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2048999999999999e-05 2024-09-10T06:27:07.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751024+0000", 2024-09-10T06:27:07.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8802e-05 2024-09-10T06:27:07.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751043+0000", 2024-09-10T06:27:07.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8266000000000001e-05 2024-09-10T06:27:07.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751191+0000", 2024-09-10T06:27:07.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014818200000000001 2024-09-10T06:27:07.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751417+0000", 2024-09-10T06:27:07.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022648199999999999 2024-09-10T06:27:07.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751747+0000", 2024-09-10T06:27:07.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032945000000000001 2024-09-10T06:27:07.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.752752+0000", 2024-09-10T06:27:07.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010054790000000001 2024-09-10T06:27:07.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753896+0000", 2024-09-10T06:27:07.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001143638 2024-09-10T06:27:07.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753989+0000", 2024-09-10T06:27:07.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3466000000000003e-05 2024-09-10T06:27:07.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.754054+0000", 2024-09-10T06:27:07.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4533e-05 2024-09-10T06:27:07.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.543 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.543 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.544 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.544 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:07.544 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.671868757999999, 2024-09-10T06:27:07.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002896722, 2024-09-10T06:27:07.544 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.544 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.544 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.544 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.544 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.544 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.544 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 751 2024-09-10T06:27:07.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.544 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:07.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:07.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791464+0000", 2024-09-10T06:27:07.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7140000000000002e-06 2024-09-10T06:27:07.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791475+0000", 2024-09-10T06:27:07.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1535999999999999e-05 2024-09-10T06:27:07.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791501+0000", 2024-09-10T06:27:07.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5276e-05 2024-09-10T06:27:07.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791514+0000", 2024-09-10T06:27:07.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3203e-05 2024-09-10T06:27:07.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791643+0000", 2024-09-10T06:27:07.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012961900000000001 2024-09-10T06:27:07.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791857+0000", 2024-09-10T06:27:07.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021351599999999999 2024-09-10T06:27:07.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.792178+0000", 2024-09-10T06:27:07.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032090999999999999 2024-09-10T06:27:07.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.793281+0000", 2024-09-10T06:27:07.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001103319 2024-09-10T06:27:07.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794209+0000", 2024-09-10T06:27:07.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000927676 2024-09-10T06:27:07.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794295+0000", 2024-09-10T06:27:07.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5682999999999999e-05 2024-09-10T06:27:07.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794358+0000", 2024-09-10T06:27:07.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3269999999999996e-05 2024-09-10T06:27:07.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.550 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.550 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.550 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:07.550 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.667981261000001, 2024-09-10T06:27:07.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030558059999999999, 2024-09-10T06:27:07.550 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.550 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.550 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.550 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 753 2024-09-10T06:27:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:07.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795352+0000", 2024-09-10T06:27:07.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0130000000000002e-06 2024-09-10T06:27:07.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795364+0000", 2024-09-10T06:27:07.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1939999999999999e-05 2024-09-10T06:27:07.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795395+0000", 2024-09-10T06:27:07.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0976999999999998e-05 2024-09-10T06:27:07.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795413+0000", 2024-09-10T06:27:07.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7980000000000001e-05 2024-09-10T06:27:07.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795533+0000", 2024-09-10T06:27:07.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120732 2024-09-10T06:27:07.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795665+0000", 2024-09-10T06:27:07.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013215899999999999 2024-09-10T06:27:07.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795931+0000", 2024-09-10T06:27:07.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026536499999999999 2024-09-10T06:27:07.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.796995+0000", 2024-09-10T06:27:07.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001064611 2024-09-10T06:27:07.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798256+0000", 2024-09-10T06:27:07.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00126022 2024-09-10T06:27:07.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798340+0000", 2024-09-10T06:27:07.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4753000000000007e-05 2024-09-10T06:27:07.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798404+0000", 2024-09-10T06:27:07.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4055999999999998e-05 2024-09-10T06:27:07.556 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.556 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.556 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.556 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.556 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:07.556 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.55277302, 2024-09-10T06:27:07.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031632380000000001, 2024-09-10T06:27:07.556 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.556 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.556 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 805 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:07.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910560+0000", 2024-09-10T06:27:07.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2200000000000001e-06 2024-09-10T06:27:07.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910574+0000", 2024-09-10T06:27:07.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3536000000000001e-05 2024-09-10T06:27:07.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910604+0000", 2024-09-10T06:27:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0645999999999998e-05 2024-09-10T06:27:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910619+0000", 2024-09-10T06:27:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5064e-05 2024-09-10T06:27:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910759+0000", 2024-09-10T06:27:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013943899999999999 2024-09-10T06:27:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910984+0000", 2024-09-10T06:27:07.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000225381 2024-09-10T06:27:07.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.911312+0000", 2024-09-10T06:27:07.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032782800000000001 2024-09-10T06:27:07.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.912402+0000", 2024-09-10T06:27:07.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010895639999999999 2024-09-10T06:27:07.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913576+0000", 2024-09-10T06:27:07.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174591 2024-09-10T06:27:07.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913657+0000", 2024-09-10T06:27:07.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1223000000000005e-05 2024-09-10T06:27:07.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913720+0000", 2024-09-10T06:27:07.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2745999999999999e-05 2024-09-10T06:27:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.492995284999999, 2024-09-10T06:27:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030680099999999999, 2024-09-10T06:27:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.562 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 832 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970337+0000", 2024-09-10T06:27:07.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6230000000000001e-06 2024-09-10T06:27:07.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970349+0000", 2024-09-10T06:27:07.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1557e-05 2024-09-10T06:27:07.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970379+0000", 2024-09-10T06:27:07.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0456000000000001e-05 2024-09-10T06:27:07.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970394+0000", 2024-09-10T06:27:07.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4683e-05 2024-09-10T06:27:07.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970509+0000", 2024-09-10T06:27:07.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114613 2024-09-10T06:27:07.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970753+0000", 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244295 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.971078+0000", 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000325583 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.972162+0000", 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010834519999999999 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973200+0000", 2024-09-10T06:27:07.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010376560000000001 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973287+0000", 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7163000000000006e-05 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973403+0000", 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011592899999999999 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.567 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.568 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:07.568 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.337924057999999, 2024-09-10T06:27:07.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030018599999999999, 2024-09-10T06:27:07.568 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.568 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.568 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.568 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.568 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.568 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.568 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 901 2024-09-10T06:27:07.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.568 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125409+0000", 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.253e-06 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125425+0000", 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5636000000000001e-05 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125456+0000", 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1130000000000002e-05 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125470+0000", 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.464e-05 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.570 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125581+0000", 2024-09-10T06:27:07.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110612 2024-09-10T06:27:07.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125814+0000", 2024-09-10T06:27:07.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023266899999999999 2024-09-10T06:27:07.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.126159+0000", 2024-09-10T06:27:07.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034565399999999998 2024-09-10T06:27:07.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.127161+0000", 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010020890000000001 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128202+0000", 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001040242 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128288+0000", 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6156000000000007e-05 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128408+0000", 2024-09-10T06:27:07.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011977900000000001 2024-09-10T06:27:07.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.573 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.573 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.573 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.573 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:07.573 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.303831688999999, 2024-09-10T06:27:07.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029016649999999999, 2024-09-10T06:27:07.573 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.573 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.573 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.574 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.574 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 916 2024-09-10T06:27:07.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.574 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:07.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159501+0000", 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159512+0000", 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1564e-05 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.575 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159543+0000", 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0942999999999998e-05 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159558+0000", 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.436e-05 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159701+0000", 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014363599999999999 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159927+0000", 2024-09-10T06:27:07.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022535099999999999 2024-09-10T06:27:07.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.160260+0000", 2024-09-10T06:27:07.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033321700000000002 2024-09-10T06:27:07.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.161312+0000", 2024-09-10T06:27:07.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001052222 2024-09-10T06:27:07.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162261+0000", 2024-09-10T06:27:07.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00094912600000000001 2024-09-10T06:27:07.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162337+0000", 2024-09-10T06:27:07.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6268999999999998e-05 2024-09-10T06:27:07.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162400+0000", 2024-09-10T06:27:07.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2477000000000005e-05 2024-09-10T06:27:07.578 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.578 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.233522178000001, 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030045179999999999, 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 946 2024-09-10T06:27:07.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229810+0000", 2024-09-10T06:27:07.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229838+0000", 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7776e-05 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229869+0000", 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0766999999999999e-05 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229883+0000", 2024-09-10T06:27:07.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4423000000000001e-05 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230005+0000", 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121919 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230219+0000", 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000214098 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230588+0000", 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036857099999999999 2024-09-10T06:27:07.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.231707+0000", 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011193349999999999 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232662+0000", 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095513300000000005 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232748+0000", 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6151999999999998e-05 2024-09-10T06:27:07.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232812+0000", 2024-09-10T06:27:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3876999999999998e-05 2024-09-10T06:27:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:07.584 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:07.584 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:07.585 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:27:07.586 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:07.582+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:07.608 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T06:27:07.686 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:07.682+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:07.748 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:07.749 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:07.749 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:07.749 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:07.763 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:27:07.787 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:07.786+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:07.876 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:07.876 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:07.876 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:07.876 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:07.877 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:07.887 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:27:07.888 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:07.886+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:07.989 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:07.986+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:08.007 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:08.007 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:08.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:08.007 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:08.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.007 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4236.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T06:27:08.007 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:08.007 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.496815453000004, 2024-09-10T06:27:08.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049682550000000004, 2024-09-10T06:27:08.008 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.008 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.008 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.008 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:08.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:08.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507427+0000", 2024-09-10T06:27:08.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5629999999999999e-06 2024-09-10T06:27:08.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507439+0000", 2024-09-10T06:27:08.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.19e-05 2024-09-10T06:27:08.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507460+0000", 2024-09-10T06:27:08.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1693000000000001e-05 2024-09-10T06:27:08.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507480+0000", 2024-09-10T06:27:08.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9947000000000001e-05 2024-09-10T06:27:08.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507613+0000", 2024-09-10T06:27:08.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000132409 2024-09-10T06:27:08.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507696+0000", 2024-09-10T06:27:08.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2953000000000004e-05 2024-09-10T06:27:08.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512288+0000", 2024-09-10T06:27:08.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045927110000000002 2024-09-10T06:27:08.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512393+0000", 2024-09-10T06:27:08.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105079 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 33.673351421, 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025692739999999999, 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:08.012 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 42 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330891+0000", 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9700000000000002e-06 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330901+0000", 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2909999999999996e-06 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330924+0000", 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3132000000000001e-05 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330935+0000", 2024-09-10T06:27:08.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0893999999999999e-05 2024-09-10T06:27:08.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331021+0000", 2024-09-10T06:27:08.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6205000000000006e-05 2024-09-10T06:27:08.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331160+0000", 2024-09-10T06:27:08.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013973600000000001 2024-09-10T06:27:08.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:08.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331336+0000", 2024-09-10T06:27:08.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017578799999999999 2024-09-10T06:27:08.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.332381+0000", 2024-09-10T06:27:08.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001044627 2024-09-10T06:27:08.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333371+0000", 2024-09-10T06:27:08.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098979800000000007 2024-09-10T06:27:08.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333421+0000", 2024-09-10T06:27:08.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9872e-05 2024-09-10T06:27:08.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333459+0000", 2024-09-10T06:27:08.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7960999999999998e-05 2024-09-10T06:27:08.017 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.017 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.017 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.688160500999999, 2024-09-10T06:27:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025247730000000001, 2024-09-10T06:27:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 52 2024-09-10T06:27:08.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.019 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:08.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:08.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316084+0000", 2024-09-10T06:27:08.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8260000000000003e-06 2024-09-10T06:27:08.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316095+0000", 2024-09-10T06:27:08.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1229999999999999e-05 2024-09-10T06:27:08.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316131+0000", 2024-09-10T06:27:08.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5499e-05 2024-09-10T06:27:08.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316150+0000", 2024-09-10T06:27:08.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9510000000000001e-05 2024-09-10T06:27:08.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316275+0000", 2024-09-10T06:27:08.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012501600000000001 2024-09-10T06:27:08.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316507+0000", 2024-09-10T06:27:08.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000231404 2024-09-10T06:27:08.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:08.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316712+0000", 2024-09-10T06:27:08.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204873 2024-09-10T06:27:08.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.317603+0000", 2024-09-10T06:27:08.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089174399999999998 2024-09-10T06:27:08.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318470+0000", 2024-09-10T06:27:08.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086713399999999998 2024-09-10T06:27:08.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318552+0000", 2024-09-10T06:27:08.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1279999999999994e-05 2024-09-10T06:27:08.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318605+0000", 2024-09-10T06:27:08.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3257000000000002e-05 2024-09-10T06:27:08.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.024 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.024 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.024 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.024 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:08.024 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.584382172000002, 2024-09-10T06:27:08.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033383480000000001, 2024-09-10T06:27:08.024 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.024 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.024 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.025 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.025 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.025 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.025 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 236 2024-09-10T06:27:08.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.025 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:08.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:08.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419861+0000", 2024-09-10T06:27:08.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.734e-06 2024-09-10T06:27:08.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419873+0000", 2024-09-10T06:27:08.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1789e-05 2024-09-10T06:27:08.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419904+0000", 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1377000000000001e-05 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419921+0000", 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6878999999999999e-05 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420052+0000", 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013025600000000001 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420263+0000", 2024-09-10T06:27:08.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021196600000000001 2024-09-10T06:27:08.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:08.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420649+0000", 2024-09-10T06:27:08.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038507 2024-09-10T06:27:08.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.422366+0000", 2024-09-10T06:27:08.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017172000000000001 2024-09-10T06:27:08.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423048+0000", 2024-09-10T06:27:08.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00068254100000000005 2024-09-10T06:27:08.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423127+0000", 2024-09-10T06:27:08.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8207000000000005e-05 2024-09-10T06:27:08.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423197+0000", 2024-09-10T06:27:08.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0328999999999997e-05 2024-09-10T06:27:08.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.030 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.030 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.030 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.030 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:08.030 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.567780897999999, 2024-09-10T06:27:08.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003575235, 2024-09-10T06:27:08.030 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.030 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.030 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.030 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.030 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.031 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.031 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 299 2024-09-10T06:27:08.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.031 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:08.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:08.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436461+0000", 2024-09-10T06:27:08.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.144e-06 2024-09-10T06:27:08.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436466+0000", 2024-09-10T06:27:08.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8409999999999999e-06 2024-09-10T06:27:08.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436477+0000", 2024-09-10T06:27:08.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1253000000000001e-05 2024-09-10T06:27:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436483+0000", 2024-09-10T06:27:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7010000000000001e-06 2024-09-10T06:27:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436527+0000", 2024-09-10T06:27:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4381000000000001e-05 2024-09-10T06:27:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436569+0000", 2024-09-10T06:27:08.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2208e-05 2024-09-10T06:27:08.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:08.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436687+0000", 2024-09-10T06:27:08.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118093 2024-09-10T06:27:08.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.437455+0000", 2024-09-10T06:27:08.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076799599999999996 2024-09-10T06:27:08.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439950+0000", 2024-09-10T06:27:08.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024946040000000001 2024-09-10T06:27:08.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439988+0000", 2024-09-10T06:27:08.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8405999999999998e-05 2024-09-10T06:27:08.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.440035+0000", 2024-09-10T06:27:08.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6607999999999998e-05 2024-09-10T06:27:08.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.036 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.036 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.036 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:08.036 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.233104816000001, 2024-09-10T06:27:08.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028833040000000002, 2024-09-10T06:27:08.037 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.037 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.037 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.037 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 742 2024-09-10T06:27:08.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.037 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:08.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:08.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771139+0000", 2024-09-10T06:27:08.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5269999999999999e-06 2024-09-10T06:27:08.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771153+0000", 2024-09-10T06:27:08.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4036000000000001e-05 2024-09-10T06:27:08.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771186+0000", 2024-09-10T06:27:08.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2113000000000002e-05 2024-09-10T06:27:08.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771201+0000", 2024-09-10T06:27:08.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:08.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771320+0000", 2024-09-10T06:27:08.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119265 2024-09-10T06:27:08.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771557+0000", 2024-09-10T06:27:08.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023640600000000001 2024-09-10T06:27:08.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:08.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771890+0000", 2024-09-10T06:27:08.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033302000000000001 2024-09-10T06:27:08.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773204+0000", 2024-09-10T06:27:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013142239999999999 2024-09-10T06:27:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773864+0000", 2024-09-10T06:27:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066005100000000004 2024-09-10T06:27:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773948+0000", 2024-09-10T06:27:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4625999999999999e-05 2024-09-10T06:27:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774019+0000", 2024-09-10T06:27:08.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0705999999999997e-05 2024-09-10T06:27:08.042 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.042 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.042 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.042 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.042 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:08.042 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.229325566, 2024-09-10T06:27:08.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025263479999999999, 2024-09-10T06:27:08.042 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.043 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.043 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.043 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 744 2024-09-10T06:27:08.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.043 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:08.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:08.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774917+0000", 2024-09-10T06:27:08.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0540000000000002e-06 2024-09-10T06:27:08.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774926+0000", 2024-09-10T06:27:08.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5660000000000007e-06 2024-09-10T06:27:08.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774947+0000", 2024-09-10T06:27:08.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0852999999999998e-05 2024-09-10T06:27:08.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774958+0000", 2024-09-10T06:27:08.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1216999999999999e-05 2024-09-10T06:27:08.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775045+0000", 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7643000000000001e-05 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775167+0000", 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012163900000000001 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775427+0000", 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000259678 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.776736+0000", 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013093429999999999 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777296+0000", 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056029599999999995 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777374+0000", 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7721999999999999e-05 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777441+0000", 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7336999999999996e-05 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.192010020000001, 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036412979999999998, 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.048 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 760 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812233+0000", 2024-09-10T06:27:08.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:08.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812244+0000", 2024-09-10T06:27:08.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1273e-05 2024-09-10T06:27:08.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812276+0000", 2024-09-10T06:27:08.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1253e-05 2024-09-10T06:27:08.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812290+0000", 2024-09-10T06:27:08.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4576000000000001e-05 2024-09-10T06:27:08.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812438+0000", 2024-09-10T06:27:08.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014775899999999999 2024-09-10T06:27:08.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812821+0000", 2024-09-10T06:27:08.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000383187 2024-09-10T06:27:08.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:08.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.813398+0000", 2024-09-10T06:27:08.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000576619 2024-09-10T06:27:08.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.814658+0000", 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001260207 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815591+0000", 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00093332899999999999 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815745+0000", 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153392 2024-09-10T06:27:08.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815872+0000", 2024-09-10T06:27:08.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012715599999999999 2024-09-10T06:27:08.054 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.054 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.054 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.054 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.054 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:08.054 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.187374636000001, 2024-09-10T06:27:08.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029417369999999998, 2024-09-10T06:27:08.054 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.055 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.055 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.055 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.055 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.055 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.055 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 762 2024-09-10T06:27:08.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.055 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:08.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816868+0000", 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.283e-06 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816879+0000", 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0523000000000001e-05 2024-09-10T06:27:08.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816910+0000", 2024-09-10T06:27:08.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0732999999999999e-05 2024-09-10T06:27:08.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816926+0000", 2024-09-10T06:27:08.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.677e-05 2024-09-10T06:27:08.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817058+0000", 2024-09-10T06:27:08.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013195599999999999 2024-09-10T06:27:08.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817299+0000", 2024-09-10T06:27:08.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000241091 2024-09-10T06:27:08.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:08.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817761+0000", 2024-09-10T06:27:08.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046188400000000003 2024-09-10T06:27:08.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.818948+0000", 2024-09-10T06:27:08.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:08.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819662+0000", 2024-09-10T06:27:08.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071398399999999997 2024-09-10T06:27:08.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819745+0000", 2024-09-10T06:27:08.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3560000000000006e-05 2024-09-10T06:27:08.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819808+0000", 2024-09-10T06:27:08.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2329000000000006e-05 2024-09-10T06:27:08.060 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.060 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.060 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.060 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.060 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:08.060 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.066913919000001, 2024-09-10T06:27:08.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002834175, 2024-09-10T06:27:08.061 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.061 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.061 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.061 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.061 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.061 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.061 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 817 2024-09-10T06:27:08.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.061 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:08.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937330+0000", 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9869999999999999e-06 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937342+0000", 2024-09-10T06:27:08.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2595999999999999e-05 2024-09-10T06:27:08.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937375+0000", 2024-09-10T06:27:08.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2320000000000002e-05 2024-09-10T06:27:08.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937390+0000", 2024-09-10T06:27:08.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4977000000000001e-05 2024-09-10T06:27:08.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937529+0000", 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013937199999999999 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937753+0000", 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000224358 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.938061+0000", 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030808799999999998 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.939112+0000", 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010503050000000001 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940005+0000", 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089366599999999999 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940093+0000", 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8053000000000006e-05 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940161+0000", 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7453000000000006e-05 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.013985877, 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027552649999999998, 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.066 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 841 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990257+0000", 2024-09-10T06:27:08.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6869999999999999e-06 2024-09-10T06:27:08.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990270+0000", 2024-09-10T06:27:08.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2843000000000001e-05 2024-09-10T06:27:08.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990300+0000", 2024-09-10T06:27:08.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9252999999999999e-05 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990314+0000", 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4796e-05 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990427+0000", 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112649 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990671+0000", 2024-09-10T06:27:08.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244408 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990987+0000", 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031593099999999998 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992073+0000", 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010854549999999999 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992862+0000", 2024-09-10T06:27:08.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00078889400000000005 2024-09-10T06:27:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992944+0000", 2024-09-10T06:27:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2152999999999998e-05 2024-09-10T06:27:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993010+0000", 2024-09-10T06:27:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6196000000000001e-05 2024-09-10T06:27:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.072 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.072 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:08.072 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.010249943000002, 2024-09-10T06:27:08.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025373539999999999, 2024-09-10T06:27:08.072 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.072 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.072 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.072 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.072 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 843 2024-09-10T06:27:08.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.072 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:08.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:08.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993993+0000", 2024-09-10T06:27:08.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3630000000000001e-06 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994004+0000", 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0557000000000001e-05 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994035+0000", 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0969000000000001e-05 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994055+0000", 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0497e-05 2024-09-10T06:27:08.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994150+0000", 2024-09-10T06:27:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5363000000000002e-05 2024-09-10T06:27:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994275+0000", 2024-09-10T06:27:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012453200000000001 2024-09-10T06:27:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994570+0000", 2024-09-10T06:27:08.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029522100000000003 2024-09-10T06:27:08.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.995569+0000", 2024-09-10T06:27:08.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00099913200000000001 2024-09-10T06:27:08.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996384+0000", 2024-09-10T06:27:08.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081451099999999997 2024-09-10T06:27:08.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996462+0000", 2024-09-10T06:27:08.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8502000000000002e-05 2024-09-10T06:27:08.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996528+0000", 2024-09-10T06:27:08.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5707e-05 2024-09-10T06:27:08.077 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.077 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.077 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.077 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.078 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:08.078 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 26.000802795999999, 2024-09-10T06:27:08.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033145539999999999, 2024-09-10T06:27:08.078 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.078 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.078 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.078 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.078 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.078 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.078 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 847 2024-09-10T06:27:08.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.078 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:08.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:08.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003440+0000", 2024-09-10T06:27:08.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5299999999999999e-06 2024-09-10T06:27:08.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003452+0000", 2024-09-10T06:27:08.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:08.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003482+0000", 2024-09-10T06:27:08.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0790000000000002e-05 2024-09-10T06:27:08.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003497+0000", 2024-09-10T06:27:08.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.489e-05 2024-09-10T06:27:08.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003645+0000", 2024-09-10T06:27:08.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014771900000000001 2024-09-10T06:27:08.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003996+0000", 2024-09-10T06:27:08.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000350861 2024-09-10T06:27:08.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:08.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.004540+0000", 2024-09-10T06:27:08.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054383199999999995 2024-09-10T06:27:08.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.005831+0000", 2024-09-10T06:27:08.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001291366 2024-09-10T06:27:08.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006461+0000", 2024-09-10T06:27:08.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062943899999999998 2024-09-10T06:27:08.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006631+0000", 2024-09-10T06:27:08.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000170228 2024-09-10T06:27:08.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006752+0000", 2024-09-10T06:27:08.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012160899999999999 2024-09-10T06:27:08.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.083 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.083 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.083 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.084 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:08.084 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.996549629, 2024-09-10T06:27:08.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002619953, 2024-09-10T06:27:08.084 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.084 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.084 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.084 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.084 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 849 2024-09-10T06:27:08.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.084 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007693+0000", 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3099999999999999e-06 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007704+0000", 2024-09-10T06:27:08.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0387000000000001e-05 2024-09-10T06:27:08.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007734+0000", 2024-09-10T06:27:08.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0676000000000002e-05 2024-09-10T06:27:08.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007753+0000", 2024-09-10T06:27:08.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.836e-05 2024-09-10T06:27:08.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007857+0000", 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103836 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007980+0000", 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123843 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.008241+0000", 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026085799999999999 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.009475+0000", 2024-09-10T06:27:08.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012340230000000001 2024-09-10T06:27:08.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010168+0000", 2024-09-10T06:27:08.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00069220800000000004 2024-09-10T06:27:08.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010247+0000", 2024-09-10T06:27:08.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9929e-05 2024-09-10T06:27:08.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010311+0000", 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3522999999999995e-05 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.952069808000001, 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026646590000000002, 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.089 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.090 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.090 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.090 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 868 2024-09-10T06:27:08.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.090 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:08.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:08.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052173+0000", 2024-09-10T06:27:08.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-10T06:27:08.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052186+0000", 2024-09-10T06:27:08.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2787e-05 2024-09-10T06:27:08.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052216+0000", 2024-09-10T06:27:08.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9618999999999999e-05 2024-09-10T06:27:08.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052231+0000", 2024-09-10T06:27:08.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4929999999999999e-05 2024-09-10T06:27:08.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052349+0000", 2024-09-10T06:27:08.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011830200000000001 2024-09-10T06:27:08.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052561+0000", 2024-09-10T06:27:08.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000212182 2024-09-10T06:27:08.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:08.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052874+0000", 2024-09-10T06:27:08.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031299399999999998 2024-09-10T06:27:08.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054049+0000", 2024-09-10T06:27:08.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174825 2024-09-10T06:27:08.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054635+0000", 2024-09-10T06:27:08.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058643900000000001 2024-09-10T06:27:08.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054721+0000", 2024-09-10T06:27:08.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5185999999999994e-05 2024-09-10T06:27:08.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054836+0000", 2024-09-10T06:27:08.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114922 2024-09-10T06:27:08.095 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.095 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.095 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.095 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.095 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:08.095 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.865413706999998, 2024-09-10T06:27:08.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028453739999999999, 2024-09-10T06:27:08.095 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.095 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.096 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.096 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.096 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 907 2024-09-10T06:27:08.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.096 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:08.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:08.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138830+0000", 2024-09-10T06:27:08.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8600000000000001e-06 2024-09-10T06:27:08.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138842+0000", 2024-09-10T06:27:08.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2126e-05 2024-09-10T06:27:08.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138874+0000", 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2047e-05 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138889+0000", 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4966999999999999e-05 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139007+0000", 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118479 2024-09-10T06:27:08.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139238+0000", 2024-09-10T06:27:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023031399999999999 2024-09-10T06:27:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139566+0000", 2024-09-10T06:27:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032816099999999999 2024-09-10T06:27:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.140631+0000", 2024-09-10T06:27:08.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010653679999999999 2024-09-10T06:27:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141393+0000", 2024-09-10T06:27:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076187100000000001 2024-09-10T06:27:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141561+0000", 2024-09-10T06:27:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016755599999999999 2024-09-10T06:27:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141672+0000", 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111625 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.861490191000001, 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002857268, 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 909 2024-09-10T06:27:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142753+0000", 2024-09-10T06:27:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4040000000000002e-06 2024-09-10T06:27:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142764+0000", 2024-09-10T06:27:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0789e-05 2024-09-10T06:27:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142795+0000", 2024-09-10T06:27:08.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0982999999999998e-05 2024-09-10T06:27:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142810+0000", 2024-09-10T06:27:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4960000000000001e-05 2024-09-10T06:27:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142908+0000", 2024-09-10T06:27:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8726000000000003e-05 2024-09-10T06:27:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143030+0000", 2024-09-10T06:27:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121649 2024-09-10T06:27:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143294+0000", 2024-09-10T06:27:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000263875 2024-09-10T06:27:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.144530+0000", 2024-09-10T06:27:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001236067 2024-09-10T06:27:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145340+0000", 2024-09-10T06:27:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080966700000000003 2024-09-10T06:27:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145497+0000", 2024-09-10T06:27:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015773499999999999 2024-09-10T06:27:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145608+0000", 2024-09-10T06:27:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110413 2024-09-10T06:27:08.106 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.767792694000001, 2024-09-10T06:27:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029166940000000001, 2024-09-10T06:27:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 949 2024-09-10T06:27:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236451+0000", 2024-09-10T06:27:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:27:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236464+0000", 2024-09-10T06:27:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3223e-05 2024-09-10T06:27:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236497+0000", 2024-09-10T06:27:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2672999999999997e-05 2024-09-10T06:27:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236515+0000", 2024-09-10T06:27:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8386999999999999e-05 2024-09-10T06:27:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236636+0000", 2024-09-10T06:27:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120752 2024-09-10T06:27:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236857+0000", 2024-09-10T06:27:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022134499999999999 2024-09-10T06:27:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.237188+0000", 2024-09-10T06:27:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033057799999999999 2024-09-10T06:27:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.238353+0000", 2024-09-10T06:27:08.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001164841 2024-09-10T06:27:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239160+0000", 2024-09-10T06:27:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080743000000000004 2024-09-10T06:27:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239245+0000", 2024-09-10T06:27:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5189e-05 2024-09-10T06:27:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239365+0000", 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119406 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.763931586999998, 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025033970000000001, 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.113 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 951 2024-09-10T06:27:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240311+0000", 2024-09-10T06:27:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8899999999999999e-06 2024-09-10T06:27:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240320+0000", 2024-09-10T06:27:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6799999999999999e-06 2024-09-10T06:27:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240341+0000", 2024-09-10T06:27:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1379e-05 2024-09-10T06:27:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240352+0000", 2024-09-10T06:27:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1354e-05 2024-09-10T06:27:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240450+0000", 2024-09-10T06:27:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7866000000000001e-05 2024-09-10T06:27:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240580+0000", 2024-09-10T06:27:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012970899999999999 2024-09-10T06:27:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240851+0000", 2024-09-10T06:27:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027059099999999998 2024-09-10T06:27:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242052+0000", 2024-09-10T06:27:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001201014 2024-09-10T06:27:08.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242662+0000", 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061076800000000003 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242747+0000", 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5019999999999996e-05 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242812+0000", 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5126e-05 2024-09-10T06:27:08.118 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.753482168000001, 2024-09-10T06:27:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027897120000000002, 2024-09-10T06:27:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:08.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 955 2024-09-10T06:27:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:08.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250761+0000", 2024-09-10T06:27:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250772+0000", 2024-09-10T06:27:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1153e-05 2024-09-10T06:27:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:08.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250802+0000", 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-05 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250817+0000", 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4883e-05 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250925+0000", 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108249 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:08.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251139+0000", 2024-09-10T06:27:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000213568 2024-09-10T06:27:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251450+0000", 2024-09-10T06:27:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031139200000000002 2024-09-10T06:27:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.252574+0000", 2024-09-10T06:27:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011239139999999999 2024-09-10T06:27:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253377+0000", 2024-09-10T06:27:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080306400000000003 2024-09-10T06:27:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253466+0000", 2024-09-10T06:27:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8436000000000005e-05 2024-09-10T06:27:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253548+0000", 2024-09-10T06:27:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2496000000000004e-05 2024-09-10T06:27:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.124 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:08.125 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:08.125 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:08.126 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:27:08.127 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:08.122+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:08.227 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:08.222+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:08.298 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:08.299 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:08.299 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:08.299 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:08.312 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:27:08.327 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:08.326+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:08.349 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:27:08.422 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:08.422 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:08.422 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:08.422 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:08.422 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:08.428 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:08.426+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:08.436 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:27:08.490 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:08.490 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:08.509 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:08.509 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:08.526 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:08.527 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:08.529 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:08.526+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:08.558 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:08.558 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:08.590 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-10T06:27:08.596 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:08.596 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:08.625 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:08.625 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:08.630 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:08.626+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:08.630 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:08.630 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:08.639 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:27:08.652 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:08.652 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:08.670 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:08.671 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:08.731 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:08.726+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:08.769 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:08.769 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:08.783 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:27:08.871 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:08.870+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:08.933 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:08.930+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:08.950 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:08.950 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:08.964 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:27:09.051 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:09.050+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:09.132 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:09.132 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:09.135 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:09.130+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:09.146 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:27:09.236 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:09.234+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:09.313 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:09.313 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:09.327 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:27:09.337 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:09.334+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:09.438 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:09.434+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:09.451 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:09.451 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:09.465 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:27:09.551 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:09.550+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:09.630 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:09.630 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:09.639 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:09.634+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:09.644 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:27:09.741 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:09.742+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:09.807 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:09.807 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:09.822 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:27:09.867 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:09.866+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:09.943 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:09.938+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:09.946 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:09.946 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:09.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:27:10.044 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:10.042+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:10.126 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:10.126 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:10.140 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:27:10.145 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:10.146+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:10.246 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:10.242+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:10.257 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:10.258 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:10.272 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:27:10.363 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:10.362+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:10.442 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:10.442 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:10.447 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:10.446+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:10.456 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:27:10.548 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:10.546+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:10.612 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T06:27:10.625 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:10.625 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:10.640 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:27:10.650 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:10.646+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:10.687 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:27:10.750 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:10.750+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:10.787 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:10.787 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:10.802 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:27:10.843 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:10.843 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:10.860 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:10.861 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:10.861 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:10.862+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:10.878 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:10.878 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:10.910 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:10.911 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:10.931 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:10.931 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:10.951 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:10.952 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:10.952 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:10.950+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:10.970 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:10.970 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:10.970 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:10.971 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:10.971 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:10.971 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:10.972 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:10.987 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:27:10.998 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:10.999 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:11.057 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:11.058+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:11.110 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:11.110 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:11.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:11.111 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:11.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.111 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:46 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'28, mlcod=16'22)", 2024-09-10T06:27:11.111 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:27:11.111 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.817017325999998, 2024-09-10T06:27:11.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042526789999999997, 2024-09-10T06:27:11.111 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.111 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.111 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.111 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:27:11.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293570+0000", 2024-09-10T06:27:11.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293571+0000", 2024-09-10T06:27:11.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1119999999999999e-06 2024-09-10T06:27:11.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293577+0000", 2024-09-10T06:27:11.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2179999999999996e-06 2024-09-10T06:27:11.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293596+0000", 2024-09-10T06:27:11.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9170000000000001e-05 2024-09-10T06:27:11.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293605+0000", 2024-09-10T06:27:11.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4060000000000005e-06 2024-09-10T06:27:11.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293654+0000", 2024-09-10T06:27:11.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9116999999999997e-05 2024-09-10T06:27:11.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.293671+0000", 2024-09-10T06:27:11.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7110999999999999e-05 2024-09-10T06:27:11.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.297783+0000", 2024-09-10T06:27:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041121409999999997 2024-09-10T06:27:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.297822+0000", 2024-09-10T06:27:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9403999999999997e-05 2024-09-10T06:27:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:50 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'26)", 2024-09-10T06:27:11.115 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:27:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.811228827000001, 2024-09-10T06:27:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042664490000000003, 2024-09-10T06:27:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:27:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299358+0000", 2024-09-10T06:27:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299359+0000", 2024-09-10T06:27:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1100000000000004e-07 2024-09-10T06:27:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299425+0000", 2024-09-10T06:27:11.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5994999999999994e-05 2024-09-10T06:27:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299440+0000", 2024-09-10T06:27:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4552999999999999e-05 2024-09-10T06:27:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299448+0000", 2024-09-10T06:27:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7469999999999994e-06 2024-09-10T06:27:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299504+0000", 2024-09-10T06:27:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5257999999999998e-05 2024-09-10T06:27:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.299518+0000", 2024-09-10T06:27:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4037e-05 2024-09-10T06:27:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.303578+0000", 2024-09-10T06:27:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040603439999999996 2024-09-10T06:27:11.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.303625+0000", 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6604000000000003e-05 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:51 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.809222247000001, 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048711279999999997, 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.120 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:27:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301365+0000", 2024-09-10T06:27:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301366+0000", 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0079999999999999e-06 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301400+0000", 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3816000000000003e-05 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301419+0000", 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9032e-05 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301427+0000", 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6759999999999996e-06 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301475+0000", 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8201999999999997e-05 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.301494+0000", 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8791e-05 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306182+0000", 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046878379999999997 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306236+0000", 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3764999999999998e-05 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:52 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'34, mlcod=16'29)", 2024-09-10T06:27:11.124 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:27:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.808232891999999, 2024-09-10T06:27:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039365659999999999, 2024-09-10T06:27:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:27:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302354+0000", 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302355+0000", 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.009e-06 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302373+0000", 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8232000000000001e-05 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302388+0000", 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4246999999999999e-05 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302400+0000", 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2054e-05 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302449+0000", 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9119000000000002e-05 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.302461+0000", 2024-09-10T06:27:11.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2206e-05 2024-09-10T06:27:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306238+0000", 2024-09-10T06:27:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037773889999999999 2024-09-10T06:27:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.306291+0000", 2024-09-10T06:27:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2309999999999999e-05 2024-09-10T06:27:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:55 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'37, mlcod=16'33)", 2024-09-10T06:27:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:27:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.799927191000002, 2024-09-10T06:27:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041116740000000001, 2024-09-10T06:27:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:27:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310660+0000", 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310661+0000", 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3600000000000003e-07 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310724+0000", 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3706000000000003e-05 2024-09-10T06:27:11.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310734+0000", 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0207000000000001e-05 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310740+0000", 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8760000000000002e-06 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310796+0000", 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6206999999999999e-05 2024-09-10T06:27:11.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.310813+0000", 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6385999999999999e-05 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.314729+0000", 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039157469999999998 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.314771+0000", 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2809000000000003e-05 2024-09-10T06:27:11.132 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'47, mlcod=16'41)", 2024-09-10T06:27:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:27:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.578189844999997, 2024-09-10T06:27:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0084590540000000006, 2024-09-10T06:27:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532397+0000", 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532398+0000", 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0599999999999999e-07 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532437+0000", 2024-09-10T06:27:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8711000000000003e-05 2024-09-10T06:27:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532449+0000", 2024-09-10T06:27:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2075999999999999e-05 2024-09-10T06:27:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.532455+0000", 2024-09-10T06:27:11.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2110000000000003e-06 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533257+0000", 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080233799999999999 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533318+0000", 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1033000000000003e-05 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540718+0000", 2024-09-10T06:27:11.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073998529999999996 2024-09-10T06:27:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540856+0000", 2024-09-10T06:27:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013792599999999999 2024-09-10T06:27:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:70 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'48, mlcod=16'41)", 2024-09-10T06:27:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:27:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.577483829999998, 2024-09-10T06:27:11.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0078483679999999997, 2024-09-10T06:27:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:27:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533103+0000", 2024-09-10T06:27:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533104+0000", 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3799999999999997e-07 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533109+0000", 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1100000000000002e-06 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533117+0000", 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7260000000000002e-06 2024-09-10T06:27:11.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533125+0000", 2024-09-10T06:27:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8170000000000005e-06 2024-09-10T06:27:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534794+0000", 2024-09-10T06:27:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016687760000000001 2024-09-10T06:27:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534808+0000", 2024-09-10T06:27:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4293e-05 2024-09-10T06:27:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540863+0000", 2024-09-10T06:27:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060549549999999999 2024-09-10T06:27:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540951+0000", 2024-09-10T06:27:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8152999999999994e-05 2024-09-10T06:27:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.141 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:71 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'49, mlcod=16'44)", 2024-09-10T06:27:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:27:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.576610682000002, 2024-09-10T06:27:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070511530000000001, 2024-09-10T06:27:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:27:11.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533976+0000", 2024-09-10T06:27:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533978+0000", 2024-09-10T06:27:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5799999999999999e-06 2024-09-10T06:27:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.533987+0000", 2024-09-10T06:27:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4460000000000007e-06 2024-09-10T06:27:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534017+0000", 2024-09-10T06:27:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9524000000000001e-05 2024-09-10T06:27:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534027+0000", 2024-09-10T06:27:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0593e-05 2024-09-10T06:27:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535082+0000", 2024-09-10T06:27:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001054609 2024-09-10T06:27:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535095+0000", 2024-09-10T06:27:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2870999999999999e-05 2024-09-10T06:27:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.540955+0000", 2024-09-10T06:27:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058596270000000001 2024-09-10T06:27:11.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541027+0000", 2024-09-10T06:27:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2903000000000003e-05 2024-09-10T06:27:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:72 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'50, mlcod=16'44)", 2024-09-10T06:27:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:27:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.575998519999999, 2024-09-10T06:27:11.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0065158799999999999, 2024-09-10T06:27:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:27:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534588+0000", 2024-09-10T06:27:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534591+0000", 2024-09-10T06:27:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0729999999999999e-06 2024-09-10T06:27:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534722+0000", 2024-09-10T06:27:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013124299999999999 2024-09-10T06:27:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534746+0000", 2024-09-10T06:27:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3903000000000001e-05 2024-09-10T06:27:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.534758+0000", 2024-09-10T06:27:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2449000000000001e-05 2024-09-10T06:27:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535408+0000", 2024-09-10T06:27:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00064971199999999999 2024-09-10T06:27:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.535465+0000", 2024-09-10T06:27:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6892999999999999e-05 2024-09-10T06:27:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541030+0000", 2024-09-10T06:27:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055649209999999996 2024-09-10T06:27:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541104+0000", 2024-09-10T06:27:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4685999999999996e-05 2024-09-10T06:27:11.150 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:73 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'51, mlcod=16'44)", 2024-09-10T06:27:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:27:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.574118198000001, 2024-09-10T06:27:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047149710000000001, 2024-09-10T06:27:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:27:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536469+0000", 2024-09-10T06:27:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536471+0000", 2024-09-10T06:27:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.934e-06 2024-09-10T06:27:11.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536482+0000", 2024-09-10T06:27:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1542999999999999e-05 2024-09-10T06:27:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536511+0000", 2024-09-10T06:27:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8649999999999998e-05 2024-09-10T06:27:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536527+0000", 2024-09-10T06:27:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.649e-05 2024-09-10T06:27:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536776+0000", 2024-09-10T06:27:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024814800000000001 2024-09-10T06:27:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.536811+0000", 2024-09-10T06:27:11.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5716000000000002e-05 2024-09-10T06:27:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541107+0000", 2024-09-10T06:27:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042952770000000001 2024-09-10T06:27:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541184+0000", 2024-09-10T06:27:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7212999999999994e-05 2024-09-10T06:27:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:74 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'52, mlcod=16'45)", 2024-09-10T06:27:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:27:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.573555624999997, 2024-09-10T06:27:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042018239999999998, 2024-09-10T06:27:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:27:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537031+0000", 2024-09-10T06:27:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537033+0000", 2024-09-10T06:27:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.533e-06 2024-09-10T06:27:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537043+0000", 2024-09-10T06:27:11.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0000000000000001e-05 2024-09-10T06:27:11.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537062+0000", 2024-09-10T06:27:11.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8686999999999999e-05 2024-09-10T06:27:11.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537072+0000", 2024-09-10T06:27:11.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0746e-05 2024-09-10T06:27:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537359+0000", 2024-09-10T06:27:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000286908 2024-09-10T06:27:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537415+0000", 2024-09-10T06:27:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5389000000000001e-05 2024-09-10T06:27:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541186+0000", 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0037710550000000002 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541233+0000", 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7506000000000002e-05 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:75 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'53, mlcod=16'45)", 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.572941886999999, 2024-09-10T06:27:11.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036309760000000002, 2024-09-10T06:27:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:27:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537645+0000", 2024-09-10T06:27:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537647+0000", 2024-09-10T06:27:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8369999999999999e-06 2024-09-10T06:27:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537767+0000", 2024-09-10T06:27:11.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119826 2024-09-10T06:27:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537798+0000", 2024-09-10T06:27:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0775999999999998e-05 2024-09-10T06:27:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.537811+0000", 2024-09-10T06:27:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.327e-05 2024-09-10T06:27:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.538148+0000", 2024-09-10T06:27:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033750799999999998 2024-09-10T06:27:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.538189+0000", 2024-09-10T06:27:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0713000000000001e-05 2024-09-10T06:27:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541238+0000", 2024-09-10T06:27:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030488500000000001 2024-09-10T06:27:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.541276+0000", 2024-09-10T06:27:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8195999999999998e-05 2024-09-10T06:27:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:77 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'55, mlcod=16'53)", 2024-09-10T06:27:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:27:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.566770366999997, 2024-09-10T06:27:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041185240000000001, 2024-09-10T06:27:11.165 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:27:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543817+0000", 2024-09-10T06:27:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543818+0000", 2024-09-10T06:27:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8029999999999999e-06 2024-09-10T06:27:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543948+0000", 2024-09-10T06:27:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000129369 2024-09-10T06:27:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543977+0000", 2024-09-10T06:27:11.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8813e-05 2024-09-10T06:27:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.543989+0000", 2024-09-10T06:27:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2886e-05 2024-09-10T06:27:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544115+0000", 2024-09-10T06:27:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012526900000000001 2024-09-10T06:27:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544174+0000", 2024-09-10T06:27:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9166999999999998e-05 2024-09-10T06:27:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547867+0000", 2024-09-10T06:27:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036934340000000002 2024-09-10T06:27:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547935+0000", 2024-09-10T06:27:11.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7782999999999998e-05 2024-09-10T06:27:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:78 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'56, mlcod=16'53)", 2024-09-10T06:27:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:27:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.566201665999998, 2024-09-10T06:27:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035960359999999999, 2024-09-10T06:27:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.170 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:27:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544385+0000", 2024-09-10T06:27:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544386+0000", 2024-09-10T06:27:11.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1399999999999995e-07 2024-09-10T06:27:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544510+0000", 2024-09-10T06:27:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124265 2024-09-10T06:27:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544528+0000", 2024-09-10T06:27:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7706999999999998e-05 2024-09-10T06:27:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544538+0000", 2024-09-10T06:27:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7799999999999995e-06 2024-09-10T06:27:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545067+0000", 2024-09-10T06:27:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00052855600000000001 2024-09-10T06:27:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545125+0000", 2024-09-10T06:27:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8313000000000002e-05 2024-09-10T06:27:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547942+0000", 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028174749999999998 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547981+0000", 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9026000000000002e-05 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:79 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'57, mlcod=16'53)", 2024-09-10T06:27:11.174 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.565662946000003, 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044068620000000001, 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544924+0000", 2024-09-10T06:27:11.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.544925+0000", 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8000000000000004e-07 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545047+0000", 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121779 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545077+0000", 2024-09-10T06:27:11.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0463e-05 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545087+0000", 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0067e-05 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.546104+0000", 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001017088 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.546157+0000", 2024-09-10T06:27:11.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2886000000000002e-05 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549219+0000", 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030620539999999998 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549331+0000", 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011164500000000001 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4167.0:80 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'58, mlcod=16'53)", 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.565065158000003, 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0042652369999999998, 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545522+0000", 2024-09-10T06:27:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545523+0000", 2024-09-10T06:27:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2399999999999997e-07 2024-09-10T06:27:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545646+0000", 2024-09-10T06:27:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123662 2024-09-10T06:27:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545664+0000", 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8e-05 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.545673+0000", 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9930000000000001e-06 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547057+0000", 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013834629999999999 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.547129+0000", 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1759000000000002e-05 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549724+0000", 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002595834 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:18.549787+0000", 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2701999999999997e-05 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.182 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:27:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.808921836, 2024-09-10T06:27:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040313359999999999, 2024-09-10T06:27:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.183 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 206 2024-09-10T06:27:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:27:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301665+0000", 2024-09-10T06:27:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301670+0000", 2024-09-10T06:27:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5669999999999996e-06 2024-09-10T06:27:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301690+0000", 2024-09-10T06:27:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0636999999999999e-05 2024-09-10T06:27:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301735+0000", 2024-09-10T06:27:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4298999999999997e-05 2024-09-10T06:27:11.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301759+0000", 2024-09-10T06:27:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4769999999999998e-05 2024-09-10T06:27:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.301938+0000", 2024-09-10T06:27:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017901899999999999 2024-09-10T06:27:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.302305+0000", 2024-09-10T06:27:11.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036679699999999998 2024-09-10T06:27:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.303069+0000", 2024-09-10T06:27:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076360999999999996 2024-09-10T06:27:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.304549+0000", 2024-09-10T06:27:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014798229999999999 2024-09-10T06:27:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305530+0000", 2024-09-10T06:27:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098141200000000008 2024-09-10T06:27:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305610+0000", 2024-09-10T06:27:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9785999999999998e-05 2024-09-10T06:27:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305696+0000", 2024-09-10T06:27:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6615999999999999e-05 2024-09-10T06:27:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:27:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.786317224000001, 2024-09-10T06:27:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0081512240000000003, 2024-09-10T06:27:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 210 2024-09-10T06:27:11.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324270+0000", 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324273+0000", 2024-09-10T06:27:11.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1240000000000001e-06 2024-09-10T06:27:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324285+0000", 2024-09-10T06:27:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2463000000000001e-05 2024-09-10T06:27:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324319+0000", 2024-09-10T06:27:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3309999999999998e-05 2024-09-10T06:27:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324342+0000", 2024-09-10T06:27:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3672999999999998e-05 2024-09-10T06:27:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324476+0000", 2024-09-10T06:27:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013378199999999999 2024-09-10T06:27:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:27:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.324489+0000", 2024-09-10T06:27:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3127e-05 2024-09-10T06:27:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.328893+0000", 2024-09-10T06:27:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044040190000000003 2024-09-10T06:27:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.329211+0000", 2024-09-10T06:27:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031762799999999998 2024-09-10T06:27:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.329880+0000", 2024-09-10T06:27:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066933800000000001 2024-09-10T06:27:11.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.331727+0000", 2024-09-10T06:27:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018466120000000001 2024-09-10T06:27:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332287+0000", 2024-09-10T06:27:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056016599999999996 2024-09-10T06:27:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332363+0000", 2024-09-10T06:27:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5748999999999996e-05 2024-09-10T06:27:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.332421+0000", 2024-09-10T06:27:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8233000000000003e-05 2024-09-10T06:27:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:469 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:27:11.195 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.611466306000001, 2024-09-10T06:27:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0056131189999999997, 2024-09-10T06:27:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 469 2024-09-10T06:27:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:27:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:27:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499121+0000", 2024-09-10T06:27:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8400000000000003e-07 2024-09-10T06:27:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499125+0000", 2024-09-10T06:27:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.692e-06 2024-09-10T06:27:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499135+0000", 2024-09-10T06:27:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5310000000000007e-06 2024-09-10T06:27:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499140+0000", 2024-09-10T06:27:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9640000000000002e-06 2024-09-10T06:27:11.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499200+0000", 2024-09-10T06:27:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0874e-05 2024-09-10T06:27:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499303+0000", 2024-09-10T06:27:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102395 2024-09-10T06:27:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499518+0000", 2024-09-10T06:27:11.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021481500000000001 2024-09-10T06:27:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.500112+0000", 2024-09-10T06:27:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059408699999999998 2024-09-10T06:27:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504614+0000", 2024-09-10T06:27:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045017859999999998 2024-09-10T06:27:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504688+0000", 2024-09-10T06:27:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4528000000000002e-05 2024-09-10T06:27:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504734+0000", 2024-09-10T06:27:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5663e-05 2024-09-10T06:27:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.201 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:621 6.0 6:0705c68b:::obj_delete_at_hint.0000000028:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:27:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.506236245, 2024-09-10T06:27:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039399250000000004, 2024-09-10T06:27:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 621 2024-09-10T06:27:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:27:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604351+0000", 2024-09-10T06:27:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604353+0000", 2024-09-10T06:27:11.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.537e-06 2024-09-10T06:27:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604364+0000", 2024-09-10T06:27:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0923e-05 2024-09-10T06:27:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604394+0000", 2024-09-10T06:27:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0176999999999999e-05 2024-09-10T06:27:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604409+0000", 2024-09-10T06:27:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4666e-05 2024-09-10T06:27:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604505+0000", 2024-09-10T06:27:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5914000000000004e-05 2024-09-10T06:27:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604588+0000", 2024-09-10T06:27:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3127999999999994e-05 2024-09-10T06:27:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604709+0000", 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121344 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.605312+0000", 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00060259599999999995 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608229+0000", 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029169600000000001 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608264+0000", 2024-09-10T06:27:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4756999999999999e-05 2024-09-10T06:27:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608291+0000", 2024-09-10T06:27:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6923e-05 2024-09-10T06:27:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.207 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.207 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:11.209 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:27:11.209 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:11.210+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:11.310 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:11.310+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:11.371 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:11.371 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:11.371 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:11.371 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:11.384 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:27:11.429 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:11.430+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:11.503 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:11.504 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:11.504 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:11.504 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:11.504 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:11.511 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:11.510+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:11.518 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:27:11.612 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:11.610+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:11.675 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:11.675 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:11.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:11.676 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:11.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.676 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:11.676 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:11.676 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 37.398844126, 2024-09-10T06:27:11.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069538480000000003, 2024-09-10T06:27:11.676 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.676 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.676 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-10T06:27:11.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:11.676 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:11.677 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2 2024-09-10T06:27:11.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.677 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:11.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:11.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275742+0000", 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7460000000000001e-06 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275751+0000", 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3979999999999999e-06 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275769+0000", 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8637000000000001e-05 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275784+0000", 2024-09-10T06:27:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4518000000000001e-05 2024-09-10T06:27:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275905+0000", 2024-09-10T06:27:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012092899999999999 2024-09-10T06:27:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-10T06:27:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275920+0000", 2024-09-10T06:27:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5325999999999999e-05 2024-09-10T06:27:11.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282541+0000", 2024-09-10T06:27:11.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066208400000000002 2024-09-10T06:27:11.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282693+0000", 2024-09-10T06:27:11.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152454 2024-09-10T06:27:11.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.680 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.681 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:11.681 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:11.681 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 33.262015564999999, 2024-09-10T06:27:11.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029204980000000001, 2024-09-10T06:27:11.681 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.681 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.681 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.681 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 193 2024-09-10T06:27:11.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.681 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412570+0000", 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4530000000000001e-06 2024-09-10T06:27:11.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412582+0000", 2024-09-10T06:27:11.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1524e-05 2024-09-10T06:27:11.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412612+0000", 2024-09-10T06:27:11.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0436000000000001e-05 2024-09-10T06:27:11.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412627+0000", 2024-09-10T06:27:11.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4306e-05 2024-09-10T06:27:11.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412723+0000", 2024-09-10T06:27:11.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6075000000000004e-05 2024-09-10T06:27:11.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412831+0000", 2024-09-10T06:27:11.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108453 2024-09-10T06:27:11.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412972+0000", 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141225 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.414147+0000", 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174989 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415334+0000", 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415420+0000", 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6009999999999998e-05 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415489+0000", 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8403000000000002e-05 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.364531923000001, 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092944310000000006, 2024-09-10T06:27:11.686 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 208 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310055+0000", 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310066+0000", 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1739999999999999e-05 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310096+0000", 2024-09-10T06:27:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0159e-05 2024-09-10T06:27:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310111+0000", 2024-09-10T06:27:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5007e-05 2024-09-10T06:27:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310235+0000", 2024-09-10T06:27:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123132 2024-09-10T06:27:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310246+0000", 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1487e-05 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315594+0000", 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005347592 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315932+0000", 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033789099999999999 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.316549+0000", 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061698099999999995 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.317898+0000", 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013498799999999999 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319207+0000", 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013086969999999999 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319289+0000", 2024-09-10T06:27:11.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2259e-05 2024-09-10T06:27:11.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319346+0000", 2024-09-10T06:27:11.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6675999999999997e-05 2024-09-10T06:27:11.692 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.692 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.692 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.692 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.693 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:11.693 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.338195200000001, 2024-09-10T06:27:11.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003262778, 2024-09-10T06:27:11.693 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.693 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.693 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.693 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 212 2024-09-10T06:27:11.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.693 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336391+0000", 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5770000000000001e-06 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336403+0000", 2024-09-10T06:27:11.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2286000000000001e-05 2024-09-10T06:27:11.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336425+0000", 2024-09-10T06:27:11.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2164e-05 2024-09-10T06:27:11.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336440+0000", 2024-09-10T06:27:11.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4222999999999999e-05 2024-09-10T06:27:11.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336621+0000", 2024-09-10T06:27:11.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018136500000000001 2024-09-10T06:27:11.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336830+0000", 2024-09-10T06:27:11.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209125 2024-09-10T06:27:11.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.337206+0000", 2024-09-10T06:27:11.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037553700000000001 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.338527+0000", 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00132142 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339502+0000", 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00097512599999999999 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339585+0000", 2024-09-10T06:27:11.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2466000000000006e-05 2024-09-10T06:27:11.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339651+0000", 2024-09-10T06:27:11.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6489000000000007e-05 2024-09-10T06:27:11.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.698 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.698 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.698 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:11.698 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.313881661, 2024-09-10T06:27:11.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032440849999999999, 2024-09-10T06:27:11.699 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.699 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.699 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.699 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 219 2024-09-10T06:27:11.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.699 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:11.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:11.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360705+0000", 2024-09-10T06:27:11.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.593e-06 2024-09-10T06:27:11.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360716+0000", 2024-09-10T06:27:11.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1717e-05 2024-09-10T06:27:11.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360746+0000", 2024-09-10T06:27:11.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0233e-05 2024-09-10T06:27:11.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360761+0000", 2024-09-10T06:27:11.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4593000000000001e-05 2024-09-10T06:27:11.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360873+0000", 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111809 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361105+0000", 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023171800000000001 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361523+0000", 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000418694 2024-09-10T06:27:11.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.362840+0000", 2024-09-10T06:27:11.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013165570000000001 2024-09-10T06:27:11.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363793+0000", 2024-09-10T06:27:11.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095323200000000004 2024-09-10T06:27:11.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363880+0000", 2024-09-10T06:27:11.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6689999999999998e-05 2024-09-10T06:27:11.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363946+0000", 2024-09-10T06:27:11.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6248999999999995e-05 2024-09-10T06:27:11.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.704 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.704 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.704 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.704 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:11.704 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.296614808000001, 2024-09-10T06:27:11.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003271422, 2024-09-10T06:27:11.705 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.705 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.705 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.705 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.705 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.705 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.705 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 224 2024-09-10T06:27:11.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.705 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377971+0000", 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377983+0000", 2024-09-10T06:27:11.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1517e-05 2024-09-10T06:27:11.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378013+0000", 2024-09-10T06:27:11.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0476000000000001e-05 2024-09-10T06:27:11.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378028+0000", 2024-09-10T06:27:11.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5173e-05 2024-09-10T06:27:11.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378134+0000", 2024-09-10T06:27:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010533 2024-09-10T06:27:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378346+0000", 2024-09-10T06:27:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021175499999999999 2024-09-10T06:27:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378787+0000", 2024-09-10T06:27:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044190899999999999 2024-09-10T06:27:11.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.380237+0000", 2024-09-10T06:27:11.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001449093 2024-09-10T06:27:11.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381097+0000", 2024-09-10T06:27:11.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086022300000000002 2024-09-10T06:27:11.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381181+0000", 2024-09-10T06:27:11.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3973000000000004e-05 2024-09-10T06:27:11.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381240+0000", 2024-09-10T06:27:11.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9472999999999998e-05 2024-09-10T06:27:11.710 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.710 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.710 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.710 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.710 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.264947355, 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031998719999999999, 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 233 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:11.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:11.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409639+0000", 2024-09-10T06:27:11.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4770000000000002e-06 2024-09-10T06:27:11.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409652+0000", 2024-09-10T06:27:11.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3692999999999999e-05 2024-09-10T06:27:11.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409683+0000", 2024-09-10T06:27:11.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1080000000000001e-05 2024-09-10T06:27:11.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409699+0000", 2024-09-10T06:27:11.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5245999999999999e-05 2024-09-10T06:27:11.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409881+0000", 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000182709 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410088+0000", 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020630799999999999 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410495+0000", 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00040682700000000001 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.411805+0000", 2024-09-10T06:27:11.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013101059999999999 2024-09-10T06:27:11.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412672+0000", 2024-09-10T06:27:11.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086778699999999996 2024-09-10T06:27:11.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412769+0000", 2024-09-10T06:27:11.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6565999999999997e-05 2024-09-10T06:27:11.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412836+0000", 2024-09-10T06:27:11.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7073e-05 2024-09-10T06:27:11.716 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.716 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.716 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.716 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:353 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.716 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:11.716 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.224040040999999, 2024-09-10T06:27:11.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059710450000000003, 2024-09-10T06:27:11.717 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.717 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.717 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.717 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.717 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.717 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.717 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 353 2024-09-10T06:27:11.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.717 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:11.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:11.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450545+0000", 2024-09-10T06:27:11.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.423e-06 2024-09-10T06:27:11.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450551+0000", 2024-09-10T06:27:11.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7370000000000003e-06 2024-09-10T06:27:11.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450565+0000", 2024-09-10T06:27:11.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4649e-05 2024-09-10T06:27:11.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450574+0000", 2024-09-10T06:27:11.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5129999999999996e-06 2024-09-10T06:27:11.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450644+0000", 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0387000000000002e-05 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450818+0000", 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017368400000000001 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451030+0000", 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021189599999999999 2024-09-10T06:27:11.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451607+0000", 2024-09-10T06:27:11.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057672599999999995 2024-09-10T06:27:11.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456437+0000", 2024-09-10T06:27:11.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048301940000000003 2024-09-10T06:27:11.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456472+0000", 2024-09-10T06:27:11.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5178000000000001e-05 2024-09-10T06:27:11.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456515+0000", 2024-09-10T06:27:11.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2657999999999997e-05 2024-09-10T06:27:11.722 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.722 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.722 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.722 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:362 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.722 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:11.722 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.217592519, 2024-09-10T06:27:11.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044032239999999999, 2024-09-10T06:27:11.723 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.723 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.723 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.723 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.723 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.723 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.723 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 362 2024-09-10T06:27:11.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.723 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456992+0000", 2024-09-10T06:27:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6700000000000002e-07 2024-09-10T06:27:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456997+0000", 2024-09-10T06:27:11.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6249999999999998e-06 2024-09-10T06:27:11.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457005+0000", 2024-09-10T06:27:11.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6719999999999993e-06 2024-09-10T06:27:11.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457010+0000", 2024-09-10T06:27:11.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7360000000000001e-06 2024-09-10T06:27:11.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457054+0000", 2024-09-10T06:27:11.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4138999999999999e-05 2024-09-10T06:27:11.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457163+0000", 2024-09-10T06:27:11.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108558 2024-09-10T06:27:11.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457340+0000", 2024-09-10T06:27:11.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017730600000000001 2024-09-10T06:27:11.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.458065+0000", 2024-09-10T06:27:11.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00072480400000000001 2024-09-10T06:27:11.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461294+0000", 2024-09-10T06:27:11.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032287890000000001 2024-09-10T06:27:11.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461352+0000", 2024-09-10T06:27:11.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8502000000000003e-05 2024-09-10T06:27:11.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461394+0000", 2024-09-10T06:27:11.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2225999999999999e-05 2024-09-10T06:27:11.728 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.728 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.728 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.728 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:475 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.729 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:11.729 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.171742953999999, 2024-09-10T06:27:11.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046091930000000001, 2024-09-10T06:27:11.729 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.729 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.729 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.729 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.729 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 475 2024-09-10T06:27:11.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.729 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:11.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:11.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:11.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6100000000000001e-07 2024-09-10T06:27:11.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502844+0000", 2024-09-10T06:27:11.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0529999999999998e-06 2024-09-10T06:27:11.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502852+0000", 2024-09-10T06:27:11.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2579999999999995e-06 2024-09-10T06:27:11.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502857+0000", 2024-09-10T06:27:11.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3460000000000004e-06 2024-09-10T06:27:11.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502894+0000", 2024-09-10T06:27:11.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6884000000000001e-05 2024-09-10T06:27:11.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502942+0000", 2024-09-10T06:27:11.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7791999999999999e-05 2024-09-10T06:27:11.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.503048+0000", 2024-09-10T06:27:11.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010678799999999999 2024-09-10T06:27:11.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.506079+0000", 2024-09-10T06:27:11.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030311510000000002 2024-09-10T06:27:11.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507361+0000", 2024-09-10T06:27:11.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001281208 2024-09-10T06:27:11.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507400+0000", 2024-09-10T06:27:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9483000000000001e-05 2024-09-10T06:27:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507450+0000", 2024-09-10T06:27:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9669000000000002e-05 2024-09-10T06:27:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.735 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:477 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.735 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:11.735 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.169781836999999, 2024-09-10T06:27:11.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038544, 2024-09-10T06:27:11.735 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.735 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.735 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.735 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.735 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 477 2024-09-10T06:27:11.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.735 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504803+0000", 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9999999999999996e-07 2024-09-10T06:27:11.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504808+0000", 2024-09-10T06:27:11.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1909999999999999e-06 2024-09-10T06:27:11.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504818+0000", 2024-09-10T06:27:11.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0081999999999999e-05 2024-09-10T06:27:11.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504823+0000", 2024-09-10T06:27:11.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9969999999999998e-06 2024-09-10T06:27:11.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504870+0000", 2024-09-10T06:27:11.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6980000000000001e-05 2024-09-10T06:27:11.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504922+0000", 2024-09-10T06:27:11.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869000000000001e-05 2024-09-10T06:27:11.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505020+0000", 2024-09-10T06:27:11.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8010999999999994e-05 2024-09-10T06:27:11.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507789+0000", 2024-09-10T06:27:11.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027690219999999999 2024-09-10T06:27:11.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508599+0000", 2024-09-10T06:27:11.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081037800000000005 2024-09-10T06:27:11.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508631+0000", 2024-09-10T06:27:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.137e-05 2024-09-10T06:27:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508656+0000", 2024-09-10T06:27:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5599999999999999e-05 2024-09-10T06:27:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.740 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:478 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.741 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:11.741 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.169734935000001, 2024-09-10T06:27:11.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039361880000000002, 2024-09-10T06:27:11.741 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.741 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.741 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.741 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.741 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.741 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.741 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 478 2024-09-10T06:27:11.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.741 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:11.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:11.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:11.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7800000000000001e-07 2024-09-10T06:27:11.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504853+0000", 2024-09-10T06:27:11.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2780000000000002e-06 2024-09-10T06:27:11.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504858+0000", 2024-09-10T06:27:11.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7359999999999998e-06 2024-09-10T06:27:11.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504862+0000", 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6650000000000001e-06 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504938+0000", 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6286999999999997e-05 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505091+0000", 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152385 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:11.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505335+0000", 2024-09-10T06:27:11.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244281 2024-09-10T06:27:11.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507764+0000", 2024-09-10T06:27:11.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002429624 2024-09-10T06:27:11.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508681+0000", 2024-09-10T06:27:11.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00091630100000000001 2024-09-10T06:27:11.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508747+0000", 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5733000000000002e-05 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508785+0000", 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8319999999999999e-05 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.923603015000001, 2024-09-10T06:27:11.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030732350000000001, 2024-09-10T06:27:11.747 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.747 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.747 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.747 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.747 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.747 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.747 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 733 2024-09-10T06:27:11.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.747 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:11.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:11.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750983+0000", 2024-09-10T06:27:11.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8880000000000001e-06 2024-09-10T06:27:11.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750996+0000", 2024-09-10T06:27:11.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2048999999999999e-05 2024-09-10T06:27:11.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751024+0000", 2024-09-10T06:27:11.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8802e-05 2024-09-10T06:27:11.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751043+0000", 2024-09-10T06:27:11.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8266000000000001e-05 2024-09-10T06:27:11.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751191+0000", 2024-09-10T06:27:11.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014818200000000001 2024-09-10T06:27:11.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751417+0000", 2024-09-10T06:27:11.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022648199999999999 2024-09-10T06:27:11.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751747+0000", 2024-09-10T06:27:11.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032945000000000001 2024-09-10T06:27:11.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.752752+0000", 2024-09-10T06:27:11.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010054790000000001 2024-09-10T06:27:11.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753896+0000", 2024-09-10T06:27:11.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001143638 2024-09-10T06:27:11.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753989+0000", 2024-09-10T06:27:11.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3466000000000003e-05 2024-09-10T06:27:11.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.754054+0000", 2024-09-10T06:27:11.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4533e-05 2024-09-10T06:27:11.753 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.753 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.753 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.883122469, 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002896722, 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 751 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791464+0000", 2024-09-10T06:27:11.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7140000000000002e-06 2024-09-10T06:27:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791475+0000", 2024-09-10T06:27:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1535999999999999e-05 2024-09-10T06:27:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791501+0000", 2024-09-10T06:27:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5276e-05 2024-09-10T06:27:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791514+0000", 2024-09-10T06:27:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3203e-05 2024-09-10T06:27:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791643+0000", 2024-09-10T06:27:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012961900000000001 2024-09-10T06:27:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791857+0000", 2024-09-10T06:27:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021351599999999999 2024-09-10T06:27:11.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.792178+0000", 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032090999999999999 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.793281+0000", 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001103319 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794209+0000", 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000927676 2024-09-10T06:27:11.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794295+0000", 2024-09-10T06:27:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5682999999999999e-05 2024-09-10T06:27:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794358+0000", 2024-09-10T06:27:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3269999999999996e-05 2024-09-10T06:27:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.879234971999999, 2024-09-10T06:27:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030558059999999999, 2024-09-10T06:27:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 753 2024-09-10T06:27:11.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795352+0000", 2024-09-10T06:27:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0130000000000002e-06 2024-09-10T06:27:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795364+0000", 2024-09-10T06:27:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1939999999999999e-05 2024-09-10T06:27:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795395+0000", 2024-09-10T06:27:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0976999999999998e-05 2024-09-10T06:27:11.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795413+0000", 2024-09-10T06:27:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7980000000000001e-05 2024-09-10T06:27:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795533+0000", 2024-09-10T06:27:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120732 2024-09-10T06:27:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795665+0000", 2024-09-10T06:27:11.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013215899999999999 2024-09-10T06:27:11.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795931+0000", 2024-09-10T06:27:11.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026536499999999999 2024-09-10T06:27:11.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.796995+0000", 2024-09-10T06:27:11.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001064611 2024-09-10T06:27:11.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798256+0000", 2024-09-10T06:27:11.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00126022 2024-09-10T06:27:11.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798340+0000", 2024-09-10T06:27:11.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4753000000000007e-05 2024-09-10T06:27:11.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798404+0000", 2024-09-10T06:27:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4055999999999998e-05 2024-09-10T06:27:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.764026731000001, 2024-09-10T06:27:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031632380000000001, 2024-09-10T06:27:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.766 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 805 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910560+0000", 2024-09-10T06:27:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2200000000000001e-06 2024-09-10T06:27:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910574+0000", 2024-09-10T06:27:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3536000000000001e-05 2024-09-10T06:27:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910604+0000", 2024-09-10T06:27:11.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0645999999999998e-05 2024-09-10T06:27:11.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910619+0000", 2024-09-10T06:27:11.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5064e-05 2024-09-10T06:27:11.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910759+0000", 2024-09-10T06:27:11.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013943899999999999 2024-09-10T06:27:11.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910984+0000", 2024-09-10T06:27:11.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000225381 2024-09-10T06:27:11.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.911312+0000", 2024-09-10T06:27:11.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032782800000000001 2024-09-10T06:27:11.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.912402+0000", 2024-09-10T06:27:11.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010895639999999999 2024-09-10T06:27:11.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913576+0000", 2024-09-10T06:27:11.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174591 2024-09-10T06:27:11.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913657+0000", 2024-09-10T06:27:11.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1223000000000005e-05 2024-09-10T06:27:11.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913720+0000", 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2745999999999999e-05 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.704248996, 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030680099999999999, 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.772 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.773 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 832 2024-09-10T06:27:11.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.773 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:11.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:11.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970337+0000", 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6230000000000001e-06 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970349+0000", 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1557e-05 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970379+0000", 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0456000000000001e-05 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970394+0000", 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4683e-05 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970509+0000", 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114613 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970753+0000", 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244295 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:11.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.971078+0000", 2024-09-10T06:27:11.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000325583 2024-09-10T06:27:11.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.972162+0000", 2024-09-10T06:27:11.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010834519999999999 2024-09-10T06:27:11.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973200+0000", 2024-09-10T06:27:11.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010376560000000001 2024-09-10T06:27:11.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973287+0000", 2024-09-10T06:27:11.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7163000000000006e-05 2024-09-10T06:27:11.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973403+0000", 2024-09-10T06:27:11.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011592899999999999 2024-09-10T06:27:11.777 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.777 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.777 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.549177769, 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030018599999999999, 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 901 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125409+0000", 2024-09-10T06:27:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.253e-06 2024-09-10T06:27:11.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125425+0000", 2024-09-10T06:27:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5636000000000001e-05 2024-09-10T06:27:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125456+0000", 2024-09-10T06:27:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1130000000000002e-05 2024-09-10T06:27:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125470+0000", 2024-09-10T06:27:11.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.464e-05 2024-09-10T06:27:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125581+0000", 2024-09-10T06:27:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110612 2024-09-10T06:27:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125814+0000", 2024-09-10T06:27:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023266899999999999 2024-09-10T06:27:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.126159+0000", 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034565399999999998 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.127161+0000", 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010020890000000001 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128202+0000", 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001040242 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128288+0000", 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6156000000000007e-05 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128408+0000", 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011977900000000001 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.5150854, 2024-09-10T06:27:11.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029016649999999999, 2024-09-10T06:27:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 916 2024-09-10T06:27:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159501+0000", 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159512+0000", 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1564e-05 2024-09-10T06:27:11.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159543+0000", 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0942999999999998e-05 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159558+0000", 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.436e-05 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159701+0000", 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014363599999999999 2024-09-10T06:27:11.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159927+0000", 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022535099999999999 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.160260+0000", 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033321700000000002 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.161312+0000", 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001052222 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162261+0000", 2024-09-10T06:27:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00094912600000000001 2024-09-10T06:27:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162337+0000", 2024-09-10T06:27:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6268999999999998e-05 2024-09-10T06:27:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162400+0000", 2024-09-10T06:27:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2477000000000005e-05 2024-09-10T06:27:11.788 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.444775888999999, 2024-09-10T06:27:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030045179999999999, 2024-09-10T06:27:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:11.789 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 946 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229810+0000", 2024-09-10T06:27:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:27:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229838+0000", 2024-09-10T06:27:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7776e-05 2024-09-10T06:27:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229869+0000", 2024-09-10T06:27:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0766999999999999e-05 2024-09-10T06:27:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229883+0000", 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4423000000000001e-05 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230005+0000", 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121919 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230219+0000", 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000214098 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230588+0000", 2024-09-10T06:27:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036857099999999999 2024-09-10T06:27:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.231707+0000", 2024-09-10T06:27:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011193349999999999 2024-09-10T06:27:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232662+0000", 2024-09-10T06:27:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095513300000000005 2024-09-10T06:27:11.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232748+0000", 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6151999999999998e-05 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232812+0000", 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3876999999999998e-05 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:11.794 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:11.796 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:27:11.796 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:11.794+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:11.893 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-10T06:27:11.897 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:11.894+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:11.971 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:11.971 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:11.971 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:11.972 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:11.985 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:27:12.029 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:12.030+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:12.098 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:12.098 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:12.098 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:12.098 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:12.098 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:12.098 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:12.098+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:12.110 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:27:12.198 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:12.198+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:12.277 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:12.277 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:12.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:12.277 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:12.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.278 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4236.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T06:27:12.278 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:12.278 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.769505930000001, 2024-09-10T06:27:12.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049682550000000004, 2024-09-10T06:27:12.278 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.278 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.278 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.278 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:12.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507427+0000", 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5629999999999999e-06 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507439+0000", 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.19e-05 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507460+0000", 2024-09-10T06:27:12.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1693000000000001e-05 2024-09-10T06:27:12.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507480+0000", 2024-09-10T06:27:12.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9947000000000001e-05 2024-09-10T06:27:12.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507613+0000", 2024-09-10T06:27:12.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000132409 2024-09-10T06:27:12.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507696+0000", 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2953000000000004e-05 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512288+0000", 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045927110000000002 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512393+0000", 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105079 2024-09-10T06:27:12.281 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.282 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.282 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.282 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:12.282 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:12.282 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 37.946041897999997, 2024-09-10T06:27:12.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025692739999999999, 2024-09-10T06:27:12.282 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.282 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.282 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:12.282 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 42 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330891+0000", 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9700000000000002e-06 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330901+0000", 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2909999999999996e-06 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330924+0000", 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3132000000000001e-05 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330935+0000", 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0893999999999999e-05 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331021+0000", 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6205000000000006e-05 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331160+0000", 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013973600000000001 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:12.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331336+0000", 2024-09-10T06:27:12.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017578799999999999 2024-09-10T06:27:12.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.332381+0000", 2024-09-10T06:27:12.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001044627 2024-09-10T06:27:12.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333371+0000", 2024-09-10T06:27:12.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098979800000000007 2024-09-10T06:27:12.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333421+0000", 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9872e-05 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333459+0000", 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7960999999999998e-05 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:12.287 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:12.288 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 33.960850978000003, 2024-09-10T06:27:12.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025247730000000001, 2024-09-10T06:27:12.288 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.288 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.288 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.288 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.288 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.288 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.288 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 52 2024-09-10T06:27:12.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.288 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316084+0000", 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8260000000000003e-06 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316095+0000", 2024-09-10T06:27:12.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1229999999999999e-05 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316131+0000", 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5499e-05 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316150+0000", 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9510000000000001e-05 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316275+0000", 2024-09-10T06:27:12.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012501600000000001 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316507+0000", 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000231404 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316712+0000", 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204873 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.317603+0000", 2024-09-10T06:27:12.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089174399999999998 2024-09-10T06:27:12.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318470+0000", 2024-09-10T06:27:12.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086713399999999998 2024-09-10T06:27:12.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318552+0000", 2024-09-10T06:27:12.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1279999999999994e-05 2024-09-10T06:27:12.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318605+0000", 2024-09-10T06:27:12.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3257000000000002e-05 2024-09-10T06:27:12.293 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.293 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.293 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.293 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.293 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:12.293 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.857072648999999, 2024-09-10T06:27:12.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033383480000000001, 2024-09-10T06:27:12.293 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.293 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.293 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.293 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 236 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419861+0000", 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.734e-06 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419873+0000", 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1789e-05 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419904+0000", 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1377000000000001e-05 2024-09-10T06:27:12.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419921+0000", 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6878999999999999e-05 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420052+0000", 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013025600000000001 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420263+0000", 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021196600000000001 2024-09-10T06:27:12.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:12.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420649+0000", 2024-09-10T06:27:12.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038507 2024-09-10T06:27:12.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.422366+0000", 2024-09-10T06:27:12.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017172000000000001 2024-09-10T06:27:12.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423048+0000", 2024-09-10T06:27:12.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00068254100000000005 2024-09-10T06:27:12.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423127+0000", 2024-09-10T06:27:12.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8207000000000005e-05 2024-09-10T06:27:12.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423197+0000", 2024-09-10T06:27:12.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0328999999999997e-05 2024-09-10T06:27:12.298 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.298 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.298 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.299 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.299 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:12.299 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.840471375, 2024-09-10T06:27:12.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003575235, 2024-09-10T06:27:12.299 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.299 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.299 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.299 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 299 2024-09-10T06:27:12.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436461+0000", 2024-09-10T06:27:12.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.144e-06 2024-09-10T06:27:12.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436466+0000", 2024-09-10T06:27:12.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8409999999999999e-06 2024-09-10T06:27:12.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436477+0000", 2024-09-10T06:27:12.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1253000000000001e-05 2024-09-10T06:27:12.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436483+0000", 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7010000000000001e-06 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436527+0000", 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4381000000000001e-05 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436569+0000", 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2208e-05 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:12.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436687+0000", 2024-09-10T06:27:12.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118093 2024-09-10T06:27:12.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.437455+0000", 2024-09-10T06:27:12.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076799599999999996 2024-09-10T06:27:12.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439950+0000", 2024-09-10T06:27:12.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024946040000000001 2024-09-10T06:27:12.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439988+0000", 2024-09-10T06:27:12.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8405999999999998e-05 2024-09-10T06:27:12.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.440035+0000", 2024-09-10T06:27:12.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6607999999999998e-05 2024-09-10T06:27:12.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.304 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.304 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.304 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.305 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:12.305 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.505795292999998, 2024-09-10T06:27:12.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028833040000000002, 2024-09-10T06:27:12.305 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.305 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.305 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.305 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.305 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 742 2024-09-10T06:27:12.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.305 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771139+0000", 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5269999999999999e-06 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771153+0000", 2024-09-10T06:27:12.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4036000000000001e-05 2024-09-10T06:27:12.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771186+0000", 2024-09-10T06:27:12.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2113000000000002e-05 2024-09-10T06:27:12.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771201+0000", 2024-09-10T06:27:12.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:12.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771320+0000", 2024-09-10T06:27:12.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119265 2024-09-10T06:27:12.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771557+0000", 2024-09-10T06:27:12.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023640600000000001 2024-09-10T06:27:12.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:12.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771890+0000", 2024-09-10T06:27:12.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033302000000000001 2024-09-10T06:27:12.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773204+0000", 2024-09-10T06:27:12.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013142239999999999 2024-09-10T06:27:12.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773864+0000", 2024-09-10T06:27:12.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066005100000000004 2024-09-10T06:27:12.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773948+0000", 2024-09-10T06:27:12.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4625999999999999e-05 2024-09-10T06:27:12.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774019+0000", 2024-09-10T06:27:12.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0705999999999997e-05 2024-09-10T06:27:12.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.310 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.310 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.310 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.311 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:12.311 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.502016043000001, 2024-09-10T06:27:12.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025263479999999999, 2024-09-10T06:27:12.311 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.311 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.311 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.311 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.311 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 744 2024-09-10T06:27:12.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.311 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:12.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:12.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774917+0000", 2024-09-10T06:27:12.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0540000000000002e-06 2024-09-10T06:27:12.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774926+0000", 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5660000000000007e-06 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774947+0000", 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0852999999999998e-05 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774958+0000", 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1216999999999999e-05 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775045+0000", 2024-09-10T06:27:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7643000000000001e-05 2024-09-10T06:27:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775167+0000", 2024-09-10T06:27:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012163900000000001 2024-09-10T06:27:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775427+0000", 2024-09-10T06:27:12.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000259678 2024-09-10T06:27:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.776736+0000", 2024-09-10T06:27:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013093429999999999 2024-09-10T06:27:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777296+0000", 2024-09-10T06:27:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056029599999999995 2024-09-10T06:27:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777374+0000", 2024-09-10T06:27:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7721999999999999e-05 2024-09-10T06:27:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777441+0000", 2024-09-10T06:27:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7336999999999996e-05 2024-09-10T06:27:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:12.316 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.464700496999999, 2024-09-10T06:27:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036412979999999998, 2024-09-10T06:27:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 760 2024-09-10T06:27:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:12.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812233+0000", 2024-09-10T06:27:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812244+0000", 2024-09-10T06:27:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1273e-05 2024-09-10T06:27:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812276+0000", 2024-09-10T06:27:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1253e-05 2024-09-10T06:27:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812290+0000", 2024-09-10T06:27:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4576000000000001e-05 2024-09-10T06:27:12.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812438+0000", 2024-09-10T06:27:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014775899999999999 2024-09-10T06:27:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812821+0000", 2024-09-10T06:27:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000383187 2024-09-10T06:27:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:12.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.813398+0000", 2024-09-10T06:27:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000576619 2024-09-10T06:27:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.814658+0000", 2024-09-10T06:27:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001260207 2024-09-10T06:27:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815591+0000", 2024-09-10T06:27:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00093332899999999999 2024-09-10T06:27:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815745+0000", 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153392 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815872+0000", 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012715599999999999 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:12.322 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.460065112999999, 2024-09-10T06:27:12.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029417369999999998, 2024-09-10T06:27:12.323 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.323 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.323 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.323 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.323 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.323 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.323 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 762 2024-09-10T06:27:12.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.323 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:12.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816868+0000", 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.283e-06 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816879+0000", 2024-09-10T06:27:12.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0523000000000001e-05 2024-09-10T06:27:12.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816910+0000", 2024-09-10T06:27:12.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0732999999999999e-05 2024-09-10T06:27:12.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816926+0000", 2024-09-10T06:27:12.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.677e-05 2024-09-10T06:27:12.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817058+0000", 2024-09-10T06:27:12.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013195599999999999 2024-09-10T06:27:12.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817299+0000", 2024-09-10T06:27:12.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000241091 2024-09-10T06:27:12.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:12.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817761+0000", 2024-09-10T06:27:12.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046188400000000003 2024-09-10T06:27:12.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.818948+0000", 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819662+0000", 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071398399999999997 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819745+0000", 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3560000000000006e-05 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819808+0000", 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2329000000000006e-05 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.339604395999999, 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002834175, 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.328 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.329 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.329 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 817 2024-09-10T06:27:12.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.329 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:12.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:12.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937330+0000", 2024-09-10T06:27:12.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9869999999999999e-06 2024-09-10T06:27:12.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937342+0000", 2024-09-10T06:27:12.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2595999999999999e-05 2024-09-10T06:27:12.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937375+0000", 2024-09-10T06:27:12.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2320000000000002e-05 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937390+0000", 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4977000000000001e-05 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937529+0000", 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013937199999999999 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937753+0000", 2024-09-10T06:27:12.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000224358 2024-09-10T06:27:12.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:12.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.938061+0000", 2024-09-10T06:27:12.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030808799999999998 2024-09-10T06:27:12.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.939112+0000", 2024-09-10T06:27:12.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010503050000000001 2024-09-10T06:27:12.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940005+0000", 2024-09-10T06:27:12.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089366599999999999 2024-09-10T06:27:12.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940093+0000", 2024-09-10T06:27:12.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8053000000000006e-05 2024-09-10T06:27:12.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940161+0000", 2024-09-10T06:27:12.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7453000000000006e-05 2024-09-10T06:27:12.333 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.333 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.334 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.334 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.334 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:12.334 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.286676354000001, 2024-09-10T06:27:12.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027552649999999998, 2024-09-10T06:27:12.334 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.334 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.334 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.334 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 841 2024-09-10T06:27:12.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.335 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:12.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:12.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990257+0000", 2024-09-10T06:27:12.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6869999999999999e-06 2024-09-10T06:27:12.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990270+0000", 2024-09-10T06:27:12.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2843000000000001e-05 2024-09-10T06:27:12.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990300+0000", 2024-09-10T06:27:12.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9252999999999999e-05 2024-09-10T06:27:12.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990314+0000", 2024-09-10T06:27:12.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4796e-05 2024-09-10T06:27:12.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990427+0000", 2024-09-10T06:27:12.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112649 2024-09-10T06:27:12.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990671+0000", 2024-09-10T06:27:12.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244408 2024-09-10T06:27:12.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:12.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990987+0000", 2024-09-10T06:27:12.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031593099999999998 2024-09-10T06:27:12.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992073+0000", 2024-09-10T06:27:12.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010854549999999999 2024-09-10T06:27:12.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992862+0000", 2024-09-10T06:27:12.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00078889400000000005 2024-09-10T06:27:12.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992944+0000", 2024-09-10T06:27:12.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2152999999999998e-05 2024-09-10T06:27:12.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993010+0000", 2024-09-10T06:27:12.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6196000000000001e-05 2024-09-10T06:27:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.282940419999999, 2024-09-10T06:27:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025373539999999999, 2024-09-10T06:27:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.340 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.341 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.341 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 843 2024-09-10T06:27:12.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.341 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:12.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:12.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993993+0000", 2024-09-10T06:27:12.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3630000000000001e-06 2024-09-10T06:27:12.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994004+0000", 2024-09-10T06:27:12.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0557000000000001e-05 2024-09-10T06:27:12.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994035+0000", 2024-09-10T06:27:12.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0969000000000001e-05 2024-09-10T06:27:12.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994055+0000", 2024-09-10T06:27:12.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0497e-05 2024-09-10T06:27:12.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994150+0000", 2024-09-10T06:27:12.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5363000000000002e-05 2024-09-10T06:27:12.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994275+0000", 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012453200000000001 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994570+0000", 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029522100000000003 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.995569+0000", 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00099913200000000001 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996384+0000", 2024-09-10T06:27:12.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081451099999999997 2024-09-10T06:27:12.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996462+0000", 2024-09-10T06:27:12.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8502000000000002e-05 2024-09-10T06:27:12.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996528+0000", 2024-09-10T06:27:12.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5707e-05 2024-09-10T06:27:12.346 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.346 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.346 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.346 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.346 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:12.346 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.273493273, 2024-09-10T06:27:12.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033145539999999999, 2024-09-10T06:27:12.346 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.346 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.346 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.347 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.347 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.347 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 847 2024-09-10T06:27:12.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.347 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:12.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:12.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003440+0000", 2024-09-10T06:27:12.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5299999999999999e-06 2024-09-10T06:27:12.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003452+0000", 2024-09-10T06:27:12.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:12.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003482+0000", 2024-09-10T06:27:12.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0790000000000002e-05 2024-09-10T06:27:12.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003497+0000", 2024-09-10T06:27:12.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.489e-05 2024-09-10T06:27:12.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003645+0000", 2024-09-10T06:27:12.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014771900000000001 2024-09-10T06:27:12.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003996+0000", 2024-09-10T06:27:12.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000350861 2024-09-10T06:27:12.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:12.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.004540+0000", 2024-09-10T06:27:12.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054383199999999995 2024-09-10T06:27:12.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.005831+0000", 2024-09-10T06:27:12.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001291366 2024-09-10T06:27:12.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006461+0000", 2024-09-10T06:27:12.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062943899999999998 2024-09-10T06:27:12.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006631+0000", 2024-09-10T06:27:12.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000170228 2024-09-10T06:27:12.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006752+0000", 2024-09-10T06:27:12.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012160899999999999 2024-09-10T06:27:12.352 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.352 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.352 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.352 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.352 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:12.352 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.269240106000002, 2024-09-10T06:27:12.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002619953, 2024-09-10T06:27:12.352 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.352 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.352 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.353 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.353 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.353 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.353 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 849 2024-09-10T06:27:12.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.353 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:12.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:12.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007693+0000", 2024-09-10T06:27:12.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3099999999999999e-06 2024-09-10T06:27:12.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007704+0000", 2024-09-10T06:27:12.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0387000000000001e-05 2024-09-10T06:27:12.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007734+0000", 2024-09-10T06:27:12.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0676000000000002e-05 2024-09-10T06:27:12.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007753+0000", 2024-09-10T06:27:12.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.836e-05 2024-09-10T06:27:12.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007857+0000", 2024-09-10T06:27:12.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103836 2024-09-10T06:27:12.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007980+0000", 2024-09-10T06:27:12.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123843 2024-09-10T06:27:12.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:12.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.008241+0000", 2024-09-10T06:27:12.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026085799999999999 2024-09-10T06:27:12.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.009475+0000", 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012340230000000001 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010168+0000", 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00069220800000000004 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010247+0000", 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9929e-05 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010311+0000", 2024-09-10T06:27:12.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3522999999999995e-05 2024-09-10T06:27:12.358 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.358 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.358 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.358 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.358 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:12.358 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.224760284999999, 2024-09-10T06:27:12.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026646590000000002, 2024-09-10T06:27:12.358 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.358 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.358 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.358 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.359 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.359 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.359 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 868 2024-09-10T06:27:12.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.359 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:12.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:12.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052173+0000", 2024-09-10T06:27:12.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-10T06:27:12.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052186+0000", 2024-09-10T06:27:12.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2787e-05 2024-09-10T06:27:12.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052216+0000", 2024-09-10T06:27:12.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9618999999999999e-05 2024-09-10T06:27:12.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052231+0000", 2024-09-10T06:27:12.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4929999999999999e-05 2024-09-10T06:27:12.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052349+0000", 2024-09-10T06:27:12.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011830200000000001 2024-09-10T06:27:12.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052561+0000", 2024-09-10T06:27:12.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000212182 2024-09-10T06:27:12.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:12.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052874+0000", 2024-09-10T06:27:12.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031299399999999998 2024-09-10T06:27:12.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054049+0000", 2024-09-10T06:27:12.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174825 2024-09-10T06:27:12.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054635+0000", 2024-09-10T06:27:12.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058643900000000001 2024-09-10T06:27:12.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054721+0000", 2024-09-10T06:27:12.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5185999999999994e-05 2024-09-10T06:27:12.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054836+0000", 2024-09-10T06:27:12.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114922 2024-09-10T06:27:12.367 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.367 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.367 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.368 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.368 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:12.368 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.138104183999999, 2024-09-10T06:27:12.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028453739999999999, 2024-09-10T06:27:12.368 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.368 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.368 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.368 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.368 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.368 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.368 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 907 2024-09-10T06:27:12.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.368 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:12.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:12.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138830+0000", 2024-09-10T06:27:12.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8600000000000001e-06 2024-09-10T06:27:12.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138842+0000", 2024-09-10T06:27:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2126e-05 2024-09-10T06:27:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138874+0000", 2024-09-10T06:27:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2047e-05 2024-09-10T06:27:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138889+0000", 2024-09-10T06:27:12.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4966999999999999e-05 2024-09-10T06:27:12.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139007+0000", 2024-09-10T06:27:12.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118479 2024-09-10T06:27:12.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139238+0000", 2024-09-10T06:27:12.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023031399999999999 2024-09-10T06:27:12.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:12.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139566+0000", 2024-09-10T06:27:12.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032816099999999999 2024-09-10T06:27:12.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.140631+0000", 2024-09-10T06:27:12.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010653679999999999 2024-09-10T06:27:12.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141393+0000", 2024-09-10T06:27:12.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076187100000000001 2024-09-10T06:27:12.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141561+0000", 2024-09-10T06:27:12.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016755599999999999 2024-09-10T06:27:12.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141672+0000", 2024-09-10T06:27:12.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111625 2024-09-10T06:27:12.373 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.373 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.373 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.374 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.374 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:12.374 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.134180667999999, 2024-09-10T06:27:12.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002857268, 2024-09-10T06:27:12.374 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.374 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.374 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.374 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 909 2024-09-10T06:27:12.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142753+0000", 2024-09-10T06:27:12.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4040000000000002e-06 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142764+0000", 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0789e-05 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142795+0000", 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0982999999999998e-05 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142810+0000", 2024-09-10T06:27:12.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4960000000000001e-05 2024-09-10T06:27:12.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142908+0000", 2024-09-10T06:27:12.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8726000000000003e-05 2024-09-10T06:27:12.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143030+0000", 2024-09-10T06:27:12.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121649 2024-09-10T06:27:12.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143294+0000", 2024-09-10T06:27:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000263875 2024-09-10T06:27:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.144530+0000", 2024-09-10T06:27:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001236067 2024-09-10T06:27:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145340+0000", 2024-09-10T06:27:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080966700000000003 2024-09-10T06:27:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145497+0000", 2024-09-10T06:27:12.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015773499999999999 2024-09-10T06:27:12.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145608+0000", 2024-09-10T06:27:12.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110413 2024-09-10T06:27:12.379 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.379 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.379 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.379 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.380 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:12.380 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.040483171000002, 2024-09-10T06:27:12.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029166940000000001, 2024-09-10T06:27:12.380 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.380 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.380 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.380 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.380 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.380 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.380 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 949 2024-09-10T06:27:12.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.380 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:12.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:12.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236451+0000", 2024-09-10T06:27:12.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:27:12.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236464+0000", 2024-09-10T06:27:12.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3223e-05 2024-09-10T06:27:12.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236497+0000", 2024-09-10T06:27:12.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2672999999999997e-05 2024-09-10T06:27:12.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236515+0000", 2024-09-10T06:27:12.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8386999999999999e-05 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236636+0000", 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120752 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236857+0000", 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022134499999999999 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.237188+0000", 2024-09-10T06:27:12.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033057799999999999 2024-09-10T06:27:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.238353+0000", 2024-09-10T06:27:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001164841 2024-09-10T06:27:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239160+0000", 2024-09-10T06:27:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080743000000000004 2024-09-10T06:27:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239245+0000", 2024-09-10T06:27:12.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5189e-05 2024-09-10T06:27:12.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239365+0000", 2024-09-10T06:27:12.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119406 2024-09-10T06:27:12.385 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.385 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.385 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.385 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.385 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:12.386 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.036622063999999, 2024-09-10T06:27:12.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025033970000000001, 2024-09-10T06:27:12.386 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.386 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.386 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.386 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.386 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.386 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.386 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 951 2024-09-10T06:27:12.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.386 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:12.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:12.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240311+0000", 2024-09-10T06:27:12.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8899999999999999e-06 2024-09-10T06:27:12.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240320+0000", 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6799999999999999e-06 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240341+0000", 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1379e-05 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240352+0000", 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1354e-05 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240450+0000", 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7866000000000001e-05 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240580+0000", 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012970899999999999 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240851+0000", 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027059099999999998 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242052+0000", 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001201014 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242662+0000", 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061076800000000003 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242747+0000", 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5019999999999996e-05 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242812+0000", 2024-09-10T06:27:12.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5126e-05 2024-09-10T06:27:12.391 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.391 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.391 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.391 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.391 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:12.391 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.026172644999999, 2024-09-10T06:27:12.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027897120000000002, 2024-09-10T06:27:12.391 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.392 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.392 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.392 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 955 2024-09-10T06:27:12.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.392 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:12.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:12.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250761+0000", 2024-09-10T06:27:12.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:12.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250772+0000", 2024-09-10T06:27:12.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1153e-05 2024-09-10T06:27:12.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250802+0000", 2024-09-10T06:27:12.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-05 2024-09-10T06:27:12.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250817+0000", 2024-09-10T06:27:12.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4883e-05 2024-09-10T06:27:12.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250925+0000", 2024-09-10T06:27:12.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108249 2024-09-10T06:27:12.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251139+0000", 2024-09-10T06:27:12.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000213568 2024-09-10T06:27:12.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:12.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251450+0000", 2024-09-10T06:27:12.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031139200000000002 2024-09-10T06:27:12.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.252574+0000", 2024-09-10T06:27:12.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011239139999999999 2024-09-10T06:27:12.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253377+0000", 2024-09-10T06:27:12.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080306400000000003 2024-09-10T06:27:12.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253466+0000", 2024-09-10T06:27:12.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8436000000000005e-05 2024-09-10T06:27:12.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253548+0000", 2024-09-10T06:27:12.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2496000000000004e-05 2024-09-10T06:27:12.397 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.397 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.397 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.397 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.397 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.397 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:12.399 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:27:12.399 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:12.394+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:12.499 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:12.498+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:12.561 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:12.561 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:12.561 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:12.561 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:12.575 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:27:12.600 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:12.598+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:12.701 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:12.698+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:12.702 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:12.702 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:12.702 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:12.717 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:27:12.801 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:12.802+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:12.841 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:12.841 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:12.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:12.841 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:12.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.841 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:12.842 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:12.842 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.515731866000003, 2024-09-10T06:27:12.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030326279999999999, 2024-09-10T06:27:12.842 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.842 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.842 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.842 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.842 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.842 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.842 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 58 2024-09-10T06:27:12.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.842 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:12.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:12.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:12.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-10T06:27:12.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324169+0000", 2024-09-10T06:27:12.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9020000000000004e-06 2024-09-10T06:27:12.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324182+0000", 2024-09-10T06:27:12.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2166e-05 2024-09-10T06:27:12.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324190+0000", 2024-09-10T06:27:12.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.337e-06 2024-09-10T06:27:12.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324282+0000", 2024-09-10T06:27:12.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2331999999999996e-05 2024-09-10T06:27:12.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324486+0000", 2024-09-10T06:27:12.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020347400000000001 2024-09-10T06:27:12.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:12.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324719+0000", 2024-09-10T06:27:12.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023289900000000001 2024-09-10T06:27:12.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.325993+0000", 2024-09-10T06:27:12.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012746929999999999 2024-09-10T06:27:12.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327088+0000", 2024-09-10T06:27:12.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010947330000000001 2024-09-10T06:27:12.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327147+0000", 2024-09-10T06:27:12.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8677000000000001e-05 2024-09-10T06:27:12.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327195+0000", 2024-09-10T06:27:12.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8469e-05 2024-09-10T06:27:12.848 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.848 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.848 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.848 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:12.848 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:12.848 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.533911283999998, 2024-09-10T06:27:12.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003846917, 2024-09-10T06:27:12.848 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.848 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.848 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.848 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 207 2024-09-10T06:27:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:12.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305987+0000", 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6069999999999999e-06 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306002+0000", 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5406000000000001e-05 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306036+0000", 2024-09-10T06:27:12.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4146000000000001e-05 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306061+0000", 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4470000000000001e-05 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306325+0000", 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026382800000000002 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306569+0000", 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024445499999999998 2024-09-10T06:27:12.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.307017+0000", 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044774000000000002 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.308517+0000", 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001500075 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309685+0000", 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001168505 2024-09-10T06:27:12.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309767+0000", 2024-09-10T06:27:12.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1992999999999999e-05 2024-09-10T06:27:12.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309830+0000", 2024-09-10T06:27:12.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2692000000000002e-05 2024-09-10T06:27:12.853 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.853 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.853 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.489659236000001, 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003433888, 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 216 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:12.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:12.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350239+0000", 2024-09-10T06:27:12.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.377e-06 2024-09-10T06:27:12.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350254+0000", 2024-09-10T06:27:12.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.501e-05 2024-09-10T06:27:12.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350288+0000", 2024-09-10T06:27:12.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4746000000000002e-05 2024-09-10T06:27:12.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350312+0000", 2024-09-10T06:27:12.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3249999999999999e-05 2024-09-10T06:27:12.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350456+0000", 2024-09-10T06:27:12.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014483899999999999 2024-09-10T06:27:12.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350704+0000", 2024-09-10T06:27:12.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024719100000000001 2024-09-10T06:27:12.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:12.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.351117+0000", 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000412934 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.352644+0000", 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015271079999999999 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353397+0000", 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075311799999999999 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353556+0000", 2024-09-10T06:27:12.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159612 2024-09-10T06:27:12.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353669+0000", 2024-09-10T06:27:12.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011270299999999999 2024-09-10T06:27:12.859 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.859 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.859 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.859 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.859 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:12.859 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.450979774, 2024-09-10T06:27:12.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033447479999999998, 2024-09-10T06:27:12.860 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.860 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.860 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.860 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.860 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.860 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.860 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 227 2024-09-10T06:27:12.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.860 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:12.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:12.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388917+0000", 2024-09-10T06:27:12.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6900000000000001e-06 2024-09-10T06:27:12.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388931+0000", 2024-09-10T06:27:12.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3900000000000001e-05 2024-09-10T06:27:12.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388964+0000", 2024-09-10T06:27:12.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2985999999999999e-05 2024-09-10T06:27:12.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388980+0000", 2024-09-10T06:27:12.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.535e-05 2024-09-10T06:27:12.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389123+0000", 2024-09-10T06:27:12.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014337900000000001 2024-09-10T06:27:12.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389341+0000", 2024-09-10T06:27:12.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021765099999999999 2024-09-10T06:27:12.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:12.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389765+0000", 2024-09-10T06:27:12.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042423100000000001 2024-09-10T06:27:12.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.391433+0000", 2024-09-10T06:27:12.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016681000000000001 2024-09-10T06:27:12.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392104+0000", 2024-09-10T06:27:12.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067064800000000003 2024-09-10T06:27:12.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392191+0000", 2024-09-10T06:27:12.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7912999999999997e-05 2024-09-10T06:27:12.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392259+0000", 2024-09-10T06:27:12.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7899999999999997e-05 2024-09-10T06:27:12.865 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.865 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.865 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.866 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.866 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:12.866 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.443722999999999, 2024-09-10T06:27:12.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029995500000000001, 2024-09-10T06:27:12.866 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.866 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.866 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.866 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.866 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.866 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.866 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 229 2024-09-10T06:27:12.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.867 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:12.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:12.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396174+0000", 2024-09-10T06:27:12.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.774e-06 2024-09-10T06:27:12.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396186+0000", 2024-09-10T06:27:12.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2055999999999999e-05 2024-09-10T06:27:12.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396216+0000", 2024-09-10T06:27:12.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9640000000000001e-05 2024-09-10T06:27:12.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396231+0000", 2024-09-10T06:27:12.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:12.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396356+0000", 2024-09-10T06:27:12.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012504500000000001 2024-09-10T06:27:12.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396568+0000", 2024-09-10T06:27:12.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000211709 2024-09-10T06:27:12.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:12.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396954+0000", 2024-09-10T06:27:12.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386027 2024-09-10T06:27:12.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.398287+0000", 2024-09-10T06:27:12.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013331560000000001 2024-09-10T06:27:12.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399004+0000", 2024-09-10T06:27:12.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071720499999999995 2024-09-10T06:27:12.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399091+0000", 2024-09-10T06:27:12.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6714999999999999e-05 2024-09-10T06:27:12.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399171+0000", 2024-09-10T06:27:12.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9893000000000002e-05 2024-09-10T06:27:12.872 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.872 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.872 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.872 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.872 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:12.872 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.437164430999999, 2024-09-10T06:27:12.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030468270000000002, 2024-09-10T06:27:12.873 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.873 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.873 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.873 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.873 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.873 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.873 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 231 2024-09-10T06:27:12.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.873 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:12.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402732+0000", 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-06 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402744+0000", 2024-09-10T06:27:12.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1633e-05 2024-09-10T06:27:12.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402774+0000", 2024-09-10T06:27:12.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9666999999999999e-05 2024-09-10T06:27:12.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402789+0000", 2024-09-10T06:27:12.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5466000000000001e-05 2024-09-10T06:27:12.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402904+0000", 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114466 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403119+0000", 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215572 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403516+0000", 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039663300000000002 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405012+0000", 2024-09-10T06:27:12.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014961919999999999 2024-09-10T06:27:12.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405634+0000", 2024-09-10T06:27:12.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062145199999999999 2024-09-10T06:27:12.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405715+0000", 2024-09-10T06:27:12.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1619000000000006e-05 2024-09-10T06:27:12.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405777+0000", 2024-09-10T06:27:12.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1639999999999999e-05 2024-09-10T06:27:12.878 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.878 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.878 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.878 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:377 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.878 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:12.878 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.378409099999999, 2024-09-10T06:27:12.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058485480000000003, 2024-09-10T06:27:12.878 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.878 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.879 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.879 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.879 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.879 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.879 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 377 2024-09-10T06:27:12.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.879 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:12.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461486+0000", 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0720000000000001e-06 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461504+0000", 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8002000000000001e-05 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461519+0000", 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4584e-05 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461526+0000", 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5560000000000004e-06 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461597+0000", 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1311999999999998e-05 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461709+0000", 2024-09-10T06:27:12.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011191100000000001 2024-09-10T06:27:12.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:12.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461871+0000", 2024-09-10T06:27:12.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016254900000000001 2024-09-10T06:27:12.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.462777+0000", 2024-09-10T06:27:12.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00090547100000000003 2024-09-10T06:27:12.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467265+0000", 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004488222 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467308+0000", 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2975000000000001e-05 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467334+0000", 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5894e-05 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.883 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.884 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.884 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:384 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.884 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:12.884 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.376276245, 2024-09-10T06:27:12.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031588900000000001, 2024-09-10T06:27:12.884 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.884 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.884 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.884 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.884 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.884 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 384 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463620+0000", 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463625+0000", 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6450000000000002e-06 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463639+0000", 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3540000000000001e-05 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463648+0000", 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0259999999999996e-06 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463713+0000", 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5438000000000006e-05 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463774+0000", 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0582999999999999e-05 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:12.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463899+0000", 2024-09-10T06:27:12.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-10T06:27:12.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.464371+0000", 2024-09-10T06:27:12.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047201600000000002 2024-09-10T06:27:12.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466707+0000", 2024-09-10T06:27:12.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023354999999999999 2024-09-10T06:27:12.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466742+0000", 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4686e-05 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466777+0000", 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5537000000000002e-05 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:436 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.889 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:12.890 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.361029198000001, 2024-09-10T06:27:12.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040690570000000001, 2024-09-10T06:27:12.890 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.890 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.890 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.890 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.890 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.890 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.890 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 436 2024-09-10T06:27:12.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.890 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478866+0000", 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1960000000000001e-06 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478871+0000", 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6879999999999998e-06 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478883+0000", 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1790999999999999e-05 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478890+0000", 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8569999999999997e-06 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478958+0000", 2024-09-10T06:27:12.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7774999999999994e-05 2024-09-10T06:27:12.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479072+0000", 2024-09-10T06:27:12.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114577 2024-09-10T06:27:12.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:12.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479255+0000", 2024-09-10T06:27:12.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018297300000000001 2024-09-10T06:27:12.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482448+0000", 2024-09-10T06:27:12.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031933389999999999 2024-09-10T06:27:12.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482828+0000", 2024-09-10T06:27:12.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037961800000000002 2024-09-10T06:27:12.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482891+0000", 2024-09-10T06:27:12.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3316000000000002e-05 2024-09-10T06:27:12.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482934+0000", 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2926999999999997e-05 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:441 6.7 e34/28 6:e1cdb60d:reshard::reshard.0000000008:head v 34'7, mlcod=34'5)", 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.357428280000001, 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060368319999999998, 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.895 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:12.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:12.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482467+0000", 2024-09-10T06:27:12.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8800000000000003e-07 2024-09-10T06:27:12.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482472+0000", 2024-09-10T06:27:12.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8730000000000004e-06 2024-09-10T06:27:12.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482481+0000", 2024-09-10T06:27:12.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1980000000000001e-06 2024-09-10T06:27:12.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482485+0000", 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.386e-06 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482541+0000", 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5788000000000002e-05 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482563+0000", 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2303999999999999e-05 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488465+0000", 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059014810000000001 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488503+0000", 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8313999999999999e-05 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:466 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.342269030000001, 2024-09-10T06:27:12.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039032810000000002, 2024-09-10T06:27:12.900 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.900 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.900 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.900 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.900 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.900 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.900 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 466 2024-09-10T06:27:12.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.900 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:12.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:12.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497626+0000", 2024-09-10T06:27:12.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9099999999999991e-07 2024-09-10T06:27:12.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497634+0000", 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.994e-06 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497644+0000", 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6260000000000007e-06 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497650+0000", 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5160000000000002e-06 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497718+0000", 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8862999999999994e-05 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497775+0000", 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6156000000000002e-05 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497903+0000", 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012879800000000001 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499630+0000", 2024-09-10T06:27:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017268139999999999 2024-09-10T06:27:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501439+0000", 2024-09-10T06:27:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018086669999999999 2024-09-10T06:27:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501478+0000", 2024-09-10T06:27:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9269e-05 2024-09-10T06:27:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501529+0000", 2024-09-10T06:27:12.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0587000000000002e-05 2024-09-10T06:27:12.905 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.905 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.905 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.905 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:469 6.0 e34/28 6:02683654:reshard::reshard.0000000010:head v 34'6, mlcod=34'4)", 2024-09-10T06:27:12.905 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:12.905 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.340266206999999, 2024-09-10T06:27:12.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048323109999999997, 2024-09-10T06:27:12.905 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.906 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.906 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.906 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:12.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:12.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499629+0000", 2024-09-10T06:27:12.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9199999999999999e-07 2024-09-10T06:27:12.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499634+0000", 2024-09-10T06:27:12.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2530000000000004e-06 2024-09-10T06:27:12.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499644+0000", 2024-09-10T06:27:12.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5820000000000008e-06 2024-09-10T06:27:12.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499650+0000", 2024-09-10T06:27:12.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7919999999999998e-06 2024-09-10T06:27:12.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499697+0000", 2024-09-10T06:27:12.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7564000000000001e-05 2024-09-10T06:27:12.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499719+0000", 2024-09-10T06:27:12.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1297999999999998e-05 2024-09-10T06:27:12.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504413+0000", 2024-09-10T06:27:12.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004694419 2024-09-10T06:27:12.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504461+0000", 2024-09-10T06:27:12.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7511e-05 2024-09-10T06:27:12.909 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:621 6.0 e34/28 6:0705c68b:::obj_delete_at_hint.0000000028:head v 34'11, mlcod=34'9)", 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.235065062, 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003196562, 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604831+0000", 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.823e-06 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604843+0000", 2024-09-10T06:27:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1437000000000001e-05 2024-09-10T06:27:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604868+0000", 2024-09-10T06:27:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5837e-05 2024-09-10T06:27:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604885+0000", 2024-09-10T06:27:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6759999999999999e-05 2024-09-10T06:27:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604971+0000", 2024-09-10T06:27:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5512000000000004e-05 2024-09-10T06:27:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604991+0000", 2024-09-10T06:27:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0197999999999999e-05 2024-09-10T06:27:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.607960+0000", 2024-09-10T06:27:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002969307 2024-09-10T06:27:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608026+0000", 2024-09-10T06:27:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5687999999999999e-05 2024-09-10T06:27:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:636 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.226155408, 2024-09-10T06:27:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048306950000000003, 2024-09-10T06:27:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.914 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 636 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:12.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613740+0000", 2024-09-10T06:27:12.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:12.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613747+0000", 2024-09-10T06:27:12.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8090000000000004e-06 2024-09-10T06:27:12.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613762+0000", 2024-09-10T06:27:12.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5037e-05 2024-09-10T06:27:12.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613772+0000", 2024-09-10T06:27:12.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7510000000000003e-06 2024-09-10T06:27:12.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613834+0000", 2024-09-10T06:27:12.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2458000000000004e-05 2024-09-10T06:27:12.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613916+0000", 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1630000000000003e-05 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.614071+0000", 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015480800000000001 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.615885+0000", 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001814607 2024-09-10T06:27:12.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618438+0000", 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025529459999999999 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618503+0000", 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4851000000000006e-05 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618570+0000", 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6418e-05 2024-09-10T06:27:12.919 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:646 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.216693618000001, 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049103549999999999, 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.920 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 646 2024-09-10T06:27:12.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.921 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:12.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:12.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623202+0000", 2024-09-10T06:27:12.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9800000000000002e-07 2024-09-10T06:27:12.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623206+0000", 2024-09-10T06:27:12.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6380000000000003e-06 2024-09-10T06:27:12.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623216+0000", 2024-09-10T06:27:12.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4439999999999997e-06 2024-09-10T06:27:12.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623221+0000", 2024-09-10T06:27:12.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6400000000000002e-06 2024-09-10T06:27:12.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623300+0000", 2024-09-10T06:27:12.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8677999999999994e-05 2024-09-10T06:27:12.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623410+0000", 2024-09-10T06:27:12.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010954399999999999 2024-09-10T06:27:12.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:12.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623629+0000", 2024-09-10T06:27:12.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000219836 2024-09-10T06:27:12.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.625072+0000", 2024-09-10T06:27:12.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014427929999999999 2024-09-10T06:27:12.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.627982+0000", 2024-09-10T06:27:12.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029097620000000002 2024-09-10T06:27:12.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628058+0000", 2024-09-10T06:27:12.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6390999999999994e-05 2024-09-10T06:27:12.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628111+0000", 2024-09-10T06:27:12.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2731e-05 2024-09-10T06:27:12.925 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.925 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 31.154019345999998, 2024-09-10T06:27:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033783509999999999, 2024-09-10T06:27:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.926 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 703 2024-09-10T06:27:12.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.927 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:12.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:12.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685878+0000", 2024-09-10T06:27:12.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5900000000000002e-06 2024-09-10T06:27:12.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685889+0000", 2024-09-10T06:27:12.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:12.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685919+0000", 2024-09-10T06:27:12.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0307e-05 2024-09-10T06:27:12.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685935+0000", 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5336e-05 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686092+0000", 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015776200000000001 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686462+0000", 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036925700000000001 2024-09-10T06:27:12.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:12.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.687048+0000", 2024-09-10T06:27:12.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000586266 2024-09-10T06:27:12.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688261+0000", 2024-09-10T06:27:12.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012132670000000001 2024-09-10T06:27:12.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688974+0000", 2024-09-10T06:27:12.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071248800000000005 2024-09-10T06:27:12.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689129+0000", 2024-09-10T06:27:12.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155499 2024-09-10T06:27:12.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689253+0000", 2024-09-10T06:27:12.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124289 2024-09-10T06:27:12.931 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.931 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.931 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.932 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.932 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:12.932 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.795453843000001, 2024-09-10T06:27:12.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032750980000000002, 2024-09-10T06:27:12.932 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.932 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.932 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.932 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.932 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.932 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.932 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 865 2024-09-10T06:27:12.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.933 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:12.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:12.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044443+0000", 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6929999999999999e-06 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044456+0000", 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.224e-05 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044486+0000", 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.095e-05 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044501+0000", 2024-09-10T06:27:12.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4932999999999999e-05 2024-09-10T06:27:12.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044646+0000", 2024-09-10T06:27:12.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014465600000000001 2024-09-10T06:27:12.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045001+0000", 2024-09-10T06:27:12.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035473999999999998 2024-09-10T06:27:12.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:12.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045549+0000", 2024-09-10T06:27:12.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054870299999999999 2024-09-10T06:27:12.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.046956+0000", 2024-09-10T06:27:12.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014061189999999999 2024-09-10T06:27:12.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047452+0000", 2024-09-10T06:27:12.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049682199999999995 2024-09-10T06:27:12.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047606+0000", 2024-09-10T06:27:12.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015379599999999999 2024-09-10T06:27:12.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047716+0000", 2024-09-10T06:27:12.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109446 2024-09-10T06:27:12.937 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.937 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.937 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.938 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.938 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:12.938 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.790990691000001, 2024-09-10T06:27:12.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030837989999999999, 2024-09-10T06:27:12.938 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.938 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.938 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.938 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.938 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.938 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.938 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 867 2024-09-10T06:27:12.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.938 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048906+0000", 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1770000000000001e-06 2024-09-10T06:27:12.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048916+0000", 2024-09-10T06:27:12.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.025e-05 2024-09-10T06:27:12.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048948+0000", 2024-09-10T06:27:12.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1859000000000001e-05 2024-09-10T06:27:12.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048968+0000", 2024-09-10T06:27:12.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9647e-05 2024-09-10T06:27:12.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049090+0000", 2024-09-10T06:27:12.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122645 2024-09-10T06:27:12.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049314+0000", 2024-09-10T06:27:12.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022372900000000001 2024-09-10T06:27:12.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049785+0000", 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047121899999999999 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.050979+0000", 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001193408 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051729+0000", 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075039699999999998 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051874+0000", 2024-09-10T06:27:12.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000145253 2024-09-10T06:27:12.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051988+0000", 2024-09-10T06:27:12.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011321500000000001 2024-09-10T06:27:12.943 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.943 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.943 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.943 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.943 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:12.944 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.722123509999999, 2024-09-10T06:27:12.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035511029999999999, 2024-09-10T06:27:12.944 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.944 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.944 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.944 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.944 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.944 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.944 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 898 2024-09-10T06:27:12.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.944 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:12.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:12.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117772+0000", 2024-09-10T06:27:12.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5340000000000001e-06 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117781+0000", 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.276e-06 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117804+0000", 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3093999999999999e-05 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117816+0000", 2024-09-10T06:27:12.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1986e-05 2024-09-10T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117954+0000", 2024-09-10T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013856900000000001 2024-09-10T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118327+0000", 2024-09-10T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000372841 2024-09-10T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:12.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118919+0000", 2024-09-10T06:27:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059172800000000002 2024-09-10T06:27:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.120253+0000", 2024-09-10T06:27:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001333643 2024-09-10T06:27:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121060+0000", 2024-09-10T06:27:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080731100000000001 2024-09-10T06:27:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121210+0000", 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014980500000000001 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121322+0000", 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112316 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:12.949 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.632853698000002, 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051838630000000004, 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 937 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207042+0000", 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7439999999999999e-06 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207051+0000", 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7299999999999994e-06 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:12.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207072+0000", 2024-09-10T06:27:12.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1209e-05 2024-09-10T06:27:12.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:12.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207089+0000", 2024-09-10T06:27:12.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6297e-05 2024-09-10T06:27:12.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:12.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207231+0000", 2024-09-10T06:27:12.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014233200000000001 2024-09-10T06:27:12.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:12.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207463+0000", 2024-09-10T06:27:12.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023155199999999999 2024-09-10T06:27:12.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:12.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207797+0000", 2024-09-10T06:27:12.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033413699999999998 2024-09-10T06:27:12.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:12.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.209053+0000", 2024-09-10T06:27:12.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012560029999999999 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212076+0000", 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030234239999999998 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212162+0000", 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5506000000000004e-05 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212225+0000", 2024-09-10T06:27:12.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2928999999999993e-05 2024-09-10T06:27:12.955 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.955 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.955 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.955 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:12.955 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:12.955 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:12.956 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:27:12.957 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:12.954+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:13.015 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:27:13.057 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:13.054+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:13.087 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:13.087 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:13.087 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:13.087 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:13.101 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:27:13.168 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:13.168 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:13.185 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:13.186 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:13.192 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:13.190+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:13.202 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:13.202 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:13.220 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:13.220 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:13.238 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:13.238 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:13.255 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:13.255 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:13.258 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:13.258+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:13.273 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:13.273 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:13.276 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:13.277 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:13.288 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:27:13.296 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:13.296 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:13.360 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:13.358+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:13.449 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:13.450 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:13.461 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:13.458+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:13.465 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:27:13.562 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:13.562+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:13.627 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:13.627 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:13.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:27:13.663 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:13.662+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:13.764 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:13.762+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:13.765 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:13.765 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:13.780 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:27:13.867 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:13.866+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:13.919 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T06:27:13.943 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:13.943 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:13.957 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:27:13.965 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:13.966+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:14.066 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:14.062+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:14.117 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:14.117 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:14.131 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:27:14.176 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:14.174+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:14.268 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:14.266+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:14.301 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:14.301 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:14.315 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:27:14.369 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:14.370+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:14.470 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:14.470+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:14.479 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:14.479 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:14.494 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:27:14.570 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:14.566+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:14.616 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:14.616 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:14.631 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:27:14.672 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:14.670+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:14.772 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:14.770+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:14.793 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:14.793 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:14.807 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:27:14.873 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:14.874+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:14.909 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-10T06:27:14.927 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:14.927 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:14.941 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:27:14.973 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:14.974+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:15.074 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:15.070+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:15.090 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:15.090 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:15.104 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:27:15.175 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:15.170+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:15.221 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:15.222 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:15.236 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:27:15.276 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:15.274+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:15.313 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:27:15.353 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:15.353 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:15.368 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:27:15.377 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:15.374+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:15.450 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:15.450 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:15.466 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:15.466 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:15.477 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:15.478+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:15.483 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:15.483 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:15.499 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:15.499 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:15.519 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:15.520 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:15.525 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:15.525 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:15.525 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:15.538 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:27:15.541 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:15.542 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:15.563 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:15.563 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:15.577 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:15.578+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:15.585 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:15.585 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:15.660 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:15.660 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:15.661 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:15.661 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:15.673 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:27:15.678 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:15.674+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:15.779 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:15.778+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:15.798 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:15.798 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:15.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 41.521209370000001, 2024-09-10T06:27:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069538480000000003, 2024-09-10T06:27:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-10T06:27:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:15.799 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2 2024-09-10T06:27:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275742+0000", 2024-09-10T06:27:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7460000000000001e-06 2024-09-10T06:27:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275751+0000", 2024-09-10T06:27:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3979999999999999e-06 2024-09-10T06:27:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275769+0000", 2024-09-10T06:27:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8637000000000001e-05 2024-09-10T06:27:15.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275784+0000", 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4518000000000001e-05 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275905+0000", 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012092899999999999 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275920+0000", 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5325999999999999e-05 2024-09-10T06:27:15.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282541+0000", 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066208400000000002 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282693+0000", 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152454 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:15.803 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 37.384380809, 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029204980000000001, 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 193 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:15.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412570+0000", 2024-09-10T06:27:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4530000000000001e-06 2024-09-10T06:27:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412582+0000", 2024-09-10T06:27:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1524e-05 2024-09-10T06:27:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412612+0000", 2024-09-10T06:27:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0436000000000001e-05 2024-09-10T06:27:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412627+0000", 2024-09-10T06:27:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4306e-05 2024-09-10T06:27:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412723+0000", 2024-09-10T06:27:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6075000000000004e-05 2024-09-10T06:27:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412831+0000", 2024-09-10T06:27:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108453 2024-09-10T06:27:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412972+0000", 2024-09-10T06:27:15.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141225 2024-09-10T06:27:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.414147+0000", 2024-09-10T06:27:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174989 2024-09-10T06:27:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415334+0000", 2024-09-10T06:27:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415420+0000", 2024-09-10T06:27:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6009999999999998e-05 2024-09-10T06:27:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415489+0000", 2024-09-10T06:27:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8403000000000002e-05 2024-09-10T06:27:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:15.809 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.486897167000002, 2024-09-10T06:27:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092944310000000006, 2024-09-10T06:27:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 208 2024-09-10T06:27:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310055+0000", 2024-09-10T06:27:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-10T06:27:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310066+0000", 2024-09-10T06:27:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1739999999999999e-05 2024-09-10T06:27:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310096+0000", 2024-09-10T06:27:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0159e-05 2024-09-10T06:27:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310111+0000", 2024-09-10T06:27:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5007e-05 2024-09-10T06:27:15.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310235+0000", 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123132 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310246+0000", 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1487e-05 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315594+0000", 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005347592 2024-09-10T06:27:15.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315932+0000", 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033789099999999999 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.316549+0000", 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061698099999999995 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.317898+0000", 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013498799999999999 2024-09-10T06:27:15.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319207+0000", 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013086969999999999 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319289+0000", 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2259e-05 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319346+0000", 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6675999999999997e-05 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.815 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.460560444000002, 2024-09-10T06:27:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003262778, 2024-09-10T06:27:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.816 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 212 2024-09-10T06:27:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336391+0000", 2024-09-10T06:27:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5770000000000001e-06 2024-09-10T06:27:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336403+0000", 2024-09-10T06:27:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2286000000000001e-05 2024-09-10T06:27:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336425+0000", 2024-09-10T06:27:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2164e-05 2024-09-10T06:27:15.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336440+0000", 2024-09-10T06:27:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4222999999999999e-05 2024-09-10T06:27:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336621+0000", 2024-09-10T06:27:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018136500000000001 2024-09-10T06:27:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336830+0000", 2024-09-10T06:27:15.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209125 2024-09-10T06:27:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.337206+0000", 2024-09-10T06:27:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037553700000000001 2024-09-10T06:27:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.338527+0000", 2024-09-10T06:27:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00132142 2024-09-10T06:27:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339502+0000", 2024-09-10T06:27:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00097512599999999999 2024-09-10T06:27:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339585+0000", 2024-09-10T06:27:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2466000000000006e-05 2024-09-10T06:27:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339651+0000", 2024-09-10T06:27:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6489000000000007e-05 2024-09-10T06:27:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.821 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.436246904999997, 2024-09-10T06:27:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032440849999999999, 2024-09-10T06:27:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.822 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 219 2024-09-10T06:27:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360705+0000", 2024-09-10T06:27:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.593e-06 2024-09-10T06:27:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360716+0000", 2024-09-10T06:27:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1717e-05 2024-09-10T06:27:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360746+0000", 2024-09-10T06:27:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0233e-05 2024-09-10T06:27:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360761+0000", 2024-09-10T06:27:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4593000000000001e-05 2024-09-10T06:27:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360873+0000", 2024-09-10T06:27:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111809 2024-09-10T06:27:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361105+0000", 2024-09-10T06:27:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023171800000000001 2024-09-10T06:27:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361523+0000", 2024-09-10T06:27:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000418694 2024-09-10T06:27:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.362840+0000", 2024-09-10T06:27:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013165570000000001 2024-09-10T06:27:15.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363793+0000", 2024-09-10T06:27:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095323200000000004 2024-09-10T06:27:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363880+0000", 2024-09-10T06:27:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6689999999999998e-05 2024-09-10T06:27:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363946+0000", 2024-09-10T06:27:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6248999999999995e-05 2024-09-10T06:27:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.418980052000002, 2024-09-10T06:27:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003271422, 2024-09-10T06:27:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.828 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 224 2024-09-10T06:27:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377971+0000", 2024-09-10T06:27:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377983+0000", 2024-09-10T06:27:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1517e-05 2024-09-10T06:27:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378013+0000", 2024-09-10T06:27:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0476000000000001e-05 2024-09-10T06:27:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378028+0000", 2024-09-10T06:27:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5173e-05 2024-09-10T06:27:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378134+0000", 2024-09-10T06:27:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010533 2024-09-10T06:27:15.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378346+0000", 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021175499999999999 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378787+0000", 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044190899999999999 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.380237+0000", 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001449093 2024-09-10T06:27:15.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381097+0000", 2024-09-10T06:27:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086022300000000002 2024-09-10T06:27:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381181+0000", 2024-09-10T06:27:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3973000000000004e-05 2024-09-10T06:27:15.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381240+0000", 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9472999999999998e-05 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.387312598999998, 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031998719999999999, 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.838 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 233 2024-09-10T06:27:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:15.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409639+0000", 2024-09-10T06:27:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4770000000000002e-06 2024-09-10T06:27:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409652+0000", 2024-09-10T06:27:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3692999999999999e-05 2024-09-10T06:27:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409683+0000", 2024-09-10T06:27:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1080000000000001e-05 2024-09-10T06:27:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409699+0000", 2024-09-10T06:27:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5245999999999999e-05 2024-09-10T06:27:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409881+0000", 2024-09-10T06:27:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000182709 2024-09-10T06:27:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410088+0000", 2024-09-10T06:27:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020630799999999999 2024-09-10T06:27:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410495+0000", 2024-09-10T06:27:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00040682700000000001 2024-09-10T06:27:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.411805+0000", 2024-09-10T06:27:15.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013101059999999999 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412672+0000", 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086778699999999996 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412769+0000", 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6565999999999997e-05 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412836+0000", 2024-09-10T06:27:15.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7073e-05 2024-09-10T06:27:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:353 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.346405285000003, 2024-09-10T06:27:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059710450000000003, 2024-09-10T06:27:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.844 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 353 2024-09-10T06:27:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450545+0000", 2024-09-10T06:27:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.423e-06 2024-09-10T06:27:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450551+0000", 2024-09-10T06:27:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7370000000000003e-06 2024-09-10T06:27:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450565+0000", 2024-09-10T06:27:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4649e-05 2024-09-10T06:27:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450574+0000", 2024-09-10T06:27:15.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5129999999999996e-06 2024-09-10T06:27:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450644+0000", 2024-09-10T06:27:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0387000000000002e-05 2024-09-10T06:27:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450818+0000", 2024-09-10T06:27:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017368400000000001 2024-09-10T06:27:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451030+0000", 2024-09-10T06:27:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021189599999999999 2024-09-10T06:27:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451607+0000", 2024-09-10T06:27:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057672599999999995 2024-09-10T06:27:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456437+0000", 2024-09-10T06:27:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048301940000000003 2024-09-10T06:27:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456472+0000", 2024-09-10T06:27:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5178000000000001e-05 2024-09-10T06:27:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456515+0000", 2024-09-10T06:27:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2657999999999997e-05 2024-09-10T06:27:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:362 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.339957763000001, 2024-09-10T06:27:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044032239999999999, 2024-09-10T06:27:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 362 2024-09-10T06:27:15.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456992+0000", 2024-09-10T06:27:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6700000000000002e-07 2024-09-10T06:27:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456997+0000", 2024-09-10T06:27:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6249999999999998e-06 2024-09-10T06:27:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457005+0000", 2024-09-10T06:27:15.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6719999999999993e-06 2024-09-10T06:27:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457010+0000", 2024-09-10T06:27:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7360000000000001e-06 2024-09-10T06:27:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457054+0000", 2024-09-10T06:27:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4138999999999999e-05 2024-09-10T06:27:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457163+0000", 2024-09-10T06:27:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108558 2024-09-10T06:27:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457340+0000", 2024-09-10T06:27:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017730600000000001 2024-09-10T06:27:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.458065+0000", 2024-09-10T06:27:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00072480400000000001 2024-09-10T06:27:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461294+0000", 2024-09-10T06:27:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032287890000000001 2024-09-10T06:27:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461352+0000", 2024-09-10T06:27:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8502000000000003e-05 2024-09-10T06:27:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461394+0000", 2024-09-10T06:27:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2225999999999999e-05 2024-09-10T06:27:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:475 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.294108198000004, 2024-09-10T06:27:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046091930000000001, 2024-09-10T06:27:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.857 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 475 2024-09-10T06:27:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6100000000000001e-07 2024-09-10T06:27:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502844+0000", 2024-09-10T06:27:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0529999999999998e-06 2024-09-10T06:27:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502852+0000", 2024-09-10T06:27:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2579999999999995e-06 2024-09-10T06:27:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502857+0000", 2024-09-10T06:27:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3460000000000004e-06 2024-09-10T06:27:15.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502894+0000", 2024-09-10T06:27:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6884000000000001e-05 2024-09-10T06:27:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502942+0000", 2024-09-10T06:27:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7791999999999999e-05 2024-09-10T06:27:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.503048+0000", 2024-09-10T06:27:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010678799999999999 2024-09-10T06:27:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.506079+0000", 2024-09-10T06:27:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030311510000000002 2024-09-10T06:27:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507361+0000", 2024-09-10T06:27:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001281208 2024-09-10T06:27:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507400+0000", 2024-09-10T06:27:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9483000000000001e-05 2024-09-10T06:27:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507450+0000", 2024-09-10T06:27:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9669000000000002e-05 2024-09-10T06:27:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:477 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.292147081000003, 2024-09-10T06:27:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038544, 2024-09-10T06:27:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 477 2024-09-10T06:27:15.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504803+0000", 2024-09-10T06:27:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9999999999999996e-07 2024-09-10T06:27:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504808+0000", 2024-09-10T06:27:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1909999999999999e-06 2024-09-10T06:27:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504818+0000", 2024-09-10T06:27:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0081999999999999e-05 2024-09-10T06:27:15.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504823+0000", 2024-09-10T06:27:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9969999999999998e-06 2024-09-10T06:27:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504870+0000", 2024-09-10T06:27:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6980000000000001e-05 2024-09-10T06:27:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504922+0000", 2024-09-10T06:27:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869000000000001e-05 2024-09-10T06:27:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505020+0000", 2024-09-10T06:27:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8010999999999994e-05 2024-09-10T06:27:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507789+0000", 2024-09-10T06:27:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027690219999999999 2024-09-10T06:27:15.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508599+0000", 2024-09-10T06:27:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081037800000000005 2024-09-10T06:27:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508631+0000", 2024-09-10T06:27:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.137e-05 2024-09-10T06:27:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508656+0000", 2024-09-10T06:27:15.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5599999999999999e-05 2024-09-10T06:27:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:478 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.292100179000002, 2024-09-10T06:27:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039361880000000002, 2024-09-10T06:27:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.870 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 478 2024-09-10T06:27:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7800000000000001e-07 2024-09-10T06:27:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504853+0000", 2024-09-10T06:27:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2780000000000002e-06 2024-09-10T06:27:15.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504858+0000", 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7359999999999998e-06 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504862+0000", 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6650000000000001e-06 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504938+0000", 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6286999999999997e-05 2024-09-10T06:27:15.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505091+0000", 2024-09-10T06:27:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152385 2024-09-10T06:27:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505335+0000", 2024-09-10T06:27:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244281 2024-09-10T06:27:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507764+0000", 2024-09-10T06:27:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002429624 2024-09-10T06:27:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508681+0000", 2024-09-10T06:27:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00091630100000000001 2024-09-10T06:27:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508747+0000", 2024-09-10T06:27:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5733000000000002e-05 2024-09-10T06:27:15.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508785+0000", 2024-09-10T06:27:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8319999999999999e-05 2024-09-10T06:27:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.045968258999999, 2024-09-10T06:27:15.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030732350000000001, 2024-09-10T06:27:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 733 2024-09-10T06:27:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:15.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750983+0000", 2024-09-10T06:27:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8880000000000001e-06 2024-09-10T06:27:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750996+0000", 2024-09-10T06:27:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2048999999999999e-05 2024-09-10T06:27:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751024+0000", 2024-09-10T06:27:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8802e-05 2024-09-10T06:27:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751043+0000", 2024-09-10T06:27:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8266000000000001e-05 2024-09-10T06:27:15.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751191+0000", 2024-09-10T06:27:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014818200000000001 2024-09-10T06:27:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751417+0000", 2024-09-10T06:27:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022648199999999999 2024-09-10T06:27:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751747+0000", 2024-09-10T06:27:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032945000000000001 2024-09-10T06:27:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.752752+0000", 2024-09-10T06:27:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010054790000000001 2024-09-10T06:27:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753896+0000", 2024-09-10T06:27:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001143638 2024-09-10T06:27:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753989+0000", 2024-09-10T06:27:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3466000000000003e-05 2024-09-10T06:27:15.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.754054+0000", 2024-09-10T06:27:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4533e-05 2024-09-10T06:27:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.005487713000001, 2024-09-10T06:27:15.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002896722, 2024-09-10T06:27:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 751 2024-09-10T06:27:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791464+0000", 2024-09-10T06:27:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7140000000000002e-06 2024-09-10T06:27:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791475+0000", 2024-09-10T06:27:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1535999999999999e-05 2024-09-10T06:27:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791501+0000", 2024-09-10T06:27:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5276e-05 2024-09-10T06:27:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791514+0000", 2024-09-10T06:27:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3203e-05 2024-09-10T06:27:15.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791643+0000", 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012961900000000001 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791857+0000", 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021351599999999999 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.792178+0000", 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032090999999999999 2024-09-10T06:27:15.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.793281+0000", 2024-09-10T06:27:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001103319 2024-09-10T06:27:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794209+0000", 2024-09-10T06:27:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000927676 2024-09-10T06:27:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794295+0000", 2024-09-10T06:27:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5682999999999999e-05 2024-09-10T06:27:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794358+0000", 2024-09-10T06:27:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3269999999999996e-05 2024-09-10T06:27:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.889 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.001600216, 2024-09-10T06:27:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030558059999999999, 2024-09-10T06:27:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 753 2024-09-10T06:27:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795352+0000", 2024-09-10T06:27:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0130000000000002e-06 2024-09-10T06:27:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795364+0000", 2024-09-10T06:27:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1939999999999999e-05 2024-09-10T06:27:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795395+0000", 2024-09-10T06:27:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0976999999999998e-05 2024-09-10T06:27:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795413+0000", 2024-09-10T06:27:15.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7980000000000001e-05 2024-09-10T06:27:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795533+0000", 2024-09-10T06:27:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120732 2024-09-10T06:27:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795665+0000", 2024-09-10T06:27:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013215899999999999 2024-09-10T06:27:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795931+0000", 2024-09-10T06:27:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026536499999999999 2024-09-10T06:27:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.796995+0000", 2024-09-10T06:27:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001064611 2024-09-10T06:27:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798256+0000", 2024-09-10T06:27:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00126022 2024-09-10T06:27:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798340+0000", 2024-09-10T06:27:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4753000000000007e-05 2024-09-10T06:27:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798404+0000", 2024-09-10T06:27:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4055999999999998e-05 2024-09-10T06:27:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.895 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 33.886391975000002, 2024-09-10T06:27:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031632380000000001, 2024-09-10T06:27:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 805 2024-09-10T06:27:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910560+0000", 2024-09-10T06:27:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2200000000000001e-06 2024-09-10T06:27:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910574+0000", 2024-09-10T06:27:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3536000000000001e-05 2024-09-10T06:27:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910604+0000", 2024-09-10T06:27:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0645999999999998e-05 2024-09-10T06:27:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910619+0000", 2024-09-10T06:27:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5064e-05 2024-09-10T06:27:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910759+0000", 2024-09-10T06:27:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013943899999999999 2024-09-10T06:27:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910984+0000", 2024-09-10T06:27:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000225381 2024-09-10T06:27:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.911312+0000", 2024-09-10T06:27:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032782800000000001 2024-09-10T06:27:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.912402+0000", 2024-09-10T06:27:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010895639999999999 2024-09-10T06:27:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913576+0000", 2024-09-10T06:27:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174591 2024-09-10T06:27:15.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913657+0000", 2024-09-10T06:27:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1223000000000005e-05 2024-09-10T06:27:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913720+0000", 2024-09-10T06:27:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2745999999999999e-05 2024-09-10T06:27:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 33.826614239999998, 2024-09-10T06:27:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030680099999999999, 2024-09-10T06:27:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 832 2024-09-10T06:27:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.902 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970337+0000", 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6230000000000001e-06 2024-09-10T06:27:15.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970349+0000", 2024-09-10T06:27:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1557e-05 2024-09-10T06:27:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970379+0000", 2024-09-10T06:27:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0456000000000001e-05 2024-09-10T06:27:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970394+0000", 2024-09-10T06:27:15.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4683e-05 2024-09-10T06:27:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970509+0000", 2024-09-10T06:27:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114613 2024-09-10T06:27:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970753+0000", 2024-09-10T06:27:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244295 2024-09-10T06:27:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:15.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.971078+0000", 2024-09-10T06:27:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000325583 2024-09-10T06:27:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.972162+0000", 2024-09-10T06:27:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010834519999999999 2024-09-10T06:27:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973200+0000", 2024-09-10T06:27:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010376560000000001 2024-09-10T06:27:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973287+0000", 2024-09-10T06:27:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7163000000000006e-05 2024-09-10T06:27:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973403+0000", 2024-09-10T06:27:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011592899999999999 2024-09-10T06:27:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.907 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 33.671543012999997, 2024-09-10T06:27:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030018599999999999, 2024-09-10T06:27:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 901 2024-09-10T06:27:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125409+0000", 2024-09-10T06:27:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.253e-06 2024-09-10T06:27:15.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125425+0000", 2024-09-10T06:27:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5636000000000001e-05 2024-09-10T06:27:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125456+0000", 2024-09-10T06:27:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1130000000000002e-05 2024-09-10T06:27:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125470+0000", 2024-09-10T06:27:15.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.464e-05 2024-09-10T06:27:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125581+0000", 2024-09-10T06:27:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110612 2024-09-10T06:27:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125814+0000", 2024-09-10T06:27:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023266899999999999 2024-09-10T06:27:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.126159+0000", 2024-09-10T06:27:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034565399999999998 2024-09-10T06:27:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.127161+0000", 2024-09-10T06:27:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010020890000000001 2024-09-10T06:27:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128202+0000", 2024-09-10T06:27:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001040242 2024-09-10T06:27:15.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128288+0000", 2024-09-10T06:27:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6156000000000007e-05 2024-09-10T06:27:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128408+0000", 2024-09-10T06:27:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011977900000000001 2024-09-10T06:27:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 33.637450643999998, 2024-09-10T06:27:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029016649999999999, 2024-09-10T06:27:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 916 2024-09-10T06:27:15.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159501+0000", 2024-09-10T06:27:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159512+0000", 2024-09-10T06:27:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1564e-05 2024-09-10T06:27:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159543+0000", 2024-09-10T06:27:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0942999999999998e-05 2024-09-10T06:27:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159558+0000", 2024-09-10T06:27:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.436e-05 2024-09-10T06:27:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159701+0000", 2024-09-10T06:27:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014363599999999999 2024-09-10T06:27:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159927+0000", 2024-09-10T06:27:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022535099999999999 2024-09-10T06:27:15.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.160260+0000", 2024-09-10T06:27:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033321700000000002 2024-09-10T06:27:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.161312+0000", 2024-09-10T06:27:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001052222 2024-09-10T06:27:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162261+0000", 2024-09-10T06:27:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00094912600000000001 2024-09-10T06:27:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162337+0000", 2024-09-10T06:27:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6268999999999998e-05 2024-09-10T06:27:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162400+0000", 2024-09-10T06:27:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2477000000000005e-05 2024-09-10T06:27:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.919 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 33.567141133, 2024-09-10T06:27:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030045179999999999, 2024-09-10T06:27:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:15.920 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 946 2024-09-10T06:27:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229810+0000", 2024-09-10T06:27:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:27:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229838+0000", 2024-09-10T06:27:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7776e-05 2024-09-10T06:27:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229869+0000", 2024-09-10T06:27:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0766999999999999e-05 2024-09-10T06:27:15.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229883+0000", 2024-09-10T06:27:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4423000000000001e-05 2024-09-10T06:27:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230005+0000", 2024-09-10T06:27:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121919 2024-09-10T06:27:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:15.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230219+0000", 2024-09-10T06:27:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000214098 2024-09-10T06:27:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230588+0000", 2024-09-10T06:27:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036857099999999999 2024-09-10T06:27:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.231707+0000", 2024-09-10T06:27:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011193349999999999 2024-09-10T06:27:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232662+0000", 2024-09-10T06:27:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095513300000000005 2024-09-10T06:27:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232748+0000", 2024-09-10T06:27:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6151999999999998e-05 2024-09-10T06:27:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232812+0000", 2024-09-10T06:27:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3876999999999998e-05 2024-09-10T06:27:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.925 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:15.926 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:15.926 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:15.927 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:27:15.928 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:15.926+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:16.028 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:16.026+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:16.104 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:16.104 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:16.104 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:16.104 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:16.118 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:27:16.161 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:16.162+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:16.230 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:16.230+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:16.284 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:16.284 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:16.284 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:16.285 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:16.285 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:16.299 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:27:16.345 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:16.346+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:16.432 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:16.432 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:16.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:16.432 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:16.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.432 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4236.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T06:27:16.432 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:16.432 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.921837631000002, 2024-09-10T06:27:16.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049682550000000004, 2024-09-10T06:27:16.432 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.432 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.433 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.433 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:16.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:16.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507427+0000", 2024-09-10T06:27:16.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5629999999999999e-06 2024-09-10T06:27:16.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507439+0000", 2024-09-10T06:27:16.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.19e-05 2024-09-10T06:27:16.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507460+0000", 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1693000000000001e-05 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507480+0000", 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9947000000000001e-05 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507613+0000", 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000132409 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507696+0000", 2024-09-10T06:27:16.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2953000000000004e-05 2024-09-10T06:27:16.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512288+0000", 2024-09-10T06:27:16.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045927110000000002 2024-09-10T06:27:16.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512393+0000", 2024-09-10T06:27:16.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105079 2024-09-10T06:27:16.436 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.436 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.437 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.437 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:16.437 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:16.437 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.098373598999999, 2024-09-10T06:27:16.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025692739999999999, 2024-09-10T06:27:16.437 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.437 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.437 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.437 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.437 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:16.437 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:16.437 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 42 2024-09-10T06:27:16.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.438 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:16.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:16.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330891+0000", 2024-09-10T06:27:16.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9700000000000002e-06 2024-09-10T06:27:16.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330901+0000", 2024-09-10T06:27:16.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2909999999999996e-06 2024-09-10T06:27:16.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330924+0000", 2024-09-10T06:27:16.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3132000000000001e-05 2024-09-10T06:27:16.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330935+0000", 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0893999999999999e-05 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331021+0000", 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6205000000000006e-05 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331160+0000", 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013973600000000001 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331336+0000", 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017578799999999999 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.332381+0000", 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001044627 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333371+0000", 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098979800000000007 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333421+0000", 2024-09-10T06:27:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9872e-05 2024-09-10T06:27:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333459+0000", 2024-09-10T06:27:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7960999999999998e-05 2024-09-10T06:27:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.442 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:16.443 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:16.443 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.113182678999998, 2024-09-10T06:27:16.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025247730000000001, 2024-09-10T06:27:16.443 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.443 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.443 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.443 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.443 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.443 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.443 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 52 2024-09-10T06:27:16.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.443 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:16.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:16.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316084+0000", 2024-09-10T06:27:16.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8260000000000003e-06 2024-09-10T06:27:16.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316095+0000", 2024-09-10T06:27:16.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1229999999999999e-05 2024-09-10T06:27:16.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316131+0000", 2024-09-10T06:27:16.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5499e-05 2024-09-10T06:27:16.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316150+0000", 2024-09-10T06:27:16.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9510000000000001e-05 2024-09-10T06:27:16.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316275+0000", 2024-09-10T06:27:16.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012501600000000001 2024-09-10T06:27:16.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316507+0000", 2024-09-10T06:27:16.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000231404 2024-09-10T06:27:16.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316712+0000", 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204873 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.317603+0000", 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089174399999999998 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318470+0000", 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086713399999999998 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318552+0000", 2024-09-10T06:27:16.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1279999999999994e-05 2024-09-10T06:27:16.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318605+0000", 2024-09-10T06:27:16.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3257000000000002e-05 2024-09-10T06:27:16.448 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.448 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.448 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.448 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.449 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:16.449 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.009404349999997, 2024-09-10T06:27:16.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033383480000000001, 2024-09-10T06:27:16.449 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.449 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.449 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.449 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.449 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.449 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.449 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 236 2024-09-10T06:27:16.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.449 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419861+0000", 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.734e-06 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419873+0000", 2024-09-10T06:27:16.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1789e-05 2024-09-10T06:27:16.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419904+0000", 2024-09-10T06:27:16.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1377000000000001e-05 2024-09-10T06:27:16.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419921+0000", 2024-09-10T06:27:16.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6878999999999999e-05 2024-09-10T06:27:16.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420052+0000", 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013025600000000001 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420263+0000", 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021196600000000001 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420649+0000", 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038507 2024-09-10T06:27:16.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.422366+0000", 2024-09-10T06:27:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017172000000000001 2024-09-10T06:27:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423048+0000", 2024-09-10T06:27:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00068254100000000005 2024-09-10T06:27:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423127+0000", 2024-09-10T06:27:16.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8207000000000005e-05 2024-09-10T06:27:16.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423197+0000", 2024-09-10T06:27:16.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0328999999999997e-05 2024-09-10T06:27:16.454 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.454 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.454 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.454 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.454 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:16.454 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.992803076000001, 2024-09-10T06:27:16.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003575235, 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 299 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436461+0000", 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.144e-06 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436466+0000", 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8409999999999999e-06 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436477+0000", 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1253000000000001e-05 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436483+0000", 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7010000000000001e-06 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436527+0000", 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4381000000000001e-05 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436569+0000", 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2208e-05 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436687+0000", 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118093 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.437455+0000", 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076799599999999996 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439950+0000", 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024946040000000001 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439988+0000", 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8405999999999998e-05 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.440035+0000", 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6607999999999998e-05 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.658126994, 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028833040000000002, 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 742 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771139+0000", 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5269999999999999e-06 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771153+0000", 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4036000000000001e-05 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771186+0000", 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2113000000000002e-05 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771201+0000", 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771320+0000", 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119265 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771557+0000", 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023640600000000001 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771890+0000", 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033302000000000001 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773204+0000", 2024-09-10T06:27:16.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013142239999999999 2024-09-10T06:27:16.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773864+0000", 2024-09-10T06:27:16.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066005100000000004 2024-09-10T06:27:16.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773948+0000", 2024-09-10T06:27:16.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4625999999999999e-05 2024-09-10T06:27:16.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774019+0000", 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0705999999999997e-05 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.654347743999999, 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025263479999999999, 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.465 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.466 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.466 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 744 2024-09-10T06:27:16.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.466 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:16.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774917+0000", 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0540000000000002e-06 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774926+0000", 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5660000000000007e-06 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774947+0000", 2024-09-10T06:27:16.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0852999999999998e-05 2024-09-10T06:27:16.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774958+0000", 2024-09-10T06:27:16.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1216999999999999e-05 2024-09-10T06:27:16.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775045+0000", 2024-09-10T06:27:16.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7643000000000001e-05 2024-09-10T06:27:16.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775167+0000", 2024-09-10T06:27:16.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012163900000000001 2024-09-10T06:27:16.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:16.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775427+0000", 2024-09-10T06:27:16.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000259678 2024-09-10T06:27:16.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.776736+0000", 2024-09-10T06:27:16.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013093429999999999 2024-09-10T06:27:16.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777296+0000", 2024-09-10T06:27:16.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056029599999999995 2024-09-10T06:27:16.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777374+0000", 2024-09-10T06:27:16.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7721999999999999e-05 2024-09-10T06:27:16.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777441+0000", 2024-09-10T06:27:16.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7336999999999996e-05 2024-09-10T06:27:16.470 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.471 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.471 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.471 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.471 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:16.471 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.617032197999997, 2024-09-10T06:27:16.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036412979999999998, 2024-09-10T06:27:16.471 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.471 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.471 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.471 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.471 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.471 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 760 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812233+0000", 2024-09-10T06:27:16.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:16.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812244+0000", 2024-09-10T06:27:16.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1273e-05 2024-09-10T06:27:16.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812276+0000", 2024-09-10T06:27:16.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1253e-05 2024-09-10T06:27:16.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812290+0000", 2024-09-10T06:27:16.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4576000000000001e-05 2024-09-10T06:27:16.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812438+0000", 2024-09-10T06:27:16.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014775899999999999 2024-09-10T06:27:16.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812821+0000", 2024-09-10T06:27:16.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000383187 2024-09-10T06:27:16.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.813398+0000", 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000576619 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.814658+0000", 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001260207 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815591+0000", 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00093332899999999999 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815745+0000", 2024-09-10T06:27:16.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153392 2024-09-10T06:27:16.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815872+0000", 2024-09-10T06:27:16.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012715599999999999 2024-09-10T06:27:16.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.476 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.476 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.476 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.612396814, 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029417369999999998, 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 762 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816868+0000", 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.283e-06 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816879+0000", 2024-09-10T06:27:16.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0523000000000001e-05 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816910+0000", 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0732999999999999e-05 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816926+0000", 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.677e-05 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817058+0000", 2024-09-10T06:27:16.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013195599999999999 2024-09-10T06:27:16.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817299+0000", 2024-09-10T06:27:16.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000241091 2024-09-10T06:27:16.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:16.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817761+0000", 2024-09-10T06:27:16.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046188400000000003 2024-09-10T06:27:16.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.818948+0000", 2024-09-10T06:27:16.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:16.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819662+0000", 2024-09-10T06:27:16.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071398399999999997 2024-09-10T06:27:16.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819745+0000", 2024-09-10T06:27:16.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3560000000000006e-05 2024-09-10T06:27:16.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819808+0000", 2024-09-10T06:27:16.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2329000000000006e-05 2024-09-10T06:27:16.482 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.482 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.482 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.482 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.482 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:16.482 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.491936097, 2024-09-10T06:27:16.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002834175, 2024-09-10T06:27:16.483 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.483 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.483 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.483 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.483 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 817 2024-09-10T06:27:16.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.483 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:16.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:16.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937330+0000", 2024-09-10T06:27:16.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9869999999999999e-06 2024-09-10T06:27:16.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937342+0000", 2024-09-10T06:27:16.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2595999999999999e-05 2024-09-10T06:27:16.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937375+0000", 2024-09-10T06:27:16.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2320000000000002e-05 2024-09-10T06:27:16.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937390+0000", 2024-09-10T06:27:16.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4977000000000001e-05 2024-09-10T06:27:16.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937529+0000", 2024-09-10T06:27:16.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013937199999999999 2024-09-10T06:27:16.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937753+0000", 2024-09-10T06:27:16.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000224358 2024-09-10T06:27:16.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.938061+0000", 2024-09-10T06:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030808799999999998 2024-09-10T06:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.939112+0000", 2024-09-10T06:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010503050000000001 2024-09-10T06:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940005+0000", 2024-09-10T06:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089366599999999999 2024-09-10T06:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940093+0000", 2024-09-10T06:27:16.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8053000000000006e-05 2024-09-10T06:27:16.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940161+0000", 2024-09-10T06:27:16.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7453000000000006e-05 2024-09-10T06:27:16.488 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.488 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.488 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.439008055000002, 2024-09-10T06:27:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027552649999999998, 2024-09-10T06:27:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 841 2024-09-10T06:27:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:16.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:16.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990257+0000", 2024-09-10T06:27:16.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6869999999999999e-06 2024-09-10T06:27:16.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990270+0000", 2024-09-10T06:27:16.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2843000000000001e-05 2024-09-10T06:27:16.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990300+0000", 2024-09-10T06:27:16.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9252999999999999e-05 2024-09-10T06:27:16.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990314+0000", 2024-09-10T06:27:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4796e-05 2024-09-10T06:27:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990427+0000", 2024-09-10T06:27:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112649 2024-09-10T06:27:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990671+0000", 2024-09-10T06:27:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244408 2024-09-10T06:27:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:16.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990987+0000", 2024-09-10T06:27:16.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031593099999999998 2024-09-10T06:27:16.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992073+0000", 2024-09-10T06:27:16.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010854549999999999 2024-09-10T06:27:16.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992862+0000", 2024-09-10T06:27:16.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00078889400000000005 2024-09-10T06:27:16.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992944+0000", 2024-09-10T06:27:16.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2152999999999998e-05 2024-09-10T06:27:16.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993010+0000", 2024-09-10T06:27:16.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6196000000000001e-05 2024-09-10T06:27:16.494 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.494 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.494 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.435272120999997, 2024-09-10T06:27:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025373539999999999, 2024-09-10T06:27:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 843 2024-09-10T06:27:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.495 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:16.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:16.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993993+0000", 2024-09-10T06:27:16.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3630000000000001e-06 2024-09-10T06:27:16.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994004+0000", 2024-09-10T06:27:16.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0557000000000001e-05 2024-09-10T06:27:16.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994035+0000", 2024-09-10T06:27:16.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0969000000000001e-05 2024-09-10T06:27:16.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994055+0000", 2024-09-10T06:27:16.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0497e-05 2024-09-10T06:27:16.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994150+0000", 2024-09-10T06:27:16.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5363000000000002e-05 2024-09-10T06:27:16.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994275+0000", 2024-09-10T06:27:16.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012453200000000001 2024-09-10T06:27:16.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994570+0000", 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029522100000000003 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.995569+0000", 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00099913200000000001 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996384+0000", 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081451099999999997 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996462+0000", 2024-09-10T06:27:16.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8502000000000002e-05 2024-09-10T06:27:16.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996528+0000", 2024-09-10T06:27:16.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5707e-05 2024-09-10T06:27:16.500 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.500 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.500 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.425824974000001, 2024-09-10T06:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033145539999999999, 2024-09-10T06:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 847 2024-09-10T06:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003440+0000", 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5299999999999999e-06 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003452+0000", 2024-09-10T06:27:16.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:16.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003482+0000", 2024-09-10T06:27:16.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0790000000000002e-05 2024-09-10T06:27:16.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003497+0000", 2024-09-10T06:27:16.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.489e-05 2024-09-10T06:27:16.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003645+0000", 2024-09-10T06:27:16.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014771900000000001 2024-09-10T06:27:16.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003996+0000", 2024-09-10T06:27:16.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000350861 2024-09-10T06:27:16.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:16.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.004540+0000", 2024-09-10T06:27:16.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054383199999999995 2024-09-10T06:27:16.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.005831+0000", 2024-09-10T06:27:16.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001291366 2024-09-10T06:27:16.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006461+0000", 2024-09-10T06:27:16.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062943899999999998 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006631+0000", 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000170228 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006752+0000", 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012160899999999999 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.507 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.507 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:16.507 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.421571806999999, 2024-09-10T06:27:16.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002619953, 2024-09-10T06:27:16.507 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.507 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.507 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.507 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 849 2024-09-10T06:27:16.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.507 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007693+0000", 2024-09-10T06:27:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3099999999999999e-06 2024-09-10T06:27:16.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007704+0000", 2024-09-10T06:27:16.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0387000000000001e-05 2024-09-10T06:27:16.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007734+0000", 2024-09-10T06:27:16.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0676000000000002e-05 2024-09-10T06:27:16.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007753+0000", 2024-09-10T06:27:16.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.836e-05 2024-09-10T06:27:16.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007857+0000", 2024-09-10T06:27:16.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103836 2024-09-10T06:27:16.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007980+0000", 2024-09-10T06:27:16.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123843 2024-09-10T06:27:16.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.008241+0000", 2024-09-10T06:27:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026085799999999999 2024-09-10T06:27:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.009475+0000", 2024-09-10T06:27:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012340230000000001 2024-09-10T06:27:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010168+0000", 2024-09-10T06:27:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00069220800000000004 2024-09-10T06:27:16.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010247+0000", 2024-09-10T06:27:16.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9929e-05 2024-09-10T06:27:16.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010311+0000", 2024-09-10T06:27:16.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3522999999999995e-05 2024-09-10T06:27:16.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.512 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.377091986000003, 2024-09-10T06:27:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026646590000000002, 2024-09-10T06:27:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 868 2024-09-10T06:27:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.513 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:16.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:16.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052173+0000", 2024-09-10T06:27:16.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-10T06:27:16.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052186+0000", 2024-09-10T06:27:16.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2787e-05 2024-09-10T06:27:16.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052216+0000", 2024-09-10T06:27:16.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9618999999999999e-05 2024-09-10T06:27:16.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052231+0000", 2024-09-10T06:27:16.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4929999999999999e-05 2024-09-10T06:27:16.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052349+0000", 2024-09-10T06:27:16.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011830200000000001 2024-09-10T06:27:16.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052561+0000", 2024-09-10T06:27:16.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000212182 2024-09-10T06:27:16.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:16.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052874+0000", 2024-09-10T06:27:16.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031299399999999998 2024-09-10T06:27:16.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054049+0000", 2024-09-10T06:27:16.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174825 2024-09-10T06:27:16.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054635+0000", 2024-09-10T06:27:16.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058643900000000001 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054721+0000", 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5185999999999994e-05 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054836+0000", 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114922 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.290435885000001, 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028453739999999999, 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 907 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:16.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:16.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138830+0000", 2024-09-10T06:27:16.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8600000000000001e-06 2024-09-10T06:27:16.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138842+0000", 2024-09-10T06:27:16.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2126e-05 2024-09-10T06:27:16.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138874+0000", 2024-09-10T06:27:16.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2047e-05 2024-09-10T06:27:16.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138889+0000", 2024-09-10T06:27:16.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4966999999999999e-05 2024-09-10T06:27:16.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139007+0000", 2024-09-10T06:27:16.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118479 2024-09-10T06:27:16.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139238+0000", 2024-09-10T06:27:16.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023031399999999999 2024-09-10T06:27:16.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:16.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139566+0000", 2024-09-10T06:27:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032816099999999999 2024-09-10T06:27:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.140631+0000", 2024-09-10T06:27:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010653679999999999 2024-09-10T06:27:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141393+0000", 2024-09-10T06:27:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076187100000000001 2024-09-10T06:27:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141561+0000", 2024-09-10T06:27:16.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016755599999999999 2024-09-10T06:27:16.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141672+0000", 2024-09-10T06:27:16.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111625 2024-09-10T06:27:16.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.524 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.524 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.524 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:16.525 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.286512369, 2024-09-10T06:27:16.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002857268, 2024-09-10T06:27:16.525 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.525 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.525 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.525 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 909 2024-09-10T06:27:16.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.525 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:16.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:16.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142753+0000", 2024-09-10T06:27:16.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4040000000000002e-06 2024-09-10T06:27:16.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142764+0000", 2024-09-10T06:27:16.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0789e-05 2024-09-10T06:27:16.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142795+0000", 2024-09-10T06:27:16.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0982999999999998e-05 2024-09-10T06:27:16.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142810+0000", 2024-09-10T06:27:16.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4960000000000001e-05 2024-09-10T06:27:16.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142908+0000", 2024-09-10T06:27:16.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8726000000000003e-05 2024-09-10T06:27:16.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143030+0000", 2024-09-10T06:27:16.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121649 2024-09-10T06:27:16.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:16.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143294+0000", 2024-09-10T06:27:16.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000263875 2024-09-10T06:27:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.144530+0000", 2024-09-10T06:27:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001236067 2024-09-10T06:27:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145340+0000", 2024-09-10T06:27:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080966700000000003 2024-09-10T06:27:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145497+0000", 2024-09-10T06:27:16.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015773499999999999 2024-09-10T06:27:16.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145608+0000", 2024-09-10T06:27:16.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110413 2024-09-10T06:27:16.530 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.530 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.530 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.530 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.530 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:16.530 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.192814872, 2024-09-10T06:27:16.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029166940000000001, 2024-09-10T06:27:16.531 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.531 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.531 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.531 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.531 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 949 2024-09-10T06:27:16.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.531 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:16.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:16.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236451+0000", 2024-09-10T06:27:16.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:27:16.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236464+0000", 2024-09-10T06:27:16.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3223e-05 2024-09-10T06:27:16.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236497+0000", 2024-09-10T06:27:16.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2672999999999997e-05 2024-09-10T06:27:16.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236515+0000", 2024-09-10T06:27:16.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8386999999999999e-05 2024-09-10T06:27:16.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236636+0000", 2024-09-10T06:27:16.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120752 2024-09-10T06:27:16.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236857+0000", 2024-09-10T06:27:16.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022134499999999999 2024-09-10T06:27:16.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:16.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.237188+0000", 2024-09-10T06:27:16.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033057799999999999 2024-09-10T06:27:16.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.238353+0000", 2024-09-10T06:27:16.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001164841 2024-09-10T06:27:16.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239160+0000", 2024-09-10T06:27:16.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080743000000000004 2024-09-10T06:27:16.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239245+0000", 2024-09-10T06:27:16.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5189e-05 2024-09-10T06:27:16.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239365+0000", 2024-09-10T06:27:16.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119406 2024-09-10T06:27:16.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.536 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.536 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.537 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.537 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:16.537 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.188953765000001, 2024-09-10T06:27:16.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025033970000000001, 2024-09-10T06:27:16.537 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.537 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.537 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.537 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.537 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 951 2024-09-10T06:27:16.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.538 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:16.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:16.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240311+0000", 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8899999999999999e-06 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240320+0000", 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6799999999999999e-06 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240341+0000", 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1379e-05 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240352+0000", 2024-09-10T06:27:16.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1354e-05 2024-09-10T06:27:16.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240450+0000", 2024-09-10T06:27:16.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7866000000000001e-05 2024-09-10T06:27:16.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240580+0000", 2024-09-10T06:27:16.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012970899999999999 2024-09-10T06:27:16.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:16.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240851+0000", 2024-09-10T06:27:16.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027059099999999998 2024-09-10T06:27:16.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242052+0000", 2024-09-10T06:27:16.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001201014 2024-09-10T06:27:16.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242662+0000", 2024-09-10T06:27:16.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061076800000000003 2024-09-10T06:27:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242747+0000", 2024-09-10T06:27:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5019999999999996e-05 2024-09-10T06:27:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242812+0000", 2024-09-10T06:27:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5126e-05 2024-09-10T06:27:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.543 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:16.543 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:16.543 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.178504345999997, 2024-09-10T06:27:16.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027897120000000002, 2024-09-10T06:27:16.543 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:16.543 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:16.543 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:16.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:16.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:16.543 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:16.543 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 955 2024-09-10T06:27:16.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.543 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:16.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:16.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:16.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:16.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:16.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:16.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:16.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250761+0000", 2024-09-10T06:27:16.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:16.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:16.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250772+0000", 2024-09-10T06:27:16.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1153e-05 2024-09-10T06:27:16.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:16.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250802+0000", 2024-09-10T06:27:16.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-05 2024-09-10T06:27:16.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:16.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250817+0000", 2024-09-10T06:27:16.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4883e-05 2024-09-10T06:27:16.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:16.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250925+0000", 2024-09-10T06:27:16.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108249 2024-09-10T06:27:16.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:16.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251139+0000", 2024-09-10T06:27:16.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000213568 2024-09-10T06:27:16.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:16.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251450+0000", 2024-09-10T06:27:16.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031139200000000002 2024-09-10T06:27:16.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:16.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.252574+0000", 2024-09-10T06:27:16.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011239139999999999 2024-09-10T06:27:16.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:16.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253377+0000", 2024-09-10T06:27:16.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080306400000000003 2024-09-10T06:27:16.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:16.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253466+0000", 2024-09-10T06:27:16.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8436000000000005e-05 2024-09-10T06:27:16.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:16.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:16.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:16.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253548+0000", 2024-09-10T06:27:16.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2496000000000004e-05 2024-09-10T06:27:16.548 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.548 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.548 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.548 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:16.549 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:16.549 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:16.549 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:16.430+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:16.550 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:27:16.593 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:16.594+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:16.653 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:16.654+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:16.721 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:16.721 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:16.721 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:16.721 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:16.734 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:27:16.755 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:16.750+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:16.856 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:16.854+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:16.892 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:16.892 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:16.892 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:16.892 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:16.892 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:16.906 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:27:16.931 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T06:27:16.958 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:16.954+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:17.061 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:17.062+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:17.073 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:17.073 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:17.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:17.073 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:17.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.073 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:17.073 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:17.073 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.748071434000003, 2024-09-10T06:27:17.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030326279999999999, 2024-09-10T06:27:17.073 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.074 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.074 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.074 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.074 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.074 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.074 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 58 2024-09-10T06:27:17.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.074 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:17.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:17.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:17.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-10T06:27:17.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324169+0000", 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9020000000000004e-06 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324182+0000", 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2166e-05 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324190+0000", 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.337e-06 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324282+0000", 2024-09-10T06:27:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2331999999999996e-05 2024-09-10T06:27:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324486+0000", 2024-09-10T06:27:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020347400000000001 2024-09-10T06:27:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324719+0000", 2024-09-10T06:27:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023289900000000001 2024-09-10T06:27:17.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.325993+0000", 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012746929999999999 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327088+0000", 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010947330000000001 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327147+0000", 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8677000000000001e-05 2024-09-10T06:27:17.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327195+0000", 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8469e-05 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.766250851999999, 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003846917, 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.079 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 207 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305987+0000", 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6069999999999999e-06 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306002+0000", 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5406000000000001e-05 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306036+0000", 2024-09-10T06:27:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4146000000000001e-05 2024-09-10T06:27:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306061+0000", 2024-09-10T06:27:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4470000000000001e-05 2024-09-10T06:27:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306325+0000", 2024-09-10T06:27:17.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026382800000000002 2024-09-10T06:27:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306569+0000", 2024-09-10T06:27:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024445499999999998 2024-09-10T06:27:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.307017+0000", 2024-09-10T06:27:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044774000000000002 2024-09-10T06:27:17.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.308517+0000", 2024-09-10T06:27:17.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001500075 2024-09-10T06:27:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309685+0000", 2024-09-10T06:27:17.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001168505 2024-09-10T06:27:17.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309767+0000", 2024-09-10T06:27:17.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1992999999999999e-05 2024-09-10T06:27:17.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309830+0000", 2024-09-10T06:27:17.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2692000000000002e-05 2024-09-10T06:27:17.087 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.087 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.087 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.087 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.088 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:17.088 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.721998804000002, 2024-09-10T06:27:17.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003433888, 2024-09-10T06:27:17.088 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.088 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.088 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.088 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.088 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.088 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.088 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 216 2024-09-10T06:27:17.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.088 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:17.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:17.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350239+0000", 2024-09-10T06:27:17.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.377e-06 2024-09-10T06:27:17.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350254+0000", 2024-09-10T06:27:17.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.501e-05 2024-09-10T06:27:17.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350288+0000", 2024-09-10T06:27:17.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4746000000000002e-05 2024-09-10T06:27:17.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350312+0000", 2024-09-10T06:27:17.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3249999999999999e-05 2024-09-10T06:27:17.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350456+0000", 2024-09-10T06:27:17.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014483899999999999 2024-09-10T06:27:17.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350704+0000", 2024-09-10T06:27:17.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024719100000000001 2024-09-10T06:27:17.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:17.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.351117+0000", 2024-09-10T06:27:17.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000412934 2024-09-10T06:27:17.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.352644+0000", 2024-09-10T06:27:17.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015271079999999999 2024-09-10T06:27:17.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353397+0000", 2024-09-10T06:27:17.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075311799999999999 2024-09-10T06:27:17.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353556+0000", 2024-09-10T06:27:17.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159612 2024-09-10T06:27:17.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353669+0000", 2024-09-10T06:27:17.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011270299999999999 2024-09-10T06:27:17.093 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.094 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.094 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.094 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.094 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:17.094 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.683319341999997, 2024-09-10T06:27:17.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033447479999999998, 2024-09-10T06:27:17.094 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.094 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.094 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.094 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.094 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.095 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 227 2024-09-10T06:27:17.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.095 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:17.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:17.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388917+0000", 2024-09-10T06:27:17.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6900000000000001e-06 2024-09-10T06:27:17.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388931+0000", 2024-09-10T06:27:17.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3900000000000001e-05 2024-09-10T06:27:17.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388964+0000", 2024-09-10T06:27:17.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2985999999999999e-05 2024-09-10T06:27:17.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388980+0000", 2024-09-10T06:27:17.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.535e-05 2024-09-10T06:27:17.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389123+0000", 2024-09-10T06:27:17.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014337900000000001 2024-09-10T06:27:17.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389341+0000", 2024-09-10T06:27:17.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021765099999999999 2024-09-10T06:27:17.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:17.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389765+0000", 2024-09-10T06:27:17.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042423100000000001 2024-09-10T06:27:17.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.391433+0000", 2024-09-10T06:27:17.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016681000000000001 2024-09-10T06:27:17.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392104+0000", 2024-09-10T06:27:17.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067064800000000003 2024-09-10T06:27:17.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392191+0000", 2024-09-10T06:27:17.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7912999999999997e-05 2024-09-10T06:27:17.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.100 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392259+0000", 2024-09-10T06:27:17.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7899999999999997e-05 2024-09-10T06:27:17.100 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.100 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.100 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.101 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.101 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:17.101 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.676062567999999, 2024-09-10T06:27:17.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029995500000000001, 2024-09-10T06:27:17.101 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.101 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.101 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.101 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 229 2024-09-10T06:27:17.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.101 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:17.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:17.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396174+0000", 2024-09-10T06:27:17.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.774e-06 2024-09-10T06:27:17.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396186+0000", 2024-09-10T06:27:17.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2055999999999999e-05 2024-09-10T06:27:17.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396216+0000", 2024-09-10T06:27:17.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9640000000000001e-05 2024-09-10T06:27:17.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396231+0000", 2024-09-10T06:27:17.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:17.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396356+0000", 2024-09-10T06:27:17.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012504500000000001 2024-09-10T06:27:17.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396568+0000", 2024-09-10T06:27:17.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000211709 2024-09-10T06:27:17.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:17.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396954+0000", 2024-09-10T06:27:17.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386027 2024-09-10T06:27:17.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.398287+0000", 2024-09-10T06:27:17.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013331560000000001 2024-09-10T06:27:17.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399004+0000", 2024-09-10T06:27:17.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071720499999999995 2024-09-10T06:27:17.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.106 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399091+0000", 2024-09-10T06:27:17.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6714999999999999e-05 2024-09-10T06:27:17.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.106 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399171+0000", 2024-09-10T06:27:17.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9893000000000002e-05 2024-09-10T06:27:17.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.107 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.107 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.107 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.107 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:17.107 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.669503999, 2024-09-10T06:27:17.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030468270000000002, 2024-09-10T06:27:17.107 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.107 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.107 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.108 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.108 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 231 2024-09-10T06:27:17.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.108 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:17.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402732+0000", 2024-09-10T06:27:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-06 2024-09-10T06:27:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402744+0000", 2024-09-10T06:27:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1633e-05 2024-09-10T06:27:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402774+0000", 2024-09-10T06:27:17.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9666999999999999e-05 2024-09-10T06:27:17.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402789+0000", 2024-09-10T06:27:17.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5466000000000001e-05 2024-09-10T06:27:17.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402904+0000", 2024-09-10T06:27:17.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114466 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403119+0000", 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215572 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403516+0000", 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039663300000000002 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405012+0000", 2024-09-10T06:27:17.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014961919999999999 2024-09-10T06:27:17.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405634+0000", 2024-09-10T06:27:17.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062145199999999999 2024-09-10T06:27:17.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405715+0000", 2024-09-10T06:27:17.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1619000000000006e-05 2024-09-10T06:27:17.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.112 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405777+0000", 2024-09-10T06:27:17.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1639999999999999e-05 2024-09-10T06:27:17.113 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.113 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.113 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.113 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:377 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.113 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:17.113 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.610748667999999, 2024-09-10T06:27:17.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058485480000000003, 2024-09-10T06:27:17.113 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.113 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.113 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.114 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.114 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 377 2024-09-10T06:27:17.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.114 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:17.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:17.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461486+0000", 2024-09-10T06:27:17.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0720000000000001e-06 2024-09-10T06:27:17.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461504+0000", 2024-09-10T06:27:17.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8002000000000001e-05 2024-09-10T06:27:17.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461519+0000", 2024-09-10T06:27:17.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4584e-05 2024-09-10T06:27:17.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461526+0000", 2024-09-10T06:27:17.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5560000000000004e-06 2024-09-10T06:27:17.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461597+0000", 2024-09-10T06:27:17.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1311999999999998e-05 2024-09-10T06:27:17.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461709+0000", 2024-09-10T06:27:17.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011191100000000001 2024-09-10T06:27:17.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:17.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461871+0000", 2024-09-10T06:27:17.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016254900000000001 2024-09-10T06:27:17.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.462777+0000", 2024-09-10T06:27:17.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00090547100000000003 2024-09-10T06:27:17.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467265+0000", 2024-09-10T06:27:17.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004488222 2024-09-10T06:27:17.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467308+0000", 2024-09-10T06:27:17.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2975000000000001e-05 2024-09-10T06:27:17.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467334+0000", 2024-09-10T06:27:17.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5894e-05 2024-09-10T06:27:17.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.119 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.119 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.119 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:384 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.119 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:17.119 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.608615813, 2024-09-10T06:27:17.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031588900000000001, 2024-09-10T06:27:17.119 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.119 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.119 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.120 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.120 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 384 2024-09-10T06:27:17.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.120 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:17.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:17.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463620+0000", 2024-09-10T06:27:17.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:17.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463625+0000", 2024-09-10T06:27:17.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6450000000000002e-06 2024-09-10T06:27:17.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463639+0000", 2024-09-10T06:27:17.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3540000000000001e-05 2024-09-10T06:27:17.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463648+0000", 2024-09-10T06:27:17.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0259999999999996e-06 2024-09-10T06:27:17.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463713+0000", 2024-09-10T06:27:17.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5438000000000006e-05 2024-09-10T06:27:17.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463774+0000", 2024-09-10T06:27:17.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0582999999999999e-05 2024-09-10T06:27:17.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:17.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463899+0000", 2024-09-10T06:27:17.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-10T06:27:17.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.464371+0000", 2024-09-10T06:27:17.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047201600000000002 2024-09-10T06:27:17.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466707+0000", 2024-09-10T06:27:17.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023354999999999999 2024-09-10T06:27:17.124 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466742+0000", 2024-09-10T06:27:17.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4686e-05 2024-09-10T06:27:17.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466777+0000", 2024-09-10T06:27:17.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5537000000000002e-05 2024-09-10T06:27:17.125 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.125 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.125 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.125 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:436 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.125 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:17.125 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.593368765999998, 2024-09-10T06:27:17.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040690570000000001, 2024-09-10T06:27:17.126 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.126 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.126 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.126 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.126 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.126 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.126 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 436 2024-09-10T06:27:17.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.126 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:17.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:17.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478866+0000", 2024-09-10T06:27:17.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1960000000000001e-06 2024-09-10T06:27:17.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478871+0000", 2024-09-10T06:27:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6879999999999998e-06 2024-09-10T06:27:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478883+0000", 2024-09-10T06:27:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1790999999999999e-05 2024-09-10T06:27:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478890+0000", 2024-09-10T06:27:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8569999999999997e-06 2024-09-10T06:27:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478958+0000", 2024-09-10T06:27:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7774999999999994e-05 2024-09-10T06:27:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479072+0000", 2024-09-10T06:27:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114577 2024-09-10T06:27:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479255+0000", 2024-09-10T06:27:17.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018297300000000001 2024-09-10T06:27:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482448+0000", 2024-09-10T06:27:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031933389999999999 2024-09-10T06:27:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482828+0000", 2024-09-10T06:27:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037961800000000002 2024-09-10T06:27:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482891+0000", 2024-09-10T06:27:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3316000000000002e-05 2024-09-10T06:27:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482934+0000", 2024-09-10T06:27:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2926999999999997e-05 2024-09-10T06:27:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:441 6.7 e34/28 6:e1cdb60d:reshard::reshard.0000000008:head v 34'7, mlcod=34'5)", 2024-09-10T06:27:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:17.131 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.589767848000001, 2024-09-10T06:27:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060368319999999998, 2024-09-10T06:27:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:17.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482467+0000", 2024-09-10T06:27:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8800000000000003e-07 2024-09-10T06:27:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482472+0000", 2024-09-10T06:27:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8730000000000004e-06 2024-09-10T06:27:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482481+0000", 2024-09-10T06:27:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1980000000000001e-06 2024-09-10T06:27:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482485+0000", 2024-09-10T06:27:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.386e-06 2024-09-10T06:27:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482541+0000", 2024-09-10T06:27:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5788000000000002e-05 2024-09-10T06:27:17.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482563+0000", 2024-09-10T06:27:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2303999999999999e-05 2024-09-10T06:27:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488465+0000", 2024-09-10T06:27:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059014810000000001 2024-09-10T06:27:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488503+0000", 2024-09-10T06:27:17.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8313999999999999e-05 2024-09-10T06:27:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:466 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.574608597999998, 2024-09-10T06:27:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039032810000000002, 2024-09-10T06:27:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 466 2024-09-10T06:27:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:17.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497626+0000", 2024-09-10T06:27:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9099999999999991e-07 2024-09-10T06:27:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497634+0000", 2024-09-10T06:27:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.994e-06 2024-09-10T06:27:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497644+0000", 2024-09-10T06:27:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6260000000000007e-06 2024-09-10T06:27:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497650+0000", 2024-09-10T06:27:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5160000000000002e-06 2024-09-10T06:27:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497718+0000", 2024-09-10T06:27:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8862999999999994e-05 2024-09-10T06:27:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497775+0000", 2024-09-10T06:27:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6156000000000002e-05 2024-09-10T06:27:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497903+0000", 2024-09-10T06:27:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012879800000000001 2024-09-10T06:27:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499630+0000", 2024-09-10T06:27:17.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017268139999999999 2024-09-10T06:27:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501439+0000", 2024-09-10T06:27:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018086669999999999 2024-09-10T06:27:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501478+0000", 2024-09-10T06:27:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9269e-05 2024-09-10T06:27:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.141 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501529+0000", 2024-09-10T06:27:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0587000000000002e-05 2024-09-10T06:27:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:469 6.0 e34/28 6:02683654:reshard::reshard.0000000010:head v 34'6, mlcod=34'4)", 2024-09-10T06:27:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.572605775, 2024-09-10T06:27:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048323109999999997, 2024-09-10T06:27:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.142 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499629+0000", 2024-09-10T06:27:17.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9199999999999999e-07 2024-09-10T06:27:17.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499634+0000", 2024-09-10T06:27:17.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2530000000000004e-06 2024-09-10T06:27:17.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499644+0000", 2024-09-10T06:27:17.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5820000000000008e-06 2024-09-10T06:27:17.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499650+0000", 2024-09-10T06:27:17.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7919999999999998e-06 2024-09-10T06:27:17.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499697+0000", 2024-09-10T06:27:17.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7564000000000001e-05 2024-09-10T06:27:17.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499719+0000", 2024-09-10T06:27:17.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1297999999999998e-05 2024-09-10T06:27:17.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504413+0000", 2024-09-10T06:27:17.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004694419 2024-09-10T06:27:17.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504461+0000", 2024-09-10T06:27:17.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7511e-05 2024-09-10T06:27:17.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.146 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.146 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.146 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:621 6.0 e34/28 6:0705c68b:::obj_delete_at_hint.0000000028:head v 34'11, mlcod=34'9)", 2024-09-10T06:27:17.147 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:17.147 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.467404629999997, 2024-09-10T06:27:17.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003196562, 2024-09-10T06:27:17.147 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.147 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.147 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.147 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:17.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604831+0000", 2024-09-10T06:27:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.823e-06 2024-09-10T06:27:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604843+0000", 2024-09-10T06:27:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1437000000000001e-05 2024-09-10T06:27:17.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604868+0000", 2024-09-10T06:27:17.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5837e-05 2024-09-10T06:27:17.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604885+0000", 2024-09-10T06:27:17.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6759999999999999e-05 2024-09-10T06:27:17.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604971+0000", 2024-09-10T06:27:17.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5512000000000004e-05 2024-09-10T06:27:17.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604991+0000", 2024-09-10T06:27:17.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0197999999999999e-05 2024-09-10T06:27:17.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.607960+0000", 2024-09-10T06:27:17.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002969307 2024-09-10T06:27:17.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608026+0000", 2024-09-10T06:27:17.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5687999999999999e-05 2024-09-10T06:27:17.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.151 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.151 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:636 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.151 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:17.151 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.458494975999997, 2024-09-10T06:27:17.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048306950000000003, 2024-09-10T06:27:17.152 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.152 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.152 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.152 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.152 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 636 2024-09-10T06:27:17.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.152 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:17.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:17.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613740+0000", 2024-09-10T06:27:17.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:17.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613747+0000", 2024-09-10T06:27:17.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8090000000000004e-06 2024-09-10T06:27:17.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613762+0000", 2024-09-10T06:27:17.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5037e-05 2024-09-10T06:27:17.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613772+0000", 2024-09-10T06:27:17.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7510000000000003e-06 2024-09-10T06:27:17.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613834+0000", 2024-09-10T06:27:17.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2458000000000004e-05 2024-09-10T06:27:17.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613916+0000", 2024-09-10T06:27:17.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1630000000000003e-05 2024-09-10T06:27:17.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:17.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.614071+0000", 2024-09-10T06:27:17.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015480800000000001 2024-09-10T06:27:17.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.615885+0000", 2024-09-10T06:27:17.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001814607 2024-09-10T06:27:17.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618438+0000", 2024-09-10T06:27:17.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025529459999999999 2024-09-10T06:27:17.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618503+0000", 2024-09-10T06:27:17.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4851000000000006e-05 2024-09-10T06:27:17.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618570+0000", 2024-09-10T06:27:17.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6418e-05 2024-09-10T06:27:17.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.157 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.157 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.158 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:646 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.158 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:17.158 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.449033186000001, 2024-09-10T06:27:17.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049103549999999999, 2024-09-10T06:27:17.158 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.158 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.158 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.158 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.158 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 646 2024-09-10T06:27:17.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623202+0000", 2024-09-10T06:27:17.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9800000000000002e-07 2024-09-10T06:27:17.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623206+0000", 2024-09-10T06:27:17.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6380000000000003e-06 2024-09-10T06:27:17.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623216+0000", 2024-09-10T06:27:17.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4439999999999997e-06 2024-09-10T06:27:17.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623221+0000", 2024-09-10T06:27:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6400000000000002e-06 2024-09-10T06:27:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623300+0000", 2024-09-10T06:27:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8677999999999994e-05 2024-09-10T06:27:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623410+0000", 2024-09-10T06:27:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010954399999999999 2024-09-10T06:27:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:17.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623629+0000", 2024-09-10T06:27:17.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000219836 2024-09-10T06:27:17.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.625072+0000", 2024-09-10T06:27:17.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014427929999999999 2024-09-10T06:27:17.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.627982+0000", 2024-09-10T06:27:17.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029097620000000002 2024-09-10T06:27:17.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628058+0000", 2024-09-10T06:27:17.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6390999999999994e-05 2024-09-10T06:27:17.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628111+0000", 2024-09-10T06:27:17.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2731e-05 2024-09-10T06:27:17.163 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.163 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.163 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.164 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.164 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:17.164 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.386358913999999, 2024-09-10T06:27:17.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033783509999999999, 2024-09-10T06:27:17.164 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.164 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.164 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.164 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.164 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 703 2024-09-10T06:27:17.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.165 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:17.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:17.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685878+0000", 2024-09-10T06:27:17.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5900000000000002e-06 2024-09-10T06:27:17.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685889+0000", 2024-09-10T06:27:17.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:17.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685919+0000", 2024-09-10T06:27:17.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0307e-05 2024-09-10T06:27:17.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685935+0000", 2024-09-10T06:27:17.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5336e-05 2024-09-10T06:27:17.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686092+0000", 2024-09-10T06:27:17.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015776200000000001 2024-09-10T06:27:17.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686462+0000", 2024-09-10T06:27:17.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036925700000000001 2024-09-10T06:27:17.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:17.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.687048+0000", 2024-09-10T06:27:17.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000586266 2024-09-10T06:27:17.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688261+0000", 2024-09-10T06:27:17.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012132670000000001 2024-09-10T06:27:17.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688974+0000", 2024-09-10T06:27:17.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071248800000000005 2024-09-10T06:27:17.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689129+0000", 2024-09-10T06:27:17.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155499 2024-09-10T06:27:17.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689253+0000", 2024-09-10T06:27:17.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124289 2024-09-10T06:27:17.169 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.169 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.170 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.170 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.170 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:17.170 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.027793410999998, 2024-09-10T06:27:17.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032750980000000002, 2024-09-10T06:27:17.170 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.170 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.170 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.170 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.170 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 865 2024-09-10T06:27:17.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.171 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:17.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:17.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044443+0000", 2024-09-10T06:27:17.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6929999999999999e-06 2024-09-10T06:27:17.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044456+0000", 2024-09-10T06:27:17.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.224e-05 2024-09-10T06:27:17.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044486+0000", 2024-09-10T06:27:17.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.095e-05 2024-09-10T06:27:17.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044501+0000", 2024-09-10T06:27:17.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4932999999999999e-05 2024-09-10T06:27:17.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044646+0000", 2024-09-10T06:27:17.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014465600000000001 2024-09-10T06:27:17.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045001+0000", 2024-09-10T06:27:17.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035473999999999998 2024-09-10T06:27:17.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:17.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045549+0000", 2024-09-10T06:27:17.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054870299999999999 2024-09-10T06:27:17.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.046956+0000", 2024-09-10T06:27:17.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014061189999999999 2024-09-10T06:27:17.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047452+0000", 2024-09-10T06:27:17.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049682199999999995 2024-09-10T06:27:17.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047606+0000", 2024-09-10T06:27:17.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015379599999999999 2024-09-10T06:27:17.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047716+0000", 2024-09-10T06:27:17.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109446 2024-09-10T06:27:17.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.176 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.176 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.176 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.176 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:17.176 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 35.023330258999998, 2024-09-10T06:27:17.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030837989999999999, 2024-09-10T06:27:17.177 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.177 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.177 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.177 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.177 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.177 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.177 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 867 2024-09-10T06:27:17.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.177 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:17.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:17.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048906+0000", 2024-09-10T06:27:17.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1770000000000001e-06 2024-09-10T06:27:17.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048916+0000", 2024-09-10T06:27:17.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.025e-05 2024-09-10T06:27:17.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048948+0000", 2024-09-10T06:27:17.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1859000000000001e-05 2024-09-10T06:27:17.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048968+0000", 2024-09-10T06:27:17.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9647e-05 2024-09-10T06:27:17.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049090+0000", 2024-09-10T06:27:17.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122645 2024-09-10T06:27:17.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049314+0000", 2024-09-10T06:27:17.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022372900000000001 2024-09-10T06:27:17.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:17.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049785+0000", 2024-09-10T06:27:17.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047121899999999999 2024-09-10T06:27:17.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.050979+0000", 2024-09-10T06:27:17.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001193408 2024-09-10T06:27:17.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051729+0000", 2024-09-10T06:27:17.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075039699999999998 2024-09-10T06:27:17.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051874+0000", 2024-09-10T06:27:17.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000145253 2024-09-10T06:27:17.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051988+0000", 2024-09-10T06:27:17.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011321500000000001 2024-09-10T06:27:17.182 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.182 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.182 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.182 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.183 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:17.183 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.954463078000003, 2024-09-10T06:27:17.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035511029999999999, 2024-09-10T06:27:17.183 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.183 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.183 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.183 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.183 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 898 2024-09-10T06:27:17.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.184 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:17.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:17.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117772+0000", 2024-09-10T06:27:17.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5340000000000001e-06 2024-09-10T06:27:17.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117781+0000", 2024-09-10T06:27:17.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.276e-06 2024-09-10T06:27:17.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117804+0000", 2024-09-10T06:27:17.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3093999999999999e-05 2024-09-10T06:27:17.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117816+0000", 2024-09-10T06:27:17.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1986e-05 2024-09-10T06:27:17.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117954+0000", 2024-09-10T06:27:17.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013856900000000001 2024-09-10T06:27:17.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118327+0000", 2024-09-10T06:27:17.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000372841 2024-09-10T06:27:17.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:17.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118919+0000", 2024-09-10T06:27:17.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059172800000000002 2024-09-10T06:27:17.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.120253+0000", 2024-09-10T06:27:17.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001333643 2024-09-10T06:27:17.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121060+0000", 2024-09-10T06:27:17.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080731100000000001 2024-09-10T06:27:17.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121210+0000", 2024-09-10T06:27:17.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014980500000000001 2024-09-10T06:27:17.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121322+0000", 2024-09-10T06:27:17.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112316 2024-09-10T06:27:17.188 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.188 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.189 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.189 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:17.189 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 34.865193265999999, 2024-09-10T06:27:17.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051838630000000004, 2024-09-10T06:27:17.189 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:17.189 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:17.189 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:17.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:17.189 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.189 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 937 2024-09-10T06:27:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:17.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207042+0000", 2024-09-10T06:27:17.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7439999999999999e-06 2024-09-10T06:27:17.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:17.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207051+0000", 2024-09-10T06:27:17.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7299999999999994e-06 2024-09-10T06:27:17.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:17.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207072+0000", 2024-09-10T06:27:17.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1209e-05 2024-09-10T06:27:17.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207089+0000", 2024-09-10T06:27:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6297e-05 2024-09-10T06:27:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207231+0000", 2024-09-10T06:27:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014233200000000001 2024-09-10T06:27:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:17.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207463+0000", 2024-09-10T06:27:17.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023155199999999999 2024-09-10T06:27:17.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:17.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207797+0000", 2024-09-10T06:27:17.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033413699999999998 2024-09-10T06:27:17.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:17.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.209053+0000", 2024-09-10T06:27:17.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012560029999999999 2024-09-10T06:27:17.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212076+0000", 2024-09-10T06:27:17.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030234239999999998 2024-09-10T06:27:17.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:17.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212162+0000", 2024-09-10T06:27:17.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5506000000000004e-05 2024-09-10T06:27:17.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:17.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:17.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:17.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212225+0000", 2024-09-10T06:27:17.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2928999999999993e-05 2024-09-10T06:27:17.194 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.195 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:17.195 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:17.195 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:17.197 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:27:17.197 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:17.194+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:17.297 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:17.298+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:17.329 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:17.329 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:17.329 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:17.329 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:17.343 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:27:17.353 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-10T06:27:17.425 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:17.426+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:17.466 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:17.466 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:17.466 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:17.466 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:17.481 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:27:17.498 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:17.498+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:17.599 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:17.598+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:17.602 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:27:17.605 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:17.605 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-10T06:27:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.312398702000003, 2024-09-10T06:27:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047108059999999997, 2024-09-10T06:27:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291391+0000", 2024-09-10T06:27:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8700000000000001e-06 2024-09-10T06:27:17.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291405+0000", 2024-09-10T06:27:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4623e-05 2024-09-10T06:27:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291438+0000", 2024-09-10T06:27:17.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2616000000000001e-05 2024-09-10T06:27:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291461+0000", 2024-09-10T06:27:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2883000000000001e-05 2024-09-10T06:27:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293024+0000", 2024-09-10T06:27:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015627709999999999 2024-09-10T06:27:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293071+0000", 2024-09-10T06:27:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7797000000000003e-05 2024-09-10T06:27:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295983+0000", 2024-09-10T06:27:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029113640000000001 2024-09-10T06:27:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296100+0000", 2024-09-10T06:27:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116882 2024-09-10T06:27:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.610 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.271040923999998, 2024-09-10T06:27:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00338296, 2024-09-10T06:27:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.611 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 211 2024-09-10T06:27:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332750+0000", 2024-09-10T06:27:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-10T06:27:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332767+0000", 2024-09-10T06:27:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.702e-05 2024-09-10T06:27:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332805+0000", 2024-09-10T06:27:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7950000000000001e-05 2024-09-10T06:27:17.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332824+0000", 2024-09-10T06:27:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8462999999999999e-05 2024-09-10T06:27:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332950+0000", 2024-09-10T06:27:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012653600000000001 2024-09-10T06:27:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333177+0000", 2024-09-10T06:27:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022626800000000001 2024-09-10T06:27:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333604+0000", 2024-09-10T06:27:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042759999999999999 2024-09-10T06:27:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335279+0000", 2024-09-10T06:27:17.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001674481 2024-09-10T06:27:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335976+0000", 2024-09-10T06:27:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069707099999999995 2024-09-10T06:27:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336063+0000", 2024-09-10T06:27:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6916000000000006e-05 2024-09-10T06:27:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336130+0000", 2024-09-10T06:27:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6971999999999995e-05 2024-09-10T06:27:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.197766049000002, 2024-09-10T06:27:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034123389999999999, 2024-09-10T06:27:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232 2024-09-10T06:27:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406025+0000", 2024-09-10T06:27:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-10T06:27:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406040+0000", 2024-09-10T06:27:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5299999999999999e-05 2024-09-10T06:27:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406072+0000", 2024-09-10T06:27:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2543000000000003e-05 2024-09-10T06:27:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406088+0000", 2024-09-10T06:27:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5699999999999999e-05 2024-09-10T06:27:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406206+0000", 2024-09-10T06:27:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011828900000000001 2024-09-10T06:27:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406416+0000", 2024-09-10T06:27:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020969900000000001 2024-09-10T06:27:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406804+0000", 2024-09-10T06:27:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038783699999999998 2024-09-10T06:27:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.408490+0000", 2024-09-10T06:27:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001686353 2024-09-10T06:27:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409152+0000", 2024-09-10T06:27:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066160800000000005 2024-09-10T06:27:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409314+0000", 2024-09-10T06:27:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000162285 2024-09-10T06:27:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409434+0000", 2024-09-10T06:27:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119639 2024-09-10T06:27:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.177836603999999, 2024-09-10T06:27:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034077650000000001, 2024-09-10T06:27:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241 2024-09-10T06:27:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425954+0000", 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425965+0000", 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.181e-05 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425996+0000", 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0759000000000001e-05 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426011+0000", 2024-09-10T06:27:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4507e-05 2024-09-10T06:27:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426153+0000", 2024-09-10T06:27:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014206599999999999 2024-09-10T06:27:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426491+0000", 2024-09-10T06:27:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033830399999999999 2024-09-10T06:27:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426973+0000", 2024-09-10T06:27:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000482113 2024-09-10T06:27:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.428378+0000", 2024-09-10T06:27:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001404539 2024-09-10T06:27:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429113+0000", 2024-09-10T06:27:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073537799999999996 2024-09-10T06:27:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429251+0000", 2024-09-10T06:27:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013789600000000001 2024-09-10T06:27:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429359+0000", 2024-09-10T06:27:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107846 2024-09-10T06:27:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:266 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.173103580000003, 2024-09-10T06:27:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030966560000000001, 2024-09-10T06:27:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 266 2024-09-10T06:27:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430687+0000", 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0299999999999998e-06 2024-09-10T06:27:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430702+0000", 2024-09-10T06:27:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5316999999999999e-05 2024-09-10T06:27:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430741+0000", 2024-09-10T06:27:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8336e-05 2024-09-10T06:27:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430762+0000", 2024-09-10T06:27:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.162e-05 2024-09-10T06:27:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430923+0000", 2024-09-10T06:27:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016044599999999999 2024-09-10T06:27:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431103+0000", 2024-09-10T06:27:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018030100000000001 2024-09-10T06:27:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431513+0000", 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040992999999999997 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432715+0000", 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001202411 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433624+0000", 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090863000000000001 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433718+0000", 2024-09-10T06:27:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3749e-05 2024-09-10T06:27:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433781+0000", 2024-09-10T06:27:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2885999999999994e-05 2024-09-10T06:27:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:273 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.171529978999999, 2024-09-10T06:27:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028009850000000002, 2024-09-10T06:27:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 273 2024-09-10T06:27:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432260+0000", 2024-09-10T06:27:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1900000000000002e-06 2024-09-10T06:27:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432271+0000", 2024-09-10T06:27:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1353e-05 2024-09-10T06:27:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432296+0000", 2024-09-10T06:27:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4817e-05 2024-09-10T06:27:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432318+0000", 2024-09-10T06:27:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1963e-05 2024-09-10T06:27:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432465+0000", 2024-09-10T06:27:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014658299999999999 2024-09-10T06:27:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432801+0000", 2024-09-10T06:27:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033681299999999999 2024-09-10T06:27:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433188+0000", 2024-09-10T06:27:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000386857 2024-09-10T06:27:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434552+0000", 2024-09-10T06:27:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013634400000000001 2024-09-10T06:27:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434872+0000", 2024-09-10T06:27:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031998399999999999 2024-09-10T06:27:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434973+0000", 2024-09-10T06:27:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100962 2024-09-10T06:27:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.435059+0000", 2024-09-10T06:27:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6023e-05 2024-09-10T06:27:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:299 6.14 e34/28 6:2c0c0c23:reshard::reshard.0000000001:head v 34'2, mlcod=0'0)", 2024-09-10T06:27:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.166914128000002, 2024-09-10T06:27:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029099109999999998, 2024-09-10T06:27:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436875+0000", 2024-09-10T06:27:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0430000000000002e-06 2024-09-10T06:27:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436890+0000", 2024-09-10T06:27:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4766999999999999e-05 2024-09-10T06:27:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436918+0000", 2024-09-10T06:27:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.76e-05 2024-09-10T06:27:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436937+0000", 2024-09-10T06:27:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9539999999999999e-05 2024-09-10T06:27:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437081+0000", 2024-09-10T06:27:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144065 2024-09-10T06:27:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437130+0000", 2024-09-10T06:27:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8609999999999997e-05 2024-09-10T06:27:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439676+0000", 2024-09-10T06:27:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002546137 2024-09-10T06:27:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439783+0000", 2024-09-10T06:27:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107149 2024-09-10T06:27:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:341 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.157994432999999, 2024-09-10T06:27:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030260230000000001, 2024-09-10T06:27:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 341 2024-09-10T06:27:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445796+0000", 2024-09-10T06:27:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7130000000000001e-06 2024-09-10T06:27:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445810+0000", 2024-09-10T06:27:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4564e-05 2024-09-10T06:27:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445886+0000", 2024-09-10T06:27:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5921999999999996e-05 2024-09-10T06:27:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445902+0000", 2024-09-10T06:27:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5800000000000001e-05 2024-09-10T06:27:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446057+0000", 2024-09-10T06:27:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015475600000000001 2024-09-10T06:27:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446347+0000", 2024-09-10T06:27:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029057699999999998 2024-09-10T06:27:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446669+0000", 2024-09-10T06:27:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032102399999999999 2024-09-10T06:27:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.447891+0000", 2024-09-10T06:27:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012226680000000001 2024-09-10T06:27:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448550+0000", 2024-09-10T06:27:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065925800000000002 2024-09-10T06:27:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448699+0000", 2024-09-10T06:27:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014831800000000001 2024-09-10T06:27:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448819+0000", 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120423 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:505 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.076315903000001, 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028092249999999998, 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 505 2024-09-10T06:27:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527474+0000", 2024-09-10T06:27:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-10T06:27:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527495+0000", 2024-09-10T06:27:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0910000000000001e-05 2024-09-10T06:27:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527549+0000", 2024-09-10T06:27:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3223000000000002e-05 2024-09-10T06:27:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527583+0000", 2024-09-10T06:27:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4773000000000001e-05 2024-09-10T06:27:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527737+0000", 2024-09-10T06:27:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325199999999999 2024-09-10T06:27:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528092+0000", 2024-09-10T06:27:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000354951 2024-09-10T06:27:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528657+0000", 2024-09-10T06:27:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00056537500000000001 2024-09-10T06:27:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.529771+0000", 2024-09-10T06:27:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011136519999999999 2024-09-10T06:27:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530072+0000", 2024-09-10T06:27:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030151700000000001 2024-09-10T06:27:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530213+0000", 2024-09-10T06:27:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014100500000000001 2024-09-10T06:27:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530281+0000", 2024-09-10T06:27:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7793999999999995e-05 2024-09-10T06:27:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.072646626000001, 2024-09-10T06:27:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051813969999999999, 2024-09-10T06:27:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 513 2024-09-10T06:27:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531143+0000", 2024-09-10T06:27:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7400000000000001e-06 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531153+0000", 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.815e-06 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531178+0000", 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5755e-05 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531190+0000", 2024-09-10T06:27:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1250000000000001e-05 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531322+0000", 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013239299999999999 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531550+0000", 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000227598 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531966+0000", 2024-09-10T06:27:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041634400000000002 2024-09-10T06:27:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533197+0000", 2024-09-10T06:27:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012308810000000001 2024-09-10T06:27:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536097+0000", 2024-09-10T06:27:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029007159999999998 2024-09-10T06:27:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536245+0000", 2024-09-10T06:27:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000147816 2024-09-10T06:27:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536322+0000", 2024-09-10T06:27:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7088999999999993e-05 2024-09-10T06:27:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:514 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.072574428999999, 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048258260000000001, 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 514 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531214+0000", 2024-09-10T06:27:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2699999999999998e-07 2024-09-10T06:27:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531219+0000", 2024-09-10T06:27:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-10T06:27:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531233+0000", 2024-09-10T06:27:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.38e-05 2024-09-10T06:27:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531240+0000", 2024-09-10T06:27:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7399999999999998e-06 2024-09-10T06:27:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531378+0000", 2024-09-10T06:27:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013860399999999999 2024-09-10T06:27:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531600+0000", 2024-09-10T06:27:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221287 2024-09-10T06:27:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532007+0000", 2024-09-10T06:27:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040728500000000001 2024-09-10T06:27:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533131+0000", 2024-09-10T06:27:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011240429999999999 2024-09-10T06:27:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535894+0000", 2024-09-10T06:27:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027628650000000002 2024-09-10T06:27:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535973+0000", 2024-09-10T06:27:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9399000000000003e-05 2024-09-10T06:27:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536039+0000", 2024-09-10T06:27:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5619999999999999e-05 2024-09-10T06:27:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:655 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.972631890999999, 2024-09-10T06:27:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003017207, 2024-09-10T06:27:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 655 2024-09-10T06:27:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631159+0000", 2024-09-10T06:27:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8270000000000002e-06 2024-09-10T06:27:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631173+0000", 2024-09-10T06:27:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4739999999999999e-05 2024-09-10T06:27:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631206+0000", 2024-09-10T06:27:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2425999999999998e-05 2024-09-10T06:27:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631221+0000", 2024-09-10T06:27:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4927e-05 2024-09-10T06:27:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631336+0000", 2024-09-10T06:27:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115062 2024-09-10T06:27:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631547+0000", 2024-09-10T06:27:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021178200000000001 2024-09-10T06:27:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.632034+0000", 2024-09-10T06:27:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000486899 2024-09-10T06:27:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633413+0000", 2024-09-10T06:27:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001379077 2024-09-10T06:27:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633891+0000", 2024-09-10T06:27:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000477489 2024-09-10T06:27:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634057+0000", 2024-09-10T06:27:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016608500000000001 2024-09-10T06:27:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634173+0000", 2024-09-10T06:27:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115893 2024-09-10T06:27:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:658 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.968617647000002, 2024-09-10T06:27:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030550820000000002, 2024-09-10T06:27:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 658 2024-09-10T06:27:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635171+0000", 2024-09-10T06:27:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.322e-06 2024-09-10T06:27:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635178+0000", 2024-09-10T06:27:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7950000000000002e-06 2024-09-10T06:27:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635197+0000", 2024-09-10T06:27:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8845e-05 2024-09-10T06:27:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635215+0000", 2024-09-10T06:27:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7822e-05 2024-09-10T06:27:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635329+0000", 2024-09-10T06:27:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011433 2024-09-10T06:27:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635554+0000", 2024-09-10T06:27:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022527800000000001 2024-09-10T06:27:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.636007+0000", 2024-09-10T06:27:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045297099999999998 2024-09-10T06:27:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637198+0000", 2024-09-10T06:27:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011902740000000001 2024-09-10T06:27:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637961+0000", 2024-09-10T06:27:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000763234 2024-09-10T06:27:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638110+0000", 2024-09-10T06:27:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149259 2024-09-10T06:27:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638225+0000", 2024-09-10T06:27:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011495200000000001 2024-09-10T06:27:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.872285705000003, 2024-09-10T06:27:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028070980000000001, 2024-09-10T06:27:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 724 2024-09-10T06:27:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731504+0000", 2024-09-10T06:27:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731516+0000", 2024-09-10T06:27:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1885999999999999e-05 2024-09-10T06:27:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731547+0000", 2024-09-10T06:27:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0923000000000002e-05 2024-09-10T06:27:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731563+0000", 2024-09-10T06:27:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5342999999999999e-05 2024-09-10T06:27:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731704+0000", 2024-09-10T06:27:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014128599999999999 2024-09-10T06:27:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731917+0000", 2024-09-10T06:27:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021280800000000001 2024-09-10T06:27:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.732227+0000", 2024-09-10T06:27:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031024500000000001 2024-09-10T06:27:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.733258+0000", 2024-09-10T06:27:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010306880000000001 2024-09-10T06:27:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734163+0000", 2024-09-10T06:27:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090502400000000004 2024-09-10T06:27:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734247+0000", 2024-09-10T06:27:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4363000000000005e-05 2024-09-10T06:27:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734309+0000", 2024-09-10T06:27:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2005e-05 2024-09-10T06:27:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.865439571000003, 2024-09-10T06:27:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030399789999999999, 2024-09-10T06:27:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 727 2024-09-10T06:27:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738350+0000", 2024-09-10T06:27:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2199999999999999e-06 2024-09-10T06:27:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738360+0000", 2024-09-10T06:27:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0122999999999999e-05 2024-09-10T06:27:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738384+0000", 2024-09-10T06:27:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3390000000000001e-05 2024-09-10T06:27:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738397+0000", 2024-09-10T06:27:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2896e-05 2024-09-10T06:27:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738524+0000", 2024-09-10T06:27:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126883 2024-09-10T06:27:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738752+0000", 2024-09-10T06:27:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022864200000000001 2024-09-10T06:27:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.739080+0000", 2024-09-10T06:27:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032783699999999999 2024-09-10T06:27:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.740085+0000", 2024-09-10T06:27:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001005438 2024-09-10T06:27:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741203+0000", 2024-09-10T06:27:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011175919999999999 2024-09-10T06:27:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741280+0000", 2024-09-10T06:27:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6545999999999995e-05 2024-09-10T06:27:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741388+0000", 2024-09-10T06:27:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108412 2024-09-10T06:27:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.673417065999999, 2024-09-10T06:27:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028715709999999998, 2024-09-10T06:27:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 814 2024-09-10T06:27:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930373+0000", 2024-09-10T06:27:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-10T06:27:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930384+0000", 2024-09-10T06:27:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1357e-05 2024-09-10T06:27:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930417+0000", 2024-09-10T06:27:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2289000000000002e-05 2024-09-10T06:27:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930438+0000", 2024-09-10T06:27:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1399999999999998e-05 2024-09-10T06:27:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930626+0000", 2024-09-10T06:27:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018812899999999999 2024-09-10T06:27:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930843+0000", 2024-09-10T06:27:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021719400000000001 2024-09-10T06:27:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.931152+0000", 2024-09-10T06:27:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030821199999999998 2024-09-10T06:27:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.932258+0000", 2024-09-10T06:27:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001106304 2024-09-10T06:27:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933092+0000", 2024-09-10T06:27:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00083364699999999997 2024-09-10T06:27:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933179+0000", 2024-09-10T06:27:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7383e-05 2024-09-10T06:27:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933242+0000", 2024-09-10T06:27:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3072999999999997e-05 2024-09-10T06:27:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.525865584999998, 2024-09-10T06:27:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029601670000000001, 2024-09-10T06:27:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 880 2024-09-10T06:27:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077925+0000", 2024-09-10T06:27:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-10T06:27:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077938+0000", 2024-09-10T06:27:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2836999999999999e-05 2024-09-10T06:27:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077970+0000", 2024-09-10T06:27:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1542999999999999e-05 2024-09-10T06:27:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077984+0000", 2024-09-10T06:27:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4963999999999999e-05 2024-09-10T06:27:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078118+0000", 2024-09-10T06:27:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134015 2024-09-10T06:27:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078344+0000", 2024-09-10T06:27:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225038 2024-09-10T06:27:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078696+0000", 2024-09-10T06:27:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035250100000000002 2024-09-10T06:27:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.079793+0000", 2024-09-10T06:27:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010967049999999999 2024-09-10T06:27:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080714+0000", 2024-09-10T06:27:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00092153600000000003 2024-09-10T06:27:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080802+0000", 2024-09-10T06:27:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7446000000000003e-05 2024-09-10T06:27:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080882+0000", 2024-09-10T06:27:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0445999999999995e-05 2024-09-10T06:27:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.451245358000001, 2024-09-10T06:27:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002919091, 2024-09-10T06:27:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 913 2024-09-10T06:27:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152545+0000", 2024-09-10T06:27:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6529999999999998e-06 2024-09-10T06:27:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152557+0000", 2024-09-10T06:27:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919999999999999e-05 2024-09-10T06:27:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152587+0000", 2024-09-10T06:27:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0097e-05 2024-09-10T06:27:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152601+0000", 2024-09-10T06:27:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4579999999999999e-05 2024-09-10T06:27:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152732+0000", 2024-09-10T06:27:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013085500000000001 2024-09-10T06:27:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153007+0000", 2024-09-10T06:27:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027469499999999998 2024-09-10T06:27:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153344+0000", 2024-09-10T06:27:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033742400000000001 2024-09-10T06:27:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.154351+0000", 2024-09-10T06:27:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010067590000000001 2024-09-10T06:27:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155301+0000", 2024-09-10T06:27:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095000900000000003 2024-09-10T06:27:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155387+0000", 2024-09-10T06:27:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6136000000000003e-05 2024-09-10T06:27:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155461+0000", 2024-09-10T06:27:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3962999999999996e-05 2024-09-10T06:27:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.419598676, 2024-09-10T06:27:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029321239999999999, 2024-09-10T06:27:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 927 2024-09-10T06:27:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184191+0000", 2024-09-10T06:27:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.764e-06 2024-09-10T06:27:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184199+0000", 2024-09-10T06:27:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4630000000000001e-06 2024-09-10T06:27:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184221+0000", 2024-09-10T06:27:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1603e-05 2024-09-10T06:27:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184233+0000", 2024-09-10T06:27:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.189e-05 2024-09-10T06:27:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184382+0000", 2024-09-10T06:27:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014939900000000001 2024-09-10T06:27:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184495+0000", 2024-09-10T06:27:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113459 2024-09-10T06:27:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184735+0000", 2024-09-10T06:27:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000239554 2024-09-10T06:27:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186036+0000", 2024-09-10T06:27:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00130072 2024-09-10T06:27:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186929+0000", 2024-09-10T06:27:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000893694 2024-09-10T06:27:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187014+0000", 2024-09-10T06:27:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4222999999999996e-05 2024-09-10T06:27:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187121+0000", 2024-09-10T06:27:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107355 2024-09-10T06:27:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.416337810999998, 2024-09-10T06:27:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028243320000000001, 2024-09-10T06:27:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 928 2024-09-10T06:27:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187452+0000", 2024-09-10T06:27:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5069999999999999e-06 2024-09-10T06:27:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187464+0000", 2024-09-10T06:27:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1243000000000001e-05 2024-09-10T06:27:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187495+0000", 2024-09-10T06:27:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1136000000000001e-05 2024-09-10T06:27:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187511+0000", 2024-09-10T06:27:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6710000000000001e-05 2024-09-10T06:27:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187648+0000", 2024-09-10T06:27:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013657599999999999 2024-09-10T06:27:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187866+0000", 2024-09-10T06:27:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021853500000000001 2024-09-10T06:27:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.188168+0000", 2024-09-10T06:27:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030161100000000002 2024-09-10T06:27:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.189334+0000", 2024-09-10T06:27:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001166048 2024-09-10T06:27:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190086+0000", 2024-09-10T06:27:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075159399999999996 2024-09-10T06:27:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190165+0000", 2024-09-10T06:27:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8953000000000001e-05 2024-09-10T06:27:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190274+0000", 2024-09-10T06:27:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109419 2024-09-10T06:27:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:17.738 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:17.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:27:17.740 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:17.738+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:17.745 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:17.746 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:17.761 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:17.761 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:17.777 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:17.777 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:17.792 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:17.793 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:17.812 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:17.812 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:17.829 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:17.829 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:17.840 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:17.838+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:17.848 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:17.849 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:17.867 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:17.867 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:17.868 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:17.868 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:17.882 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:27:17.941 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:17.942+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:17.998 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:17.998 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:18.012 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:27:18.043 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:18.042+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:18.130 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:18.130 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:18.143 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:18.142+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:18.144 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:27:18.244 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:18.242+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:18.262 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:18.262 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:18.279 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:27:18.345 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:18.342+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:18.399 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:18.399 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:18.413 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:27:18.446 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:18.445+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:18.547 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:18.545+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:18.578 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:18.578 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:18.593 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:27:18.648 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:18.645+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:18.714 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:18.714 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:18.728 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:27:18.749 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:18.749+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:18.849 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:18.849+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:18.851 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:18.851 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:18.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:27:18.951 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:18.949+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:18.986 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:18.986 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:19.001 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:27:19.051 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:19.049+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:19.152 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:19.149+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:19.158 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:19.158 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:19.171 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:27:19.253 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:19.254+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:19.343 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:19.354 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:19.350+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:19.356 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:27:19.380 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T06:27:19.454 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:19.450+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:19.514 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:19.514 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:19.529 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:27:19.573 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:19.573+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:19.589 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-10T06:27:19.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-10T06:27:19.656 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:19.653+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:19.680 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:19.680 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:19.698 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:27:19.757 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:19.758+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:19.858 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:19.854+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:19.874 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:19.874 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:19.888 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:27:19.891 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:27:19.958 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:19.954+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:20.034 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:20.034 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:20.044 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:20.044 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:20.051 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:20.051 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:20.058 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:27:20.059 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:20.058+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:20.075 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:20.075 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:20.091 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:20.091 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:20.128 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:20.129 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:20.160 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:20.157+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:20.161 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:20.161 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:20.195 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:20.195 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:20.226 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:20.227 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:20.227 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:20.228 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:20.228 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:20.246 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:27:20.261 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:20.258+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:20.362 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:20.361+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:20.452 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:20.452 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:20.452 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:20.452 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:20.452 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:20.463 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:20.458+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:20.469 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:27:20.485 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.0 to 1 (10000) 2024-09-10T06:27:20.495 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-10T06:27:20.520 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-10T06:27:20.564 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:20.562+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:20.635 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:20.635 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:20.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:20.636 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:20.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.636 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4236.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T06:27:20.636 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:20.636 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 57.127649124999998, 2024-09-10T06:27:20.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049682550000000004, 2024-09-10T06:27:20.636 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.636 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.636 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.636 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:20.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:20.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507427+0000", 2024-09-10T06:27:20.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5629999999999999e-06 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507439+0000", 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.19e-05 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507460+0000", 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1693000000000001e-05 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507480+0000", 2024-09-10T06:27:20.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9947000000000001e-05 2024-09-10T06:27:20.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507613+0000", 2024-09-10T06:27:20.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000132409 2024-09-10T06:27:20.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507696+0000", 2024-09-10T06:27:20.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2953000000000004e-05 2024-09-10T06:27:20.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512288+0000", 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045927110000000002 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512393+0000", 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105079 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 46.304185093000001, 2024-09-10T06:27:20.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025692739999999999, 2024-09-10T06:27:20.641 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.641 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.641 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.641 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.641 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:20.641 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:20.641 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 42 2024-09-10T06:27:20.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.641 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:20.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330891+0000", 2024-09-10T06:27:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9700000000000002e-06 2024-09-10T06:27:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330901+0000", 2024-09-10T06:27:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2909999999999996e-06 2024-09-10T06:27:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330924+0000", 2024-09-10T06:27:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3132000000000001e-05 2024-09-10T06:27:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330935+0000", 2024-09-10T06:27:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0893999999999999e-05 2024-09-10T06:27:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331021+0000", 2024-09-10T06:27:20.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6205000000000006e-05 2024-09-10T06:27:20.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331160+0000", 2024-09-10T06:27:20.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013973600000000001 2024-09-10T06:27:20.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:20.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331336+0000", 2024-09-10T06:27:20.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017578799999999999 2024-09-10T06:27:20.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.332381+0000", 2024-09-10T06:27:20.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001044627 2024-09-10T06:27:20.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333371+0000", 2024-09-10T06:27:20.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098979800000000007 2024-09-10T06:27:20.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333421+0000", 2024-09-10T06:27:20.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9872e-05 2024-09-10T06:27:20.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333459+0000", 2024-09-10T06:27:20.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7960999999999998e-05 2024-09-10T06:27:20.646 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.646 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.646 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.646 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:20.647 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:20.647 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.318994173, 2024-09-10T06:27:20.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025247730000000001, 2024-09-10T06:27:20.647 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.647 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.647 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.647 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.647 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.647 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.647 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 52 2024-09-10T06:27:20.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.647 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:20.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:20.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316084+0000", 2024-09-10T06:27:20.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8260000000000003e-06 2024-09-10T06:27:20.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316095+0000", 2024-09-10T06:27:20.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1229999999999999e-05 2024-09-10T06:27:20.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316131+0000", 2024-09-10T06:27:20.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5499e-05 2024-09-10T06:27:20.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316150+0000", 2024-09-10T06:27:20.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9510000000000001e-05 2024-09-10T06:27:20.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316275+0000", 2024-09-10T06:27:20.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012501600000000001 2024-09-10T06:27:20.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316507+0000", 2024-09-10T06:27:20.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000231404 2024-09-10T06:27:20.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:20.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316712+0000", 2024-09-10T06:27:20.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204873 2024-09-10T06:27:20.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.317603+0000", 2024-09-10T06:27:20.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089174399999999998 2024-09-10T06:27:20.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318470+0000", 2024-09-10T06:27:20.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086713399999999998 2024-09-10T06:27:20.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318552+0000", 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1279999999999994e-05 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318605+0000", 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3257000000000002e-05 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:20.652 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.215215843999999, 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033383480000000001, 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 236 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419861+0000", 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.734e-06 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419873+0000", 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1789e-05 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419904+0000", 2024-09-10T06:27:20.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1377000000000001e-05 2024-09-10T06:27:20.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419921+0000", 2024-09-10T06:27:20.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6878999999999999e-05 2024-09-10T06:27:20.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.655 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420052+0000", 2024-09-10T06:27:20.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013025600000000001 2024-09-10T06:27:20.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420263+0000", 2024-09-10T06:27:20.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021196600000000001 2024-09-10T06:27:20.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:20.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420649+0000", 2024-09-10T06:27:20.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038507 2024-09-10T06:27:20.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.422366+0000", 2024-09-10T06:27:20.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017172000000000001 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423048+0000", 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00068254100000000005 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423127+0000", 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8207000000000005e-05 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423197+0000", 2024-09-10T06:27:20.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0328999999999997e-05 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.198614569999997, 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003575235, 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.658 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 299 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436461+0000", 2024-09-10T06:27:20.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.144e-06 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436466+0000", 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8409999999999999e-06 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436477+0000", 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1253000000000001e-05 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436483+0000", 2024-09-10T06:27:20.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7010000000000001e-06 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436527+0000", 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4381000000000001e-05 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436569+0000", 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2208e-05 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436687+0000", 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118093 2024-09-10T06:27:20.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.437455+0000", 2024-09-10T06:27:20.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076799599999999996 2024-09-10T06:27:20.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439950+0000", 2024-09-10T06:27:20.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024946040000000001 2024-09-10T06:27:20.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439988+0000", 2024-09-10T06:27:20.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8405999999999998e-05 2024-09-10T06:27:20.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.440035+0000", 2024-09-10T06:27:20.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6607999999999998e-05 2024-09-10T06:27:20.663 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.663 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.663 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.663 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.663 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:20.663 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.863938488000002, 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028833040000000002, 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 742 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771139+0000", 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5269999999999999e-06 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771153+0000", 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4036000000000001e-05 2024-09-10T06:27:20.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771186+0000", 2024-09-10T06:27:20.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2113000000000002e-05 2024-09-10T06:27:20.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771201+0000", 2024-09-10T06:27:20.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:20.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771320+0000", 2024-09-10T06:27:20.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119265 2024-09-10T06:27:20.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771557+0000", 2024-09-10T06:27:20.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023640600000000001 2024-09-10T06:27:20.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:20.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771890+0000", 2024-09-10T06:27:20.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033302000000000001 2024-09-10T06:27:20.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773204+0000", 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013142239999999999 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773864+0000", 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066005100000000004 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773948+0000", 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4625999999999999e-05 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774019+0000", 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0705999999999997e-05 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.860159238000001, 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025263479999999999, 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.669 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.670 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.670 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 744 2024-09-10T06:27:20.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.670 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:20.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:20.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774917+0000", 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0540000000000002e-06 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774926+0000", 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5660000000000007e-06 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774947+0000", 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0852999999999998e-05 2024-09-10T06:27:20.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774958+0000", 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1216999999999999e-05 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775045+0000", 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7643000000000001e-05 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775167+0000", 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012163900000000001 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:20.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775427+0000", 2024-09-10T06:27:20.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000259678 2024-09-10T06:27:20.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.776736+0000", 2024-09-10T06:27:20.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013093429999999999 2024-09-10T06:27:20.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777296+0000", 2024-09-10T06:27:20.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056029599999999995 2024-09-10T06:27:20.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777374+0000", 2024-09-10T06:27:20.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7721999999999999e-05 2024-09-10T06:27:20.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777441+0000", 2024-09-10T06:27:20.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7336999999999996e-05 2024-09-10T06:27:20.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.674 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.822843691999999, 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036412979999999998, 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 760 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812233+0000", 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812244+0000", 2024-09-10T06:27:20.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1273e-05 2024-09-10T06:27:20.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812276+0000", 2024-09-10T06:27:20.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1253e-05 2024-09-10T06:27:20.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812290+0000", 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4576000000000001e-05 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812438+0000", 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014775899999999999 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812821+0000", 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000383187 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:20.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.813398+0000", 2024-09-10T06:27:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000576619 2024-09-10T06:27:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.814658+0000", 2024-09-10T06:27:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001260207 2024-09-10T06:27:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815591+0000", 2024-09-10T06:27:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00093332899999999999 2024-09-10T06:27:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815745+0000", 2024-09-10T06:27:20.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153392 2024-09-10T06:27:20.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815872+0000", 2024-09-10T06:27:20.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012715599999999999 2024-09-10T06:27:20.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.680 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.680 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.681 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:20.681 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.818208308000003, 2024-09-10T06:27:20.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029417369999999998, 2024-09-10T06:27:20.681 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.681 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.681 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.681 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 762 2024-09-10T06:27:20.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.681 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816868+0000", 2024-09-10T06:27:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.283e-06 2024-09-10T06:27:20.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816879+0000", 2024-09-10T06:27:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0523000000000001e-05 2024-09-10T06:27:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816910+0000", 2024-09-10T06:27:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0732999999999999e-05 2024-09-10T06:27:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816926+0000", 2024-09-10T06:27:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.677e-05 2024-09-10T06:27:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817058+0000", 2024-09-10T06:27:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013195599999999999 2024-09-10T06:27:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817299+0000", 2024-09-10T06:27:20.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000241091 2024-09-10T06:27:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817761+0000", 2024-09-10T06:27:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046188400000000003 2024-09-10T06:27:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.818948+0000", 2024-09-10T06:27:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:20.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819662+0000", 2024-09-10T06:27:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071398399999999997 2024-09-10T06:27:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819745+0000", 2024-09-10T06:27:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3560000000000006e-05 2024-09-10T06:27:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819808+0000", 2024-09-10T06:27:20.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2329000000000006e-05 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.697747591000002, 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002834175, 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 817 2024-09-10T06:27:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937330+0000", 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9869999999999999e-06 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937342+0000", 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2595999999999999e-05 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937375+0000", 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2320000000000002e-05 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937390+0000", 2024-09-10T06:27:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4977000000000001e-05 2024-09-10T06:27:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937529+0000", 2024-09-10T06:27:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013937199999999999 2024-09-10T06:27:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937753+0000", 2024-09-10T06:27:20.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000224358 2024-09-10T06:27:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.938061+0000", 2024-09-10T06:27:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030808799999999998 2024-09-10T06:27:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.939112+0000", 2024-09-10T06:27:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010503050000000001 2024-09-10T06:27:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940005+0000", 2024-09-10T06:27:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089366599999999999 2024-09-10T06:27:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940093+0000", 2024-09-10T06:27:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8053000000000006e-05 2024-09-10T06:27:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940161+0000", 2024-09-10T06:27:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7453000000000006e-05 2024-09-10T06:27:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.692 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.644819548999997, 2024-09-10T06:27:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027552649999999998, 2024-09-10T06:27:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.693 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 841 2024-09-10T06:27:20.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.694 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:20.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:20.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990257+0000", 2024-09-10T06:27:20.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6869999999999999e-06 2024-09-10T06:27:20.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990270+0000", 2024-09-10T06:27:20.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2843000000000001e-05 2024-09-10T06:27:20.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990300+0000", 2024-09-10T06:27:20.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9252999999999999e-05 2024-09-10T06:27:20.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990314+0000", 2024-09-10T06:27:20.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4796e-05 2024-09-10T06:27:20.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990427+0000", 2024-09-10T06:27:20.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112649 2024-09-10T06:27:20.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990671+0000", 2024-09-10T06:27:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244408 2024-09-10T06:27:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990987+0000", 2024-09-10T06:27:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031593099999999998 2024-09-10T06:27:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992073+0000", 2024-09-10T06:27:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010854549999999999 2024-09-10T06:27:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992862+0000", 2024-09-10T06:27:20.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00078889400000000005 2024-09-10T06:27:20.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992944+0000", 2024-09-10T06:27:20.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2152999999999998e-05 2024-09-10T06:27:20.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993010+0000", 2024-09-10T06:27:20.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6196000000000001e-05 2024-09-10T06:27:20.698 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.698 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.699 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.699 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:20.699 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.641083614999999, 2024-09-10T06:27:20.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025373539999999999, 2024-09-10T06:27:20.699 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.699 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.700 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.700 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 843 2024-09-10T06:27:20.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.700 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:20.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:20.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993993+0000", 2024-09-10T06:27:20.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3630000000000001e-06 2024-09-10T06:27:20.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994004+0000", 2024-09-10T06:27:20.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0557000000000001e-05 2024-09-10T06:27:20.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994035+0000", 2024-09-10T06:27:20.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0969000000000001e-05 2024-09-10T06:27:20.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994055+0000", 2024-09-10T06:27:20.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0497e-05 2024-09-10T06:27:20.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994150+0000", 2024-09-10T06:27:20.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5363000000000002e-05 2024-09-10T06:27:20.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994275+0000", 2024-09-10T06:27:20.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012453200000000001 2024-09-10T06:27:20.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:20.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994570+0000", 2024-09-10T06:27:20.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029522100000000003 2024-09-10T06:27:20.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.995569+0000", 2024-09-10T06:27:20.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00099913200000000001 2024-09-10T06:27:20.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996384+0000", 2024-09-10T06:27:20.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081451099999999997 2024-09-10T06:27:20.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996462+0000", 2024-09-10T06:27:20.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8502000000000002e-05 2024-09-10T06:27:20.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996528+0000", 2024-09-10T06:27:20.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5707e-05 2024-09-10T06:27:20.705 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.705 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.705 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.705 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.705 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:20.705 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.631636467999996, 2024-09-10T06:27:20.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033145539999999999, 2024-09-10T06:27:20.705 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.705 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 847 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003440+0000", 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5299999999999999e-06 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003452+0000", 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003482+0000", 2024-09-10T06:27:20.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0790000000000002e-05 2024-09-10T06:27:20.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003497+0000", 2024-09-10T06:27:20.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.489e-05 2024-09-10T06:27:20.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003645+0000", 2024-09-10T06:27:20.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014771900000000001 2024-09-10T06:27:20.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003996+0000", 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000350861 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.004540+0000", 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054383199999999995 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.005831+0000", 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001291366 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006461+0000", 2024-09-10T06:27:20.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062943899999999998 2024-09-10T06:27:20.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006631+0000", 2024-09-10T06:27:20.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000170228 2024-09-10T06:27:20.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006752+0000", 2024-09-10T06:27:20.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012160899999999999 2024-09-10T06:27:20.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.711 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.711 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.711 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:20.711 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.627383301000002, 2024-09-10T06:27:20.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002619953, 2024-09-10T06:27:20.711 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.711 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.711 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.712 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.712 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.712 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.712 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 849 2024-09-10T06:27:20.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.712 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:20.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:20.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007693+0000", 2024-09-10T06:27:20.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3099999999999999e-06 2024-09-10T06:27:20.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007704+0000", 2024-09-10T06:27:20.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0387000000000001e-05 2024-09-10T06:27:20.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007734+0000", 2024-09-10T06:27:20.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0676000000000002e-05 2024-09-10T06:27:20.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007753+0000", 2024-09-10T06:27:20.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.836e-05 2024-09-10T06:27:20.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007857+0000", 2024-09-10T06:27:20.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103836 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007980+0000", 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123843 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.008241+0000", 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026085799999999999 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.009475+0000", 2024-09-10T06:27:20.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012340230000000001 2024-09-10T06:27:20.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010168+0000", 2024-09-10T06:27:20.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00069220800000000004 2024-09-10T06:27:20.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010247+0000", 2024-09-10T06:27:20.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9929e-05 2024-09-10T06:27:20.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010311+0000", 2024-09-10T06:27:20.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3522999999999995e-05 2024-09-10T06:27:20.717 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.717 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.717 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.717 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.717 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:20.717 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.582903479999999, 2024-09-10T06:27:20.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026646590000000002, 2024-09-10T06:27:20.717 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.717 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.717 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.717 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.718 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.718 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.718 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 868 2024-09-10T06:27:20.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.718 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:20.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:20.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052173+0000", 2024-09-10T06:27:20.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-10T06:27:20.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052186+0000", 2024-09-10T06:27:20.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2787e-05 2024-09-10T06:27:20.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052216+0000", 2024-09-10T06:27:20.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9618999999999999e-05 2024-09-10T06:27:20.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052231+0000", 2024-09-10T06:27:20.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4929999999999999e-05 2024-09-10T06:27:20.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052349+0000", 2024-09-10T06:27:20.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011830200000000001 2024-09-10T06:27:20.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052561+0000", 2024-09-10T06:27:20.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000212182 2024-09-10T06:27:20.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:20.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052874+0000", 2024-09-10T06:27:20.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031299399999999998 2024-09-10T06:27:20.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054049+0000", 2024-09-10T06:27:20.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174825 2024-09-10T06:27:20.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054635+0000", 2024-09-10T06:27:20.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058643900000000001 2024-09-10T06:27:20.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054721+0000", 2024-09-10T06:27:20.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5185999999999994e-05 2024-09-10T06:27:20.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054836+0000", 2024-09-10T06:27:20.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114922 2024-09-10T06:27:20.723 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.723 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.723 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.723 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.723 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:20.724 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.496247379000003, 2024-09-10T06:27:20.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028453739999999999, 2024-09-10T06:27:20.724 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.724 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.724 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.724 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.724 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.724 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.724 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 907 2024-09-10T06:27:20.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.724 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:20.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:20.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138830+0000", 2024-09-10T06:27:20.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8600000000000001e-06 2024-09-10T06:27:20.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138842+0000", 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2126e-05 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138874+0000", 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2047e-05 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138889+0000", 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4966999999999999e-05 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139007+0000", 2024-09-10T06:27:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118479 2024-09-10T06:27:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139238+0000", 2024-09-10T06:27:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023031399999999999 2024-09-10T06:27:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139566+0000", 2024-09-10T06:27:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032816099999999999 2024-09-10T06:27:20.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.140631+0000", 2024-09-10T06:27:20.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010653679999999999 2024-09-10T06:27:20.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141393+0000", 2024-09-10T06:27:20.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076187100000000001 2024-09-10T06:27:20.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141561+0000", 2024-09-10T06:27:20.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016755599999999999 2024-09-10T06:27:20.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141672+0000", 2024-09-10T06:27:20.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111625 2024-09-10T06:27:20.729 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.729 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.729 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.729 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.729 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:20.729 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.492323863000003, 2024-09-10T06:27:20.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002857268, 2024-09-10T06:27:20.730 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.730 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.730 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.730 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 909 2024-09-10T06:27:20.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.730 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:20.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142753+0000", 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4040000000000002e-06 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142764+0000", 2024-09-10T06:27:20.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0789e-05 2024-09-10T06:27:20.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142795+0000", 2024-09-10T06:27:20.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0982999999999998e-05 2024-09-10T06:27:20.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142810+0000", 2024-09-10T06:27:20.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4960000000000001e-05 2024-09-10T06:27:20.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142908+0000", 2024-09-10T06:27:20.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8726000000000003e-05 2024-09-10T06:27:20.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143030+0000", 2024-09-10T06:27:20.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121649 2024-09-10T06:27:20.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:20.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143294+0000", 2024-09-10T06:27:20.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000263875 2024-09-10T06:27:20.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.144530+0000", 2024-09-10T06:27:20.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001236067 2024-09-10T06:27:20.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145340+0000", 2024-09-10T06:27:20.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080966700000000003 2024-09-10T06:27:20.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145497+0000", 2024-09-10T06:27:20.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015773499999999999 2024-09-10T06:27:20.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145608+0000", 2024-09-10T06:27:20.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110413 2024-09-10T06:27:20.735 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.735 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.735 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.735 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.735 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:20.735 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.398626366000002, 2024-09-10T06:27:20.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029166940000000001, 2024-09-10T06:27:20.736 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.736 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.736 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.736 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.736 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.736 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.736 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 949 2024-09-10T06:27:20.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.736 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236451+0000", 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236464+0000", 2024-09-10T06:27:20.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3223e-05 2024-09-10T06:27:20.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236497+0000", 2024-09-10T06:27:20.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2672999999999997e-05 2024-09-10T06:27:20.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236515+0000", 2024-09-10T06:27:20.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8386999999999999e-05 2024-09-10T06:27:20.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236636+0000", 2024-09-10T06:27:20.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120752 2024-09-10T06:27:20.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236857+0000", 2024-09-10T06:27:20.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022134499999999999 2024-09-10T06:27:20.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:20.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.237188+0000", 2024-09-10T06:27:20.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033057799999999999 2024-09-10T06:27:20.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.238353+0000", 2024-09-10T06:27:20.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001164841 2024-09-10T06:27:20.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239160+0000", 2024-09-10T06:27:20.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080743000000000004 2024-09-10T06:27:20.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239245+0000", 2024-09-10T06:27:20.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5189e-05 2024-09-10T06:27:20.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239365+0000", 2024-09-10T06:27:20.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119406 2024-09-10T06:27:20.741 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.741 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.741 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.741 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.742 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:20.742 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.394765259000003, 2024-09-10T06:27:20.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025033970000000001, 2024-09-10T06:27:20.742 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.742 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.742 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.742 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.742 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 951 2024-09-10T06:27:20.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.742 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:20.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:20.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240311+0000", 2024-09-10T06:27:20.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8899999999999999e-06 2024-09-10T06:27:20.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240320+0000", 2024-09-10T06:27:20.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6799999999999999e-06 2024-09-10T06:27:20.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240341+0000", 2024-09-10T06:27:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1379e-05 2024-09-10T06:27:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240352+0000", 2024-09-10T06:27:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1354e-05 2024-09-10T06:27:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240450+0000", 2024-09-10T06:27:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7866000000000001e-05 2024-09-10T06:27:20.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240580+0000", 2024-09-10T06:27:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012970899999999999 2024-09-10T06:27:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240851+0000", 2024-09-10T06:27:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027059099999999998 2024-09-10T06:27:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242052+0000", 2024-09-10T06:27:20.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001201014 2024-09-10T06:27:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242662+0000", 2024-09-10T06:27:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061076800000000003 2024-09-10T06:27:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242747+0000", 2024-09-10T06:27:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5019999999999996e-05 2024-09-10T06:27:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242812+0000", 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5126e-05 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 38.384315839999999, 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027897120000000002, 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:20.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 955 2024-09-10T06:27:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:20.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250761+0000", 2024-09-10T06:27:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250772+0000", 2024-09-10T06:27:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1153e-05 2024-09-10T06:27:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250802+0000", 2024-09-10T06:27:20.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-05 2024-09-10T06:27:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250817+0000", 2024-09-10T06:27:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4883e-05 2024-09-10T06:27:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250925+0000", 2024-09-10T06:27:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108249 2024-09-10T06:27:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:20.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251139+0000", 2024-09-10T06:27:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000213568 2024-09-10T06:27:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251450+0000", 2024-09-10T06:27:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031139200000000002 2024-09-10T06:27:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.252574+0000", 2024-09-10T06:27:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011239139999999999 2024-09-10T06:27:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253377+0000", 2024-09-10T06:27:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080306400000000003 2024-09-10T06:27:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253466+0000", 2024-09-10T06:27:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8436000000000005e-05 2024-09-10T06:27:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253548+0000", 2024-09-10T06:27:20.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2496000000000004e-05 2024-09-10T06:27:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:20.754 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:20.754 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:20.755 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:27:20.756 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:20.754+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:20.856 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:20.853+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:20.864 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:20.864 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:20.864 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:20.864 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:20.877 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:27:20.957 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:20.954+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:21.057 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:21.057+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:21.081 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:21.082 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:21.082 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:21.082 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:21.082 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:21.099 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:27:21.185 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:21.185+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:21.260 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:21.258+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:21.271 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:21.272 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:21.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:21.272 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:21.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.272 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:21.272 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:21.272 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 42.947128319999997, 2024-09-10T06:27:21.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030326279999999999, 2024-09-10T06:27:21.272 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.272 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.273 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.273 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.273 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.273 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.273 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 58 2024-09-10T06:27:21.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.273 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:21.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:21.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:21.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-10T06:27:21.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324169+0000", 2024-09-10T06:27:21.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9020000000000004e-06 2024-09-10T06:27:21.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324182+0000", 2024-09-10T06:27:21.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2166e-05 2024-09-10T06:27:21.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324190+0000", 2024-09-10T06:27:21.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.337e-06 2024-09-10T06:27:21.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324282+0000", 2024-09-10T06:27:21.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2331999999999996e-05 2024-09-10T06:27:21.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324486+0000", 2024-09-10T06:27:21.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020347400000000001 2024-09-10T06:27:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324719+0000", 2024-09-10T06:27:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023289900000000001 2024-09-10T06:27:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.325993+0000", 2024-09-10T06:27:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012746929999999999 2024-09-10T06:27:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327088+0000", 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010947330000000001 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327147+0000", 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8677000000000001e-05 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327195+0000", 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8469e-05 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.278 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.965307738, 2024-09-10T06:27:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003846917, 2024-09-10T06:27:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.279 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 207 2024-09-10T06:27:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305987+0000", 2024-09-10T06:27:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6069999999999999e-06 2024-09-10T06:27:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306002+0000", 2024-09-10T06:27:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5406000000000001e-05 2024-09-10T06:27:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306036+0000", 2024-09-10T06:27:21.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4146000000000001e-05 2024-09-10T06:27:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306061+0000", 2024-09-10T06:27:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4470000000000001e-05 2024-09-10T06:27:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306325+0000", 2024-09-10T06:27:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026382800000000002 2024-09-10T06:27:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306569+0000", 2024-09-10T06:27:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024445499999999998 2024-09-10T06:27:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.307017+0000", 2024-09-10T06:27:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044774000000000002 2024-09-10T06:27:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.308517+0000", 2024-09-10T06:27:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001500075 2024-09-10T06:27:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309685+0000", 2024-09-10T06:27:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001168505 2024-09-10T06:27:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309767+0000", 2024-09-10T06:27:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1992999999999999e-05 2024-09-10T06:27:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309830+0000", 2024-09-10T06:27:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2692000000000002e-05 2024-09-10T06:27:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.921055690000003, 2024-09-10T06:27:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003433888, 2024-09-10T06:27:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.285 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 216 2024-09-10T06:27:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350239+0000", 2024-09-10T06:27:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.377e-06 2024-09-10T06:27:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350254+0000", 2024-09-10T06:27:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.501e-05 2024-09-10T06:27:21.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350288+0000", 2024-09-10T06:27:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4746000000000002e-05 2024-09-10T06:27:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350312+0000", 2024-09-10T06:27:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3249999999999999e-05 2024-09-10T06:27:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350456+0000", 2024-09-10T06:27:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014483899999999999 2024-09-10T06:27:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350704+0000", 2024-09-10T06:27:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024719100000000001 2024-09-10T06:27:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:21.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.351117+0000", 2024-09-10T06:27:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000412934 2024-09-10T06:27:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.352644+0000", 2024-09-10T06:27:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015271079999999999 2024-09-10T06:27:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353397+0000", 2024-09-10T06:27:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075311799999999999 2024-09-10T06:27:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353556+0000", 2024-09-10T06:27:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159612 2024-09-10T06:27:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353669+0000", 2024-09-10T06:27:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011270299999999999 2024-09-10T06:27:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.882376227999998, 2024-09-10T06:27:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033447479999999998, 2024-09-10T06:27:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.292 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 227 2024-09-10T06:27:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388917+0000", 2024-09-10T06:27:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6900000000000001e-06 2024-09-10T06:27:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388931+0000", 2024-09-10T06:27:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3900000000000001e-05 2024-09-10T06:27:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388964+0000", 2024-09-10T06:27:21.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2985999999999999e-05 2024-09-10T06:27:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388980+0000", 2024-09-10T06:27:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.535e-05 2024-09-10T06:27:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389123+0000", 2024-09-10T06:27:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014337900000000001 2024-09-10T06:27:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389341+0000", 2024-09-10T06:27:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021765099999999999 2024-09-10T06:27:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389765+0000", 2024-09-10T06:27:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042423100000000001 2024-09-10T06:27:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.391433+0000", 2024-09-10T06:27:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016681000000000001 2024-09-10T06:27:21.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392104+0000", 2024-09-10T06:27:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067064800000000003 2024-09-10T06:27:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392191+0000", 2024-09-10T06:27:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7912999999999997e-05 2024-09-10T06:27:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392259+0000", 2024-09-10T06:27:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7899999999999997e-05 2024-09-10T06:27:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.298 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.875119454, 2024-09-10T06:27:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029995500000000001, 2024-09-10T06:27:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 229 2024-09-10T06:27:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396174+0000", 2024-09-10T06:27:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.774e-06 2024-09-10T06:27:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396186+0000", 2024-09-10T06:27:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2055999999999999e-05 2024-09-10T06:27:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396216+0000", 2024-09-10T06:27:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9640000000000001e-05 2024-09-10T06:27:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396231+0000", 2024-09-10T06:27:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396356+0000", 2024-09-10T06:27:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012504500000000001 2024-09-10T06:27:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396568+0000", 2024-09-10T06:27:21.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000211709 2024-09-10T06:27:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396954+0000", 2024-09-10T06:27:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386027 2024-09-10T06:27:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.398287+0000", 2024-09-10T06:27:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013331560000000001 2024-09-10T06:27:21.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399004+0000", 2024-09-10T06:27:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071720499999999995 2024-09-10T06:27:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399091+0000", 2024-09-10T06:27:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6714999999999999e-05 2024-09-10T06:27:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399171+0000", 2024-09-10T06:27:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9893000000000002e-05 2024-09-10T06:27:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.868560885000001, 2024-09-10T06:27:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030468270000000002, 2024-09-10T06:27:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.306 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 231 2024-09-10T06:27:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:21.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402732+0000", 2024-09-10T06:27:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-06 2024-09-10T06:27:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402744+0000", 2024-09-10T06:27:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1633e-05 2024-09-10T06:27:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402774+0000", 2024-09-10T06:27:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9666999999999999e-05 2024-09-10T06:27:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402789+0000", 2024-09-10T06:27:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5466000000000001e-05 2024-09-10T06:27:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402904+0000", 2024-09-10T06:27:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114466 2024-09-10T06:27:21.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403119+0000", 2024-09-10T06:27:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215572 2024-09-10T06:27:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403516+0000", 2024-09-10T06:27:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039663300000000002 2024-09-10T06:27:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405012+0000", 2024-09-10T06:27:21.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014961919999999999 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405634+0000", 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062145199999999999 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405715+0000", 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1619000000000006e-05 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405777+0000", 2024-09-10T06:27:21.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1639999999999999e-05 2024-09-10T06:27:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:377 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.809805554, 2024-09-10T06:27:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058485480000000003, 2024-09-10T06:27:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 377 2024-09-10T06:27:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461486+0000", 2024-09-10T06:27:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0720000000000001e-06 2024-09-10T06:27:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461504+0000", 2024-09-10T06:27:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8002000000000001e-05 2024-09-10T06:27:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461519+0000", 2024-09-10T06:27:21.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4584e-05 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461526+0000", 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5560000000000004e-06 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461597+0000", 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1311999999999998e-05 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461709+0000", 2024-09-10T06:27:21.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011191100000000001 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461871+0000", 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016254900000000001 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.462777+0000", 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00090547100000000003 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467265+0000", 2024-09-10T06:27:21.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004488222 2024-09-10T06:27:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467308+0000", 2024-09-10T06:27:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2975000000000001e-05 2024-09-10T06:27:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467334+0000", 2024-09-10T06:27:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5894e-05 2024-09-10T06:27:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:384 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.807672699000001, 2024-09-10T06:27:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031588900000000001, 2024-09-10T06:27:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 384 2024-09-10T06:27:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.318 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463620+0000", 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:21.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463625+0000", 2024-09-10T06:27:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6450000000000002e-06 2024-09-10T06:27:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463639+0000", 2024-09-10T06:27:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3540000000000001e-05 2024-09-10T06:27:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463648+0000", 2024-09-10T06:27:21.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0259999999999996e-06 2024-09-10T06:27:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463713+0000", 2024-09-10T06:27:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5438000000000006e-05 2024-09-10T06:27:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463774+0000", 2024-09-10T06:27:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0582999999999999e-05 2024-09-10T06:27:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463899+0000", 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.464371+0000", 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047201600000000002 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466707+0000", 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023354999999999999 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466742+0000", 2024-09-10T06:27:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4686e-05 2024-09-10T06:27:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466777+0000", 2024-09-10T06:27:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5537000000000002e-05 2024-09-10T06:27:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.323 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:436 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.792425651999999, 2024-09-10T06:27:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040690570000000001, 2024-09-10T06:27:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 436 2024-09-10T06:27:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478866+0000", 2024-09-10T06:27:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1960000000000001e-06 2024-09-10T06:27:21.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478871+0000", 2024-09-10T06:27:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6879999999999998e-06 2024-09-10T06:27:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478883+0000", 2024-09-10T06:27:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1790999999999999e-05 2024-09-10T06:27:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478890+0000", 2024-09-10T06:27:21.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8569999999999997e-06 2024-09-10T06:27:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478958+0000", 2024-09-10T06:27:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7774999999999994e-05 2024-09-10T06:27:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479072+0000", 2024-09-10T06:27:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114577 2024-09-10T06:27:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:21.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479255+0000", 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018297300000000001 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482448+0000", 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031933389999999999 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482828+0000", 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037961800000000002 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482891+0000", 2024-09-10T06:27:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3316000000000002e-05 2024-09-10T06:27:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482934+0000", 2024-09-10T06:27:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2926999999999997e-05 2024-09-10T06:27:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:441 6.7 e34/28 6:e1cdb60d:reshard::reshard.0000000008:head v 34'7, mlcod=34'5)", 2024-09-10T06:27:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:21.329 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.788824734000002, 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060368319999999998, 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482467+0000", 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8800000000000003e-07 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482472+0000", 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8730000000000004e-06 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482481+0000", 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1980000000000001e-06 2024-09-10T06:27:21.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482485+0000", 2024-09-10T06:27:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.386e-06 2024-09-10T06:27:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482541+0000", 2024-09-10T06:27:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5788000000000002e-05 2024-09-10T06:27:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482563+0000", 2024-09-10T06:27:21.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2303999999999999e-05 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488465+0000", 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059014810000000001 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488503+0000", 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8313999999999999e-05 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:466 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.773665483999999, 2024-09-10T06:27:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039032810000000002, 2024-09-10T06:27:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 466 2024-09-10T06:27:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497626+0000", 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9099999999999991e-07 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497634+0000", 2024-09-10T06:27:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.994e-06 2024-09-10T06:27:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497644+0000", 2024-09-10T06:27:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6260000000000007e-06 2024-09-10T06:27:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497650+0000", 2024-09-10T06:27:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5160000000000002e-06 2024-09-10T06:27:21.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497718+0000", 2024-09-10T06:27:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8862999999999994e-05 2024-09-10T06:27:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497775+0000", 2024-09-10T06:27:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6156000000000002e-05 2024-09-10T06:27:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497903+0000", 2024-09-10T06:27:21.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012879800000000001 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499630+0000", 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017268139999999999 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501439+0000", 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018086669999999999 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501478+0000", 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9269e-05 2024-09-10T06:27:21.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501529+0000", 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0587000000000002e-05 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:469 6.0 e34/28 6:02683654:reshard::reshard.0000000010:head v 34'6, mlcod=34'4)", 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.771662661000001, 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048323109999999997, 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.339 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499629+0000", 2024-09-10T06:27:21.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9199999999999999e-07 2024-09-10T06:27:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499634+0000", 2024-09-10T06:27:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2530000000000004e-06 2024-09-10T06:27:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499644+0000", 2024-09-10T06:27:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5820000000000008e-06 2024-09-10T06:27:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499650+0000", 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7919999999999998e-06 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499697+0000", 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7564000000000001e-05 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499719+0000", 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1297999999999998e-05 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504413+0000", 2024-09-10T06:27:21.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004694419 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504461+0000", 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7511e-05 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:621 6.0 e34/28 6:0705c68b:::obj_delete_at_hint.0000000028:head v 34'11, mlcod=34'9)", 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.666461515999998, 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003196562, 2024-09-10T06:27:21.343 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604831+0000", 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.823e-06 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604843+0000", 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1437000000000001e-05 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604868+0000", 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5837e-05 2024-09-10T06:27:21.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604885+0000", 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6759999999999999e-05 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604971+0000", 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5512000000000004e-05 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604991+0000", 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0197999999999999e-05 2024-09-10T06:27:21.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.607960+0000", 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002969307 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608026+0000", 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5687999999999999e-05 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.347 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:636 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.657551861999998, 2024-09-10T06:27:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048306950000000003, 2024-09-10T06:27:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 636 2024-09-10T06:27:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613740+0000", 2024-09-10T06:27:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613747+0000", 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8090000000000004e-06 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613762+0000", 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5037e-05 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613772+0000", 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7510000000000003e-06 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613834+0000", 2024-09-10T06:27:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2458000000000004e-05 2024-09-10T06:27:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613916+0000", 2024-09-10T06:27:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1630000000000003e-05 2024-09-10T06:27:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.614071+0000", 2024-09-10T06:27:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015480800000000001 2024-09-10T06:27:21.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.615885+0000", 2024-09-10T06:27:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001814607 2024-09-10T06:27:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618438+0000", 2024-09-10T06:27:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025529459999999999 2024-09-10T06:27:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618503+0000", 2024-09-10T06:27:21.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4851000000000006e-05 2024-09-10T06:27:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618570+0000", 2024-09-10T06:27:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6418e-05 2024-09-10T06:27:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:646 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.648090072000002, 2024-09-10T06:27:21.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049103549999999999, 2024-09-10T06:27:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 646 2024-09-10T06:27:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:21.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623202+0000", 2024-09-10T06:27:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9800000000000002e-07 2024-09-10T06:27:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623206+0000", 2024-09-10T06:27:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6380000000000003e-06 2024-09-10T06:27:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623216+0000", 2024-09-10T06:27:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4439999999999997e-06 2024-09-10T06:27:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623221+0000", 2024-09-10T06:27:21.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6400000000000002e-06 2024-09-10T06:27:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623300+0000", 2024-09-10T06:27:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8677999999999994e-05 2024-09-10T06:27:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623410+0000", 2024-09-10T06:27:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010954399999999999 2024-09-10T06:27:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:21.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623629+0000", 2024-09-10T06:27:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000219836 2024-09-10T06:27:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.625072+0000", 2024-09-10T06:27:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014427929999999999 2024-09-10T06:27:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.627982+0000", 2024-09-10T06:27:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029097620000000002 2024-09-10T06:27:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628058+0000", 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6390999999999994e-05 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628111+0000", 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2731e-05 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:21.359 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.5854158, 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033783509999999999, 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 703 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685878+0000", 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5900000000000002e-06 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685889+0000", 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:21.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685919+0000", 2024-09-10T06:27:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0307e-05 2024-09-10T06:27:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685935+0000", 2024-09-10T06:27:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5336e-05 2024-09-10T06:27:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686092+0000", 2024-09-10T06:27:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015776200000000001 2024-09-10T06:27:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686462+0000", 2024-09-10T06:27:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036925700000000001 2024-09-10T06:27:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.687048+0000", 2024-09-10T06:27:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000586266 2024-09-10T06:27:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688261+0000", 2024-09-10T06:27:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012132670000000001 2024-09-10T06:27:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688974+0000", 2024-09-10T06:27:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071248800000000005 2024-09-10T06:27:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689129+0000", 2024-09-10T06:27:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155499 2024-09-10T06:27:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689253+0000", 2024-09-10T06:27:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124289 2024-09-10T06:27:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.226850296999999, 2024-09-10T06:27:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032750980000000002, 2024-09-10T06:27:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.365 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 865 2024-09-10T06:27:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044443+0000", 2024-09-10T06:27:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6929999999999999e-06 2024-09-10T06:27:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044456+0000", 2024-09-10T06:27:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.224e-05 2024-09-10T06:27:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044486+0000", 2024-09-10T06:27:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.095e-05 2024-09-10T06:27:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044501+0000", 2024-09-10T06:27:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4932999999999999e-05 2024-09-10T06:27:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044646+0000", 2024-09-10T06:27:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014465600000000001 2024-09-10T06:27:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045001+0000", 2024-09-10T06:27:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035473999999999998 2024-09-10T06:27:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045549+0000", 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054870299999999999 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.046956+0000", 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014061189999999999 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047452+0000", 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049682199999999995 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047606+0000", 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015379599999999999 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047716+0000", 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109446 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.222387144999999, 2024-09-10T06:27:21.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030837989999999999, 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 867 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048906+0000", 2024-09-10T06:27:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1770000000000001e-06 2024-09-10T06:27:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048916+0000", 2024-09-10T06:27:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.025e-05 2024-09-10T06:27:21.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048948+0000", 2024-09-10T06:27:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1859000000000001e-05 2024-09-10T06:27:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048968+0000", 2024-09-10T06:27:21.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9647e-05 2024-09-10T06:27:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049090+0000", 2024-09-10T06:27:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122645 2024-09-10T06:27:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049314+0000", 2024-09-10T06:27:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022372900000000001 2024-09-10T06:27:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049785+0000", 2024-09-10T06:27:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047121899999999999 2024-09-10T06:27:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.050979+0000", 2024-09-10T06:27:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001193408 2024-09-10T06:27:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051729+0000", 2024-09-10T06:27:21.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075039699999999998 2024-09-10T06:27:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051874+0000", 2024-09-10T06:27:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000145253 2024-09-10T06:27:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051988+0000", 2024-09-10T06:27:21.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011321500000000001 2024-09-10T06:27:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.153519963999997, 2024-09-10T06:27:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035511029999999999, 2024-09-10T06:27:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.378 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 898 2024-09-10T06:27:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117772+0000", 2024-09-10T06:27:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5340000000000001e-06 2024-09-10T06:27:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117781+0000", 2024-09-10T06:27:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.276e-06 2024-09-10T06:27:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117804+0000", 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3093999999999999e-05 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117816+0000", 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1986e-05 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117954+0000", 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013856900000000001 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118327+0000", 2024-09-10T06:27:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000372841 2024-09-10T06:27:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118919+0000", 2024-09-10T06:27:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059172800000000002 2024-09-10T06:27:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.120253+0000", 2024-09-10T06:27:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001333643 2024-09-10T06:27:21.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121060+0000", 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080731100000000001 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121210+0000", 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014980500000000001 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121322+0000", 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112316 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.383 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 39.064250152, 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051838630000000004, 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 937 2024-09-10T06:27:21.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207042+0000", 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7439999999999999e-06 2024-09-10T06:27:21.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207051+0000", 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7299999999999994e-06 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207072+0000", 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1209e-05 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207089+0000", 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6297e-05 2024-09-10T06:27:21.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207231+0000", 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014233200000000001 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207463+0000", 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023155199999999999 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207797+0000", 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033413699999999998 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.209053+0000", 2024-09-10T06:27:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012560029999999999 2024-09-10T06:27:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212076+0000", 2024-09-10T06:27:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030234239999999998 2024-09-10T06:27:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212162+0000", 2024-09-10T06:27:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5506000000000004e-05 2024-09-10T06:27:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:21.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212225+0000", 2024-09-10T06:27:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2928999999999993e-05 2024-09-10T06:27:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:21.389 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:21.389 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:21.390 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:27:21.391 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:21.386+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:21.491 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:21.489+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:21.497 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.1 to 1 (10000) 2024-09-10T06:27:21.524 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-10T06:27:21.525 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:21.525 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:21.525 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:21.525 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:21.540 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:27:21.613 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:21.613+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:21.661 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:21.661 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:21.662 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:21.662 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:21.662 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:21.675 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:27:21.720 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:21.718+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:21.794 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:21.790+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:21.796 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-10T06:27:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.503298553999997, 2024-09-10T06:27:21.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047108059999999997, 2024-09-10T06:27:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291391+0000", 2024-09-10T06:27:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8700000000000001e-06 2024-09-10T06:27:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291405+0000", 2024-09-10T06:27:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4623e-05 2024-09-10T06:27:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291438+0000", 2024-09-10T06:27:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2616000000000001e-05 2024-09-10T06:27:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291461+0000", 2024-09-10T06:27:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2883000000000001e-05 2024-09-10T06:27:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293024+0000", 2024-09-10T06:27:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015627709999999999 2024-09-10T06:27:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293071+0000", 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7797000000000003e-05 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295983+0000", 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029113640000000001 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296100+0000", 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116882 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.461940775999999, 2024-09-10T06:27:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00338296, 2024-09-10T06:27:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 211 2024-09-10T06:27:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332750+0000", 2024-09-10T06:27:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-10T06:27:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332767+0000", 2024-09-10T06:27:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.702e-05 2024-09-10T06:27:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332805+0000", 2024-09-10T06:27:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7950000000000001e-05 2024-09-10T06:27:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332824+0000", 2024-09-10T06:27:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8462999999999999e-05 2024-09-10T06:27:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332950+0000", 2024-09-10T06:27:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012653600000000001 2024-09-10T06:27:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333177+0000", 2024-09-10T06:27:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022626800000000001 2024-09-10T06:27:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333604+0000", 2024-09-10T06:27:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042759999999999999 2024-09-10T06:27:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335279+0000", 2024-09-10T06:27:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001674481 2024-09-10T06:27:21.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335976+0000", 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069707099999999995 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336063+0000", 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6916000000000006e-05 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336130+0000", 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6971999999999995e-05 2024-09-10T06:27:21.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.388665901000003, 2024-09-10T06:27:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034123389999999999, 2024-09-10T06:27:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406025+0000", 2024-09-10T06:27:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-10T06:27:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406040+0000", 2024-09-10T06:27:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5299999999999999e-05 2024-09-10T06:27:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406072+0000", 2024-09-10T06:27:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2543000000000003e-05 2024-09-10T06:27:21.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406088+0000", 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5699999999999999e-05 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406206+0000", 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011828900000000001 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406416+0000", 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020969900000000001 2024-09-10T06:27:21.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406804+0000", 2024-09-10T06:27:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038783699999999998 2024-09-10T06:27:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.408490+0000", 2024-09-10T06:27:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001686353 2024-09-10T06:27:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409152+0000", 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066160800000000005 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409314+0000", 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000162285 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409434+0000", 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119639 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.368736456000001, 2024-09-10T06:27:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034077650000000001, 2024-09-10T06:27:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241 2024-09-10T06:27:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.813 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425954+0000", 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:21.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425965+0000", 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.181e-05 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425996+0000", 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0759000000000001e-05 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426011+0000", 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4507e-05 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426153+0000", 2024-09-10T06:27:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014206599999999999 2024-09-10T06:27:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426491+0000", 2024-09-10T06:27:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033830399999999999 2024-09-10T06:27:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426973+0000", 2024-09-10T06:27:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000482113 2024-09-10T06:27:21.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.428378+0000", 2024-09-10T06:27:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001404539 2024-09-10T06:27:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429113+0000", 2024-09-10T06:27:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073537799999999996 2024-09-10T06:27:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429251+0000", 2024-09-10T06:27:21.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013789600000000001 2024-09-10T06:27:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429359+0000", 2024-09-10T06:27:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107846 2024-09-10T06:27:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:266 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:21.818 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.364003431999997, 2024-09-10T06:27:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030966560000000001, 2024-09-10T06:27:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 266 2024-09-10T06:27:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:21.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430687+0000", 2024-09-10T06:27:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0299999999999998e-06 2024-09-10T06:27:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430702+0000", 2024-09-10T06:27:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5316999999999999e-05 2024-09-10T06:27:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430741+0000", 2024-09-10T06:27:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8336e-05 2024-09-10T06:27:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430762+0000", 2024-09-10T06:27:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.162e-05 2024-09-10T06:27:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430923+0000", 2024-09-10T06:27:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016044599999999999 2024-09-10T06:27:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431103+0000", 2024-09-10T06:27:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018030100000000001 2024-09-10T06:27:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431513+0000", 2024-09-10T06:27:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040992999999999997 2024-09-10T06:27:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432715+0000", 2024-09-10T06:27:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001202411 2024-09-10T06:27:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433624+0000", 2024-09-10T06:27:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090863000000000001 2024-09-10T06:27:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433718+0000", 2024-09-10T06:27:21.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3749e-05 2024-09-10T06:27:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433781+0000", 2024-09-10T06:27:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2885999999999994e-05 2024-09-10T06:27:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:273 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:21.824 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.362429831, 2024-09-10T06:27:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028009850000000002, 2024-09-10T06:27:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 273 2024-09-10T06:27:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432260+0000", 2024-09-10T06:27:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1900000000000002e-06 2024-09-10T06:27:21.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432271+0000", 2024-09-10T06:27:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1353e-05 2024-09-10T06:27:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432296+0000", 2024-09-10T06:27:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4817e-05 2024-09-10T06:27:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432318+0000", 2024-09-10T06:27:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1963e-05 2024-09-10T06:27:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432465+0000", 2024-09-10T06:27:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014658299999999999 2024-09-10T06:27:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432801+0000", 2024-09-10T06:27:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033681299999999999 2024-09-10T06:27:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433188+0000", 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000386857 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434552+0000", 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013634400000000001 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434872+0000", 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031998399999999999 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434973+0000", 2024-09-10T06:27:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100962 2024-09-10T06:27:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.435059+0000", 2024-09-10T06:27:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6023e-05 2024-09-10T06:27:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:299 6.14 e34/28 6:2c0c0c23:reshard::reshard.0000000001:head v 34'2, mlcod=0'0)", 2024-09-10T06:27:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.357813980000003, 2024-09-10T06:27:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029099109999999998, 2024-09-10T06:27:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436875+0000", 2024-09-10T06:27:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0430000000000002e-06 2024-09-10T06:27:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436890+0000", 2024-09-10T06:27:21.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4766999999999999e-05 2024-09-10T06:27:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436918+0000", 2024-09-10T06:27:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.76e-05 2024-09-10T06:27:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436937+0000", 2024-09-10T06:27:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9539999999999999e-05 2024-09-10T06:27:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437081+0000", 2024-09-10T06:27:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144065 2024-09-10T06:27:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437130+0000", 2024-09-10T06:27:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8609999999999997e-05 2024-09-10T06:27:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439676+0000", 2024-09-10T06:27:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002546137 2024-09-10T06:27:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439783+0000", 2024-09-10T06:27:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107149 2024-09-10T06:27:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:341 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.348894285, 2024-09-10T06:27:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030260230000000001, 2024-09-10T06:27:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.835 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 341 2024-09-10T06:27:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445796+0000", 2024-09-10T06:27:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7130000000000001e-06 2024-09-10T06:27:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445810+0000", 2024-09-10T06:27:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4564e-05 2024-09-10T06:27:21.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445886+0000", 2024-09-10T06:27:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5921999999999996e-05 2024-09-10T06:27:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445902+0000", 2024-09-10T06:27:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5800000000000001e-05 2024-09-10T06:27:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446057+0000", 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015475600000000001 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446347+0000", 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029057699999999998 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446669+0000", 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032102399999999999 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.447891+0000", 2024-09-10T06:27:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012226680000000001 2024-09-10T06:27:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448550+0000", 2024-09-10T06:27:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065925800000000002 2024-09-10T06:27:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448699+0000", 2024-09-10T06:27:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014831800000000001 2024-09-10T06:27:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448819+0000", 2024-09-10T06:27:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120423 2024-09-10T06:27:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:505 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.267215755000002, 2024-09-10T06:27:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028092249999999998, 2024-09-10T06:27:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.841 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 505 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:21.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527474+0000", 2024-09-10T06:27:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-10T06:27:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527495+0000", 2024-09-10T06:27:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0910000000000001e-05 2024-09-10T06:27:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527549+0000", 2024-09-10T06:27:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3223000000000002e-05 2024-09-10T06:27:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527583+0000", 2024-09-10T06:27:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4773000000000001e-05 2024-09-10T06:27:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527737+0000", 2024-09-10T06:27:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325199999999999 2024-09-10T06:27:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528092+0000", 2024-09-10T06:27:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000354951 2024-09-10T06:27:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528657+0000", 2024-09-10T06:27:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00056537500000000001 2024-09-10T06:27:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.529771+0000", 2024-09-10T06:27:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011136519999999999 2024-09-10T06:27:21.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530072+0000", 2024-09-10T06:27:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030151700000000001 2024-09-10T06:27:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530213+0000", 2024-09-10T06:27:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014100500000000001 2024-09-10T06:27:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530281+0000", 2024-09-10T06:27:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7793999999999995e-05 2024-09-10T06:27:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.263546478000002, 2024-09-10T06:27:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051813969999999999, 2024-09-10T06:27:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.847 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 513 2024-09-10T06:27:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531143+0000", 2024-09-10T06:27:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7400000000000001e-06 2024-09-10T06:27:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531153+0000", 2024-09-10T06:27:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.815e-06 2024-09-10T06:27:21.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531178+0000", 2024-09-10T06:27:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5755e-05 2024-09-10T06:27:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531190+0000", 2024-09-10T06:27:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1250000000000001e-05 2024-09-10T06:27:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531322+0000", 2024-09-10T06:27:21.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013239299999999999 2024-09-10T06:27:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531550+0000", 2024-09-10T06:27:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000227598 2024-09-10T06:27:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531966+0000", 2024-09-10T06:27:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041634400000000002 2024-09-10T06:27:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533197+0000", 2024-09-10T06:27:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012308810000000001 2024-09-10T06:27:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536097+0000", 2024-09-10T06:27:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029007159999999998 2024-09-10T06:27:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536245+0000", 2024-09-10T06:27:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000147816 2024-09-10T06:27:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536322+0000", 2024-09-10T06:27:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7088999999999993e-05 2024-09-10T06:27:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:514 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.263474281000001, 2024-09-10T06:27:21.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048258260000000001, 2024-09-10T06:27:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 514 2024-09-10T06:27:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531214+0000", 2024-09-10T06:27:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2699999999999998e-07 2024-09-10T06:27:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531219+0000", 2024-09-10T06:27:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-10T06:27:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531233+0000", 2024-09-10T06:27:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.38e-05 2024-09-10T06:27:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531240+0000", 2024-09-10T06:27:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7399999999999998e-06 2024-09-10T06:27:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531378+0000", 2024-09-10T06:27:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013860399999999999 2024-09-10T06:27:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531600+0000", 2024-09-10T06:27:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221287 2024-09-10T06:27:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532007+0000", 2024-09-10T06:27:21.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040728500000000001 2024-09-10T06:27:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533131+0000", 2024-09-10T06:27:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011240429999999999 2024-09-10T06:27:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535894+0000", 2024-09-10T06:27:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027628650000000002 2024-09-10T06:27:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535973+0000", 2024-09-10T06:27:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9399000000000003e-05 2024-09-10T06:27:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536039+0000", 2024-09-10T06:27:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5619999999999999e-05 2024-09-10T06:27:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:655 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:21.859 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.163531743, 2024-09-10T06:27:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003017207, 2024-09-10T06:27:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 655 2024-09-10T06:27:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631159+0000", 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8270000000000002e-06 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631173+0000", 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4739999999999999e-05 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631206+0000", 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2425999999999998e-05 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631221+0000", 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4927e-05 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631336+0000", 2024-09-10T06:27:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115062 2024-09-10T06:27:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631547+0000", 2024-09-10T06:27:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021178200000000001 2024-09-10T06:27:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.632034+0000", 2024-09-10T06:27:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000486899 2024-09-10T06:27:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633413+0000", 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001379077 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633891+0000", 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000477489 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634057+0000", 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016608500000000001 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634173+0000", 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115893 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:658 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.159517499000003, 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030550820000000002, 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.865 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 658 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635171+0000", 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.322e-06 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635178+0000", 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7950000000000002e-06 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635197+0000", 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8845e-05 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635215+0000", 2024-09-10T06:27:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7822e-05 2024-09-10T06:27:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635329+0000", 2024-09-10T06:27:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011433 2024-09-10T06:27:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635554+0000", 2024-09-10T06:27:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022527800000000001 2024-09-10T06:27:21.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.636007+0000", 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045297099999999998 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637198+0000", 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011902740000000001 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637961+0000", 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000763234 2024-09-10T06:27:21.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638110+0000", 2024-09-10T06:27:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149259 2024-09-10T06:27:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638225+0000", 2024-09-10T06:27:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011495200000000001 2024-09-10T06:27:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.063185556999997, 2024-09-10T06:27:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028070980000000001, 2024-09-10T06:27:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 724 2024-09-10T06:27:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.871 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731504+0000", 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:21.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731516+0000", 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1885999999999999e-05 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731547+0000", 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0923000000000002e-05 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731563+0000", 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5342999999999999e-05 2024-09-10T06:27:21.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731704+0000", 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014128599999999999 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731917+0000", 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021280800000000001 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.732227+0000", 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031024500000000001 2024-09-10T06:27:21.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.733258+0000", 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010306880000000001 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734163+0000", 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090502400000000004 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734247+0000", 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4363000000000005e-05 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734309+0000", 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2005e-05 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.056339422999997, 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030399789999999999, 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.876 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 727 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:21.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738350+0000", 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2199999999999999e-06 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738360+0000", 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0122999999999999e-05 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738384+0000", 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3390000000000001e-05 2024-09-10T06:27:21.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738397+0000", 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2896e-05 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738524+0000", 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126883 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738752+0000", 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022864200000000001 2024-09-10T06:27:21.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.739080+0000", 2024-09-10T06:27:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032783699999999999 2024-09-10T06:27:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.740085+0000", 2024-09-10T06:27:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001005438 2024-09-10T06:27:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741203+0000", 2024-09-10T06:27:21.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011175919999999999 2024-09-10T06:27:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741280+0000", 2024-09-10T06:27:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6545999999999995e-05 2024-09-10T06:27:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741388+0000", 2024-09-10T06:27:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108412 2024-09-10T06:27:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.864316918, 2024-09-10T06:27:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028715709999999998, 2024-09-10T06:27:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.882 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 814 2024-09-10T06:27:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930373+0000", 2024-09-10T06:27:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-10T06:27:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930384+0000", 2024-09-10T06:27:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1357e-05 2024-09-10T06:27:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930417+0000", 2024-09-10T06:27:21.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2289000000000002e-05 2024-09-10T06:27:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930438+0000", 2024-09-10T06:27:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1399999999999998e-05 2024-09-10T06:27:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930626+0000", 2024-09-10T06:27:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018812899999999999 2024-09-10T06:27:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930843+0000", 2024-09-10T06:27:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021719400000000001 2024-09-10T06:27:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.931152+0000", 2024-09-10T06:27:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030821199999999998 2024-09-10T06:27:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.932258+0000", 2024-09-10T06:27:21.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001106304 2024-09-10T06:27:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933092+0000", 2024-09-10T06:27:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00083364699999999997 2024-09-10T06:27:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933179+0000", 2024-09-10T06:27:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7383e-05 2024-09-10T06:27:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933242+0000", 2024-09-10T06:27:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3072999999999997e-05 2024-09-10T06:27:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.716765436999999, 2024-09-10T06:27:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029601670000000001, 2024-09-10T06:27:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.888 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 880 2024-09-10T06:27:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077925+0000", 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077938+0000", 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2836999999999999e-05 2024-09-10T06:27:21.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077970+0000", 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1542999999999999e-05 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077984+0000", 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4963999999999999e-05 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078118+0000", 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134015 2024-09-10T06:27:21.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078344+0000", 2024-09-10T06:27:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225038 2024-09-10T06:27:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078696+0000", 2024-09-10T06:27:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035250100000000002 2024-09-10T06:27:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.079793+0000", 2024-09-10T06:27:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010967049999999999 2024-09-10T06:27:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080714+0000", 2024-09-10T06:27:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00092153600000000003 2024-09-10T06:27:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080802+0000", 2024-09-10T06:27:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7446000000000003e-05 2024-09-10T06:27:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080882+0000", 2024-09-10T06:27:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0445999999999995e-05 2024-09-10T06:27:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.642145210000002, 2024-09-10T06:27:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002919091, 2024-09-10T06:27:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.894 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 913 2024-09-10T06:27:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152545+0000", 2024-09-10T06:27:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6529999999999998e-06 2024-09-10T06:27:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152557+0000", 2024-09-10T06:27:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919999999999999e-05 2024-09-10T06:27:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152587+0000", 2024-09-10T06:27:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0097e-05 2024-09-10T06:27:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152601+0000", 2024-09-10T06:27:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4579999999999999e-05 2024-09-10T06:27:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152732+0000", 2024-09-10T06:27:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013085500000000001 2024-09-10T06:27:21.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153007+0000", 2024-09-10T06:27:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027469499999999998 2024-09-10T06:27:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153344+0000", 2024-09-10T06:27:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033742400000000001 2024-09-10T06:27:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.154351+0000", 2024-09-10T06:27:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010067590000000001 2024-09-10T06:27:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155301+0000", 2024-09-10T06:27:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095000900000000003 2024-09-10T06:27:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155387+0000", 2024-09-10T06:27:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6136000000000003e-05 2024-09-10T06:27:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155461+0000", 2024-09-10T06:27:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3962999999999996e-05 2024-09-10T06:27:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.610498528000001, 2024-09-10T06:27:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029321239999999999, 2024-09-10T06:27:21.900 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 927 2024-09-10T06:27:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184191+0000", 2024-09-10T06:27:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.764e-06 2024-09-10T06:27:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184199+0000", 2024-09-10T06:27:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4630000000000001e-06 2024-09-10T06:27:21.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184221+0000", 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1603e-05 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184233+0000", 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.189e-05 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184382+0000", 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014939900000000001 2024-09-10T06:27:21.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184495+0000", 2024-09-10T06:27:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113459 2024-09-10T06:27:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184735+0000", 2024-09-10T06:27:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000239554 2024-09-10T06:27:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186036+0000", 2024-09-10T06:27:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00130072 2024-09-10T06:27:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186929+0000", 2024-09-10T06:27:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000893694 2024-09-10T06:27:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187014+0000", 2024-09-10T06:27:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4222999999999996e-05 2024-09-10T06:27:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187121+0000", 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107355 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.607237662999999, 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028243320000000001, 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:21.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 928 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187452+0000", 2024-09-10T06:27:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5069999999999999e-06 2024-09-10T06:27:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187464+0000", 2024-09-10T06:27:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1243000000000001e-05 2024-09-10T06:27:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187495+0000", 2024-09-10T06:27:21.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1136000000000001e-05 2024-09-10T06:27:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187511+0000", 2024-09-10T06:27:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6710000000000001e-05 2024-09-10T06:27:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187648+0000", 2024-09-10T06:27:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013657599999999999 2024-09-10T06:27:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:21.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187866+0000", 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021853500000000001 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.188168+0000", 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030161100000000002 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.189334+0000", 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001166048 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:21.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190086+0000", 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075159399999999996 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190165+0000", 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8953000000000001e-05 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190274+0000", 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109419 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:21.911 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:21.912 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:21.913 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:27:21.913 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:21.914+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:22.013 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:22.013+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:22.086 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:22.086 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:22.086 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:22.087 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:22.100 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:27:22.114 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:22.113+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:22.215 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:22.210+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:22.223 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:22.224 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:22.224 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:22.238 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:27:22.251 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:27:22.323 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:22.322+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:22.401 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4236.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-10T06:27:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:23.499464+0000", 2024-09-10T06:27:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.899723352999999, 2024-09-10T06:27:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013449099000000001, 2024-09-10T06:27:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4236", 2024-09-10T06:27:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1622831300", 2024-09-10T06:27:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1 2024-09-10T06:27:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499464+0000", 2024-09-10T06:27:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499464+0000", 2024-09-10T06:27:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499474+0000", 2024-09-10T06:27:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.004e-05 2024-09-10T06:27:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499488+0000", 2024-09-10T06:27:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3516000000000001e-05 2024-09-10T06:27:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499514+0000", 2024-09-10T06:27:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6310000000000001e-05 2024-09-10T06:27:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499538+0000", 2024-09-10T06:27:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3589000000000001e-05 2024-09-10T06:27:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.500297+0000", 2024-09-10T06:27:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000759908 2024-09-10T06:27:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:27:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.500351+0000", 2024-09-10T06:27:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3285999999999998e-05 2024-09-10T06:27:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.506506+0000", 2024-09-10T06:27:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061553090000000003 2024-09-10T06:27:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.506862+0000", 2024-09-10T06:27:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035549099999999999 2024-09-10T06:27:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.507143+0000", 2024-09-10T06:27:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000281964 2024-09-10T06:27:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.509394+0000", 2024-09-10T06:27:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022506700000000002 2024-09-10T06:27:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.512769+0000", 2024-09-10T06:27:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033745899999999998 2024-09-10T06:27:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.512850+0000", 2024-09-10T06:27:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1446000000000006e-05 2024-09-10T06:27:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.512913+0000", 2024-09-10T06:27:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2979999999999997e-05 2024-09-10T06:27:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4236.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-10T06:27:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:24.509270+0000", 2024-09-10T06:27:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.889917551000003, 2024-09-10T06:27:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068216769999999999, 2024-09-10T06:27:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4236", 2024-09-10T06:27:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1622831300", 2024-09-10T06:27:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5 2024-09-10T06:27:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509270+0000", 2024-09-10T06:27:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509270+0000", 2024-09-10T06:27:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509273+0000", 2024-09-10T06:27:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4199999999999999e-06 2024-09-10T06:27:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509288+0000", 2024-09-10T06:27:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4732999999999999e-05 2024-09-10T06:27:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509322+0000", 2024-09-10T06:27:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3596000000000002e-05 2024-09-10T06:27:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509345+0000", 2024-09-10T06:27:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3767000000000001e-05 2024-09-10T06:27:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509475+0000", 2024-09-10T06:27:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130099 2024-09-10T06:27:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:27:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509486+0000", 2024-09-10T06:27:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.083e-05 2024-09-10T06:27:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.512854+0000", 2024-09-10T06:27:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00336748 2024-09-10T06:27:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.513079+0000", 2024-09-10T06:27:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225565 2024-09-10T06:27:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.513291+0000", 2024-09-10T06:27:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021120199999999999 2024-09-10T06:27:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.514873+0000", 2024-09-10T06:27:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001582841 2024-09-10T06:27:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.515896+0000", 2024-09-10T06:27:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010226619999999999 2024-09-10T06:27:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.515976+0000", 2024-09-10T06:27:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0055999999999994e-05 2024-09-10T06:27:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.516092+0000", 2024-09-10T06:27:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115426 2024-09-10T06:27:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4236.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T06:27:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:25.528375+0000", 2024-09-10T06:27:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.870812035, 2024-09-10T06:27:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070604630000000003, 2024-09-10T06:27:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4236", 2024-09-10T06:27:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1622831300", 2024-09-10T06:27:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7 2024-09-10T06:27:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528375+0000", 2024-09-10T06:27:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528375+0000", 2024-09-10T06:27:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528379+0000", 2024-09-10T06:27:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.19e-06 2024-09-10T06:27:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528393+0000", 2024-09-10T06:27:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4474000000000001e-05 2024-09-10T06:27:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528429+0000", 2024-09-10T06:27:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6273000000000003e-05 2024-09-10T06:27:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528448+0000", 2024-09-10T06:27:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.827e-05 2024-09-10T06:27:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528578+0000", 2024-09-10T06:27:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013027899999999999 2024-09-10T06:27:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:27:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528588+0000", 2024-09-10T06:27:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.042e-05 2024-09-10T06:27:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.532249+0000", 2024-09-10T06:27:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003660955 2024-09-10T06:27:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.532448+0000", 2024-09-10T06:27:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019897799999999999 2024-09-10T06:27:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.532832+0000", 2024-09-10T06:27:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038408399999999998 2024-09-10T06:27:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.534422+0000", 2024-09-10T06:27:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001589708 2024-09-10T06:27:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.535279+0000", 2024-09-10T06:27:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00085695599999999997 2024-09-10T06:27:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.535365+0000", 2024-09-10T06:27:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6348999999999996e-05 2024-09-10T06:27:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.535436+0000", 2024-09-10T06:27:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0526999999999997e-05 2024-09-10T06:27:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4349.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:34.327633+0000", 2024-09-10T06:27:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.071554540999998, 2024-09-10T06:27:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031482849999999998, 2024-09-10T06:27:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4349", 2024-09-10T06:27:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 41 2024-09-10T06:27:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327633+0000", 2024-09-10T06:27:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327633+0000", 2024-09-10T06:27:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327635+0000", 2024-09-10T06:27:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4559999999999999e-06 2024-09-10T06:27:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327649+0000", 2024-09-10T06:27:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3380000000000001e-05 2024-09-10T06:27:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327680+0000", 2024-09-10T06:27:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1253e-05 2024-09-10T06:27:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327696+0000", 2024-09-10T06:27:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5736999999999999e-05 2024-09-10T06:27:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327890+0000", 2024-09-10T06:27:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000194468 2024-09-10T06:27:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.328116+0000", 2024-09-10T06:27:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225746 2024-09-10T06:27:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.328401+0000", 2024-09-10T06:27:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028469699999999999 2024-09-10T06:27:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.329688+0000", 2024-09-10T06:27:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001287327 2024-09-10T06:27:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.330628+0000", 2024-09-10T06:27:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094027599999999998 2024-09-10T06:27:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.330718+0000", 2024-09-10T06:27:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9676e-05 2024-09-10T06:27:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.330781+0000", 2024-09-10T06:27:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3268999999999993e-05 2024-09-10T06:27:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.297889+0000", 2024-09-10T06:27:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.101298833999998, 2024-09-10T06:27:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015273603, 2024-09-10T06:27:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48 2024-09-10T06:27:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297889+0000", 2024-09-10T06:27:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297889+0000", 2024-09-10T06:27:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297892+0000", 2024-09-10T06:27:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.703e-06 2024-09-10T06:27:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297905+0000", 2024-09-10T06:27:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2874000000000001e-05 2024-09-10T06:27:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297930+0000", 2024-09-10T06:27:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5029999999999999e-05 2024-09-10T06:27:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297946+0000", 2024-09-10T06:27:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5336e-05 2024-09-10T06:27:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298133+0000", 2024-09-10T06:27:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187725 2024-09-10T06:27:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:27:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298154+0000", 2024-09-10T06:27:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0953000000000001e-05 2024-09-10T06:27:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.310851+0000", 2024-09-10T06:27:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012696522999999999 2024-09-10T06:27:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.311061+0000", 2024-09-10T06:27:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021023799999999999 2024-09-10T06:27:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.311247+0000", 2024-09-10T06:27:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018557900000000001 2024-09-10T06:27:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.312771+0000", 2024-09-10T06:27:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015244119999999999 2024-09-10T06:27:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.312957+0000", 2024-09-10T06:27:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000185885 2024-09-10T06:27:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313037+0000", 2024-09-10T06:27:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9802999999999995e-05 2024-09-10T06:27:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313162+0000", 2024-09-10T06:27:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000125542 2024-09-10T06:27:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94143734762752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.313369+0000", 2024-09-10T06:27:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.085817916000003, 2024-09-10T06:27:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034352330000000002, 2024-09-10T06:27:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49 2024-09-10T06:27:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313369+0000", 2024-09-10T06:27:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313369+0000", 2024-09-10T06:27:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313372+0000", 2024-09-10T06:27:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4830000000000002e-06 2024-09-10T06:27:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313384+0000", 2024-09-10T06:27:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2150000000000001e-05 2024-09-10T06:27:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313410+0000", 2024-09-10T06:27:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6356999999999999e-05 2024-09-10T06:27:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313425+0000", 2024-09-10T06:27:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.437e-05 2024-09-10T06:27:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313540+0000", 2024-09-10T06:27:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115555 2024-09-10T06:27:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313739+0000", 2024-09-10T06:27:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019832199999999999 2024-09-10T06:27:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:22.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.314101+0000", 2024-09-10T06:27:22.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036192499999999997 2024-09-10T06:27:22.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.315569+0000", 2024-09-10T06:27:22.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014680089999999999 2024-09-10T06:27:22.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.316489+0000", 2024-09-10T06:27:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00092051299999999997 2024-09-10T06:27:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.316623+0000", 2024-09-10T06:27:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013342399999999999 2024-09-10T06:27:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.316805+0000", 2024-09-10T06:27:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182125 2024-09-10T06:27:22.446 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.447 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.447 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:22.447 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.297211+0000", 2024-09-10T06:27:22.447 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.101976084, 2024-09-10T06:27:22.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041349439999999998, 2024-09-10T06:27:22.447 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.447 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.447 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.447 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205 2024-09-10T06:27:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297211+0000", 2024-09-10T06:27:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297211+0000", 2024-09-10T06:27:22.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297215+0000", 2024-09-10T06:27:22.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1930000000000002e-06 2024-09-10T06:27:22.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297229+0000", 2024-09-10T06:27:22.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.472e-05 2024-09-10T06:27:22.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297265+0000", 2024-09-10T06:27:22.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5407000000000002e-05 2024-09-10T06:27:22.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297290+0000", 2024-09-10T06:27:22.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5153000000000001e-05 2024-09-10T06:27:22.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297482+0000", 2024-09-10T06:27:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019209199999999999 2024-09-10T06:27:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297721+0000", 2024-09-10T06:27:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023919499999999999 2024-09-10T06:27:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:22.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.298183+0000", 2024-09-10T06:27:22.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046180899999999998 2024-09-10T06:27:22.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.299918+0000", 2024-09-10T06:27:22.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001734827 2024-09-10T06:27:22.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.301183+0000", 2024-09-10T06:27:22.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001265347 2024-09-10T06:27:22.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.301273+0000", 2024-09-10T06:27:22.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0031999999999995e-05 2024-09-10T06:27:22.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.301346+0000", 2024-09-10T06:27:22.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3169000000000004e-05 2024-09-10T06:27:22.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.454 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.454 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.454 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:22.454 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.364287+0000", 2024-09-10T06:27:22.454 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.034900604999997, 2024-09-10T06:27:22.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003215922, 2024-09-10T06:27:22.454 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.454 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.454 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:22.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:22.455 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 220 2024-09-10T06:27:22.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.455 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364287+0000", 2024-09-10T06:27:22.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364287+0000", 2024-09-10T06:27:22.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364290+0000", 2024-09-10T06:27:22.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3340000000000002e-06 2024-09-10T06:27:22.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364305+0000", 2024-09-10T06:27:22.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4790000000000001e-05 2024-09-10T06:27:22.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364337+0000", 2024-09-10T06:27:22.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2425999999999998e-05 2024-09-10T06:27:22.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364353+0000", 2024-09-10T06:27:22.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5213e-05 2024-09-10T06:27:22.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364463+0000", 2024-09-10T06:27:22.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110126 2024-09-10T06:27:22.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364668+0000", 2024-09-10T06:27:22.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020534199999999999 2024-09-10T06:27:22.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:22.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.365077+0000", 2024-09-10T06:27:22.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040907999999999998 2024-09-10T06:27:22.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.366652+0000", 2024-09-10T06:27:22.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015746239999999999 2024-09-10T06:27:22.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.367350+0000", 2024-09-10T06:27:22.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069806100000000004 2024-09-10T06:27:22.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.367434+0000", 2024-09-10T06:27:22.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3819999999999994e-05 2024-09-10T06:27:22.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.367503+0000", 2024-09-10T06:27:22.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-10T06:27:22.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.461 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.461 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.461 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:22.461 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.374400+0000", 2024-09-10T06:27:22.461 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.024787482999997, 2024-09-10T06:27:22.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033158279999999998, 2024-09-10T06:27:22.461 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.461 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.462 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.462 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.462 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:22.462 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:22.462 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223 2024-09-10T06:27:22.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.462 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374400+0000", 2024-09-10T06:27:22.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374400+0000", 2024-09-10T06:27:22.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374402+0000", 2024-09-10T06:27:22.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4030000000000001e-06 2024-09-10T06:27:22.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374414+0000", 2024-09-10T06:27:22.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1260000000000001e-05 2024-09-10T06:27:22.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374447+0000", 2024-09-10T06:27:22.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3149999999999999e-05 2024-09-10T06:27:22.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374462+0000", 2024-09-10T06:27:22.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5495999999999999e-05 2024-09-10T06:27:22.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374582+0000", 2024-09-10T06:27:22.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119999 2024-09-10T06:27:22.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374775+0000", 2024-09-10T06:27:22.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192556 2024-09-10T06:27:22.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:22.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.375157+0000", 2024-09-10T06:27:22.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038242700000000002 2024-09-10T06:27:22.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.376482+0000", 2024-09-10T06:27:22.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013249329999999999 2024-09-10T06:27:22.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.377533+0000", 2024-09-10T06:27:22.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010505759999999999 2024-09-10T06:27:22.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.377610+0000", 2024-09-10T06:27:22.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7179000000000001e-05 2024-09-10T06:27:22.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.377716+0000", 2024-09-10T06:27:22.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105849 2024-09-10T06:27:22.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.468 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.468 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.468 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:22.468 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.385071+0000", 2024-09-10T06:27:22.468 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.014116442000002, 2024-09-10T06:27:22.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034290969999999999, 2024-09-10T06:27:22.469 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.469 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.469 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.469 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.469 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:22.469 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:22.469 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 226 2024-09-10T06:27:22.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.469 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385071+0000", 2024-09-10T06:27:22.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385071+0000", 2024-09-10T06:27:22.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385073+0000", 2024-09-10T06:27:22.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4329999999999998e-06 2024-09-10T06:27:22.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385085+0000", 2024-09-10T06:27:22.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1372999999999999e-05 2024-09-10T06:27:22.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385117+0000", 2024-09-10T06:27:22.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1874e-05 2024-09-10T06:27:22.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385135+0000", 2024-09-10T06:27:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8419000000000001e-05 2024-09-10T06:27:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385263+0000", 2024-09-10T06:27:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012800600000000001 2024-09-10T06:27:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385459+0000", 2024-09-10T06:27:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000196128 2024-09-10T06:27:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385870+0000", 2024-09-10T06:27:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000410417 2024-09-10T06:27:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.387503+0000", 2024-09-10T06:27:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001633671 2024-09-10T06:27:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.388349+0000", 2024-09-10T06:27:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00084602400000000002 2024-09-10T06:27:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.388436+0000", 2024-09-10T06:27:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6706000000000006e-05 2024-09-10T06:27:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.388500+0000", 2024-09-10T06:27:22.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4046000000000003e-05 2024-09-10T06:27:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.413140+0000", 2024-09-10T06:27:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.986047458999998, 2024-09-10T06:27:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003240962, 2024-09-10T06:27:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234 2024-09-10T06:27:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413140+0000", 2024-09-10T06:27:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413140+0000", 2024-09-10T06:27:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413142+0000", 2024-09-10T06:27:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3999999999999999e-06 2024-09-10T06:27:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413153+0000", 2024-09-10T06:27:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.076e-05 2024-09-10T06:27:22.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413180+0000", 2024-09-10T06:27:22.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6746000000000001e-05 2024-09-10T06:27:22.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413195+0000", 2024-09-10T06:27:22.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4674e-05 2024-09-10T06:27:22.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413367+0000", 2024-09-10T06:27:22.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017253200000000001 2024-09-10T06:27:22.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413594+0000", 2024-09-10T06:27:22.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022710499999999999 2024-09-10T06:27:22.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:22.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.414064+0000", 2024-09-10T06:27:22.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046966599999999999 2024-09-10T06:27:22.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.415286+0000", 2024-09-10T06:27:22.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001222281 2024-09-10T06:27:22.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.416233+0000", 2024-09-10T06:27:22.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094718600000000003 2024-09-10T06:27:22.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.416320+0000", 2024-09-10T06:27:22.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6521999999999996e-05 2024-09-10T06:27:22.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.416381+0000", 2024-09-10T06:27:22.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.109e-05 2024-09-10T06:27:22.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.481 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.482 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:353 6.4 e34/28 6:25ca39bb:::obj_delete_at_hint.0000000005:head v 34'6, mlcod=34'4)", 2024-09-10T06:27:22.482 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.451186+0000", 2024-09-10T06:27:22.482 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.948001746000003, 2024-09-10T06:27:22.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050475579999999997, 2024-09-10T06:27:22.482 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.482 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.482 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.482 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451186+0000", 2024-09-10T06:27:22.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451186+0000", 2024-09-10T06:27:22.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451191+0000", 2024-09-10T06:27:22.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.677e-06 2024-09-10T06:27:22.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451202+0000", 2024-09-10T06:27:22.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0777e-05 2024-09-10T06:27:22.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451225+0000", 2024-09-10T06:27:22.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3329999999999999e-05 2024-09-10T06:27:22.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451237+0000", 2024-09-10T06:27:22.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1226000000000001e-05 2024-09-10T06:27:22.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451356+0000", 2024-09-10T06:27:22.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118989 2024-09-10T06:27:22.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451405+0000", 2024-09-10T06:27:22.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9395999999999999e-05 2024-09-10T06:27:22.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.456155+0000", 2024-09-10T06:27:22.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047504239999999996 2024-09-10T06:27:22.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.456233+0000", 2024-09-10T06:27:22.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7738999999999995e-05 2024-09-10T06:27:22.486 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.486 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.486 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.487 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:362 6.4 e34/28 6:25ca39bb:::obj_delete_at_hint.0000000005:head v 34'7, mlcod=34'5)", 2024-09-10T06:27:22.487 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.457483+0000", 2024-09-10T06:27:22.487 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.941703986999997, 2024-09-10T06:27:22.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036278249999999999, 2024-09-10T06:27:22.487 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.487 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.487 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.487 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457483+0000", 2024-09-10T06:27:22.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457483+0000", 2024-09-10T06:27:22.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457485+0000", 2024-09-10T06:27:22.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.573e-06 2024-09-10T06:27:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457496+0000", 2024-09-10T06:27:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1066999999999999e-05 2024-09-10T06:27:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457520+0000", 2024-09-10T06:27:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4108999999999999e-05 2024-09-10T06:27:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457533+0000", 2024-09-10T06:27:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.288e-05 2024-09-10T06:27:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457637+0000", 2024-09-10T06:27:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103836 2024-09-10T06:27:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457668+0000", 2024-09-10T06:27:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1507000000000002e-05 2024-09-10T06:27:22.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461014+0000", 2024-09-10T06:27:22.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033451069999999999 2024-09-10T06:27:22.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461111+0000", 2024-09-10T06:27:22.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7745999999999996e-05 2024-09-10T06:27:22.491 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.491 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:441 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.481408+0000", 2024-09-10T06:27:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.917779856000003, 2024-09-10T06:27:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076439680000000001, 2024-09-10T06:27:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 441 2024-09-10T06:27:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481408+0000", 2024-09-10T06:27:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481408+0000", 2024-09-10T06:27:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481410+0000", 2024-09-10T06:27:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6539999999999999e-06 2024-09-10T06:27:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481428+0000", 2024-09-10T06:27:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7336000000000001e-05 2024-09-10T06:27:22.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481468+0000", 2024-09-10T06:27:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0062999999999999e-05 2024-09-10T06:27:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481494+0000", 2024-09-10T06:27:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6616999999999999e-05 2024-09-10T06:27:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481625+0000", 2024-09-10T06:27:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013042800000000001 2024-09-10T06:27:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481867+0000", 2024-09-10T06:27:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024220399999999999 2024-09-10T06:27:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.482325+0000", 2024-09-10T06:27:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045814199999999998 2024-09-10T06:27:22.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483548+0000", 2024-09-10T06:27:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012227900000000001 2024-09-10T06:27:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488857+0000", 2024-09-10T06:27:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053088120000000004 2024-09-10T06:27:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488959+0000", 2024-09-10T06:27:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102787 2024-09-10T06:27:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489052+0000", 2024-09-10T06:27:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2134999999999998e-05 2024-09-10T06:27:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.498 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:444 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:22.499 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.483111+0000", 2024-09-10T06:27:22.499 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.916076668999999, 2024-09-10T06:27:22.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055206379999999996, 2024-09-10T06:27:22.499 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.499 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.499 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:22.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:22.499 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 444 2024-09-10T06:27:22.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.499 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483111+0000", 2024-09-10T06:27:22.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483111+0000", 2024-09-10T06:27:22.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483114+0000", 2024-09-10T06:27:22.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1300000000000001e-06 2024-09-10T06:27:22.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483128+0000", 2024-09-10T06:27:22.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4032999999999999e-05 2024-09-10T06:27:22.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483161+0000", 2024-09-10T06:27:22.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3062999999999998e-05 2024-09-10T06:27:22.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483181+0000", 2024-09-10T06:27:22.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0486999999999999e-05 2024-09-10T06:27:22.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483316+0000", 2024-09-10T06:27:22.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013411099999999999 2024-09-10T06:27:22.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483642+0000", 2024-09-10T06:27:22.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032656299999999998 2024-09-10T06:27:22.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:22.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484153+0000", 2024-09-10T06:27:22.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00051090200000000004 2024-09-10T06:27:22.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.485759+0000", 2024-09-10T06:27:22.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001606215 2024-09-10T06:27:22.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488482+0000", 2024-09-10T06:27:22.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027225079999999998 2024-09-10T06:27:22.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488569+0000", 2024-09-10T06:27:22.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7602999999999995e-05 2024-09-10T06:27:22.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488631+0000", 2024-09-10T06:27:22.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2022999999999999e-05 2024-09-10T06:27:22.505 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.505 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.505 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.506 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:453 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:22.506 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.489376+0000", 2024-09-10T06:27:22.506 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.909811517000001, 2024-09-10T06:27:22.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052737419999999997, 2024-09-10T06:27:22.506 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.506 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.506 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.506 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.506 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:22.506 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:22.507 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 453 2024-09-10T06:27:22.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.507 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489376+0000", 2024-09-10T06:27:22.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489376+0000", 2024-09-10T06:27:22.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489378+0000", 2024-09-10T06:27:22.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9470000000000002e-06 2024-09-10T06:27:22.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489385+0000", 2024-09-10T06:27:22.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5830000000000001e-06 2024-09-10T06:27:22.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489408+0000", 2024-09-10T06:27:22.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2739999999999999e-05 2024-09-10T06:27:22.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489418+0000", 2024-09-10T06:27:22.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8730000000000002e-06 2024-09-10T06:27:22.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.490351+0000", 2024-09-10T06:27:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093270600000000005 2024-09-10T06:27:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.490602+0000", 2024-09-10T06:27:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025102499999999999 2024-09-10T06:27:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.490955+0000", 2024-09-10T06:27:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035311000000000001 2024-09-10T06:27:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494256+0000", 2024-09-10T06:27:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003301109 2024-09-10T06:27:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494417+0000", 2024-09-10T06:27:22.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016123799999999999 2024-09-10T06:27:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494571+0000", 2024-09-10T06:27:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000153425 2024-09-10T06:27:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494650+0000", 2024-09-10T06:27:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8986000000000006e-05 2024-09-10T06:27:22.512 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:457 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.492971+0000", 2024-09-10T06:27:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.906216454999999, 2024-09-10T06:27:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038003139999999999, 2024-09-10T06:27:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.513 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 457 2024-09-10T06:27:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492971+0000", 2024-09-10T06:27:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492971+0000", 2024-09-10T06:27:22.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492973+0000", 2024-09-10T06:27:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0499999999999999e-06 2024-09-10T06:27:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492981+0000", 2024-09-10T06:27:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1200000000000002e-06 2024-09-10T06:27:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493005+0000", 2024-09-10T06:27:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4125999999999999e-05 2024-09-10T06:27:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493017+0000", 2024-09-10T06:27:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.148e-05 2024-09-10T06:27:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493092+0000", 2024-09-10T06:27:22.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5112999999999997e-05 2024-09-10T06:27:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493294+0000", 2024-09-10T06:27:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020212100000000001 2024-09-10T06:27:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493743+0000", 2024-09-10T06:27:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000449436 2024-09-10T06:27:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494855+0000", 2024-09-10T06:27:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00111181 2024-09-10T06:27:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.496621+0000", 2024-09-10T06:27:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017657090000000001 2024-09-10T06:27:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.496701+0000", 2024-09-10T06:27:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0259000000000005e-05 2024-09-10T06:27:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.496771+0000", 2024-09-10T06:27:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0090000000000001e-05 2024-09-10T06:27:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.519 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:477 6.4 e34/28 6:264a8785:::obj_delete_at_hint.0000000011:head v 34'11, mlcod=34'9)", 2024-09-10T06:27:22.520 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.505151+0000", 2024-09-10T06:27:22.520 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.894036047999997, 2024-09-10T06:27:22.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033063839999999999, 2024-09-10T06:27:22.520 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.520 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.520 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.520 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505151+0000", 2024-09-10T06:27:22.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505151+0000", 2024-09-10T06:27:22.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505153+0000", 2024-09-10T06:27:22.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.697e-06 2024-09-10T06:27:22.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505164+0000", 2024-09-10T06:27:22.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1369000000000001e-05 2024-09-10T06:27:22.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505185+0000", 2024-09-10T06:27:22.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0387999999999999e-05 2024-09-10T06:27:22.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505195+0000", 2024-09-10T06:27:22.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166000000000001e-05 2024-09-10T06:27:22.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505281+0000", 2024-09-10T06:27:22.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5605000000000005e-05 2024-09-10T06:27:22.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505314+0000", 2024-09-10T06:27:22.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3433000000000003e-05 2024-09-10T06:27:22.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.508336+0000", 2024-09-10T06:27:22.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003022313 2024-09-10T06:27:22.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.508458+0000", 2024-09-10T06:27:22.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121413 2024-09-10T06:27:22.524 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.524 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.524 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.524 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:513 6.1a e34/28 6:5c7e8a6d:reshard::reshard.0000000015:head v 34'2, mlcod=0'0)", 2024-09-10T06:27:22.524 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.532129+0000", 2024-09-10T06:27:22.525 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.867058006999997, 2024-09-10T06:27:22.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036491039999999998, 2024-09-10T06:27:22.525 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.525 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.525 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.525 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532129+0000", 2024-09-10T06:27:22.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532129+0000", 2024-09-10T06:27:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532132+0000", 2024-09-10T06:27:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2800000000000002e-06 2024-09-10T06:27:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532146+0000", 2024-09-10T06:27:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.452e-05 2024-09-10T06:27:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532190+0000", 2024-09-10T06:27:22.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3485999999999997e-05 2024-09-10T06:27:22.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532208+0000", 2024-09-10T06:27:22.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8450000000000001e-05 2024-09-10T06:27:22.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532338+0000", 2024-09-10T06:27:22.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129727 2024-09-10T06:27:22.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532382+0000", 2024-09-10T06:27:22.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4598999999999998e-05 2024-09-10T06:27:22.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535696+0000", 2024-09-10T06:27:22.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033139369999999999 2024-09-10T06:27:22.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535779+0000", 2024-09-10T06:27:22.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2105000000000001e-05 2024-09-10T06:27:22.529 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.529 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.529 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.529 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:22.529 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.243071+0000", 2024-09-10T06:27:22.529 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.156116464, 2024-09-10T06:27:22.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033924269999999999, 2024-09-10T06:27:22.529 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:22.529 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:22.529 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:22.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:22.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:22.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:22.530 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 952 2024-09-10T06:27:22.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.530 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:22.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:22.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243071+0000", 2024-09-10T06:27:22.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243071+0000", 2024-09-10T06:27:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243073+0000", 2024-09-10T06:27:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3659999999999999e-06 2024-09-10T06:27:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243085+0000", 2024-09-10T06:27:22.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1440000000000001e-05 2024-09-10T06:27:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243113+0000", 2024-09-10T06:27:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8717e-05 2024-09-10T06:27:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243130+0000", 2024-09-10T06:27:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6796999999999999e-05 2024-09-10T06:27:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:22.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243281+0000", 2024-09-10T06:27:22.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151228 2024-09-10T06:27:22.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:22.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243625+0000", 2024-09-10T06:27:22.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034360400000000001 2024-09-10T06:27:22.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.244161+0000", 2024-09-10T06:27:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00053615300000000004 2024-09-10T06:27:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.245360+0000", 2024-09-10T06:27:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011983740000000001 2024-09-10T06:27:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.246315+0000", 2024-09-10T06:27:22.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095580299999999997 2024-09-10T06:27:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.246400+0000", 2024-09-10T06:27:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4075999999999999e-05 2024-09-10T06:27:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.246463+0000", 2024-09-10T06:27:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3868999999999994e-05 2024-09-10T06:27:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.535 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.536 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:22.536 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:22.536 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:22.536 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T06:27:22.537 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:22.538 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:22.538 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:22.539 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:22.539 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:27:22.539 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:22.534+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:22.540 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:22.540 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:22.540 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:22.541 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:22.541 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:22.541 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:22.541 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.2 to 1 (10000) 2024-09-10T06:27:22.542 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:22.542 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:22.543 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-10T06:27:22.570 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:22.570 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:22.601 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:22.601 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:22.638 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:22.633+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:22.711 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:22.711 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:22.725 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:27:22.739 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:22.737+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:22.840 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:22.837+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:22.887 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:22.887 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:22.902 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:27:22.941 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:22.937+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:23.042 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:23.041+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:23.067 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:23.067 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:23.082 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:27:23.144 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:23.141+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:23.199 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:23.199 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:23.214 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:27:23.256 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:23.253+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:23.346 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:23.341+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:23.375 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:23.375 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:23.389 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:27:23.446 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:23.445+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:23.527 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.3 to 1 (10000) 2024-09-10T06:27:23.534 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-10T06:27:23.547 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:23.545+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:23.558 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:23.558 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:23.561 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-10T06:27:23.572 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:27:23.649 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:23.645+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:23.737 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:23.737 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:23.750 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:23.745+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:23.754 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:27:23.850 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:23.845+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:23.920 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:23.920 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:23.937 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:27:23.951 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:23.949+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:24.052 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:24.053+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:24.091 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:24.091 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:24.108 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:27:24.153 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:24.149+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:24.254 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:24.253+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:24.262 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:24.262 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:24.280 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:27:24.366 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:24.365+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:24.455 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:24.453+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:24.488 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:24.488 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:24.505 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:27:24.542 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.4 to 1 (10000) 2024-09-10T06:27:24.556 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:24.553+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:24.567 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-10T06:27:24.625 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:27:24.657 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:24.657+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:24.715 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:24.715 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:24.736 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:27:24.758 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:24.753+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:24.859 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:24.857+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:24.875 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:24.875 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:24.908 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:24.908 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:24.916 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:24.916 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:24.935 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:27:24.941 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:24.942 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:24.972 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:24.973 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:24.973 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:24.973+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:25.005 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:25.005 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:25.039 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:25.039 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:25.062 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:25.057+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:25.072 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:25.072 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:25.105 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:25.105 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:25.117 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:25.117 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:25.117 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:25.132 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:27:25.162 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:25.157+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:25.263 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:25.261+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:25.346 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:25.346 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:25.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:25.346 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:25.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.346 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4236.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T06:27:25.346 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:25.347 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 61.837055005000003, 2024-09-10T06:27:25.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049682550000000004, 2024-09-10T06:27:25.347 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.347 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.347 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.347 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:25.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:25.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507427+0000", 2024-09-10T06:27:25.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5629999999999999e-06 2024-09-10T06:27:25.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507439+0000", 2024-09-10T06:27:25.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.19e-05 2024-09-10T06:27:25.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507460+0000", 2024-09-10T06:27:25.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1693000000000001e-05 2024-09-10T06:27:25.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507480+0000", 2024-09-10T06:27:25.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9947000000000001e-05 2024-09-10T06:27:25.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507613+0000", 2024-09-10T06:27:25.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000132409 2024-09-10T06:27:25.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507696+0000", 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2953000000000004e-05 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512288+0000", 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045927110000000002 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512393+0000", 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105079 2024-09-10T06:27:25.350 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.351 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.351 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.351 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:25.351 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:25.351 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 51.013590972999999, 2024-09-10T06:27:25.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025692739999999999, 2024-09-10T06:27:25.351 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.351 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.351 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:25.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:25.352 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 42 2024-09-10T06:27:25.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.352 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:25.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:25.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330891+0000", 2024-09-10T06:27:25.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9700000000000002e-06 2024-09-10T06:27:25.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330901+0000", 2024-09-10T06:27:25.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2909999999999996e-06 2024-09-10T06:27:25.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330924+0000", 2024-09-10T06:27:25.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3132000000000001e-05 2024-09-10T06:27:25.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330935+0000", 2024-09-10T06:27:25.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0893999999999999e-05 2024-09-10T06:27:25.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331021+0000", 2024-09-10T06:27:25.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6205000000000006e-05 2024-09-10T06:27:25.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331160+0000", 2024-09-10T06:27:25.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013973600000000001 2024-09-10T06:27:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331336+0000", 2024-09-10T06:27:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017578799999999999 2024-09-10T06:27:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.332381+0000", 2024-09-10T06:27:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001044627 2024-09-10T06:27:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333371+0000", 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098979800000000007 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333421+0000", 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9872e-05 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333459+0000", 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7960999999999998e-05 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.357 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:25.357 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:25.357 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.028400052999999, 2024-09-10T06:27:25.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025247730000000001, 2024-09-10T06:27:25.357 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.357 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.357 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.357 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.357 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.357 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.357 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 52 2024-09-10T06:27:25.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.357 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:25.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:25.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316084+0000", 2024-09-10T06:27:25.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8260000000000003e-06 2024-09-10T06:27:25.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316095+0000", 2024-09-10T06:27:25.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1229999999999999e-05 2024-09-10T06:27:25.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316131+0000", 2024-09-10T06:27:25.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5499e-05 2024-09-10T06:27:25.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316150+0000", 2024-09-10T06:27:25.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9510000000000001e-05 2024-09-10T06:27:25.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316275+0000", 2024-09-10T06:27:25.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012501600000000001 2024-09-10T06:27:25.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316507+0000", 2024-09-10T06:27:25.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000231404 2024-09-10T06:27:25.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:25.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316712+0000", 2024-09-10T06:27:25.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204873 2024-09-10T06:27:25.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.317603+0000", 2024-09-10T06:27:25.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089174399999999998 2024-09-10T06:27:25.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318470+0000", 2024-09-10T06:27:25.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086713399999999998 2024-09-10T06:27:25.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318552+0000", 2024-09-10T06:27:25.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1279999999999994e-05 2024-09-10T06:27:25.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318605+0000", 2024-09-10T06:27:25.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3257000000000002e-05 2024-09-10T06:27:25.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.362 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.362 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.924621723999998, 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033383480000000001, 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 236 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:25.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:25.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419861+0000", 2024-09-10T06:27:25.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.734e-06 2024-09-10T06:27:25.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419873+0000", 2024-09-10T06:27:25.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1789e-05 2024-09-10T06:27:25.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419904+0000", 2024-09-10T06:27:25.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1377000000000001e-05 2024-09-10T06:27:25.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419921+0000", 2024-09-10T06:27:25.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6878999999999999e-05 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420052+0000", 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013025600000000001 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420263+0000", 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021196600000000001 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420649+0000", 2024-09-10T06:27:25.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038507 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.422366+0000", 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017172000000000001 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423048+0000", 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00068254100000000005 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423127+0000", 2024-09-10T06:27:25.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8207000000000005e-05 2024-09-10T06:27:25.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423197+0000", 2024-09-10T06:27:25.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0328999999999997e-05 2024-09-10T06:27:25.368 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.368 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.368 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.368 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.368 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:25.368 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.908020450000002, 2024-09-10T06:27:25.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003575235, 2024-09-10T06:27:25.369 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.369 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.369 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.369 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.369 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.369 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.369 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 299 2024-09-10T06:27:25.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.369 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:25.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436461+0000", 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.144e-06 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436466+0000", 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8409999999999999e-06 2024-09-10T06:27:25.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436477+0000", 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1253000000000001e-05 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436483+0000", 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7010000000000001e-06 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436527+0000", 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4381000000000001e-05 2024-09-10T06:27:25.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436569+0000", 2024-09-10T06:27:25.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2208e-05 2024-09-10T06:27:25.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:25.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436687+0000", 2024-09-10T06:27:25.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118093 2024-09-10T06:27:25.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.437455+0000", 2024-09-10T06:27:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076799599999999996 2024-09-10T06:27:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439950+0000", 2024-09-10T06:27:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024946040000000001 2024-09-10T06:27:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439988+0000", 2024-09-10T06:27:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8405999999999998e-05 2024-09-10T06:27:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.440035+0000", 2024-09-10T06:27:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6607999999999998e-05 2024-09-10T06:27:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.573344368000001, 2024-09-10T06:27:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028833040000000002, 2024-09-10T06:27:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 742 2024-09-10T06:27:25.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771139+0000", 2024-09-10T06:27:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5269999999999999e-06 2024-09-10T06:27:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771153+0000", 2024-09-10T06:27:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4036000000000001e-05 2024-09-10T06:27:25.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771186+0000", 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2113000000000002e-05 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771201+0000", 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771320+0000", 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119265 2024-09-10T06:27:25.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771557+0000", 2024-09-10T06:27:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023640600000000001 2024-09-10T06:27:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771890+0000", 2024-09-10T06:27:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033302000000000001 2024-09-10T06:27:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773204+0000", 2024-09-10T06:27:25.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013142239999999999 2024-09-10T06:27:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773864+0000", 2024-09-10T06:27:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066005100000000004 2024-09-10T06:27:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773948+0000", 2024-09-10T06:27:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4625999999999999e-05 2024-09-10T06:27:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774019+0000", 2024-09-10T06:27:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0705999999999997e-05 2024-09-10T06:27:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.569565118, 2024-09-10T06:27:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025263479999999999, 2024-09-10T06:27:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.381 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 744 2024-09-10T06:27:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774917+0000", 2024-09-10T06:27:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0540000000000002e-06 2024-09-10T06:27:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774926+0000", 2024-09-10T06:27:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5660000000000007e-06 2024-09-10T06:27:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774947+0000", 2024-09-10T06:27:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0852999999999998e-05 2024-09-10T06:27:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774958+0000", 2024-09-10T06:27:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1216999999999999e-05 2024-09-10T06:27:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775045+0000", 2024-09-10T06:27:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7643000000000001e-05 2024-09-10T06:27:25.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775167+0000", 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012163900000000001 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775427+0000", 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000259678 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.776736+0000", 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013093429999999999 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777296+0000", 2024-09-10T06:27:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056029599999999995 2024-09-10T06:27:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777374+0000", 2024-09-10T06:27:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7721999999999999e-05 2024-09-10T06:27:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777441+0000", 2024-09-10T06:27:25.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7336999999999996e-05 2024-09-10T06:27:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.532249571999998, 2024-09-10T06:27:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036412979999999998, 2024-09-10T06:27:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.387 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 760 2024-09-10T06:27:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:25.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812233+0000", 2024-09-10T06:27:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812244+0000", 2024-09-10T06:27:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1273e-05 2024-09-10T06:27:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812276+0000", 2024-09-10T06:27:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1253e-05 2024-09-10T06:27:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812290+0000", 2024-09-10T06:27:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4576000000000001e-05 2024-09-10T06:27:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812438+0000", 2024-09-10T06:27:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014775899999999999 2024-09-10T06:27:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812821+0000", 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000383187 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.813398+0000", 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000576619 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.814658+0000", 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001260207 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815591+0000", 2024-09-10T06:27:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00093332899999999999 2024-09-10T06:27:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815745+0000", 2024-09-10T06:27:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153392 2024-09-10T06:27:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815872+0000", 2024-09-10T06:27:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012715599999999999 2024-09-10T06:27:25.392 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.527614188000001, 2024-09-10T06:27:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029417369999999998, 2024-09-10T06:27:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.393 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 762 2024-09-10T06:27:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816868+0000", 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.283e-06 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816879+0000", 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0523000000000001e-05 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816910+0000", 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0732999999999999e-05 2024-09-10T06:27:25.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816926+0000", 2024-09-10T06:27:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.677e-05 2024-09-10T06:27:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817058+0000", 2024-09-10T06:27:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013195599999999999 2024-09-10T06:27:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817299+0000", 2024-09-10T06:27:25.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000241091 2024-09-10T06:27:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817761+0000", 2024-09-10T06:27:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046188400000000003 2024-09-10T06:27:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.818948+0000", 2024-09-10T06:27:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:25.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819662+0000", 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071398399999999997 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819745+0000", 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3560000000000006e-05 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819808+0000", 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2329000000000006e-05 2024-09-10T06:27:25.398 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.407153471000001, 2024-09-10T06:27:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002834175, 2024-09-10T06:27:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.399 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 817 2024-09-10T06:27:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:25.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937330+0000", 2024-09-10T06:27:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9869999999999999e-06 2024-09-10T06:27:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937342+0000", 2024-09-10T06:27:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2595999999999999e-05 2024-09-10T06:27:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937375+0000", 2024-09-10T06:27:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2320000000000002e-05 2024-09-10T06:27:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937390+0000", 2024-09-10T06:27:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4977000000000001e-05 2024-09-10T06:27:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937529+0000", 2024-09-10T06:27:25.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013937199999999999 2024-09-10T06:27:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937753+0000", 2024-09-10T06:27:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000224358 2024-09-10T06:27:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.938061+0000", 2024-09-10T06:27:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030808799999999998 2024-09-10T06:27:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.939112+0000", 2024-09-10T06:27:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010503050000000001 2024-09-10T06:27:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940005+0000", 2024-09-10T06:27:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089366599999999999 2024-09-10T06:27:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940093+0000", 2024-09-10T06:27:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8053000000000006e-05 2024-09-10T06:27:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940161+0000", 2024-09-10T06:27:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7453000000000006e-05 2024-09-10T06:27:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.354225429000003, 2024-09-10T06:27:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027552649999999998, 2024-09-10T06:27:25.405 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 841 2024-09-10T06:27:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990257+0000", 2024-09-10T06:27:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6869999999999999e-06 2024-09-10T06:27:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990270+0000", 2024-09-10T06:27:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2843000000000001e-05 2024-09-10T06:27:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990300+0000", 2024-09-10T06:27:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9252999999999999e-05 2024-09-10T06:27:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990314+0000", 2024-09-10T06:27:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4796e-05 2024-09-10T06:27:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990427+0000", 2024-09-10T06:27:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112649 2024-09-10T06:27:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990671+0000", 2024-09-10T06:27:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244408 2024-09-10T06:27:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990987+0000", 2024-09-10T06:27:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031593099999999998 2024-09-10T06:27:25.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992073+0000", 2024-09-10T06:27:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010854549999999999 2024-09-10T06:27:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992862+0000", 2024-09-10T06:27:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00078889400000000005 2024-09-10T06:27:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992944+0000", 2024-09-10T06:27:25.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2152999999999998e-05 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993010+0000", 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6196000000000001e-05 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.350489494999998, 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025373539999999999, 2024-09-10T06:27:25.411 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 843 2024-09-10T06:27:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993993+0000", 2024-09-10T06:27:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3630000000000001e-06 2024-09-10T06:27:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994004+0000", 2024-09-10T06:27:25.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0557000000000001e-05 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994035+0000", 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0969000000000001e-05 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994055+0000", 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0497e-05 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994150+0000", 2024-09-10T06:27:25.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5363000000000002e-05 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994275+0000", 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012453200000000001 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994570+0000", 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029522100000000003 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.995569+0000", 2024-09-10T06:27:25.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00099913200000000001 2024-09-10T06:27:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996384+0000", 2024-09-10T06:27:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081451099999999997 2024-09-10T06:27:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996462+0000", 2024-09-10T06:27:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8502000000000002e-05 2024-09-10T06:27:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996528+0000", 2024-09-10T06:27:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5707e-05 2024-09-10T06:27:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.341042348000002, 2024-09-10T06:27:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033145539999999999, 2024-09-10T06:27:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.417 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 847 2024-09-10T06:27:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:25.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003440+0000", 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5299999999999999e-06 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003452+0000", 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003482+0000", 2024-09-10T06:27:25.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0790000000000002e-05 2024-09-10T06:27:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003497+0000", 2024-09-10T06:27:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.489e-05 2024-09-10T06:27:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003645+0000", 2024-09-10T06:27:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014771900000000001 2024-09-10T06:27:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003996+0000", 2024-09-10T06:27:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000350861 2024-09-10T06:27:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.004540+0000", 2024-09-10T06:27:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054383199999999995 2024-09-10T06:27:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.005831+0000", 2024-09-10T06:27:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001291366 2024-09-10T06:27:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006461+0000", 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062943899999999998 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006631+0000", 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000170228 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006752+0000", 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012160899999999999 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.422 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.336789181, 2024-09-10T06:27:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002619953, 2024-09-10T06:27:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 849 2024-09-10T06:27:25.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007693+0000", 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3099999999999999e-06 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007704+0000", 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0387000000000001e-05 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007734+0000", 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0676000000000002e-05 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007753+0000", 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.836e-05 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007857+0000", 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103836 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007980+0000", 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123843 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:25.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.008241+0000", 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026085799999999999 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.009475+0000", 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012340230000000001 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010168+0000", 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00069220800000000004 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010247+0000", 2024-09-10T06:27:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9929e-05 2024-09-10T06:27:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010311+0000", 2024-09-10T06:27:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3522999999999995e-05 2024-09-10T06:27:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:25.428 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.292309359999997, 2024-09-10T06:27:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026646590000000002, 2024-09-10T06:27:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 868 2024-09-10T06:27:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:25.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052173+0000", 2024-09-10T06:27:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-10T06:27:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052186+0000", 2024-09-10T06:27:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2787e-05 2024-09-10T06:27:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052216+0000", 2024-09-10T06:27:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9618999999999999e-05 2024-09-10T06:27:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052231+0000", 2024-09-10T06:27:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4929999999999999e-05 2024-09-10T06:27:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052349+0000", 2024-09-10T06:27:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011830200000000001 2024-09-10T06:27:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052561+0000", 2024-09-10T06:27:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000212182 2024-09-10T06:27:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052874+0000", 2024-09-10T06:27:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031299399999999998 2024-09-10T06:27:25.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054049+0000", 2024-09-10T06:27:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174825 2024-09-10T06:27:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054635+0000", 2024-09-10T06:27:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058643900000000001 2024-09-10T06:27:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054721+0000", 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5185999999999994e-05 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054836+0000", 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114922 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:25.434 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.205653259000002, 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028453739999999999, 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 907 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138830+0000", 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8600000000000001e-06 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138842+0000", 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2126e-05 2024-09-10T06:27:25.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138874+0000", 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2047e-05 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138889+0000", 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4966999999999999e-05 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139007+0000", 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118479 2024-09-10T06:27:25.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139238+0000", 2024-09-10T06:27:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023031399999999999 2024-09-10T06:27:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139566+0000", 2024-09-10T06:27:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032816099999999999 2024-09-10T06:27:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.140631+0000", 2024-09-10T06:27:25.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010653679999999999 2024-09-10T06:27:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141393+0000", 2024-09-10T06:27:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076187100000000001 2024-09-10T06:27:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141561+0000", 2024-09-10T06:27:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016755599999999999 2024-09-10T06:27:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141672+0000", 2024-09-10T06:27:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111625 2024-09-10T06:27:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.201729743000001, 2024-09-10T06:27:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002857268, 2024-09-10T06:27:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.440 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 909 2024-09-10T06:27:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142753+0000", 2024-09-10T06:27:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4040000000000002e-06 2024-09-10T06:27:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142764+0000", 2024-09-10T06:27:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0789e-05 2024-09-10T06:27:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142795+0000", 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0982999999999998e-05 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142810+0000", 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4960000000000001e-05 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142908+0000", 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8726000000000003e-05 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143030+0000", 2024-09-10T06:27:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121649 2024-09-10T06:27:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143294+0000", 2024-09-10T06:27:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000263875 2024-09-10T06:27:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.144530+0000", 2024-09-10T06:27:25.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001236067 2024-09-10T06:27:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145340+0000", 2024-09-10T06:27:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080966700000000003 2024-09-10T06:27:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145497+0000", 2024-09-10T06:27:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015773499999999999 2024-09-10T06:27:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145608+0000", 2024-09-10T06:27:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110413 2024-09-10T06:27:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.108032246, 2024-09-10T06:27:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029166940000000001, 2024-09-10T06:27:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.446 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 949 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236451+0000", 2024-09-10T06:27:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:27:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236464+0000", 2024-09-10T06:27:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3223e-05 2024-09-10T06:27:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236497+0000", 2024-09-10T06:27:25.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2672999999999997e-05 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236515+0000", 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8386999999999999e-05 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236636+0000", 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120752 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236857+0000", 2024-09-10T06:27:25.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022134499999999999 2024-09-10T06:27:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.237188+0000", 2024-09-10T06:27:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033057799999999999 2024-09-10T06:27:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.238353+0000", 2024-09-10T06:27:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001164841 2024-09-10T06:27:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239160+0000", 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080743000000000004 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239245+0000", 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5189e-05 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239365+0000", 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119406 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.104171139000002, 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025033970000000001, 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 951 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240311+0000", 2024-09-10T06:27:25.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8899999999999999e-06 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240320+0000", 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6799999999999999e-06 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240341+0000", 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1379e-05 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240352+0000", 2024-09-10T06:27:25.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1354e-05 2024-09-10T06:27:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240450+0000", 2024-09-10T06:27:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7866000000000001e-05 2024-09-10T06:27:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240580+0000", 2024-09-10T06:27:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012970899999999999 2024-09-10T06:27:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:25.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240851+0000", 2024-09-10T06:27:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027059099999999998 2024-09-10T06:27:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242052+0000", 2024-09-10T06:27:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001201014 2024-09-10T06:27:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242662+0000", 2024-09-10T06:27:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061076800000000003 2024-09-10T06:27:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242747+0000", 2024-09-10T06:27:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5019999999999996e-05 2024-09-10T06:27:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242812+0000", 2024-09-10T06:27:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5126e-05 2024-09-10T06:27:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 43.093721719999998, 2024-09-10T06:27:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027897120000000002, 2024-09-10T06:27:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:25.458 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 955 2024-09-10T06:27:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250761+0000", 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250772+0000", 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1153e-05 2024-09-10T06:27:25.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250802+0000", 2024-09-10T06:27:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-05 2024-09-10T06:27:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250817+0000", 2024-09-10T06:27:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4883e-05 2024-09-10T06:27:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250925+0000", 2024-09-10T06:27:25.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108249 2024-09-10T06:27:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251139+0000", 2024-09-10T06:27:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000213568 2024-09-10T06:27:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251450+0000", 2024-09-10T06:27:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031139200000000002 2024-09-10T06:27:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.252574+0000", 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011239139999999999 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253377+0000", 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080306400000000003 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253466+0000", 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8436000000000005e-05 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:25.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253548+0000", 2024-09-10T06:27:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2496000000000004e-05 2024-09-10T06:27:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:25.465 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:25.465 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:25.466 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:27:25.467 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:25.461+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:25.550 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.5 to 1 (10000) 2024-09-10T06:27:25.562 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T06:27:25.568 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:25.565+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:25.578 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-10T06:27:25.668 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:25.668 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:25.874 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:25.874 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:25.875 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:25.669+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:25.876 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:27:25.877 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:25.873+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:25.976 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:25.977+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:26.076 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:26.073+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:26.086 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:26.086 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:26.086 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:26.086 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:26.086 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:26.105 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:27:26.193 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:26.193+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:26.278 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:26.277+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:26.320 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:26.320 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.994450409999999, 2024-09-10T06:27:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030326279999999999, 2024-09-10T06:27:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 58 2024-09-10T06:27:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.321 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:26.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-10T06:27:26.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324169+0000", 2024-09-10T06:27:26.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9020000000000004e-06 2024-09-10T06:27:26.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.323 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324182+0000", 2024-09-10T06:27:26.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2166e-05 2024-09-10T06:27:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324190+0000", 2024-09-10T06:27:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.337e-06 2024-09-10T06:27:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324282+0000", 2024-09-10T06:27:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2331999999999996e-05 2024-09-10T06:27:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324486+0000", 2024-09-10T06:27:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020347400000000001 2024-09-10T06:27:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324719+0000", 2024-09-10T06:27:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023289900000000001 2024-09-10T06:27:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.325993+0000", 2024-09-10T06:27:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012746929999999999 2024-09-10T06:27:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327088+0000", 2024-09-10T06:27:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010947330000000001 2024-09-10T06:27:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327147+0000", 2024-09-10T06:27:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8677000000000001e-05 2024-09-10T06:27:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327195+0000", 2024-09-10T06:27:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8469e-05 2024-09-10T06:27:26.326 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 45.012629828000001, 2024-09-10T06:27:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003846917, 2024-09-10T06:27:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.327 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 207 2024-09-10T06:27:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305987+0000", 2024-09-10T06:27:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6069999999999999e-06 2024-09-10T06:27:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306002+0000", 2024-09-10T06:27:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5406000000000001e-05 2024-09-10T06:27:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306036+0000", 2024-09-10T06:27:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4146000000000001e-05 2024-09-10T06:27:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306061+0000", 2024-09-10T06:27:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4470000000000001e-05 2024-09-10T06:27:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306325+0000", 2024-09-10T06:27:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026382800000000002 2024-09-10T06:27:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306569+0000", 2024-09-10T06:27:26.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024445499999999998 2024-09-10T06:27:26.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:26.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.307017+0000", 2024-09-10T06:27:26.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044774000000000002 2024-09-10T06:27:26.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.308517+0000", 2024-09-10T06:27:26.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001500075 2024-09-10T06:27:26.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309685+0000", 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001168505 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309767+0000", 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1992999999999999e-05 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309830+0000", 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2692000000000002e-05 2024-09-10T06:27:26.332 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.333 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.333 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.333 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.333 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:26.333 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.968377779999997, 2024-09-10T06:27:26.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003433888, 2024-09-10T06:27:26.333 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.333 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.334 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.334 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.334 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 216 2024-09-10T06:27:26.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.334 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:26.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:26.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350239+0000", 2024-09-10T06:27:26.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.377e-06 2024-09-10T06:27:26.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350254+0000", 2024-09-10T06:27:26.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.501e-05 2024-09-10T06:27:26.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350288+0000", 2024-09-10T06:27:26.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4746000000000002e-05 2024-09-10T06:27:26.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350312+0000", 2024-09-10T06:27:26.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3249999999999999e-05 2024-09-10T06:27:26.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350456+0000", 2024-09-10T06:27:26.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014483899999999999 2024-09-10T06:27:26.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350704+0000", 2024-09-10T06:27:26.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024719100000000001 2024-09-10T06:27:26.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:26.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.351117+0000", 2024-09-10T06:27:26.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000412934 2024-09-10T06:27:26.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.352644+0000", 2024-09-10T06:27:26.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015271079999999999 2024-09-10T06:27:26.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353397+0000", 2024-09-10T06:27:26.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075311799999999999 2024-09-10T06:27:26.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353556+0000", 2024-09-10T06:27:26.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159612 2024-09-10T06:27:26.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353669+0000", 2024-09-10T06:27:26.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011270299999999999 2024-09-10T06:27:26.339 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.340 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.340 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.340 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.340 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:26.340 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.929698318, 2024-09-10T06:27:26.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033447479999999998, 2024-09-10T06:27:26.340 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.340 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.340 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.340 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.340 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.341 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.341 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 227 2024-09-10T06:27:26.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.341 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:26.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:26.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388917+0000", 2024-09-10T06:27:26.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6900000000000001e-06 2024-09-10T06:27:26.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388931+0000", 2024-09-10T06:27:26.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3900000000000001e-05 2024-09-10T06:27:26.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388964+0000", 2024-09-10T06:27:26.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2985999999999999e-05 2024-09-10T06:27:26.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388980+0000", 2024-09-10T06:27:26.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.535e-05 2024-09-10T06:27:26.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389123+0000", 2024-09-10T06:27:26.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014337900000000001 2024-09-10T06:27:26.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389341+0000", 2024-09-10T06:27:26.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021765099999999999 2024-09-10T06:27:26.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:26.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389765+0000", 2024-09-10T06:27:26.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042423100000000001 2024-09-10T06:27:26.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.391433+0000", 2024-09-10T06:27:26.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016681000000000001 2024-09-10T06:27:26.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392104+0000", 2024-09-10T06:27:26.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067064800000000003 2024-09-10T06:27:26.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392191+0000", 2024-09-10T06:27:26.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7912999999999997e-05 2024-09-10T06:27:26.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392259+0000", 2024-09-10T06:27:26.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7899999999999997e-05 2024-09-10T06:27:26.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.922441544000002, 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029995500000000001, 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.346 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 229 2024-09-10T06:27:26.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.347 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:26.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:26.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396174+0000", 2024-09-10T06:27:26.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.774e-06 2024-09-10T06:27:26.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396186+0000", 2024-09-10T06:27:26.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2055999999999999e-05 2024-09-10T06:27:26.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396216+0000", 2024-09-10T06:27:26.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9640000000000001e-05 2024-09-10T06:27:26.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396231+0000", 2024-09-10T06:27:26.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:26.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396356+0000", 2024-09-10T06:27:26.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012504500000000001 2024-09-10T06:27:26.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396568+0000", 2024-09-10T06:27:26.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000211709 2024-09-10T06:27:26.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:26.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396954+0000", 2024-09-10T06:27:26.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386027 2024-09-10T06:27:26.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.398287+0000", 2024-09-10T06:27:26.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013331560000000001 2024-09-10T06:27:26.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399004+0000", 2024-09-10T06:27:26.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071720499999999995 2024-09-10T06:27:26.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399091+0000", 2024-09-10T06:27:26.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6714999999999999e-05 2024-09-10T06:27:26.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399171+0000", 2024-09-10T06:27:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9893000000000002e-05 2024-09-10T06:27:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.915882975000002, 2024-09-10T06:27:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030468270000000002, 2024-09-10T06:27:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.352 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.353 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.353 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.353 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 231 2024-09-10T06:27:26.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.353 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:26.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:26.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402732+0000", 2024-09-10T06:27:26.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-06 2024-09-10T06:27:26.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402744+0000", 2024-09-10T06:27:26.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1633e-05 2024-09-10T06:27:26.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402774+0000", 2024-09-10T06:27:26.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9666999999999999e-05 2024-09-10T06:27:26.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402789+0000", 2024-09-10T06:27:26.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5466000000000001e-05 2024-09-10T06:27:26.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402904+0000", 2024-09-10T06:27:26.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114466 2024-09-10T06:27:26.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403119+0000", 2024-09-10T06:27:26.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215572 2024-09-10T06:27:26.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:26.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403516+0000", 2024-09-10T06:27:26.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039663300000000002 2024-09-10T06:27:26.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405012+0000", 2024-09-10T06:27:26.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014961919999999999 2024-09-10T06:27:26.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405634+0000", 2024-09-10T06:27:26.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062145199999999999 2024-09-10T06:27:26.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405715+0000", 2024-09-10T06:27:26.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1619000000000006e-05 2024-09-10T06:27:26.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405777+0000", 2024-09-10T06:27:26.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1639999999999999e-05 2024-09-10T06:27:26.361 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.361 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.361 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.361 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:377 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.361 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:26.361 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.857127644000002, 2024-09-10T06:27:26.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058485480000000003, 2024-09-10T06:27:26.361 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.361 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.361 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.361 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.361 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.362 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.362 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 377 2024-09-10T06:27:26.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.362 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:26.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:26.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461486+0000", 2024-09-10T06:27:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0720000000000001e-06 2024-09-10T06:27:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461504+0000", 2024-09-10T06:27:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8002000000000001e-05 2024-09-10T06:27:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461519+0000", 2024-09-10T06:27:26.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4584e-05 2024-09-10T06:27:26.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461526+0000", 2024-09-10T06:27:26.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5560000000000004e-06 2024-09-10T06:27:26.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461597+0000", 2024-09-10T06:27:26.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1311999999999998e-05 2024-09-10T06:27:26.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461709+0000", 2024-09-10T06:27:26.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011191100000000001 2024-09-10T06:27:26.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:26.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461871+0000", 2024-09-10T06:27:26.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016254900000000001 2024-09-10T06:27:26.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.462777+0000", 2024-09-10T06:27:26.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00090547100000000003 2024-09-10T06:27:26.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467265+0000", 2024-09-10T06:27:26.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004488222 2024-09-10T06:27:26.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467308+0000", 2024-09-10T06:27:26.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2975000000000001e-05 2024-09-10T06:27:26.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.367 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467334+0000", 2024-09-10T06:27:26.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5894e-05 2024-09-10T06:27:26.367 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.367 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.367 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.367 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:384 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.367 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:26.367 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.854994789000003, 2024-09-10T06:27:26.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031588900000000001, 2024-09-10T06:27:26.367 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.367 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.367 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.368 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.368 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.368 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.368 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 384 2024-09-10T06:27:26.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.368 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:26.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:26.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463620+0000", 2024-09-10T06:27:26.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:26.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463625+0000", 2024-09-10T06:27:26.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6450000000000002e-06 2024-09-10T06:27:26.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463639+0000", 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3540000000000001e-05 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463648+0000", 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0259999999999996e-06 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463713+0000", 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5438000000000006e-05 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463774+0000", 2024-09-10T06:27:26.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0582999999999999e-05 2024-09-10T06:27:26.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:26.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463899+0000", 2024-09-10T06:27:26.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-10T06:27:26.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.464371+0000", 2024-09-10T06:27:26.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047201600000000002 2024-09-10T06:27:26.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466707+0000", 2024-09-10T06:27:26.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023354999999999999 2024-09-10T06:27:26.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466742+0000", 2024-09-10T06:27:26.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4686e-05 2024-09-10T06:27:26.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.372 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.372 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466777+0000", 2024-09-10T06:27:26.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5537000000000002e-05 2024-09-10T06:27:26.373 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.373 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.373 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.373 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:436 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.373 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:26.373 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.839747742, 2024-09-10T06:27:26.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040690570000000001, 2024-09-10T06:27:26.373 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.373 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.374 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.374 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.374 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 436 2024-09-10T06:27:26.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.374 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:26.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478866+0000", 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1960000000000001e-06 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478871+0000", 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6879999999999998e-06 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478883+0000", 2024-09-10T06:27:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1790999999999999e-05 2024-09-10T06:27:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478890+0000", 2024-09-10T06:27:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8569999999999997e-06 2024-09-10T06:27:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478958+0000", 2024-09-10T06:27:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7774999999999994e-05 2024-09-10T06:27:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479072+0000", 2024-09-10T06:27:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114577 2024-09-10T06:27:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479255+0000", 2024-09-10T06:27:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018297300000000001 2024-09-10T06:27:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482448+0000", 2024-09-10T06:27:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031933389999999999 2024-09-10T06:27:26.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482828+0000", 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037961800000000002 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482891+0000", 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3316000000000002e-05 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482934+0000", 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2926999999999997e-05 2024-09-10T06:27:26.378 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.379 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.379 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.379 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:441 6.7 e34/28 6:e1cdb60d:reshard::reshard.0000000008:head v 34'7, mlcod=34'5)", 2024-09-10T06:27:26.379 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:26.379 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.836146823999997, 2024-09-10T06:27:26.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060368319999999998, 2024-09-10T06:27:26.379 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.379 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.379 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.379 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:26.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:26.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482467+0000", 2024-09-10T06:27:26.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8800000000000003e-07 2024-09-10T06:27:26.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482472+0000", 2024-09-10T06:27:26.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8730000000000004e-06 2024-09-10T06:27:26.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482481+0000", 2024-09-10T06:27:26.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1980000000000001e-06 2024-09-10T06:27:26.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482485+0000", 2024-09-10T06:27:26.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.386e-06 2024-09-10T06:27:26.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482541+0000", 2024-09-10T06:27:26.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5788000000000002e-05 2024-09-10T06:27:26.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482563+0000", 2024-09-10T06:27:26.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2303999999999999e-05 2024-09-10T06:27:26.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488465+0000", 2024-09-10T06:27:26.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059014810000000001 2024-09-10T06:27:26.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488503+0000", 2024-09-10T06:27:26.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8313999999999999e-05 2024-09-10T06:27:26.383 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.383 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.383 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.383 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:466 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.383 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:26.384 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.820987574, 2024-09-10T06:27:26.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039032810000000002, 2024-09-10T06:27:26.384 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.384 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.384 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.384 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.384 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.384 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.384 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 466 2024-09-10T06:27:26.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.384 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:26.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:26.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497626+0000", 2024-09-10T06:27:26.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9099999999999991e-07 2024-09-10T06:27:26.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497634+0000", 2024-09-10T06:27:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.994e-06 2024-09-10T06:27:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497644+0000", 2024-09-10T06:27:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6260000000000007e-06 2024-09-10T06:27:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497650+0000", 2024-09-10T06:27:26.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5160000000000002e-06 2024-09-10T06:27:26.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497718+0000", 2024-09-10T06:27:26.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8862999999999994e-05 2024-09-10T06:27:26.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497775+0000", 2024-09-10T06:27:26.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6156000000000002e-05 2024-09-10T06:27:26.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:26.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497903+0000", 2024-09-10T06:27:26.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012879800000000001 2024-09-10T06:27:26.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499630+0000", 2024-09-10T06:27:26.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017268139999999999 2024-09-10T06:27:26.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501439+0000", 2024-09-10T06:27:26.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018086669999999999 2024-09-10T06:27:26.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501478+0000", 2024-09-10T06:27:26.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9269e-05 2024-09-10T06:27:26.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501529+0000", 2024-09-10T06:27:26.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0587000000000002e-05 2024-09-10T06:27:26.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.389 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.389 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.389 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:469 6.0 e34/28 6:02683654:reshard::reshard.0000000010:head v 34'6, mlcod=34'4)", 2024-09-10T06:27:26.389 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.818984751000002, 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048323109999999997, 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:26.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499629+0000", 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9199999999999999e-07 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499634+0000", 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2530000000000004e-06 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499644+0000", 2024-09-10T06:27:26.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5820000000000008e-06 2024-09-10T06:27:26.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499650+0000", 2024-09-10T06:27:26.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7919999999999998e-06 2024-09-10T06:27:26.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499697+0000", 2024-09-10T06:27:26.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7564000000000001e-05 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499719+0000", 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1297999999999998e-05 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504413+0000", 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004694419 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504461+0000", 2024-09-10T06:27:26.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7511e-05 2024-09-10T06:27:26.394 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.394 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.394 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.394 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:621 6.0 e34/28 6:0705c68b:::obj_delete_at_hint.0000000028:head v 34'11, mlcod=34'9)", 2024-09-10T06:27:26.394 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:26.394 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.713783606, 2024-09-10T06:27:26.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003196562, 2024-09-10T06:27:26.394 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.394 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.394 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.394 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:26.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:26.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604831+0000", 2024-09-10T06:27:26.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.823e-06 2024-09-10T06:27:26.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604843+0000", 2024-09-10T06:27:26.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1437000000000001e-05 2024-09-10T06:27:26.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604868+0000", 2024-09-10T06:27:26.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5837e-05 2024-09-10T06:27:26.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604885+0000", 2024-09-10T06:27:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6759999999999999e-05 2024-09-10T06:27:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604971+0000", 2024-09-10T06:27:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5512000000000004e-05 2024-09-10T06:27:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604991+0000", 2024-09-10T06:27:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0197999999999999e-05 2024-09-10T06:27:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.607960+0000", 2024-09-10T06:27:26.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002969307 2024-09-10T06:27:26.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608026+0000", 2024-09-10T06:27:26.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5687999999999999e-05 2024-09-10T06:27:26.398 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.398 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.398 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.399 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:636 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.399 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:26.399 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.704873952, 2024-09-10T06:27:26.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048306950000000003, 2024-09-10T06:27:26.399 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.399 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.399 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.399 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.399 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.400 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.400 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 636 2024-09-10T06:27:26.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.400 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:26.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:26.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613740+0000", 2024-09-10T06:27:26.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:26.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613747+0000", 2024-09-10T06:27:26.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8090000000000004e-06 2024-09-10T06:27:26.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613762+0000", 2024-09-10T06:27:26.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5037e-05 2024-09-10T06:27:26.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613772+0000", 2024-09-10T06:27:26.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7510000000000003e-06 2024-09-10T06:27:26.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613834+0000", 2024-09-10T06:27:26.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2458000000000004e-05 2024-09-10T06:27:26.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613916+0000", 2024-09-10T06:27:26.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1630000000000003e-05 2024-09-10T06:27:26.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:26.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.614071+0000", 2024-09-10T06:27:26.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015480800000000001 2024-09-10T06:27:26.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.615885+0000", 2024-09-10T06:27:26.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001814607 2024-09-10T06:27:26.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618438+0000", 2024-09-10T06:27:26.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025529459999999999 2024-09-10T06:27:26.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618503+0000", 2024-09-10T06:27:26.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4851000000000006e-05 2024-09-10T06:27:26.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618570+0000", 2024-09-10T06:27:26.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6418e-05 2024-09-10T06:27:26.407 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.408 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.408 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.408 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:646 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.408 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:26.408 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.695412161999997, 2024-09-10T06:27:26.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049103549999999999, 2024-09-10T06:27:26.408 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.409 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.409 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.409 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 646 2024-09-10T06:27:26.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.409 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:26.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:26.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623202+0000", 2024-09-10T06:27:26.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9800000000000002e-07 2024-09-10T06:27:26.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623206+0000", 2024-09-10T06:27:26.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6380000000000003e-06 2024-09-10T06:27:26.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623216+0000", 2024-09-10T06:27:26.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4439999999999997e-06 2024-09-10T06:27:26.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623221+0000", 2024-09-10T06:27:26.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6400000000000002e-06 2024-09-10T06:27:26.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623300+0000", 2024-09-10T06:27:26.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8677999999999994e-05 2024-09-10T06:27:26.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623410+0000", 2024-09-10T06:27:26.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010954399999999999 2024-09-10T06:27:26.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623629+0000", 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000219836 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.625072+0000", 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014427929999999999 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.627982+0000", 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029097620000000002 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628058+0000", 2024-09-10T06:27:26.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6390999999999994e-05 2024-09-10T06:27:26.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628111+0000", 2024-09-10T06:27:26.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2731e-05 2024-09-10T06:27:26.415 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.415 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.415 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.415 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.416 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:26.416 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.632737890000001, 2024-09-10T06:27:26.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033783509999999999, 2024-09-10T06:27:26.416 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.416 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.416 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.416 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 703 2024-09-10T06:27:26.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.417 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:26.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:26.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685878+0000", 2024-09-10T06:27:26.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5900000000000002e-06 2024-09-10T06:27:26.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685889+0000", 2024-09-10T06:27:26.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:26.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685919+0000", 2024-09-10T06:27:26.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0307e-05 2024-09-10T06:27:26.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685935+0000", 2024-09-10T06:27:26.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5336e-05 2024-09-10T06:27:26.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686092+0000", 2024-09-10T06:27:26.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015776200000000001 2024-09-10T06:27:26.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686462+0000", 2024-09-10T06:27:26.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036925700000000001 2024-09-10T06:27:26.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:26.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.687048+0000", 2024-09-10T06:27:26.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000586266 2024-09-10T06:27:26.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688261+0000", 2024-09-10T06:27:26.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012132670000000001 2024-09-10T06:27:26.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688974+0000", 2024-09-10T06:27:26.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071248800000000005 2024-09-10T06:27:26.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689129+0000", 2024-09-10T06:27:26.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155499 2024-09-10T06:27:26.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689253+0000", 2024-09-10T06:27:26.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124289 2024-09-10T06:27:26.422 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.422 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.422 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.422 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.422 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:26.422 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.274172387, 2024-09-10T06:27:26.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032750980000000002, 2024-09-10T06:27:26.422 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.422 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.422 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.422 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.423 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.423 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 865 2024-09-10T06:27:26.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.423 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:26.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:26.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044443+0000", 2024-09-10T06:27:26.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6929999999999999e-06 2024-09-10T06:27:26.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044456+0000", 2024-09-10T06:27:26.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.224e-05 2024-09-10T06:27:26.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044486+0000", 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.095e-05 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044501+0000", 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4932999999999999e-05 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044646+0000", 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014465600000000001 2024-09-10T06:27:26.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045001+0000", 2024-09-10T06:27:26.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035473999999999998 2024-09-10T06:27:26.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:26.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045549+0000", 2024-09-10T06:27:26.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054870299999999999 2024-09-10T06:27:26.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.046956+0000", 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014061189999999999 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047452+0000", 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049682199999999995 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047606+0000", 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015379599999999999 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047716+0000", 2024-09-10T06:27:26.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109446 2024-09-10T06:27:26.428 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.428 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.428 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.428 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.428 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:26.428 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.269709235000001, 2024-09-10T06:27:26.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030837989999999999, 2024-09-10T06:27:26.428 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.428 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.428 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.429 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.429 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.429 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 867 2024-09-10T06:27:26.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.429 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:26.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:26.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048906+0000", 2024-09-10T06:27:26.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1770000000000001e-06 2024-09-10T06:27:26.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048916+0000", 2024-09-10T06:27:26.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.025e-05 2024-09-10T06:27:26.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048948+0000", 2024-09-10T06:27:26.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1859000000000001e-05 2024-09-10T06:27:26.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048968+0000", 2024-09-10T06:27:26.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9647e-05 2024-09-10T06:27:26.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049090+0000", 2024-09-10T06:27:26.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122645 2024-09-10T06:27:26.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049314+0000", 2024-09-10T06:27:26.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022372900000000001 2024-09-10T06:27:26.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:26.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049785+0000", 2024-09-10T06:27:26.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047121899999999999 2024-09-10T06:27:26.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.050979+0000", 2024-09-10T06:27:26.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001193408 2024-09-10T06:27:26.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051729+0000", 2024-09-10T06:27:26.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075039699999999998 2024-09-10T06:27:26.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051874+0000", 2024-09-10T06:27:26.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000145253 2024-09-10T06:27:26.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051988+0000", 2024-09-10T06:27:26.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011321500000000001 2024-09-10T06:27:26.435 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.435 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.435 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.435 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.435 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.200842053999999, 2024-09-10T06:27:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035511029999999999, 2024-09-10T06:27:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 898 2024-09-10T06:27:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:26.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:26.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117772+0000", 2024-09-10T06:27:26.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5340000000000001e-06 2024-09-10T06:27:26.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117781+0000", 2024-09-10T06:27:26.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.276e-06 2024-09-10T06:27:26.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117804+0000", 2024-09-10T06:27:26.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3093999999999999e-05 2024-09-10T06:27:26.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117816+0000", 2024-09-10T06:27:26.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1986e-05 2024-09-10T06:27:26.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117954+0000", 2024-09-10T06:27:26.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013856900000000001 2024-09-10T06:27:26.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118327+0000", 2024-09-10T06:27:26.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000372841 2024-09-10T06:27:26.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:26.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118919+0000", 2024-09-10T06:27:26.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059172800000000002 2024-09-10T06:27:26.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.120253+0000", 2024-09-10T06:27:26.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001333643 2024-09-10T06:27:26.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121060+0000", 2024-09-10T06:27:26.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080731100000000001 2024-09-10T06:27:26.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121210+0000", 2024-09-10T06:27:26.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014980500000000001 2024-09-10T06:27:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121322+0000", 2024-09-10T06:27:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112316 2024-09-10T06:27:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 44.111572242000001, 2024-09-10T06:27:26.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051838630000000004, 2024-09-10T06:27:26.442 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:26.442 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:26.442 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:26.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:26.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.442 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 937 2024-09-10T06:27:26.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.442 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:26.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:26.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:26.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:26.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:26.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:26.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:26.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207042+0000", 2024-09-10T06:27:26.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7439999999999999e-06 2024-09-10T06:27:26.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:26.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207051+0000", 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7299999999999994e-06 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207072+0000", 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1209e-05 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207089+0000", 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6297e-05 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:26.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207231+0000", 2024-09-10T06:27:26.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014233200000000001 2024-09-10T06:27:26.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:26.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207463+0000", 2024-09-10T06:27:26.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023155199999999999 2024-09-10T06:27:26.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:26.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207797+0000", 2024-09-10T06:27:26.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033413699999999998 2024-09-10T06:27:26.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:26.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.209053+0000", 2024-09-10T06:27:26.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012560029999999999 2024-09-10T06:27:26.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212076+0000", 2024-09-10T06:27:26.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030234239999999998 2024-09-10T06:27:26.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:26.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212162+0000", 2024-09-10T06:27:26.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5506000000000004e-05 2024-09-10T06:27:26.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:26.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:26.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:26.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212225+0000", 2024-09-10T06:27:26.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2928999999999993e-05 2024-09-10T06:27:26.447 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.447 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.447 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.447 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:26.447 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:26.447 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:26.448 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:27:26.449 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:26.449+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:26.549 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:26.549+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:26.565 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-10T06:27:26.575 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.6 to 1 (10000) 2024-09-10T06:27:26.582 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:26.582 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:26.598 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:27:26.606 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-10T06:27:26.650 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:26.645+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:26.722 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:26.722 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:26.722 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:26.737 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:27:26.751 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:26.749+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:26.852 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:26.849+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:26.901 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-10T06:27:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.609829456, 2024-09-10T06:27:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047108059999999997, 2024-09-10T06:27:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291391+0000", 2024-09-10T06:27:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8700000000000001e-06 2024-09-10T06:27:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291405+0000", 2024-09-10T06:27:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4623e-05 2024-09-10T06:27:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291438+0000", 2024-09-10T06:27:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2616000000000001e-05 2024-09-10T06:27:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291461+0000", 2024-09-10T06:27:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2883000000000001e-05 2024-09-10T06:27:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293024+0000", 2024-09-10T06:27:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015627709999999999 2024-09-10T06:27:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293071+0000", 2024-09-10T06:27:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7797000000000003e-05 2024-09-10T06:27:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295983+0000", 2024-09-10T06:27:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029113640000000001 2024-09-10T06:27:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296100+0000", 2024-09-10T06:27:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116882 2024-09-10T06:27:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.568471678000002, 2024-09-10T06:27:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00338296, 2024-09-10T06:27:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 211 2024-09-10T06:27:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332750+0000", 2024-09-10T06:27:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-10T06:27:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332767+0000", 2024-09-10T06:27:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.702e-05 2024-09-10T06:27:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332805+0000", 2024-09-10T06:27:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7950000000000001e-05 2024-09-10T06:27:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332824+0000", 2024-09-10T06:27:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8462999999999999e-05 2024-09-10T06:27:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332950+0000", 2024-09-10T06:27:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012653600000000001 2024-09-10T06:27:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333177+0000", 2024-09-10T06:27:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022626800000000001 2024-09-10T06:27:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333604+0000", 2024-09-10T06:27:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042759999999999999 2024-09-10T06:27:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335279+0000", 2024-09-10T06:27:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001674481 2024-09-10T06:27:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335976+0000", 2024-09-10T06:27:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069707099999999995 2024-09-10T06:27:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336063+0000", 2024-09-10T06:27:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6916000000000006e-05 2024-09-10T06:27:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336130+0000", 2024-09-10T06:27:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6971999999999995e-05 2024-09-10T06:27:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.495196802999999, 2024-09-10T06:27:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034123389999999999, 2024-09-10T06:27:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232 2024-09-10T06:27:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406025+0000", 2024-09-10T06:27:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-10T06:27:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406040+0000", 2024-09-10T06:27:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5299999999999999e-05 2024-09-10T06:27:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406072+0000", 2024-09-10T06:27:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2543000000000003e-05 2024-09-10T06:27:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406088+0000", 2024-09-10T06:27:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5699999999999999e-05 2024-09-10T06:27:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406206+0000", 2024-09-10T06:27:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011828900000000001 2024-09-10T06:27:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406416+0000", 2024-09-10T06:27:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020969900000000001 2024-09-10T06:27:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406804+0000", 2024-09-10T06:27:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038783699999999998 2024-09-10T06:27:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.408490+0000", 2024-09-10T06:27:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001686353 2024-09-10T06:27:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409152+0000", 2024-09-10T06:27:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066160800000000005 2024-09-10T06:27:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409314+0000", 2024-09-10T06:27:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000162285 2024-09-10T06:27:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409434+0000", 2024-09-10T06:27:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119639 2024-09-10T06:27:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.475267357999996, 2024-09-10T06:27:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034077650000000001, 2024-09-10T06:27:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241 2024-09-10T06:27:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425954+0000", 2024-09-10T06:27:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425965+0000", 2024-09-10T06:27:26.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.181e-05 2024-09-10T06:27:26.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425996+0000", 2024-09-10T06:27:26.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0759000000000001e-05 2024-09-10T06:27:26.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426011+0000", 2024-09-10T06:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4507e-05 2024-09-10T06:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426153+0000", 2024-09-10T06:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014206599999999999 2024-09-10T06:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426491+0000", 2024-09-10T06:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033830399999999999 2024-09-10T06:27:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426973+0000", 2024-09-10T06:27:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000482113 2024-09-10T06:27:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.428378+0000", 2024-09-10T06:27:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001404539 2024-09-10T06:27:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429113+0000", 2024-09-10T06:27:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073537799999999996 2024-09-10T06:27:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429251+0000", 2024-09-10T06:27:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013789600000000001 2024-09-10T06:27:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429359+0000", 2024-09-10T06:27:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107846 2024-09-10T06:27:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:266 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.470534334, 2024-09-10T06:27:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030966560000000001, 2024-09-10T06:27:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 266 2024-09-10T06:27:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430687+0000", 2024-09-10T06:27:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0299999999999998e-06 2024-09-10T06:27:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430702+0000", 2024-09-10T06:27:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5316999999999999e-05 2024-09-10T06:27:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430741+0000", 2024-09-10T06:27:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8336e-05 2024-09-10T06:27:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430762+0000", 2024-09-10T06:27:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.162e-05 2024-09-10T06:27:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430923+0000", 2024-09-10T06:27:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016044599999999999 2024-09-10T06:27:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431103+0000", 2024-09-10T06:27:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018030100000000001 2024-09-10T06:27:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431513+0000", 2024-09-10T06:27:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040992999999999997 2024-09-10T06:27:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432715+0000", 2024-09-10T06:27:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001202411 2024-09-10T06:27:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433624+0000", 2024-09-10T06:27:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090863000000000001 2024-09-10T06:27:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433718+0000", 2024-09-10T06:27:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3749e-05 2024-09-10T06:27:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433781+0000", 2024-09-10T06:27:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2885999999999994e-05 2024-09-10T06:27:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:273 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.468960733000003, 2024-09-10T06:27:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028009850000000002, 2024-09-10T06:27:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 273 2024-09-10T06:27:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432260+0000", 2024-09-10T06:27:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1900000000000002e-06 2024-09-10T06:27:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432271+0000", 2024-09-10T06:27:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1353e-05 2024-09-10T06:27:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432296+0000", 2024-09-10T06:27:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4817e-05 2024-09-10T06:27:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432318+0000", 2024-09-10T06:27:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1963e-05 2024-09-10T06:27:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432465+0000", 2024-09-10T06:27:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014658299999999999 2024-09-10T06:27:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432801+0000", 2024-09-10T06:27:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033681299999999999 2024-09-10T06:27:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433188+0000", 2024-09-10T06:27:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000386857 2024-09-10T06:27:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434552+0000", 2024-09-10T06:27:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013634400000000001 2024-09-10T06:27:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434872+0000", 2024-09-10T06:27:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031998399999999999 2024-09-10T06:27:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434973+0000", 2024-09-10T06:27:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100962 2024-09-10T06:27:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.435059+0000", 2024-09-10T06:27:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6023e-05 2024-09-10T06:27:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:299 6.14 e34/28 6:2c0c0c23:reshard::reshard.0000000001:head v 34'2, mlcod=0'0)", 2024-09-10T06:27:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.464344881999999, 2024-09-10T06:27:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029099109999999998, 2024-09-10T06:27:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436875+0000", 2024-09-10T06:27:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0430000000000002e-06 2024-09-10T06:27:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436890+0000", 2024-09-10T06:27:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4766999999999999e-05 2024-09-10T06:27:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436918+0000", 2024-09-10T06:27:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.76e-05 2024-09-10T06:27:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436937+0000", 2024-09-10T06:27:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9539999999999999e-05 2024-09-10T06:27:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437081+0000", 2024-09-10T06:27:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144065 2024-09-10T06:27:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437130+0000", 2024-09-10T06:27:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8609999999999997e-05 2024-09-10T06:27:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439676+0000", 2024-09-10T06:27:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002546137 2024-09-10T06:27:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439783+0000", 2024-09-10T06:27:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107149 2024-09-10T06:27:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:341 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.455425187000003, 2024-09-10T06:27:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030260230000000001, 2024-09-10T06:27:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 341 2024-09-10T06:27:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445796+0000", 2024-09-10T06:27:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7130000000000001e-06 2024-09-10T06:27:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445810+0000", 2024-09-10T06:27:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4564e-05 2024-09-10T06:27:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445886+0000", 2024-09-10T06:27:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5921999999999996e-05 2024-09-10T06:27:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445902+0000", 2024-09-10T06:27:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5800000000000001e-05 2024-09-10T06:27:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446057+0000", 2024-09-10T06:27:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015475600000000001 2024-09-10T06:27:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446347+0000", 2024-09-10T06:27:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029057699999999998 2024-09-10T06:27:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446669+0000", 2024-09-10T06:27:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032102399999999999 2024-09-10T06:27:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.447891+0000", 2024-09-10T06:27:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012226680000000001 2024-09-10T06:27:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448550+0000", 2024-09-10T06:27:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065925800000000002 2024-09-10T06:27:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448699+0000", 2024-09-10T06:27:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014831800000000001 2024-09-10T06:27:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448819+0000", 2024-09-10T06:27:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120423 2024-09-10T06:27:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:505 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.373746656999998, 2024-09-10T06:27:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028092249999999998, 2024-09-10T06:27:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 505 2024-09-10T06:27:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527474+0000", 2024-09-10T06:27:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-10T06:27:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527495+0000", 2024-09-10T06:27:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0910000000000001e-05 2024-09-10T06:27:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527549+0000", 2024-09-10T06:27:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3223000000000002e-05 2024-09-10T06:27:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527583+0000", 2024-09-10T06:27:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4773000000000001e-05 2024-09-10T06:27:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527737+0000", 2024-09-10T06:27:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325199999999999 2024-09-10T06:27:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528092+0000", 2024-09-10T06:27:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000354951 2024-09-10T06:27:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528657+0000", 2024-09-10T06:27:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00056537500000000001 2024-09-10T06:27:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.529771+0000", 2024-09-10T06:27:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011136519999999999 2024-09-10T06:27:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530072+0000", 2024-09-10T06:27:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030151700000000001 2024-09-10T06:27:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530213+0000", 2024-09-10T06:27:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014100500000000001 2024-09-10T06:27:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530281+0000", 2024-09-10T06:27:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7793999999999995e-05 2024-09-10T06:27:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.370077379999998, 2024-09-10T06:27:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051813969999999999, 2024-09-10T06:27:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 513 2024-09-10T06:27:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531143+0000", 2024-09-10T06:27:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7400000000000001e-06 2024-09-10T06:27:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531153+0000", 2024-09-10T06:27:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.815e-06 2024-09-10T06:27:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531178+0000", 2024-09-10T06:27:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5755e-05 2024-09-10T06:27:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531190+0000", 2024-09-10T06:27:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1250000000000001e-05 2024-09-10T06:27:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531322+0000", 2024-09-10T06:27:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013239299999999999 2024-09-10T06:27:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531550+0000", 2024-09-10T06:27:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000227598 2024-09-10T06:27:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531966+0000", 2024-09-10T06:27:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041634400000000002 2024-09-10T06:27:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533197+0000", 2024-09-10T06:27:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012308810000000001 2024-09-10T06:27:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536097+0000", 2024-09-10T06:27:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029007159999999998 2024-09-10T06:27:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536245+0000", 2024-09-10T06:27:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000147816 2024-09-10T06:27:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536322+0000", 2024-09-10T06:27:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7088999999999993e-05 2024-09-10T06:27:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:514 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.370005183000004, 2024-09-10T06:27:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048258260000000001, 2024-09-10T06:27:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 514 2024-09-10T06:27:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531214+0000", 2024-09-10T06:27:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2699999999999998e-07 2024-09-10T06:27:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531219+0000", 2024-09-10T06:27:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-10T06:27:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531233+0000", 2024-09-10T06:27:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.38e-05 2024-09-10T06:27:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531240+0000", 2024-09-10T06:27:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7399999999999998e-06 2024-09-10T06:27:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531378+0000", 2024-09-10T06:27:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013860399999999999 2024-09-10T06:27:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531600+0000", 2024-09-10T06:27:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221287 2024-09-10T06:27:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532007+0000", 2024-09-10T06:27:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040728500000000001 2024-09-10T06:27:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533131+0000", 2024-09-10T06:27:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011240429999999999 2024-09-10T06:27:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535894+0000", 2024-09-10T06:27:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027628650000000002 2024-09-10T06:27:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535973+0000", 2024-09-10T06:27:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9399000000000003e-05 2024-09-10T06:27:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536039+0000", 2024-09-10T06:27:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5619999999999999e-05 2024-09-10T06:27:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:655 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.270062645000003, 2024-09-10T06:27:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003017207, 2024-09-10T06:27:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 655 2024-09-10T06:27:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631159+0000", 2024-09-10T06:27:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8270000000000002e-06 2024-09-10T06:27:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631173+0000", 2024-09-10T06:27:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4739999999999999e-05 2024-09-10T06:27:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631206+0000", 2024-09-10T06:27:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2425999999999998e-05 2024-09-10T06:27:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631221+0000", 2024-09-10T06:27:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4927e-05 2024-09-10T06:27:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631336+0000", 2024-09-10T06:27:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115062 2024-09-10T06:27:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631547+0000", 2024-09-10T06:27:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021178200000000001 2024-09-10T06:27:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.632034+0000", 2024-09-10T06:27:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000486899 2024-09-10T06:27:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633413+0000", 2024-09-10T06:27:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001379077 2024-09-10T06:27:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633891+0000", 2024-09-10T06:27:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000477489 2024-09-10T06:27:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634057+0000", 2024-09-10T06:27:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016608500000000001 2024-09-10T06:27:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634173+0000", 2024-09-10T06:27:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115893 2024-09-10T06:27:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:658 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.266048400999999, 2024-09-10T06:27:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030550820000000002, 2024-09-10T06:27:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 658 2024-09-10T06:27:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635171+0000", 2024-09-10T06:27:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.322e-06 2024-09-10T06:27:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635178+0000", 2024-09-10T06:27:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7950000000000002e-06 2024-09-10T06:27:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635197+0000", 2024-09-10T06:27:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8845e-05 2024-09-10T06:27:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635215+0000", 2024-09-10T06:27:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7822e-05 2024-09-10T06:27:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635329+0000", 2024-09-10T06:27:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011433 2024-09-10T06:27:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635554+0000", 2024-09-10T06:27:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022527800000000001 2024-09-10T06:27:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.636007+0000", 2024-09-10T06:27:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045297099999999998 2024-09-10T06:27:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637198+0000", 2024-09-10T06:27:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011902740000000001 2024-09-10T06:27:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637961+0000", 2024-09-10T06:27:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000763234 2024-09-10T06:27:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638110+0000", 2024-09-10T06:27:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149259 2024-09-10T06:27:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638225+0000", 2024-09-10T06:27:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011495200000000001 2024-09-10T06:27:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.169716459, 2024-09-10T06:27:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028070980000000001, 2024-09-10T06:27:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 724 2024-09-10T06:27:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731504+0000", 2024-09-10T06:27:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731516+0000", 2024-09-10T06:27:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1885999999999999e-05 2024-09-10T06:27:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731547+0000", 2024-09-10T06:27:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0923000000000002e-05 2024-09-10T06:27:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731563+0000", 2024-09-10T06:27:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5342999999999999e-05 2024-09-10T06:27:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731704+0000", 2024-09-10T06:27:26.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014128599999999999 2024-09-10T06:27:26.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731917+0000", 2024-09-10T06:27:26.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021280800000000001 2024-09-10T06:27:26.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:26.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.732227+0000", 2024-09-10T06:27:26.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031024500000000001 2024-09-10T06:27:26.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:26.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.733258+0000", 2024-09-10T06:27:26.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010306880000000001 2024-09-10T06:27:26.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:26.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734163+0000", 2024-09-10T06:27:26.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090502400000000004 2024-09-10T06:27:26.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:26.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734247+0000", 2024-09-10T06:27:26.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4363000000000005e-05 2024-09-10T06:27:26.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:26.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734309+0000", 2024-09-10T06:27:26.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2005e-05 2024-09-10T06:27:26.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.995 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:26.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:26.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.995 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:26.995 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:26.995 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.162870325, 2024-09-10T06:27:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030399789999999999, 2024-09-10T06:27:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 727 2024-09-10T06:27:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738350+0000", 2024-09-10T06:27:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2199999999999999e-06 2024-09-10T06:27:26.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738360+0000", 2024-09-10T06:27:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0122999999999999e-05 2024-09-10T06:27:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738384+0000", 2024-09-10T06:27:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3390000000000001e-05 2024-09-10T06:27:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:26.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738397+0000", 2024-09-10T06:27:26.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2896e-05 2024-09-10T06:27:26.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:26.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738524+0000", 2024-09-10T06:27:26.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126883 2024-09-10T06:27:26.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:26.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:26.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:26.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738752+0000", 2024-09-10T06:27:27.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022864200000000001 2024-09-10T06:27:27.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:27.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.739080+0000", 2024-09-10T06:27:27.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032783699999999999 2024-09-10T06:27:27.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:27.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.740085+0000", 2024-09-10T06:27:27.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001005438 2024-09-10T06:27:27.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:27.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741203+0000", 2024-09-10T06:27:27.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011175919999999999 2024-09-10T06:27:27.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:27.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741280+0000", 2024-09-10T06:27:27.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6545999999999995e-05 2024-09-10T06:27:27.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:27.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741388+0000", 2024-09-10T06:27:27.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108412 2024-09-10T06:27:27.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:27.002 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:27.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:27.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.002 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:27.002 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:27.003 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.970847820000003, 2024-09-10T06:27:27.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028715709999999998, 2024-09-10T06:27:27.003 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:27.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:27.003 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:27.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:27.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:27.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:27.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 814 2024-09-10T06:27:27.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.004 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:27.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:27.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:27.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:27.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:27.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:27.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:27.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:27.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930373+0000", 2024-09-10T06:27:27.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-10T06:27:27.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:27.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930384+0000", 2024-09-10T06:27:27.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1357e-05 2024-09-10T06:27:27.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930417+0000", 2024-09-10T06:27:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2289000000000002e-05 2024-09-10T06:27:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930438+0000", 2024-09-10T06:27:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1399999999999998e-05 2024-09-10T06:27:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:27.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930626+0000", 2024-09-10T06:27:27.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018812899999999999 2024-09-10T06:27:27.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:27.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930843+0000", 2024-09-10T06:27:27.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021719400000000001 2024-09-10T06:27:27.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:27.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.931152+0000", 2024-09-10T06:27:27.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030821199999999998 2024-09-10T06:27:27.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:27.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.932258+0000", 2024-09-10T06:27:27.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001106304 2024-09-10T06:27:27.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:27.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933092+0000", 2024-09-10T06:27:27.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00083364699999999997 2024-09-10T06:27:27.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:27.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933179+0000", 2024-09-10T06:27:27.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7383e-05 2024-09-10T06:27:27.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:27.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933242+0000", 2024-09-10T06:27:27.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3072999999999997e-05 2024-09-10T06:27:27.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:27.010 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:27.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:27.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.010 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:27.010 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:27.010 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.823296339000002, 2024-09-10T06:27:27.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029601670000000001, 2024-09-10T06:27:27.010 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:27.010 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:27.010 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:27.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:27.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:27.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:27.011 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 880 2024-09-10T06:27:27.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.011 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:27.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:27.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:27.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:27.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:27.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:27.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:27.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:27.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077925+0000", 2024-09-10T06:27:27.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-10T06:27:27.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:27.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077938+0000", 2024-09-10T06:27:27.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2836999999999999e-05 2024-09-10T06:27:27.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:27.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077970+0000", 2024-09-10T06:27:27.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1542999999999999e-05 2024-09-10T06:27:27.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:27.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077984+0000", 2024-09-10T06:27:27.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4963999999999999e-05 2024-09-10T06:27:27.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:27.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078118+0000", 2024-09-10T06:27:27.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134015 2024-09-10T06:27:27.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:27.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078344+0000", 2024-09-10T06:27:27.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225038 2024-09-10T06:27:27.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:27.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078696+0000", 2024-09-10T06:27:27.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035250100000000002 2024-09-10T06:27:27.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:27.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.079793+0000", 2024-09-10T06:27:27.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010967049999999999 2024-09-10T06:27:27.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:27.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080714+0000", 2024-09-10T06:27:27.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00092153600000000003 2024-09-10T06:27:27.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:27.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080802+0000", 2024-09-10T06:27:27.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7446000000000003e-05 2024-09-10T06:27:27.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:27.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080882+0000", 2024-09-10T06:27:27.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0445999999999995e-05 2024-09-10T06:27:27.017 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:27.017 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:27.017 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:27.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.017 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:27.017 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:27.017 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.748676111999998, 2024-09-10T06:27:27.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002919091, 2024-09-10T06:27:27.018 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:27.018 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:27.018 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:27.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:27.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:27.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:27.018 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 913 2024-09-10T06:27:27.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.018 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:27.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:27.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:27.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:27.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:27.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:27.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:27.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:27.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152545+0000", 2024-09-10T06:27:27.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6529999999999998e-06 2024-09-10T06:27:27.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:27.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152557+0000", 2024-09-10T06:27:27.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919999999999999e-05 2024-09-10T06:27:27.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:27.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152587+0000", 2024-09-10T06:27:27.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0097e-05 2024-09-10T06:27:27.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:27.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152601+0000", 2024-09-10T06:27:27.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4579999999999999e-05 2024-09-10T06:27:27.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:27.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152732+0000", 2024-09-10T06:27:27.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013085500000000001 2024-09-10T06:27:27.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:27.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153007+0000", 2024-09-10T06:27:27.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027469499999999998 2024-09-10T06:27:27.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:27.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153344+0000", 2024-09-10T06:27:27.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033742400000000001 2024-09-10T06:27:27.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:27.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.154351+0000", 2024-09-10T06:27:27.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010067590000000001 2024-09-10T06:27:27.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:27.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155301+0000", 2024-09-10T06:27:27.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095000900000000003 2024-09-10T06:27:27.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:27.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155387+0000", 2024-09-10T06:27:27.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6136000000000003e-05 2024-09-10T06:27:27.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:27.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155461+0000", 2024-09-10T06:27:27.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3962999999999996e-05 2024-09-10T06:27:27.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:27.024 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:27.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:27.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.025 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:27.025 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:27.025 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.717029429999997, 2024-09-10T06:27:27.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029321239999999999, 2024-09-10T06:27:27.025 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:27.025 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:27.025 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:27.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:27.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:27.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:27.025 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 927 2024-09-10T06:27:27.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.026 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:27.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:27.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:27.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:27.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:27.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:27.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:27.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:27.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184191+0000", 2024-09-10T06:27:27.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.764e-06 2024-09-10T06:27:27.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:27.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184199+0000", 2024-09-10T06:27:27.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4630000000000001e-06 2024-09-10T06:27:27.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:27.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184221+0000", 2024-09-10T06:27:27.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1603e-05 2024-09-10T06:27:27.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:27.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184233+0000", 2024-09-10T06:27:27.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.189e-05 2024-09-10T06:27:27.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:27.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184382+0000", 2024-09-10T06:27:27.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014939900000000001 2024-09-10T06:27:27.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:27.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184495+0000", 2024-09-10T06:27:27.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113459 2024-09-10T06:27:27.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184735+0000", 2024-09-10T06:27:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000239554 2024-09-10T06:27:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186036+0000", 2024-09-10T06:27:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00130072 2024-09-10T06:27:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:27.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186929+0000", 2024-09-10T06:27:27.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000893694 2024-09-10T06:27:27.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:27.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187014+0000", 2024-09-10T06:27:27.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4222999999999996e-05 2024-09-10T06:27:27.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:27.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187121+0000", 2024-09-10T06:27:27.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107355 2024-09-10T06:27:27.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:27.032 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:27.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:27.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.032 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:27.032 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:27.032 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.713768565000002, 2024-09-10T06:27:27.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028243320000000001, 2024-09-10T06:27:27.032 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:27.033 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:27.033 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:27.033 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:27.033 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:27.033 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:27.033 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 928 2024-09-10T06:27:27.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.033 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:27.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:27.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:27.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:27.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:27.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:27.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:27.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:27.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187452+0000", 2024-09-10T06:27:27.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5069999999999999e-06 2024-09-10T06:27:27.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:27.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187464+0000", 2024-09-10T06:27:27.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1243000000000001e-05 2024-09-10T06:27:27.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:27.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187495+0000", 2024-09-10T06:27:27.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1136000000000001e-05 2024-09-10T06:27:27.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:27.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187511+0000", 2024-09-10T06:27:27.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6710000000000001e-05 2024-09-10T06:27:27.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:27.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187648+0000", 2024-09-10T06:27:27.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013657599999999999 2024-09-10T06:27:27.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:27.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187866+0000", 2024-09-10T06:27:27.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021853500000000001 2024-09-10T06:27:27.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:27.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.188168+0000", 2024-09-10T06:27:27.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030161100000000002 2024-09-10T06:27:27.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:27.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.189334+0000", 2024-09-10T06:27:27.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001166048 2024-09-10T06:27:27.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:27.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190086+0000", 2024-09-10T06:27:27.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075159399999999996 2024-09-10T06:27:27.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:27.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190165+0000", 2024-09-10T06:27:27.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8953000000000001e-05 2024-09-10T06:27:27.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:27.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:27.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:27.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190274+0000", 2024-09-10T06:27:27.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109419 2024-09-10T06:27:27.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:27.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:27.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:27.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:27.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:27.039 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:27.041 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:27:27.042 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:27.041+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:27.131 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:27:27.177 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:27.177+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:27.211 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:27.211 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:27.225 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:27:27.242 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:27.241+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:27.326 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:27.327 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:27.343 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:27.341+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:27.350 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:27.350 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:27.350 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:27.357 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:27.357 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:27.364 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:27:27.387 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:27.387 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:27.417 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:27.417 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:27.447 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:27.447 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:27.452 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:27.449+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:27.477 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:27.478 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:27.510 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:27.510 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:27.533 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:27.533 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:27.542 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:27.542 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:27.546 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:27.541+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:27.548 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:27:27.568 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.7 to 1 (10000) 2024-09-10T06:27:27.599 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-10T06:27:27.599 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:27:27.647 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:27.645+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:27.713 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:27.713 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:27.727 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:27:27.768 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:27.765+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:27.849 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:27.845+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:27.893 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:27.893 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:27.908 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:27:27.952 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:27.953+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:28.050 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:28.049+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:28.074 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:28.074 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:28.088 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:27:28.151 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:28.149+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:28.164 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:27:28.170 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:27:28.186 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-10T06:27:27.577803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":759,"num_read_kb":507,"num_write":532,"num_write_kb":1672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":485,"ondisk_log_size":485,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230472,"kb_used_data":5888,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744248,"statfs":{"total":773094113280,"available":772858109952,"internally_reserved":0,"allocated":6029312,"data_stored":3489412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.047524"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551389+0000","last_change":"2024-09-10T06:27:08.597414+0000","last_active":"2024-09-10T06:27:25.551389+0000","last_peered":"2024-09-10T06:27:25.551389+0000","last_clean":"2024-09-10T06:27:25.551389+0000","last_became_active":"2024-09-10T06:27:08.597026+0000","last_became_peered":"2024-09-10T06:27:08.597026+0000","last_unstale":"2024-09-10T06:27:25.551389+0000","last_undegraded":"2024-09-10T06:27:25.551389+0000","last_fullsized":"2024-09-10T06:27:25.551389+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:07.484952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.784628+0000","last_change":"2024-09-10T06:26:32.279882+0000","last_active":"2024-09-10T06:27:23.784628+0000","last_peered":"2024-09-10T06:27:23.784628+0000","last_clean":"2024-09-10T06:27:23.784628+0000","last_became_active":"2024-09-10T06:26:32.279098+0000","last_became_peered":"2024-09-10T06:26:32.279098+0000","last_unstale":"2024-09-10T06:27:23.784628+0000","last_undegraded":"2024-09-10T06:27:23.784628+0000","last_fullsized":"2024-09-10T06:27:23.784628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551204+0000","last_change":"2024-09-10T06:26:30.573148+0000","last_active":"2024-09-10T06:27:25.551204+0000","last_peered":"2024-09-10T06:27:25.551204+0000","last_clean":"2024-09-10T06:27:25.551204+0000","last_became_active":"2024-09-10T06:26:30.572798+0000","last_became_peered":"2024-09-10T06:26:30.572798+0000","last_unstale":"2024-09-10T06:27:25.551204+0000","last_undegraded":"2024-09-10T06:27:25.551204+0000","last_fullsized":"2024-09-10T06:27:25.551204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:38.833715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.787836+0000","last_change":"2024-09-10T06:26:32.276811+0000","last_active":"2024-09-10T06:27:23.787836+0000","last_peered":"2024-09-10T06:27:23.787836+0000","last_clean":"2024-09-10T06:27:23.787836+0000","last_became_active":"2024-09-10T06:26:32.275990+0000","last_became_peered":"2024-09-10T06:26:32.275990+0000","last_unstale":"2024-09-10T06:27:23.787836+0000","last_undegraded":"2024-09-10T06:27:23.787836+0000","last_fullsized":"2024-09-10T06:27:23.787836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.782178+0000","last_change":"2024-09-10T06:26:30.578068+0000","last_active":"2024-09-10T06:27:23.782178+0000","last_peered":"2024-09-10T06:27:23.782178+0000","last_clean":"2024-09-10T06:27:23.782178+0000","last_became_active":"2024-09-10T06:26:30.577688+0000","last_became_peered":"2024-09-10T06:26:30.577688+0000","last_unstale":"2024-09-10T06:27:23.782178+0000","last_undegraded":"2024-09-10T06:27:23.782178+0000","last_fullsized":"2024-09-10T06:27:23.782178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:34.137079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550406+0000","last_change":"2024-09-10T06:26:32.256939+0000","last_active":"2024-09-10T06:27:25.550406+0000","last_peered":"2024-09-10T06:27:25.550406+0000","last_clean":"2024-09-10T06:27:25.550406+0000","last_became_active":"2024-09-10T06:26:32.256117+0000","last_became_peered":"2024-09-10T06:26:32.256117+0000","last_unstale":"2024-09-10T06:27:25.550406+0000","last_undegraded":"2024-09-10T06:27:25.550406+0000","last_fullsized":"2024-09-10T06:27:25.550406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:51.879604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788424+0000","last_change":"2024-09-10T06:26:30.593697+0000","last_active":"2024-09-10T06:27:23.788424+0000","last_peered":"2024-09-10T06:27:23.788424+0000","last_clean":"2024-09-10T06:27:23.788424+0000","last_became_active":"2024-09-10T06:26:30.591807+0000","last_became_peered":"2024-09-10T06:26:30.591807+0000","last_unstale":"2024-09-10T06:27:23.788424+0000","last_undegraded":"2024-09-10T06:27:23.788424+0000","last_fullsized":"2024-09-10T06:27:23.788424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780552+0000","last_change":"2024-09-10T06:26:32.264685+0000","last_active":"2024-09-10T06:27:23.780552+0000","last_peered":"2024-09-10T06:27:23.780552+0000","last_clean":"2024-09-10T06:27:23.780552+0000","last_became_active":"2024-09-10T06:26:32.264199+0000","last_became_peered":"2024-09-10T06:26:32.264199+0000","last_unstale":"2024-09-10T06:27:23.780552+0000","last_undegraded":"2024-09-10T06:27:23.780552+0000","last_fullsized":"2024-09-10T06:27:23.780552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:20.713066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790209+0000","last_change":"2024-09-10T06:26:30.584856+0000","last_active":"2024-09-10T06:27:23.790209+0000","last_peered":"2024-09-10T06:27:23.790209+0000","last_clean":"2024-09-10T06:27:23.790209+0000","last_became_active":"2024-09-10T06:26:30.584149+0000","last_became_peered":"2024-09-10T06:26:30.584149+0000","last_unstale":"2024-09-10T06:27:23.790209+0000","last_undegraded":"2024-09-10T06:27:23.790209+0000","last_fullsized":"2024-09-10T06:27:23.790209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:35.688897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967925+0000","last_change":"2024-09-10T06:26:32.290741+0000","last_active":"2024-09-10T06:27:24.967925+0000","last_peered":"2024-09-10T06:27:24.967925+0000","last_clean":"2024-09-10T06:27:24.967925+0000","last_became_active":"2024-09-10T06:26:32.289840+0000","last_became_peered":"2024-09-10T06:26:32.289840+0000","last_unstale":"2024-09-10T06:27:24.967925+0000","last_undegraded":"2024-09-10T06:27:24.967925+0000","last_fullsized":"2024-09-10T06:27:24.967925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.786032+0000","last_change":"2024-09-10T06:26:30.609817+0000","last_active":"2024-09-10T06:27:23.786032+0000","last_peered":"2024-09-10T06:27:23.786032+0000","last_clean":"2024-09-10T06:27:23.786032+0000","last_became_active":"2024-09-10T06:26:30.603330+0000","last_became_peered":"2024-09-10T06:26:30.603330+0000","last_unstale":"2024-09-10T06:27:23.786032+0000","last_undegraded":"2024-09-10T06:27:23.786032+0000","last_fullsized":"2024-09-10T06:27:23.786032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:09.523045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551378+0000","last_change":"2024-09-10T06:26:32.257050+0000","last_active":"2024-09-10T06:27:25.551378+0000","last_peered":"2024-09-10T06:27:25.551378+0000","last_clean":"2024-09-10T06:27:25.551378+0000","last_became_active":"2024-09-10T06:26:32.254437+0000","last_became_peered":"2024-09-10T06:26:32.254437+0000","last_unstale":"2024-09-10T06:27:25.551378+0000","last_undegraded":"2024-09-10T06:27:25.551378+0000","last_fullsized":"2024-09-10T06:27:25.551378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788585+0000","last_change":"2024-09-10T06:26:30.579756+0000","last_active":"2024-09-10T06:27:23.788585+0000","last_peered":"2024-09-10T06:27:23.788585+0000","last_clean":"2024-09-10T06:27:23.788585+0000","last_became_active":"2024-09-10T06:26:30.578033+0000","last_became_peered":"2024-09-10T06:26:30.578033+0000","last_unstale":"2024-09-10T06:27:23.788585+0000","last_undegraded":"2024-09-10T06:27:23.788585+0000","last_fullsized":"2024-09-10T06:27:23.788585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789000+0000","last_change":"2024-09-10T06:26:32.281248+0000","last_active":"2024-09-10T06:27:23.789000+0000","last_peered":"2024-09-10T06:27:23.789000+0000","last_clean":"2024-09-10T06:27:23.789000+0000","last_became_active":"2024-09-10T06:26:32.280480+0000","last_became_peered":"2024-09-10T06:26:32.280480+0000","last_unstale":"2024-09-10T06:27:23.789000+0000","last_undegraded":"2024-09-10T06:27:23.789000+0000","last_fullsized":"2024-09-10T06:27:23.789000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552774+0000","last_change":"2024-09-10T06:26:30.593213+0000","last_active":"2024-09-10T06:27:25.552774+0000","last_peered":"2024-09-10T06:27:25.552774+0000","last_clean":"2024-09-10T06:27:25.552774+0000","last_became_active":"2024-09-10T06:26:30.592770+0000","last_became_peered":"2024-09-10T06:26:30.592770+0000","last_unstale":"2024-09-10T06:27:25.552774+0000","last_undegraded":"2024-09-10T06:27:25.552774+0000","last_fullsized":"2024-09-10T06:27:25.552774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.879256+0000","last_change":"2024-09-10T06:26:32.267430+0000","last_active":"2024-09-10T06:27:24.879256+0000","last_peered":"2024-09-10T06:27:24.879256+0000","last_clean":"2024-09-10T06:27:24.879256+0000","last_became_active":"2024-09-10T06:26:32.265788+0000","last_became_peered":"2024-09-10T06:26:32.265788+0000","last_unstale":"2024-09-10T06:27:24.879256+0000","last_undegraded":"2024-09-10T06:27:24.879256+0000","last_fullsized":"2024-09-10T06:27:24.879256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:19.180142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549590+0000","last_change":"2024-09-10T06:26:32.255038+0000","last_active":"2024-09-10T06:27:25.549590+0000","last_peered":"2024-09-10T06:27:25.549590+0000","last_clean":"2024-09-10T06:27:25.549590+0000","last_became_active":"2024-09-10T06:26:32.254281+0000","last_became_peered":"2024-09-10T06:26:32.254281+0000","last_unstale":"2024-09-10T06:27:25.549590+0000","last_undegraded":"2024-09-10T06:27:25.549590+0000","last_fullsized":"2024-09-10T06:27:25.549590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:46.363171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.792005+0000","last_change":"2024-09-10T06:26:30.607280+0000","last_active":"2024-09-10T06:27:23.792005+0000","last_peered":"2024-09-10T06:27:23.792005+0000","last_clean":"2024-09-10T06:27:23.792005+0000","last_became_active":"2024-09-10T06:26:30.605602+0000","last_became_peered":"2024-09-10T06:26:30.605602+0000","last_unstale":"2024-09-10T06:27:23.792005+0000","last_undegraded":"2024-09-10T06:27:23.792005+0000","last_fullsized":"2024-09-10T06:27:23.792005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:49.865234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788097+0000","last_change":"2024-09-10T06:26:32.275913+0000","last_active":"2024-09-10T06:27:23.788097+0000","last_peered":"2024-09-10T06:27:23.788097+0000","last_clean":"2024-09-10T06:27:23.788097+0000","last_became_active":"2024-09-10T06:26:32.274264+0000","last_became_peered":"2024-09-10T06:26:32.274264+0000","last_unstale":"2024-09-10T06:27:23.788097+0000","last_undegraded":"2024-09-10T06:27:23.788097+0000","last_fullsized":"2024-09-10T06:27:23.788097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.968300+0000","last_change":"2024-09-10T06:26:30.598756+0000","last_active":"2024-09-10T06:27:24.968300+0000","last_peered":"2024-09-10T06:27:24.968300+0000","last_clean":"2024-09-10T06:27:24.968300+0000","last_became_active":"2024-09-10T06:26:30.597001+0000","last_became_peered":"2024-09-10T06:26:30.597001+0000","last_unstale":"2024-09-10T06:27:24.968300+0000","last_undegraded":"2024-09-10T06:27:24.968300+0000","last_fullsized":"2024-09-10T06:27:24.968300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:17.165772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.786150+0000","last_change":"2024-09-10T06:26:32.279079+0000","last_active":"2024-09-10T06:27:23.786150+0000","last_peered":"2024-09-10T06:27:23.786150+0000","last_clean":"2024-09-10T06:27:23.786150+0000","last_became_active":"2024-09-10T06:26:32.278407+0000","last_became_peered":"2024-09-10T06:26:32.278407+0000","last_unstale":"2024-09-10T06:27:23.786150+0000","last_undegraded":"2024-09-10T06:27:23.786150+0000","last_fullsized":"2024-09-10T06:27:23.786150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.968720+0000","last_change":"2024-09-10T06:26:30.607368+0000","last_active":"2024-09-10T06:27:24.968720+0000","last_peered":"2024-09-10T06:27:24.968720+0000","last_clean":"2024-09-10T06:27:24.968720+0000","last_became_active":"2024-09-10T06:26:30.606807+0000","last_became_peered":"2024-09-10T06:26:30.606807+0000","last_unstale":"2024-09-10T06:27:24.968720+0000","last_undegraded":"2024-09-10T06:27:24.968720+0000","last_fullsized":"2024-09-10T06:27:24.968720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878249+0000","last_change":"2024-09-10T06:27:08.801987+0000","last_active":"2024-09-10T06:27:24.878249+0000","last_peered":"2024-09-10T06:27:24.878249+0000","last_clean":"2024-09-10T06:27:24.878249+0000","last_became_active":"2024-09-10T06:27:08.801461+0000","last_became_peered":"2024-09-10T06:27:08.801461+0000","last_unstale":"2024-09-10T06:27:24.878249+0000","last_undegraded":"2024-09-10T06:27:24.878249+0000","last_fullsized":"2024-09-10T06:27:24.878249+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550051+0000","last_change":"2024-09-10T06:26:30.598381+0000","last_active":"2024-09-10T06:27:25.550051+0000","last_peered":"2024-09-10T06:27:25.550051+0000","last_clean":"2024-09-10T06:27:25.550051+0000","last_became_active":"2024-09-10T06:26:30.597271+0000","last_became_peered":"2024-09-10T06:26:30.597271+0000","last_unstale":"2024-09-10T06:27:25.550051+0000","last_undegraded":"2024-09-10T06:27:25.550051+0000","last_fullsized":"2024-09-10T06:27:25.550051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:59.908548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878442+0000","last_change":"2024-09-10T06:26:32.247492+0000","last_active":"2024-09-10T06:27:24.878442+0000","last_peered":"2024-09-10T06:27:24.878442+0000","last_clean":"2024-09-10T06:27:24.878442+0000","last_became_active":"2024-09-10T06:26:32.246938+0000","last_became_peered":"2024-09-10T06:26:32.246938+0000","last_unstale":"2024-09-10T06:27:24.878442+0000","last_undegraded":"2024-09-10T06:27:24.878442+0000","last_fullsized":"2024-09-10T06:27:24.878442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:01.766868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553715+0000","last_change":"2024-09-10T06:26:30.592866+0000","last_active":"2024-09-10T06:27:25.553715+0000","last_peered":"2024-09-10T06:27:25.553715+0000","last_clean":"2024-09-10T06:27:25.553715+0000","last_became_active":"2024-09-10T06:26:30.592550+0000","last_became_peered":"2024-09-10T06:26:30.592550+0000","last_unstale":"2024-09-10T06:27:25.553715+0000","last_undegraded":"2024-09-10T06:27:25.553715+0000","last_fullsized":"2024-09-10T06:27:25.553715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:02.132556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551602+0000","last_change":"2024-09-10T06:26:32.278347+0000","last_active":"2024-09-10T06:27:25.551602+0000","last_peered":"2024-09-10T06:27:25.551602+0000","last_clean":"2024-09-10T06:27:25.551602+0000","last_became_active":"2024-09-10T06:26:32.275206+0000","last_became_peered":"2024-09-10T06:26:32.275206+0000","last_unstale":"2024-09-10T06:27:25.551602+0000","last_undegraded":"2024-09-10T06:27:25.551602+0000","last_fullsized":"2024-09-10T06:27:25.551602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780035+0000","last_change":"2024-09-10T06:26:30.572734+0000","last_active":"2024-09-10T06:27:23.780035+0000","last_peered":"2024-09-10T06:27:23.780035+0000","last_clean":"2024-09-10T06:27:23.780035+0000","last_became_active":"2024-09-10T06:26:30.572043+0000","last_became_peered":"2024-09-10T06:26:30.572043+0000","last_unstale":"2024-09-10T06:27:23.780035+0000","last_undegraded":"2024-09-10T06:27:23.780035+0000","last_fullsized":"2024-09-10T06:27:23.780035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549120+0000","last_change":"2024-09-10T06:26:40.323476+0000","last_active":"2024-09-10T06:27:25.549120+0000","last_peered":"2024-09-10T06:27:25.549120+0000","last_clean":"2024-09-10T06:27:25.549120+0000","last_became_active":"2024-09-10T06:26:40.322711+0000","last_became_peered":"2024-09-10T06:26:40.322711+0000","last_unstale":"2024-09-10T06:27:25.549120+0000","last_undegraded":"2024-09-10T06:27:25.549120+0000","last_fullsized":"2024-09-10T06:27:25.549120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554356+0000","last_change":"2024-09-10T06:26:32.276274+0000","last_active":"2024-09-10T06:27:25.554356+0000","last_peered":"2024-09-10T06:27:25.554356+0000","last_clean":"2024-09-10T06:27:25.554356+0000","last_became_active":"2024-09-10T06:26:32.275889+0000","last_became_peered":"2024-09-10T06:26:32.275889+0000","last_unstale":"2024-09-10T06:27:25.554356+0000","last_undegraded":"2024-09-10T06:27:25.554356+0000","last_fullsized":"2024-09-10T06:27:25.554356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790617+0000","last_change":"2024-09-10T06:26:30.595738+0000","last_active":"2024-09-10T06:27:23.790617+0000","last_peered":"2024-09-10T06:27:23.790617+0000","last_clean":"2024-09-10T06:27:23.790617+0000","last_became_active":"2024-09-10T06:26:30.595128+0000","last_became_peered":"2024-09-10T06:26:30.595128+0000","last_unstale":"2024-09-10T06:27:23.790617+0000","last_undegraded":"2024-09-10T06:27:23.790617+0000","last_fullsized":"2024-09-10T06:27:23.790617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788402+0000","last_change":"2024-09-10T06:26:34.279824+0000","last_active":"2024-09-10T06:27:23.788402+0000","last_peered":"2024-09-10T06:27:23.788402+0000","last_clean":"2024-09-10T06:27:23.788402+0000","last_became_active":"2024-09-10T06:26:34.279074+0000","last_became_peered":"2024-09-10T06:26:34.279074+0000","last_unstale":"2024-09-10T06:27:23.788402+0000","last_undegraded":"2024-09-10T06:27:23.788402+0000","last_fullsized":"2024-09-10T06:27:23.788402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:40.507467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"34'9","reported_seq":67,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780844+0000","last_change":"2024-09-10T06:26:36.296703+0000","last_active":"2024-09-10T06:27:23.780844+0000","last_peered":"2024-09-10T06:27:23.780844+0000","last_clean":"2024-09-10T06:27:23.780844+0000","last_became_active":"2024-09-10T06:26:36.295786+0000","last_became_peered":"2024-09-10T06:26:36.295786+0000","last_unstale":"2024-09-10T06:27:23.780844+0000","last_undegraded":"2024-09-10T06:27:23.780844+0000","last_fullsized":"2024-09-10T06:27:23.780844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:31.699855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":46,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790687+0000","last_change":"2024-09-10T06:26:38.305468+0000","last_active":"2024-09-10T06:27:23.790687+0000","last_peered":"2024-09-10T06:27:23.790687+0000","last_clean":"2024-09-10T06:27:23.790687+0000","last_became_active":"2024-09-10T06:26:38.304847+0000","last_became_peered":"2024-09-10T06:26:38.304847+0000","last_unstale":"2024-09-10T06:27:23.790687+0000","last_undegraded":"2024-09-10T06:27:23.790687+0000","last_fullsized":"2024-09-10T06:27:23.790687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:36.499856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.784306+0000","last_change":"2024-09-10T06:26:40.331389+0000","last_active":"2024-09-10T06:27:23.784306+0000","last_peered":"2024-09-10T06:27:23.784306+0000","last_clean":"2024-09-10T06:27:23.784306+0000","last_became_active":"2024-09-10T06:26:40.330777+0000","last_became_peered":"2024-09-10T06:26:40.330777+0000","last_unstale":"2024-09-10T06:27:23.784306+0000","last_undegraded":"2024-09-10T06:27:23.784306+0000","last_fullsized":"2024-09-10T06:27:23.784306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:22.792159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788924+0000","last_change":"2024-09-10T06:26:32.283112+0000","last_active":"2024-09-10T06:27:23.788924+0000","last_peered":"2024-09-10T06:27:23.788924+0000","last_clean":"2024-09-10T06:27:23.788924+0000","last_became_active":"2024-09-10T06:26:32.282263+0000","last_became_peered":"2024-09-10T06:26:32.282263+0000","last_unstale":"2024-09-10T06:27:23.788924+0000","last_undegraded":"2024-09-10T06:27:23.788924+0000","last_fullsized":"2024-09-10T06:27:23.788924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:02.124800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780108+0000","last_change":"2024-09-10T06:26:30.576489+0000","last_active":"2024-09-10T06:27:23.780108+0000","last_peered":"2024-09-10T06:27:23.780108+0000","last_clean":"2024-09-10T06:27:23.780108+0000","last_became_active":"2024-09-10T06:26:30.576039+0000","last_became_peered":"2024-09-10T06:26:30.576039+0000","last_unstale":"2024-09-10T06:27:23.780108+0000","last_undegraded":"2024-09-10T06:27:23.780108+0000","last_fullsized":"2024-09-10T06:27:23.780108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":59,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554277+0000","last_change":"2024-09-10T06:26:34.268758+0000","last_active":"2024-09-10T06:27:25.554277+0000","last_peered":"2024-09-10T06:27:25.554277+0000","last_clean":"2024-09-10T06:27:25.554277+0000","last_became_active":"2024-09-10T06:26:34.268279+0000","last_became_peered":"2024-09-10T06:26:34.268279+0000","last_unstale":"2024-09-10T06:27:25.554277+0000","last_undegraded":"2024-09-10T06:27:25.554277+0000","last_fullsized":"2024-09-10T06:27:25.554277+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:42.052702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551622+0000","last_change":"2024-09-10T06:26:36.273991+0000","last_active":"2024-09-10T06:27:25.551622+0000","last_peered":"2024-09-10T06:27:25.551622+0000","last_clean":"2024-09-10T06:27:25.551622+0000","last_became_active":"2024-09-10T06:26:36.273138+0000","last_became_peered":"2024-09-10T06:26:36.273138+0000","last_unstale":"2024-09-10T06:27:25.551622+0000","last_undegraded":"2024-09-10T06:27:25.551622+0000","last_fullsized":"2024-09-10T06:27:25.551622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":50,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551393+0000","last_change":"2024-09-10T06:26:38.294543+0000","last_active":"2024-09-10T06:27:25.551393+0000","last_peered":"2024-09-10T06:27:25.551393+0000","last_clean":"2024-09-10T06:27:25.551393+0000","last_became_active":"2024-09-10T06:26:38.293754+0000","last_became_peered":"2024-09-10T06:26:38.293754+0000","last_unstale":"2024-09-10T06:27:25.551393+0000","last_undegraded":"2024-09-10T06:27:25.551393+0000","last_fullsized":"2024-09-10T06:27:25.551393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.779821+0000","last_change":"2024-09-10T06:26:40.326998+0000","last_active":"2024-09-10T06:27:23.779821+0000","last_peered":"2024-09-10T06:27:23.779821+0000","last_clean":"2024-09-10T06:27:23.779821+0000","last_became_active":"2024-09-10T06:26:40.322648+0000","last_became_peered":"2024-09-10T06:26:40.322648+0000","last_unstale":"2024-09-10T06:27:23.779821+0000","last_undegraded":"2024-09-10T06:27:23.779821+0000","last_fullsized":"2024-09-10T06:27:23.779821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:19.837495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781412+0000","last_change":"2024-09-10T06:26:32.256959+0000","last_active":"2024-09-10T06:27:23.781412+0000","last_peered":"2024-09-10T06:27:23.781412+0000","last_clean":"2024-09-10T06:27:23.781412+0000","last_became_active":"2024-09-10T06:26:32.256701+0000","last_became_peered":"2024-09-10T06:26:32.256701+0000","last_unstale":"2024-09-10T06:27:23.781412+0000","last_undegraded":"2024-09-10T06:27:23.781412+0000","last_fullsized":"2024-09-10T06:27:23.781412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788873+0000","last_change":"2024-09-10T06:26:30.598409+0000","last_active":"2024-09-10T06:27:23.788873+0000","last_peered":"2024-09-10T06:27:23.788873+0000","last_clean":"2024-09-10T06:27:23.788873+0000","last_became_active":"2024-09-10T06:26:30.597703+0000","last_became_peered":"2024-09-10T06:26:30.597703+0000","last_unstale":"2024-09-10T06:27:23.788873+0000","last_undegraded":"2024-09-10T06:27:23.788873+0000","last_fullsized":"2024-09-10T06:27:23.788873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":59,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553994+0000","last_change":"2024-09-10T06:26:34.268741+0000","last_active":"2024-09-10T06:27:25.553994+0000","last_peered":"2024-09-10T06:27:25.553994+0000","last_clean":"2024-09-10T06:27:25.553994+0000","last_became_active":"2024-09-10T06:26:34.268192+0000","last_became_peered":"2024-09-10T06:26:34.268192+0000","last_unstale":"2024-09-10T06:27:25.553994+0000","last_undegraded":"2024-09-10T06:27:25.553994+0000","last_fullsized":"2024-09-10T06:27:25.553994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:42:10.110645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.877874+0000","last_change":"2024-09-10T06:26:36.275955+0000","last_active":"2024-09-10T06:27:24.877874+0000","last_peered":"2024-09-10T06:27:24.877874+0000","last_clean":"2024-09-10T06:27:24.877874+0000","last_became_active":"2024-09-10T06:26:36.275306+0000","last_became_peered":"2024-09-10T06:26:36.275306+0000","last_unstale":"2024-09-10T06:27:24.877874+0000","last_undegraded":"2024-09-10T06:27:24.877874+0000","last_fullsized":"2024-09-10T06:27:24.877874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:03.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'2","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790130+0000","last_change":"2024-09-10T06:26:38.302764+0000","last_active":"2024-09-10T06:27:23.790130+0000","last_peered":"2024-09-10T06:27:23.790130+0000","last_clean":"2024-09-10T06:27:23.790130+0000","last_became_active":"2024-09-10T06:26:38.300326+0000","last_became_peered":"2024-09-10T06:26:38.300326+0000","last_unstale":"2024-09-10T06:27:23.790130+0000","last_undegraded":"2024-09-10T06:27:23.790130+0000","last_fullsized":"2024-09-10T06:27:23.790130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:29.851085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549648+0000","last_change":"2024-09-10T06:26:40.297893+0000","last_active":"2024-09-10T06:27:25.549648+0000","last_peered":"2024-09-10T06:27:25.549648+0000","last_clean":"2024-09-10T06:27:25.549648+0000","last_became_active":"2024-09-10T06:26:40.297296+0000","last_became_peered":"2024-09-10T06:26:40.297296+0000","last_unstale":"2024-09-10T06:27:25.549648+0000","last_undegraded":"2024-09-10T06:27:25.549648+0000","last_fullsized":"2024-09-10T06:27:25.549648+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553626+0000","last_change":"2024-09-10T06:26:32.265005+0000","last_active":"2024-09-10T06:27:25.553626+0000","last_peered":"2024-09-10T06:27:25.553626+0000","last_clean":"2024-09-10T06:27:25.553626+0000","last_became_active":"2024-09-10T06:26:32.264334+0000","last_became_peered":"2024-09-10T06:26:32.264334+0000","last_unstale":"2024-09-10T06:27:25.553626+0000","last_undegraded":"2024-09-10T06:27:25.553626+0000","last_fullsized":"2024-09-10T06:27:25.553626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967123+0000","last_change":"2024-09-10T06:26:30.576242+0000","last_active":"2024-09-10T06:27:24.967123+0000","last_peered":"2024-09-10T06:27:24.967123+0000","last_clean":"2024-09-10T06:27:24.967123+0000","last_became_active":"2024-09-10T06:26:30.575433+0000","last_became_peered":"2024-09-10T06:26:30.575433+0000","last_unstale":"2024-09-10T06:27:24.967123+0000","last_undegraded":"2024-09-10T06:27:24.967123+0000","last_fullsized":"2024-09-10T06:27:24.967123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788762+0000","last_change":"2024-09-10T06:26:34.283701+0000","last_active":"2024-09-10T06:27:23.788762+0000","last_peered":"2024-09-10T06:27:23.788762+0000","last_clean":"2024-09-10T06:27:23.788762+0000","last_became_active":"2024-09-10T06:26:34.282941+0000","last_became_peered":"2024-09-10T06:26:34.282941+0000","last_unstale":"2024-09-10T06:27:23.788762+0000","last_undegraded":"2024-09-10T06:27:23.788762+0000","last_fullsized":"2024-09-10T06:27:23.788762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:29.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'9","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790398+0000","last_change":"2024-09-10T06:26:36.298510+0000","last_active":"2024-09-10T06:27:23.790398+0000","last_peered":"2024-09-10T06:27:23.790398+0000","last_clean":"2024-09-10T06:27:23.790398+0000","last_became_active":"2024-09-10T06:26:36.297309+0000","last_became_peered":"2024-09-10T06:26:36.297309+0000","last_unstale":"2024-09-10T06:27:23.790398+0000","last_undegraded":"2024-09-10T06:27:23.790398+0000","last_fullsized":"2024-09-10T06:27:23.790398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"31'2","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553369+0000","last_change":"2024-09-10T06:26:38.300228+0000","last_active":"2024-09-10T06:27:25.553369+0000","last_peered":"2024-09-10T06:27:25.553369+0000","last_clean":"2024-09-10T06:27:25.553369+0000","last_became_active":"2024-09-10T06:26:38.299355+0000","last_became_peered":"2024-09-10T06:26:38.299355+0000","last_unstale":"2024-09-10T06:27:25.553369+0000","last_undegraded":"2024-09-10T06:27:25.553369+0000","last_fullsized":"2024-09-10T06:27:25.553369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:20.050096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.785079+0000","last_change":"2024-09-10T06:26:32.271283+0000","last_active":"2024-09-10T06:27:23.785079+0000","last_peered":"2024-09-10T06:27:23.785079+0000","last_clean":"2024-09-10T06:27:23.785079+0000","last_became_active":"2024-09-10T06:26:32.270496+0000","last_became_peered":"2024-09-10T06:26:32.270496+0000","last_unstale":"2024-09-10T06:27:23.785079+0000","last_undegraded":"2024-09-10T06:27:23.785079+0000","last_fullsized":"2024-09-10T06:27:23.785079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.791342+0000","last_change":"2024-09-10T06:26:30.607373+0000","last_active":"2024-09-10T06:27:23.791342+0000","last_peered":"2024-09-10T06:27:23.791342+0000","last_clean":"2024-09-10T06:27:23.791342+0000","last_became_active":"2024-09-10T06:26:30.606685+0000","last_became_peered":"2024-09-10T06:26:30.606685+0000","last_unstale":"2024-09-10T06:27:23.791342+0000","last_undegraded":"2024-09-10T06:27:23.791342+0000","last_fullsized":"2024-09-10T06:27:23.791342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:35.705564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.787583+0000","last_change":"2024-09-10T06:26:34.286925+0000","last_active":"2024-09-10T06:27:23.787583+0000","last_peered":"2024-09-10T06:27:23.787583+0000","last_clean":"2024-09-10T06:27:23.787583+0000","last_became_active":"2024-09-10T06:26:34.285787+0000","last_became_peered":"2024-09-10T06:26:34.285787+0000","last_unstale":"2024-09-10T06:27:23.787583+0000","last_undegraded":"2024-09-10T06:27:23.787583+0000","last_fullsized":"2024-09-10T06:27:23.787583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"34'19","reported_seq":82,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.785527+0000","last_change":"2024-09-10T06:26:36.293988+0000","last_active":"2024-09-10T06:27:23.785527+0000","last_peered":"2024-09-10T06:27:23.785527+0000","last_clean":"2024-09-10T06:27:23.785527+0000","last_became_active":"2024-09-10T06:26:36.293226+0000","last_became_peered":"2024-09-10T06:26:36.293226+0000","last_unstale":"2024-09-10T06:27:23.785527+0000","last_undegraded":"2024-09-10T06:27:23.785527+0000","last_fullsized":"2024-09-10T06:27:23.785527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":50,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549424+0000","last_change":"2024-09-10T06:26:38.305826+0000","last_active":"2024-09-10T06:27:25.549424+0000","last_peered":"2024-09-10T06:27:25.549424+0000","last_clean":"2024-09-10T06:27:25.549424+0000","last_became_active":"2024-09-10T06:26:38.304601+0000","last_became_peered":"2024-09-10T06:26:38.304601+0000","last_unstale":"2024-09-10T06:27:25.549424+0000","last_undegraded":"2024-09-10T06:27:25.549424+0000","last_fullsized":"2024-09-10T06:27:25.549424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:12.545261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788151+0000","last_change":"2024-09-10T06:26:40.332286+0000","last_active":"2024-09-10T06:27:23.788151+0000","last_peered":"2024-09-10T06:27:23.788151+0000","last_clean":"2024-09-10T06:27:23.788151+0000","last_became_active":"2024-09-10T06:26:40.331262+0000","last_became_peered":"2024-09-10T06:26:40.331262+0000","last_unstale":"2024-09-10T06:27:23.788151+0000","last_undegraded":"2024-09-10T06:27:23.788151+0000","last_fullsized":"2024-09-10T06:27:23.788151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549517+0000","last_change":"2024-09-10T06:26:32.262320+0000","last_active":"2024-09-10T06:27:25.549517+0000","last_peered":"2024-09-10T06:27:25.549517+0000","last_clean":"2024-09-10T06:27:25.549517+0000","last_became_active":"2024-09-10T06:26:32.261423+0000","last_became_peered":"2024-09-10T06:26:32.261423+0000","last_unstale":"2024-09-10T06:27:25.549517+0000","last_undegraded":"2024-09-10T06:27:25.549517+0000","last_fullsized":"2024-09-10T06:27:25.549517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.791441+0000","last_change":"2024-09-10T06:26:30.595879+0000","last_active":"2024-09-10T06:27:23.791441+0000","last_peered":"2024-09-10T06:27:23.791441+0000","last_clean":"2024-09-10T06:27:23.791441+0000","last_became_active":"2024-09-10T06:26:30.595269+0000","last_became_peered":"2024-09-10T06:26:30.595269+0000","last_unstale":"2024-09-10T06:27:23.791441+0000","last_undegraded":"2024-09-10T06:27:23.791441+0000","last_fullsized":"2024-09-10T06:27:23.791441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.877795+0000","last_change":"2024-09-10T06:26:34.266906+0000","last_active":"2024-09-10T06:27:24.877795+0000","last_peered":"2024-09-10T06:27:24.877795+0000","last_clean":"2024-09-10T06:27:24.877795+0000","last_became_active":"2024-09-10T06:26:34.266017+0000","last_became_peered":"2024-09-10T06:26:34.266017+0000","last_unstale":"2024-09-10T06:27:24.877795+0000","last_undegraded":"2024-09-10T06:27:24.877795+0000","last_fullsized":"2024-09-10T06:27:24.877795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:24.366166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'9","reported_seq":71,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554095+0000","last_change":"2024-09-10T06:26:36.297020+0000","last_active":"2024-09-10T06:27:25.554095+0000","last_peered":"2024-09-10T06:27:25.554095+0000","last_clean":"2024-09-10T06:27:25.554095+0000","last_became_active":"2024-09-10T06:26:36.295796+0000","last_became_peered":"2024-09-10T06:26:36.295796+0000","last_unstale":"2024-09-10T06:27:25.554095+0000","last_undegraded":"2024-09-10T06:27:25.554095+0000","last_fullsized":"2024-09-10T06:27:25.554095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":51,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552934+0000","last_change":"2024-09-10T06:26:38.297273+0000","last_active":"2024-09-10T06:27:25.552934+0000","last_peered":"2024-09-10T06:27:25.552934+0000","last_clean":"2024-09-10T06:27:25.552934+0000","last_became_active":"2024-09-10T06:26:38.296455+0000","last_became_peered":"2024-09-10T06:26:38.296455+0000","last_unstale":"2024-09-10T06:27:25.552934+0000","last_undegraded":"2024-09-10T06:27:25.552934+0000","last_fullsized":"2024-09-10T06:27:25.552934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:26.766702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":44,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967944+0000","last_change":"2024-09-10T06:26:40.328294+0000","last_active":"2024-09-10T06:27:24.967944+0000","last_peered":"2024-09-10T06:27:24.967944+0000","last_clean":"2024-09-10T06:27:24.967944+0000","last_became_active":"2024-09-10T06:26:40.327585+0000","last_became_peered":"2024-09-10T06:26:40.327585+0000","last_unstale":"2024-09-10T06:27:24.967944+0000","last_undegraded":"2024-09-10T06:27:24.967944+0000","last_fullsized":"2024-09-10T06:27:24.967944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.537210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967641+0000","last_change":"2024-09-10T06:27:08.600683+0000","last_active":"2024-09-10T06:27:24.967641+0000","last_peered":"2024-09-10T06:27:24.967641+0000","last_clean":"2024-09-10T06:27:24.967641+0000","last_became_active":"2024-09-10T06:27:08.599875+0000","last_became_peered":"2024-09-10T06:27:08.599875+0000","last_unstale":"2024-09-10T06:27:24.967641+0000","last_undegraded":"2024-09-10T06:27:24.967641+0000","last_fullsized":"2024-09-10T06:27:24.967641+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:59.605814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.791024+0000","last_change":"2024-09-10T06:26:30.611704+0000","last_active":"2024-09-10T06:27:23.791024+0000","last_peered":"2024-09-10T06:27:23.791024+0000","last_clean":"2024-09-10T06:27:23.791024+0000","last_became_active":"2024-09-10T06:26:30.611039+0000","last_became_peered":"2024-09-10T06:26:30.611039+0000","last_unstale":"2024-09-10T06:27:23.791024+0000","last_undegraded":"2024-09-10T06:27:23.791024+0000","last_fullsized":"2024-09-10T06:27:23.791024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878477+0000","last_change":"2024-09-10T06:26:34.263514+0000","last_active":"2024-09-10T06:27:24.878477+0000","last_peered":"2024-09-10T06:27:24.878477+0000","last_clean":"2024-09-10T06:27:24.878477+0000","last_became_active":"2024-09-10T06:26:34.262793+0000","last_became_peered":"2024-09-10T06:26:34.262793+0000","last_unstale":"2024-09-10T06:27:24.878477+0000","last_undegraded":"2024-09-10T06:27:24.878477+0000","last_fullsized":"2024-09-10T06:27:24.878477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:31.501738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'15","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.783980+0000","last_change":"2024-09-10T06:26:36.299923+0000","last_active":"2024-09-10T06:27:23.783980+0000","last_peered":"2024-09-10T06:27:23.783980+0000","last_clean":"2024-09-10T06:27:23.783980+0000","last_became_active":"2024-09-10T06:26:36.299140+0000","last_became_peered":"2024-09-10T06:26:36.299140+0000","last_unstale":"2024-09-10T06:27:23.783980+0000","last_undegraded":"2024-09-10T06:27:23.783980+0000","last_fullsized":"2024-09-10T06:27:23.783980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:12.246303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"31'2","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781713+0000","last_change":"2024-09-10T06:26:38.292019+0000","last_active":"2024-09-10T06:27:23.781713+0000","last_peered":"2024-09-10T06:27:23.781713+0000","last_clean":"2024-09-10T06:27:23.781713+0000","last_became_active":"2024-09-10T06:26:38.291322+0000","last_became_peered":"2024-09-10T06:26:38.291322+0000","last_unstale":"2024-09-10T06:27:23.781713+0000","last_undegraded":"2024-09-10T06:27:23.781713+0000","last_fullsized":"2024-09-10T06:27:23.781713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780932+0000","last_change":"2024-09-10T06:26:40.328427+0000","last_active":"2024-09-10T06:27:23.780932+0000","last_peered":"2024-09-10T06:27:23.780932+0000","last_clean":"2024-09-10T06:27:23.780932+0000","last_became_active":"2024-09-10T06:26:40.323249+0000","last_became_peered":"2024-09-10T06:26:40.323249+0000","last_unstale":"2024-09-10T06:27:23.780932+0000","last_undegraded":"2024-09-10T06:27:23.780932+0000","last_fullsized":"2024-09-10T06:27:23.780932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:50.823195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780949+0000","last_change":"2024-09-10T06:26:32.274824+0000","last_active":"2024-09-10T06:27:23.780949+0000","last_peered":"2024-09-10T06:27:23.780949+0000","last_clean":"2024-09-10T06:27:23.780949+0000","last_became_active":"2024-09-10T06:26:32.274496+0000","last_became_peered":"2024-09-10T06:26:32.274496+0000","last_unstale":"2024-09-10T06:27:23.780949+0000","last_undegraded":"2024-09-10T06:27:23.780949+0000","last_fullsized":"2024-09-10T06:27:23.780949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:39.513476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788821+0000","last_change":"2024-09-10T06:26:30.604684+0000","last_active":"2024-09-10T06:27:23.788821+0000","last_peered":"2024-09-10T06:27:23.788821+0000","last_clean":"2024-09-10T06:27:23.788821+0000","last_became_active":"2024-09-10T06:26:30.593432+0000","last_became_peered":"2024-09-10T06:26:30.593432+0000","last_unstale":"2024-09-10T06:27:23.788821+0000","last_undegraded":"2024-09-10T06:27:23.788821+0000","last_fullsized":"2024-09-10T06:27:23.788821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878207+0000","last_change":"2024-09-10T06:26:34.256662+0000","last_active":"2024-09-10T06:27:24.878207+0000","last_peered":"2024-09-10T06:27:24.878207+0000","last_clean":"2024-09-10T06:27:24.878207+0000","last_became_active":"2024-09-10T06:26:34.256256+0000","last_became_peered":"2024-09-10T06:26:34.256256+0000","last_unstale":"2024-09-10T06:27:24.878207+0000","last_undegraded":"2024-09-10T06:27:24.878207+0000","last_fullsized":"2024-09-10T06:27:24.878207+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:35.549063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'12","reported_seq":74,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781926+0000","last_change":"2024-09-10T06:26:36.296631+0000","last_active":"2024-09-10T06:27:23.781926+0000","last_peered":"2024-09-10T06:27:23.781926+0000","last_clean":"2024-09-10T06:27:23.781926+0000","last_became_active":"2024-09-10T06:26:36.295838+0000","last_became_peered":"2024-09-10T06:26:36.295838+0000","last_unstale":"2024-09-10T06:27:23.781926+0000","last_undegraded":"2024-09-10T06:27:23.781926+0000","last_fullsized":"2024-09-10T06:27:23.781926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:04.271824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.877704+0000","last_change":"2024-09-10T06:26:38.308698+0000","last_active":"2024-09-10T06:27:24.877704+0000","last_peered":"2024-09-10T06:27:24.877704+0000","last_clean":"2024-09-10T06:27:24.877704+0000","last_became_active":"2024-09-10T06:26:38.307965+0000","last_became_peered":"2024-09-10T06:26:38.307965+0000","last_unstale":"2024-09-10T06:27:24.877704+0000","last_undegraded":"2024-09-10T06:27:24.877704+0000","last_fullsized":"2024-09-10T06:27:24.877704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:04.566221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551465+0000","last_change":"2024-09-10T06:26:40.326474+0000","last_active":"2024-09-10T06:27:25.551465+0000","last_peered":"2024-09-10T06:27:25.551465+0000","last_clean":"2024-09-10T06:27:25.551465+0000","last_became_active":"2024-09-10T06:26:40.325731+0000","last_became_peered":"2024-09-10T06:26:40.325731+0000","last_unstale":"2024-09-10T06:27:25.551465+0000","last_undegraded":"2024-09-10T06:27:25.551465+0000","last_fullsized":"2024-09-10T06:27:25.551465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:19.400355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550415+0000","last_change":"2024-09-10T06:26:32.254177+0000","last_active":"2024-09-10T06:27:25.550415+0000","last_peered":"2024-09-10T06:27:25.550415+0000","last_clean":"2024-09-10T06:27:25.550415+0000","last_became_active":"2024-09-10T06:26:32.253154+0000","last_became_peered":"2024-09-10T06:26:32.253154+0000","last_unstale":"2024-09-10T06:27:25.550415+0000","last_undegraded":"2024-09-10T06:27:25.550415+0000","last_fullsized":"2024-09-10T06:27:25.550415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553498+0000","last_change":"2024-09-10T06:26:30.572406+0000","last_active":"2024-09-10T06:27:25.553498+0000","last_peered":"2024-09-10T06:27:25.553498+0000","last_clean":"2024-09-10T06:27:25.553498+0000","last_became_active":"2024-09-10T06:26:30.571829+0000","last_became_peered":"2024-09-10T06:26:30.571829+0000","last_unstale":"2024-09-10T06:27:25.553498+0000","last_undegraded":"2024-09-10T06:27:25.553498+0000","last_fullsized":"2024-09-10T06:27:25.553498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878654+0000","last_change":"2024-09-10T06:26:34.285406+0000","last_active":"2024-09-10T06:27:24.878654+0000","last_peered":"2024-09-10T06:27:24.878654+0000","last_clean":"2024-09-10T06:27:24.878654+0000","last_became_active":"2024-09-10T06:26:34.285004+0000","last_became_peered":"2024-09-10T06:26:34.285004+0000","last_unstale":"2024-09-10T06:27:24.878654+0000","last_undegraded":"2024-09-10T06:27:24.878654+0000","last_fullsized":"2024-09-10T06:27:24.878654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:03.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'11","reported_seq":73,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551432+0000","last_change":"2024-09-10T06:26:36.293191+0000","last_active":"2024-09-10T06:27:25.551432+0000","last_peered":"2024-09-10T06:27:25.551432+0000","last_clean":"2024-09-10T06:27:25.551432+0000","last_became_active":"2024-09-10T06:26:36.292423+0000","last_became_peered":"2024-09-10T06:26:36.292423+0000","last_unstale":"2024-09-10T06:27:25.551432+0000","last_undegraded":"2024-09-10T06:27:25.551432+0000","last_fullsized":"2024-09-10T06:27:25.551432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781765+0000","last_change":"2024-09-10T06:26:38.293667+0000","last_active":"2024-09-10T06:27:23.781765+0000","last_peered":"2024-09-10T06:27:23.781765+0000","last_clean":"2024-09-10T06:27:23.781765+0000","last_became_active":"2024-09-10T06:26:38.292918+0000","last_became_peered":"2024-09-10T06:26:38.292918+0000","last_unstale":"2024-09-10T06:27:23.781765+0000","last_undegraded":"2024-09-10T06:27:23.781765+0000","last_fullsized":"2024-09-10T06:27:23.781765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:57.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552149+0000","last_change":"2024-09-10T06:26:40.327061+0000","last_active":"2024-09-10T06:27:25.552149+0000","last_peered":"2024-09-10T06:27:25.552149+0000","last_clean":"2024-09-10T06:27:25.552149+0000","last_became_active":"2024-09-10T06:26:40.326431+0000","last_became_peered":"2024-09-10T06:26:40.326431+0000","last_unstale":"2024-09-10T06:27:25.552149+0000","last_undegraded":"2024-09-10T06:27:25.552149+0000","last_fullsized":"2024-09-10T06:27:25.552149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:27.631214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551610+0000","last_change":"2024-09-10T06:26:32.255139+0000","last_active":"2024-09-10T06:27:25.551610+0000","last_peered":"2024-09-10T06:27:25.551610+0000","last_clean":"2024-09-10T06:27:25.551610+0000","last_became_active":"2024-09-10T06:26:32.253524+0000","last_became_peered":"2024-09-10T06:26:32.253524+0000","last_unstale":"2024-09-10T06:27:25.551610+0000","last_undegraded":"2024-09-10T06:27:25.551610+0000","last_fullsized":"2024-09-10T06:27:25.551610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967873+0000","last_change":"2024-09-10T06:26:30.591838+0000","last_active":"2024-09-10T06:27:24.967873+0000","last_peered":"2024-09-10T06:27:24.967873+0000","last_clean":"2024-09-10T06:27:24.967873+0000","last_became_active":"2024-09-10T06:26:30.591125+0000","last_became_peered":"2024-09-10T06:26:30.591125+0000","last_unstale":"2024-09-10T06:27:24.967873+0000","last_undegraded":"2024-09-10T06:27:24.967873+0000","last_fullsized":"2024-09-10T06:27:24.967873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549644+0000","last_change":"2024-09-10T06:26:34.280391+0000","last_active":"2024-09-10T06:27:25.549644+0000","last_peered":"2024-09-10T06:27:25.549644+0000","last_clean":"2024-09-10T06:27:25.549644+0000","last_became_active":"2024-09-10T06:26:34.280058+0000","last_became_peered":"2024-09-10T06:26:34.280058+0000","last_unstale":"2024-09-10T06:27:25.549644+0000","last_undegraded":"2024-09-10T06:27:25.549644+0000","last_fullsized":"2024-09-10T06:27:25.549644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.461857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'15","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.879124+0000","last_change":"2024-09-10T06:26:36.277547+0000","last_active":"2024-09-10T06:27:24.879124+0000","last_peered":"2024-09-10T06:27:24.879124+0000","last_clean":"2024-09-10T06:27:24.879124+0000","last_became_active":"2024-09-10T06:26:36.276965+0000","last_became_peered":"2024-09-10T06:26:36.276965+0000","last_unstale":"2024-09-10T06:27:24.879124+0000","last_undegraded":"2024-09-10T06:27:24.879124+0000","last_fullsized":"2024-09-10T06:27:24.879124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:43.212945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'2","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878716+0000","last_change":"2024-09-10T06:26:38.306134+0000","last_active":"2024-09-10T06:27:24.878716+0000","last_peered":"2024-09-10T06:27:24.878716+0000","last_clean":"2024-09-10T06:27:24.878716+0000","last_became_active":"2024-09-10T06:26:38.299012+0000","last_became_peered":"2024-09-10T06:26:38.299012+0000","last_unstale":"2024-09-10T06:27:24.878716+0000","last_undegraded":"2024-09-10T06:27:24.878716+0000","last_fullsized":"2024-09-10T06:27:24.878716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:37.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552167+0000","last_change":"2024-09-10T06:26:40.336036+0000","last_active":"2024-09-10T06:27:25.552167+0000","last_peered":"2024-09-10T06:27:25.552167+0000","last_clean":"2024-09-10T06:27:25.552167+0000","last_became_active":"2024-09-10T06:26:40.335302+0000","last_became_peered":"2024-09-10T06:26:40.335302+0000","last_unstale":"2024-09-10T06:27:25.552167+0000","last_undegraded":"2024-09-10T06:27:25.552167+0000","last_fullsized":"2024-09-10T06:27:25.552167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:24.024562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552106+0000","last_change":"2024-09-10T06:26:32.287897+0000","last_active":"2024-09-10T06:27:25.552106+0000","last_peered":"2024-09-10T06:27:25.552106+0000","last_clean":"2024-09-10T06:27:25.552106+0000","last_became_active":"2024-09-10T06:26:32.287315+0000","last_became_peered":"2024-09-10T06:26:32.287315+0000","last_unstale":"2024-09-10T06:27:25.552106+0000","last_undegraded":"2024-09-10T06:27:25.552106+0000","last_fullsized":"2024-09-10T06:27:25.552106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550645+0000","last_change":"2024-09-10T06:26:30.569192+0000","last_active":"2024-09-10T06:27:25.550645+0000","last_peered":"2024-09-10T06:27:25.550645+0000","last_clean":"2024-09-10T06:27:25.550645+0000","last_became_active":"2024-09-10T06:26:30.568464+0000","last_became_peered":"2024-09-10T06:26:30.568464+0000","last_unstale":"2024-09-10T06:27:25.550645+0000","last_undegraded":"2024-09-10T06:27:25.550645+0000","last_fullsized":"2024-09-10T06:27:25.550645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:58.987914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790144+0000","last_change":"2024-09-10T06:26:34.279935+0000","last_active":"2024-09-10T06:27:23.790144+0000","last_peered":"2024-09-10T06:27:23.790144+0000","last_clean":"2024-09-10T06:27:23.790144+0000","last_became_active":"2024-09-10T06:26:34.279192+0000","last_became_peered":"2024-09-10T06:26:34.279192+0000","last_unstale":"2024-09-10T06:27:23.790144+0000","last_undegraded":"2024-09-10T06:27:23.790144+0000","last_fullsized":"2024-09-10T06:27:23.790144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:18.753175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554174+0000","last_change":"2024-09-10T06:26:36.290330+0000","last_active":"2024-09-10T06:27:25.554174+0000","last_peered":"2024-09-10T06:27:25.554174+0000","last_clean":"2024-09-10T06:27:25.554174+0000","last_became_active":"2024-09-10T06:26:36.289527+0000","last_became_peered":"2024-09-10T06:26:36.289527+0000","last_unstale":"2024-09-10T06:27:25.554174+0000","last_undegraded":"2024-09-10T06:27:25.554174+0000","last_fullsized":"2024-09-10T06:27:25.554174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'2","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.968225+0000","last_change":"2024-09-10T06:26:38.288663+0000","last_active":"2024-09-10T06:27:24.968225+0000","last_peered":"2024-09-10T06:27:24.968225+0000","last_clean":"2024-09-10T06:27:24.968225+0000","last_became_active":"2024-09-10T06:26:38.287740+0000","last_became_peered":"2024-09-10T06:26:38.287740+0000","last_unstale":"2024-09-10T06:27:24.968225+0000","last_undegraded":"2024-09-10T06:27:24.968225+0000","last_fullsized":"2024-09-10T06:27:24.968225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:22.078943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550248+0000","last_change":"2024-09-10T06:26:40.329737+0000","last_active":"2024-09-10T06:27:25.550248+0000","last_peered":"2024-09-10T06:27:25.550248+0000","last_clean":"2024-09-10T06:27:25.550248+0000","last_became_active":"2024-09-10T06:26:40.328952+0000","last_became_peered":"2024-09-10T06:26:40.328952+0000","last_unstale":"2024-09-10T06:27:25.550248+0000","last_undegraded":"2024-09-10T06:27:25.550248+0000","last_fullsized":"2024-09-10T06:27:25.550248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551699+0000","last_change":"2024-09-10T06:26:32.270997+0000","last_active":"2024-09-10T06:27:25.551699+0000","last_peered":"2024-09-10T06:27:25.551699+0000","last_clean":"2024-09-10T06:27:25.551699+0000","last_became_active":"2024-09-10T06:26:32.270265+0000","last_became_peered":"2024-09-10T06:26:32.270265+0000","last_unstale":"2024-09-10T06:27:25.551699+0000","last_undegraded":"2024-09-10T06:27:25.551699+0000","last_fullsized":"2024-09-10T06:27:25.551699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:33.067523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":27,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.877577+0000","last_change":"2024-09-10T06:27:08.593158+0000","last_active":"2024-09-10T06:27:24.877577+0000","last_peered":"2024-09-10T06:27:24.877577+0000","last_clean":"2024-09-10T06:27:24.877577+0000","last_became_active":"2024-09-10T06:27:08.592864+0000","last_became_peered":"2024-09-10T06:27:08.592864+0000","last_unstale":"2024-09-10T06:27:24.877577+0000","last_undegraded":"2024-09-10T06:27:24.877577+0000","last_fullsized":"2024-09-10T06:27:24.877577+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:35.185591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551803+0000","last_change":"2024-09-10T06:26:34.286497+0000","last_active":"2024-09-10T06:27:25.551803+0000","last_peered":"2024-09-10T06:27:25.551803+0000","last_clean":"2024-09-10T06:27:25.551803+0000","last_became_active":"2024-09-10T06:26:34.285334+0000","last_became_peered":"2024-09-10T06:26:34.285334+0000","last_unstale":"2024-09-10T06:27:25.551803+0000","last_undegraded":"2024-09-10T06:27:25.551803+0000","last_fullsized":"2024-09-10T06:27:25.551803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:54.506182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'17","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788124+0000","last_change":"2024-09-10T06:26:36.288213+0000","last_active":"2024-09-10T06:27:23.788124+0000","last_peered":"2024-09-10T06:27:23.788124+0000","last_clean":"2024-09-10T06:27:23.788124+0000","last_became_active":"2024-09-10T06:26:36.287468+0000","last_became_peered":"2024-09-10T06:26:36.287468+0000","last_unstale":"2024-09-10T06:27:23.788124+0000","last_undegraded":"2024-09-10T06:27:23.788124+0000","last_fullsized":"2024-09-10T06:27:23.788124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967668+0000","last_change":"2024-09-10T06:26:38.291943+0000","last_active":"2024-09-10T06:27:24.967668+0000","last_peered":"2024-09-10T06:27:24.967668+0000","last_clean":"2024-09-10T06:27:24.967668+0000","last_became_active":"2024-09-10T06:26:38.291214+0000","last_became_peered":"2024-09-10T06:26:38.291214+0000","last_unstale":"2024-09-10T06:27:24.967668+0000","last_undegraded":"2024-09-10T06:27:24.967668+0000","last_fullsized":"2024-09-10T06:27:24.967668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:56.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549337+0000","last_change":"2024-09-10T06:26:40.331977+0000","last_active":"2024-09-10T06:27:25.549337+0000","last_peered":"2024-09-10T06:27:25.549337+0000","last_clean":"2024-09-10T06:27:25.549337+0000","last_became_active":"2024-09-10T06:26:40.331502+0000","last_became_peered":"2024-09-10T06:26:40.331502+0000","last_unstale":"2024-09-10T06:27:25.549337+0000","last_undegraded":"2024-09-10T06:27:25.549337+0000","last_fullsized":"2024-09-10T06:27:25.549337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:43.572813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.968532+0000","last_change":"2024-09-10T06:26:32.274623+0000","last_active":"2024-09-10T06:27:24.968532+0000","last_peered":"2024-09-10T06:27:24.968532+0000","last_clean":"2024-09-10T06:27:24.968532+0000","last_became_active":"2024-09-10T06:26:32.273727+0000","last_became_peered":"2024-09-10T06:26:32.273727+0000","last_unstale":"2024-09-10T06:27:24.968532+0000","last_undegraded":"2024-09-10T06:27:24.968532+0000","last_fullsized":"2024-09-10T06:27:24.968532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:15.364938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":166,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.784253+0000","last_change":"2024-09-10T06:26:18.153206+0000","last_active":"2024-09-10T06:27:23.784253+0000","last_peered":"2024-09-10T06:27:23.784253+0000","last_clean":"2024-09-10T06:27:23.784253+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:27:23.784253+0000","last_undegraded":"2024-09-10T06:27:23.784253+0000","last_fullsized":"2024-09-10T06:27:23.784253+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_clean_scrub_stamp":"2024-09-10T06:26:16.422775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:42.510577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":77,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.787866+0000","last_change":"2024-09-10T06:26:25.532465+0000","last_active":"2024-09-10T06:27:23.787866+0000","last_peered":"2024-09-10T06:27:23.787866+0000","last_clean":"2024-09-10T06:27:23.787866+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:27:23.787866+0000","last_undegraded":"2024-09-10T06:27:23.787866+0000","last_fullsized":"2024-09-10T06:27:23.787866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:10.318844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553233+0000","last_change":"2024-09-10T06:26:30.606630+0000","last_active":"2024-09-10T06:27:25.553233+0000","last_peered":"2024-09-10T06:27:25.553233+0000","last_clean":"2024-09-10T06:27:25.553233+0000","last_became_active":"2024-09-10T06:26:30.606348+0000","last_became_peered":"2024-09-10T06:26:30.606348+0000","last_unstale":"2024-09-10T06:27:25.553233+0000","last_undegraded":"2024-09-10T06:27:25.553233+0000","last_fullsized":"2024-09-10T06:27:25.553233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789872+0000","last_change":"2024-09-10T06:26:34.287201+0000","last_active":"2024-09-10T06:27:23.789872+0000","last_peered":"2024-09-10T06:27:23.789872+0000","last_clean":"2024-09-10T06:27:23.789872+0000","last_became_active":"2024-09-10T06:26:34.285248+0000","last_became_peered":"2024-09-10T06:26:34.285248+0000","last_unstale":"2024-09-10T06:27:23.789872+0000","last_undegraded":"2024-09-10T06:27:23.789872+0000","last_fullsized":"2024-09-10T06:27:23.789872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:43.907684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'13","reported_seq":78,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790436+0000","last_change":"2024-09-10T06:26:36.296684+0000","last_active":"2024-09-10T06:27:23.790436+0000","last_peered":"2024-09-10T06:27:23.790436+0000","last_clean":"2024-09-10T06:27:23.790436+0000","last_became_active":"2024-09-10T06:26:36.295901+0000","last_became_peered":"2024-09-10T06:26:36.295901+0000","last_unstale":"2024-09-10T06:27:23.790436+0000","last_undegraded":"2024-09-10T06:27:23.790436+0000","last_fullsized":"2024-09-10T06:27:23.790436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781016+0000","last_change":"2024-09-10T06:26:38.306412+0000","last_active":"2024-09-10T06:27:23.781016+0000","last_peered":"2024-09-10T06:27:23.781016+0000","last_clean":"2024-09-10T06:27:23.781016+0000","last_became_active":"2024-09-10T06:26:38.305496+0000","last_became_peered":"2024-09-10T06:26:38.305496+0000","last_unstale":"2024-09-10T06:27:23.781016+0000","last_undegraded":"2024-09-10T06:27:23.781016+0000","last_fullsized":"2024-09-10T06:27:23.781016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.370035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":44,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.966854+0000","last_change":"2024-09-10T06:26:40.331981+0000","last_active":"2024-09-10T06:27:24.966854+0000","last_peered":"2024-09-10T06:27:24.966854+0000","last_clean":"2024-09-10T06:27:24.966854+0000","last_became_active":"2024-09-10T06:26:40.331294+0000","last_became_peered":"2024-09-10T06:26:40.331294+0000","last_unstale":"2024-09-10T06:27:24.966854+0000","last_undegraded":"2024-09-10T06:27:24.966854+0000","last_fullsized":"2024-09-10T06:27:24.966854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:00.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781291+0000","last_change":"2024-09-10T06:26:32.278733+0000","last_active":"2024-09-10T06:27:23.781291+0000","last_peered":"2024-09-10T06:27:23.781291+0000","last_clean":"2024-09-10T06:27:23.781291+0000","last_became_active":"2024-09-10T06:26:32.278118+0000","last_became_peered":"2024-09-10T06:26:32.278118+0000","last_unstale":"2024-09-10T06:27:23.781291+0000","last_undegraded":"2024-09-10T06:27:23.781291+0000","last_fullsized":"2024-09-10T06:27:23.781291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:58.860666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.783748+0000","last_change":"2024-09-10T06:26:26.180664+0000","last_active":"2024-09-10T06:27:23.783748+0000","last_peered":"2024-09-10T06:27:23.783748+0000","last_clean":"2024-09-10T06:27:23.783748+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:27:23.783748+0000","last_undegraded":"2024-09-10T06:27:23.783748+0000","last_fullsized":"2024-09-10T06:27:23.783748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:28.793045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.782026+0000","last_change":"2024-09-10T06:26:30.594315+0000","last_active":"2024-09-10T06:27:23.782026+0000","last_peered":"2024-09-10T06:27:23.782026+0000","last_clean":"2024-09-10T06:27:23.782026+0000","last_became_active":"2024-09-10T06:26:30.593978+0000","last_became_peered":"2024-09-10T06:26:30.593978+0000","last_unstale":"2024-09-10T06:27:23.782026+0000","last_undegraded":"2024-09-10T06:27:23.782026+0000","last_fullsized":"2024-09-10T06:27:23.782026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:41.851632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790689+0000","last_change":"2024-09-10T06:26:34.279889+0000","last_active":"2024-09-10T06:27:23.790689+0000","last_peered":"2024-09-10T06:27:23.790689+0000","last_clean":"2024-09-10T06:27:23.790689+0000","last_became_active":"2024-09-10T06:26:34.279147+0000","last_became_peered":"2024-09-10T06:26:34.279147+0000","last_unstale":"2024-09-10T06:27:23.790689+0000","last_undegraded":"2024-09-10T06:27:23.790689+0000","last_fullsized":"2024-09-10T06:27:23.790689+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:02.260309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"34'23","reported_seq":105,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549564+0000","last_change":"2024-09-10T06:26:36.290005+0000","last_active":"2024-09-10T06:27:25.549564+0000","last_peered":"2024-09-10T06:27:25.549564+0000","last_clean":"2024-09-10T06:27:25.549564+0000","last_became_active":"2024-09-10T06:26:36.289232+0000","last_became_peered":"2024-09-10T06:26:36.289232+0000","last_unstale":"2024-09-10T06:27:25.549564+0000","last_undegraded":"2024-09-10T06:27:25.549564+0000","last_fullsized":"2024-09-10T06:27:25.549564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:51.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":46,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790355+0000","last_change":"2024-09-10T06:26:38.302505+0000","last_active":"2024-09-10T06:27:23.790355+0000","last_peered":"2024-09-10T06:27:23.790355+0000","last_clean":"2024-09-10T06:27:23.790355+0000","last_became_active":"2024-09-10T06:26:38.301104+0000","last_became_peered":"2024-09-10T06:26:38.301104+0000","last_unstale":"2024-09-10T06:27:23.790355+0000","last_undegraded":"2024-09-10T06:27:23.790355+0000","last_fullsized":"2024-09-10T06:27:23.790355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.863622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.548782+0000","last_change":"2024-09-10T06:26:40.320079+0000","last_active":"2024-09-10T06:27:25.548782+0000","last_peered":"2024-09-10T06:27:25.548782+0000","last_clean":"2024-09-10T06:27:25.548782+0000","last_became_active":"2024-09-10T06:26:40.319266+0000","last_became_peered":"2024-09-10T06:26:40.319266+0000","last_unstale":"2024-09-10T06:27:25.548782+0000","last_undegraded":"2024-09-10T06:27:25.548782+0000","last_fullsized":"2024-09-10T06:27:25.548782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:57.937745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551776+0000","last_change":"2024-09-10T06:26:32.282679+0000","last_active":"2024-09-10T06:27:25.551776+0000","last_peered":"2024-09-10T06:27:25.551776+0000","last_clean":"2024-09-10T06:27:25.551776+0000","last_became_active":"2024-09-10T06:26:32.282235+0000","last_became_peered":"2024-09-10T06:26:32.282235+0000","last_unstale":"2024-09-10T06:27:25.551776+0000","last_undegraded":"2024-09-10T06:27:25.551776+0000","last_fullsized":"2024-09-10T06:27:25.551776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:27.994318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878064+0000","last_change":"2024-09-10T06:26:25.979784+0000","last_active":"2024-09-10T06:27:24.878064+0000","last_peered":"2024-09-10T06:27:24.878064+0000","last_clean":"2024-09-10T06:27:24.878064+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:27:24.878064+0000","last_undegraded":"2024-09-10T06:27:24.878064+0000","last_fullsized":"2024-09-10T06:27:24.878064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:42.490682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.548499+0000","last_change":"2024-09-10T06:26:30.570558+0000","last_active":"2024-09-10T06:27:25.548499+0000","last_peered":"2024-09-10T06:27:25.548499+0000","last_clean":"2024-09-10T06:27:25.548499+0000","last_became_active":"2024-09-10T06:26:30.570037+0000","last_became_peered":"2024-09-10T06:26:30.570037+0000","last_unstale":"2024-09-10T06:27:25.548499+0000","last_undegraded":"2024-09-10T06:27:25.548499+0000","last_fullsized":"2024-09-10T06:27:25.548499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:46.692143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":58,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.879346+0000","last_change":"2024-09-10T06:26:34.284394+0000","last_active":"2024-09-10T06:27:24.879346+0000","last_peered":"2024-09-10T06:27:24.879346+0000","last_clean":"2024-09-10T06:27:24.879346+0000","last_became_active":"2024-09-10T06:26:34.283980+0000","last_became_peered":"2024-09-10T06:26:34.283980+0000","last_unstale":"2024-09-10T06:27:24.879346+0000","last_undegraded":"2024-09-10T06:27:24.879346+0000","last_fullsized":"2024-09-10T06:27:24.879346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:38.061123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'15","reported_seq":81,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790765+0000","last_change":"2024-09-10T06:26:36.302835+0000","last_active":"2024-09-10T06:27:23.790765+0000","last_peered":"2024-09-10T06:27:23.790765+0000","last_clean":"2024-09-10T06:27:23.790765+0000","last_became_active":"2024-09-10T06:26:36.299434+0000","last_became_peered":"2024-09-10T06:26:36.299434+0000","last_unstale":"2024-09-10T06:27:23.790765+0000","last_undegraded":"2024-09-10T06:27:23.790765+0000","last_fullsized":"2024-09-10T06:27:23.790765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781769+0000","last_change":"2024-09-10T06:26:38.292411+0000","last_active":"2024-09-10T06:27:23.781769+0000","last_peered":"2024-09-10T06:27:23.781769+0000","last_clean":"2024-09-10T06:27:23.781769+0000","last_became_active":"2024-09-10T06:26:38.291623+0000","last_became_peered":"2024-09-10T06:26:38.291623+0000","last_unstale":"2024-09-10T06:27:23.781769+0000","last_undegraded":"2024-09-10T06:27:23.781769+0000","last_fullsized":"2024-09-10T06:27:23.781769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553882+0000","last_change":"2024-09-10T06:26:40.303598+0000","last_active":"2024-09-10T06:27:25.553882+0000","last_peered":"2024-09-10T06:27:25.553882+0000","last_clean":"2024-09-10T06:27:25.553882+0000","last_became_active":"2024-09-10T06:26:40.302898+0000","last_became_peered":"2024-09-10T06:26:40.302898+0000","last_unstale":"2024-09-10T06:27:25.553882+0000","last_undegraded":"2024-09-10T06:27:25.553882+0000","last_fullsized":"2024-09-10T06:27:25.553882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:49.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549800+0000","last_change":"2024-09-10T06:26:32.273484+0000","last_active":"2024-09-10T06:27:25.549800+0000","last_peered":"2024-09-10T06:27:25.549800+0000","last_clean":"2024-09-10T06:27:25.549800+0000","last_became_active":"2024-09-10T06:26:32.273183+0000","last_became_peered":"2024-09-10T06:26:32.273183+0000","last_unstale":"2024-09-10T06:27:25.549800+0000","last_undegraded":"2024-09-10T06:27:25.549800+0000","last_fullsized":"2024-09-10T06:27:25.549800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:32.410538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":78,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.786299+0000","last_change":"2024-09-10T06:26:25.534289+0000","last_active":"2024-09-10T06:27:23.786299+0000","last_peered":"2024-09-10T06:27:23.786299+0000","last_clean":"2024-09-10T06:27:23.786299+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:27:23.786299+0000","last_undegraded":"2024-09-10T06:27:23.786299+0000","last_fullsized":"2024-09-10T06:27:23.786299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:11.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550649+0000","last_change":"2024-09-10T06:26:30.579693+0000","last_active":"2024-09-10T06:27:25.550649+0000","last_peered":"2024-09-10T06:27:25.550649+0000","last_clean":"2024-09-10T06:27:25.550649+0000","last_became_active":"2024-09-10T06:26:30.577934+0000","last_became_peered":"2024-09-10T06:26:30.577934+0000","last_unstale":"2024-09-10T06:27:25.550649+0000","last_undegraded":"2024-09-10T06:27:25.550649+0000","last_fullsized":"2024-09-10T06:27:25.550649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:35.852655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780422+0000","last_change":"2024-09-10T06:26:34.275458+0000","last_active":"2024-09-10T06:27:23.780422+0000","last_peered":"2024-09-10T06:27:23.780422+0000","last_clean":"2024-09-10T06:27:23.780422+0000","last_became_active":"2024-09-10T06:26:34.274705+0000","last_became_peered":"2024-09-10T06:26:34.274705+0000","last_unstale":"2024-09-10T06:27:23.780422+0000","last_undegraded":"2024-09-10T06:27:23.780422+0000","last_fullsized":"2024-09-10T06:27:23.780422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:20.624872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":73,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554900+0000","last_change":"2024-09-10T06:26:36.266077+0000","last_active":"2024-09-10T06:27:25.554900+0000","last_peered":"2024-09-10T06:27:25.554900+0000","last_clean":"2024-09-10T06:27:25.554900+0000","last_became_active":"2024-09-10T06:26:36.265322+0000","last_became_peered":"2024-09-10T06:26:36.265322+0000","last_unstale":"2024-09-10T06:27:25.554900+0000","last_undegraded":"2024-09-10T06:27:25.554900+0000","last_fullsized":"2024-09-10T06:27:25.554900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.969073+0000","last_change":"2024-09-10T06:26:38.296115+0000","last_active":"2024-09-10T06:27:24.969073+0000","last_peered":"2024-09-10T06:27:24.969073+0000","last_clean":"2024-09-10T06:27:24.969073+0000","last_became_active":"2024-09-10T06:26:38.295264+0000","last_became_peered":"2024-09-10T06:26:38.295264+0000","last_unstale":"2024-09-10T06:27:24.969073+0000","last_undegraded":"2024-09-10T06:27:24.969073+0000","last_fullsized":"2024-09-10T06:27:24.969073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:52:33.108384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.785734+0000","last_change":"2024-09-10T06:26:40.326887+0000","last_active":"2024-09-10T06:27:23.785734+0000","last_peered":"2024-09-10T06:27:23.785734+0000","last_clean":"2024-09-10T06:27:23.785734+0000","last_became_active":"2024-09-10T06:26:40.326130+0000","last_became_peered":"2024-09-10T06:26:40.326130+0000","last_unstale":"2024-09-10T06:27:23.785734+0000","last_undegraded":"2024-09-10T06:27:23.785734+0000","last_fullsized":"2024-09-10T06:27:23.785734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:28.237428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549031+0000","last_change":"2024-09-10T06:26:32.282586+0000","last_active":"2024-09-10T06:27:25.549031+0000","last_peered":"2024-09-10T06:27:25.549031+0000","last_clean":"2024-09-10T06:27:25.549031+0000","last_became_active":"2024-09-10T06:26:32.282086+0000","last_became_peered":"2024-09-10T06:26:32.282086+0000","last_unstale":"2024-09-10T06:27:25.549031+0000","last_undegraded":"2024-09-10T06:27:25.549031+0000","last_fullsized":"2024-09-10T06:27:25.549031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:44.269917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789004+0000","last_change":"2024-09-10T06:26:30.591913+0000","last_active":"2024-09-10T06:27:23.789004+0000","last_peered":"2024-09-10T06:27:23.789004+0000","last_clean":"2024-09-10T06:27:23.789004+0000","last_became_active":"2024-09-10T06:26:30.591140+0000","last_became_peered":"2024-09-10T06:26:30.591140+0000","last_unstale":"2024-09-10T06:27:23.789004+0000","last_undegraded":"2024-09-10T06:27:23.789004+0000","last_fullsized":"2024-09-10T06:27:23.789004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550016+0000","last_change":"2024-09-10T06:26:25.537497+0000","last_active":"2024-09-10T06:27:25.550016+0000","last_peered":"2024-09-10T06:27:25.550016+0000","last_clean":"2024-09-10T06:27:25.550016+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:27:25.550016+0000","last_undegraded":"2024-09-10T06:27:25.550016+0000","last_fullsized":"2024-09-10T06:27:25.550016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:44.787852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780701+0000","last_change":"2024-09-10T06:26:34.276099+0000","last_active":"2024-09-10T06:27:23.780701+0000","last_peered":"2024-09-10T06:27:23.780701+0000","last_clean":"2024-09-10T06:27:23.780701+0000","last_became_active":"2024-09-10T06:26:34.273984+0000","last_became_peered":"2024-09-10T06:26:34.273984+0000","last_unstale":"2024-09-10T06:27:23.780701+0000","last_undegraded":"2024-09-10T06:27:23.780701+0000","last_fullsized":"2024-09-10T06:27:23.780701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'18","reported_seq":83,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780036+0000","last_change":"2024-09-10T06:26:36.272589+0000","last_active":"2024-09-10T06:27:23.780036+0000","last_peered":"2024-09-10T06:27:23.780036+0000","last_clean":"2024-09-10T06:27:23.780036+0000","last_became_active":"2024-09-10T06:26:36.270914+0000","last_became_peered":"2024-09-10T06:26:36.270914+0000","last_unstale":"2024-09-10T06:27:23.780036+0000","last_undegraded":"2024-09-10T06:27:23.780036+0000","last_fullsized":"2024-09-10T06:27:23.780036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:20.764690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":50,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549179+0000","last_change":"2024-09-10T06:26:38.278069+0000","last_active":"2024-09-10T06:27:25.549179+0000","last_peered":"2024-09-10T06:27:25.549179+0000","last_clean":"2024-09-10T06:27:25.549179+0000","last_became_active":"2024-09-10T06:26:38.277261+0000","last_became_peered":"2024-09-10T06:26:38.277261+0000","last_unstale":"2024-09-10T06:27:25.549179+0000","last_undegraded":"2024-09-10T06:27:25.549179+0000","last_fullsized":"2024-09-10T06:27:25.549179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780701+0000","last_change":"2024-09-10T06:26:40.333741+0000","last_active":"2024-09-10T06:27:23.780701+0000","last_peered":"2024-09-10T06:27:23.780701+0000","last_clean":"2024-09-10T06:27:23.780701+0000","last_became_active":"2024-09-10T06:26:40.329701+0000","last_became_peered":"2024-09-10T06:26:40.329701+0000","last_unstale":"2024-09-10T06:27:23.780701+0000","last_undegraded":"2024-09-10T06:27:23.780701+0000","last_fullsized":"2024-09-10T06:27:23.780701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:53.704790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780873+0000","last_change":"2024-09-10T06:26:32.275551+0000","last_active":"2024-09-10T06:27:23.780873+0000","last_peered":"2024-09-10T06:27:23.780873+0000","last_clean":"2024-09-10T06:27:23.780873+0000","last_became_active":"2024-09-10T06:26:32.274946+0000","last_became_peered":"2024-09-10T06:26:32.274946+0000","last_unstale":"2024-09-10T06:27:23.780873+0000","last_undegraded":"2024-09-10T06:27:23.780873+0000","last_fullsized":"2024-09-10T06:27:23.780873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549874+0000","last_change":"2024-09-10T06:26:30.565595+0000","last_active":"2024-09-10T06:27:25.549874+0000","last_peered":"2024-09-10T06:27:25.549874+0000","last_clean":"2024-09-10T06:27:25.549874+0000","last_became_active":"2024-09-10T06:26:30.565220+0000","last_became_peered":"2024-09-10T06:26:30.565220+0000","last_unstale":"2024-09-10T06:27:25.549874+0000","last_undegraded":"2024-09-10T06:27:25.549874+0000","last_fullsized":"2024-09-10T06:27:25.549874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:14.600216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.791313+0000","last_change":"2024-09-10T06:26:26.180820+0000","last_active":"2024-09-10T06:27:23.791313+0000","last_peered":"2024-09-10T06:27:23.791313+0000","last_clean":"2024-09-10T06:27:23.791313+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:27:23.791313+0000","last_undegraded":"2024-09-10T06:27:23.791313+0000","last_fullsized":"2024-09-10T06:27:23.791313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:51.928304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":56,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967351+0000","last_change":"2024-09-10T06:26:34.272915+0000","last_active":"2024-09-10T06:27:24.967351+0000","last_peered":"2024-09-10T06:27:24.967351+0000","last_clean":"2024-09-10T06:27:24.967351+0000","last_became_active":"2024-09-10T06:26:34.272192+0000","last_became_peered":"2024-09-10T06:26:34.272192+0000","last_unstale":"2024-09-10T06:27:24.967351+0000","last_undegraded":"2024-09-10T06:27:24.967351+0000","last_fullsized":"2024-09-10T06:27:24.967351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:07.874348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":75,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.548286+0000","last_change":"2024-09-10T06:26:36.291431+0000","last_active":"2024-09-10T06:27:25.548286+0000","last_peered":"2024-09-10T06:27:25.548286+0000","last_clean":"2024-09-10T06:27:25.548286+0000","last_became_active":"2024-09-10T06:26:36.290570+0000","last_became_peered":"2024-09-10T06:26:36.290570+0000","last_unstale":"2024-09-10T06:27:25.548286+0000","last_undegraded":"2024-09-10T06:27:25.548286+0000","last_fullsized":"2024-09-10T06:27:25.548286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:10.565531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'2","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.784925+0000","last_change":"2024-09-10T06:26:38.312069+0000","last_active":"2024-09-10T06:27:23.784925+0000","last_peered":"2024-09-10T06:27:23.784925+0000","last_clean":"2024-09-10T06:27:23.784925+0000","last_became_active":"2024-09-10T06:26:38.310450+0000","last_became_peered":"2024-09-10T06:26:38.310450+0000","last_unstale":"2024-09-10T06:27:23.784925+0000","last_undegraded":"2024-09-10T06:27:23.784925+0000","last_fullsized":"2024-09-10T06:27:23.784925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553748+0000","last_change":"2024-09-10T06:26:40.312990+0000","last_active":"2024-09-10T06:27:25.553748+0000","last_peered":"2024-09-10T06:27:25.553748+0000","last_clean":"2024-09-10T06:27:25.553748+0000","last_became_active":"2024-09-10T06:26:40.312266+0000","last_became_peered":"2024-09-10T06:26:40.312266+0000","last_unstale":"2024-09-10T06:27:25.553748+0000","last_undegraded":"2024-09-10T06:27:25.553748+0000","last_fullsized":"2024-09-10T06:27:25.553748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:15.777105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552576+0000","last_change":"2024-09-10T06:26:32.258874+0000","last_active":"2024-09-10T06:27:25.552576+0000","last_peered":"2024-09-10T06:27:25.552576+0000","last_clean":"2024-09-10T06:27:25.552576+0000","last_became_active":"2024-09-10T06:26:32.258337+0000","last_became_peered":"2024-09-10T06:26:32.258337+0000","last_unstale":"2024-09-10T06:27:25.552576+0000","last_undegraded":"2024-09-10T06:27:25.552576+0000","last_fullsized":"2024-09-10T06:27:25.552576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553502+0000","last_change":"2024-09-10T06:26:30.581501+0000","last_active":"2024-09-10T06:27:25.553502+0000","last_peered":"2024-09-10T06:27:25.553502+0000","last_clean":"2024-09-10T06:27:25.553502+0000","last_became_active":"2024-09-10T06:26:30.581115+0000","last_became_peered":"2024-09-10T06:26:30.581115+0000","last_unstale":"2024-09-10T06:27:25.553502+0000","last_undegraded":"2024-09-10T06:27:25.553502+0000","last_fullsized":"2024-09-10T06:27:25.553502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551295+0000","last_change":"2024-09-10T06:26:25.537295+0000","last_active":"2024-09-10T06:27:25.551295+0000","last_peered":"2024-09-10T06:27:25.551295+0000","last_clean":"2024-09-10T06:27:25.551295+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:27:25.551295+0000","last_undegraded":"2024-09-10T06:27:25.551295+0000","last_fullsized":"2024-09-10T06:27:25.551295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:32.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549425+0000","last_change":"2024-09-10T06:26:34.258956+0000","last_active":"2024-09-10T06:27:25.549425+0000","last_peered":"2024-09-10T06:27:25.549425+0000","last_clean":"2024-09-10T06:27:25.549425+0000","last_became_active":"2024-09-10T06:26:34.257739+0000","last_became_peered":"2024-09-10T06:26:34.257739+0000","last_unstale":"2024-09-10T06:27:25.549425+0000","last_undegraded":"2024-09-10T06:27:25.549425+0000","last_fullsized":"2024-09-10T06:27:25.549425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:18.547827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'10","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550530+0000","last_change":"2024-09-10T06:26:36.271096+0000","last_active":"2024-09-10T06:27:25.550530+0000","last_peered":"2024-09-10T06:27:25.550530+0000","last_clean":"2024-09-10T06:27:25.550530+0000","last_became_active":"2024-09-10T06:26:36.270325+0000","last_became_peered":"2024-09-10T06:26:36.270325+0000","last_unstale":"2024-09-10T06:27:25.550530+0000","last_undegraded":"2024-09-10T06:27:25.550530+0000","last_fullsized":"2024-09-10T06:27:25.550530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"31'2","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554368+0000","last_change":"2024-09-10T06:26:38.300795+0000","last_active":"2024-09-10T06:27:25.554368+0000","last_peered":"2024-09-10T06:27:25.554368+0000","last_clean":"2024-09-10T06:27:25.554368+0000","last_became_active":"2024-09-10T06:26:38.299466+0000","last_became_peered":"2024-09-10T06:26:38.299466+0000","last_unstale":"2024-09-10T06:27:25.554368+0000","last_undegraded":"2024-09-10T06:27:25.554368+0000","last_fullsized":"2024-09-10T06:27:25.554368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:38.641500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781848+0000","last_change":"2024-09-10T06:26:40.329688+0000","last_active":"2024-09-10T06:27:23.781848+0000","last_peered":"2024-09-10T06:27:23.781848+0000","last_clean":"2024-09-10T06:27:23.781848+0000","last_became_active":"2024-09-10T06:26:40.329009+0000","last_became_peered":"2024-09-10T06:26:40.329009+0000","last_unstale":"2024-09-10T06:27:23.781848+0000","last_undegraded":"2024-09-10T06:27:23.781848+0000","last_fullsized":"2024-09-10T06:27:23.781848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549665+0000","last_change":"2024-09-10T06:26:32.283524+0000","last_active":"2024-09-10T06:27:25.549665+0000","last_peered":"2024-09-10T06:27:25.549665+0000","last_clean":"2024-09-10T06:27:25.549665+0000","last_became_active":"2024-09-10T06:26:32.282794+0000","last_became_peered":"2024-09-10T06:26:32.282794+0000","last_unstale":"2024-09-10T06:27:25.549665+0000","last_undegraded":"2024-09-10T06:27:25.549665+0000","last_fullsized":"2024-09-10T06:27:25.549665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:11.537416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781488+0000","last_change":"2024-09-10T06:26:30.578273+0000","last_active":"2024-09-10T06:27:23.781488+0000","last_peered":"2024-09-10T06:27:23.781488+0000","last_clean":"2024-09-10T06:27:23.781488+0000","last_became_active":"2024-09-10T06:26:30.577985+0000","last_became_peered":"2024-09-10T06:26:30.577985+0000","last_unstale":"2024-09-10T06:27:23.781488+0000","last_undegraded":"2024-09-10T06:27:23.781488+0000","last_fullsized":"2024-09-10T06:27:23.781488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.969344+0000","last_change":"2024-09-10T06:26:26.037773+0000","last_active":"2024-09-10T06:27:24.969344+0000","last_peered":"2024-09-10T06:27:24.969344+0000","last_clean":"2024-09-10T06:27:24.969344+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:27:24.969344+0000","last_undegraded":"2024-09-10T06:27:24.969344+0000","last_fullsized":"2024-09-10T06:27:24.969344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:21.949708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":59,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552446+0000","last_change":"2024-09-10T06:26:34.268710+0000","last_active":"2024-09-10T06:27:25.552446+0000","last_peered":"2024-09-10T06:27:25.552446+0000","last_clean":"2024-09-10T06:27:25.552446+0000","last_became_active":"2024-09-10T06:26:34.268359+0000","last_became_peered":"2024-09-10T06:26:34.268359+0000","last_unstale":"2024-09-10T06:27:25.552446+0000","last_undegraded":"2024-09-10T06:27:25.552446+0000","last_fullsized":"2024-09-10T06:27:25.552446+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:27.191787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'19","reported_seq":86,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789436+0000","last_change":"2024-09-10T06:26:36.299700+0000","last_active":"2024-09-10T06:27:23.789436+0000","last_peered":"2024-09-10T06:27:23.789436+0000","last_clean":"2024-09-10T06:27:23.789436+0000","last_became_active":"2024-09-10T06:26:36.297606+0000","last_became_peered":"2024-09-10T06:26:36.297606+0000","last_unstale":"2024-09-10T06:27:23.789436+0000","last_undegraded":"2024-09-10T06:27:23.789436+0000","last_fullsized":"2024-09-10T06:27:23.789436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":51,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553011+0000","last_change":"2024-09-10T06:26:38.290601+0000","last_active":"2024-09-10T06:27:25.553011+0000","last_peered":"2024-09-10T06:27:25.553011+0000","last_clean":"2024-09-10T06:27:25.553011+0000","last_became_active":"2024-09-10T06:26:38.289589+0000","last_became_peered":"2024-09-10T06:26:38.289589+0000","last_unstale":"2024-09-10T06:27:25.553011+0000","last_undegraded":"2024-09-10T06:27:25.553011+0000","last_fullsized":"2024-09-10T06:27:25.553011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:22.625936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788100+0000","last_change":"2024-09-10T06:26:40.332819+0000","last_active":"2024-09-10T06:27:23.788100+0000","last_peered":"2024-09-10T06:27:23.788100+0000","last_clean":"2024-09-10T06:27:23.788100+0000","last_became_active":"2024-09-10T06:26:40.332160+0000","last_became_peered":"2024-09-10T06:26:40.332160+0000","last_unstale":"2024-09-10T06:27:23.788100+0000","last_undegraded":"2024-09-10T06:27:23.788100+0000","last_fullsized":"2024-09-10T06:27:23.788100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.784870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781639+0000","last_change":"2024-09-10T06:26:40.334393+0000","last_active":"2024-09-10T06:27:23.781639+0000","last_peered":"2024-09-10T06:27:23.781639+0000","last_clean":"2024-09-10T06:27:23.781639+0000","last_became_active":"2024-09-10T06:26:40.333474+0000","last_became_peered":"2024-09-10T06:26:40.333474+0000","last_unstale":"2024-09-10T06:27:23.781639+0000","last_undegraded":"2024-09-10T06:27:23.781639+0000","last_fullsized":"2024-09-10T06:27:23.781639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:35.031954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550167+0000","last_change":"2024-09-10T06:26:32.272914+0000","last_active":"2024-09-10T06:27:25.550167+0000","last_peered":"2024-09-10T06:27:25.550167+0000","last_clean":"2024-09-10T06:27:25.550167+0000","last_became_active":"2024-09-10T06:26:32.272178+0000","last_became_peered":"2024-09-10T06:26:32.272178+0000","last_unstale":"2024-09-10T06:27:25.550167+0000","last_undegraded":"2024-09-10T06:27:25.550167+0000","last_fullsized":"2024-09-10T06:27:25.550167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549946+0000","last_change":"2024-09-10T06:26:30.593531+0000","last_active":"2024-09-10T06:27:25.549946+0000","last_peered":"2024-09-10T06:27:25.549946+0000","last_clean":"2024-09-10T06:27:25.549946+0000","last_became_active":"2024-09-10T06:26:30.592753+0000","last_became_peered":"2024-09-10T06:26:30.592753+0000","last_unstale":"2024-09-10T06:27:25.549946+0000","last_undegraded":"2024-09-10T06:27:25.549946+0000","last_fullsized":"2024-09-10T06:27:25.549946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:14.506864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549103+0000","last_change":"2024-09-10T06:26:34.282877+0000","last_active":"2024-09-10T06:27:25.549103+0000","last_peered":"2024-09-10T06:27:25.549103+0000","last_clean":"2024-09-10T06:27:25.549103+0000","last_became_active":"2024-09-10T06:26:34.282281+0000","last_became_peered":"2024-09-10T06:26:34.282281+0000","last_unstale":"2024-09-10T06:27:25.549103+0000","last_undegraded":"2024-09-10T06:27:25.549103+0000","last_fullsized":"2024-09-10T06:27:25.549103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:41.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'11","reported_seq":74,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552715+0000","last_change":"2024-09-10T06:26:36.273166+0000","last_active":"2024-09-10T06:27:25.552715+0000","last_peered":"2024-09-10T06:27:25.552715+0000","last_clean":"2024-09-10T06:27:25.552715+0000","last_became_active":"2024-09-10T06:26:36.272386+0000","last_became_peered":"2024-09-10T06:26:36.272386+0000","last_unstale":"2024-09-10T06:27:25.552715+0000","last_undegraded":"2024-09-10T06:27:25.552715+0000","last_fullsized":"2024-09-10T06:27:25.552715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":51,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552300+0000","last_change":"2024-09-10T06:26:38.297347+0000","last_active":"2024-09-10T06:27:25.552300+0000","last_peered":"2024-09-10T06:27:25.552300+0000","last_clean":"2024-09-10T06:27:25.552300+0000","last_became_active":"2024-09-10T06:26:38.296600+0000","last_became_peered":"2024-09-10T06:26:38.296600+0000","last_unstale":"2024-09-10T06:27:25.552300+0000","last_undegraded":"2024-09-10T06:27:25.552300+0000","last_fullsized":"2024-09-10T06:27:25.552300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:08.758126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554703+0000","last_change":"2024-09-10T06:26:40.321844+0000","last_active":"2024-09-10T06:27:25.554703+0000","last_peered":"2024-09-10T06:27:25.554703+0000","last_clean":"2024-09-10T06:27:25.554703+0000","last_became_active":"2024-09-10T06:26:40.321097+0000","last_became_peered":"2024-09-10T06:26:40.321097+0000","last_unstale":"2024-09-10T06:27:25.554703+0000","last_undegraded":"2024-09-10T06:27:25.554703+0000","last_fullsized":"2024-09-10T06:27:25.554703+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:10.004849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.548955+0000","last_change":"2024-09-10T06:26:32.286989+0000","last_active":"2024-09-10T06:27:25.548955+0000","last_peered":"2024-09-10T06:27:25.548955+0000","last_clean":"2024-09-10T06:27:25.548955+0000","last_became_active":"2024-09-10T06:26:32.286519+0000","last_became_peered":"2024-09-10T06:26:32.286519+0000","last_unstale":"2024-09-10T06:27:25.548955+0000","last_undegraded":"2024-09-10T06:27:25.548955+0000","last_fullsized":"2024-09-10T06:27:25.548955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:31.592472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790937+0000","last_change":"2024-09-10T06:26:30.587315+0000","last_active":"2024-09-10T06:27:23.790937+0000","last_peered":"2024-09-10T06:27:23.790937+0000","last_clean":"2024-09-10T06:27:23.790937+0000","last_became_active":"2024-09-10T06:26:30.586611+0000","last_became_peered":"2024-09-10T06:26:30.586611+0000","last_unstale":"2024-09-10T06:27:23.790937+0000","last_undegraded":"2024-09-10T06:27:23.790937+0000","last_fullsized":"2024-09-10T06:27:23.790937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"27'1","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553794+0000","last_change":"2024-09-10T06:26:34.271770+0000","last_active":"2024-09-10T06:27:25.553794+0000","last_peered":"2024-09-10T06:27:25.553794+0000","last_clean":"2024-09-10T06:27:25.553794+0000","last_became_active":"2024-09-10T06:26:34.269875+0000","last_became_peered":"2024-09-10T06:26:34.269875+0000","last_unstale":"2024-09-10T06:27:25.553794+0000","last_undegraded":"2024-09-10T06:27:25.553794+0000","last_fullsized":"2024-09-10T06:27:25.553794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:09.570079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"42'5","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.779906+0000","last_change":"2024-09-10T06:26:36.289140+0000","last_active":"2024-09-10T06:27:23.779906+0000","last_peered":"2024-09-10T06:27:23.779906+0000","last_clean":"2024-09-10T06:27:23.779906+0000","last_became_active":"2024-09-10T06:26:36.288355+0000","last_became_peered":"2024-09-10T06:26:36.288355+0000","last_unstale":"2024-09-10T06:27:23.779906+0000","last_undegraded":"2024-09-10T06:27:23.779906+0000","last_fullsized":"2024-09-10T06:27:23.779906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:42.518982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":46,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.787832+0000","last_change":"2024-09-10T06:26:38.302040+0000","last_active":"2024-09-10T06:27:23.787832+0000","last_peered":"2024-09-10T06:27:23.787832+0000","last_clean":"2024-09-10T06:27:23.787832+0000","last_became_active":"2024-09-10T06:26:38.301064+0000","last_became_peered":"2024-09-10T06:26:38.301064+0000","last_unstale":"2024-09-10T06:27:23.787832+0000","last_undegraded":"2024-09-10T06:27:23.787832+0000","last_fullsized":"2024-09-10T06:27:23.787832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:41.513255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780330+0000","last_change":"2024-09-10T06:26:40.322368+0000","last_active":"2024-09-10T06:27:23.780330+0000","last_peered":"2024-09-10T06:27:23.780330+0000","last_clean":"2024-09-10T06:27:23.780330+0000","last_became_active":"2024-09-10T06:26:40.321592+0000","last_became_peered":"2024-09-10T06:26:40.321592+0000","last_unstale":"2024-09-10T06:27:23.780330+0000","last_undegraded":"2024-09-10T06:27:23.780330+0000","last_fullsized":"2024-09-10T06:27:23.780330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:03.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553059+0000","last_change":"2024-09-10T06:26:32.259666+0000","last_active":"2024-09-10T06:27:25.553059+0000","last_peered":"2024-09-10T06:27:25.553059+0000","last_clean":"2024-09-10T06:27:25.553059+0000","last_became_active":"2024-09-10T06:26:32.258775+0000","last_became_peered":"2024-09-10T06:26:32.258775+0000","last_unstale":"2024-09-10T06:27:25.553059+0000","last_undegraded":"2024-09-10T06:27:25.553059+0000","last_fullsized":"2024-09-10T06:27:25.553059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789514+0000","last_change":"2024-09-10T06:26:30.592773+0000","last_active":"2024-09-10T06:27:23.789514+0000","last_peered":"2024-09-10T06:27:23.789514+0000","last_clean":"2024-09-10T06:27:23.789514+0000","last_became_active":"2024-09-10T06:26:30.590566+0000","last_became_peered":"2024-09-10T06:26:30.590566+0000","last_unstale":"2024-09-10T06:27:23.789514+0000","last_undegraded":"2024-09-10T06:27:23.789514+0000","last_fullsized":"2024-09-10T06:27:23.789514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:35.688897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.782647+0000","last_change":"2024-09-10T06:26:34.281690+0000","last_active":"2024-09-10T06:27:23.782647+0000","last_peered":"2024-09-10T06:27:23.782647+0000","last_clean":"2024-09-10T06:27:23.782647+0000","last_became_active":"2024-09-10T06:26:34.281008+0000","last_became_peered":"2024-09-10T06:26:34.281008+0000","last_unstale":"2024-09-10T06:27:23.782647+0000","last_undegraded":"2024-09-10T06:27:23.782647+0000","last_fullsized":"2024-09-10T06:27:23.782647+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'11","reported_seq":74,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553627+0000","last_change":"2024-09-10T06:26:36.277028+0000","last_active":"2024-09-10T06:27:25.553627+0000","last_peered":"2024-09-10T06:27:25.553627+0000","last_clean":"2024-09-10T06:27:25.553627+0000","last_became_active":"2024-09-10T06:26:36.276248+0000","last_became_peered":"2024-09-10T06:26:36.276248+0000","last_unstale":"2024-09-10T06:27:25.553627+0000","last_undegraded":"2024-09-10T06:27:25.553627+0000","last_fullsized":"2024-09-10T06:27:25.553627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:53.521681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967337+0000","last_change":"2024-09-10T06:26:38.294889+0000","last_active":"2024-09-10T06:27:24.967337+0000","last_peered":"2024-09-10T06:27:24.967337+0000","last_clean":"2024-09-10T06:27:24.967337+0000","last_became_active":"2024-09-10T06:26:38.294124+0000","last_became_peered":"2024-09-10T06:26:38.294124+0000","last_unstale":"2024-09-10T06:27:24.967337+0000","last_undegraded":"2024-09-10T06:27:24.967337+0000","last_fullsized":"2024-09-10T06:27:24.967337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:42.905517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.787675+0000","last_change":"2024-09-10T06:26:40.331445+0000","last_active":"2024-09-10T06:27:23.787675+0000","last_peered":"2024-09-10T06:27:23.787675+0000","last_clean":"2024-09-10T06:27:23.787675+0000","last_became_active":"2024-09-10T06:26:40.330707+0000","last_became_peered":"2024-09-10T06:26:40.330707+0000","last_unstale":"2024-09-10T06:27:23.787675+0000","last_undegraded":"2024-09-10T06:27:23.787675+0000","last_fullsized":"2024-09-10T06:27:23.787675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.822687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552698+0000","last_change":"2024-09-10T06:26:32.266221+0000","last_active":"2024-09-10T06:27:25.552698+0000","last_peered":"2024-09-10T06:27:25.552698+0000","last_clean":"2024-09-10T06:27:25.552698+0000","last_became_active":"2024-09-10T06:26:32.265705+0000","last_became_peered":"2024-09-10T06:26:32.265705+0000","last_unstale":"2024-09-10T06:27:25.552698+0000","last_undegraded":"2024-09-10T06:27:25.552698+0000","last_fullsized":"2024-09-10T06:27:25.552698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.782082+0000","last_change":"2024-09-10T06:26:30.594335+0000","last_active":"2024-09-10T06:27:23.782082+0000","last_peered":"2024-09-10T06:27:23.782082+0000","last_clean":"2024-09-10T06:27:23.782082+0000","last_became_active":"2024-09-10T06:26:30.593326+0000","last_became_peered":"2024-09-10T06:26:30.593326+0000","last_unstale":"2024-09-10T06:27:23.782082+0000","last_undegraded":"2024-09-10T06:27:23.782082+0000","last_fullsized":"2024-09-10T06:27:23.782082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:37.297722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":56,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967347+0000","last_change":"2024-09-10T06:26:34.281915+0000","last_active":"2024-09-10T06:27:24.967347+0000","last_peered":"2024-09-10T06:27:24.967347+0000","last_clean":"2024-09-10T06:27:24.967347+0000","last_became_active":"2024-09-10T06:26:34.281147+0000","last_became_peered":"2024-09-10T06:26:34.281147+0000","last_unstale":"2024-09-10T06:27:24.967347+0000","last_undegraded":"2024-09-10T06:27:24.967347+0000","last_fullsized":"2024-09-10T06:27:24.967347+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:41.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"34'9","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789088+0000","last_change":"2024-09-10T06:26:36.298537+0000","last_active":"2024-09-10T06:27:23.789088+0000","last_peered":"2024-09-10T06:27:23.789088+0000","last_clean":"2024-09-10T06:27:23.789088+0000","last_became_active":"2024-09-10T06:26:36.297372+0000","last_became_peered":"2024-09-10T06:26:36.297372+0000","last_unstale":"2024-09-10T06:27:23.789088+0000","last_undegraded":"2024-09-10T06:27:23.789088+0000","last_fullsized":"2024-09-10T06:27:23.789088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.779606+0000","last_change":"2024-09-10T06:26:38.301461+0000","last_active":"2024-09-10T06:27:23.779606+0000","last_peered":"2024-09-10T06:27:23.779606+0000","last_clean":"2024-09-10T06:27:23.779606+0000","last_became_active":"2024-09-10T06:26:38.300580+0000","last_became_peered":"2024-09-10T06:26:38.300580+0000","last_unstale":"2024-09-10T06:27:23.779606+0000","last_undegraded":"2024-09-10T06:27:23.779606+0000","last_fullsized":"2024-09-10T06:27:23.779606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.969311+0000","last_change":"2024-09-10T06:26:32.285276+0000","last_active":"2024-09-10T06:27:24.969311+0000","last_peered":"2024-09-10T06:27:24.969311+0000","last_clean":"2024-09-10T06:27:24.969311+0000","last_became_active":"2024-09-10T06:26:32.284457+0000","last_became_peered":"2024-09-10T06:26:32.284457+0000","last_unstale":"2024-09-10T06:27:24.969311+0000","last_undegraded":"2024-09-10T06:27:24.969311+0000","last_fullsized":"2024-09-10T06:27:24.969311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:37.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552850+0000","last_change":"2024-09-10T06:26:30.573339+0000","last_active":"2024-09-10T06:27:25.552850+0000","last_peered":"2024-09-10T06:27:25.552850+0000","last_clean":"2024-09-10T06:27:25.552850+0000","last_became_active":"2024-09-10T06:26:30.571377+0000","last_became_peered":"2024-09-10T06:26:30.571377+0000","last_unstale":"2024-09-10T06:27:25.552850+0000","last_undegraded":"2024-09-10T06:27:25.552850+0000","last_fullsized":"2024-09-10T06:27:25.552850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:59.752497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781096+0000","last_change":"2024-09-10T06:26:34.269013+0000","last_active":"2024-09-10T06:27:23.781096+0000","last_peered":"2024-09-10T06:27:23.781096+0000","last_clean":"2024-09-10T06:27:23.781096+0000","last_became_active":"2024-09-10T06:26:34.268677+0000","last_became_peered":"2024-09-10T06:26:34.268677+0000","last_unstale":"2024-09-10T06:27:23.781096+0000","last_undegraded":"2024-09-10T06:27:23.781096+0000","last_fullsized":"2024-09-10T06:27:23.781096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'12","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550212+0000","last_change":"2024-09-10T06:26:36.300362+0000","last_active":"2024-09-10T06:27:25.550212+0000","last_peered":"2024-09-10T06:27:25.550212+0000","last_clean":"2024-09-10T06:27:25.550212+0000","last_became_active":"2024-09-10T06:26:36.299645+0000","last_became_peered":"2024-09-10T06:26:36.299645+0000","last_unstale":"2024-09-10T06:27:25.550212+0000","last_undegraded":"2024-09-10T06:27:25.550212+0000","last_fullsized":"2024-09-10T06:27:25.550212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:17.424354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.787969+0000","last_change":"2024-09-10T06:26:38.299751+0000","last_active":"2024-09-10T06:27:23.787969+0000","last_peered":"2024-09-10T06:27:23.787969+0000","last_clean":"2024-09-10T06:27:23.787969+0000","last_became_active":"2024-09-10T06:26:38.298414+0000","last_became_peered":"2024-09-10T06:26:38.298414+0000","last_unstale":"2024-09-10T06:27:23.787969+0000","last_undegraded":"2024-09-10T06:27:23.787969+0000","last_fullsized":"2024-09-10T06:27:23.787969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553409+0000","last_change":"2024-09-10T06:26:40.312752+0000","last_active":"2024-09-10T06:27:25.553409+0000","last_peered":"2024-09-10T06:27:25.553409+0000","last_clean":"2024-09-10T06:27:25.553409+0000","last_became_active":"2024-09-10T06:26:40.312026+0000","last_became_peered":"2024-09-10T06:26:40.312026+0000","last_unstale":"2024-09-10T06:27:25.553409+0000","last_undegraded":"2024-09-10T06:27:25.553409+0000","last_fullsized":"2024-09-10T06:27:25.553409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:50.071224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781218+0000","last_change":"2024-09-10T06:26:32.266934+0000","last_active":"2024-09-10T06:27:23.781218+0000","last_peered":"2024-09-10T06:27:23.781218+0000","last_clean":"2024-09-10T06:27:23.781218+0000","last_became_active":"2024-09-10T06:26:32.266682+0000","last_became_peered":"2024-09-10T06:26:32.266682+0000","last_unstale":"2024-09-10T06:27:23.781218+0000","last_undegraded":"2024-09-10T06:27:23.781218+0000","last_fullsized":"2024-09-10T06:27:23.781218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552462+0000","last_change":"2024-09-10T06:26:30.579097+0000","last_active":"2024-09-10T06:27:25.552462+0000","last_peered":"2024-09-10T06:27:25.552462+0000","last_clean":"2024-09-10T06:27:25.552462+0000","last_became_active":"2024-09-10T06:26:30.578692+0000","last_became_peered":"2024-09-10T06:26:30.578692+0000","last_unstale":"2024-09-10T06:27:25.552462+0000","last_undegraded":"2024-09-10T06:27:25.552462+0000","last_fullsized":"2024-09-10T06:27:25.552462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:15.878123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"27'1","reported_seq":58,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.969135+0000","last_change":"2024-09-10T06:26:34.282356+0000","last_active":"2024-09-10T06:27:24.969135+0000","last_peered":"2024-09-10T06:27:24.969135+0000","last_clean":"2024-09-10T06:27:24.969135+0000","last_became_active":"2024-09-10T06:26:34.281167+0000","last_became_peered":"2024-09-10T06:26:34.281167+0000","last_unstale":"2024-09-10T06:27:24.969135+0000","last_undegraded":"2024-09-10T06:27:24.969135+0000","last_fullsized":"2024-09-10T06:27:24.969135+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:59.042394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'15","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789118+0000","last_change":"2024-09-10T06:26:36.301277+0000","last_active":"2024-09-10T06:27:23.789118+0000","last_peered":"2024-09-10T06:27:23.789118+0000","last_clean":"2024-09-10T06:27:23.789118+0000","last_became_active":"2024-09-10T06:26:36.300501+0000","last_became_peered":"2024-09-10T06:26:36.300501+0000","last_unstale":"2024-09-10T06:27:23.789118+0000","last_undegraded":"2024-09-10T06:27:23.789118+0000","last_fullsized":"2024-09-10T06:27:23.789118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:38.477946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":50,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550384+0000","last_change":"2024-09-10T06:26:38.305737+0000","last_active":"2024-09-10T06:27:25.550384+0000","last_peered":"2024-09-10T06:27:25.550384+0000","last_clean":"2024-09-10T06:27:25.550384+0000","last_became_active":"2024-09-10T06:26:38.303318+0000","last_became_peered":"2024-09-10T06:26:38.303318+0000","last_unstale":"2024-09-10T06:27:25.550384+0000","last_undegraded":"2024-09-10T06:27:25.550384+0000","last_fullsized":"2024-09-10T06:27:25.550384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:52.587622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":44,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967059+0000","last_change":"2024-09-10T06:26:40.318587+0000","last_active":"2024-09-10T06:27:24.967059+0000","last_peered":"2024-09-10T06:27:24.967059+0000","last_clean":"2024-09-10T06:27:24.967059+0000","last_became_active":"2024-09-10T06:26:40.317695+0000","last_became_peered":"2024-09-10T06:26:40.317695+0000","last_unstale":"2024-09-10T06:27:24.967059+0000","last_undegraded":"2024-09-10T06:27:24.967059+0000","last_fullsized":"2024-09-10T06:27:24.967059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:48.298686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554572+0000","last_change":"2024-09-10T06:26:32.276218+0000","last_active":"2024-09-10T06:27:25.554572+0000","last_peered":"2024-09-10T06:27:25.554572+0000","last_clean":"2024-09-10T06:27:25.554572+0000","last_became_active":"2024-09-10T06:26:32.275805+0000","last_became_peered":"2024-09-10T06:26:32.275805+0000","last_unstale":"2024-09-10T06:27:25.554572+0000","last_undegraded":"2024-09-10T06:27:25.554572+0000","last_fullsized":"2024-09-10T06:27:25.554572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550966+0000","last_change":"2024-09-10T06:26:30.568731+0000","last_active":"2024-09-10T06:27:25.550966+0000","last_peered":"2024-09-10T06:27:25.550966+0000","last_clean":"2024-09-10T06:27:25.550966+0000","last_became_active":"2024-09-10T06:26:30.567937+0000","last_became_peered":"2024-09-10T06:26:30.567937+0000","last_unstale":"2024-09-10T06:27:25.550966+0000","last_undegraded":"2024-09-10T06:27:25.550966+0000","last_fullsized":"2024-09-10T06:27:25.550966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:18.974865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551159+0000","last_change":"2024-09-10T06:26:34.266227+0000","last_active":"2024-09-10T06:27:25.551159+0000","last_peered":"2024-09-10T06:27:25.551159+0000","last_clean":"2024-09-10T06:27:25.551159+0000","last_became_active":"2024-09-10T06:26:34.262443+0000","last_became_peered":"2024-09-10T06:26:34.262443+0000","last_unstale":"2024-09-10T06:27:25.551159+0000","last_undegraded":"2024-09-10T06:27:25.551159+0000","last_fullsized":"2024-09-10T06:27:25.551159+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.918813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"34'11","reported_seq":74,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553867+0000","last_change":"2024-09-10T06:26:36.292958+0000","last_active":"2024-09-10T06:27:25.553867+0000","last_peered":"2024-09-10T06:27:25.553867+0000","last_clean":"2024-09-10T06:27:25.553867+0000","last_became_active":"2024-09-10T06:26:36.292149+0000","last_became_peered":"2024-09-10T06:26:36.292149+0000","last_unstale":"2024-09-10T06:27:25.553867+0000","last_undegraded":"2024-09-10T06:27:25.553867+0000","last_fullsized":"2024-09-10T06:27:25.553867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":50,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550878+0000","last_change":"2024-09-10T06:26:38.302991+0000","last_active":"2024-09-10T06:27:25.550878+0000","last_peered":"2024-09-10T06:27:25.550878+0000","last_clean":"2024-09-10T06:27:25.550878+0000","last_became_active":"2024-09-10T06:26:38.289306+0000","last_became_peered":"2024-09-10T06:26:38.289306+0000","last_unstale":"2024-09-10T06:27:25.550878+0000","last_undegraded":"2024-09-10T06:27:25.550878+0000","last_fullsized":"2024-09-10T06:27:25.550878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:57.625329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.784584+0000","last_change":"2024-09-10T06:26:40.327627+0000","last_active":"2024-09-10T06:27:23.784584+0000","last_peered":"2024-09-10T06:27:23.784584+0000","last_clean":"2024-09-10T06:27:23.784584+0000","last_became_active":"2024-09-10T06:26:40.326888+0000","last_became_peered":"2024-09-10T06:26:40.326888+0000","last_unstale":"2024-09-10T06:27:23.784584+0000","last_undegraded":"2024-09-10T06:27:23.784584+0000","last_fullsized":"2024-09-10T06:27:23.784584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:41.122562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878494+0000","last_change":"2024-09-10T06:26:32.275071+0000","last_active":"2024-09-10T06:27:24.878494+0000","last_peered":"2024-09-10T06:27:24.878494+0000","last_clean":"2024-09-10T06:27:24.878494+0000","last_became_active":"2024-09-10T06:26:32.274395+0000","last_became_peered":"2024-09-10T06:26:32.274395+0000","last_unstale":"2024-09-10T06:27:24.878494+0000","last_undegraded":"2024-09-10T06:27:24.878494+0000","last_fullsized":"2024-09-10T06:27:24.878494+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:51.369493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780474+0000","last_change":"2024-09-10T06:26:30.594599+0000","last_active":"2024-09-10T06:27:23.780474+0000","last_peered":"2024-09-10T06:27:23.780474+0000","last_clean":"2024-09-10T06:27:23.780474+0000","last_became_active":"2024-09-10T06:26:30.594058+0000","last_became_peered":"2024-09-10T06:26:30.594058+0000","last_unstale":"2024-09-10T06:27:23.780474+0000","last_undegraded":"2024-09-10T06:27:23.780474+0000","last_fullsized":"2024-09-10T06:27:23.780474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:18.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550569+0000","last_change":"2024-09-10T06:26:34.279538+0000","last_active":"2024-09-10T06:27:25.550569+0000","last_peered":"2024-09-10T06:27:25.550569+0000","last_clean":"2024-09-10T06:27:25.550569+0000","last_became_active":"2024-09-10T06:26:34.278871+0000","last_became_peered":"2024-09-10T06:26:34.278871+0000","last_unstale":"2024-09-10T06:27:25.550569+0000","last_undegraded":"2024-09-10T06:27:25.550569+0000","last_fullsized":"2024-09-10T06:27:25.550569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:13.203357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'10","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551796+0000","last_change":"2024-09-10T06:26:36.290976+0000","last_active":"2024-09-10T06:27:25.551796+0000","last_peered":"2024-09-10T06:27:25.551796+0000","last_clean":"2024-09-10T06:27:25.551796+0000","last_became_active":"2024-09-10T06:26:36.290265+0000","last_became_peered":"2024-09-10T06:26:36.290265+0000","last_unstale":"2024-09-10T06:27:25.551796+0000","last_undegraded":"2024-09-10T06:27:25.551796+0000","last_fullsized":"2024-09-10T06:27:25.551796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"31'2","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.968958+0000","last_change":"2024-09-10T06:26:38.292031+0000","last_active":"2024-09-10T06:27:24.968958+0000","last_peered":"2024-09-10T06:27:24.968958+0000","last_clean":"2024-09-10T06:27:24.968958+0000","last_became_active":"2024-09-10T06:26:38.288791+0000","last_became_peered":"2024-09-10T06:26:38.288791+0000","last_unstale":"2024-09-10T06:27:24.968958+0000","last_undegraded":"2024-09-10T06:27:24.968958+0000","last_fullsized":"2024-09-10T06:27:24.968958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:07.830355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":42,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.782615+0000","last_change":"2024-09-10T06:26:40.336448+0000","last_active":"2024-09-10T06:27:23.782615+0000","last_peered":"2024-09-10T06:27:23.782615+0000","last_clean":"2024-09-10T06:27:23.782615+0000","last_became_active":"2024-09-10T06:26:40.335771+0000","last_became_peered":"2024-09-10T06:26:40.335771+0000","last_unstale":"2024-09-10T06:27:23.782615+0000","last_undegraded":"2024-09-10T06:27:23.782615+0000","last_fullsized":"2024-09-10T06:27:23.782615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549925+0000","last_change":"2024-09-10T06:26:32.262176+0000","last_active":"2024-09-10T06:27:25.549925+0000","last_peered":"2024-09-10T06:27:25.549925+0000","last_clean":"2024-09-10T06:27:25.549925+0000","last_became_active":"2024-09-10T06:26:32.261250+0000","last_became_peered":"2024-09-10T06:26:32.261250+0000","last_unstale":"2024-09-10T06:27:25.549925+0000","last_undegraded":"2024-09-10T06:27:25.549925+0000","last_fullsized":"2024-09-10T06:27:25.549925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788589+0000","last_change":"2024-09-10T06:26:30.604587+0000","last_active":"2024-09-10T06:27:23.788589+0000","last_peered":"2024-09-10T06:27:23.788589+0000","last_clean":"2024-09-10T06:27:23.788589+0000","last_became_active":"2024-09-10T06:26:30.603175+0000","last_became_peered":"2024-09-10T06:26:30.603175+0000","last_unstale":"2024-09-10T06:27:23.788589+0000","last_undegraded":"2024-09-10T06:27:23.788589+0000","last_fullsized":"2024-09-10T06:27:23.788589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789291+0000","last_change":"2024-09-10T06:26:34.286028+0000","last_active":"2024-09-10T06:27:23.789291+0000","last_peered":"2024-09-10T06:27:23.789291+0000","last_clean":"2024-09-10T06:27:23.789291+0000","last_became_active":"2024-09-10T06:26:34.285169+0000","last_became_peered":"2024-09-10T06:26:34.285169+0000","last_unstale":"2024-09-10T06:27:23.789291+0000","last_undegraded":"2024-09-10T06:27:23.789291+0000","last_fullsized":"2024-09-10T06:27:23.789291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:24.146088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"34'15","reported_seq":76,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.784983+0000","last_change":"2024-09-10T06:26:36.292679+0000","last_active":"2024-09-10T06:27:23.784983+0000","last_peered":"2024-09-10T06:27:23.784983+0000","last_clean":"2024-09-10T06:27:23.784983+0000","last_became_active":"2024-09-10T06:26:36.288780+0000","last_became_peered":"2024-09-10T06:26:36.288780+0000","last_unstale":"2024-09-10T06:27:23.784983+0000","last_undegraded":"2024-09-10T06:27:23.784983+0000","last_fullsized":"2024-09-10T06:27:23.784983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.779294+0000","last_change":"2024-09-10T06:26:38.293015+0000","last_active":"2024-09-10T06:27:23.779294+0000","last_peered":"2024-09-10T06:27:23.779294+0000","last_clean":"2024-09-10T06:27:23.779294+0000","last_became_active":"2024-09-10T06:26:38.292185+0000","last_became_peered":"2024-09-10T06:26:38.292185+0000","last_unstale":"2024-09-10T06:27:23.779294+0000","last_undegraded":"2024-09-10T06:27:23.779294+0000","last_fullsized":"2024-09-10T06:27:23.779294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:32.694777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":42,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.791578+0000","last_change":"2024-09-10T06:26:40.336074+0000","last_active":"2024-09-10T06:27:23.791578+0000","last_peered":"2024-09-10T06:27:23.791578+0000","last_clean":"2024-09-10T06:27:23.791578+0000","last_became_active":"2024-09-10T06:26:40.335339+0000","last_became_peered":"2024-09-10T06:26:40.335339+0000","last_unstale":"2024-09-10T06:27:23.791578+0000","last_undegraded":"2024-09-10T06:27:23.791578+0000","last_fullsized":"2024-09-10T06:27:23.791578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550652+0000","last_change":"2024-09-10T06:26:32.262823+0000","last_active":"2024-09-10T06:27:25.550652+0000","last_peered":"2024-09-10T06:27:25.550652+0000","last_clean":"2024-09-10T06:27:25.550652+0000","last_became_active":"2024-09-10T06:26:32.262041+0000","last_became_peered":"2024-09-10T06:26:32.262041+0000","last_unstale":"2024-09-10T06:27:25.550652+0000","last_undegraded":"2024-09-10T06:27:25.550652+0000","last_fullsized":"2024-09-10T06:27:25.550652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:48.768083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":27,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.877609+0000","last_change":"2024-09-10T06:27:08.868703+0000","last_active":"2024-09-10T06:27:24.877609+0000","last_peered":"2024-09-10T06:27:24.877609+0000","last_clean":"2024-09-10T06:27:24.877609+0000","last_became_active":"2024-09-10T06:27:08.868399+0000","last_became_peered":"2024-09-10T06:27:08.868399+0000","last_unstale":"2024-09-10T06:27:24.877609+0000","last_undegraded":"2024-09-10T06:27:24.877609+0000","last_fullsized":"2024-09-10T06:27:24.877609+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:20.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.787713+0000","last_change":"2024-09-10T06:26:34.282651+0000","last_active":"2024-09-10T06:27:23.787713+0000","last_peered":"2024-09-10T06:27:23.787713+0000","last_clean":"2024-09-10T06:27:23.787713+0000","last_became_active":"2024-09-10T06:26:34.281777+0000","last_became_peered":"2024-09-10T06:26:34.281777+0000","last_unstale":"2024-09-10T06:27:23.787713+0000","last_undegraded":"2024-09-10T06:27:23.787713+0000","last_fullsized":"2024-09-10T06:27:23.787713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:42.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"34'9","reported_seq":67,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.779691+0000","last_change":"2024-09-10T06:26:36.285192+0000","last_active":"2024-09-10T06:27:23.779691+0000","last_peered":"2024-09-10T06:27:23.779691+0000","last_clean":"2024-09-10T06:27:23.779691+0000","last_became_active":"2024-09-10T06:26:36.284470+0000","last_became_peered":"2024-09-10T06:26:36.284470+0000","last_unstale":"2024-09-10T06:27:23.779691+0000","last_undegraded":"2024-09-10T06:27:23.779691+0000","last_fullsized":"2024-09-10T06:27:23.779691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:44.280458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967042+0000","last_change":"2024-09-10T06:26:38.303425+0000","last_active":"2024-09-10T06:27:24.967042+0000","last_peered":"2024-09-10T06:27:24.967042+0000","last_clean":"2024-09-10T06:27:24.967042+0000","last_became_active":"2024-09-10T06:26:38.302606+0000","last_became_peered":"2024-09-10T06:26:38.302606+0000","last_unstale":"2024-09-10T06:27:24.967042+0000","last_undegraded":"2024-09-10T06:27:24.967042+0000","last_fullsized":"2024-09-10T06:27:24.967042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:14.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554781+0000","last_change":"2024-09-10T06:26:40.311253+0000","last_active":"2024-09-10T06:27:25.554781+0000","last_peered":"2024-09-10T06:27:25.554781+0000","last_clean":"2024-09-10T06:27:25.554781+0000","last_became_active":"2024-09-10T06:26:40.310414+0000","last_became_peered":"2024-09-10T06:26:40.310414+0000","last_unstale":"2024-09-10T06:27:25.554781+0000","last_undegraded":"2024-09-10T06:27:25.554781+0000","last_fullsized":"2024-09-10T06:27:25.554781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:20.868195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553186+0000","last_change":"2024-09-10T06:26:32.262972+0000","last_active":"2024-09-10T06:27:25.553186+0000","last_peered":"2024-09-10T06:27:25.553186+0000","last_clean":"2024-09-10T06:27:25.553186+0000","last_became_active":"2024-09-10T06:26:32.262469+0000","last_became_peered":"2024-09-10T06:26:32.262469+0000","last_unstale":"2024-09-10T06:27:25.553186+0000","last_undegraded":"2024-09-10T06:27:25.553186+0000","last_fullsized":"2024-09-10T06:27:25.553186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.555071+0000","last_change":"2024-09-10T06:26:30.602013+0000","last_active":"2024-09-10T06:27:25.555071+0000","last_peered":"2024-09-10T06:27:25.555071+0000","last_clean":"2024-09-10T06:27:25.555071+0000","last_became_active":"2024-09-10T06:26:30.601672+0000","last_became_peered":"2024-09-10T06:26:30.601672+0000","last_unstale":"2024-09-10T06:27:25.555071+0000","last_undegraded":"2024-09-10T06:27:25.555071+0000","last_fullsized":"2024-09-10T06:27:25.555071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:52.012063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549122+0000","last_change":"2024-09-10T06:26:34.277010+0000","last_active":"2024-09-10T06:27:25.549122+0000","last_peered":"2024-09-10T06:27:25.549122+0000","last_clean":"2024-09-10T06:27:25.549122+0000","last_became_active":"2024-09-10T06:26:34.276197+0000","last_became_peered":"2024-09-10T06:26:34.276197+0000","last_unstale":"2024-09-10T06:27:25.549122+0000","last_undegraded":"2024-09-10T06:27:25.549122+0000","last_fullsized":"2024-09-10T06:27:25.549122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:32.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'5","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554233+0000","last_change":"2024-09-10T06:26:36.297514+0000","last_active":"2024-09-10T06:27:25.554233+0000","last_peered":"2024-09-10T06:27:25.554233+0000","last_clean":"2024-09-10T06:27:25.554233+0000","last_became_active":"2024-09-10T06:26:36.296615+0000","last_became_peered":"2024-09-10T06:26:36.296615+0000","last_unstale":"2024-09-10T06:27:25.554233+0000","last_undegraded":"2024-09-10T06:27:25.554233+0000","last_fullsized":"2024-09-10T06:27:25.554233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":50,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549378+0000","last_change":"2024-09-10T06:26:38.288794+0000","last_active":"2024-09-10T06:27:25.549378+0000","last_peered":"2024-09-10T06:27:25.549378+0000","last_clean":"2024-09-10T06:27:25.549378+0000","last_became_active":"2024-09-10T06:26:38.288055+0000","last_became_peered":"2024-09-10T06:26:38.288055+0000","last_unstale":"2024-09-10T06:27:25.549378+0000","last_undegraded":"2024-09-10T06:27:25.549378+0000","last_fullsized":"2024-09-10T06:27:25.549378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":42,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790573+0000","last_change":"2024-09-10T06:26:40.318067+0000","last_active":"2024-09-10T06:27:23.790573+0000","last_peered":"2024-09-10T06:27:23.790573+0000","last_clean":"2024-09-10T06:27:23.790573+0000","last_became_active":"2024-09-10T06:26:40.317244+0000","last_became_peered":"2024-09-10T06:26:40.317244+0000","last_unstale":"2024-09-10T06:27:23.790573+0000","last_undegraded":"2024-09-10T06:27:23.790573+0000","last_fullsized":"2024-09-10T06:27:23.790573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549871+0000","last_change":"2024-09-10T06:26:32.277908+0000","last_active":"2024-09-10T06:27:25.549871+0000","last_peered":"2024-09-10T06:27:25.549871+0000","last_clean":"2024-09-10T06:27:25.549871+0000","last_became_active":"2024-09-10T06:26:32.274812+0000","last_became_peered":"2024-09-10T06:26:32.274812+0000","last_unstale":"2024-09-10T06:27:25.549871+0000","last_undegraded":"2024-09-10T06:27:25.549871+0000","last_fullsized":"2024-09-10T06:27:25.549871+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:37.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.782004+0000","last_change":"2024-09-10T06:26:30.594013+0000","last_active":"2024-09-10T06:27:23.782004+0000","last_peered":"2024-09-10T06:27:23.782004+0000","last_clean":"2024-09-10T06:27:23.782004+0000","last_became_active":"2024-09-10T06:26:30.593687+0000","last_became_peered":"2024-09-10T06:26:30.593687+0000","last_unstale":"2024-09-10T06:27:23.782004+0000","last_undegraded":"2024-09-10T06:27:23.782004+0000","last_fullsized":"2024-09-10T06:27:23.782004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:37.375037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":59,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551980+0000","last_change":"2024-09-10T06:26:34.283392+0000","last_active":"2024-09-10T06:27:25.551980+0000","last_peered":"2024-09-10T06:27:25.551980+0000","last_clean":"2024-09-10T06:27:25.551980+0000","last_became_active":"2024-09-10T06:26:34.282931+0000","last_became_peered":"2024-09-10T06:26:34.282931+0000","last_unstale":"2024-09-10T06:27:25.551980+0000","last_undegraded":"2024-09-10T06:27:25.551980+0000","last_fullsized":"2024-09-10T06:27:25.551980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:01.310719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'9","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549912+0000","last_change":"2024-09-10T06:26:36.289834+0000","last_active":"2024-09-10T06:27:25.549912+0000","last_peered":"2024-09-10T06:27:25.549912+0000","last_clean":"2024-09-10T06:27:25.549912+0000","last_became_active":"2024-09-10T06:26:36.289033+0000","last_became_peered":"2024-09-10T06:26:36.289033+0000","last_unstale":"2024-09-10T06:27:25.549912+0000","last_undegraded":"2024-09-10T06:27:25.549912+0000","last_fullsized":"2024-09-10T06:27:25.549912+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.779588+0000","last_change":"2024-09-10T06:26:38.299568+0000","last_active":"2024-09-10T06:27:23.779588+0000","last_peered":"2024-09-10T06:27:23.779588+0000","last_clean":"2024-09-10T06:27:23.779588+0000","last_became_active":"2024-09-10T06:26:38.298779+0000","last_became_peered":"2024-09-10T06:26:38.298779+0000","last_unstale":"2024-09-10T06:27:23.779588+0000","last_undegraded":"2024-09-10T06:27:23.779588+0000","last_fullsized":"2024-09-10T06:27:23.779588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551169+0000","last_change":"2024-09-10T06:26:40.336329+0000","last_active":"2024-09-10T06:27:25.551169+0000","last_peered":"2024-09-10T06:27:25.551169+0000","last_clean":"2024-09-10T06:27:25.551169+0000","last_became_active":"2024-09-10T06:26:40.335348+0000","last_became_peered":"2024-09-10T06:26:40.335348+0000","last_unstale":"2024-09-10T06:27:25.551169+0000","last_undegraded":"2024-09-10T06:27:25.551169+0000","last_fullsized":"2024-09-10T06:27:25.551169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:40.653642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551629+0000","last_change":"2024-09-10T06:26:32.276392+0000","last_active":"2024-09-10T06:27:25.551629+0000","last_peered":"2024-09-10T06:27:25.551629+0000","last_clean":"2024-09-10T06:27:25.551629+0000","last_became_active":"2024-09-10T06:26:32.275855+0000","last_became_peered":"2024-09-10T06:26:32.275855+0000","last_unstale":"2024-09-10T06:27:25.551629+0000","last_undegraded":"2024-09-10T06:27:25.551629+0000","last_fullsized":"2024-09-10T06:27:25.551629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:34.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.966957+0000","last_change":"2024-09-10T06:26:30.591577+0000","last_active":"2024-09-10T06:27:24.966957+0000","last_peered":"2024-09-10T06:27:24.966957+0000","last_clean":"2024-09-10T06:27:24.966957+0000","last_became_active":"2024-09-10T06:26:30.590801+0000","last_became_peered":"2024-09-10T06:26:30.590801+0000","last_unstale":"2024-09-10T06:27:24.966957+0000","last_undegraded":"2024-09-10T06:27:24.966957+0000","last_fullsized":"2024-09-10T06:27:24.966957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:16.066664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551081+0000","last_change":"2024-09-10T06:26:32.268621+0000","last_active":"2024-09-10T06:27:25.551081+0000","last_peered":"2024-09-10T06:27:25.551081+0000","last_clean":"2024-09-10T06:27:25.551081+0000","last_became_active":"2024-09-10T06:26:32.267915+0000","last_became_peered":"2024-09-10T06:26:32.267915+0000","last_unstale":"2024-09-10T06:27:25.551081+0000","last_undegraded":"2024-09-10T06:27:25.551081+0000","last_fullsized":"2024-09-10T06:27:25.551081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:10.670492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":65,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.877901+0000","last_change":"2024-09-10T06:26:30.593794+0000","last_active":"2024-09-10T06:27:24.877901+0000","last_peered":"2024-09-10T06:27:24.877901+0000","last_clean":"2024-09-10T06:27:24.877901+0000","last_became_active":"2024-09-10T06:26:30.593506+0000","last_became_peered":"2024-09-10T06:26:30.593506+0000","last_unstale":"2024-09-10T06:27:24.877901+0000","last_undegraded":"2024-09-10T06:27:24.877901+0000","last_fullsized":"2024-09-10T06:27:24.877901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:29.521578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788399+0000","last_change":"2024-09-10T06:26:32.288497+0000","last_active":"2024-09-10T06:27:23.788399+0000","last_peered":"2024-09-10T06:27:23.788399+0000","last_clean":"2024-09-10T06:27:23.788399+0000","last_became_active":"2024-09-10T06:26:32.287839+0000","last_became_peered":"2024-09-10T06:26:32.287839+0000","last_unstale":"2024-09-10T06:27:23.788399+0000","last_undegraded":"2024-09-10T06:27:23.788399+0000","last_fullsized":"2024-09-10T06:27:23.788399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.786298+0000","last_change":"2024-09-10T06:26:30.610172+0000","last_active":"2024-09-10T06:27:23.786298+0000","last_peered":"2024-09-10T06:27:23.786298+0000","last_clean":"2024-09-10T06:27:23.786298+0000","last_became_active":"2024-09-10T06:26:30.602685+0000","last_became_peered":"2024-09-10T06:26:30.602685+0000","last_unstale":"2024-09-10T06:27:23.786298+0000","last_undegraded":"2024-09-10T06:27:23.786298+0000","last_fullsized":"2024-09-10T06:27:23.786298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:35.705564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549943+0000","last_change":"2024-09-10T06:26:32.272921+0000","last_active":"2024-09-10T06:27:25.549943+0000","last_peered":"2024-09-10T06:27:25.549943+0000","last_clean":"2024-09-10T06:27:25.549943+0000","last_became_active":"2024-09-10T06:26:32.272279+0000","last_became_peered":"2024-09-10T06:26:32.272279+0000","last_unstale":"2024-09-10T06:27:25.549943+0000","last_undegraded":"2024-09-10T06:27:25.549943+0000","last_fullsized":"2024-09-10T06:27:25.549943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:11.951551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780627+0000","last_change":"2024-09-10T06:26:30.579541+0000","last_active":"2024-09-10T06:27:23.780627+0000","last_peered":"2024-09-10T06:27:23.780627+0000","last_clean":"2024-09-10T06:27:23.780627+0000","last_became_active":"2024-09-10T06:26:30.579189+0000","last_became_peered":"2024-09-10T06:26:30.579189+0000","last_unstale":"2024-09-10T06:27:23.780627+0000","last_undegraded":"2024-09-10T06:27:23.780627+0000","last_fullsized":"2024-09-10T06:27:23.780627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:18.099885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554011+0000","last_change":"2024-09-10T06:26:32.260098+0000","last_active":"2024-09-10T06:27:25.554011+0000","last_peered":"2024-09-10T06:27:25.554011+0000","last_clean":"2024-09-10T06:27:25.554011+0000","last_became_active":"2024-09-10T06:26:32.259644+0000","last_became_peered":"2024-09-10T06:26:32.259644+0000","last_unstale":"2024-09-10T06:27:25.554011+0000","last_undegraded":"2024-09-10T06:27:25.554011+0000","last_fullsized":"2024-09-10T06:27:25.554011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554541+0000","last_change":"2024-09-10T06:26:30.576146+0000","last_active":"2024-09-10T06:27:25.554541+0000","last_peered":"2024-09-10T06:27:25.554541+0000","last_clean":"2024-09-10T06:27:25.554541+0000","last_became_active":"2024-09-10T06:26:30.575605+0000","last_became_peered":"2024-09-10T06:26:30.575605+0000","last_unstale":"2024-09-10T06:27:25.554541+0000","last_undegraded":"2024-09-10T06:27:25.554541+0000","last_fullsized":"2024-09-10T06:27:25.554541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550922+0000","last_change":"2024-09-10T06:26:32.277577+0000","last_active":"2024-09-10T06:27:25.550922+0000","last_peered":"2024-09-10T06:27:25.550922+0000","last_clean":"2024-09-10T06:27:25.550922+0000","last_became_active":"2024-09-10T06:26:32.272454+0000","last_became_peered":"2024-09-10T06:26:32.272454+0000","last_unstale":"2024-09-10T06:27:25.550922+0000","last_undegraded":"2024-09-10T06:27:25.550922+0000","last_fullsized":"2024-09-10T06:27:25.550922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550786+0000","last_change":"2024-09-10T06:26:30.579134+0000","last_active":"2024-09-10T06:27:25.550786+0000","last_peered":"2024-09-10T06:27:25.550786+0000","last_clean":"2024-09-10T06:27:25.550786+0000","last_became_active":"2024-09-10T06:26:30.578732+0000","last_became_peered":"2024-09-10T06:26:30.578732+0000","last_unstale":"2024-09-10T06:27:25.550786+0000","last_undegraded":"2024-09-10T06:27:25.550786+0000","last_fullsized":"2024-09-10T06:27:25.550786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:08.832907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552984+0000","last_change":"2024-09-10T06:26:32.270804+0000","last_active":"2024-09-10T06:27:25.552984+0000","last_peered":"2024-09-10T06:27:25.552984+0000","last_clean":"2024-09-10T06:27:25.552984+0000","last_became_active":"2024-09-10T06:26:32.270327+0000","last_became_peered":"2024-09-10T06:26:32.270327+0000","last_unstale":"2024-09-10T06:27:25.552984+0000","last_undegraded":"2024-09-10T06:27:25.552984+0000","last_fullsized":"2024-09-10T06:27:25.552984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.968489+0000","last_change":"2024-09-10T06:26:30.598004+0000","last_active":"2024-09-10T06:27:24.968489+0000","last_peered":"2024-09-10T06:27:24.968489+0000","last_clean":"2024-09-10T06:27:24.968489+0000","last_became_active":"2024-09-10T06:26:30.596254+0000","last_became_peered":"2024-09-10T06:26:30.596254+0000","last_unstale":"2024-09-10T06:27:24.968489+0000","last_undegraded":"2024-09-10T06:27:24.968489+0000","last_fullsized":"2024-09-10T06:27:24.968489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.966874+0000","last_change":"2024-09-10T06:26:32.284215+0000","last_active":"2024-09-10T06:27:24.966874+0000","last_peered":"2024-09-10T06:27:24.966874+0000","last_clean":"2024-09-10T06:27:24.966874+0000","last_became_active":"2024-09-10T06:26:32.275133+0000","last_became_peered":"2024-09-10T06:26:32.275133+0000","last_unstale":"2024-09-10T06:27:24.966874+0000","last_undegraded":"2024-09-10T06:27:24.966874+0000","last_fullsized":"2024-09-10T06:27:24.966874+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:37.703268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553699+0000","last_change":"2024-09-10T06:26:30.580586+0000","last_active":"2024-09-10T06:27:25.553699+0000","last_peered":"2024-09-10T06:27:25.553699+0000","last_clean":"2024-09-10T06:27:25.553699+0000","last_became_active":"2024-09-10T06:26:30.580134+0000","last_became_peered":"2024-09-10T06:26:30.580134+0000","last_unstale":"2024-09-10T06:27:25.553699+0000","last_undegraded":"2024-09-10T06:27:25.553699+0000","last_fullsized":"2024-09-10T06:27:25.553699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781930+0000","last_change":"2024-09-10T06:26:32.256538+0000","last_active":"2024-09-10T06:27:23.781930+0000","last_peered":"2024-09-10T06:27:23.781930+0000","last_clean":"2024-09-10T06:27:23.781930+0000","last_became_active":"2024-09-10T06:26:32.256052+0000","last_became_peered":"2024-09-10T06:26:32.256052+0000","last_unstale":"2024-09-10T06:27:23.781930+0000","last_undegraded":"2024-09-10T06:27:23.781930+0000","last_fullsized":"2024-09-10T06:27:23.781930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:14.620472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.785508+0000","last_change":"2024-09-10T06:26:30.585220+0000","last_active":"2024-09-10T06:27:23.785508+0000","last_peered":"2024-09-10T06:27:23.785508+0000","last_clean":"2024-09-10T06:27:23.785508+0000","last_became_active":"2024-09-10T06:26:30.584443+0000","last_became_peered":"2024-09-10T06:26:30.584443+0000","last_unstale":"2024-09-10T06:27:23.785508+0000","last_undegraded":"2024-09-10T06:27:23.785508+0000","last_fullsized":"2024-09-10T06:27:23.785508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552043+0000","last_change":"2024-09-10T06:26:32.259306+0000","last_active":"2024-09-10T06:27:25.552043+0000","last_peered":"2024-09-10T06:27:25.552043+0000","last_clean":"2024-09-10T06:27:25.552043+0000","last_became_active":"2024-09-10T06:26:32.258513+0000","last_became_peered":"2024-09-10T06:26:32.258513+0000","last_unstale":"2024-09-10T06:27:25.552043+0000","last_undegraded":"2024-09-10T06:27:25.552043+0000","last_fullsized":"2024-09-10T06:27:25.552043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553262+0000","last_change":"2024-09-10T06:26:30.581285+0000","last_active":"2024-09-10T06:27:25.553262+0000","last_peered":"2024-09-10T06:27:25.553262+0000","last_clean":"2024-09-10T06:27:25.553262+0000","last_became_active":"2024-09-10T06:26:30.580913+0000","last_became_peered":"2024-09-10T06:26:30.580913+0000","last_unstale":"2024-09-10T06:27:25.553262+0000","last_undegraded":"2024-09-10T06:27:25.553262+0000","last_fullsized":"2024-09-10T06:27:25.553262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878815+0000","last_change":"2024-09-10T06:26:32.274773+0000","last_active":"2024-09-10T06:27:24.878815+0000","last_peered":"2024-09-10T06:27:24.878815+0000","last_clean":"2024-09-10T06:27:24.878815+0000","last_became_active":"2024-09-10T06:26:32.274327+0000","last_became_peered":"2024-09-10T06:26:32.274327+0000","last_unstale":"2024-09-10T06:27:24.878815+0000","last_undegraded":"2024-09-10T06:27:24.878815+0000","last_fullsized":"2024-09-10T06:27:24.878815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:54.026434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":27,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878090+0000","last_change":"2024-09-10T06:27:08.592940+0000","last_active":"2024-09-10T06:27:24.878090+0000","last_peered":"2024-09-10T06:27:24.878090+0000","last_clean":"2024-09-10T06:27:24.878090+0000","last_became_active":"2024-09-10T06:27:08.592637+0000","last_became_peered":"2024-09-10T06:27:08.592637+0000","last_unstale":"2024-09-10T06:27:24.878090+0000","last_undegraded":"2024-09-10T06:27:24.878090+0000","last_fullsized":"2024-09-10T06:27:24.878090+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:06.335302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550866+0000","last_change":"2024-09-10T06:26:32.279474+0000","last_active":"2024-09-10T06:27:25.550866+0000","last_peered":"2024-09-10T06:27:25.550866+0000","last_clean":"2024-09-10T06:27:25.550866+0000","last_became_active":"2024-09-10T06:26:32.278461+0000","last_became_peered":"2024-09-10T06:26:32.278461+0000","last_unstale":"2024-09-10T06:27:25.550866+0000","last_undegraded":"2024-09-10T06:27:25.550866+0000","last_fullsized":"2024-09-10T06:27:25.550866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780742+0000","last_change":"2024-09-10T06:26:30.605519+0000","last_active":"2024-09-10T06:27:23.780742+0000","last_peered":"2024-09-10T06:27:23.780742+0000","last_clean":"2024-09-10T06:27:23.780742+0000","last_became_active":"2024-09-10T06:26:30.605225+0000","last_became_peered":"2024-09-10T06:26:30.605225+0000","last_unstale":"2024-09-10T06:27:23.780742+0000","last_undegraded":"2024-09-10T06:27:23.780742+0000","last_fullsized":"2024-09-10T06:27:23.780742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789961+0000","last_change":"2024-09-10T06:26:32.267201+0000","last_active":"2024-09-10T06:27:23.789961+0000","last_peered":"2024-09-10T06:27:23.789961+0000","last_clean":"2024-09-10T06:27:23.789961+0000","last_became_active":"2024-09-10T06:26:32.266234+0000","last_became_peered":"2024-09-10T06:26:32.266234+0000","last_unstale":"2024-09-10T06:27:23.789961+0000","last_undegraded":"2024-09-10T06:27:23.789961+0000","last_fullsized":"2024-09-10T06:27:23.789961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.968177+0000","last_change":"2024-09-10T06:26:30.596647+0000","last_active":"2024-09-10T06:27:24.968177+0000","last_peered":"2024-09-10T06:27:24.968177+0000","last_clean":"2024-09-10T06:27:24.968177+0000","last_became_active":"2024-09-10T06:26:30.593598+0000","last_became_peered":"2024-09-10T06:26:30.593598+0000","last_unstale":"2024-09-10T06:27:24.968177+0000","last_undegraded":"2024-09-10T06:27:24.968177+0000","last_fullsized":"2024-09-10T06:27:24.968177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.779744+0000","last_change":"2024-09-10T06:26:32.278317+0000","last_active":"2024-09-10T06:27:23.779744+0000","last_peered":"2024-09-10T06:27:23.779744+0000","last_clean":"2024-09-10T06:27:23.779744+0000","last_became_active":"2024-09-10T06:26:32.278032+0000","last_became_peered":"2024-09-10T06:26:32.278032+0000","last_unstale":"2024-09-10T06:27:23.779744+0000","last_undegraded":"2024-09-10T06:27:23.779744+0000","last_fullsized":"2024-09-10T06:27:23.779744+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:00.200118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.791297+0000","last_change":"2024-09-10T06:26:30.580552+0000","last_active":"2024-09-10T06:27:23.791297+0000","last_peered":"2024-09-10T06:27:23.791297+0000","last_clean":"2024-09-10T06:27:23.791297+0000","last_became_active":"2024-09-10T06:26:30.579319+0000","last_became_peered":"2024-09-10T06:26:30.579319+0000","last_unstale":"2024-09-10T06:27:23.791297+0000","last_undegraded":"2024-09-10T06:27:23.791297+0000","last_fullsized":"2024-09-10T06:27:23.791297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:59.885311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552909+0000","last_change":"2024-09-10T06:26:32.257601+0000","last_active":"2024-09-10T06:27:25.552909+0000","last_peered":"2024-09-10T06:27:25.552909+0000","last_clean":"2024-09-10T06:27:25.552909+0000","last_became_active":"2024-09-10T06:26:32.256851+0000","last_became_peered":"2024-09-10T06:26:32.256851+0000","last_unstale":"2024-09-10T06:27:25.552909+0000","last_undegraded":"2024-09-10T06:27:25.552909+0000","last_fullsized":"2024-09-10T06:27:25.552909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":65,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.879530+0000","last_change":"2024-09-10T06:26:30.601996+0000","last_active":"2024-09-10T06:27:24.879530+0000","last_peered":"2024-09-10T06:27:24.879530+0000","last_clean":"2024-09-10T06:27:24.879530+0000","last_became_active":"2024-09-10T06:26:30.601686+0000","last_became_peered":"2024-09-10T06:26:30.601686+0000","last_unstale":"2024-09-10T06:27:24.879530+0000","last_undegraded":"2024-09-10T06:27:24.879530+0000","last_fullsized":"2024-09-10T06:27:24.879530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:11.953454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.783388+0000","last_change":"2024-09-10T06:26:32.266768+0000","last_active":"2024-09-10T06:27:23.783388+0000","last_peered":"2024-09-10T06:27:23.783388+0000","last_clean":"2024-09-10T06:27:23.783388+0000","last_became_active":"2024-09-10T06:26:32.266000+0000","last_became_peered":"2024-09-10T06:26:32.266000+0000","last_unstale":"2024-09-10T06:27:23.783388+0000","last_undegraded":"2024-09-10T06:27:23.783388+0000","last_fullsized":"2024-09-10T06:27:23.783388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790912+0000","last_change":"2024-09-10T06:26:30.610309+0000","last_active":"2024-09-10T06:27:23.790912+0000","last_peered":"2024-09-10T06:27:23.790912+0000","last_clean":"2024-09-10T06:27:23.790912+0000","last_became_active":"2024-09-10T06:26:30.609674+0000","last_became_peered":"2024-09-10T06:26:30.609674+0000","last_unstale":"2024-09-10T06:27:23.790912+0000","last_undegraded":"2024-09-10T06:27:23.790912+0000","last_fullsized":"2024-09-10T06:27:23.790912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.785282+0000","last_change":"2024-09-10T06:26:30.591365+0000","last_active":"2024-09-10T06:27:23.785282+0000","last_peered":"2024-09-10T06:27:23.785282+0000","last_clean":"2024-09-10T06:27:23.785282+0000","last_became_active":"2024-09-10T06:26:30.590640+0000","last_became_peered":"2024-09-10T06:26:30.590640+0000","last_unstale":"2024-09-10T06:27:23.785282+0000","last_undegraded":"2024-09-10T06:27:23.785282+0000","last_fullsized":"2024-09-10T06:27:23.785282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781846+0000","last_change":"2024-09-10T06:26:32.267333+0000","last_active":"2024-09-10T06:27:23.781846+0000","last_peered":"2024-09-10T06:27:23.781846+0000","last_clean":"2024-09-10T06:27:23.781846+0000","last_became_active":"2024-09-10T06:26:32.266876+0000","last_became_peered":"2024-09-10T06:26:32.266876+0000","last_unstale":"2024-09-10T06:27:23.781846+0000","last_undegraded":"2024-09-10T06:27:23.781846+0000","last_fullsized":"2024-09-10T06:27:23.781846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:02.483639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552342+0000","last_change":"2024-09-10T06:26:30.590924+0000","last_active":"2024-09-10T06:27:25.552342+0000","last_peered":"2024-09-10T06:27:25.552342+0000","last_clean":"2024-09-10T06:27:25.552342+0000","last_became_active":"2024-09-10T06:26:30.590415+0000","last_became_peered":"2024-09-10T06:26:30.590415+0000","last_unstale":"2024-09-10T06:27:25.552342+0000","last_undegraded":"2024-09-10T06:27:25.552342+0000","last_fullsized":"2024-09-10T06:27:25.552342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:32.460291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789201+0000","last_change":"2024-09-10T06:26:32.283339+0000","last_active":"2024-09-10T06:27:23.789201+0000","last_peered":"2024-09-10T06:27:23.789201+0000","last_clean":"2024-09-10T06:27:23.789201+0000","last_became_active":"2024-09-10T06:26:32.282581+0000","last_became_peered":"2024-09-10T06:26:32.282581+0000","last_unstale":"2024-09-10T06:27:23.789201+0000","last_undegraded":"2024-09-10T06:27:23.789201+0000","last_fullsized":"2024-09-10T06:27:23.789201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1204224,"data_stored":875185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":602112,"data_stored":292966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":634880,"data_stored":285004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":589824,"data_stored":292464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":618496,"data_stored":292805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":283719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31792,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":618496,"data_stored":292242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1187840,"data_stored":875027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:27:28.197 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:27:28.212 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:28.212 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:28.226 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:27:28.268 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:28.269+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:28.353 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:28.353+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:28.390 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:28.391 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:28.405 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:27:28.454 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:28.453+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:28.528 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:28.528 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:28.542 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:27:28.555 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:28.553+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:28.600 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T06:27:28.656 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:28.657+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:28.714 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:28.714 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:28.734 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:27:28.754 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:27:28.760 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:27:28.761 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:28.761+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:28.788 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-10T06:27:27.577803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":759,"num_read_kb":507,"num_write":532,"num_write_kb":1672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":485,"ondisk_log_size":485,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":230472,"kb_used_data":5888,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744248,"statfs":{"total":773094113280,"available":772858109952,"internally_reserved":0,"allocated":6029312,"data_stored":3489412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.047524"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551389+0000","last_change":"2024-09-10T06:27:08.597414+0000","last_active":"2024-09-10T06:27:25.551389+0000","last_peered":"2024-09-10T06:27:25.551389+0000","last_clean":"2024-09-10T06:27:25.551389+0000","last_became_active":"2024-09-10T06:27:08.597026+0000","last_became_peered":"2024-09-10T06:27:08.597026+0000","last_unstale":"2024-09-10T06:27:25.551389+0000","last_undegraded":"2024-09-10T06:27:25.551389+0000","last_fullsized":"2024-09-10T06:27:25.551389+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:07.484952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.784628+0000","last_change":"2024-09-10T06:26:32.279882+0000","last_active":"2024-09-10T06:27:23.784628+0000","last_peered":"2024-09-10T06:27:23.784628+0000","last_clean":"2024-09-10T06:27:23.784628+0000","last_became_active":"2024-09-10T06:26:32.279098+0000","last_became_peered":"2024-09-10T06:26:32.279098+0000","last_unstale":"2024-09-10T06:27:23.784628+0000","last_undegraded":"2024-09-10T06:27:23.784628+0000","last_fullsized":"2024-09-10T06:27:23.784628+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551204+0000","last_change":"2024-09-10T06:26:30.573148+0000","last_active":"2024-09-10T06:27:25.551204+0000","last_peered":"2024-09-10T06:27:25.551204+0000","last_clean":"2024-09-10T06:27:25.551204+0000","last_became_active":"2024-09-10T06:26:30.572798+0000","last_became_peered":"2024-09-10T06:26:30.572798+0000","last_unstale":"2024-09-10T06:27:25.551204+0000","last_undegraded":"2024-09-10T06:27:25.551204+0000","last_fullsized":"2024-09-10T06:27:25.551204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:38.833715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.787836+0000","last_change":"2024-09-10T06:26:32.276811+0000","last_active":"2024-09-10T06:27:23.787836+0000","last_peered":"2024-09-10T06:27:23.787836+0000","last_clean":"2024-09-10T06:27:23.787836+0000","last_became_active":"2024-09-10T06:26:32.275990+0000","last_became_peered":"2024-09-10T06:26:32.275990+0000","last_unstale":"2024-09-10T06:27:23.787836+0000","last_undegraded":"2024-09-10T06:27:23.787836+0000","last_fullsized":"2024-09-10T06:27:23.787836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.782178+0000","last_change":"2024-09-10T06:26:30.578068+0000","last_active":"2024-09-10T06:27:23.782178+0000","last_peered":"2024-09-10T06:27:23.782178+0000","last_clean":"2024-09-10T06:27:23.782178+0000","last_became_active":"2024-09-10T06:26:30.577688+0000","last_became_peered":"2024-09-10T06:26:30.577688+0000","last_unstale":"2024-09-10T06:27:23.782178+0000","last_undegraded":"2024-09-10T06:27:23.782178+0000","last_fullsized":"2024-09-10T06:27:23.782178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:34.137079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550406+0000","last_change":"2024-09-10T06:26:32.256939+0000","last_active":"2024-09-10T06:27:25.550406+0000","last_peered":"2024-09-10T06:27:25.550406+0000","last_clean":"2024-09-10T06:27:25.550406+0000","last_became_active":"2024-09-10T06:26:32.256117+0000","last_became_peered":"2024-09-10T06:26:32.256117+0000","last_unstale":"2024-09-10T06:27:25.550406+0000","last_undegraded":"2024-09-10T06:27:25.550406+0000","last_fullsized":"2024-09-10T06:27:25.550406+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:51.879604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788424+0000","last_change":"2024-09-10T06:26:30.593697+0000","last_active":"2024-09-10T06:27:23.788424+0000","last_peered":"2024-09-10T06:27:23.788424+0000","last_clean":"2024-09-10T06:27:23.788424+0000","last_became_active":"2024-09-10T06:26:30.591807+0000","last_became_peered":"2024-09-10T06:26:30.591807+0000","last_unstale":"2024-09-10T06:27:23.788424+0000","last_undegraded":"2024-09-10T06:27:23.788424+0000","last_fullsized":"2024-09-10T06:27:23.788424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780552+0000","last_change":"2024-09-10T06:26:32.264685+0000","last_active":"2024-09-10T06:27:23.780552+0000","last_peered":"2024-09-10T06:27:23.780552+0000","last_clean":"2024-09-10T06:27:23.780552+0000","last_became_active":"2024-09-10T06:26:32.264199+0000","last_became_peered":"2024-09-10T06:26:32.264199+0000","last_unstale":"2024-09-10T06:27:23.780552+0000","last_undegraded":"2024-09-10T06:27:23.780552+0000","last_fullsized":"2024-09-10T06:27:23.780552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:20.713066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790209+0000","last_change":"2024-09-10T06:26:30.584856+0000","last_active":"2024-09-10T06:27:23.790209+0000","last_peered":"2024-09-10T06:27:23.790209+0000","last_clean":"2024-09-10T06:27:23.790209+0000","last_became_active":"2024-09-10T06:26:30.584149+0000","last_became_peered":"2024-09-10T06:26:30.584149+0000","last_unstale":"2024-09-10T06:27:23.790209+0000","last_undegraded":"2024-09-10T06:27:23.790209+0000","last_fullsized":"2024-09-10T06:27:23.790209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:35.688897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967925+0000","last_change":"2024-09-10T06:26:32.290741+0000","last_active":"2024-09-10T06:27:24.967925+0000","last_peered":"2024-09-10T06:27:24.967925+0000","last_clean":"2024-09-10T06:27:24.967925+0000","last_became_active":"2024-09-10T06:26:32.289840+0000","last_became_peered":"2024-09-10T06:26:32.289840+0000","last_unstale":"2024-09-10T06:27:24.967925+0000","last_undegraded":"2024-09-10T06:27:24.967925+0000","last_fullsized":"2024-09-10T06:27:24.967925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.786032+0000","last_change":"2024-09-10T06:26:30.609817+0000","last_active":"2024-09-10T06:27:23.786032+0000","last_peered":"2024-09-10T06:27:23.786032+0000","last_clean":"2024-09-10T06:27:23.786032+0000","last_became_active":"2024-09-10T06:26:30.603330+0000","last_became_peered":"2024-09-10T06:26:30.603330+0000","last_unstale":"2024-09-10T06:27:23.786032+0000","last_undegraded":"2024-09-10T06:27:23.786032+0000","last_fullsized":"2024-09-10T06:27:23.786032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:09.523045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551378+0000","last_change":"2024-09-10T06:26:32.257050+0000","last_active":"2024-09-10T06:27:25.551378+0000","last_peered":"2024-09-10T06:27:25.551378+0000","last_clean":"2024-09-10T06:27:25.551378+0000","last_became_active":"2024-09-10T06:26:32.254437+0000","last_became_peered":"2024-09-10T06:26:32.254437+0000","last_unstale":"2024-09-10T06:27:25.551378+0000","last_undegraded":"2024-09-10T06:27:25.551378+0000","last_fullsized":"2024-09-10T06:27:25.551378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788585+0000","last_change":"2024-09-10T06:26:30.579756+0000","last_active":"2024-09-10T06:27:23.788585+0000","last_peered":"2024-09-10T06:27:23.788585+0000","last_clean":"2024-09-10T06:27:23.788585+0000","last_became_active":"2024-09-10T06:26:30.578033+0000","last_became_peered":"2024-09-10T06:26:30.578033+0000","last_unstale":"2024-09-10T06:27:23.788585+0000","last_undegraded":"2024-09-10T06:27:23.788585+0000","last_fullsized":"2024-09-10T06:27:23.788585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789000+0000","last_change":"2024-09-10T06:26:32.281248+0000","last_active":"2024-09-10T06:27:23.789000+0000","last_peered":"2024-09-10T06:27:23.789000+0000","last_clean":"2024-09-10T06:27:23.789000+0000","last_became_active":"2024-09-10T06:26:32.280480+0000","last_became_peered":"2024-09-10T06:26:32.280480+0000","last_unstale":"2024-09-10T06:27:23.789000+0000","last_undegraded":"2024-09-10T06:27:23.789000+0000","last_fullsized":"2024-09-10T06:27:23.789000+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552774+0000","last_change":"2024-09-10T06:26:30.593213+0000","last_active":"2024-09-10T06:27:25.552774+0000","last_peered":"2024-09-10T06:27:25.552774+0000","last_clean":"2024-09-10T06:27:25.552774+0000","last_became_active":"2024-09-10T06:26:30.592770+0000","last_became_peered":"2024-09-10T06:26:30.592770+0000","last_unstale":"2024-09-10T06:27:25.552774+0000","last_undegraded":"2024-09-10T06:27:25.552774+0000","last_fullsized":"2024-09-10T06:27:25.552774+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.879256+0000","last_change":"2024-09-10T06:26:32.267430+0000","last_active":"2024-09-10T06:27:24.879256+0000","last_peered":"2024-09-10T06:27:24.879256+0000","last_clean":"2024-09-10T06:27:24.879256+0000","last_became_active":"2024-09-10T06:26:32.265788+0000","last_became_peered":"2024-09-10T06:26:32.265788+0000","last_unstale":"2024-09-10T06:27:24.879256+0000","last_undegraded":"2024-09-10T06:27:24.879256+0000","last_fullsized":"2024-09-10T06:27:24.879256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:19.180142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549590+0000","last_change":"2024-09-10T06:26:32.255038+0000","last_active":"2024-09-10T06:27:25.549590+0000","last_peered":"2024-09-10T06:27:25.549590+0000","last_clean":"2024-09-10T06:27:25.549590+0000","last_became_active":"2024-09-10T06:26:32.254281+0000","last_became_peered":"2024-09-10T06:26:32.254281+0000","last_unstale":"2024-09-10T06:27:25.549590+0000","last_undegraded":"2024-09-10T06:27:25.549590+0000","last_fullsized":"2024-09-10T06:27:25.549590+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:46.363171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.792005+0000","last_change":"2024-09-10T06:26:30.607280+0000","last_active":"2024-09-10T06:27:23.792005+0000","last_peered":"2024-09-10T06:27:23.792005+0000","last_clean":"2024-09-10T06:27:23.792005+0000","last_became_active":"2024-09-10T06:26:30.605602+0000","last_became_peered":"2024-09-10T06:26:30.605602+0000","last_unstale":"2024-09-10T06:27:23.792005+0000","last_undegraded":"2024-09-10T06:27:23.792005+0000","last_fullsized":"2024-09-10T06:27:23.792005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:49.865234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788097+0000","last_change":"2024-09-10T06:26:32.275913+0000","last_active":"2024-09-10T06:27:23.788097+0000","last_peered":"2024-09-10T06:27:23.788097+0000","last_clean":"2024-09-10T06:27:23.788097+0000","last_became_active":"2024-09-10T06:26:32.274264+0000","last_became_peered":"2024-09-10T06:26:32.274264+0000","last_unstale":"2024-09-10T06:27:23.788097+0000","last_undegraded":"2024-09-10T06:27:23.788097+0000","last_fullsized":"2024-09-10T06:27:23.788097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.968300+0000","last_change":"2024-09-10T06:26:30.598756+0000","last_active":"2024-09-10T06:27:24.968300+0000","last_peered":"2024-09-10T06:27:24.968300+0000","last_clean":"2024-09-10T06:27:24.968300+0000","last_became_active":"2024-09-10T06:26:30.597001+0000","last_became_peered":"2024-09-10T06:26:30.597001+0000","last_unstale":"2024-09-10T06:27:24.968300+0000","last_undegraded":"2024-09-10T06:27:24.968300+0000","last_fullsized":"2024-09-10T06:27:24.968300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:17.165772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.786150+0000","last_change":"2024-09-10T06:26:32.279079+0000","last_active":"2024-09-10T06:27:23.786150+0000","last_peered":"2024-09-10T06:27:23.786150+0000","last_clean":"2024-09-10T06:27:23.786150+0000","last_became_active":"2024-09-10T06:26:32.278407+0000","last_became_peered":"2024-09-10T06:26:32.278407+0000","last_unstale":"2024-09-10T06:27:23.786150+0000","last_undegraded":"2024-09-10T06:27:23.786150+0000","last_fullsized":"2024-09-10T06:27:23.786150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.968720+0000","last_change":"2024-09-10T06:26:30.607368+0000","last_active":"2024-09-10T06:27:24.968720+0000","last_peered":"2024-09-10T06:27:24.968720+0000","last_clean":"2024-09-10T06:27:24.968720+0000","last_became_active":"2024-09-10T06:26:30.606807+0000","last_became_peered":"2024-09-10T06:26:30.606807+0000","last_unstale":"2024-09-10T06:27:24.968720+0000","last_undegraded":"2024-09-10T06:27:24.968720+0000","last_fullsized":"2024-09-10T06:27:24.968720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":67,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878249+0000","last_change":"2024-09-10T06:27:08.801987+0000","last_active":"2024-09-10T06:27:24.878249+0000","last_peered":"2024-09-10T06:27:24.878249+0000","last_clean":"2024-09-10T06:27:24.878249+0000","last_became_active":"2024-09-10T06:27:08.801461+0000","last_became_peered":"2024-09-10T06:27:08.801461+0000","last_unstale":"2024-09-10T06:27:24.878249+0000","last_undegraded":"2024-09-10T06:27:24.878249+0000","last_fullsized":"2024-09-10T06:27:24.878249+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550051+0000","last_change":"2024-09-10T06:26:30.598381+0000","last_active":"2024-09-10T06:27:25.550051+0000","last_peered":"2024-09-10T06:27:25.550051+0000","last_clean":"2024-09-10T06:27:25.550051+0000","last_became_active":"2024-09-10T06:26:30.597271+0000","last_became_peered":"2024-09-10T06:26:30.597271+0000","last_unstale":"2024-09-10T06:27:25.550051+0000","last_undegraded":"2024-09-10T06:27:25.550051+0000","last_fullsized":"2024-09-10T06:27:25.550051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:59.908548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878442+0000","last_change":"2024-09-10T06:26:32.247492+0000","last_active":"2024-09-10T06:27:24.878442+0000","last_peered":"2024-09-10T06:27:24.878442+0000","last_clean":"2024-09-10T06:27:24.878442+0000","last_became_active":"2024-09-10T06:26:32.246938+0000","last_became_peered":"2024-09-10T06:26:32.246938+0000","last_unstale":"2024-09-10T06:27:24.878442+0000","last_undegraded":"2024-09-10T06:27:24.878442+0000","last_fullsized":"2024-09-10T06:27:24.878442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:01.766868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553715+0000","last_change":"2024-09-10T06:26:30.592866+0000","last_active":"2024-09-10T06:27:25.553715+0000","last_peered":"2024-09-10T06:27:25.553715+0000","last_clean":"2024-09-10T06:27:25.553715+0000","last_became_active":"2024-09-10T06:26:30.592550+0000","last_became_peered":"2024-09-10T06:26:30.592550+0000","last_unstale":"2024-09-10T06:27:25.553715+0000","last_undegraded":"2024-09-10T06:27:25.553715+0000","last_fullsized":"2024-09-10T06:27:25.553715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:02.132556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551602+0000","last_change":"2024-09-10T06:26:32.278347+0000","last_active":"2024-09-10T06:27:25.551602+0000","last_peered":"2024-09-10T06:27:25.551602+0000","last_clean":"2024-09-10T06:27:25.551602+0000","last_became_active":"2024-09-10T06:26:32.275206+0000","last_became_peered":"2024-09-10T06:26:32.275206+0000","last_unstale":"2024-09-10T06:27:25.551602+0000","last_undegraded":"2024-09-10T06:27:25.551602+0000","last_fullsized":"2024-09-10T06:27:25.551602+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780035+0000","last_change":"2024-09-10T06:26:30.572734+0000","last_active":"2024-09-10T06:27:23.780035+0000","last_peered":"2024-09-10T06:27:23.780035+0000","last_clean":"2024-09-10T06:27:23.780035+0000","last_became_active":"2024-09-10T06:26:30.572043+0000","last_became_peered":"2024-09-10T06:26:30.572043+0000","last_unstale":"2024-09-10T06:27:23.780035+0000","last_undegraded":"2024-09-10T06:27:23.780035+0000","last_fullsized":"2024-09-10T06:27:23.780035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549120+0000","last_change":"2024-09-10T06:26:40.323476+0000","last_active":"2024-09-10T06:27:25.549120+0000","last_peered":"2024-09-10T06:27:25.549120+0000","last_clean":"2024-09-10T06:27:25.549120+0000","last_became_active":"2024-09-10T06:26:40.322711+0000","last_became_peered":"2024-09-10T06:26:40.322711+0000","last_unstale":"2024-09-10T06:27:25.549120+0000","last_undegraded":"2024-09-10T06:27:25.549120+0000","last_fullsized":"2024-09-10T06:27:25.549120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554356+0000","last_change":"2024-09-10T06:26:32.276274+0000","last_active":"2024-09-10T06:27:25.554356+0000","last_peered":"2024-09-10T06:27:25.554356+0000","last_clean":"2024-09-10T06:27:25.554356+0000","last_became_active":"2024-09-10T06:26:32.275889+0000","last_became_peered":"2024-09-10T06:26:32.275889+0000","last_unstale":"2024-09-10T06:27:25.554356+0000","last_undegraded":"2024-09-10T06:27:25.554356+0000","last_fullsized":"2024-09-10T06:27:25.554356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790617+0000","last_change":"2024-09-10T06:26:30.595738+0000","last_active":"2024-09-10T06:27:23.790617+0000","last_peered":"2024-09-10T06:27:23.790617+0000","last_clean":"2024-09-10T06:27:23.790617+0000","last_became_active":"2024-09-10T06:26:30.595128+0000","last_became_peered":"2024-09-10T06:26:30.595128+0000","last_unstale":"2024-09-10T06:27:23.790617+0000","last_undegraded":"2024-09-10T06:27:23.790617+0000","last_fullsized":"2024-09-10T06:27:23.790617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788402+0000","last_change":"2024-09-10T06:26:34.279824+0000","last_active":"2024-09-10T06:27:23.788402+0000","last_peered":"2024-09-10T06:27:23.788402+0000","last_clean":"2024-09-10T06:27:23.788402+0000","last_became_active":"2024-09-10T06:26:34.279074+0000","last_became_peered":"2024-09-10T06:26:34.279074+0000","last_unstale":"2024-09-10T06:27:23.788402+0000","last_undegraded":"2024-09-10T06:27:23.788402+0000","last_fullsized":"2024-09-10T06:27:23.788402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:40.507467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"34'9","reported_seq":67,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780844+0000","last_change":"2024-09-10T06:26:36.296703+0000","last_active":"2024-09-10T06:27:23.780844+0000","last_peered":"2024-09-10T06:27:23.780844+0000","last_clean":"2024-09-10T06:27:23.780844+0000","last_became_active":"2024-09-10T06:26:36.295786+0000","last_became_peered":"2024-09-10T06:26:36.295786+0000","last_unstale":"2024-09-10T06:27:23.780844+0000","last_undegraded":"2024-09-10T06:27:23.780844+0000","last_fullsized":"2024-09-10T06:27:23.780844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:31.699855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":46,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790687+0000","last_change":"2024-09-10T06:26:38.305468+0000","last_active":"2024-09-10T06:27:23.790687+0000","last_peered":"2024-09-10T06:27:23.790687+0000","last_clean":"2024-09-10T06:27:23.790687+0000","last_became_active":"2024-09-10T06:26:38.304847+0000","last_became_peered":"2024-09-10T06:26:38.304847+0000","last_unstale":"2024-09-10T06:27:23.790687+0000","last_undegraded":"2024-09-10T06:27:23.790687+0000","last_fullsized":"2024-09-10T06:27:23.790687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:36.499856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.784306+0000","last_change":"2024-09-10T06:26:40.331389+0000","last_active":"2024-09-10T06:27:23.784306+0000","last_peered":"2024-09-10T06:27:23.784306+0000","last_clean":"2024-09-10T06:27:23.784306+0000","last_became_active":"2024-09-10T06:26:40.330777+0000","last_became_peered":"2024-09-10T06:26:40.330777+0000","last_unstale":"2024-09-10T06:27:23.784306+0000","last_undegraded":"2024-09-10T06:27:23.784306+0000","last_fullsized":"2024-09-10T06:27:23.784306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:22.792159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788924+0000","last_change":"2024-09-10T06:26:32.283112+0000","last_active":"2024-09-10T06:27:23.788924+0000","last_peered":"2024-09-10T06:27:23.788924+0000","last_clean":"2024-09-10T06:27:23.788924+0000","last_became_active":"2024-09-10T06:26:32.282263+0000","last_became_peered":"2024-09-10T06:26:32.282263+0000","last_unstale":"2024-09-10T06:27:23.788924+0000","last_undegraded":"2024-09-10T06:27:23.788924+0000","last_fullsized":"2024-09-10T06:27:23.788924+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:02.124800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780108+0000","last_change":"2024-09-10T06:26:30.576489+0000","last_active":"2024-09-10T06:27:23.780108+0000","last_peered":"2024-09-10T06:27:23.780108+0000","last_clean":"2024-09-10T06:27:23.780108+0000","last_became_active":"2024-09-10T06:26:30.576039+0000","last_became_peered":"2024-09-10T06:26:30.576039+0000","last_unstale":"2024-09-10T06:27:23.780108+0000","last_undegraded":"2024-09-10T06:27:23.780108+0000","last_fullsized":"2024-09-10T06:27:23.780108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":59,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554277+0000","last_change":"2024-09-10T06:26:34.268758+0000","last_active":"2024-09-10T06:27:25.554277+0000","last_peered":"2024-09-10T06:27:25.554277+0000","last_clean":"2024-09-10T06:27:25.554277+0000","last_became_active":"2024-09-10T06:26:34.268279+0000","last_became_peered":"2024-09-10T06:26:34.268279+0000","last_unstale":"2024-09-10T06:27:25.554277+0000","last_undegraded":"2024-09-10T06:27:25.554277+0000","last_fullsized":"2024-09-10T06:27:25.554277+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:42.052702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551622+0000","last_change":"2024-09-10T06:26:36.273991+0000","last_active":"2024-09-10T06:27:25.551622+0000","last_peered":"2024-09-10T06:27:25.551622+0000","last_clean":"2024-09-10T06:27:25.551622+0000","last_became_active":"2024-09-10T06:26:36.273138+0000","last_became_peered":"2024-09-10T06:26:36.273138+0000","last_unstale":"2024-09-10T06:27:25.551622+0000","last_undegraded":"2024-09-10T06:27:25.551622+0000","last_fullsized":"2024-09-10T06:27:25.551622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":50,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551393+0000","last_change":"2024-09-10T06:26:38.294543+0000","last_active":"2024-09-10T06:27:25.551393+0000","last_peered":"2024-09-10T06:27:25.551393+0000","last_clean":"2024-09-10T06:27:25.551393+0000","last_became_active":"2024-09-10T06:26:38.293754+0000","last_became_peered":"2024-09-10T06:26:38.293754+0000","last_unstale":"2024-09-10T06:27:25.551393+0000","last_undegraded":"2024-09-10T06:27:25.551393+0000","last_fullsized":"2024-09-10T06:27:25.551393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.779821+0000","last_change":"2024-09-10T06:26:40.326998+0000","last_active":"2024-09-10T06:27:23.779821+0000","last_peered":"2024-09-10T06:27:23.779821+0000","last_clean":"2024-09-10T06:27:23.779821+0000","last_became_active":"2024-09-10T06:26:40.322648+0000","last_became_peered":"2024-09-10T06:26:40.322648+0000","last_unstale":"2024-09-10T06:27:23.779821+0000","last_undegraded":"2024-09-10T06:27:23.779821+0000","last_fullsized":"2024-09-10T06:27:23.779821+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:19.837495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781412+0000","last_change":"2024-09-10T06:26:32.256959+0000","last_active":"2024-09-10T06:27:23.781412+0000","last_peered":"2024-09-10T06:27:23.781412+0000","last_clean":"2024-09-10T06:27:23.781412+0000","last_became_active":"2024-09-10T06:26:32.256701+0000","last_became_peered":"2024-09-10T06:26:32.256701+0000","last_unstale":"2024-09-10T06:27:23.781412+0000","last_undegraded":"2024-09-10T06:27:23.781412+0000","last_fullsized":"2024-09-10T06:27:23.781412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788873+0000","last_change":"2024-09-10T06:26:30.598409+0000","last_active":"2024-09-10T06:27:23.788873+0000","last_peered":"2024-09-10T06:27:23.788873+0000","last_clean":"2024-09-10T06:27:23.788873+0000","last_became_active":"2024-09-10T06:26:30.597703+0000","last_became_peered":"2024-09-10T06:26:30.597703+0000","last_unstale":"2024-09-10T06:27:23.788873+0000","last_undegraded":"2024-09-10T06:27:23.788873+0000","last_fullsized":"2024-09-10T06:27:23.788873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":59,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553994+0000","last_change":"2024-09-10T06:26:34.268741+0000","last_active":"2024-09-10T06:27:25.553994+0000","last_peered":"2024-09-10T06:27:25.553994+0000","last_clean":"2024-09-10T06:27:25.553994+0000","last_became_active":"2024-09-10T06:26:34.268192+0000","last_became_peered":"2024-09-10T06:26:34.268192+0000","last_unstale":"2024-09-10T06:27:25.553994+0000","last_undegraded":"2024-09-10T06:27:25.553994+0000","last_fullsized":"2024-09-10T06:27:25.553994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:42:10.110645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":68,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.877874+0000","last_change":"2024-09-10T06:26:36.275955+0000","last_active":"2024-09-10T06:27:24.877874+0000","last_peered":"2024-09-10T06:27:24.877874+0000","last_clean":"2024-09-10T06:27:24.877874+0000","last_became_active":"2024-09-10T06:26:36.275306+0000","last_became_peered":"2024-09-10T06:26:36.275306+0000","last_unstale":"2024-09-10T06:27:24.877874+0000","last_undegraded":"2024-09-10T06:27:24.877874+0000","last_fullsized":"2024-09-10T06:27:24.877874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:03.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'2","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790130+0000","last_change":"2024-09-10T06:26:38.302764+0000","last_active":"2024-09-10T06:27:23.790130+0000","last_peered":"2024-09-10T06:27:23.790130+0000","last_clean":"2024-09-10T06:27:23.790130+0000","last_became_active":"2024-09-10T06:26:38.300326+0000","last_became_peered":"2024-09-10T06:26:38.300326+0000","last_unstale":"2024-09-10T06:27:23.790130+0000","last_undegraded":"2024-09-10T06:27:23.790130+0000","last_fullsized":"2024-09-10T06:27:23.790130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:29.851085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549648+0000","last_change":"2024-09-10T06:26:40.297893+0000","last_active":"2024-09-10T06:27:25.549648+0000","last_peered":"2024-09-10T06:27:25.549648+0000","last_clean":"2024-09-10T06:27:25.549648+0000","last_became_active":"2024-09-10T06:26:40.297296+0000","last_became_peered":"2024-09-10T06:26:40.297296+0000","last_unstale":"2024-09-10T06:27:25.549648+0000","last_undegraded":"2024-09-10T06:27:25.549648+0000","last_fullsized":"2024-09-10T06:27:25.549648+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553626+0000","last_change":"2024-09-10T06:26:32.265005+0000","last_active":"2024-09-10T06:27:25.553626+0000","last_peered":"2024-09-10T06:27:25.553626+0000","last_clean":"2024-09-10T06:27:25.553626+0000","last_became_active":"2024-09-10T06:26:32.264334+0000","last_became_peered":"2024-09-10T06:26:32.264334+0000","last_unstale":"2024-09-10T06:27:25.553626+0000","last_undegraded":"2024-09-10T06:27:25.553626+0000","last_fullsized":"2024-09-10T06:27:25.553626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967123+0000","last_change":"2024-09-10T06:26:30.576242+0000","last_active":"2024-09-10T06:27:24.967123+0000","last_peered":"2024-09-10T06:27:24.967123+0000","last_clean":"2024-09-10T06:27:24.967123+0000","last_became_active":"2024-09-10T06:26:30.575433+0000","last_became_peered":"2024-09-10T06:26:30.575433+0000","last_unstale":"2024-09-10T06:27:24.967123+0000","last_undegraded":"2024-09-10T06:27:24.967123+0000","last_fullsized":"2024-09-10T06:27:24.967123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788762+0000","last_change":"2024-09-10T06:26:34.283701+0000","last_active":"2024-09-10T06:27:23.788762+0000","last_peered":"2024-09-10T06:27:23.788762+0000","last_clean":"2024-09-10T06:27:23.788762+0000","last_became_active":"2024-09-10T06:26:34.282941+0000","last_became_peered":"2024-09-10T06:26:34.282941+0000","last_unstale":"2024-09-10T06:27:23.788762+0000","last_undegraded":"2024-09-10T06:27:23.788762+0000","last_fullsized":"2024-09-10T06:27:23.788762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:29.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'9","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790398+0000","last_change":"2024-09-10T06:26:36.298510+0000","last_active":"2024-09-10T06:27:23.790398+0000","last_peered":"2024-09-10T06:27:23.790398+0000","last_clean":"2024-09-10T06:27:23.790398+0000","last_became_active":"2024-09-10T06:26:36.297309+0000","last_became_peered":"2024-09-10T06:26:36.297309+0000","last_unstale":"2024-09-10T06:27:23.790398+0000","last_undegraded":"2024-09-10T06:27:23.790398+0000","last_fullsized":"2024-09-10T06:27:23.790398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"31'2","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553369+0000","last_change":"2024-09-10T06:26:38.300228+0000","last_active":"2024-09-10T06:27:25.553369+0000","last_peered":"2024-09-10T06:27:25.553369+0000","last_clean":"2024-09-10T06:27:25.553369+0000","last_became_active":"2024-09-10T06:26:38.299355+0000","last_became_peered":"2024-09-10T06:26:38.299355+0000","last_unstale":"2024-09-10T06:27:25.553369+0000","last_undegraded":"2024-09-10T06:27:25.553369+0000","last_fullsized":"2024-09-10T06:27:25.553369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:20.050096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.785079+0000","last_change":"2024-09-10T06:26:32.271283+0000","last_active":"2024-09-10T06:27:23.785079+0000","last_peered":"2024-09-10T06:27:23.785079+0000","last_clean":"2024-09-10T06:27:23.785079+0000","last_became_active":"2024-09-10T06:26:32.270496+0000","last_became_peered":"2024-09-10T06:26:32.270496+0000","last_unstale":"2024-09-10T06:27:23.785079+0000","last_undegraded":"2024-09-10T06:27:23.785079+0000","last_fullsized":"2024-09-10T06:27:23.785079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.791342+0000","last_change":"2024-09-10T06:26:30.607373+0000","last_active":"2024-09-10T06:27:23.791342+0000","last_peered":"2024-09-10T06:27:23.791342+0000","last_clean":"2024-09-10T06:27:23.791342+0000","last_became_active":"2024-09-10T06:26:30.606685+0000","last_became_peered":"2024-09-10T06:26:30.606685+0000","last_unstale":"2024-09-10T06:27:23.791342+0000","last_undegraded":"2024-09-10T06:27:23.791342+0000","last_fullsized":"2024-09-10T06:27:23.791342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:35.705564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.787583+0000","last_change":"2024-09-10T06:26:34.286925+0000","last_active":"2024-09-10T06:27:23.787583+0000","last_peered":"2024-09-10T06:27:23.787583+0000","last_clean":"2024-09-10T06:27:23.787583+0000","last_became_active":"2024-09-10T06:26:34.285787+0000","last_became_peered":"2024-09-10T06:26:34.285787+0000","last_unstale":"2024-09-10T06:27:23.787583+0000","last_undegraded":"2024-09-10T06:27:23.787583+0000","last_fullsized":"2024-09-10T06:27:23.787583+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"34'19","reported_seq":82,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.785527+0000","last_change":"2024-09-10T06:26:36.293988+0000","last_active":"2024-09-10T06:27:23.785527+0000","last_peered":"2024-09-10T06:27:23.785527+0000","last_clean":"2024-09-10T06:27:23.785527+0000","last_became_active":"2024-09-10T06:26:36.293226+0000","last_became_peered":"2024-09-10T06:26:36.293226+0000","last_unstale":"2024-09-10T06:27:23.785527+0000","last_undegraded":"2024-09-10T06:27:23.785527+0000","last_fullsized":"2024-09-10T06:27:23.785527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":50,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549424+0000","last_change":"2024-09-10T06:26:38.305826+0000","last_active":"2024-09-10T06:27:25.549424+0000","last_peered":"2024-09-10T06:27:25.549424+0000","last_clean":"2024-09-10T06:27:25.549424+0000","last_became_active":"2024-09-10T06:26:38.304601+0000","last_became_peered":"2024-09-10T06:26:38.304601+0000","last_unstale":"2024-09-10T06:27:25.549424+0000","last_undegraded":"2024-09-10T06:27:25.549424+0000","last_fullsized":"2024-09-10T06:27:25.549424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:12.545261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788151+0000","last_change":"2024-09-10T06:26:40.332286+0000","last_active":"2024-09-10T06:27:23.788151+0000","last_peered":"2024-09-10T06:27:23.788151+0000","last_clean":"2024-09-10T06:27:23.788151+0000","last_became_active":"2024-09-10T06:26:40.331262+0000","last_became_peered":"2024-09-10T06:26:40.331262+0000","last_unstale":"2024-09-10T06:27:23.788151+0000","last_undegraded":"2024-09-10T06:27:23.788151+0000","last_fullsized":"2024-09-10T06:27:23.788151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549517+0000","last_change":"2024-09-10T06:26:32.262320+0000","last_active":"2024-09-10T06:27:25.549517+0000","last_peered":"2024-09-10T06:27:25.549517+0000","last_clean":"2024-09-10T06:27:25.549517+0000","last_became_active":"2024-09-10T06:26:32.261423+0000","last_became_peered":"2024-09-10T06:26:32.261423+0000","last_unstale":"2024-09-10T06:27:25.549517+0000","last_undegraded":"2024-09-10T06:27:25.549517+0000","last_fullsized":"2024-09-10T06:27:25.549517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.791441+0000","last_change":"2024-09-10T06:26:30.595879+0000","last_active":"2024-09-10T06:27:23.791441+0000","last_peered":"2024-09-10T06:27:23.791441+0000","last_clean":"2024-09-10T06:27:23.791441+0000","last_became_active":"2024-09-10T06:26:30.595269+0000","last_became_peered":"2024-09-10T06:26:30.595269+0000","last_unstale":"2024-09-10T06:27:23.791441+0000","last_undegraded":"2024-09-10T06:27:23.791441+0000","last_fullsized":"2024-09-10T06:27:23.791441+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.877795+0000","last_change":"2024-09-10T06:26:34.266906+0000","last_active":"2024-09-10T06:27:24.877795+0000","last_peered":"2024-09-10T06:27:24.877795+0000","last_clean":"2024-09-10T06:27:24.877795+0000","last_became_active":"2024-09-10T06:26:34.266017+0000","last_became_peered":"2024-09-10T06:26:34.266017+0000","last_unstale":"2024-09-10T06:27:24.877795+0000","last_undegraded":"2024-09-10T06:27:24.877795+0000","last_fullsized":"2024-09-10T06:27:24.877795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:24.366166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'9","reported_seq":71,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554095+0000","last_change":"2024-09-10T06:26:36.297020+0000","last_active":"2024-09-10T06:27:25.554095+0000","last_peered":"2024-09-10T06:27:25.554095+0000","last_clean":"2024-09-10T06:27:25.554095+0000","last_became_active":"2024-09-10T06:26:36.295796+0000","last_became_peered":"2024-09-10T06:26:36.295796+0000","last_unstale":"2024-09-10T06:27:25.554095+0000","last_undegraded":"2024-09-10T06:27:25.554095+0000","last_fullsized":"2024-09-10T06:27:25.554095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":51,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552934+0000","last_change":"2024-09-10T06:26:38.297273+0000","last_active":"2024-09-10T06:27:25.552934+0000","last_peered":"2024-09-10T06:27:25.552934+0000","last_clean":"2024-09-10T06:27:25.552934+0000","last_became_active":"2024-09-10T06:26:38.296455+0000","last_became_peered":"2024-09-10T06:26:38.296455+0000","last_unstale":"2024-09-10T06:27:25.552934+0000","last_undegraded":"2024-09-10T06:27:25.552934+0000","last_fullsized":"2024-09-10T06:27:25.552934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:26.766702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":44,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967944+0000","last_change":"2024-09-10T06:26:40.328294+0000","last_active":"2024-09-10T06:27:24.967944+0000","last_peered":"2024-09-10T06:27:24.967944+0000","last_clean":"2024-09-10T06:27:24.967944+0000","last_became_active":"2024-09-10T06:26:40.327585+0000","last_became_peered":"2024-09-10T06:26:40.327585+0000","last_unstale":"2024-09-10T06:27:24.967944+0000","last_undegraded":"2024-09-10T06:27:24.967944+0000","last_fullsized":"2024-09-10T06:27:24.967944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.537210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":66,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967641+0000","last_change":"2024-09-10T06:27:08.600683+0000","last_active":"2024-09-10T06:27:24.967641+0000","last_peered":"2024-09-10T06:27:24.967641+0000","last_clean":"2024-09-10T06:27:24.967641+0000","last_became_active":"2024-09-10T06:27:08.599875+0000","last_became_peered":"2024-09-10T06:27:08.599875+0000","last_unstale":"2024-09-10T06:27:24.967641+0000","last_undegraded":"2024-09-10T06:27:24.967641+0000","last_fullsized":"2024-09-10T06:27:24.967641+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:59.605814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.791024+0000","last_change":"2024-09-10T06:26:30.611704+0000","last_active":"2024-09-10T06:27:23.791024+0000","last_peered":"2024-09-10T06:27:23.791024+0000","last_clean":"2024-09-10T06:27:23.791024+0000","last_became_active":"2024-09-10T06:26:30.611039+0000","last_became_peered":"2024-09-10T06:26:30.611039+0000","last_unstale":"2024-09-10T06:27:23.791024+0000","last_undegraded":"2024-09-10T06:27:23.791024+0000","last_fullsized":"2024-09-10T06:27:23.791024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878477+0000","last_change":"2024-09-10T06:26:34.263514+0000","last_active":"2024-09-10T06:27:24.878477+0000","last_peered":"2024-09-10T06:27:24.878477+0000","last_clean":"2024-09-10T06:27:24.878477+0000","last_became_active":"2024-09-10T06:26:34.262793+0000","last_became_peered":"2024-09-10T06:26:34.262793+0000","last_unstale":"2024-09-10T06:27:24.878477+0000","last_undegraded":"2024-09-10T06:27:24.878477+0000","last_fullsized":"2024-09-10T06:27:24.878477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:31.501738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'15","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.783980+0000","last_change":"2024-09-10T06:26:36.299923+0000","last_active":"2024-09-10T06:27:23.783980+0000","last_peered":"2024-09-10T06:27:23.783980+0000","last_clean":"2024-09-10T06:27:23.783980+0000","last_became_active":"2024-09-10T06:26:36.299140+0000","last_became_peered":"2024-09-10T06:26:36.299140+0000","last_unstale":"2024-09-10T06:27:23.783980+0000","last_undegraded":"2024-09-10T06:27:23.783980+0000","last_fullsized":"2024-09-10T06:27:23.783980+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:12.246303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"31'2","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781713+0000","last_change":"2024-09-10T06:26:38.292019+0000","last_active":"2024-09-10T06:27:23.781713+0000","last_peered":"2024-09-10T06:27:23.781713+0000","last_clean":"2024-09-10T06:27:23.781713+0000","last_became_active":"2024-09-10T06:26:38.291322+0000","last_became_peered":"2024-09-10T06:26:38.291322+0000","last_unstale":"2024-09-10T06:27:23.781713+0000","last_undegraded":"2024-09-10T06:27:23.781713+0000","last_fullsized":"2024-09-10T06:27:23.781713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780932+0000","last_change":"2024-09-10T06:26:40.328427+0000","last_active":"2024-09-10T06:27:23.780932+0000","last_peered":"2024-09-10T06:27:23.780932+0000","last_clean":"2024-09-10T06:27:23.780932+0000","last_became_active":"2024-09-10T06:26:40.323249+0000","last_became_peered":"2024-09-10T06:26:40.323249+0000","last_unstale":"2024-09-10T06:27:23.780932+0000","last_undegraded":"2024-09-10T06:27:23.780932+0000","last_fullsized":"2024-09-10T06:27:23.780932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:50.823195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780949+0000","last_change":"2024-09-10T06:26:32.274824+0000","last_active":"2024-09-10T06:27:23.780949+0000","last_peered":"2024-09-10T06:27:23.780949+0000","last_clean":"2024-09-10T06:27:23.780949+0000","last_became_active":"2024-09-10T06:26:32.274496+0000","last_became_peered":"2024-09-10T06:26:32.274496+0000","last_unstale":"2024-09-10T06:27:23.780949+0000","last_undegraded":"2024-09-10T06:27:23.780949+0000","last_fullsized":"2024-09-10T06:27:23.780949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:39.513476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788821+0000","last_change":"2024-09-10T06:26:30.604684+0000","last_active":"2024-09-10T06:27:23.788821+0000","last_peered":"2024-09-10T06:27:23.788821+0000","last_clean":"2024-09-10T06:27:23.788821+0000","last_became_active":"2024-09-10T06:26:30.593432+0000","last_became_peered":"2024-09-10T06:26:30.593432+0000","last_unstale":"2024-09-10T06:27:23.788821+0000","last_undegraded":"2024-09-10T06:27:23.788821+0000","last_fullsized":"2024-09-10T06:27:23.788821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878207+0000","last_change":"2024-09-10T06:26:34.256662+0000","last_active":"2024-09-10T06:27:24.878207+0000","last_peered":"2024-09-10T06:27:24.878207+0000","last_clean":"2024-09-10T06:27:24.878207+0000","last_became_active":"2024-09-10T06:26:34.256256+0000","last_became_peered":"2024-09-10T06:26:34.256256+0000","last_unstale":"2024-09-10T06:27:24.878207+0000","last_undegraded":"2024-09-10T06:27:24.878207+0000","last_fullsized":"2024-09-10T06:27:24.878207+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:35.549063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'12","reported_seq":74,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781926+0000","last_change":"2024-09-10T06:26:36.296631+0000","last_active":"2024-09-10T06:27:23.781926+0000","last_peered":"2024-09-10T06:27:23.781926+0000","last_clean":"2024-09-10T06:27:23.781926+0000","last_became_active":"2024-09-10T06:26:36.295838+0000","last_became_peered":"2024-09-10T06:26:36.295838+0000","last_unstale":"2024-09-10T06:27:23.781926+0000","last_undegraded":"2024-09-10T06:27:23.781926+0000","last_fullsized":"2024-09-10T06:27:23.781926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:04.271824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":49,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.877704+0000","last_change":"2024-09-10T06:26:38.308698+0000","last_active":"2024-09-10T06:27:24.877704+0000","last_peered":"2024-09-10T06:27:24.877704+0000","last_clean":"2024-09-10T06:27:24.877704+0000","last_became_active":"2024-09-10T06:26:38.307965+0000","last_became_peered":"2024-09-10T06:26:38.307965+0000","last_unstale":"2024-09-10T06:27:24.877704+0000","last_undegraded":"2024-09-10T06:27:24.877704+0000","last_fullsized":"2024-09-10T06:27:24.877704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:04.566221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551465+0000","last_change":"2024-09-10T06:26:40.326474+0000","last_active":"2024-09-10T06:27:25.551465+0000","last_peered":"2024-09-10T06:27:25.551465+0000","last_clean":"2024-09-10T06:27:25.551465+0000","last_became_active":"2024-09-10T06:26:40.325731+0000","last_became_peered":"2024-09-10T06:26:40.325731+0000","last_unstale":"2024-09-10T06:27:25.551465+0000","last_undegraded":"2024-09-10T06:27:25.551465+0000","last_fullsized":"2024-09-10T06:27:25.551465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:19.400355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550415+0000","last_change":"2024-09-10T06:26:32.254177+0000","last_active":"2024-09-10T06:27:25.550415+0000","last_peered":"2024-09-10T06:27:25.550415+0000","last_clean":"2024-09-10T06:27:25.550415+0000","last_became_active":"2024-09-10T06:26:32.253154+0000","last_became_peered":"2024-09-10T06:26:32.253154+0000","last_unstale":"2024-09-10T06:27:25.550415+0000","last_undegraded":"2024-09-10T06:27:25.550415+0000","last_fullsized":"2024-09-10T06:27:25.550415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553498+0000","last_change":"2024-09-10T06:26:30.572406+0000","last_active":"2024-09-10T06:27:25.553498+0000","last_peered":"2024-09-10T06:27:25.553498+0000","last_clean":"2024-09-10T06:27:25.553498+0000","last_became_active":"2024-09-10T06:26:30.571829+0000","last_became_peered":"2024-09-10T06:26:30.571829+0000","last_unstale":"2024-09-10T06:27:25.553498+0000","last_undegraded":"2024-09-10T06:27:25.553498+0000","last_fullsized":"2024-09-10T06:27:25.553498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":57,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878654+0000","last_change":"2024-09-10T06:26:34.285406+0000","last_active":"2024-09-10T06:27:24.878654+0000","last_peered":"2024-09-10T06:27:24.878654+0000","last_clean":"2024-09-10T06:27:24.878654+0000","last_became_active":"2024-09-10T06:26:34.285004+0000","last_became_peered":"2024-09-10T06:26:34.285004+0000","last_unstale":"2024-09-10T06:27:24.878654+0000","last_undegraded":"2024-09-10T06:27:24.878654+0000","last_fullsized":"2024-09-10T06:27:24.878654+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:03.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'11","reported_seq":73,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551432+0000","last_change":"2024-09-10T06:26:36.293191+0000","last_active":"2024-09-10T06:27:25.551432+0000","last_peered":"2024-09-10T06:27:25.551432+0000","last_clean":"2024-09-10T06:27:25.551432+0000","last_became_active":"2024-09-10T06:26:36.292423+0000","last_became_peered":"2024-09-10T06:26:36.292423+0000","last_unstale":"2024-09-10T06:27:25.551432+0000","last_undegraded":"2024-09-10T06:27:25.551432+0000","last_fullsized":"2024-09-10T06:27:25.551432+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781765+0000","last_change":"2024-09-10T06:26:38.293667+0000","last_active":"2024-09-10T06:27:23.781765+0000","last_peered":"2024-09-10T06:27:23.781765+0000","last_clean":"2024-09-10T06:27:23.781765+0000","last_became_active":"2024-09-10T06:26:38.292918+0000","last_became_peered":"2024-09-10T06:26:38.292918+0000","last_unstale":"2024-09-10T06:27:23.781765+0000","last_undegraded":"2024-09-10T06:27:23.781765+0000","last_fullsized":"2024-09-10T06:27:23.781765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:57.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552149+0000","last_change":"2024-09-10T06:26:40.327061+0000","last_active":"2024-09-10T06:27:25.552149+0000","last_peered":"2024-09-10T06:27:25.552149+0000","last_clean":"2024-09-10T06:27:25.552149+0000","last_became_active":"2024-09-10T06:26:40.326431+0000","last_became_peered":"2024-09-10T06:26:40.326431+0000","last_unstale":"2024-09-10T06:27:25.552149+0000","last_undegraded":"2024-09-10T06:27:25.552149+0000","last_fullsized":"2024-09-10T06:27:25.552149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:27.631214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551610+0000","last_change":"2024-09-10T06:26:32.255139+0000","last_active":"2024-09-10T06:27:25.551610+0000","last_peered":"2024-09-10T06:27:25.551610+0000","last_clean":"2024-09-10T06:27:25.551610+0000","last_became_active":"2024-09-10T06:26:32.253524+0000","last_became_peered":"2024-09-10T06:26:32.253524+0000","last_unstale":"2024-09-10T06:27:25.551610+0000","last_undegraded":"2024-09-10T06:27:25.551610+0000","last_fullsized":"2024-09-10T06:27:25.551610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967873+0000","last_change":"2024-09-10T06:26:30.591838+0000","last_active":"2024-09-10T06:27:24.967873+0000","last_peered":"2024-09-10T06:27:24.967873+0000","last_clean":"2024-09-10T06:27:24.967873+0000","last_became_active":"2024-09-10T06:26:30.591125+0000","last_became_peered":"2024-09-10T06:26:30.591125+0000","last_unstale":"2024-09-10T06:27:24.967873+0000","last_undegraded":"2024-09-10T06:27:24.967873+0000","last_fullsized":"2024-09-10T06:27:24.967873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549644+0000","last_change":"2024-09-10T06:26:34.280391+0000","last_active":"2024-09-10T06:27:25.549644+0000","last_peered":"2024-09-10T06:27:25.549644+0000","last_clean":"2024-09-10T06:27:25.549644+0000","last_became_active":"2024-09-10T06:26:34.280058+0000","last_became_peered":"2024-09-10T06:26:34.280058+0000","last_unstale":"2024-09-10T06:27:25.549644+0000","last_undegraded":"2024-09-10T06:27:25.549644+0000","last_fullsized":"2024-09-10T06:27:25.549644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.461857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'15","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.879124+0000","last_change":"2024-09-10T06:26:36.277547+0000","last_active":"2024-09-10T06:27:24.879124+0000","last_peered":"2024-09-10T06:27:24.879124+0000","last_clean":"2024-09-10T06:27:24.879124+0000","last_became_active":"2024-09-10T06:26:36.276965+0000","last_became_peered":"2024-09-10T06:26:36.276965+0000","last_unstale":"2024-09-10T06:27:24.879124+0000","last_undegraded":"2024-09-10T06:27:24.879124+0000","last_fullsized":"2024-09-10T06:27:24.879124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:43.212945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'2","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878716+0000","last_change":"2024-09-10T06:26:38.306134+0000","last_active":"2024-09-10T06:27:24.878716+0000","last_peered":"2024-09-10T06:27:24.878716+0000","last_clean":"2024-09-10T06:27:24.878716+0000","last_became_active":"2024-09-10T06:26:38.299012+0000","last_became_peered":"2024-09-10T06:26:38.299012+0000","last_unstale":"2024-09-10T06:27:24.878716+0000","last_undegraded":"2024-09-10T06:27:24.878716+0000","last_fullsized":"2024-09-10T06:27:24.878716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:37.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552167+0000","last_change":"2024-09-10T06:26:40.336036+0000","last_active":"2024-09-10T06:27:25.552167+0000","last_peered":"2024-09-10T06:27:25.552167+0000","last_clean":"2024-09-10T06:27:25.552167+0000","last_became_active":"2024-09-10T06:26:40.335302+0000","last_became_peered":"2024-09-10T06:26:40.335302+0000","last_unstale":"2024-09-10T06:27:25.552167+0000","last_undegraded":"2024-09-10T06:27:25.552167+0000","last_fullsized":"2024-09-10T06:27:25.552167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:24.024562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552106+0000","last_change":"2024-09-10T06:26:32.287897+0000","last_active":"2024-09-10T06:27:25.552106+0000","last_peered":"2024-09-10T06:27:25.552106+0000","last_clean":"2024-09-10T06:27:25.552106+0000","last_became_active":"2024-09-10T06:26:32.287315+0000","last_became_peered":"2024-09-10T06:26:32.287315+0000","last_unstale":"2024-09-10T06:27:25.552106+0000","last_undegraded":"2024-09-10T06:27:25.552106+0000","last_fullsized":"2024-09-10T06:27:25.552106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550645+0000","last_change":"2024-09-10T06:26:30.569192+0000","last_active":"2024-09-10T06:27:25.550645+0000","last_peered":"2024-09-10T06:27:25.550645+0000","last_clean":"2024-09-10T06:27:25.550645+0000","last_became_active":"2024-09-10T06:26:30.568464+0000","last_became_peered":"2024-09-10T06:26:30.568464+0000","last_unstale":"2024-09-10T06:27:25.550645+0000","last_undegraded":"2024-09-10T06:27:25.550645+0000","last_fullsized":"2024-09-10T06:27:25.550645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:58.987914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790144+0000","last_change":"2024-09-10T06:26:34.279935+0000","last_active":"2024-09-10T06:27:23.790144+0000","last_peered":"2024-09-10T06:27:23.790144+0000","last_clean":"2024-09-10T06:27:23.790144+0000","last_became_active":"2024-09-10T06:26:34.279192+0000","last_became_peered":"2024-09-10T06:26:34.279192+0000","last_unstale":"2024-09-10T06:27:23.790144+0000","last_undegraded":"2024-09-10T06:27:23.790144+0000","last_fullsized":"2024-09-10T06:27:23.790144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:18.753175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554174+0000","last_change":"2024-09-10T06:26:36.290330+0000","last_active":"2024-09-10T06:27:25.554174+0000","last_peered":"2024-09-10T06:27:25.554174+0000","last_clean":"2024-09-10T06:27:25.554174+0000","last_became_active":"2024-09-10T06:26:36.289527+0000","last_became_peered":"2024-09-10T06:26:36.289527+0000","last_unstale":"2024-09-10T06:27:25.554174+0000","last_undegraded":"2024-09-10T06:27:25.554174+0000","last_fullsized":"2024-09-10T06:27:25.554174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'2","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.968225+0000","last_change":"2024-09-10T06:26:38.288663+0000","last_active":"2024-09-10T06:27:24.968225+0000","last_peered":"2024-09-10T06:27:24.968225+0000","last_clean":"2024-09-10T06:27:24.968225+0000","last_became_active":"2024-09-10T06:26:38.287740+0000","last_became_peered":"2024-09-10T06:26:38.287740+0000","last_unstale":"2024-09-10T06:27:24.968225+0000","last_undegraded":"2024-09-10T06:27:24.968225+0000","last_fullsized":"2024-09-10T06:27:24.968225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:22.078943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550248+0000","last_change":"2024-09-10T06:26:40.329737+0000","last_active":"2024-09-10T06:27:25.550248+0000","last_peered":"2024-09-10T06:27:25.550248+0000","last_clean":"2024-09-10T06:27:25.550248+0000","last_became_active":"2024-09-10T06:26:40.328952+0000","last_became_peered":"2024-09-10T06:26:40.328952+0000","last_unstale":"2024-09-10T06:27:25.550248+0000","last_undegraded":"2024-09-10T06:27:25.550248+0000","last_fullsized":"2024-09-10T06:27:25.550248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551699+0000","last_change":"2024-09-10T06:26:32.270997+0000","last_active":"2024-09-10T06:27:25.551699+0000","last_peered":"2024-09-10T06:27:25.551699+0000","last_clean":"2024-09-10T06:27:25.551699+0000","last_became_active":"2024-09-10T06:26:32.270265+0000","last_became_peered":"2024-09-10T06:26:32.270265+0000","last_unstale":"2024-09-10T06:27:25.551699+0000","last_undegraded":"2024-09-10T06:27:25.551699+0000","last_fullsized":"2024-09-10T06:27:25.551699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:33.067523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":27,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.877577+0000","last_change":"2024-09-10T06:27:08.593158+0000","last_active":"2024-09-10T06:27:24.877577+0000","last_peered":"2024-09-10T06:27:24.877577+0000","last_clean":"2024-09-10T06:27:24.877577+0000","last_became_active":"2024-09-10T06:27:08.592864+0000","last_became_peered":"2024-09-10T06:27:08.592864+0000","last_unstale":"2024-09-10T06:27:24.877577+0000","last_undegraded":"2024-09-10T06:27:24.877577+0000","last_fullsized":"2024-09-10T06:27:24.877577+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:35.185591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551803+0000","last_change":"2024-09-10T06:26:34.286497+0000","last_active":"2024-09-10T06:27:25.551803+0000","last_peered":"2024-09-10T06:27:25.551803+0000","last_clean":"2024-09-10T06:27:25.551803+0000","last_became_active":"2024-09-10T06:26:34.285334+0000","last_became_peered":"2024-09-10T06:26:34.285334+0000","last_unstale":"2024-09-10T06:27:25.551803+0000","last_undegraded":"2024-09-10T06:27:25.551803+0000","last_fullsized":"2024-09-10T06:27:25.551803+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:54.506182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'17","reported_seq":79,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788124+0000","last_change":"2024-09-10T06:26:36.288213+0000","last_active":"2024-09-10T06:27:23.788124+0000","last_peered":"2024-09-10T06:27:23.788124+0000","last_clean":"2024-09-10T06:27:23.788124+0000","last_became_active":"2024-09-10T06:26:36.287468+0000","last_became_peered":"2024-09-10T06:26:36.287468+0000","last_unstale":"2024-09-10T06:27:23.788124+0000","last_undegraded":"2024-09-10T06:27:23.788124+0000","last_fullsized":"2024-09-10T06:27:23.788124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967668+0000","last_change":"2024-09-10T06:26:38.291943+0000","last_active":"2024-09-10T06:27:24.967668+0000","last_peered":"2024-09-10T06:27:24.967668+0000","last_clean":"2024-09-10T06:27:24.967668+0000","last_became_active":"2024-09-10T06:26:38.291214+0000","last_became_peered":"2024-09-10T06:26:38.291214+0000","last_unstale":"2024-09-10T06:27:24.967668+0000","last_undegraded":"2024-09-10T06:27:24.967668+0000","last_fullsized":"2024-09-10T06:27:24.967668+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:56.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549337+0000","last_change":"2024-09-10T06:26:40.331977+0000","last_active":"2024-09-10T06:27:25.549337+0000","last_peered":"2024-09-10T06:27:25.549337+0000","last_clean":"2024-09-10T06:27:25.549337+0000","last_became_active":"2024-09-10T06:26:40.331502+0000","last_became_peered":"2024-09-10T06:26:40.331502+0000","last_unstale":"2024-09-10T06:27:25.549337+0000","last_undegraded":"2024-09-10T06:27:25.549337+0000","last_fullsized":"2024-09-10T06:27:25.549337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:43.572813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.968532+0000","last_change":"2024-09-10T06:26:32.274623+0000","last_active":"2024-09-10T06:27:24.968532+0000","last_peered":"2024-09-10T06:27:24.968532+0000","last_clean":"2024-09-10T06:27:24.968532+0000","last_became_active":"2024-09-10T06:26:32.273727+0000","last_became_peered":"2024-09-10T06:26:32.273727+0000","last_unstale":"2024-09-10T06:27:24.968532+0000","last_undegraded":"2024-09-10T06:27:24.968532+0000","last_fullsized":"2024-09-10T06:27:24.968532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:15.364938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":166,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.784253+0000","last_change":"2024-09-10T06:26:18.153206+0000","last_active":"2024-09-10T06:27:23.784253+0000","last_peered":"2024-09-10T06:27:23.784253+0000","last_clean":"2024-09-10T06:27:23.784253+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:27:23.784253+0000","last_undegraded":"2024-09-10T06:27:23.784253+0000","last_fullsized":"2024-09-10T06:27:23.784253+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_clean_scrub_stamp":"2024-09-10T06:26:16.422775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:42.510577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":77,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.787866+0000","last_change":"2024-09-10T06:26:25.532465+0000","last_active":"2024-09-10T06:27:23.787866+0000","last_peered":"2024-09-10T06:27:23.787866+0000","last_clean":"2024-09-10T06:27:23.787866+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:27:23.787866+0000","last_undegraded":"2024-09-10T06:27:23.787866+0000","last_fullsized":"2024-09-10T06:27:23.787866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:10.318844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553233+0000","last_change":"2024-09-10T06:26:30.606630+0000","last_active":"2024-09-10T06:27:25.553233+0000","last_peered":"2024-09-10T06:27:25.553233+0000","last_clean":"2024-09-10T06:27:25.553233+0000","last_became_active":"2024-09-10T06:26:30.606348+0000","last_became_peered":"2024-09-10T06:26:30.606348+0000","last_unstale":"2024-09-10T06:27:25.553233+0000","last_undegraded":"2024-09-10T06:27:25.553233+0000","last_fullsized":"2024-09-10T06:27:25.553233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789872+0000","last_change":"2024-09-10T06:26:34.287201+0000","last_active":"2024-09-10T06:27:23.789872+0000","last_peered":"2024-09-10T06:27:23.789872+0000","last_clean":"2024-09-10T06:27:23.789872+0000","last_became_active":"2024-09-10T06:26:34.285248+0000","last_became_peered":"2024-09-10T06:26:34.285248+0000","last_unstale":"2024-09-10T06:27:23.789872+0000","last_undegraded":"2024-09-10T06:27:23.789872+0000","last_fullsized":"2024-09-10T06:27:23.789872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:43.907684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'13","reported_seq":78,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790436+0000","last_change":"2024-09-10T06:26:36.296684+0000","last_active":"2024-09-10T06:27:23.790436+0000","last_peered":"2024-09-10T06:27:23.790436+0000","last_clean":"2024-09-10T06:27:23.790436+0000","last_became_active":"2024-09-10T06:26:36.295901+0000","last_became_peered":"2024-09-10T06:26:36.295901+0000","last_unstale":"2024-09-10T06:27:23.790436+0000","last_undegraded":"2024-09-10T06:27:23.790436+0000","last_fullsized":"2024-09-10T06:27:23.790436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781016+0000","last_change":"2024-09-10T06:26:38.306412+0000","last_active":"2024-09-10T06:27:23.781016+0000","last_peered":"2024-09-10T06:27:23.781016+0000","last_clean":"2024-09-10T06:27:23.781016+0000","last_became_active":"2024-09-10T06:26:38.305496+0000","last_became_peered":"2024-09-10T06:26:38.305496+0000","last_unstale":"2024-09-10T06:27:23.781016+0000","last_undegraded":"2024-09-10T06:27:23.781016+0000","last_fullsized":"2024-09-10T06:27:23.781016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.370035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":44,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.966854+0000","last_change":"2024-09-10T06:26:40.331981+0000","last_active":"2024-09-10T06:27:24.966854+0000","last_peered":"2024-09-10T06:27:24.966854+0000","last_clean":"2024-09-10T06:27:24.966854+0000","last_became_active":"2024-09-10T06:26:40.331294+0000","last_became_peered":"2024-09-10T06:26:40.331294+0000","last_unstale":"2024-09-10T06:27:24.966854+0000","last_undegraded":"2024-09-10T06:27:24.966854+0000","last_fullsized":"2024-09-10T06:27:24.966854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:00.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781291+0000","last_change":"2024-09-10T06:26:32.278733+0000","last_active":"2024-09-10T06:27:23.781291+0000","last_peered":"2024-09-10T06:27:23.781291+0000","last_clean":"2024-09-10T06:27:23.781291+0000","last_became_active":"2024-09-10T06:26:32.278118+0000","last_became_peered":"2024-09-10T06:26:32.278118+0000","last_unstale":"2024-09-10T06:27:23.781291+0000","last_undegraded":"2024-09-10T06:27:23.781291+0000","last_fullsized":"2024-09-10T06:27:23.781291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:58.860666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.783748+0000","last_change":"2024-09-10T06:26:26.180664+0000","last_active":"2024-09-10T06:27:23.783748+0000","last_peered":"2024-09-10T06:27:23.783748+0000","last_clean":"2024-09-10T06:27:23.783748+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:27:23.783748+0000","last_undegraded":"2024-09-10T06:27:23.783748+0000","last_fullsized":"2024-09-10T06:27:23.783748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:28.793045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.782026+0000","last_change":"2024-09-10T06:26:30.594315+0000","last_active":"2024-09-10T06:27:23.782026+0000","last_peered":"2024-09-10T06:27:23.782026+0000","last_clean":"2024-09-10T06:27:23.782026+0000","last_became_active":"2024-09-10T06:26:30.593978+0000","last_became_peered":"2024-09-10T06:26:30.593978+0000","last_unstale":"2024-09-10T06:27:23.782026+0000","last_undegraded":"2024-09-10T06:27:23.782026+0000","last_fullsized":"2024-09-10T06:27:23.782026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:41.851632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790689+0000","last_change":"2024-09-10T06:26:34.279889+0000","last_active":"2024-09-10T06:27:23.790689+0000","last_peered":"2024-09-10T06:27:23.790689+0000","last_clean":"2024-09-10T06:27:23.790689+0000","last_became_active":"2024-09-10T06:26:34.279147+0000","last_became_peered":"2024-09-10T06:26:34.279147+0000","last_unstale":"2024-09-10T06:27:23.790689+0000","last_undegraded":"2024-09-10T06:27:23.790689+0000","last_fullsized":"2024-09-10T06:27:23.790689+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:02.260309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"34'23","reported_seq":105,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549564+0000","last_change":"2024-09-10T06:26:36.290005+0000","last_active":"2024-09-10T06:27:25.549564+0000","last_peered":"2024-09-10T06:27:25.549564+0000","last_clean":"2024-09-10T06:27:25.549564+0000","last_became_active":"2024-09-10T06:26:36.289232+0000","last_became_peered":"2024-09-10T06:26:36.289232+0000","last_unstale":"2024-09-10T06:27:25.549564+0000","last_undegraded":"2024-09-10T06:27:25.549564+0000","last_fullsized":"2024-09-10T06:27:25.549564+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:51.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":46,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790355+0000","last_change":"2024-09-10T06:26:38.302505+0000","last_active":"2024-09-10T06:27:23.790355+0000","last_peered":"2024-09-10T06:27:23.790355+0000","last_clean":"2024-09-10T06:27:23.790355+0000","last_became_active":"2024-09-10T06:26:38.301104+0000","last_became_peered":"2024-09-10T06:26:38.301104+0000","last_unstale":"2024-09-10T06:27:23.790355+0000","last_undegraded":"2024-09-10T06:27:23.790355+0000","last_fullsized":"2024-09-10T06:27:23.790355+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.863622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.548782+0000","last_change":"2024-09-10T06:26:40.320079+0000","last_active":"2024-09-10T06:27:25.548782+0000","last_peered":"2024-09-10T06:27:25.548782+0000","last_clean":"2024-09-10T06:27:25.548782+0000","last_became_active":"2024-09-10T06:26:40.319266+0000","last_became_peered":"2024-09-10T06:26:40.319266+0000","last_unstale":"2024-09-10T06:27:25.548782+0000","last_undegraded":"2024-09-10T06:27:25.548782+0000","last_fullsized":"2024-09-10T06:27:25.548782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:57.937745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551776+0000","last_change":"2024-09-10T06:26:32.282679+0000","last_active":"2024-09-10T06:27:25.551776+0000","last_peered":"2024-09-10T06:27:25.551776+0000","last_clean":"2024-09-10T06:27:25.551776+0000","last_became_active":"2024-09-10T06:26:32.282235+0000","last_became_peered":"2024-09-10T06:26:32.282235+0000","last_unstale":"2024-09-10T06:27:25.551776+0000","last_undegraded":"2024-09-10T06:27:25.551776+0000","last_fullsized":"2024-09-10T06:27:25.551776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:27.994318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":78,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878064+0000","last_change":"2024-09-10T06:26:25.979784+0000","last_active":"2024-09-10T06:27:24.878064+0000","last_peered":"2024-09-10T06:27:24.878064+0000","last_clean":"2024-09-10T06:27:24.878064+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:27:24.878064+0000","last_undegraded":"2024-09-10T06:27:24.878064+0000","last_fullsized":"2024-09-10T06:27:24.878064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:42.490682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.548499+0000","last_change":"2024-09-10T06:26:30.570558+0000","last_active":"2024-09-10T06:27:25.548499+0000","last_peered":"2024-09-10T06:27:25.548499+0000","last_clean":"2024-09-10T06:27:25.548499+0000","last_became_active":"2024-09-10T06:26:30.570037+0000","last_became_peered":"2024-09-10T06:26:30.570037+0000","last_unstale":"2024-09-10T06:27:25.548499+0000","last_undegraded":"2024-09-10T06:27:25.548499+0000","last_fullsized":"2024-09-10T06:27:25.548499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:46.692143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":58,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.879346+0000","last_change":"2024-09-10T06:26:34.284394+0000","last_active":"2024-09-10T06:27:24.879346+0000","last_peered":"2024-09-10T06:27:24.879346+0000","last_clean":"2024-09-10T06:27:24.879346+0000","last_became_active":"2024-09-10T06:26:34.283980+0000","last_became_peered":"2024-09-10T06:26:34.283980+0000","last_unstale":"2024-09-10T06:27:24.879346+0000","last_undegraded":"2024-09-10T06:27:24.879346+0000","last_fullsized":"2024-09-10T06:27:24.879346+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:38.061123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'15","reported_seq":81,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790765+0000","last_change":"2024-09-10T06:26:36.302835+0000","last_active":"2024-09-10T06:27:23.790765+0000","last_peered":"2024-09-10T06:27:23.790765+0000","last_clean":"2024-09-10T06:27:23.790765+0000","last_became_active":"2024-09-10T06:26:36.299434+0000","last_became_peered":"2024-09-10T06:26:36.299434+0000","last_unstale":"2024-09-10T06:27:23.790765+0000","last_undegraded":"2024-09-10T06:27:23.790765+0000","last_fullsized":"2024-09-10T06:27:23.790765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781769+0000","last_change":"2024-09-10T06:26:38.292411+0000","last_active":"2024-09-10T06:27:23.781769+0000","last_peered":"2024-09-10T06:27:23.781769+0000","last_clean":"2024-09-10T06:27:23.781769+0000","last_became_active":"2024-09-10T06:26:38.291623+0000","last_became_peered":"2024-09-10T06:26:38.291623+0000","last_unstale":"2024-09-10T06:27:23.781769+0000","last_undegraded":"2024-09-10T06:27:23.781769+0000","last_fullsized":"2024-09-10T06:27:23.781769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553882+0000","last_change":"2024-09-10T06:26:40.303598+0000","last_active":"2024-09-10T06:27:25.553882+0000","last_peered":"2024-09-10T06:27:25.553882+0000","last_clean":"2024-09-10T06:27:25.553882+0000","last_became_active":"2024-09-10T06:26:40.302898+0000","last_became_peered":"2024-09-10T06:26:40.302898+0000","last_unstale":"2024-09-10T06:27:25.553882+0000","last_undegraded":"2024-09-10T06:27:25.553882+0000","last_fullsized":"2024-09-10T06:27:25.553882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:49.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549800+0000","last_change":"2024-09-10T06:26:32.273484+0000","last_active":"2024-09-10T06:27:25.549800+0000","last_peered":"2024-09-10T06:27:25.549800+0000","last_clean":"2024-09-10T06:27:25.549800+0000","last_became_active":"2024-09-10T06:26:32.273183+0000","last_became_peered":"2024-09-10T06:26:32.273183+0000","last_unstale":"2024-09-10T06:27:25.549800+0000","last_undegraded":"2024-09-10T06:27:25.549800+0000","last_fullsized":"2024-09-10T06:27:25.549800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:32.410538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":78,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.786299+0000","last_change":"2024-09-10T06:26:25.534289+0000","last_active":"2024-09-10T06:27:23.786299+0000","last_peered":"2024-09-10T06:27:23.786299+0000","last_clean":"2024-09-10T06:27:23.786299+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:27:23.786299+0000","last_undegraded":"2024-09-10T06:27:23.786299+0000","last_fullsized":"2024-09-10T06:27:23.786299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:11.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550649+0000","last_change":"2024-09-10T06:26:30.579693+0000","last_active":"2024-09-10T06:27:25.550649+0000","last_peered":"2024-09-10T06:27:25.550649+0000","last_clean":"2024-09-10T06:27:25.550649+0000","last_became_active":"2024-09-10T06:26:30.577934+0000","last_became_peered":"2024-09-10T06:26:30.577934+0000","last_unstale":"2024-09-10T06:27:25.550649+0000","last_undegraded":"2024-09-10T06:27:25.550649+0000","last_fullsized":"2024-09-10T06:27:25.550649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:35.852655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780422+0000","last_change":"2024-09-10T06:26:34.275458+0000","last_active":"2024-09-10T06:27:23.780422+0000","last_peered":"2024-09-10T06:27:23.780422+0000","last_clean":"2024-09-10T06:27:23.780422+0000","last_became_active":"2024-09-10T06:26:34.274705+0000","last_became_peered":"2024-09-10T06:26:34.274705+0000","last_unstale":"2024-09-10T06:27:23.780422+0000","last_undegraded":"2024-09-10T06:27:23.780422+0000","last_fullsized":"2024-09-10T06:27:23.780422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:20.624872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":73,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554900+0000","last_change":"2024-09-10T06:26:36.266077+0000","last_active":"2024-09-10T06:27:25.554900+0000","last_peered":"2024-09-10T06:27:25.554900+0000","last_clean":"2024-09-10T06:27:25.554900+0000","last_became_active":"2024-09-10T06:26:36.265322+0000","last_became_peered":"2024-09-10T06:26:36.265322+0000","last_unstale":"2024-09-10T06:27:25.554900+0000","last_undegraded":"2024-09-10T06:27:25.554900+0000","last_fullsized":"2024-09-10T06:27:25.554900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.969073+0000","last_change":"2024-09-10T06:26:38.296115+0000","last_active":"2024-09-10T06:27:24.969073+0000","last_peered":"2024-09-10T06:27:24.969073+0000","last_clean":"2024-09-10T06:27:24.969073+0000","last_became_active":"2024-09-10T06:26:38.295264+0000","last_became_peered":"2024-09-10T06:26:38.295264+0000","last_unstale":"2024-09-10T06:27:24.969073+0000","last_undegraded":"2024-09-10T06:27:24.969073+0000","last_fullsized":"2024-09-10T06:27:24.969073+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:52:33.108384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.785734+0000","last_change":"2024-09-10T06:26:40.326887+0000","last_active":"2024-09-10T06:27:23.785734+0000","last_peered":"2024-09-10T06:27:23.785734+0000","last_clean":"2024-09-10T06:27:23.785734+0000","last_became_active":"2024-09-10T06:26:40.326130+0000","last_became_peered":"2024-09-10T06:26:40.326130+0000","last_unstale":"2024-09-10T06:27:23.785734+0000","last_undegraded":"2024-09-10T06:27:23.785734+0000","last_fullsized":"2024-09-10T06:27:23.785734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:28.237428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549031+0000","last_change":"2024-09-10T06:26:32.282586+0000","last_active":"2024-09-10T06:27:25.549031+0000","last_peered":"2024-09-10T06:27:25.549031+0000","last_clean":"2024-09-10T06:27:25.549031+0000","last_became_active":"2024-09-10T06:26:32.282086+0000","last_became_peered":"2024-09-10T06:26:32.282086+0000","last_unstale":"2024-09-10T06:27:25.549031+0000","last_undegraded":"2024-09-10T06:27:25.549031+0000","last_fullsized":"2024-09-10T06:27:25.549031+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:44.269917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789004+0000","last_change":"2024-09-10T06:26:30.591913+0000","last_active":"2024-09-10T06:27:23.789004+0000","last_peered":"2024-09-10T06:27:23.789004+0000","last_clean":"2024-09-10T06:27:23.789004+0000","last_became_active":"2024-09-10T06:26:30.591140+0000","last_became_peered":"2024-09-10T06:26:30.591140+0000","last_unstale":"2024-09-10T06:27:23.789004+0000","last_undegraded":"2024-09-10T06:27:23.789004+0000","last_fullsized":"2024-09-10T06:27:23.789004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550016+0000","last_change":"2024-09-10T06:26:25.537497+0000","last_active":"2024-09-10T06:27:25.550016+0000","last_peered":"2024-09-10T06:27:25.550016+0000","last_clean":"2024-09-10T06:27:25.550016+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:27:25.550016+0000","last_undegraded":"2024-09-10T06:27:25.550016+0000","last_fullsized":"2024-09-10T06:27:25.550016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:44.787852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780701+0000","last_change":"2024-09-10T06:26:34.276099+0000","last_active":"2024-09-10T06:27:23.780701+0000","last_peered":"2024-09-10T06:27:23.780701+0000","last_clean":"2024-09-10T06:27:23.780701+0000","last_became_active":"2024-09-10T06:26:34.273984+0000","last_became_peered":"2024-09-10T06:26:34.273984+0000","last_unstale":"2024-09-10T06:27:23.780701+0000","last_undegraded":"2024-09-10T06:27:23.780701+0000","last_fullsized":"2024-09-10T06:27:23.780701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'18","reported_seq":83,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780036+0000","last_change":"2024-09-10T06:26:36.272589+0000","last_active":"2024-09-10T06:27:23.780036+0000","last_peered":"2024-09-10T06:27:23.780036+0000","last_clean":"2024-09-10T06:27:23.780036+0000","last_became_active":"2024-09-10T06:26:36.270914+0000","last_became_peered":"2024-09-10T06:26:36.270914+0000","last_unstale":"2024-09-10T06:27:23.780036+0000","last_undegraded":"2024-09-10T06:27:23.780036+0000","last_fullsized":"2024-09-10T06:27:23.780036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:20.764690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":50,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549179+0000","last_change":"2024-09-10T06:26:38.278069+0000","last_active":"2024-09-10T06:27:25.549179+0000","last_peered":"2024-09-10T06:27:25.549179+0000","last_clean":"2024-09-10T06:27:25.549179+0000","last_became_active":"2024-09-10T06:26:38.277261+0000","last_became_peered":"2024-09-10T06:26:38.277261+0000","last_unstale":"2024-09-10T06:27:25.549179+0000","last_undegraded":"2024-09-10T06:27:25.549179+0000","last_fullsized":"2024-09-10T06:27:25.549179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780701+0000","last_change":"2024-09-10T06:26:40.333741+0000","last_active":"2024-09-10T06:27:23.780701+0000","last_peered":"2024-09-10T06:27:23.780701+0000","last_clean":"2024-09-10T06:27:23.780701+0000","last_became_active":"2024-09-10T06:26:40.329701+0000","last_became_peered":"2024-09-10T06:26:40.329701+0000","last_unstale":"2024-09-10T06:27:23.780701+0000","last_undegraded":"2024-09-10T06:27:23.780701+0000","last_fullsized":"2024-09-10T06:27:23.780701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:53.704790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780873+0000","last_change":"2024-09-10T06:26:32.275551+0000","last_active":"2024-09-10T06:27:23.780873+0000","last_peered":"2024-09-10T06:27:23.780873+0000","last_clean":"2024-09-10T06:27:23.780873+0000","last_became_active":"2024-09-10T06:26:32.274946+0000","last_became_peered":"2024-09-10T06:26:32.274946+0000","last_unstale":"2024-09-10T06:27:23.780873+0000","last_undegraded":"2024-09-10T06:27:23.780873+0000","last_fullsized":"2024-09-10T06:27:23.780873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549874+0000","last_change":"2024-09-10T06:26:30.565595+0000","last_active":"2024-09-10T06:27:25.549874+0000","last_peered":"2024-09-10T06:27:25.549874+0000","last_clean":"2024-09-10T06:27:25.549874+0000","last_became_active":"2024-09-10T06:26:30.565220+0000","last_became_peered":"2024-09-10T06:26:30.565220+0000","last_unstale":"2024-09-10T06:27:25.549874+0000","last_undegraded":"2024-09-10T06:27:25.549874+0000","last_fullsized":"2024-09-10T06:27:25.549874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:14.600216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.791313+0000","last_change":"2024-09-10T06:26:26.180820+0000","last_active":"2024-09-10T06:27:23.791313+0000","last_peered":"2024-09-10T06:27:23.791313+0000","last_clean":"2024-09-10T06:27:23.791313+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:27:23.791313+0000","last_undegraded":"2024-09-10T06:27:23.791313+0000","last_fullsized":"2024-09-10T06:27:23.791313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:51.928304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":56,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967351+0000","last_change":"2024-09-10T06:26:34.272915+0000","last_active":"2024-09-10T06:27:24.967351+0000","last_peered":"2024-09-10T06:27:24.967351+0000","last_clean":"2024-09-10T06:27:24.967351+0000","last_became_active":"2024-09-10T06:26:34.272192+0000","last_became_peered":"2024-09-10T06:26:34.272192+0000","last_unstale":"2024-09-10T06:27:24.967351+0000","last_undegraded":"2024-09-10T06:27:24.967351+0000","last_fullsized":"2024-09-10T06:27:24.967351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:07.874348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":75,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.548286+0000","last_change":"2024-09-10T06:26:36.291431+0000","last_active":"2024-09-10T06:27:25.548286+0000","last_peered":"2024-09-10T06:27:25.548286+0000","last_clean":"2024-09-10T06:27:25.548286+0000","last_became_active":"2024-09-10T06:26:36.290570+0000","last_became_peered":"2024-09-10T06:26:36.290570+0000","last_unstale":"2024-09-10T06:27:25.548286+0000","last_undegraded":"2024-09-10T06:27:25.548286+0000","last_fullsized":"2024-09-10T06:27:25.548286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:10.565531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'2","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.784925+0000","last_change":"2024-09-10T06:26:38.312069+0000","last_active":"2024-09-10T06:27:23.784925+0000","last_peered":"2024-09-10T06:27:23.784925+0000","last_clean":"2024-09-10T06:27:23.784925+0000","last_became_active":"2024-09-10T06:26:38.310450+0000","last_became_peered":"2024-09-10T06:26:38.310450+0000","last_unstale":"2024-09-10T06:27:23.784925+0000","last_undegraded":"2024-09-10T06:27:23.784925+0000","last_fullsized":"2024-09-10T06:27:23.784925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553748+0000","last_change":"2024-09-10T06:26:40.312990+0000","last_active":"2024-09-10T06:27:25.553748+0000","last_peered":"2024-09-10T06:27:25.553748+0000","last_clean":"2024-09-10T06:27:25.553748+0000","last_became_active":"2024-09-10T06:26:40.312266+0000","last_became_peered":"2024-09-10T06:26:40.312266+0000","last_unstale":"2024-09-10T06:27:25.553748+0000","last_undegraded":"2024-09-10T06:27:25.553748+0000","last_fullsized":"2024-09-10T06:27:25.553748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:15.777105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552576+0000","last_change":"2024-09-10T06:26:32.258874+0000","last_active":"2024-09-10T06:27:25.552576+0000","last_peered":"2024-09-10T06:27:25.552576+0000","last_clean":"2024-09-10T06:27:25.552576+0000","last_became_active":"2024-09-10T06:26:32.258337+0000","last_became_peered":"2024-09-10T06:26:32.258337+0000","last_unstale":"2024-09-10T06:27:25.552576+0000","last_undegraded":"2024-09-10T06:27:25.552576+0000","last_fullsized":"2024-09-10T06:27:25.552576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553502+0000","last_change":"2024-09-10T06:26:30.581501+0000","last_active":"2024-09-10T06:27:25.553502+0000","last_peered":"2024-09-10T06:27:25.553502+0000","last_clean":"2024-09-10T06:27:25.553502+0000","last_became_active":"2024-09-10T06:26:30.581115+0000","last_became_peered":"2024-09-10T06:26:30.581115+0000","last_unstale":"2024-09-10T06:27:25.553502+0000","last_undegraded":"2024-09-10T06:27:25.553502+0000","last_fullsized":"2024-09-10T06:27:25.553502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":79,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551295+0000","last_change":"2024-09-10T06:26:25.537295+0000","last_active":"2024-09-10T06:27:25.551295+0000","last_peered":"2024-09-10T06:27:25.551295+0000","last_clean":"2024-09-10T06:27:25.551295+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:27:25.551295+0000","last_undegraded":"2024-09-10T06:27:25.551295+0000","last_fullsized":"2024-09-10T06:27:25.551295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:32.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549425+0000","last_change":"2024-09-10T06:26:34.258956+0000","last_active":"2024-09-10T06:27:25.549425+0000","last_peered":"2024-09-10T06:27:25.549425+0000","last_clean":"2024-09-10T06:27:25.549425+0000","last_became_active":"2024-09-10T06:26:34.257739+0000","last_became_peered":"2024-09-10T06:26:34.257739+0000","last_unstale":"2024-09-10T06:27:25.549425+0000","last_undegraded":"2024-09-10T06:27:25.549425+0000","last_fullsized":"2024-09-10T06:27:25.549425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:18.547827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'10","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550530+0000","last_change":"2024-09-10T06:26:36.271096+0000","last_active":"2024-09-10T06:27:25.550530+0000","last_peered":"2024-09-10T06:27:25.550530+0000","last_clean":"2024-09-10T06:27:25.550530+0000","last_became_active":"2024-09-10T06:26:36.270325+0000","last_became_peered":"2024-09-10T06:26:36.270325+0000","last_unstale":"2024-09-10T06:27:25.550530+0000","last_undegraded":"2024-09-10T06:27:25.550530+0000","last_fullsized":"2024-09-10T06:27:25.550530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"31'2","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554368+0000","last_change":"2024-09-10T06:26:38.300795+0000","last_active":"2024-09-10T06:27:25.554368+0000","last_peered":"2024-09-10T06:27:25.554368+0000","last_clean":"2024-09-10T06:27:25.554368+0000","last_became_active":"2024-09-10T06:26:38.299466+0000","last_became_peered":"2024-09-10T06:26:38.299466+0000","last_unstale":"2024-09-10T06:27:25.554368+0000","last_undegraded":"2024-09-10T06:27:25.554368+0000","last_fullsized":"2024-09-10T06:27:25.554368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:38.641500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781848+0000","last_change":"2024-09-10T06:26:40.329688+0000","last_active":"2024-09-10T06:27:23.781848+0000","last_peered":"2024-09-10T06:27:23.781848+0000","last_clean":"2024-09-10T06:27:23.781848+0000","last_became_active":"2024-09-10T06:26:40.329009+0000","last_became_peered":"2024-09-10T06:26:40.329009+0000","last_unstale":"2024-09-10T06:27:23.781848+0000","last_undegraded":"2024-09-10T06:27:23.781848+0000","last_fullsized":"2024-09-10T06:27:23.781848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549665+0000","last_change":"2024-09-10T06:26:32.283524+0000","last_active":"2024-09-10T06:27:25.549665+0000","last_peered":"2024-09-10T06:27:25.549665+0000","last_clean":"2024-09-10T06:27:25.549665+0000","last_became_active":"2024-09-10T06:26:32.282794+0000","last_became_peered":"2024-09-10T06:26:32.282794+0000","last_unstale":"2024-09-10T06:27:25.549665+0000","last_undegraded":"2024-09-10T06:27:25.549665+0000","last_fullsized":"2024-09-10T06:27:25.549665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:11.537416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781488+0000","last_change":"2024-09-10T06:26:30.578273+0000","last_active":"2024-09-10T06:27:23.781488+0000","last_peered":"2024-09-10T06:27:23.781488+0000","last_clean":"2024-09-10T06:27:23.781488+0000","last_became_active":"2024-09-10T06:26:30.577985+0000","last_became_peered":"2024-09-10T06:26:30.577985+0000","last_unstale":"2024-09-10T06:27:23.781488+0000","last_undegraded":"2024-09-10T06:27:23.781488+0000","last_fullsized":"2024-09-10T06:27:23.781488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":77,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.969344+0000","last_change":"2024-09-10T06:26:26.037773+0000","last_active":"2024-09-10T06:27:24.969344+0000","last_peered":"2024-09-10T06:27:24.969344+0000","last_clean":"2024-09-10T06:27:24.969344+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:27:24.969344+0000","last_undegraded":"2024-09-10T06:27:24.969344+0000","last_fullsized":"2024-09-10T06:27:24.969344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:21.949708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":59,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552446+0000","last_change":"2024-09-10T06:26:34.268710+0000","last_active":"2024-09-10T06:27:25.552446+0000","last_peered":"2024-09-10T06:27:25.552446+0000","last_clean":"2024-09-10T06:27:25.552446+0000","last_became_active":"2024-09-10T06:26:34.268359+0000","last_became_peered":"2024-09-10T06:26:34.268359+0000","last_unstale":"2024-09-10T06:27:25.552446+0000","last_undegraded":"2024-09-10T06:27:25.552446+0000","last_fullsized":"2024-09-10T06:27:25.552446+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:27.191787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'19","reported_seq":86,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789436+0000","last_change":"2024-09-10T06:26:36.299700+0000","last_active":"2024-09-10T06:27:23.789436+0000","last_peered":"2024-09-10T06:27:23.789436+0000","last_clean":"2024-09-10T06:27:23.789436+0000","last_became_active":"2024-09-10T06:26:36.297606+0000","last_became_peered":"2024-09-10T06:26:36.297606+0000","last_unstale":"2024-09-10T06:27:23.789436+0000","last_undegraded":"2024-09-10T06:27:23.789436+0000","last_fullsized":"2024-09-10T06:27:23.789436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":51,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553011+0000","last_change":"2024-09-10T06:26:38.290601+0000","last_active":"2024-09-10T06:27:25.553011+0000","last_peered":"2024-09-10T06:27:25.553011+0000","last_clean":"2024-09-10T06:27:25.553011+0000","last_became_active":"2024-09-10T06:26:38.289589+0000","last_became_peered":"2024-09-10T06:26:38.289589+0000","last_unstale":"2024-09-10T06:27:25.553011+0000","last_undegraded":"2024-09-10T06:27:25.553011+0000","last_fullsized":"2024-09-10T06:27:25.553011+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:22.625936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788100+0000","last_change":"2024-09-10T06:26:40.332819+0000","last_active":"2024-09-10T06:27:23.788100+0000","last_peered":"2024-09-10T06:27:23.788100+0000","last_clean":"2024-09-10T06:27:23.788100+0000","last_became_active":"2024-09-10T06:26:40.332160+0000","last_became_peered":"2024-09-10T06:26:40.332160+0000","last_unstale":"2024-09-10T06:27:23.788100+0000","last_undegraded":"2024-09-10T06:27:23.788100+0000","last_fullsized":"2024-09-10T06:27:23.788100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.784870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781639+0000","last_change":"2024-09-10T06:26:40.334393+0000","last_active":"2024-09-10T06:27:23.781639+0000","last_peered":"2024-09-10T06:27:23.781639+0000","last_clean":"2024-09-10T06:27:23.781639+0000","last_became_active":"2024-09-10T06:26:40.333474+0000","last_became_peered":"2024-09-10T06:26:40.333474+0000","last_unstale":"2024-09-10T06:27:23.781639+0000","last_undegraded":"2024-09-10T06:27:23.781639+0000","last_fullsized":"2024-09-10T06:27:23.781639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:35.031954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550167+0000","last_change":"2024-09-10T06:26:32.272914+0000","last_active":"2024-09-10T06:27:25.550167+0000","last_peered":"2024-09-10T06:27:25.550167+0000","last_clean":"2024-09-10T06:27:25.550167+0000","last_became_active":"2024-09-10T06:26:32.272178+0000","last_became_peered":"2024-09-10T06:26:32.272178+0000","last_unstale":"2024-09-10T06:27:25.550167+0000","last_undegraded":"2024-09-10T06:27:25.550167+0000","last_fullsized":"2024-09-10T06:27:25.550167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549946+0000","last_change":"2024-09-10T06:26:30.593531+0000","last_active":"2024-09-10T06:27:25.549946+0000","last_peered":"2024-09-10T06:27:25.549946+0000","last_clean":"2024-09-10T06:27:25.549946+0000","last_became_active":"2024-09-10T06:26:30.592753+0000","last_became_peered":"2024-09-10T06:26:30.592753+0000","last_unstale":"2024-09-10T06:27:25.549946+0000","last_undegraded":"2024-09-10T06:27:25.549946+0000","last_fullsized":"2024-09-10T06:27:25.549946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:14.506864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549103+0000","last_change":"2024-09-10T06:26:34.282877+0000","last_active":"2024-09-10T06:27:25.549103+0000","last_peered":"2024-09-10T06:27:25.549103+0000","last_clean":"2024-09-10T06:27:25.549103+0000","last_became_active":"2024-09-10T06:26:34.282281+0000","last_became_peered":"2024-09-10T06:26:34.282281+0000","last_unstale":"2024-09-10T06:27:25.549103+0000","last_undegraded":"2024-09-10T06:27:25.549103+0000","last_fullsized":"2024-09-10T06:27:25.549103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:41.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'11","reported_seq":74,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552715+0000","last_change":"2024-09-10T06:26:36.273166+0000","last_active":"2024-09-10T06:27:25.552715+0000","last_peered":"2024-09-10T06:27:25.552715+0000","last_clean":"2024-09-10T06:27:25.552715+0000","last_became_active":"2024-09-10T06:26:36.272386+0000","last_became_peered":"2024-09-10T06:26:36.272386+0000","last_unstale":"2024-09-10T06:27:25.552715+0000","last_undegraded":"2024-09-10T06:27:25.552715+0000","last_fullsized":"2024-09-10T06:27:25.552715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":51,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552300+0000","last_change":"2024-09-10T06:26:38.297347+0000","last_active":"2024-09-10T06:27:25.552300+0000","last_peered":"2024-09-10T06:27:25.552300+0000","last_clean":"2024-09-10T06:27:25.552300+0000","last_became_active":"2024-09-10T06:26:38.296600+0000","last_became_peered":"2024-09-10T06:26:38.296600+0000","last_unstale":"2024-09-10T06:27:25.552300+0000","last_undegraded":"2024-09-10T06:27:25.552300+0000","last_fullsized":"2024-09-10T06:27:25.552300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:08.758126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554703+0000","last_change":"2024-09-10T06:26:40.321844+0000","last_active":"2024-09-10T06:27:25.554703+0000","last_peered":"2024-09-10T06:27:25.554703+0000","last_clean":"2024-09-10T06:27:25.554703+0000","last_became_active":"2024-09-10T06:26:40.321097+0000","last_became_peered":"2024-09-10T06:26:40.321097+0000","last_unstale":"2024-09-10T06:27:25.554703+0000","last_undegraded":"2024-09-10T06:27:25.554703+0000","last_fullsized":"2024-09-10T06:27:25.554703+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:10.004849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.548955+0000","last_change":"2024-09-10T06:26:32.286989+0000","last_active":"2024-09-10T06:27:25.548955+0000","last_peered":"2024-09-10T06:27:25.548955+0000","last_clean":"2024-09-10T06:27:25.548955+0000","last_became_active":"2024-09-10T06:26:32.286519+0000","last_became_peered":"2024-09-10T06:26:32.286519+0000","last_unstale":"2024-09-10T06:27:25.548955+0000","last_undegraded":"2024-09-10T06:27:25.548955+0000","last_fullsized":"2024-09-10T06:27:25.548955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:31.592472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790937+0000","last_change":"2024-09-10T06:26:30.587315+0000","last_active":"2024-09-10T06:27:23.790937+0000","last_peered":"2024-09-10T06:27:23.790937+0000","last_clean":"2024-09-10T06:27:23.790937+0000","last_became_active":"2024-09-10T06:26:30.586611+0000","last_became_peered":"2024-09-10T06:26:30.586611+0000","last_unstale":"2024-09-10T06:27:23.790937+0000","last_undegraded":"2024-09-10T06:27:23.790937+0000","last_fullsized":"2024-09-10T06:27:23.790937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"27'1","reported_seq":61,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553794+0000","last_change":"2024-09-10T06:26:34.271770+0000","last_active":"2024-09-10T06:27:25.553794+0000","last_peered":"2024-09-10T06:27:25.553794+0000","last_clean":"2024-09-10T06:27:25.553794+0000","last_became_active":"2024-09-10T06:26:34.269875+0000","last_became_peered":"2024-09-10T06:26:34.269875+0000","last_unstale":"2024-09-10T06:27:25.553794+0000","last_undegraded":"2024-09-10T06:27:25.553794+0000","last_fullsized":"2024-09-10T06:27:25.553794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:09.570079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"42'5","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.779906+0000","last_change":"2024-09-10T06:26:36.289140+0000","last_active":"2024-09-10T06:27:23.779906+0000","last_peered":"2024-09-10T06:27:23.779906+0000","last_clean":"2024-09-10T06:27:23.779906+0000","last_became_active":"2024-09-10T06:26:36.288355+0000","last_became_peered":"2024-09-10T06:26:36.288355+0000","last_unstale":"2024-09-10T06:27:23.779906+0000","last_undegraded":"2024-09-10T06:27:23.779906+0000","last_fullsized":"2024-09-10T06:27:23.779906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:42.518982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":46,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.787832+0000","last_change":"2024-09-10T06:26:38.302040+0000","last_active":"2024-09-10T06:27:23.787832+0000","last_peered":"2024-09-10T06:27:23.787832+0000","last_clean":"2024-09-10T06:27:23.787832+0000","last_became_active":"2024-09-10T06:26:38.301064+0000","last_became_peered":"2024-09-10T06:26:38.301064+0000","last_unstale":"2024-09-10T06:27:23.787832+0000","last_undegraded":"2024-09-10T06:27:23.787832+0000","last_fullsized":"2024-09-10T06:27:23.787832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:41.513255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780330+0000","last_change":"2024-09-10T06:26:40.322368+0000","last_active":"2024-09-10T06:27:23.780330+0000","last_peered":"2024-09-10T06:27:23.780330+0000","last_clean":"2024-09-10T06:27:23.780330+0000","last_became_active":"2024-09-10T06:26:40.321592+0000","last_became_peered":"2024-09-10T06:26:40.321592+0000","last_unstale":"2024-09-10T06:27:23.780330+0000","last_undegraded":"2024-09-10T06:27:23.780330+0000","last_fullsized":"2024-09-10T06:27:23.780330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:03.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553059+0000","last_change":"2024-09-10T06:26:32.259666+0000","last_active":"2024-09-10T06:27:25.553059+0000","last_peered":"2024-09-10T06:27:25.553059+0000","last_clean":"2024-09-10T06:27:25.553059+0000","last_became_active":"2024-09-10T06:26:32.258775+0000","last_became_peered":"2024-09-10T06:26:32.258775+0000","last_unstale":"2024-09-10T06:27:25.553059+0000","last_undegraded":"2024-09-10T06:27:25.553059+0000","last_fullsized":"2024-09-10T06:27:25.553059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789514+0000","last_change":"2024-09-10T06:26:30.592773+0000","last_active":"2024-09-10T06:27:23.789514+0000","last_peered":"2024-09-10T06:27:23.789514+0000","last_clean":"2024-09-10T06:27:23.789514+0000","last_became_active":"2024-09-10T06:26:30.590566+0000","last_became_peered":"2024-09-10T06:26:30.590566+0000","last_unstale":"2024-09-10T06:27:23.789514+0000","last_undegraded":"2024-09-10T06:27:23.789514+0000","last_fullsized":"2024-09-10T06:27:23.789514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:35.688897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.782647+0000","last_change":"2024-09-10T06:26:34.281690+0000","last_active":"2024-09-10T06:27:23.782647+0000","last_peered":"2024-09-10T06:27:23.782647+0000","last_clean":"2024-09-10T06:27:23.782647+0000","last_became_active":"2024-09-10T06:26:34.281008+0000","last_became_peered":"2024-09-10T06:26:34.281008+0000","last_unstale":"2024-09-10T06:27:23.782647+0000","last_undegraded":"2024-09-10T06:27:23.782647+0000","last_fullsized":"2024-09-10T06:27:23.782647+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'11","reported_seq":74,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553627+0000","last_change":"2024-09-10T06:26:36.277028+0000","last_active":"2024-09-10T06:27:25.553627+0000","last_peered":"2024-09-10T06:27:25.553627+0000","last_clean":"2024-09-10T06:27:25.553627+0000","last_became_active":"2024-09-10T06:26:36.276248+0000","last_became_peered":"2024-09-10T06:26:36.276248+0000","last_unstale":"2024-09-10T06:27:25.553627+0000","last_undegraded":"2024-09-10T06:27:25.553627+0000","last_fullsized":"2024-09-10T06:27:25.553627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:53.521681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967337+0000","last_change":"2024-09-10T06:26:38.294889+0000","last_active":"2024-09-10T06:27:24.967337+0000","last_peered":"2024-09-10T06:27:24.967337+0000","last_clean":"2024-09-10T06:27:24.967337+0000","last_became_active":"2024-09-10T06:26:38.294124+0000","last_became_peered":"2024-09-10T06:26:38.294124+0000","last_unstale":"2024-09-10T06:27:24.967337+0000","last_undegraded":"2024-09-10T06:27:24.967337+0000","last_fullsized":"2024-09-10T06:27:24.967337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:42.905517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.787675+0000","last_change":"2024-09-10T06:26:40.331445+0000","last_active":"2024-09-10T06:27:23.787675+0000","last_peered":"2024-09-10T06:27:23.787675+0000","last_clean":"2024-09-10T06:27:23.787675+0000","last_became_active":"2024-09-10T06:26:40.330707+0000","last_became_peered":"2024-09-10T06:26:40.330707+0000","last_unstale":"2024-09-10T06:27:23.787675+0000","last_undegraded":"2024-09-10T06:27:23.787675+0000","last_fullsized":"2024-09-10T06:27:23.787675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.822687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552698+0000","last_change":"2024-09-10T06:26:32.266221+0000","last_active":"2024-09-10T06:27:25.552698+0000","last_peered":"2024-09-10T06:27:25.552698+0000","last_clean":"2024-09-10T06:27:25.552698+0000","last_became_active":"2024-09-10T06:26:32.265705+0000","last_became_peered":"2024-09-10T06:26:32.265705+0000","last_unstale":"2024-09-10T06:27:25.552698+0000","last_undegraded":"2024-09-10T06:27:25.552698+0000","last_fullsized":"2024-09-10T06:27:25.552698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.782082+0000","last_change":"2024-09-10T06:26:30.594335+0000","last_active":"2024-09-10T06:27:23.782082+0000","last_peered":"2024-09-10T06:27:23.782082+0000","last_clean":"2024-09-10T06:27:23.782082+0000","last_became_active":"2024-09-10T06:26:30.593326+0000","last_became_peered":"2024-09-10T06:26:30.593326+0000","last_unstale":"2024-09-10T06:27:23.782082+0000","last_undegraded":"2024-09-10T06:27:23.782082+0000","last_fullsized":"2024-09-10T06:27:23.782082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:37.297722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":56,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967347+0000","last_change":"2024-09-10T06:26:34.281915+0000","last_active":"2024-09-10T06:27:24.967347+0000","last_peered":"2024-09-10T06:27:24.967347+0000","last_clean":"2024-09-10T06:27:24.967347+0000","last_became_active":"2024-09-10T06:26:34.281147+0000","last_became_peered":"2024-09-10T06:26:34.281147+0000","last_unstale":"2024-09-10T06:27:24.967347+0000","last_undegraded":"2024-09-10T06:27:24.967347+0000","last_fullsized":"2024-09-10T06:27:24.967347+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:41.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"34'9","reported_seq":66,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789088+0000","last_change":"2024-09-10T06:26:36.298537+0000","last_active":"2024-09-10T06:27:23.789088+0000","last_peered":"2024-09-10T06:27:23.789088+0000","last_clean":"2024-09-10T06:27:23.789088+0000","last_became_active":"2024-09-10T06:26:36.297372+0000","last_became_peered":"2024-09-10T06:26:36.297372+0000","last_unstale":"2024-09-10T06:27:23.789088+0000","last_undegraded":"2024-09-10T06:27:23.789088+0000","last_fullsized":"2024-09-10T06:27:23.789088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.779606+0000","last_change":"2024-09-10T06:26:38.301461+0000","last_active":"2024-09-10T06:27:23.779606+0000","last_peered":"2024-09-10T06:27:23.779606+0000","last_clean":"2024-09-10T06:27:23.779606+0000","last_became_active":"2024-09-10T06:26:38.300580+0000","last_became_peered":"2024-09-10T06:26:38.300580+0000","last_unstale":"2024-09-10T06:27:23.779606+0000","last_undegraded":"2024-09-10T06:27:23.779606+0000","last_fullsized":"2024-09-10T06:27:23.779606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.969311+0000","last_change":"2024-09-10T06:26:32.285276+0000","last_active":"2024-09-10T06:27:24.969311+0000","last_peered":"2024-09-10T06:27:24.969311+0000","last_clean":"2024-09-10T06:27:24.969311+0000","last_became_active":"2024-09-10T06:26:32.284457+0000","last_became_peered":"2024-09-10T06:26:32.284457+0000","last_unstale":"2024-09-10T06:27:24.969311+0000","last_undegraded":"2024-09-10T06:27:24.969311+0000","last_fullsized":"2024-09-10T06:27:24.969311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:37.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552850+0000","last_change":"2024-09-10T06:26:30.573339+0000","last_active":"2024-09-10T06:27:25.552850+0000","last_peered":"2024-09-10T06:27:25.552850+0000","last_clean":"2024-09-10T06:27:25.552850+0000","last_became_active":"2024-09-10T06:26:30.571377+0000","last_became_peered":"2024-09-10T06:26:30.571377+0000","last_unstale":"2024-09-10T06:27:25.552850+0000","last_undegraded":"2024-09-10T06:27:25.552850+0000","last_fullsized":"2024-09-10T06:27:25.552850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:59.752497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781096+0000","last_change":"2024-09-10T06:26:34.269013+0000","last_active":"2024-09-10T06:27:23.781096+0000","last_peered":"2024-09-10T06:27:23.781096+0000","last_clean":"2024-09-10T06:27:23.781096+0000","last_became_active":"2024-09-10T06:26:34.268677+0000","last_became_peered":"2024-09-10T06:26:34.268677+0000","last_unstale":"2024-09-10T06:27:23.781096+0000","last_undegraded":"2024-09-10T06:27:23.781096+0000","last_fullsized":"2024-09-10T06:27:23.781096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'12","reported_seq":77,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550212+0000","last_change":"2024-09-10T06:26:36.300362+0000","last_active":"2024-09-10T06:27:25.550212+0000","last_peered":"2024-09-10T06:27:25.550212+0000","last_clean":"2024-09-10T06:27:25.550212+0000","last_became_active":"2024-09-10T06:26:36.299645+0000","last_became_peered":"2024-09-10T06:26:36.299645+0000","last_unstale":"2024-09-10T06:27:25.550212+0000","last_undegraded":"2024-09-10T06:27:25.550212+0000","last_fullsized":"2024-09-10T06:27:25.550212+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:17.424354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.787969+0000","last_change":"2024-09-10T06:26:38.299751+0000","last_active":"2024-09-10T06:27:23.787969+0000","last_peered":"2024-09-10T06:27:23.787969+0000","last_clean":"2024-09-10T06:27:23.787969+0000","last_became_active":"2024-09-10T06:26:38.298414+0000","last_became_peered":"2024-09-10T06:26:38.298414+0000","last_unstale":"2024-09-10T06:27:23.787969+0000","last_undegraded":"2024-09-10T06:27:23.787969+0000","last_fullsized":"2024-09-10T06:27:23.787969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553409+0000","last_change":"2024-09-10T06:26:40.312752+0000","last_active":"2024-09-10T06:27:25.553409+0000","last_peered":"2024-09-10T06:27:25.553409+0000","last_clean":"2024-09-10T06:27:25.553409+0000","last_became_active":"2024-09-10T06:26:40.312026+0000","last_became_peered":"2024-09-10T06:26:40.312026+0000","last_unstale":"2024-09-10T06:27:25.553409+0000","last_undegraded":"2024-09-10T06:27:25.553409+0000","last_fullsized":"2024-09-10T06:27:25.553409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:50.071224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781218+0000","last_change":"2024-09-10T06:26:32.266934+0000","last_active":"2024-09-10T06:27:23.781218+0000","last_peered":"2024-09-10T06:27:23.781218+0000","last_clean":"2024-09-10T06:27:23.781218+0000","last_became_active":"2024-09-10T06:26:32.266682+0000","last_became_peered":"2024-09-10T06:26:32.266682+0000","last_unstale":"2024-09-10T06:27:23.781218+0000","last_undegraded":"2024-09-10T06:27:23.781218+0000","last_fullsized":"2024-09-10T06:27:23.781218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552462+0000","last_change":"2024-09-10T06:26:30.579097+0000","last_active":"2024-09-10T06:27:25.552462+0000","last_peered":"2024-09-10T06:27:25.552462+0000","last_clean":"2024-09-10T06:27:25.552462+0000","last_became_active":"2024-09-10T06:26:30.578692+0000","last_became_peered":"2024-09-10T06:26:30.578692+0000","last_unstale":"2024-09-10T06:27:25.552462+0000","last_undegraded":"2024-09-10T06:27:25.552462+0000","last_fullsized":"2024-09-10T06:27:25.552462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:15.878123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"27'1","reported_seq":58,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.969135+0000","last_change":"2024-09-10T06:26:34.282356+0000","last_active":"2024-09-10T06:27:24.969135+0000","last_peered":"2024-09-10T06:27:24.969135+0000","last_clean":"2024-09-10T06:27:24.969135+0000","last_became_active":"2024-09-10T06:26:34.281167+0000","last_became_peered":"2024-09-10T06:26:34.281167+0000","last_unstale":"2024-09-10T06:27:24.969135+0000","last_undegraded":"2024-09-10T06:27:24.969135+0000","last_fullsized":"2024-09-10T06:27:24.969135+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:59.042394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'15","reported_seq":75,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789118+0000","last_change":"2024-09-10T06:26:36.301277+0000","last_active":"2024-09-10T06:27:23.789118+0000","last_peered":"2024-09-10T06:27:23.789118+0000","last_clean":"2024-09-10T06:27:23.789118+0000","last_became_active":"2024-09-10T06:26:36.300501+0000","last_became_peered":"2024-09-10T06:26:36.300501+0000","last_unstale":"2024-09-10T06:27:23.789118+0000","last_undegraded":"2024-09-10T06:27:23.789118+0000","last_fullsized":"2024-09-10T06:27:23.789118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:38.477946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":50,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550384+0000","last_change":"2024-09-10T06:26:38.305737+0000","last_active":"2024-09-10T06:27:25.550384+0000","last_peered":"2024-09-10T06:27:25.550384+0000","last_clean":"2024-09-10T06:27:25.550384+0000","last_became_active":"2024-09-10T06:26:38.303318+0000","last_became_peered":"2024-09-10T06:26:38.303318+0000","last_unstale":"2024-09-10T06:27:25.550384+0000","last_undegraded":"2024-09-10T06:27:25.550384+0000","last_fullsized":"2024-09-10T06:27:25.550384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:52.587622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":44,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967059+0000","last_change":"2024-09-10T06:26:40.318587+0000","last_active":"2024-09-10T06:27:24.967059+0000","last_peered":"2024-09-10T06:27:24.967059+0000","last_clean":"2024-09-10T06:27:24.967059+0000","last_became_active":"2024-09-10T06:26:40.317695+0000","last_became_peered":"2024-09-10T06:26:40.317695+0000","last_unstale":"2024-09-10T06:27:24.967059+0000","last_undegraded":"2024-09-10T06:27:24.967059+0000","last_fullsized":"2024-09-10T06:27:24.967059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:48.298686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554572+0000","last_change":"2024-09-10T06:26:32.276218+0000","last_active":"2024-09-10T06:27:25.554572+0000","last_peered":"2024-09-10T06:27:25.554572+0000","last_clean":"2024-09-10T06:27:25.554572+0000","last_became_active":"2024-09-10T06:26:32.275805+0000","last_became_peered":"2024-09-10T06:26:32.275805+0000","last_unstale":"2024-09-10T06:27:25.554572+0000","last_undegraded":"2024-09-10T06:27:25.554572+0000","last_fullsized":"2024-09-10T06:27:25.554572+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550966+0000","last_change":"2024-09-10T06:26:30.568731+0000","last_active":"2024-09-10T06:27:25.550966+0000","last_peered":"2024-09-10T06:27:25.550966+0000","last_clean":"2024-09-10T06:27:25.550966+0000","last_became_active":"2024-09-10T06:26:30.567937+0000","last_became_peered":"2024-09-10T06:26:30.567937+0000","last_unstale":"2024-09-10T06:27:25.550966+0000","last_undegraded":"2024-09-10T06:27:25.550966+0000","last_fullsized":"2024-09-10T06:27:25.550966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:18.974865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551159+0000","last_change":"2024-09-10T06:26:34.266227+0000","last_active":"2024-09-10T06:27:25.551159+0000","last_peered":"2024-09-10T06:27:25.551159+0000","last_clean":"2024-09-10T06:27:25.551159+0000","last_became_active":"2024-09-10T06:26:34.262443+0000","last_became_peered":"2024-09-10T06:26:34.262443+0000","last_unstale":"2024-09-10T06:27:25.551159+0000","last_undegraded":"2024-09-10T06:27:25.551159+0000","last_fullsized":"2024-09-10T06:27:25.551159+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.918813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"34'11","reported_seq":74,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553867+0000","last_change":"2024-09-10T06:26:36.292958+0000","last_active":"2024-09-10T06:27:25.553867+0000","last_peered":"2024-09-10T06:27:25.553867+0000","last_clean":"2024-09-10T06:27:25.553867+0000","last_became_active":"2024-09-10T06:26:36.292149+0000","last_became_peered":"2024-09-10T06:26:36.292149+0000","last_unstale":"2024-09-10T06:27:25.553867+0000","last_undegraded":"2024-09-10T06:27:25.553867+0000","last_fullsized":"2024-09-10T06:27:25.553867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":50,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550878+0000","last_change":"2024-09-10T06:26:38.302991+0000","last_active":"2024-09-10T06:27:25.550878+0000","last_peered":"2024-09-10T06:27:25.550878+0000","last_clean":"2024-09-10T06:27:25.550878+0000","last_became_active":"2024-09-10T06:26:38.289306+0000","last_became_peered":"2024-09-10T06:26:38.289306+0000","last_unstale":"2024-09-10T06:27:25.550878+0000","last_undegraded":"2024-09-10T06:27:25.550878+0000","last_fullsized":"2024-09-10T06:27:25.550878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:57.625329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":43,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.784584+0000","last_change":"2024-09-10T06:26:40.327627+0000","last_active":"2024-09-10T06:27:23.784584+0000","last_peered":"2024-09-10T06:27:23.784584+0000","last_clean":"2024-09-10T06:27:23.784584+0000","last_became_active":"2024-09-10T06:26:40.326888+0000","last_became_peered":"2024-09-10T06:26:40.326888+0000","last_unstale":"2024-09-10T06:27:23.784584+0000","last_undegraded":"2024-09-10T06:27:23.784584+0000","last_fullsized":"2024-09-10T06:27:23.784584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:41.122562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878494+0000","last_change":"2024-09-10T06:26:32.275071+0000","last_active":"2024-09-10T06:27:24.878494+0000","last_peered":"2024-09-10T06:27:24.878494+0000","last_clean":"2024-09-10T06:27:24.878494+0000","last_became_active":"2024-09-10T06:26:32.274395+0000","last_became_peered":"2024-09-10T06:26:32.274395+0000","last_unstale":"2024-09-10T06:27:24.878494+0000","last_undegraded":"2024-09-10T06:27:24.878494+0000","last_fullsized":"2024-09-10T06:27:24.878494+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:51.369493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780474+0000","last_change":"2024-09-10T06:26:30.594599+0000","last_active":"2024-09-10T06:27:23.780474+0000","last_peered":"2024-09-10T06:27:23.780474+0000","last_clean":"2024-09-10T06:27:23.780474+0000","last_became_active":"2024-09-10T06:26:30.594058+0000","last_became_peered":"2024-09-10T06:26:30.594058+0000","last_unstale":"2024-09-10T06:27:23.780474+0000","last_undegraded":"2024-09-10T06:27:23.780474+0000","last_fullsized":"2024-09-10T06:27:23.780474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:18.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550569+0000","last_change":"2024-09-10T06:26:34.279538+0000","last_active":"2024-09-10T06:27:25.550569+0000","last_peered":"2024-09-10T06:27:25.550569+0000","last_clean":"2024-09-10T06:27:25.550569+0000","last_became_active":"2024-09-10T06:26:34.278871+0000","last_became_peered":"2024-09-10T06:26:34.278871+0000","last_unstale":"2024-09-10T06:27:25.550569+0000","last_undegraded":"2024-09-10T06:27:25.550569+0000","last_fullsized":"2024-09-10T06:27:25.550569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:13.203357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'10","reported_seq":69,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551796+0000","last_change":"2024-09-10T06:26:36.290976+0000","last_active":"2024-09-10T06:27:25.551796+0000","last_peered":"2024-09-10T06:27:25.551796+0000","last_clean":"2024-09-10T06:27:25.551796+0000","last_became_active":"2024-09-10T06:26:36.290265+0000","last_became_peered":"2024-09-10T06:26:36.290265+0000","last_unstale":"2024-09-10T06:27:25.551796+0000","last_undegraded":"2024-09-10T06:27:25.551796+0000","last_fullsized":"2024-09-10T06:27:25.551796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"31'2","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.968958+0000","last_change":"2024-09-10T06:26:38.292031+0000","last_active":"2024-09-10T06:27:24.968958+0000","last_peered":"2024-09-10T06:27:24.968958+0000","last_clean":"2024-09-10T06:27:24.968958+0000","last_became_active":"2024-09-10T06:26:38.288791+0000","last_became_peered":"2024-09-10T06:26:38.288791+0000","last_unstale":"2024-09-10T06:27:24.968958+0000","last_undegraded":"2024-09-10T06:27:24.968958+0000","last_fullsized":"2024-09-10T06:27:24.968958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:07.830355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":42,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.782615+0000","last_change":"2024-09-10T06:26:40.336448+0000","last_active":"2024-09-10T06:27:23.782615+0000","last_peered":"2024-09-10T06:27:23.782615+0000","last_clean":"2024-09-10T06:27:23.782615+0000","last_became_active":"2024-09-10T06:26:40.335771+0000","last_became_peered":"2024-09-10T06:26:40.335771+0000","last_unstale":"2024-09-10T06:27:23.782615+0000","last_undegraded":"2024-09-10T06:27:23.782615+0000","last_fullsized":"2024-09-10T06:27:23.782615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549925+0000","last_change":"2024-09-10T06:26:32.262176+0000","last_active":"2024-09-10T06:27:25.549925+0000","last_peered":"2024-09-10T06:27:25.549925+0000","last_clean":"2024-09-10T06:27:25.549925+0000","last_became_active":"2024-09-10T06:26:32.261250+0000","last_became_peered":"2024-09-10T06:26:32.261250+0000","last_unstale":"2024-09-10T06:27:25.549925+0000","last_undegraded":"2024-09-10T06:27:25.549925+0000","last_fullsized":"2024-09-10T06:27:25.549925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788589+0000","last_change":"2024-09-10T06:26:30.604587+0000","last_active":"2024-09-10T06:27:23.788589+0000","last_peered":"2024-09-10T06:27:23.788589+0000","last_clean":"2024-09-10T06:27:23.788589+0000","last_became_active":"2024-09-10T06:26:30.603175+0000","last_became_peered":"2024-09-10T06:26:30.603175+0000","last_unstale":"2024-09-10T06:27:23.788589+0000","last_undegraded":"2024-09-10T06:27:23.788589+0000","last_fullsized":"2024-09-10T06:27:23.788589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":54,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789291+0000","last_change":"2024-09-10T06:26:34.286028+0000","last_active":"2024-09-10T06:27:23.789291+0000","last_peered":"2024-09-10T06:27:23.789291+0000","last_clean":"2024-09-10T06:27:23.789291+0000","last_became_active":"2024-09-10T06:26:34.285169+0000","last_became_peered":"2024-09-10T06:26:34.285169+0000","last_unstale":"2024-09-10T06:27:23.789291+0000","last_undegraded":"2024-09-10T06:27:23.789291+0000","last_fullsized":"2024-09-10T06:27:23.789291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:24.146088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"34'15","reported_seq":76,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.784983+0000","last_change":"2024-09-10T06:26:36.292679+0000","last_active":"2024-09-10T06:27:23.784983+0000","last_peered":"2024-09-10T06:27:23.784983+0000","last_clean":"2024-09-10T06:27:23.784983+0000","last_became_active":"2024-09-10T06:26:36.288780+0000","last_became_peered":"2024-09-10T06:26:36.288780+0000","last_unstale":"2024-09-10T06:27:23.784983+0000","last_undegraded":"2024-09-10T06:27:23.784983+0000","last_fullsized":"2024-09-10T06:27:23.784983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.779294+0000","last_change":"2024-09-10T06:26:38.293015+0000","last_active":"2024-09-10T06:27:23.779294+0000","last_peered":"2024-09-10T06:27:23.779294+0000","last_clean":"2024-09-10T06:27:23.779294+0000","last_became_active":"2024-09-10T06:26:38.292185+0000","last_became_peered":"2024-09-10T06:26:38.292185+0000","last_unstale":"2024-09-10T06:27:23.779294+0000","last_undegraded":"2024-09-10T06:27:23.779294+0000","last_fullsized":"2024-09-10T06:27:23.779294+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:32.694777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":42,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.791578+0000","last_change":"2024-09-10T06:26:40.336074+0000","last_active":"2024-09-10T06:27:23.791578+0000","last_peered":"2024-09-10T06:27:23.791578+0000","last_clean":"2024-09-10T06:27:23.791578+0000","last_became_active":"2024-09-10T06:26:40.335339+0000","last_became_peered":"2024-09-10T06:26:40.335339+0000","last_unstale":"2024-09-10T06:27:23.791578+0000","last_undegraded":"2024-09-10T06:27:23.791578+0000","last_fullsized":"2024-09-10T06:27:23.791578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550652+0000","last_change":"2024-09-10T06:26:32.262823+0000","last_active":"2024-09-10T06:27:25.550652+0000","last_peered":"2024-09-10T06:27:25.550652+0000","last_clean":"2024-09-10T06:27:25.550652+0000","last_became_active":"2024-09-10T06:26:32.262041+0000","last_became_peered":"2024-09-10T06:26:32.262041+0000","last_unstale":"2024-09-10T06:27:25.550652+0000","last_undegraded":"2024-09-10T06:27:25.550652+0000","last_fullsized":"2024-09-10T06:27:25.550652+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:48.768083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":27,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.877609+0000","last_change":"2024-09-10T06:27:08.868703+0000","last_active":"2024-09-10T06:27:24.877609+0000","last_peered":"2024-09-10T06:27:24.877609+0000","last_clean":"2024-09-10T06:27:24.877609+0000","last_became_active":"2024-09-10T06:27:08.868399+0000","last_became_peered":"2024-09-10T06:27:08.868399+0000","last_unstale":"2024-09-10T06:27:24.877609+0000","last_undegraded":"2024-09-10T06:27:24.877609+0000","last_fullsized":"2024-09-10T06:27:24.877609+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:20.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":55,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.787713+0000","last_change":"2024-09-10T06:26:34.282651+0000","last_active":"2024-09-10T06:27:23.787713+0000","last_peered":"2024-09-10T06:27:23.787713+0000","last_clean":"2024-09-10T06:27:23.787713+0000","last_became_active":"2024-09-10T06:26:34.281777+0000","last_became_peered":"2024-09-10T06:26:34.281777+0000","last_unstale":"2024-09-10T06:27:23.787713+0000","last_undegraded":"2024-09-10T06:27:23.787713+0000","last_fullsized":"2024-09-10T06:27:23.787713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:42.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"34'9","reported_seq":67,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.779691+0000","last_change":"2024-09-10T06:26:36.285192+0000","last_active":"2024-09-10T06:27:23.779691+0000","last_peered":"2024-09-10T06:27:23.779691+0000","last_clean":"2024-09-10T06:27:23.779691+0000","last_became_active":"2024-09-10T06:26:36.284470+0000","last_became_peered":"2024-09-10T06:26:36.284470+0000","last_unstale":"2024-09-10T06:27:23.779691+0000","last_undegraded":"2024-09-10T06:27:23.779691+0000","last_fullsized":"2024-09-10T06:27:23.779691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:44.280458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":48,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.967042+0000","last_change":"2024-09-10T06:26:38.303425+0000","last_active":"2024-09-10T06:27:24.967042+0000","last_peered":"2024-09-10T06:27:24.967042+0000","last_clean":"2024-09-10T06:27:24.967042+0000","last_became_active":"2024-09-10T06:26:38.302606+0000","last_became_peered":"2024-09-10T06:26:38.302606+0000","last_unstale":"2024-09-10T06:27:24.967042+0000","last_undegraded":"2024-09-10T06:27:24.967042+0000","last_fullsized":"2024-09-10T06:27:24.967042+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:14.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":47,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554781+0000","last_change":"2024-09-10T06:26:40.311253+0000","last_active":"2024-09-10T06:27:25.554781+0000","last_peered":"2024-09-10T06:27:25.554781+0000","last_clean":"2024-09-10T06:27:25.554781+0000","last_became_active":"2024-09-10T06:26:40.310414+0000","last_became_peered":"2024-09-10T06:26:40.310414+0000","last_unstale":"2024-09-10T06:27:25.554781+0000","last_undegraded":"2024-09-10T06:27:25.554781+0000","last_fullsized":"2024-09-10T06:27:25.554781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:20.868195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553186+0000","last_change":"2024-09-10T06:26:32.262972+0000","last_active":"2024-09-10T06:27:25.553186+0000","last_peered":"2024-09-10T06:27:25.553186+0000","last_clean":"2024-09-10T06:27:25.553186+0000","last_became_active":"2024-09-10T06:26:32.262469+0000","last_became_peered":"2024-09-10T06:26:32.262469+0000","last_unstale":"2024-09-10T06:27:25.553186+0000","last_undegraded":"2024-09-10T06:27:25.553186+0000","last_fullsized":"2024-09-10T06:27:25.553186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.555071+0000","last_change":"2024-09-10T06:26:30.602013+0000","last_active":"2024-09-10T06:27:25.555071+0000","last_peered":"2024-09-10T06:27:25.555071+0000","last_clean":"2024-09-10T06:27:25.555071+0000","last_became_active":"2024-09-10T06:26:30.601672+0000","last_became_peered":"2024-09-10T06:26:30.601672+0000","last_unstale":"2024-09-10T06:27:25.555071+0000","last_undegraded":"2024-09-10T06:27:25.555071+0000","last_fullsized":"2024-09-10T06:27:25.555071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:52.012063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":58,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549122+0000","last_change":"2024-09-10T06:26:34.277010+0000","last_active":"2024-09-10T06:27:25.549122+0000","last_peered":"2024-09-10T06:27:25.549122+0000","last_clean":"2024-09-10T06:27:25.549122+0000","last_became_active":"2024-09-10T06:26:34.276197+0000","last_became_peered":"2024-09-10T06:26:34.276197+0000","last_unstale":"2024-09-10T06:27:25.549122+0000","last_undegraded":"2024-09-10T06:27:25.549122+0000","last_fullsized":"2024-09-10T06:27:25.549122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:32.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'5","reported_seq":65,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554233+0000","last_change":"2024-09-10T06:26:36.297514+0000","last_active":"2024-09-10T06:27:25.554233+0000","last_peered":"2024-09-10T06:27:25.554233+0000","last_clean":"2024-09-10T06:27:25.554233+0000","last_became_active":"2024-09-10T06:26:36.296615+0000","last_became_peered":"2024-09-10T06:26:36.296615+0000","last_unstale":"2024-09-10T06:27:25.554233+0000","last_undegraded":"2024-09-10T06:27:25.554233+0000","last_fullsized":"2024-09-10T06:27:25.554233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":50,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549378+0000","last_change":"2024-09-10T06:26:38.288794+0000","last_active":"2024-09-10T06:27:25.549378+0000","last_peered":"2024-09-10T06:27:25.549378+0000","last_clean":"2024-09-10T06:27:25.549378+0000","last_became_active":"2024-09-10T06:26:38.288055+0000","last_became_peered":"2024-09-10T06:26:38.288055+0000","last_unstale":"2024-09-10T06:27:25.549378+0000","last_undegraded":"2024-09-10T06:27:25.549378+0000","last_fullsized":"2024-09-10T06:27:25.549378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":42,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790573+0000","last_change":"2024-09-10T06:26:40.318067+0000","last_active":"2024-09-10T06:27:23.790573+0000","last_peered":"2024-09-10T06:27:23.790573+0000","last_clean":"2024-09-10T06:27:23.790573+0000","last_became_active":"2024-09-10T06:26:40.317244+0000","last_became_peered":"2024-09-10T06:26:40.317244+0000","last_unstale":"2024-09-10T06:27:23.790573+0000","last_undegraded":"2024-09-10T06:27:23.790573+0000","last_fullsized":"2024-09-10T06:27:23.790573+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549871+0000","last_change":"2024-09-10T06:26:32.277908+0000","last_active":"2024-09-10T06:27:25.549871+0000","last_peered":"2024-09-10T06:27:25.549871+0000","last_clean":"2024-09-10T06:27:25.549871+0000","last_became_active":"2024-09-10T06:26:32.274812+0000","last_became_peered":"2024-09-10T06:26:32.274812+0000","last_unstale":"2024-09-10T06:27:25.549871+0000","last_undegraded":"2024-09-10T06:27:25.549871+0000","last_fullsized":"2024-09-10T06:27:25.549871+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:37.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.782004+0000","last_change":"2024-09-10T06:26:30.594013+0000","last_active":"2024-09-10T06:27:23.782004+0000","last_peered":"2024-09-10T06:27:23.782004+0000","last_clean":"2024-09-10T06:27:23.782004+0000","last_became_active":"2024-09-10T06:26:30.593687+0000","last_became_peered":"2024-09-10T06:26:30.593687+0000","last_unstale":"2024-09-10T06:27:23.782004+0000","last_undegraded":"2024-09-10T06:27:23.782004+0000","last_fullsized":"2024-09-10T06:27:23.782004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:37.375037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":59,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551980+0000","last_change":"2024-09-10T06:26:34.283392+0000","last_active":"2024-09-10T06:27:25.551980+0000","last_peered":"2024-09-10T06:27:25.551980+0000","last_clean":"2024-09-10T06:27:25.551980+0000","last_became_active":"2024-09-10T06:26:34.282931+0000","last_became_peered":"2024-09-10T06:26:34.282931+0000","last_unstale":"2024-09-10T06:27:25.551980+0000","last_undegraded":"2024-09-10T06:27:25.551980+0000","last_fullsized":"2024-09-10T06:27:25.551980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:01.310719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'9","reported_seq":70,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549912+0000","last_change":"2024-09-10T06:26:36.289834+0000","last_active":"2024-09-10T06:27:25.549912+0000","last_peered":"2024-09-10T06:27:25.549912+0000","last_clean":"2024-09-10T06:27:25.549912+0000","last_became_active":"2024-09-10T06:26:36.289033+0000","last_became_peered":"2024-09-10T06:26:36.289033+0000","last_unstale":"2024-09-10T06:27:25.549912+0000","last_undegraded":"2024-09-10T06:27:25.549912+0000","last_fullsized":"2024-09-10T06:27:25.549912+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":47,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.779588+0000","last_change":"2024-09-10T06:26:38.299568+0000","last_active":"2024-09-10T06:27:23.779588+0000","last_peered":"2024-09-10T06:27:23.779588+0000","last_clean":"2024-09-10T06:27:23.779588+0000","last_became_active":"2024-09-10T06:26:38.298779+0000","last_became_peered":"2024-09-10T06:26:38.298779+0000","last_unstale":"2024-09-10T06:27:23.779588+0000","last_undegraded":"2024-09-10T06:27:23.779588+0000","last_fullsized":"2024-09-10T06:27:23.779588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":46,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551169+0000","last_change":"2024-09-10T06:26:40.336329+0000","last_active":"2024-09-10T06:27:25.551169+0000","last_peered":"2024-09-10T06:27:25.551169+0000","last_clean":"2024-09-10T06:27:25.551169+0000","last_became_active":"2024-09-10T06:26:40.335348+0000","last_became_peered":"2024-09-10T06:26:40.335348+0000","last_unstale":"2024-09-10T06:27:25.551169+0000","last_undegraded":"2024-09-10T06:27:25.551169+0000","last_fullsized":"2024-09-10T06:27:25.551169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:40.653642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551629+0000","last_change":"2024-09-10T06:26:32.276392+0000","last_active":"2024-09-10T06:27:25.551629+0000","last_peered":"2024-09-10T06:27:25.551629+0000","last_clean":"2024-09-10T06:27:25.551629+0000","last_became_active":"2024-09-10T06:26:32.275855+0000","last_became_peered":"2024-09-10T06:26:32.275855+0000","last_unstale":"2024-09-10T06:27:25.551629+0000","last_undegraded":"2024-09-10T06:27:25.551629+0000","last_fullsized":"2024-09-10T06:27:25.551629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:34.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.966957+0000","last_change":"2024-09-10T06:26:30.591577+0000","last_active":"2024-09-10T06:27:24.966957+0000","last_peered":"2024-09-10T06:27:24.966957+0000","last_clean":"2024-09-10T06:27:24.966957+0000","last_became_active":"2024-09-10T06:26:30.590801+0000","last_became_peered":"2024-09-10T06:26:30.590801+0000","last_unstale":"2024-09-10T06:27:24.966957+0000","last_undegraded":"2024-09-10T06:27:24.966957+0000","last_fullsized":"2024-09-10T06:27:24.966957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:16.066664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.551081+0000","last_change":"2024-09-10T06:26:32.268621+0000","last_active":"2024-09-10T06:27:25.551081+0000","last_peered":"2024-09-10T06:27:25.551081+0000","last_clean":"2024-09-10T06:27:25.551081+0000","last_became_active":"2024-09-10T06:26:32.267915+0000","last_became_peered":"2024-09-10T06:26:32.267915+0000","last_unstale":"2024-09-10T06:27:25.551081+0000","last_undegraded":"2024-09-10T06:27:25.551081+0000","last_fullsized":"2024-09-10T06:27:25.551081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:10.670492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":65,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.877901+0000","last_change":"2024-09-10T06:26:30.593794+0000","last_active":"2024-09-10T06:27:24.877901+0000","last_peered":"2024-09-10T06:27:24.877901+0000","last_clean":"2024-09-10T06:27:24.877901+0000","last_became_active":"2024-09-10T06:26:30.593506+0000","last_became_peered":"2024-09-10T06:26:30.593506+0000","last_unstale":"2024-09-10T06:27:24.877901+0000","last_undegraded":"2024-09-10T06:27:24.877901+0000","last_fullsized":"2024-09-10T06:27:24.877901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:29.521578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.788399+0000","last_change":"2024-09-10T06:26:32.288497+0000","last_active":"2024-09-10T06:27:23.788399+0000","last_peered":"2024-09-10T06:27:23.788399+0000","last_clean":"2024-09-10T06:27:23.788399+0000","last_became_active":"2024-09-10T06:26:32.287839+0000","last_became_peered":"2024-09-10T06:26:32.287839+0000","last_unstale":"2024-09-10T06:27:23.788399+0000","last_undegraded":"2024-09-10T06:27:23.788399+0000","last_fullsized":"2024-09-10T06:27:23.788399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.786298+0000","last_change":"2024-09-10T06:26:30.610172+0000","last_active":"2024-09-10T06:27:23.786298+0000","last_peered":"2024-09-10T06:27:23.786298+0000","last_clean":"2024-09-10T06:27:23.786298+0000","last_became_active":"2024-09-10T06:26:30.602685+0000","last_became_peered":"2024-09-10T06:26:30.602685+0000","last_unstale":"2024-09-10T06:27:23.786298+0000","last_undegraded":"2024-09-10T06:27:23.786298+0000","last_fullsized":"2024-09-10T06:27:23.786298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:35.705564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.549943+0000","last_change":"2024-09-10T06:26:32.272921+0000","last_active":"2024-09-10T06:27:25.549943+0000","last_peered":"2024-09-10T06:27:25.549943+0000","last_clean":"2024-09-10T06:27:25.549943+0000","last_became_active":"2024-09-10T06:26:32.272279+0000","last_became_peered":"2024-09-10T06:26:32.272279+0000","last_unstale":"2024-09-10T06:27:25.549943+0000","last_undegraded":"2024-09-10T06:27:25.549943+0000","last_fullsized":"2024-09-10T06:27:25.549943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:11.951551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780627+0000","last_change":"2024-09-10T06:26:30.579541+0000","last_active":"2024-09-10T06:27:23.780627+0000","last_peered":"2024-09-10T06:27:23.780627+0000","last_clean":"2024-09-10T06:27:23.780627+0000","last_became_active":"2024-09-10T06:26:30.579189+0000","last_became_peered":"2024-09-10T06:26:30.579189+0000","last_unstale":"2024-09-10T06:27:23.780627+0000","last_undegraded":"2024-09-10T06:27:23.780627+0000","last_fullsized":"2024-09-10T06:27:23.780627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:18.099885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554011+0000","last_change":"2024-09-10T06:26:32.260098+0000","last_active":"2024-09-10T06:27:25.554011+0000","last_peered":"2024-09-10T06:27:25.554011+0000","last_clean":"2024-09-10T06:27:25.554011+0000","last_became_active":"2024-09-10T06:26:32.259644+0000","last_became_peered":"2024-09-10T06:26:32.259644+0000","last_unstale":"2024-09-10T06:27:25.554011+0000","last_undegraded":"2024-09-10T06:27:25.554011+0000","last_fullsized":"2024-09-10T06:27:25.554011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.554541+0000","last_change":"2024-09-10T06:26:30.576146+0000","last_active":"2024-09-10T06:27:25.554541+0000","last_peered":"2024-09-10T06:27:25.554541+0000","last_clean":"2024-09-10T06:27:25.554541+0000","last_became_active":"2024-09-10T06:26:30.575605+0000","last_became_peered":"2024-09-10T06:26:30.575605+0000","last_unstale":"2024-09-10T06:27:25.554541+0000","last_undegraded":"2024-09-10T06:27:25.554541+0000","last_fullsized":"2024-09-10T06:27:25.554541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550922+0000","last_change":"2024-09-10T06:26:32.277577+0000","last_active":"2024-09-10T06:27:25.550922+0000","last_peered":"2024-09-10T06:27:25.550922+0000","last_clean":"2024-09-10T06:27:25.550922+0000","last_became_active":"2024-09-10T06:26:32.272454+0000","last_became_peered":"2024-09-10T06:26:32.272454+0000","last_unstale":"2024-09-10T06:27:25.550922+0000","last_undegraded":"2024-09-10T06:27:25.550922+0000","last_fullsized":"2024-09-10T06:27:25.550922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550786+0000","last_change":"2024-09-10T06:26:30.579134+0000","last_active":"2024-09-10T06:27:25.550786+0000","last_peered":"2024-09-10T06:27:25.550786+0000","last_clean":"2024-09-10T06:27:25.550786+0000","last_became_active":"2024-09-10T06:26:30.578732+0000","last_became_peered":"2024-09-10T06:26:30.578732+0000","last_unstale":"2024-09-10T06:27:25.550786+0000","last_undegraded":"2024-09-10T06:27:25.550786+0000","last_fullsized":"2024-09-10T06:27:25.550786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:08.832907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552984+0000","last_change":"2024-09-10T06:26:32.270804+0000","last_active":"2024-09-10T06:27:25.552984+0000","last_peered":"2024-09-10T06:27:25.552984+0000","last_clean":"2024-09-10T06:27:25.552984+0000","last_became_active":"2024-09-10T06:26:32.270327+0000","last_became_peered":"2024-09-10T06:26:32.270327+0000","last_unstale":"2024-09-10T06:27:25.552984+0000","last_undegraded":"2024-09-10T06:27:25.552984+0000","last_fullsized":"2024-09-10T06:27:25.552984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.968489+0000","last_change":"2024-09-10T06:26:30.598004+0000","last_active":"2024-09-10T06:27:24.968489+0000","last_peered":"2024-09-10T06:27:24.968489+0000","last_clean":"2024-09-10T06:27:24.968489+0000","last_became_active":"2024-09-10T06:26:30.596254+0000","last_became_peered":"2024-09-10T06:26:30.596254+0000","last_unstale":"2024-09-10T06:27:24.968489+0000","last_undegraded":"2024-09-10T06:27:24.968489+0000","last_fullsized":"2024-09-10T06:27:24.968489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":60,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.966874+0000","last_change":"2024-09-10T06:26:32.284215+0000","last_active":"2024-09-10T06:27:24.966874+0000","last_peered":"2024-09-10T06:27:24.966874+0000","last_clean":"2024-09-10T06:27:24.966874+0000","last_became_active":"2024-09-10T06:26:32.275133+0000","last_became_peered":"2024-09-10T06:26:32.275133+0000","last_unstale":"2024-09-10T06:27:24.966874+0000","last_undegraded":"2024-09-10T06:27:24.966874+0000","last_fullsized":"2024-09-10T06:27:24.966874+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:37.703268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553699+0000","last_change":"2024-09-10T06:26:30.580586+0000","last_active":"2024-09-10T06:27:25.553699+0000","last_peered":"2024-09-10T06:27:25.553699+0000","last_clean":"2024-09-10T06:27:25.553699+0000","last_became_active":"2024-09-10T06:26:30.580134+0000","last_became_peered":"2024-09-10T06:26:30.580134+0000","last_unstale":"2024-09-10T06:27:25.553699+0000","last_undegraded":"2024-09-10T06:27:25.553699+0000","last_fullsized":"2024-09-10T06:27:25.553699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781930+0000","last_change":"2024-09-10T06:26:32.256538+0000","last_active":"2024-09-10T06:27:23.781930+0000","last_peered":"2024-09-10T06:27:23.781930+0000","last_clean":"2024-09-10T06:27:23.781930+0000","last_became_active":"2024-09-10T06:26:32.256052+0000","last_became_peered":"2024-09-10T06:26:32.256052+0000","last_unstale":"2024-09-10T06:27:23.781930+0000","last_undegraded":"2024-09-10T06:27:23.781930+0000","last_fullsized":"2024-09-10T06:27:23.781930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:14.620472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.785508+0000","last_change":"2024-09-10T06:26:30.585220+0000","last_active":"2024-09-10T06:27:23.785508+0000","last_peered":"2024-09-10T06:27:23.785508+0000","last_clean":"2024-09-10T06:27:23.785508+0000","last_became_active":"2024-09-10T06:26:30.584443+0000","last_became_peered":"2024-09-10T06:26:30.584443+0000","last_unstale":"2024-09-10T06:27:23.785508+0000","last_undegraded":"2024-09-10T06:27:23.785508+0000","last_fullsized":"2024-09-10T06:27:23.785508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552043+0000","last_change":"2024-09-10T06:26:32.259306+0000","last_active":"2024-09-10T06:27:25.552043+0000","last_peered":"2024-09-10T06:27:25.552043+0000","last_clean":"2024-09-10T06:27:25.552043+0000","last_became_active":"2024-09-10T06:26:32.258513+0000","last_became_peered":"2024-09-10T06:26:32.258513+0000","last_unstale":"2024-09-10T06:27:25.552043+0000","last_undegraded":"2024-09-10T06:27:25.552043+0000","last_fullsized":"2024-09-10T06:27:25.552043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":67,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.553262+0000","last_change":"2024-09-10T06:26:30.581285+0000","last_active":"2024-09-10T06:27:25.553262+0000","last_peered":"2024-09-10T06:27:25.553262+0000","last_clean":"2024-09-10T06:27:25.553262+0000","last_became_active":"2024-09-10T06:26:30.580913+0000","last_became_peered":"2024-09-10T06:26:30.580913+0000","last_unstale":"2024-09-10T06:27:25.553262+0000","last_undegraded":"2024-09-10T06:27:25.553262+0000","last_fullsized":"2024-09-10T06:27:25.553262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":61,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878815+0000","last_change":"2024-09-10T06:26:32.274773+0000","last_active":"2024-09-10T06:27:24.878815+0000","last_peered":"2024-09-10T06:27:24.878815+0000","last_clean":"2024-09-10T06:27:24.878815+0000","last_became_active":"2024-09-10T06:26:32.274327+0000","last_became_peered":"2024-09-10T06:26:32.274327+0000","last_unstale":"2024-09-10T06:27:24.878815+0000","last_undegraded":"2024-09-10T06:27:24.878815+0000","last_fullsized":"2024-09-10T06:27:24.878815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:54.026434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":27,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.878090+0000","last_change":"2024-09-10T06:27:08.592940+0000","last_active":"2024-09-10T06:27:24.878090+0000","last_peered":"2024-09-10T06:27:24.878090+0000","last_clean":"2024-09-10T06:27:24.878090+0000","last_became_active":"2024-09-10T06:27:08.592637+0000","last_became_peered":"2024-09-10T06:27:08.592637+0000","last_unstale":"2024-09-10T06:27:24.878090+0000","last_undegraded":"2024-09-10T06:27:24.878090+0000","last_fullsized":"2024-09-10T06:27:24.878090+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:06.335302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":62,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.550866+0000","last_change":"2024-09-10T06:26:32.279474+0000","last_active":"2024-09-10T06:27:25.550866+0000","last_peered":"2024-09-10T06:27:25.550866+0000","last_clean":"2024-09-10T06:27:25.550866+0000","last_became_active":"2024-09-10T06:26:32.278461+0000","last_became_peered":"2024-09-10T06:26:32.278461+0000","last_unstale":"2024-09-10T06:27:25.550866+0000","last_undegraded":"2024-09-10T06:27:25.550866+0000","last_fullsized":"2024-09-10T06:27:25.550866+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.780742+0000","last_change":"2024-09-10T06:26:30.605519+0000","last_active":"2024-09-10T06:27:23.780742+0000","last_peered":"2024-09-10T06:27:23.780742+0000","last_clean":"2024-09-10T06:27:23.780742+0000","last_became_active":"2024-09-10T06:26:30.605225+0000","last_became_peered":"2024-09-10T06:26:30.605225+0000","last_unstale":"2024-09-10T06:27:23.780742+0000","last_undegraded":"2024-09-10T06:27:23.780742+0000","last_fullsized":"2024-09-10T06:27:23.780742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789961+0000","last_change":"2024-09-10T06:26:32.267201+0000","last_active":"2024-09-10T06:27:23.789961+0000","last_peered":"2024-09-10T06:27:23.789961+0000","last_clean":"2024-09-10T06:27:23.789961+0000","last_became_active":"2024-09-10T06:26:32.266234+0000","last_became_peered":"2024-09-10T06:26:32.266234+0000","last_unstale":"2024-09-10T06:27:23.789961+0000","last_undegraded":"2024-09-10T06:27:23.789961+0000","last_fullsized":"2024-09-10T06:27:23.789961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":64,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.968177+0000","last_change":"2024-09-10T06:26:30.596647+0000","last_active":"2024-09-10T06:27:24.968177+0000","last_peered":"2024-09-10T06:27:24.968177+0000","last_clean":"2024-09-10T06:27:24.968177+0000","last_became_active":"2024-09-10T06:26:30.593598+0000","last_became_peered":"2024-09-10T06:26:30.593598+0000","last_unstale":"2024-09-10T06:27:24.968177+0000","last_undegraded":"2024-09-10T06:27:24.968177+0000","last_fullsized":"2024-09-10T06:27:24.968177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.779744+0000","last_change":"2024-09-10T06:26:32.278317+0000","last_active":"2024-09-10T06:27:23.779744+0000","last_peered":"2024-09-10T06:27:23.779744+0000","last_clean":"2024-09-10T06:27:23.779744+0000","last_became_active":"2024-09-10T06:26:32.278032+0000","last_became_peered":"2024-09-10T06:26:32.278032+0000","last_unstale":"2024-09-10T06:27:23.779744+0000","last_undegraded":"2024-09-10T06:27:23.779744+0000","last_fullsized":"2024-09-10T06:27:23.779744+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:00.200118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":62,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.791297+0000","last_change":"2024-09-10T06:26:30.580552+0000","last_active":"2024-09-10T06:27:23.791297+0000","last_peered":"2024-09-10T06:27:23.791297+0000","last_clean":"2024-09-10T06:27:23.791297+0000","last_became_active":"2024-09-10T06:26:30.579319+0000","last_became_peered":"2024-09-10T06:26:30.579319+0000","last_unstale":"2024-09-10T06:27:23.791297+0000","last_undegraded":"2024-09-10T06:27:23.791297+0000","last_fullsized":"2024-09-10T06:27:23.791297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:59.885311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":63,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552909+0000","last_change":"2024-09-10T06:26:32.257601+0000","last_active":"2024-09-10T06:27:25.552909+0000","last_peered":"2024-09-10T06:27:25.552909+0000","last_clean":"2024-09-10T06:27:25.552909+0000","last_became_active":"2024-09-10T06:26:32.256851+0000","last_became_peered":"2024-09-10T06:26:32.256851+0000","last_unstale":"2024-09-10T06:27:25.552909+0000","last_undegraded":"2024-09-10T06:27:25.552909+0000","last_fullsized":"2024-09-10T06:27:25.552909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":65,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-10T06:27:24.879530+0000","last_change":"2024-09-10T06:26:30.601996+0000","last_active":"2024-09-10T06:27:24.879530+0000","last_peered":"2024-09-10T06:27:24.879530+0000","last_clean":"2024-09-10T06:27:24.879530+0000","last_became_active":"2024-09-10T06:26:30.601686+0000","last_became_peered":"2024-09-10T06:26:30.601686+0000","last_unstale":"2024-09-10T06:27:24.879530+0000","last_undegraded":"2024-09-10T06:27:24.879530+0000","last_fullsized":"2024-09-10T06:27:24.879530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:31:11.953454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":58,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.783388+0000","last_change":"2024-09-10T06:26:32.266768+0000","last_active":"2024-09-10T06:27:23.783388+0000","last_peered":"2024-09-10T06:27:23.783388+0000","last_clean":"2024-09-10T06:27:23.783388+0000","last_became_active":"2024-09-10T06:26:32.266000+0000","last_became_peered":"2024-09-10T06:26:32.266000+0000","last_unstale":"2024-09-10T06:27:23.783388+0000","last_undegraded":"2024-09-10T06:27:23.783388+0000","last_fullsized":"2024-09-10T06:27:23.783388+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.790912+0000","last_change":"2024-09-10T06:26:30.610309+0000","last_active":"2024-09-10T06:27:23.790912+0000","last_peered":"2024-09-10T06:27:23.790912+0000","last_clean":"2024-09-10T06:27:23.790912+0000","last_became_active":"2024-09-10T06:26:30.609674+0000","last_became_peered":"2024-09-10T06:26:30.609674+0000","last_unstale":"2024-09-10T06:27:23.790912+0000","last_undegraded":"2024-09-10T06:27:23.790912+0000","last_fullsized":"2024-09-10T06:27:23.790912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":63,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.785282+0000","last_change":"2024-09-10T06:26:30.591365+0000","last_active":"2024-09-10T06:27:23.785282+0000","last_peered":"2024-09-10T06:27:23.785282+0000","last_clean":"2024-09-10T06:27:23.785282+0000","last_became_active":"2024-09-10T06:26:30.590640+0000","last_became_peered":"2024-09-10T06:26:30.590640+0000","last_unstale":"2024-09-10T06:27:23.785282+0000","last_undegraded":"2024-09-10T06:27:23.785282+0000","last_fullsized":"2024-09-10T06:27:23.785282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.781846+0000","last_change":"2024-09-10T06:26:32.267333+0000","last_active":"2024-09-10T06:27:23.781846+0000","last_peered":"2024-09-10T06:27:23.781846+0000","last_clean":"2024-09-10T06:27:23.781846+0000","last_became_active":"2024-09-10T06:26:32.266876+0000","last_became_peered":"2024-09-10T06:26:32.266876+0000","last_unstale":"2024-09-10T06:27:23.781846+0000","last_undegraded":"2024-09-10T06:27:23.781846+0000","last_fullsized":"2024-09-10T06:27:23.781846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:02.483639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":66,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-09-10T06:27:25.552342+0000","last_change":"2024-09-10T06:26:30.590924+0000","last_active":"2024-09-10T06:27:25.552342+0000","last_peered":"2024-09-10T06:27:25.552342+0000","last_clean":"2024-09-10T06:27:25.552342+0000","last_became_active":"2024-09-10T06:26:30.590415+0000","last_became_peered":"2024-09-10T06:26:30.590415+0000","last_unstale":"2024-09-10T06:27:25.552342+0000","last_undegraded":"2024-09-10T06:27:25.552342+0000","last_fullsized":"2024-09-10T06:27:25.552342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:32.460291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-09-10T06:27:23.789201+0000","last_change":"2024-09-10T06:26:32.283339+0000","last_active":"2024-09-10T06:27:23.789201+0000","last_peered":"2024-09-10T06:27:23.789201+0000","last_clean":"2024-09-10T06:27:23.789201+0000","last_became_active":"2024-09-10T06:26:32.282581+0000","last_became_peered":"2024-09-10T06:26:32.282581+0000","last_unstale":"2024-09-10T06:27:23.789201+0000","last_undegraded":"2024-09-10T06:27:23.789201+0000","last_fullsized":"2024-09-10T06:27:23.789201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":689,"num_read_kb":448,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":388,"ondisk_log_size":388,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1204224,"data_stored":875185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27624,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344216,"statfs":{"total":96636764160,"available":96608477184,"internally_reserved":0,"allocated":602112,"data_stored":292966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":634880,"data_stored":285004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":589824,"data_stored":292464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":618496,"data_stored":292805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":573440,"data_stored":283719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31792,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":618496,"data_stored":292242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1187840,"data_stored":875027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:27:28.797 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-10T06:27:28.797 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-10T06:27:28.798 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-10T06:27:28.798 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-10T06:27:28.798 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-10T06:27:28.798 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-10T06:27:28.862 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:28.861+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:28.905 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:28.905 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:28.924 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:27:28.928 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-10T06:27:28.929 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:28.963 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:28.961+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:29.064 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:29.061+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:29.134 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:29.134 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:29.152 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:27:29.193 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:29.193+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:29.266 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:29.265+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:29.360 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:29.360 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:29.367 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:29.365+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:29.378 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:27:29.467 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:29.465+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:29.565 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:27:29.569 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:29.565+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:29.593 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:29.593 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:29.596 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-10T06:27:29.616 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:27:29.709 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:29.709+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:29.771 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:29.769+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:29.772 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:29.772 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:29.802 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:29.802 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:29.832 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:29.833 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:29.839 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:29.839 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:29.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:29.839 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:29.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.839 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:29.839 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:29.839 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.561496417999997, 2024-09-10T06:27:29.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069538480000000003, 2024-09-10T06:27:29.839 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.839 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.839 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-10T06:27:29.839 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:29.840 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:29.840 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2 2024-09-10T06:27:29.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.840 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:29.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:29.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275742+0000", 2024-09-10T06:27:29.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7460000000000001e-06 2024-09-10T06:27:29.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275751+0000", 2024-09-10T06:27:29.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3979999999999999e-06 2024-09-10T06:27:29.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275769+0000", 2024-09-10T06:27:29.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8637000000000001e-05 2024-09-10T06:27:29.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275784+0000", 2024-09-10T06:27:29.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4518000000000001e-05 2024-09-10T06:27:29.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275905+0000", 2024-09-10T06:27:29.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012092899999999999 2024-09-10T06:27:29.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-10T06:27:29.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275920+0000", 2024-09-10T06:27:29.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5325999999999999e-05 2024-09-10T06:27:29.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282541+0000", 2024-09-10T06:27:29.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066208400000000002 2024-09-10T06:27:29.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282693+0000", 2024-09-10T06:27:29.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152454 2024-09-10T06:27:29.844 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.844 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.844 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.844 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:29.844 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:29.844 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 51.424667857000003, 2024-09-10T06:27:29.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029204980000000001, 2024-09-10T06:27:29.844 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 193 2024-09-10T06:27:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412570+0000", 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4530000000000001e-06 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412582+0000", 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1524e-05 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412612+0000", 2024-09-10T06:27:29.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0436000000000001e-05 2024-09-10T06:27:29.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412627+0000", 2024-09-10T06:27:29.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4306e-05 2024-09-10T06:27:29.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412723+0000", 2024-09-10T06:27:29.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6075000000000004e-05 2024-09-10T06:27:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412831+0000", 2024-09-10T06:27:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108453 2024-09-10T06:27:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412972+0000", 2024-09-10T06:27:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141225 2024-09-10T06:27:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.414147+0000", 2024-09-10T06:27:29.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174989 2024-09-10T06:27:29.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415334+0000", 2024-09-10T06:27:29.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:29.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415420+0000", 2024-09-10T06:27:29.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6009999999999998e-05 2024-09-10T06:27:29.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415489+0000", 2024-09-10T06:27:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8403000000000002e-05 2024-09-10T06:27:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.527184214999998, 2024-09-10T06:27:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092944310000000006, 2024-09-10T06:27:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.850 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.851 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.851 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.851 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.851 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.851 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 208 2024-09-10T06:27:29.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.851 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:29.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:29.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310055+0000", 2024-09-10T06:27:29.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-10T06:27:29.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310066+0000", 2024-09-10T06:27:29.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1739999999999999e-05 2024-09-10T06:27:29.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310096+0000", 2024-09-10T06:27:29.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0159e-05 2024-09-10T06:27:29.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310111+0000", 2024-09-10T06:27:29.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5007e-05 2024-09-10T06:27:29.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310235+0000", 2024-09-10T06:27:29.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123132 2024-09-10T06:27:29.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:27:29.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310246+0000", 2024-09-10T06:27:29.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1487e-05 2024-09-10T06:27:29.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315594+0000", 2024-09-10T06:27:29.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005347592 2024-09-10T06:27:29.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315932+0000", 2024-09-10T06:27:29.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033789099999999999 2024-09-10T06:27:29.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.316549+0000", 2024-09-10T06:27:29.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061698099999999995 2024-09-10T06:27:29.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.317898+0000", 2024-09-10T06:27:29.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013498799999999999 2024-09-10T06:27:29.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319207+0000", 2024-09-10T06:27:29.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013086969999999999 2024-09-10T06:27:29.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319289+0000", 2024-09-10T06:27:29.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2259e-05 2024-09-10T06:27:29.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319346+0000", 2024-09-10T06:27:29.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6675999999999997e-05 2024-09-10T06:27:29.857 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.857 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.857 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.857 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.857 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:29.857 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.500847491999998, 2024-09-10T06:27:29.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003262778, 2024-09-10T06:27:29.858 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.858 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.858 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.858 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.858 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.858 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.858 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 212 2024-09-10T06:27:29.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.858 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:29.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:29.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336391+0000", 2024-09-10T06:27:29.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5770000000000001e-06 2024-09-10T06:27:29.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336403+0000", 2024-09-10T06:27:29.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2286000000000001e-05 2024-09-10T06:27:29.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336425+0000", 2024-09-10T06:27:29.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2164e-05 2024-09-10T06:27:29.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336440+0000", 2024-09-10T06:27:29.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4222999999999999e-05 2024-09-10T06:27:29.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336621+0000", 2024-09-10T06:27:29.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018136500000000001 2024-09-10T06:27:29.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336830+0000", 2024-09-10T06:27:29.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209125 2024-09-10T06:27:29.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.337206+0000", 2024-09-10T06:27:29.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037553700000000001 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.338527+0000", 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00132142 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339502+0000", 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00097512599999999999 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339585+0000", 2024-09-10T06:27:29.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2466000000000006e-05 2024-09-10T06:27:29.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339651+0000", 2024-09-10T06:27:29.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6489000000000007e-05 2024-09-10T06:27:29.863 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.863 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.863 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.863 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.863 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:29.863 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.476533953000001, 2024-09-10T06:27:29.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032440849999999999, 2024-09-10T06:27:29.864 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.864 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.864 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.864 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 219 2024-09-10T06:27:29.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.864 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:29.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:29.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360705+0000", 2024-09-10T06:27:29.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.593e-06 2024-09-10T06:27:29.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360716+0000", 2024-09-10T06:27:29.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1717e-05 2024-09-10T06:27:29.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360746+0000", 2024-09-10T06:27:29.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0233e-05 2024-09-10T06:27:29.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360761+0000", 2024-09-10T06:27:29.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4593000000000001e-05 2024-09-10T06:27:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360873+0000", 2024-09-10T06:27:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111809 2024-09-10T06:27:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361105+0000", 2024-09-10T06:27:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023171800000000001 2024-09-10T06:27:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361523+0000", 2024-09-10T06:27:29.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000418694 2024-09-10T06:27:29.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.362840+0000", 2024-09-10T06:27:29.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013165570000000001 2024-09-10T06:27:29.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363793+0000", 2024-09-10T06:27:29.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095323200000000004 2024-09-10T06:27:29.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363880+0000", 2024-09-10T06:27:29.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6689999999999998e-05 2024-09-10T06:27:29.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363946+0000", 2024-09-10T06:27:29.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6248999999999995e-05 2024-09-10T06:27:29.869 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.869 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.869 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.459267099999998, 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003271422, 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 224 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:29.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:29.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377971+0000", 2024-09-10T06:27:29.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:29.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377983+0000", 2024-09-10T06:27:29.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1517e-05 2024-09-10T06:27:29.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378013+0000", 2024-09-10T06:27:29.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0476000000000001e-05 2024-09-10T06:27:29.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378028+0000", 2024-09-10T06:27:29.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5173e-05 2024-09-10T06:27:29.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378134+0000", 2024-09-10T06:27:29.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010533 2024-09-10T06:27:29.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378346+0000", 2024-09-10T06:27:29.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021175499999999999 2024-09-10T06:27:29.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378787+0000", 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044190899999999999 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.380237+0000", 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001449093 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381097+0000", 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086022300000000002 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381181+0000", 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3973000000000004e-05 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381240+0000", 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9472999999999998e-05 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.427599647000001, 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031998719999999999, 2024-09-10T06:27:29.875 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 233 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409639+0000", 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4770000000000002e-06 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409652+0000", 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3692999999999999e-05 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409683+0000", 2024-09-10T06:27:29.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1080000000000001e-05 2024-09-10T06:27:29.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409699+0000", 2024-09-10T06:27:29.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5245999999999999e-05 2024-09-10T06:27:29.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409881+0000", 2024-09-10T06:27:29.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000182709 2024-09-10T06:27:29.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410088+0000", 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020630799999999999 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410495+0000", 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00040682700000000001 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.411805+0000", 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013101059999999999 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412672+0000", 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086778699999999996 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412769+0000", 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6565999999999997e-05 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412836+0000", 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7073e-05 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.880 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:353 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.386692332999999, 2024-09-10T06:27:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059710450000000003, 2024-09-10T06:27:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.881 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 353 2024-09-10T06:27:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:29.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450545+0000", 2024-09-10T06:27:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.423e-06 2024-09-10T06:27:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450551+0000", 2024-09-10T06:27:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7370000000000003e-06 2024-09-10T06:27:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450565+0000", 2024-09-10T06:27:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4649e-05 2024-09-10T06:27:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450574+0000", 2024-09-10T06:27:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5129999999999996e-06 2024-09-10T06:27:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450644+0000", 2024-09-10T06:27:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0387000000000002e-05 2024-09-10T06:27:29.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450818+0000", 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017368400000000001 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451030+0000", 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021189599999999999 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451607+0000", 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057672599999999995 2024-09-10T06:27:29.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456437+0000", 2024-09-10T06:27:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048301940000000003 2024-09-10T06:27:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456472+0000", 2024-09-10T06:27:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5178000000000001e-05 2024-09-10T06:27:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456515+0000", 2024-09-10T06:27:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2657999999999997e-05 2024-09-10T06:27:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:362 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.380244810999997, 2024-09-10T06:27:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044032239999999999, 2024-09-10T06:27:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.887 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 362 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456992+0000", 2024-09-10T06:27:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6700000000000002e-07 2024-09-10T06:27:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456997+0000", 2024-09-10T06:27:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6249999999999998e-06 2024-09-10T06:27:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457005+0000", 2024-09-10T06:27:29.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6719999999999993e-06 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457010+0000", 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7360000000000001e-06 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457054+0000", 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4138999999999999e-05 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457163+0000", 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108558 2024-09-10T06:27:29.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457340+0000", 2024-09-10T06:27:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017730600000000001 2024-09-10T06:27:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.458065+0000", 2024-09-10T06:27:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00072480400000000001 2024-09-10T06:27:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461294+0000", 2024-09-10T06:27:29.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032287890000000001 2024-09-10T06:27:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461352+0000", 2024-09-10T06:27:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8502000000000003e-05 2024-09-10T06:27:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461394+0000", 2024-09-10T06:27:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2225999999999999e-05 2024-09-10T06:27:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:475 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.334395246, 2024-09-10T06:27:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046091930000000001, 2024-09-10T06:27:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 475 2024-09-10T06:27:29.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:29.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6100000000000001e-07 2024-09-10T06:27:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502844+0000", 2024-09-10T06:27:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0529999999999998e-06 2024-09-10T06:27:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502852+0000", 2024-09-10T06:27:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2579999999999995e-06 2024-09-10T06:27:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502857+0000", 2024-09-10T06:27:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3460000000000004e-06 2024-09-10T06:27:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502894+0000", 2024-09-10T06:27:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6884000000000001e-05 2024-09-10T06:27:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502942+0000", 2024-09-10T06:27:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7791999999999999e-05 2024-09-10T06:27:29.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.503048+0000", 2024-09-10T06:27:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010678799999999999 2024-09-10T06:27:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.506079+0000", 2024-09-10T06:27:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030311510000000002 2024-09-10T06:27:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507361+0000", 2024-09-10T06:27:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001281208 2024-09-10T06:27:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507400+0000", 2024-09-10T06:27:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9483000000000001e-05 2024-09-10T06:27:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507450+0000", 2024-09-10T06:27:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9669000000000002e-05 2024-09-10T06:27:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.898 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:477 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.332434128999999, 2024-09-10T06:27:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038544, 2024-09-10T06:27:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.899 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 477 2024-09-10T06:27:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504803+0000", 2024-09-10T06:27:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9999999999999996e-07 2024-09-10T06:27:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504808+0000", 2024-09-10T06:27:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1909999999999999e-06 2024-09-10T06:27:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504818+0000", 2024-09-10T06:27:29.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0081999999999999e-05 2024-09-10T06:27:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504823+0000", 2024-09-10T06:27:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9969999999999998e-06 2024-09-10T06:27:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504870+0000", 2024-09-10T06:27:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6980000000000001e-05 2024-09-10T06:27:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504922+0000", 2024-09-10T06:27:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869000000000001e-05 2024-09-10T06:27:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505020+0000", 2024-09-10T06:27:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8010999999999994e-05 2024-09-10T06:27:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507789+0000", 2024-09-10T06:27:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027690219999999999 2024-09-10T06:27:29.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508599+0000", 2024-09-10T06:27:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081037800000000005 2024-09-10T06:27:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508631+0000", 2024-09-10T06:27:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.137e-05 2024-09-10T06:27:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508656+0000", 2024-09-10T06:27:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5599999999999999e-05 2024-09-10T06:27:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:478 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.332387226999998, 2024-09-10T06:27:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039361880000000002, 2024-09-10T06:27:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.905 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 478 2024-09-10T06:27:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7800000000000001e-07 2024-09-10T06:27:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504853+0000", 2024-09-10T06:27:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2780000000000002e-06 2024-09-10T06:27:29.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504858+0000", 2024-09-10T06:27:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7359999999999998e-06 2024-09-10T06:27:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504862+0000", 2024-09-10T06:27:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6650000000000001e-06 2024-09-10T06:27:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504938+0000", 2024-09-10T06:27:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6286999999999997e-05 2024-09-10T06:27:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505091+0000", 2024-09-10T06:27:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152385 2024-09-10T06:27:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505335+0000", 2024-09-10T06:27:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244281 2024-09-10T06:27:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507764+0000", 2024-09-10T06:27:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002429624 2024-09-10T06:27:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508681+0000", 2024-09-10T06:27:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00091630100000000001 2024-09-10T06:27:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508747+0000", 2024-09-10T06:27:29.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5733000000000002e-05 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508785+0000", 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8319999999999999e-05 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.086255307000002, 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030732350000000001, 2024-09-10T06:27:29.911 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 733 2024-09-10T06:27:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750983+0000", 2024-09-10T06:27:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8880000000000001e-06 2024-09-10T06:27:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750996+0000", 2024-09-10T06:27:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2048999999999999e-05 2024-09-10T06:27:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751024+0000", 2024-09-10T06:27:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8802e-05 2024-09-10T06:27:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751043+0000", 2024-09-10T06:27:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8266000000000001e-05 2024-09-10T06:27:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751191+0000", 2024-09-10T06:27:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014818200000000001 2024-09-10T06:27:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751417+0000", 2024-09-10T06:27:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022648199999999999 2024-09-10T06:27:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751747+0000", 2024-09-10T06:27:29.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032945000000000001 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.752752+0000", 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010054790000000001 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753896+0000", 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001143638 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753989+0000", 2024-09-10T06:27:29.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3466000000000003e-05 2024-09-10T06:27:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.754054+0000", 2024-09-10T06:27:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4533e-05 2024-09-10T06:27:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:29.917 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.045774760999997, 2024-09-10T06:27:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002896722, 2024-09-10T06:27:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 751 2024-09-10T06:27:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791464+0000", 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7140000000000002e-06 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791475+0000", 2024-09-10T06:27:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1535999999999999e-05 2024-09-10T06:27:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791501+0000", 2024-09-10T06:27:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5276e-05 2024-09-10T06:27:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791514+0000", 2024-09-10T06:27:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3203e-05 2024-09-10T06:27:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791643+0000", 2024-09-10T06:27:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012961900000000001 2024-09-10T06:27:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791857+0000", 2024-09-10T06:27:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021351599999999999 2024-09-10T06:27:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.792178+0000", 2024-09-10T06:27:29.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032090999999999999 2024-09-10T06:27:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.793281+0000", 2024-09-10T06:27:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001103319 2024-09-10T06:27:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794209+0000", 2024-09-10T06:27:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000927676 2024-09-10T06:27:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794295+0000", 2024-09-10T06:27:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5682999999999999e-05 2024-09-10T06:27:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794358+0000", 2024-09-10T06:27:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3269999999999996e-05 2024-09-10T06:27:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.923 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.041887264000003, 2024-09-10T06:27:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030558059999999999, 2024-09-10T06:27:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 753 2024-09-10T06:27:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795352+0000", 2024-09-10T06:27:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0130000000000002e-06 2024-09-10T06:27:29.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795364+0000", 2024-09-10T06:27:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1939999999999999e-05 2024-09-10T06:27:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795395+0000", 2024-09-10T06:27:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0976999999999998e-05 2024-09-10T06:27:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795413+0000", 2024-09-10T06:27:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7980000000000001e-05 2024-09-10T06:27:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795533+0000", 2024-09-10T06:27:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120732 2024-09-10T06:27:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795665+0000", 2024-09-10T06:27:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013215899999999999 2024-09-10T06:27:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795931+0000", 2024-09-10T06:27:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026536499999999999 2024-09-10T06:27:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.796995+0000", 2024-09-10T06:27:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001064611 2024-09-10T06:27:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798256+0000", 2024-09-10T06:27:29.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00126022 2024-09-10T06:27:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798340+0000", 2024-09-10T06:27:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4753000000000007e-05 2024-09-10T06:27:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798404+0000", 2024-09-10T06:27:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4055999999999998e-05 2024-09-10T06:27:29.929 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.926679022999998, 2024-09-10T06:27:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031632380000000001, 2024-09-10T06:27:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 805 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910560+0000", 2024-09-10T06:27:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2200000000000001e-06 2024-09-10T06:27:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910574+0000", 2024-09-10T06:27:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3536000000000001e-05 2024-09-10T06:27:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910604+0000", 2024-09-10T06:27:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0645999999999998e-05 2024-09-10T06:27:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910619+0000", 2024-09-10T06:27:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5064e-05 2024-09-10T06:27:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910759+0000", 2024-09-10T06:27:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013943899999999999 2024-09-10T06:27:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910984+0000", 2024-09-10T06:27:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000225381 2024-09-10T06:27:29.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.911312+0000", 2024-09-10T06:27:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032782800000000001 2024-09-10T06:27:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.912402+0000", 2024-09-10T06:27:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010895639999999999 2024-09-10T06:27:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913576+0000", 2024-09-10T06:27:29.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174591 2024-09-10T06:27:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913657+0000", 2024-09-10T06:27:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1223000000000005e-05 2024-09-10T06:27:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913720+0000", 2024-09-10T06:27:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2745999999999999e-05 2024-09-10T06:27:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.935 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.866901288000001, 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030680099999999999, 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 832 2024-09-10T06:27:29.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970337+0000", 2024-09-10T06:27:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6230000000000001e-06 2024-09-10T06:27:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970349+0000", 2024-09-10T06:27:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1557e-05 2024-09-10T06:27:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970379+0000", 2024-09-10T06:27:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0456000000000001e-05 2024-09-10T06:27:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970394+0000", 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4683e-05 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970509+0000", 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114613 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970753+0000", 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244295 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.971078+0000", 2024-09-10T06:27:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000325583 2024-09-10T06:27:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.972162+0000", 2024-09-10T06:27:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010834519999999999 2024-09-10T06:27:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973200+0000", 2024-09-10T06:27:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010376560000000001 2024-09-10T06:27:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973287+0000", 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7163000000000006e-05 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973403+0000", 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011592899999999999 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.941 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.711830061000001, 2024-09-10T06:27:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030018599999999999, 2024-09-10T06:27:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 901 2024-09-10T06:27:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125409+0000", 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.253e-06 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125425+0000", 2024-09-10T06:27:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5636000000000001e-05 2024-09-10T06:27:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125456+0000", 2024-09-10T06:27:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1130000000000002e-05 2024-09-10T06:27:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125470+0000", 2024-09-10T06:27:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.464e-05 2024-09-10T06:27:29.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125581+0000", 2024-09-10T06:27:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110612 2024-09-10T06:27:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125814+0000", 2024-09-10T06:27:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023266899999999999 2024-09-10T06:27:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.126159+0000", 2024-09-10T06:27:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034565399999999998 2024-09-10T06:27:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.127161+0000", 2024-09-10T06:27:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010020890000000001 2024-09-10T06:27:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128202+0000", 2024-09-10T06:27:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001040242 2024-09-10T06:27:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128288+0000", 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6156000000000007e-05 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128408+0000", 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011977900000000001 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:29.947 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.677737692000001, 2024-09-10T06:27:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029016649999999999, 2024-09-10T06:27:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 916 2024-09-10T06:27:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159501+0000", 2024-09-10T06:27:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159512+0000", 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1564e-05 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159543+0000", 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0942999999999998e-05 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159558+0000", 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.436e-05 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159701+0000", 2024-09-10T06:27:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014363599999999999 2024-09-10T06:27:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159927+0000", 2024-09-10T06:27:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022535099999999999 2024-09-10T06:27:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.160260+0000", 2024-09-10T06:27:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033321700000000002 2024-09-10T06:27:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.161312+0000", 2024-09-10T06:27:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001052222 2024-09-10T06:27:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162261+0000", 2024-09-10T06:27:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00094912600000000001 2024-09-10T06:27:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162337+0000", 2024-09-10T06:27:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6268999999999998e-05 2024-09-10T06:27:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162400+0000", 2024-09-10T06:27:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2477000000000005e-05 2024-09-10T06:27:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 47.607428181000003, 2024-09-10T06:27:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030045179999999999, 2024-09-10T06:27:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 946 2024-09-10T06:27:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229810+0000", 2024-09-10T06:27:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:27:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229838+0000", 2024-09-10T06:27:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7776e-05 2024-09-10T06:27:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229869+0000", 2024-09-10T06:27:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0766999999999999e-05 2024-09-10T06:27:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229883+0000", 2024-09-10T06:27:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4423000000000001e-05 2024-09-10T06:27:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230005+0000", 2024-09-10T06:27:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121919 2024-09-10T06:27:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230219+0000", 2024-09-10T06:27:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000214098 2024-09-10T06:27:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230588+0000", 2024-09-10T06:27:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036857099999999999 2024-09-10T06:27:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.231707+0000", 2024-09-10T06:27:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011193349999999999 2024-09-10T06:27:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232662+0000", 2024-09-10T06:27:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095513300000000005 2024-09-10T06:27:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232748+0000", 2024-09-10T06:27:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6151999999999998e-05 2024-09-10T06:27:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232812+0000", 2024-09-10T06:27:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3876999999999998e-05 2024-09-10T06:27:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:29.959 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:29.961 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:27:29.961 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:29.962 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:29.962 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:29.962 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:29.962 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:29.963 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:29.963 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:29.963 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:29.964 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:29.961+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:29.994 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:29.994 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:30.061 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:30.061+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:30.134 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:30.134 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:30.134 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:30.134 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:30.153 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:27:30.197 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:30.197+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:30.263 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:30.261+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:30.364 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:30.365+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:30.365 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:30.365 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:30.365 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:30.383 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:27:30.469 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:30.469+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:30.565 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:30.565+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:30.596 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4236.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T06:27:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.087803445999995, 2024-09-10T06:27:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049682550000000004, 2024-09-10T06:27:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507427+0000", 2024-09-10T06:27:30.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5629999999999999e-06 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507439+0000", 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.19e-05 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507460+0000", 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1693000000000001e-05 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507480+0000", 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9947000000000001e-05 2024-09-10T06:27:30.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507613+0000", 2024-09-10T06:27:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000132409 2024-09-10T06:27:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507696+0000", 2024-09-10T06:27:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2953000000000004e-05 2024-09-10T06:27:30.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512288+0000", 2024-09-10T06:27:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045927110000000002 2024-09-10T06:27:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512393+0000", 2024-09-10T06:27:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105079 2024-09-10T06:27:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 56.264339413999998, 2024-09-10T06:27:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025692739999999999, 2024-09-10T06:27:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:30.602 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 42 2024-09-10T06:27:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:30.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330891+0000", 2024-09-10T06:27:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9700000000000002e-06 2024-09-10T06:27:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330901+0000", 2024-09-10T06:27:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2909999999999996e-06 2024-09-10T06:27:30.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330924+0000", 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3132000000000001e-05 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330935+0000", 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0893999999999999e-05 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331021+0000", 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6205000000000006e-05 2024-09-10T06:27:30.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331160+0000", 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013973600000000001 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331336+0000", 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017578799999999999 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.332381+0000", 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001044627 2024-09-10T06:27:30.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333371+0000", 2024-09-10T06:27:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098979800000000007 2024-09-10T06:27:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333421+0000", 2024-09-10T06:27:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9872e-05 2024-09-10T06:27:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333459+0000", 2024-09-10T06:27:30.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7960999999999998e-05 2024-09-10T06:27:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.279148493999998, 2024-09-10T06:27:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025247730000000001, 2024-09-10T06:27:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.608 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 52 2024-09-10T06:27:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316084+0000", 2024-09-10T06:27:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8260000000000003e-06 2024-09-10T06:27:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316095+0000", 2024-09-10T06:27:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1229999999999999e-05 2024-09-10T06:27:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316131+0000", 2024-09-10T06:27:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5499e-05 2024-09-10T06:27:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316150+0000", 2024-09-10T06:27:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9510000000000001e-05 2024-09-10T06:27:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316275+0000", 2024-09-10T06:27:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012501600000000001 2024-09-10T06:27:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316507+0000", 2024-09-10T06:27:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000231404 2024-09-10T06:27:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316712+0000", 2024-09-10T06:27:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204873 2024-09-10T06:27:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.317603+0000", 2024-09-10T06:27:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089174399999999998 2024-09-10T06:27:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318470+0000", 2024-09-10T06:27:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086713399999999998 2024-09-10T06:27:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318552+0000", 2024-09-10T06:27:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1279999999999994e-05 2024-09-10T06:27:30.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318605+0000", 2024-09-10T06:27:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3257000000000002e-05 2024-09-10T06:27:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.175370164999997, 2024-09-10T06:27:30.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033383480000000001, 2024-09-10T06:27:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 236 2024-09-10T06:27:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419861+0000", 2024-09-10T06:27:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.734e-06 2024-09-10T06:27:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419873+0000", 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1789e-05 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419904+0000", 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1377000000000001e-05 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419921+0000", 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6878999999999999e-05 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420052+0000", 2024-09-10T06:27:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013025600000000001 2024-09-10T06:27:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420263+0000", 2024-09-10T06:27:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021196600000000001 2024-09-10T06:27:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420649+0000", 2024-09-10T06:27:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038507 2024-09-10T06:27:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.422366+0000", 2024-09-10T06:27:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017172000000000001 2024-09-10T06:27:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423048+0000", 2024-09-10T06:27:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00068254100000000005 2024-09-10T06:27:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423127+0000", 2024-09-10T06:27:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8207000000000005e-05 2024-09-10T06:27:30.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423197+0000", 2024-09-10T06:27:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0328999999999997e-05 2024-09-10T06:27:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.158768891000001, 2024-09-10T06:27:30.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003575235, 2024-09-10T06:27:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 299 2024-09-10T06:27:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436461+0000", 2024-09-10T06:27:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.144e-06 2024-09-10T06:27:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436466+0000", 2024-09-10T06:27:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8409999999999999e-06 2024-09-10T06:27:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436477+0000", 2024-09-10T06:27:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1253000000000001e-05 2024-09-10T06:27:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436483+0000", 2024-09-10T06:27:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7010000000000001e-06 2024-09-10T06:27:30.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436527+0000", 2024-09-10T06:27:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4381000000000001e-05 2024-09-10T06:27:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436569+0000", 2024-09-10T06:27:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2208e-05 2024-09-10T06:27:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:30.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436687+0000", 2024-09-10T06:27:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118093 2024-09-10T06:27:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.437455+0000", 2024-09-10T06:27:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076799599999999996 2024-09-10T06:27:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439950+0000", 2024-09-10T06:27:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024946040000000001 2024-09-10T06:27:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439988+0000", 2024-09-10T06:27:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8405999999999998e-05 2024-09-10T06:27:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.440035+0000", 2024-09-10T06:27:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6607999999999998e-05 2024-09-10T06:27:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.824092809, 2024-09-10T06:27:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028833040000000002, 2024-09-10T06:27:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 742 2024-09-10T06:27:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.627 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771139+0000", 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5269999999999999e-06 2024-09-10T06:27:30.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771153+0000", 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4036000000000001e-05 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771186+0000", 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2113000000000002e-05 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771201+0000", 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:30.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771320+0000", 2024-09-10T06:27:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119265 2024-09-10T06:27:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771557+0000", 2024-09-10T06:27:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023640600000000001 2024-09-10T06:27:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771890+0000", 2024-09-10T06:27:30.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033302000000000001 2024-09-10T06:27:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773204+0000", 2024-09-10T06:27:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013142239999999999 2024-09-10T06:27:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773864+0000", 2024-09-10T06:27:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066005100000000004 2024-09-10T06:27:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.631 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773948+0000", 2024-09-10T06:27:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4625999999999999e-05 2024-09-10T06:27:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774019+0000", 2024-09-10T06:27:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0705999999999997e-05 2024-09-10T06:27:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:30.632 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.820313558999999, 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025263479999999999, 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 744 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774917+0000", 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0540000000000002e-06 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774926+0000", 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5660000000000007e-06 2024-09-10T06:27:30.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774947+0000", 2024-09-10T06:27:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0852999999999998e-05 2024-09-10T06:27:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774958+0000", 2024-09-10T06:27:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1216999999999999e-05 2024-09-10T06:27:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775045+0000", 2024-09-10T06:27:30.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7643000000000001e-05 2024-09-10T06:27:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775167+0000", 2024-09-10T06:27:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012163900000000001 2024-09-10T06:27:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775427+0000", 2024-09-10T06:27:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000259678 2024-09-10T06:27:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.776736+0000", 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013093429999999999 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777296+0000", 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056029599999999995 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777374+0000", 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7721999999999999e-05 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.637 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777441+0000", 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7336999999999996e-05 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.782998012999997, 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036412979999999998, 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.638 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 760 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812233+0000", 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812244+0000", 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1273e-05 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812276+0000", 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1253e-05 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812290+0000", 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4576000000000001e-05 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812438+0000", 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014775899999999999 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812821+0000", 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000383187 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.813398+0000", 2024-09-10T06:27:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000576619 2024-09-10T06:27:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.814658+0000", 2024-09-10T06:27:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001260207 2024-09-10T06:27:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815591+0000", 2024-09-10T06:27:30.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00093332899999999999 2024-09-10T06:27:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815745+0000", 2024-09-10T06:27:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153392 2024-09-10T06:27:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815872+0000", 2024-09-10T06:27:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012715599999999999 2024-09-10T06:27:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.643 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.778362629, 2024-09-10T06:27:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029417369999999998, 2024-09-10T06:27:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.644 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 762 2024-09-10T06:27:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816868+0000", 2024-09-10T06:27:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.283e-06 2024-09-10T06:27:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816879+0000", 2024-09-10T06:27:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0523000000000001e-05 2024-09-10T06:27:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816910+0000", 2024-09-10T06:27:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0732999999999999e-05 2024-09-10T06:27:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816926+0000", 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.677e-05 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817058+0000", 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013195599999999999 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817299+0000", 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000241091 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817761+0000", 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046188400000000003 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.818948+0000", 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819662+0000", 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071398399999999997 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819745+0000", 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3560000000000006e-05 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819808+0000", 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2329000000000006e-05 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.649 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.657901912, 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002834175, 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 817 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937330+0000", 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9869999999999999e-06 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937342+0000", 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2595999999999999e-05 2024-09-10T06:27:30.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937375+0000", 2024-09-10T06:27:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2320000000000002e-05 2024-09-10T06:27:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937390+0000", 2024-09-10T06:27:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4977000000000001e-05 2024-09-10T06:27:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937529+0000", 2024-09-10T06:27:30.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013937199999999999 2024-09-10T06:27:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937753+0000", 2024-09-10T06:27:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000224358 2024-09-10T06:27:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.938061+0000", 2024-09-10T06:27:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030808799999999998 2024-09-10T06:27:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.939112+0000", 2024-09-10T06:27:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010503050000000001 2024-09-10T06:27:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940005+0000", 2024-09-10T06:27:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089366599999999999 2024-09-10T06:27:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940093+0000", 2024-09-10T06:27:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8053000000000006e-05 2024-09-10T06:27:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940161+0000", 2024-09-10T06:27:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7453000000000006e-05 2024-09-10T06:27:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.604973870000002, 2024-09-10T06:27:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027552649999999998, 2024-09-10T06:27:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.655 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 841 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:30.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990257+0000", 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6869999999999999e-06 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990270+0000", 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2843000000000001e-05 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990300+0000", 2024-09-10T06:27:30.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9252999999999999e-05 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990314+0000", 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4796e-05 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990427+0000", 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112649 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990671+0000", 2024-09-10T06:27:30.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244408 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990987+0000", 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031593099999999998 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992073+0000", 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010854549999999999 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992862+0000", 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00078889400000000005 2024-09-10T06:27:30.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992944+0000", 2024-09-10T06:27:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2152999999999998e-05 2024-09-10T06:27:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993010+0000", 2024-09-10T06:27:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6196000000000001e-05 2024-09-10T06:27:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.601237935999997, 2024-09-10T06:27:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025373539999999999, 2024-09-10T06:27:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 843 2024-09-10T06:27:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.661 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993993+0000", 2024-09-10T06:27:30.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3630000000000001e-06 2024-09-10T06:27:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994004+0000", 2024-09-10T06:27:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0557000000000001e-05 2024-09-10T06:27:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994035+0000", 2024-09-10T06:27:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0969000000000001e-05 2024-09-10T06:27:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994055+0000", 2024-09-10T06:27:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0497e-05 2024-09-10T06:27:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994150+0000", 2024-09-10T06:27:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5363000000000002e-05 2024-09-10T06:27:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994275+0000", 2024-09-10T06:27:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012453200000000001 2024-09-10T06:27:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994570+0000", 2024-09-10T06:27:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029522100000000003 2024-09-10T06:27:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.995569+0000", 2024-09-10T06:27:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00099913200000000001 2024-09-10T06:27:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996384+0000", 2024-09-10T06:27:30.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081451099999999997 2024-09-10T06:27:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996462+0000", 2024-09-10T06:27:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8502000000000002e-05 2024-09-10T06:27:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996528+0000", 2024-09-10T06:27:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5707e-05 2024-09-10T06:27:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.591790789000001, 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033145539999999999, 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 847 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003440+0000", 2024-09-10T06:27:30.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5299999999999999e-06 2024-09-10T06:27:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003452+0000", 2024-09-10T06:27:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003482+0000", 2024-09-10T06:27:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0790000000000002e-05 2024-09-10T06:27:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003497+0000", 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.489e-05 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003645+0000", 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014771900000000001 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003996+0000", 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000350861 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:30.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.004540+0000", 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054383199999999995 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.005831+0000", 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001291366 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006461+0000", 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062943899999999998 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006631+0000", 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000170228 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006752+0000", 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012160899999999999 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.587537621999999, 2024-09-10T06:27:30.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002619953, 2024-09-10T06:27:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 849 2024-09-10T06:27:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007693+0000", 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3099999999999999e-06 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007704+0000", 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0387000000000001e-05 2024-09-10T06:27:30.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007734+0000", 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0676000000000002e-05 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007753+0000", 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.836e-05 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007857+0000", 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103836 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007980+0000", 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123843 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.008241+0000", 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026085799999999999 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.009475+0000", 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012340230000000001 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010168+0000", 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00069220800000000004 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010247+0000", 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9929e-05 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010311+0000", 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3522999999999995e-05 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.677 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.543057801000003, 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026646590000000002, 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 868 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052173+0000", 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052186+0000", 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2787e-05 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052216+0000", 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9618999999999999e-05 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052231+0000", 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4929999999999999e-05 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052349+0000", 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011830200000000001 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052561+0000", 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000212182 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052874+0000", 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031299399999999998 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054049+0000", 2024-09-10T06:27:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174825 2024-09-10T06:27:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054635+0000", 2024-09-10T06:27:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058643900000000001 2024-09-10T06:27:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054721+0000", 2024-09-10T06:27:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5185999999999994e-05 2024-09-10T06:27:30.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054836+0000", 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114922 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.456401700000001, 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028453739999999999, 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.683 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 907 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138830+0000", 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8600000000000001e-06 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138842+0000", 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2126e-05 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138874+0000", 2024-09-10T06:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2047e-05 2024-09-10T06:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138889+0000", 2024-09-10T06:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4966999999999999e-05 2024-09-10T06:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139007+0000", 2024-09-10T06:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118479 2024-09-10T06:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139238+0000", 2024-09-10T06:27:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023031399999999999 2024-09-10T06:27:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139566+0000", 2024-09-10T06:27:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032816099999999999 2024-09-10T06:27:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.140631+0000", 2024-09-10T06:27:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010653679999999999 2024-09-10T06:27:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141393+0000", 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076187100000000001 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141561+0000", 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016755599999999999 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141672+0000", 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111625 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.688 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.452478184, 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002857268, 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 909 2024-09-10T06:27:30.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142753+0000", 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4040000000000002e-06 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142764+0000", 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0789e-05 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142795+0000", 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0982999999999998e-05 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142810+0000", 2024-09-10T06:27:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4960000000000001e-05 2024-09-10T06:27:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142908+0000", 2024-09-10T06:27:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8726000000000003e-05 2024-09-10T06:27:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143030+0000", 2024-09-10T06:27:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121649 2024-09-10T06:27:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143294+0000", 2024-09-10T06:27:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000263875 2024-09-10T06:27:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.144530+0000", 2024-09-10T06:27:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001236067 2024-09-10T06:27:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145340+0000", 2024-09-10T06:27:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080966700000000003 2024-09-10T06:27:30.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145497+0000", 2024-09-10T06:27:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015773499999999999 2024-09-10T06:27:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145608+0000", 2024-09-10T06:27:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110413 2024-09-10T06:27:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.358780686999999, 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029166940000000001, 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 949 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236451+0000", 2024-09-10T06:27:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:27:30.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236464+0000", 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3223e-05 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236497+0000", 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2672999999999997e-05 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236515+0000", 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8386999999999999e-05 2024-09-10T06:27:30.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236636+0000", 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120752 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236857+0000", 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022134499999999999 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.237188+0000", 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033057799999999999 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.238353+0000", 2024-09-10T06:27:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001164841 2024-09-10T06:27:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239160+0000", 2024-09-10T06:27:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080743000000000004 2024-09-10T06:27:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239245+0000", 2024-09-10T06:27:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5189e-05 2024-09-10T06:27:30.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239365+0000", 2024-09-10T06:27:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119406 2024-09-10T06:27:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.354919580000001, 2024-09-10T06:27:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025033970000000001, 2024-09-10T06:27:30.700 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 951 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240311+0000", 2024-09-10T06:27:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8899999999999999e-06 2024-09-10T06:27:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240320+0000", 2024-09-10T06:27:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6799999999999999e-06 2024-09-10T06:27:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240341+0000", 2024-09-10T06:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1379e-05 2024-09-10T06:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240352+0000", 2024-09-10T06:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1354e-05 2024-09-10T06:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240450+0000", 2024-09-10T06:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7866000000000001e-05 2024-09-10T06:27:30.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240580+0000", 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012970899999999999 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240851+0000", 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027059099999999998 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242052+0000", 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001201014 2024-09-10T06:27:30.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242662+0000", 2024-09-10T06:27:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061076800000000003 2024-09-10T06:27:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242747+0000", 2024-09-10T06:27:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5019999999999996e-05 2024-09-10T06:27:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242812+0000", 2024-09-10T06:27:30.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5126e-05 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 48.344470160999997, 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027897120000000002, 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:30.706 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 955 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:30.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250761+0000", 2024-09-10T06:27:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250772+0000", 2024-09-10T06:27:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1153e-05 2024-09-10T06:27:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250802+0000", 2024-09-10T06:27:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-05 2024-09-10T06:27:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250817+0000", 2024-09-10T06:27:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4883e-05 2024-09-10T06:27:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250925+0000", 2024-09-10T06:27:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108249 2024-09-10T06:27:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251139+0000", 2024-09-10T06:27:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000213568 2024-09-10T06:27:30.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251450+0000", 2024-09-10T06:27:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031139200000000002 2024-09-10T06:27:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.252574+0000", 2024-09-10T06:27:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011239139999999999 2024-09-10T06:27:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253377+0000", 2024-09-10T06:27:30.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080306400000000003 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253466+0000", 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8436000000000005e-05 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253548+0000", 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2496000000000004e-05 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:30.711 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:30.712 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:30.713 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:27:30.713 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:30.709+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:30.814 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:30.813+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:30.916 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:30.917+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:30.924 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:30.924 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:30.924 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:30.925 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:30.942 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:27:31.029 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:31.029+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:31.118 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:31.117+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:31.154 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:31.154 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:31.154 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:31.154 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:31.154 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:31.173 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:27:31.219 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:31.217+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:31.320 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:31.321+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:31.384 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:31.385 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:31.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:31.385 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:31.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.385 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:31.385 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:31.385 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.058953211999999, 2024-09-10T06:27:31.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030326279999999999, 2024-09-10T06:27:31.385 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.385 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.385 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.386 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.386 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.386 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.386 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 58 2024-09-10T06:27:31.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.386 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:31.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:31.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:31.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-10T06:27:31.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324169+0000", 2024-09-10T06:27:31.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9020000000000004e-06 2024-09-10T06:27:31.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324182+0000", 2024-09-10T06:27:31.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2166e-05 2024-09-10T06:27:31.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324190+0000", 2024-09-10T06:27:31.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.337e-06 2024-09-10T06:27:31.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.388 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324282+0000", 2024-09-10T06:27:31.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2331999999999996e-05 2024-09-10T06:27:31.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324486+0000", 2024-09-10T06:27:31.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020347400000000001 2024-09-10T06:27:31.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:31.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324719+0000", 2024-09-10T06:27:31.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023289900000000001 2024-09-10T06:27:31.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.325993+0000", 2024-09-10T06:27:31.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012746929999999999 2024-09-10T06:27:31.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327088+0000", 2024-09-10T06:27:31.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010947330000000001 2024-09-10T06:27:31.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327147+0000", 2024-09-10T06:27:31.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8677000000000001e-05 2024-09-10T06:27:31.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.391 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327195+0000", 2024-09-10T06:27:31.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8469e-05 2024-09-10T06:27:31.391 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.391 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.391 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.391 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:31.391 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:31.391 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.077132630000001, 2024-09-10T06:27:31.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003846917, 2024-09-10T06:27:31.392 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.392 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.392 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.392 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.392 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 207 2024-09-10T06:27:31.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.392 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:31.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:31.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305987+0000", 2024-09-10T06:27:31.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6069999999999999e-06 2024-09-10T06:27:31.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306002+0000", 2024-09-10T06:27:31.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5406000000000001e-05 2024-09-10T06:27:31.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306036+0000", 2024-09-10T06:27:31.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4146000000000001e-05 2024-09-10T06:27:31.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306061+0000", 2024-09-10T06:27:31.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4470000000000001e-05 2024-09-10T06:27:31.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306325+0000", 2024-09-10T06:27:31.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026382800000000002 2024-09-10T06:27:31.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306569+0000", 2024-09-10T06:27:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024445499999999998 2024-09-10T06:27:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.307017+0000", 2024-09-10T06:27:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044774000000000002 2024-09-10T06:27:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.308517+0000", 2024-09-10T06:27:31.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001500075 2024-09-10T06:27:31.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309685+0000", 2024-09-10T06:27:31.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001168505 2024-09-10T06:27:31.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.397 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.397 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309767+0000", 2024-09-10T06:27:31.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1992999999999999e-05 2024-09-10T06:27:31.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309830+0000", 2024-09-10T06:27:31.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2692000000000002e-05 2024-09-10T06:27:31.398 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.398 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.398 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.398 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.398 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:31.398 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 50.032880581999997, 2024-09-10T06:27:31.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003433888, 2024-09-10T06:27:31.398 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.399 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.399 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.399 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.399 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.399 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.399 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 216 2024-09-10T06:27:31.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.399 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:31.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:31.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350239+0000", 2024-09-10T06:27:31.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.377e-06 2024-09-10T06:27:31.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350254+0000", 2024-09-10T06:27:31.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.501e-05 2024-09-10T06:27:31.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350288+0000", 2024-09-10T06:27:31.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4746000000000002e-05 2024-09-10T06:27:31.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350312+0000", 2024-09-10T06:27:31.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3249999999999999e-05 2024-09-10T06:27:31.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350456+0000", 2024-09-10T06:27:31.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014483899999999999 2024-09-10T06:27:31.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350704+0000", 2024-09-10T06:27:31.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024719100000000001 2024-09-10T06:27:31.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:31.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.351117+0000", 2024-09-10T06:27:31.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000412934 2024-09-10T06:27:31.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.352644+0000", 2024-09-10T06:27:31.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015271079999999999 2024-09-10T06:27:31.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353397+0000", 2024-09-10T06:27:31.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075311799999999999 2024-09-10T06:27:31.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353556+0000", 2024-09-10T06:27:31.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159612 2024-09-10T06:27:31.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353669+0000", 2024-09-10T06:27:31.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011270299999999999 2024-09-10T06:27:31.405 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.405 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.405 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.405 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.405 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:31.405 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.99420112, 2024-09-10T06:27:31.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033447479999999998, 2024-09-10T06:27:31.405 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.405 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.405 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.405 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.406 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.406 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.406 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 227 2024-09-10T06:27:31.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.406 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:31.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:31.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388917+0000", 2024-09-10T06:27:31.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6900000000000001e-06 2024-09-10T06:27:31.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388931+0000", 2024-09-10T06:27:31.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3900000000000001e-05 2024-09-10T06:27:31.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388964+0000", 2024-09-10T06:27:31.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2985999999999999e-05 2024-09-10T06:27:31.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388980+0000", 2024-09-10T06:27:31.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.535e-05 2024-09-10T06:27:31.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389123+0000", 2024-09-10T06:27:31.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014337900000000001 2024-09-10T06:27:31.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389341+0000", 2024-09-10T06:27:31.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021765099999999999 2024-09-10T06:27:31.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:31.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389765+0000", 2024-09-10T06:27:31.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042423100000000001 2024-09-10T06:27:31.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.391433+0000", 2024-09-10T06:27:31.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016681000000000001 2024-09-10T06:27:31.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392104+0000", 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067064800000000003 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392191+0000", 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7912999999999997e-05 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392259+0000", 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7899999999999997e-05 2024-09-10T06:27:31.411 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.412 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.412 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.412 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.412 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:31.412 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.986944346000001, 2024-09-10T06:27:31.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029995500000000001, 2024-09-10T06:27:31.412 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.412 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.412 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.412 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.413 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.413 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.413 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 229 2024-09-10T06:27:31.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.413 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:31.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:31.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396174+0000", 2024-09-10T06:27:31.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.774e-06 2024-09-10T06:27:31.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396186+0000", 2024-09-10T06:27:31.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2055999999999999e-05 2024-09-10T06:27:31.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396216+0000", 2024-09-10T06:27:31.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9640000000000001e-05 2024-09-10T06:27:31.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396231+0000", 2024-09-10T06:27:31.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:31.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396356+0000", 2024-09-10T06:27:31.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012504500000000001 2024-09-10T06:27:31.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396568+0000", 2024-09-10T06:27:31.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000211709 2024-09-10T06:27:31.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:31.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396954+0000", 2024-09-10T06:27:31.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386027 2024-09-10T06:27:31.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.398287+0000", 2024-09-10T06:27:31.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013331560000000001 2024-09-10T06:27:31.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399004+0000", 2024-09-10T06:27:31.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071720499999999995 2024-09-10T06:27:31.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399091+0000", 2024-09-10T06:27:31.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6714999999999999e-05 2024-09-10T06:27:31.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399171+0000", 2024-09-10T06:27:31.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9893000000000002e-05 2024-09-10T06:27:31.419 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.419 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.419 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.419 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.419 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:31.419 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.980385777000002, 2024-09-10T06:27:31.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030468270000000002, 2024-09-10T06:27:31.419 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.419 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.419 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.419 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.419 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.420 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.420 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 231 2024-09-10T06:27:31.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.420 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:31.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:31.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402732+0000", 2024-09-10T06:27:31.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-06 2024-09-10T06:27:31.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402744+0000", 2024-09-10T06:27:31.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1633e-05 2024-09-10T06:27:31.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402774+0000", 2024-09-10T06:27:31.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9666999999999999e-05 2024-09-10T06:27:31.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402789+0000", 2024-09-10T06:27:31.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5466000000000001e-05 2024-09-10T06:27:31.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402904+0000", 2024-09-10T06:27:31.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114466 2024-09-10T06:27:31.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403119+0000", 2024-09-10T06:27:31.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215572 2024-09-10T06:27:31.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:31.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403516+0000", 2024-09-10T06:27:31.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039663300000000002 2024-09-10T06:27:31.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405012+0000", 2024-09-10T06:27:31.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014961919999999999 2024-09-10T06:27:31.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405634+0000", 2024-09-10T06:27:31.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062145199999999999 2024-09-10T06:27:31.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405715+0000", 2024-09-10T06:27:31.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1619000000000006e-05 2024-09-10T06:27:31.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405777+0000", 2024-09-10T06:27:31.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1639999999999999e-05 2024-09-10T06:27:31.425 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.425 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.425 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.425 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:377 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.425 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:31.426 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.921630446000002, 2024-09-10T06:27:31.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058485480000000003, 2024-09-10T06:27:31.426 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.426 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.426 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.426 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.426 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.426 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.426 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 377 2024-09-10T06:27:31.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.426 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:31.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:31.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461486+0000", 2024-09-10T06:27:31.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0720000000000001e-06 2024-09-10T06:27:31.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461504+0000", 2024-09-10T06:27:31.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8002000000000001e-05 2024-09-10T06:27:31.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461519+0000", 2024-09-10T06:27:31.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4584e-05 2024-09-10T06:27:31.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461526+0000", 2024-09-10T06:27:31.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5560000000000004e-06 2024-09-10T06:27:31.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461597+0000", 2024-09-10T06:27:31.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1311999999999998e-05 2024-09-10T06:27:31.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461709+0000", 2024-09-10T06:27:31.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011191100000000001 2024-09-10T06:27:31.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:31.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461871+0000", 2024-09-10T06:27:31.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016254900000000001 2024-09-10T06:27:31.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.462777+0000", 2024-09-10T06:27:31.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00090547100000000003 2024-09-10T06:27:31.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467265+0000", 2024-09-10T06:27:31.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004488222 2024-09-10T06:27:31.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467308+0000", 2024-09-10T06:27:31.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2975000000000001e-05 2024-09-10T06:27:31.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467334+0000", 2024-09-10T06:27:31.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5894e-05 2024-09-10T06:27:31.432 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.432 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.432 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.432 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:384 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.432 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:31.432 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.919497591000003, 2024-09-10T06:27:31.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031588900000000001, 2024-09-10T06:27:31.432 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.433 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.433 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.433 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 384 2024-09-10T06:27:31.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.433 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:31.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:31.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463620+0000", 2024-09-10T06:27:31.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:31.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463625+0000", 2024-09-10T06:27:31.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6450000000000002e-06 2024-09-10T06:27:31.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463639+0000", 2024-09-10T06:27:31.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3540000000000001e-05 2024-09-10T06:27:31.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463648+0000", 2024-09-10T06:27:31.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0259999999999996e-06 2024-09-10T06:27:31.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463713+0000", 2024-09-10T06:27:31.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5438000000000006e-05 2024-09-10T06:27:31.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463774+0000", 2024-09-10T06:27:31.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0582999999999999e-05 2024-09-10T06:27:31.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:31.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463899+0000", 2024-09-10T06:27:31.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-10T06:27:31.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.464371+0000", 2024-09-10T06:27:31.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047201600000000002 2024-09-10T06:27:31.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466707+0000", 2024-09-10T06:27:31.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023354999999999999 2024-09-10T06:27:31.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466742+0000", 2024-09-10T06:27:31.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4686e-05 2024-09-10T06:27:31.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466777+0000", 2024-09-10T06:27:31.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5537000000000002e-05 2024-09-10T06:27:31.441 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.441 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.441 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.441 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:436 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.441 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:31.441 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.904250544, 2024-09-10T06:27:31.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040690570000000001, 2024-09-10T06:27:31.441 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.442 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.442 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.442 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.442 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 436 2024-09-10T06:27:31.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.442 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:31.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:31.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478866+0000", 2024-09-10T06:27:31.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1960000000000001e-06 2024-09-10T06:27:31.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478871+0000", 2024-09-10T06:27:31.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6879999999999998e-06 2024-09-10T06:27:31.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478883+0000", 2024-09-10T06:27:31.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1790999999999999e-05 2024-09-10T06:27:31.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478890+0000", 2024-09-10T06:27:31.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8569999999999997e-06 2024-09-10T06:27:31.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478958+0000", 2024-09-10T06:27:31.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7774999999999994e-05 2024-09-10T06:27:31.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479072+0000", 2024-09-10T06:27:31.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114577 2024-09-10T06:27:31.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:31.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479255+0000", 2024-09-10T06:27:31.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018297300000000001 2024-09-10T06:27:31.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482448+0000", 2024-09-10T06:27:31.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031933389999999999 2024-09-10T06:27:31.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482828+0000", 2024-09-10T06:27:31.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037961800000000002 2024-09-10T06:27:31.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482891+0000", 2024-09-10T06:27:31.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3316000000000002e-05 2024-09-10T06:27:31.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482934+0000", 2024-09-10T06:27:31.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2926999999999997e-05 2024-09-10T06:27:31.447 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.447 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.448 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.448 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:441 6.7 e34/28 6:e1cdb60d:reshard::reshard.0000000008:head v 34'7, mlcod=34'5)", 2024-09-10T06:27:31.448 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:31.448 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.900649626000003, 2024-09-10T06:27:31.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060368319999999998, 2024-09-10T06:27:31.448 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.448 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.448 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.448 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:31.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:31.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482467+0000", 2024-09-10T06:27:31.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8800000000000003e-07 2024-09-10T06:27:31.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482472+0000", 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8730000000000004e-06 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482481+0000", 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1980000000000001e-06 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482485+0000", 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.386e-06 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482541+0000", 2024-09-10T06:27:31.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5788000000000002e-05 2024-09-10T06:27:31.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482563+0000", 2024-09-10T06:27:31.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2303999999999999e-05 2024-09-10T06:27:31.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488465+0000", 2024-09-10T06:27:31.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059014810000000001 2024-09-10T06:27:31.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488503+0000", 2024-09-10T06:27:31.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8313999999999999e-05 2024-09-10T06:27:31.452 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.452 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.452 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.452 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:466 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.452 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:31.452 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.885490376, 2024-09-10T06:27:31.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039032810000000002, 2024-09-10T06:27:31.453 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.453 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.453 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.453 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.453 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 466 2024-09-10T06:27:31.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.453 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:31.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:31.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497626+0000", 2024-09-10T06:27:31.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9099999999999991e-07 2024-09-10T06:27:31.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497634+0000", 2024-09-10T06:27:31.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.994e-06 2024-09-10T06:27:31.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497644+0000", 2024-09-10T06:27:31.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6260000000000007e-06 2024-09-10T06:27:31.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497650+0000", 2024-09-10T06:27:31.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5160000000000002e-06 2024-09-10T06:27:31.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497718+0000", 2024-09-10T06:27:31.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8862999999999994e-05 2024-09-10T06:27:31.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497775+0000", 2024-09-10T06:27:31.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6156000000000002e-05 2024-09-10T06:27:31.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:31.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497903+0000", 2024-09-10T06:27:31.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012879800000000001 2024-09-10T06:27:31.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499630+0000", 2024-09-10T06:27:31.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017268139999999999 2024-09-10T06:27:31.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501439+0000", 2024-09-10T06:27:31.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018086669999999999 2024-09-10T06:27:31.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501478+0000", 2024-09-10T06:27:31.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9269e-05 2024-09-10T06:27:31.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501529+0000", 2024-09-10T06:27:31.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0587000000000002e-05 2024-09-10T06:27:31.461 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.461 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.461 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.461 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:469 6.0 e34/28 6:02683654:reshard::reshard.0000000010:head v 34'6, mlcod=34'4)", 2024-09-10T06:27:31.461 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:31.461 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.883487553000002, 2024-09-10T06:27:31.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048323109999999997, 2024-09-10T06:27:31.462 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.462 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.462 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.462 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:31.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:31.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499629+0000", 2024-09-10T06:27:31.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9199999999999999e-07 2024-09-10T06:27:31.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499634+0000", 2024-09-10T06:27:31.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2530000000000004e-06 2024-09-10T06:27:31.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499644+0000", 2024-09-10T06:27:31.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5820000000000008e-06 2024-09-10T06:27:31.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499650+0000", 2024-09-10T06:27:31.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7919999999999998e-06 2024-09-10T06:27:31.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499697+0000", 2024-09-10T06:27:31.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7564000000000001e-05 2024-09-10T06:27:31.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499719+0000", 2024-09-10T06:27:31.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1297999999999998e-05 2024-09-10T06:27:31.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504413+0000", 2024-09-10T06:27:31.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004694419 2024-09-10T06:27:31.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504461+0000", 2024-09-10T06:27:31.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7511e-05 2024-09-10T06:27:31.468 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.468 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.468 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.469 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:621 6.0 e34/28 6:0705c68b:::obj_delete_at_hint.0000000028:head v 34'11, mlcod=34'9)", 2024-09-10T06:27:31.469 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:31.469 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.778286408, 2024-09-10T06:27:31.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003196562, 2024-09-10T06:27:31.469 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.469 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.469 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.469 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:31.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:31.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604831+0000", 2024-09-10T06:27:31.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.823e-06 2024-09-10T06:27:31.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604843+0000", 2024-09-10T06:27:31.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1437000000000001e-05 2024-09-10T06:27:31.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604868+0000", 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5837e-05 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604885+0000", 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6759999999999999e-05 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604971+0000", 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5512000000000004e-05 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604991+0000", 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0197999999999999e-05 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.607960+0000", 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002969307 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608026+0000", 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5687999999999999e-05 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.474 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:636 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.474 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:31.474 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.769376754, 2024-09-10T06:27:31.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048306950000000003, 2024-09-10T06:27:31.474 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.474 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.474 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.474 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.474 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.474 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.474 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 636 2024-09-10T06:27:31.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.474 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613740+0000", 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:31.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613747+0000", 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8090000000000004e-06 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613762+0000", 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5037e-05 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613772+0000", 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7510000000000003e-06 2024-09-10T06:27:31.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613834+0000", 2024-09-10T06:27:31.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2458000000000004e-05 2024-09-10T06:27:31.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613916+0000", 2024-09-10T06:27:31.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1630000000000003e-05 2024-09-10T06:27:31.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:31.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.614071+0000", 2024-09-10T06:27:31.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015480800000000001 2024-09-10T06:27:31.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.615885+0000", 2024-09-10T06:27:31.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001814607 2024-09-10T06:27:31.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618438+0000", 2024-09-10T06:27:31.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025529459999999999 2024-09-10T06:27:31.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618503+0000", 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4851000000000006e-05 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618570+0000", 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6418e-05 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:646 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.479 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:31.480 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.759914964000004, 2024-09-10T06:27:31.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049103549999999999, 2024-09-10T06:27:31.480 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.480 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.480 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.480 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 646 2024-09-10T06:27:31.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.480 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:31.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:31.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623202+0000", 2024-09-10T06:27:31.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9800000000000002e-07 2024-09-10T06:27:31.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623206+0000", 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6380000000000003e-06 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623216+0000", 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4439999999999997e-06 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623221+0000", 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6400000000000002e-06 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623300+0000", 2024-09-10T06:27:31.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8677999999999994e-05 2024-09-10T06:27:31.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623410+0000", 2024-09-10T06:27:31.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010954399999999999 2024-09-10T06:27:31.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:31.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623629+0000", 2024-09-10T06:27:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000219836 2024-09-10T06:27:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.625072+0000", 2024-09-10T06:27:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014427929999999999 2024-09-10T06:27:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.627982+0000", 2024-09-10T06:27:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029097620000000002 2024-09-10T06:27:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628058+0000", 2024-09-10T06:27:31.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6390999999999994e-05 2024-09-10T06:27:31.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628111+0000", 2024-09-10T06:27:31.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2731e-05 2024-09-10T06:27:31.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.485 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.486 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.486 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:31.486 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.697240692000001, 2024-09-10T06:27:31.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033783509999999999, 2024-09-10T06:27:31.486 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.486 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.486 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.486 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 703 2024-09-10T06:27:31.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.487 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:31.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:31.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685878+0000", 2024-09-10T06:27:31.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5900000000000002e-06 2024-09-10T06:27:31.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685889+0000", 2024-09-10T06:27:31.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:31.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685919+0000", 2024-09-10T06:27:31.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0307e-05 2024-09-10T06:27:31.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685935+0000", 2024-09-10T06:27:31.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5336e-05 2024-09-10T06:27:31.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686092+0000", 2024-09-10T06:27:31.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015776200000000001 2024-09-10T06:27:31.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686462+0000", 2024-09-10T06:27:31.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036925700000000001 2024-09-10T06:27:31.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:31.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.687048+0000", 2024-09-10T06:27:31.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000586266 2024-09-10T06:27:31.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688261+0000", 2024-09-10T06:27:31.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012132670000000001 2024-09-10T06:27:31.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688974+0000", 2024-09-10T06:27:31.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071248800000000005 2024-09-10T06:27:31.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689129+0000", 2024-09-10T06:27:31.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155499 2024-09-10T06:27:31.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689253+0000", 2024-09-10T06:27:31.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124289 2024-09-10T06:27:31.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.491 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.492 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.492 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:31.492 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.338675189, 2024-09-10T06:27:31.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032750980000000002, 2024-09-10T06:27:31.492 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.492 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.492 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.492 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 865 2024-09-10T06:27:31.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.493 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:31.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:31.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044443+0000", 2024-09-10T06:27:31.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6929999999999999e-06 2024-09-10T06:27:31.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044456+0000", 2024-09-10T06:27:31.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.224e-05 2024-09-10T06:27:31.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044486+0000", 2024-09-10T06:27:31.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.095e-05 2024-09-10T06:27:31.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044501+0000", 2024-09-10T06:27:31.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4932999999999999e-05 2024-09-10T06:27:31.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044646+0000", 2024-09-10T06:27:31.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014465600000000001 2024-09-10T06:27:31.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045001+0000", 2024-09-10T06:27:31.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035473999999999998 2024-09-10T06:27:31.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:31.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045549+0000", 2024-09-10T06:27:31.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054870299999999999 2024-09-10T06:27:31.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.046956+0000", 2024-09-10T06:27:31.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014061189999999999 2024-09-10T06:27:31.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047452+0000", 2024-09-10T06:27:31.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049682199999999995 2024-09-10T06:27:31.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047606+0000", 2024-09-10T06:27:31.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015379599999999999 2024-09-10T06:27:31.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047716+0000", 2024-09-10T06:27:31.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109446 2024-09-10T06:27:31.500 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.500 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.500 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.500 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.500 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:31.501 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.334212037, 2024-09-10T06:27:31.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030837989999999999, 2024-09-10T06:27:31.501 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.501 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.501 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.501 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 867 2024-09-10T06:27:31.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.501 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048906+0000", 2024-09-10T06:27:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1770000000000001e-06 2024-09-10T06:27:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048916+0000", 2024-09-10T06:27:31.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.025e-05 2024-09-10T06:27:31.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048948+0000", 2024-09-10T06:27:31.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1859000000000001e-05 2024-09-10T06:27:31.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048968+0000", 2024-09-10T06:27:31.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9647e-05 2024-09-10T06:27:31.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049090+0000", 2024-09-10T06:27:31.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122645 2024-09-10T06:27:31.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049314+0000", 2024-09-10T06:27:31.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022372900000000001 2024-09-10T06:27:31.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:31.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049785+0000", 2024-09-10T06:27:31.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047121899999999999 2024-09-10T06:27:31.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.050979+0000", 2024-09-10T06:27:31.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001193408 2024-09-10T06:27:31.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051729+0000", 2024-09-10T06:27:31.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075039699999999998 2024-09-10T06:27:31.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051874+0000", 2024-09-10T06:27:31.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000145253 2024-09-10T06:27:31.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051988+0000", 2024-09-10T06:27:31.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011321500000000001 2024-09-10T06:27:31.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.506 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.265344855999999, 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035511029999999999, 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 898 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117772+0000", 2024-09-10T06:27:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5340000000000001e-06 2024-09-10T06:27:31.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117781+0000", 2024-09-10T06:27:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.276e-06 2024-09-10T06:27:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117804+0000", 2024-09-10T06:27:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3093999999999999e-05 2024-09-10T06:27:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117816+0000", 2024-09-10T06:27:31.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1986e-05 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117954+0000", 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013856900000000001 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118327+0000", 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000372841 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118919+0000", 2024-09-10T06:27:31.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059172800000000002 2024-09-10T06:27:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.120253+0000", 2024-09-10T06:27:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001333643 2024-09-10T06:27:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121060+0000", 2024-09-10T06:27:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080731100000000001 2024-09-10T06:27:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121210+0000", 2024-09-10T06:27:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014980500000000001 2024-09-10T06:27:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121322+0000", 2024-09-10T06:27:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112316 2024-09-10T06:27:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.512 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:31.513 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 49.176075044000001, 2024-09-10T06:27:31.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051838630000000004, 2024-09-10T06:27:31.513 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:31.513 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:31.513 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:31.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:31.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.513 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 937 2024-09-10T06:27:31.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.513 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:31.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:31.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:31.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:31.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:31.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:31.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:31.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207042+0000", 2024-09-10T06:27:31.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7439999999999999e-06 2024-09-10T06:27:31.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:31.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207051+0000", 2024-09-10T06:27:31.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7299999999999994e-06 2024-09-10T06:27:31.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:31.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207072+0000", 2024-09-10T06:27:31.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1209e-05 2024-09-10T06:27:31.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207089+0000", 2024-09-10T06:27:31.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6297e-05 2024-09-10T06:27:31.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:31.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207231+0000", 2024-09-10T06:27:31.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014233200000000001 2024-09-10T06:27:31.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:31.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207463+0000", 2024-09-10T06:27:31.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023155199999999999 2024-09-10T06:27:31.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:31.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207797+0000", 2024-09-10T06:27:31.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033413699999999998 2024-09-10T06:27:31.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:31.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.209053+0000", 2024-09-10T06:27:31.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012560029999999999 2024-09-10T06:27:31.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212076+0000", 2024-09-10T06:27:31.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030234239999999998 2024-09-10T06:27:31.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:31.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212162+0000", 2024-09-10T06:27:31.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5506000000000004e-05 2024-09-10T06:27:31.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:31.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:31.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:31.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212225+0000", 2024-09-10T06:27:31.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2928999999999993e-05 2024-09-10T06:27:31.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.519 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.519 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:31.519 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:31.519 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:31.520 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:27:31.521 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:31.517+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:31.621 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:31.617+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:31.622 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T06:27:31.652 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:31.652 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:31.652 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:31.667 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:27:31.722 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:31.721+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:31.789 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:31.789 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:31.789 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:31.803 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:27:31.848 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:31.849+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:31.924 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:31.921+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:31.925 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:31.925 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-10T06:27:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.632382833999998, 2024-09-10T06:27:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047108059999999997, 2024-09-10T06:27:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291391+0000", 2024-09-10T06:27:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8700000000000001e-06 2024-09-10T06:27:31.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291405+0000", 2024-09-10T06:27:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4623e-05 2024-09-10T06:27:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291438+0000", 2024-09-10T06:27:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2616000000000001e-05 2024-09-10T06:27:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291461+0000", 2024-09-10T06:27:31.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2883000000000001e-05 2024-09-10T06:27:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293024+0000", 2024-09-10T06:27:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015627709999999999 2024-09-10T06:27:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293071+0000", 2024-09-10T06:27:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7797000000000003e-05 2024-09-10T06:27:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295983+0000", 2024-09-10T06:27:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029113640000000001 2024-09-10T06:27:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296100+0000", 2024-09-10T06:27:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116882 2024-09-10T06:27:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.930 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.591025055999999, 2024-09-10T06:27:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00338296, 2024-09-10T06:27:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 211 2024-09-10T06:27:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:31.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332750+0000", 2024-09-10T06:27:31.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-10T06:27:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332767+0000", 2024-09-10T06:27:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.702e-05 2024-09-10T06:27:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332805+0000", 2024-09-10T06:27:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7950000000000001e-05 2024-09-10T06:27:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332824+0000", 2024-09-10T06:27:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8462999999999999e-05 2024-09-10T06:27:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332950+0000", 2024-09-10T06:27:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012653600000000001 2024-09-10T06:27:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333177+0000", 2024-09-10T06:27:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022626800000000001 2024-09-10T06:27:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333604+0000", 2024-09-10T06:27:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042759999999999999 2024-09-10T06:27:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335279+0000", 2024-09-10T06:27:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001674481 2024-09-10T06:27:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335976+0000", 2024-09-10T06:27:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069707099999999995 2024-09-10T06:27:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336063+0000", 2024-09-10T06:27:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6916000000000006e-05 2024-09-10T06:27:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336130+0000", 2024-09-10T06:27:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6971999999999995e-05 2024-09-10T06:27:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:31.936 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.517750180999997, 2024-09-10T06:27:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034123389999999999, 2024-09-10T06:27:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:31.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232 2024-09-10T06:27:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406025+0000", 2024-09-10T06:27:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-10T06:27:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406040+0000", 2024-09-10T06:27:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5299999999999999e-05 2024-09-10T06:27:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406072+0000", 2024-09-10T06:27:31.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2543000000000003e-05 2024-09-10T06:27:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406088+0000", 2024-09-10T06:27:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5699999999999999e-05 2024-09-10T06:27:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406206+0000", 2024-09-10T06:27:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011828900000000001 2024-09-10T06:27:31.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406416+0000", 2024-09-10T06:27:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020969900000000001 2024-09-10T06:27:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406804+0000", 2024-09-10T06:27:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038783699999999998 2024-09-10T06:27:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.408490+0000", 2024-09-10T06:27:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001686353 2024-09-10T06:27:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409152+0000", 2024-09-10T06:27:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066160800000000005 2024-09-10T06:27:31.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409314+0000", 2024-09-10T06:27:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000162285 2024-09-10T06:27:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409434+0000", 2024-09-10T06:27:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119639 2024-09-10T06:27:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.497820736000001, 2024-09-10T06:27:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034077650000000001, 2024-09-10T06:27:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241 2024-09-10T06:27:31.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425954+0000", 2024-09-10T06:27:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425965+0000", 2024-09-10T06:27:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.181e-05 2024-09-10T06:27:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425996+0000", 2024-09-10T06:27:31.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0759000000000001e-05 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426011+0000", 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4507e-05 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426153+0000", 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014206599999999999 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426491+0000", 2024-09-10T06:27:31.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033830399999999999 2024-09-10T06:27:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426973+0000", 2024-09-10T06:27:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000482113 2024-09-10T06:27:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.428378+0000", 2024-09-10T06:27:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001404539 2024-09-10T06:27:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429113+0000", 2024-09-10T06:27:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073537799999999996 2024-09-10T06:27:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429251+0000", 2024-09-10T06:27:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013789600000000001 2024-09-10T06:27:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429359+0000", 2024-09-10T06:27:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107846 2024-09-10T06:27:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:31.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:266 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.493087711999998, 2024-09-10T06:27:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030966560000000001, 2024-09-10T06:27:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 266 2024-09-10T06:27:31.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:31.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430687+0000", 2024-09-10T06:27:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0299999999999998e-06 2024-09-10T06:27:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430702+0000", 2024-09-10T06:27:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5316999999999999e-05 2024-09-10T06:27:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430741+0000", 2024-09-10T06:27:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8336e-05 2024-09-10T06:27:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430762+0000", 2024-09-10T06:27:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.162e-05 2024-09-10T06:27:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430923+0000", 2024-09-10T06:27:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016044599999999999 2024-09-10T06:27:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431103+0000", 2024-09-10T06:27:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018030100000000001 2024-09-10T06:27:31.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431513+0000", 2024-09-10T06:27:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040992999999999997 2024-09-10T06:27:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432715+0000", 2024-09-10T06:27:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001202411 2024-09-10T06:27:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433624+0000", 2024-09-10T06:27:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090863000000000001 2024-09-10T06:27:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433718+0000", 2024-09-10T06:27:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3749e-05 2024-09-10T06:27:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433781+0000", 2024-09-10T06:27:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2885999999999994e-05 2024-09-10T06:27:31.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:273 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.491514111000001, 2024-09-10T06:27:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028009850000000002, 2024-09-10T06:27:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 273 2024-09-10T06:27:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432260+0000", 2024-09-10T06:27:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1900000000000002e-06 2024-09-10T06:27:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432271+0000", 2024-09-10T06:27:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1353e-05 2024-09-10T06:27:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432296+0000", 2024-09-10T06:27:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4817e-05 2024-09-10T06:27:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432318+0000", 2024-09-10T06:27:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1963e-05 2024-09-10T06:27:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432465+0000", 2024-09-10T06:27:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014658299999999999 2024-09-10T06:27:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432801+0000", 2024-09-10T06:27:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033681299999999999 2024-09-10T06:27:31.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433188+0000", 2024-09-10T06:27:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000386857 2024-09-10T06:27:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434552+0000", 2024-09-10T06:27:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013634400000000001 2024-09-10T06:27:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434872+0000", 2024-09-10T06:27:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031998399999999999 2024-09-10T06:27:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434973+0000", 2024-09-10T06:27:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100962 2024-09-10T06:27:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.435059+0000", 2024-09-10T06:27:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6023e-05 2024-09-10T06:27:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:31.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:299 6.14 e34/28 6:2c0c0c23:reshard::reshard.0000000001:head v 34'2, mlcod=0'0)", 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.486898259999997, 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029099109999999998, 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436875+0000", 2024-09-10T06:27:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0430000000000002e-06 2024-09-10T06:27:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436890+0000", 2024-09-10T06:27:31.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4766999999999999e-05 2024-09-10T06:27:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436918+0000", 2024-09-10T06:27:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.76e-05 2024-09-10T06:27:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436937+0000", 2024-09-10T06:27:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9539999999999999e-05 2024-09-10T06:27:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437081+0000", 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144065 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437130+0000", 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8609999999999997e-05 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439676+0000", 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002546137 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439783+0000", 2024-09-10T06:27:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107149 2024-09-10T06:27:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:341 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:31.967 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.477978565000001, 2024-09-10T06:27:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030260230000000001, 2024-09-10T06:27:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 341 2024-09-10T06:27:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:31.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445796+0000", 2024-09-10T06:27:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7130000000000001e-06 2024-09-10T06:27:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445810+0000", 2024-09-10T06:27:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4564e-05 2024-09-10T06:27:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445886+0000", 2024-09-10T06:27:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5921999999999996e-05 2024-09-10T06:27:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445902+0000", 2024-09-10T06:27:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5800000000000001e-05 2024-09-10T06:27:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446057+0000", 2024-09-10T06:27:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015475600000000001 2024-09-10T06:27:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446347+0000", 2024-09-10T06:27:31.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029057699999999998 2024-09-10T06:27:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446669+0000", 2024-09-10T06:27:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032102399999999999 2024-09-10T06:27:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.447891+0000", 2024-09-10T06:27:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012226680000000001 2024-09-10T06:27:31.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448550+0000", 2024-09-10T06:27:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065925800000000002 2024-09-10T06:27:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448699+0000", 2024-09-10T06:27:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014831800000000001 2024-09-10T06:27:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448819+0000", 2024-09-10T06:27:31.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120423 2024-09-10T06:27:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:505 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.396300035000003, 2024-09-10T06:27:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028092249999999998, 2024-09-10T06:27:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:31.974 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 505 2024-09-10T06:27:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:31.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527474+0000", 2024-09-10T06:27:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-10T06:27:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:31.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527495+0000", 2024-09-10T06:27:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0910000000000001e-05 2024-09-10T06:27:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527549+0000", 2024-09-10T06:27:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3223000000000002e-05 2024-09-10T06:27:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527583+0000", 2024-09-10T06:27:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4773000000000001e-05 2024-09-10T06:27:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527737+0000", 2024-09-10T06:27:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325199999999999 2024-09-10T06:27:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528092+0000", 2024-09-10T06:27:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000354951 2024-09-10T06:27:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528657+0000", 2024-09-10T06:27:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00056537500000000001 2024-09-10T06:27:31.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.529771+0000", 2024-09-10T06:27:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011136519999999999 2024-09-10T06:27:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530072+0000", 2024-09-10T06:27:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030151700000000001 2024-09-10T06:27:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530213+0000", 2024-09-10T06:27:31.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014100500000000001 2024-09-10T06:27:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530281+0000", 2024-09-10T06:27:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7793999999999995e-05 2024-09-10T06:27:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.392630758000003, 2024-09-10T06:27:31.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051813969999999999, 2024-09-10T06:27:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 513 2024-09-10T06:27:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:31.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531143+0000", 2024-09-10T06:27:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7400000000000001e-06 2024-09-10T06:27:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:31.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531153+0000", 2024-09-10T06:27:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.815e-06 2024-09-10T06:27:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531178+0000", 2024-09-10T06:27:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5755e-05 2024-09-10T06:27:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531190+0000", 2024-09-10T06:27:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1250000000000001e-05 2024-09-10T06:27:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531322+0000", 2024-09-10T06:27:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013239299999999999 2024-09-10T06:27:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531550+0000", 2024-09-10T06:27:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000227598 2024-09-10T06:27:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531966+0000", 2024-09-10T06:27:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041634400000000002 2024-09-10T06:27:31.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533197+0000", 2024-09-10T06:27:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012308810000000001 2024-09-10T06:27:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536097+0000", 2024-09-10T06:27:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029007159999999998 2024-09-10T06:27:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:31.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536245+0000", 2024-09-10T06:27:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000147816 2024-09-10T06:27:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536322+0000", 2024-09-10T06:27:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7088999999999993e-05 2024-09-10T06:27:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.986 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:514 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.392558561000001, 2024-09-10T06:27:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048258260000000001, 2024-09-10T06:27:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 514 2024-09-10T06:27:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:31.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531214+0000", 2024-09-10T06:27:31.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2699999999999998e-07 2024-09-10T06:27:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531219+0000", 2024-09-10T06:27:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-10T06:27:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531233+0000", 2024-09-10T06:27:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.38e-05 2024-09-10T06:27:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531240+0000", 2024-09-10T06:27:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7399999999999998e-06 2024-09-10T06:27:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531378+0000", 2024-09-10T06:27:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013860399999999999 2024-09-10T06:27:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531600+0000", 2024-09-10T06:27:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221287 2024-09-10T06:27:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532007+0000", 2024-09-10T06:27:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040728500000000001 2024-09-10T06:27:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533131+0000", 2024-09-10T06:27:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011240429999999999 2024-09-10T06:27:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535894+0000", 2024-09-10T06:27:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027628650000000002 2024-09-10T06:27:31.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535973+0000", 2024-09-10T06:27:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9399000000000003e-05 2024-09-10T06:27:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536039+0000", 2024-09-10T06:27:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5619999999999999e-05 2024-09-10T06:27:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:655 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.292616023000001, 2024-09-10T06:27:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003017207, 2024-09-10T06:27:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 655 2024-09-10T06:27:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.993 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631159+0000", 2024-09-10T06:27:31.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8270000000000002e-06 2024-09-10T06:27:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631173+0000", 2024-09-10T06:27:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4739999999999999e-05 2024-09-10T06:27:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631206+0000", 2024-09-10T06:27:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2425999999999998e-05 2024-09-10T06:27:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:31.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631221+0000", 2024-09-10T06:27:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4927e-05 2024-09-10T06:27:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631336+0000", 2024-09-10T06:27:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115062 2024-09-10T06:27:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631547+0000", 2024-09-10T06:27:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021178200000000001 2024-09-10T06:27:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.632034+0000", 2024-09-10T06:27:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000486899 2024-09-10T06:27:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633413+0000", 2024-09-10T06:27:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001379077 2024-09-10T06:27:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633891+0000", 2024-09-10T06:27:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000477489 2024-09-10T06:27:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634057+0000", 2024-09-10T06:27:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016608500000000001 2024-09-10T06:27:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634173+0000", 2024-09-10T06:27:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115893 2024-09-10T06:27:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:31.998 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:658 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.288601778999997, 2024-09-10T06:27:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030550820000000002, 2024-09-10T06:27:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 658 2024-09-10T06:27:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:31.999 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635171+0000", 2024-09-10T06:27:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.322e-06 2024-09-10T06:27:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635178+0000", 2024-09-10T06:27:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7950000000000002e-06 2024-09-10T06:27:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635197+0000", 2024-09-10T06:27:32.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8845e-05 2024-09-10T06:27:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635215+0000", 2024-09-10T06:27:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7822e-05 2024-09-10T06:27:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635329+0000", 2024-09-10T06:27:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011433 2024-09-10T06:27:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:32.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635554+0000", 2024-09-10T06:27:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022527800000000001 2024-09-10T06:27:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.636007+0000", 2024-09-10T06:27:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045297099999999998 2024-09-10T06:27:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637198+0000", 2024-09-10T06:27:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011902740000000001 2024-09-10T06:27:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637961+0000", 2024-09-10T06:27:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000763234 2024-09-10T06:27:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638110+0000", 2024-09-10T06:27:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149259 2024-09-10T06:27:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638225+0000", 2024-09-10T06:27:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011495200000000001 2024-09-10T06:27:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.192269836999998, 2024-09-10T06:27:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028070980000000001, 2024-09-10T06:27:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:32.006 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 724 2024-09-10T06:27:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731504+0000", 2024-09-10T06:27:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731516+0000", 2024-09-10T06:27:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1885999999999999e-05 2024-09-10T06:27:32.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731547+0000", 2024-09-10T06:27:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0923000000000002e-05 2024-09-10T06:27:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:32.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731563+0000", 2024-09-10T06:27:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5342999999999999e-05 2024-09-10T06:27:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731704+0000", 2024-09-10T06:27:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014128599999999999 2024-09-10T06:27:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731917+0000", 2024-09-10T06:27:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021280800000000001 2024-09-10T06:27:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.732227+0000", 2024-09-10T06:27:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031024500000000001 2024-09-10T06:27:32.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.733258+0000", 2024-09-10T06:27:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010306880000000001 2024-09-10T06:27:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:32.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734163+0000", 2024-09-10T06:27:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090502400000000004 2024-09-10T06:27:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734247+0000", 2024-09-10T06:27:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4363000000000005e-05 2024-09-10T06:27:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734309+0000", 2024-09-10T06:27:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2005e-05 2024-09-10T06:27:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.185423702999998, 2024-09-10T06:27:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030399789999999999, 2024-09-10T06:27:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:32.016 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 727 2024-09-10T06:27:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:32.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:32.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738350+0000", 2024-09-10T06:27:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2199999999999999e-06 2024-09-10T06:27:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738360+0000", 2024-09-10T06:27:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0122999999999999e-05 2024-09-10T06:27:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738384+0000", 2024-09-10T06:27:32.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3390000000000001e-05 2024-09-10T06:27:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738397+0000", 2024-09-10T06:27:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2896e-05 2024-09-10T06:27:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738524+0000", 2024-09-10T06:27:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126883 2024-09-10T06:27:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738752+0000", 2024-09-10T06:27:32.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022864200000000001 2024-09-10T06:27:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.739080+0000", 2024-09-10T06:27:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032783699999999999 2024-09-10T06:27:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.740085+0000", 2024-09-10T06:27:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001005438 2024-09-10T06:27:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741203+0000", 2024-09-10T06:27:32.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011175919999999999 2024-09-10T06:27:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741280+0000", 2024-09-10T06:27:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6545999999999995e-05 2024-09-10T06:27:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741388+0000", 2024-09-10T06:27:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108412 2024-09-10T06:27:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.993401198000001, 2024-09-10T06:27:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028715709999999998, 2024-09-10T06:27:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:32.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:32.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:32.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:32.030 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 814 2024-09-10T06:27:32.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.030 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:32.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:32.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:32.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:32.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:32.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930373+0000", 2024-09-10T06:27:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-10T06:27:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930384+0000", 2024-09-10T06:27:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1357e-05 2024-09-10T06:27:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930417+0000", 2024-09-10T06:27:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2289000000000002e-05 2024-09-10T06:27:32.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930438+0000", 2024-09-10T06:27:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1399999999999998e-05 2024-09-10T06:27:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930626+0000", 2024-09-10T06:27:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018812899999999999 2024-09-10T06:27:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930843+0000", 2024-09-10T06:27:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021719400000000001 2024-09-10T06:27:32.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.931152+0000", 2024-09-10T06:27:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030821199999999998 2024-09-10T06:27:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.932258+0000", 2024-09-10T06:27:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001106304 2024-09-10T06:27:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933092+0000", 2024-09-10T06:27:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00083364699999999997 2024-09-10T06:27:32.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933179+0000", 2024-09-10T06:27:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7383e-05 2024-09-10T06:27:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933242+0000", 2024-09-10T06:27:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3072999999999997e-05 2024-09-10T06:27:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.845849717, 2024-09-10T06:27:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029601670000000001, 2024-09-10T06:27:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:32.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 880 2024-09-10T06:27:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.041 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077925+0000", 2024-09-10T06:27:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-10T06:27:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:32.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077938+0000", 2024-09-10T06:27:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2836999999999999e-05 2024-09-10T06:27:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077970+0000", 2024-09-10T06:27:32.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1542999999999999e-05 2024-09-10T06:27:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077984+0000", 2024-09-10T06:27:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4963999999999999e-05 2024-09-10T06:27:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078118+0000", 2024-09-10T06:27:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134015 2024-09-10T06:27:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078344+0000", 2024-09-10T06:27:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225038 2024-09-10T06:27:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078696+0000", 2024-09-10T06:27:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035250100000000002 2024-09-10T06:27:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.079793+0000", 2024-09-10T06:27:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010967049999999999 2024-09-10T06:27:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080714+0000", 2024-09-10T06:27:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00092153600000000003 2024-09-10T06:27:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080802+0000", 2024-09-10T06:27:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7446000000000003e-05 2024-09-10T06:27:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080882+0000", 2024-09-10T06:27:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0445999999999995e-05 2024-09-10T06:27:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.771229490000003, 2024-09-10T06:27:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002919091, 2024-09-10T06:27:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 913 2024-09-10T06:27:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152545+0000", 2024-09-10T06:27:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6529999999999998e-06 2024-09-10T06:27:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152557+0000", 2024-09-10T06:27:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919999999999999e-05 2024-09-10T06:27:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152587+0000", 2024-09-10T06:27:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0097e-05 2024-09-10T06:27:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152601+0000", 2024-09-10T06:27:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4579999999999999e-05 2024-09-10T06:27:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152732+0000", 2024-09-10T06:27:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013085500000000001 2024-09-10T06:27:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153007+0000", 2024-09-10T06:27:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027469499999999998 2024-09-10T06:27:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153344+0000", 2024-09-10T06:27:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033742400000000001 2024-09-10T06:27:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.154351+0000", 2024-09-10T06:27:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010067590000000001 2024-09-10T06:27:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155301+0000", 2024-09-10T06:27:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095000900000000003 2024-09-10T06:27:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155387+0000", 2024-09-10T06:27:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6136000000000003e-05 2024-09-10T06:27:32.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155461+0000", 2024-09-10T06:27:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3962999999999996e-05 2024-09-10T06:27:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.063 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.739582808000002, 2024-09-10T06:27:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029321239999999999, 2024-09-10T06:27:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 927 2024-09-10T06:27:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184191+0000", 2024-09-10T06:27:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.764e-06 2024-09-10T06:27:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184199+0000", 2024-09-10T06:27:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4630000000000001e-06 2024-09-10T06:27:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184221+0000", 2024-09-10T06:27:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1603e-05 2024-09-10T06:27:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184233+0000", 2024-09-10T06:27:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.189e-05 2024-09-10T06:27:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184382+0000", 2024-09-10T06:27:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014939900000000001 2024-09-10T06:27:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184495+0000", 2024-09-10T06:27:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113459 2024-09-10T06:27:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184735+0000", 2024-09-10T06:27:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000239554 2024-09-10T06:27:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186036+0000", 2024-09-10T06:27:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00130072 2024-09-10T06:27:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186929+0000", 2024-09-10T06:27:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000893694 2024-09-10T06:27:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187014+0000", 2024-09-10T06:27:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4222999999999996e-05 2024-09-10T06:27:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187121+0000", 2024-09-10T06:27:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107355 2024-09-10T06:27:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.736321943, 2024-09-10T06:27:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028243320000000001, 2024-09-10T06:27:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 928 2024-09-10T06:27:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187452+0000", 2024-09-10T06:27:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5069999999999999e-06 2024-09-10T06:27:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187464+0000", 2024-09-10T06:27:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1243000000000001e-05 2024-09-10T06:27:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187495+0000", 2024-09-10T06:27:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1136000000000001e-05 2024-09-10T06:27:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187511+0000", 2024-09-10T06:27:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6710000000000001e-05 2024-09-10T06:27:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187648+0000", 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013657599999999999 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187866+0000", 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021853500000000001 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.188168+0000", 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030161100000000002 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.189334+0000", 2024-09-10T06:27:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001166048 2024-09-10T06:27:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190086+0000", 2024-09-10T06:27:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075159399999999996 2024-09-10T06:27:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190165+0000", 2024-09-10T06:27:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8953000000000001e-05 2024-09-10T06:27:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190274+0000", 2024-09-10T06:27:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109419 2024-09-10T06:27:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:32.082 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:32.082 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:27:32.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:27:32.084 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:32.085+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:32.185 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:32.181+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:32.258 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:32.258 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:32.258 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:32.272 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:27:32.284 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:32.284 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:32.285 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:32.285+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:32.316 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:32.316 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:32.346 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:32.346 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:32.376 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:32.377 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:32.386 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:32.385+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:32.392 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:32.392 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:32.392 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:32.407 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:27:32.409 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:32.409 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:32.439 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:32.439 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:32.472 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:32.472 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:32.492 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:32.493+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:32.502 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:32.502 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:32.573 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:32.573 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:32.587 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:27:32.588 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:32.589+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:32.600 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-10T06:27:32.688 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:32.689+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:32.761 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:32.761 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:32.775 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:27:32.816 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:32.817+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:32.890 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:32.889+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:32.937 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:32.937 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:32.951 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:27:32.991 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:32.989+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:33.092 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:33.089+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:33.124 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:33.124 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:33.139 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:27:33.193 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:33.193+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:33.265 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:33.265 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:33.279 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:27:33.324 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:33.325+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:33.395 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:33.397+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:33.400 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:33.400 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:33.415 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:27:33.496 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:33.493+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:33.580 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:33.581 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:33.595 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:27:33.596 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:33.593+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:33.697 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:33.697+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:33.764 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:33.764 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:33.784 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:27:33.798 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:33.797+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:33.899 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:33.897+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:33.951 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:33.951 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:33.970 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:27:34.021 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:34.021+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:34.100 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:34.097+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:34.139 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:34.139 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:34.159 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:27:34.201 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:34.201+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:34.302 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:34.301+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:34.371 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:34.371 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:34.390 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:27:34.404 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:34.405+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:34.505 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:34.501+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:34.525 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:27:34.603 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:34.603 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:34.605 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:34.605+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:34.624 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:27:34.631 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T06:27:34.709 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:34.709+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:34.718 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:34.718 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:34.735 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:34.735 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:34.769 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:34.769 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:34.799 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:34.800 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:34.807 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:34.805+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:34.824 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:34.824 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:34.854 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:34.854 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:34.856 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.578630263999997, 2024-09-10T06:27:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069538480000000003, 2024-09-10T06:27:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.856 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-10T06:27:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2 2024-09-10T06:27:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:34.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275742+0000", 2024-09-10T06:27:34.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7460000000000001e-06 2024-09-10T06:27:34.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275751+0000", 2024-09-10T06:27:34.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3979999999999999e-06 2024-09-10T06:27:34.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275769+0000", 2024-09-10T06:27:34.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8637000000000001e-05 2024-09-10T06:27:34.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275784+0000", 2024-09-10T06:27:34.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4518000000000001e-05 2024-09-10T06:27:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275905+0000", 2024-09-10T06:27:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012092899999999999 2024-09-10T06:27:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-10T06:27:34.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275920+0000", 2024-09-10T06:27:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5325999999999999e-05 2024-09-10T06:27:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282541+0000", 2024-09-10T06:27:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066208400000000002 2024-09-10T06:27:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282693+0000", 2024-09-10T06:27:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152454 2024-09-10T06:27:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.861 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 56.441801703000003, 2024-09-10T06:27:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029204980000000001, 2024-09-10T06:27:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 193 2024-09-10T06:27:34.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412570+0000", 2024-09-10T06:27:34.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4530000000000001e-06 2024-09-10T06:27:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412582+0000", 2024-09-10T06:27:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1524e-05 2024-09-10T06:27:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412612+0000", 2024-09-10T06:27:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0436000000000001e-05 2024-09-10T06:27:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412627+0000", 2024-09-10T06:27:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4306e-05 2024-09-10T06:27:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412723+0000", 2024-09-10T06:27:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6075000000000004e-05 2024-09-10T06:27:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412831+0000", 2024-09-10T06:27:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108453 2024-09-10T06:27:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412972+0000", 2024-09-10T06:27:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141225 2024-09-10T06:27:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.414147+0000", 2024-09-10T06:27:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174989 2024-09-10T06:27:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415334+0000", 2024-09-10T06:27:34.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415420+0000", 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6009999999999998e-05 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415489+0000", 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8403000000000002e-05 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.544318060999998, 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092944310000000006, 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 208 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310055+0000", 2024-09-10T06:27:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-10T06:27:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310066+0000", 2024-09-10T06:27:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1739999999999999e-05 2024-09-10T06:27:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310096+0000", 2024-09-10T06:27:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0159e-05 2024-09-10T06:27:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310111+0000", 2024-09-10T06:27:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5007e-05 2024-09-10T06:27:34.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310235+0000", 2024-09-10T06:27:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123132 2024-09-10T06:27:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:27:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310246+0000", 2024-09-10T06:27:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1487e-05 2024-09-10T06:27:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315594+0000", 2024-09-10T06:27:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005347592 2024-09-10T06:27:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315932+0000", 2024-09-10T06:27:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033789099999999999 2024-09-10T06:27:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.316549+0000", 2024-09-10T06:27:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061698099999999995 2024-09-10T06:27:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.317898+0000", 2024-09-10T06:27:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013498799999999999 2024-09-10T06:27:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319207+0000", 2024-09-10T06:27:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013086969999999999 2024-09-10T06:27:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319289+0000", 2024-09-10T06:27:34.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2259e-05 2024-09-10T06:27:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319346+0000", 2024-09-10T06:27:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6675999999999997e-05 2024-09-10T06:27:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:34.874 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.517981337999998, 2024-09-10T06:27:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003262778, 2024-09-10T06:27:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 212 2024-09-10T06:27:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:34.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336391+0000", 2024-09-10T06:27:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5770000000000001e-06 2024-09-10T06:27:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.876 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336403+0000", 2024-09-10T06:27:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2286000000000001e-05 2024-09-10T06:27:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336425+0000", 2024-09-10T06:27:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2164e-05 2024-09-10T06:27:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336440+0000", 2024-09-10T06:27:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4222999999999999e-05 2024-09-10T06:27:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336621+0000", 2024-09-10T06:27:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018136500000000001 2024-09-10T06:27:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336830+0000", 2024-09-10T06:27:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209125 2024-09-10T06:27:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.337206+0000", 2024-09-10T06:27:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037553700000000001 2024-09-10T06:27:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.338527+0000", 2024-09-10T06:27:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00132142 2024-09-10T06:27:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339502+0000", 2024-09-10T06:27:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00097512599999999999 2024-09-10T06:27:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339585+0000", 2024-09-10T06:27:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2466000000000006e-05 2024-09-10T06:27:34.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339651+0000", 2024-09-10T06:27:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6489000000000007e-05 2024-09-10T06:27:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.493667799000001, 2024-09-10T06:27:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032440849999999999, 2024-09-10T06:27:34.880 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 219 2024-09-10T06:27:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360705+0000", 2024-09-10T06:27:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.593e-06 2024-09-10T06:27:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360716+0000", 2024-09-10T06:27:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1717e-05 2024-09-10T06:27:34.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360746+0000", 2024-09-10T06:27:34.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0233e-05 2024-09-10T06:27:34.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360761+0000", 2024-09-10T06:27:34.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4593000000000001e-05 2024-09-10T06:27:34.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360873+0000", 2024-09-10T06:27:34.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111809 2024-09-10T06:27:34.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361105+0000", 2024-09-10T06:27:34.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023171800000000001 2024-09-10T06:27:34.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361523+0000", 2024-09-10T06:27:34.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000418694 2024-09-10T06:27:34.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.362840+0000", 2024-09-10T06:27:34.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013165570000000001 2024-09-10T06:27:34.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363793+0000", 2024-09-10T06:27:34.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095323200000000004 2024-09-10T06:27:34.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363880+0000", 2024-09-10T06:27:34.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6689999999999998e-05 2024-09-10T06:27:34.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363946+0000", 2024-09-10T06:27:34.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6248999999999995e-05 2024-09-10T06:27:34.886 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.886 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.886 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.886 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.886 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:34.887 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.476400945999998, 2024-09-10T06:27:34.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003271422, 2024-09-10T06:27:34.887 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.887 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.887 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.887 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.887 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.887 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.887 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 224 2024-09-10T06:27:34.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.887 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:34.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:34.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377971+0000", 2024-09-10T06:27:34.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:34.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377983+0000", 2024-09-10T06:27:34.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1517e-05 2024-09-10T06:27:34.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378013+0000", 2024-09-10T06:27:34.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0476000000000001e-05 2024-09-10T06:27:34.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378028+0000", 2024-09-10T06:27:34.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5173e-05 2024-09-10T06:27:34.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378134+0000", 2024-09-10T06:27:34.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010533 2024-09-10T06:27:34.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378346+0000", 2024-09-10T06:27:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021175499999999999 2024-09-10T06:27:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378787+0000", 2024-09-10T06:27:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044190899999999999 2024-09-10T06:27:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.380237+0000", 2024-09-10T06:27:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001449093 2024-09-10T06:27:34.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381097+0000", 2024-09-10T06:27:34.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086022300000000002 2024-09-10T06:27:34.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381181+0000", 2024-09-10T06:27:34.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3973000000000004e-05 2024-09-10T06:27:34.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381240+0000", 2024-09-10T06:27:34.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9472999999999998e-05 2024-09-10T06:27:34.893 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.893 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.893 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.893 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.894 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:34.894 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.444733493000001, 2024-09-10T06:27:34.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031998719999999999, 2024-09-10T06:27:34.894 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.894 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.894 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.894 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 233 2024-09-10T06:27:34.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.894 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409639+0000", 2024-09-10T06:27:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4770000000000002e-06 2024-09-10T06:27:34.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409652+0000", 2024-09-10T06:27:34.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3692999999999999e-05 2024-09-10T06:27:34.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409683+0000", 2024-09-10T06:27:34.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1080000000000001e-05 2024-09-10T06:27:34.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409699+0000", 2024-09-10T06:27:34.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5245999999999999e-05 2024-09-10T06:27:34.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409881+0000", 2024-09-10T06:27:34.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000182709 2024-09-10T06:27:34.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410088+0000", 2024-09-10T06:27:34.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020630799999999999 2024-09-10T06:27:34.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410495+0000", 2024-09-10T06:27:34.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00040682700000000001 2024-09-10T06:27:34.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.411805+0000", 2024-09-10T06:27:34.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013101059999999999 2024-09-10T06:27:34.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412672+0000", 2024-09-10T06:27:34.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086778699999999996 2024-09-10T06:27:34.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412769+0000", 2024-09-10T06:27:34.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6565999999999997e-05 2024-09-10T06:27:34.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412836+0000", 2024-09-10T06:27:34.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7073e-05 2024-09-10T06:27:34.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.899 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.900 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:353 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.900 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:34.900 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.403826178999999, 2024-09-10T06:27:34.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059710450000000003, 2024-09-10T06:27:34.900 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.900 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.901 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.901 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.901 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.901 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.901 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 353 2024-09-10T06:27:34.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.902 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:34.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:34.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450545+0000", 2024-09-10T06:27:34.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.423e-06 2024-09-10T06:27:34.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450551+0000", 2024-09-10T06:27:34.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7370000000000003e-06 2024-09-10T06:27:34.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450565+0000", 2024-09-10T06:27:34.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4649e-05 2024-09-10T06:27:34.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450574+0000", 2024-09-10T06:27:34.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5129999999999996e-06 2024-09-10T06:27:34.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450644+0000", 2024-09-10T06:27:34.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0387000000000002e-05 2024-09-10T06:27:34.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450818+0000", 2024-09-10T06:27:34.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017368400000000001 2024-09-10T06:27:34.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451030+0000", 2024-09-10T06:27:34.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021189599999999999 2024-09-10T06:27:34.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451607+0000", 2024-09-10T06:27:34.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057672599999999995 2024-09-10T06:27:34.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456437+0000", 2024-09-10T06:27:34.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048301940000000003 2024-09-10T06:27:34.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456472+0000", 2024-09-10T06:27:34.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5178000000000001e-05 2024-09-10T06:27:34.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456515+0000", 2024-09-10T06:27:34.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2657999999999997e-05 2024-09-10T06:27:34.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.913 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.913 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.914 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:362 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.914 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:34.914 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.397378656999997, 2024-09-10T06:27:34.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044032239999999999, 2024-09-10T06:27:34.914 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.914 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.915 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.915 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.915 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.915 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.915 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 362 2024-09-10T06:27:34.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.915 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:34.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:34.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456992+0000", 2024-09-10T06:27:34.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6700000000000002e-07 2024-09-10T06:27:34.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456997+0000", 2024-09-10T06:27:34.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6249999999999998e-06 2024-09-10T06:27:34.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457005+0000", 2024-09-10T06:27:34.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6719999999999993e-06 2024-09-10T06:27:34.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457010+0000", 2024-09-10T06:27:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7360000000000001e-06 2024-09-10T06:27:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457054+0000", 2024-09-10T06:27:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4138999999999999e-05 2024-09-10T06:27:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457163+0000", 2024-09-10T06:27:34.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108558 2024-09-10T06:27:34.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457340+0000", 2024-09-10T06:27:34.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017730600000000001 2024-09-10T06:27:34.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.458065+0000", 2024-09-10T06:27:34.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00072480400000000001 2024-09-10T06:27:34.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461294+0000", 2024-09-10T06:27:34.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032287890000000001 2024-09-10T06:27:34.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461352+0000", 2024-09-10T06:27:34.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8502000000000003e-05 2024-09-10T06:27:34.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461394+0000", 2024-09-10T06:27:34.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2225999999999999e-05 2024-09-10T06:27:34.921 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.922 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.922 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:475 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.922 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:34.922 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.351529092, 2024-09-10T06:27:34.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046091930000000001, 2024-09-10T06:27:34.922 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.922 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.922 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.922 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.922 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 475 2024-09-10T06:27:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:34.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6100000000000001e-07 2024-09-10T06:27:34.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502844+0000", 2024-09-10T06:27:34.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0529999999999998e-06 2024-09-10T06:27:34.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502852+0000", 2024-09-10T06:27:34.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2579999999999995e-06 2024-09-10T06:27:34.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502857+0000", 2024-09-10T06:27:34.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3460000000000004e-06 2024-09-10T06:27:34.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502894+0000", 2024-09-10T06:27:34.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6884000000000001e-05 2024-09-10T06:27:34.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502942+0000", 2024-09-10T06:27:34.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7791999999999999e-05 2024-09-10T06:27:34.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.503048+0000", 2024-09-10T06:27:34.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010678799999999999 2024-09-10T06:27:34.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.506079+0000", 2024-09-10T06:27:34.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030311510000000002 2024-09-10T06:27:34.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507361+0000", 2024-09-10T06:27:34.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001281208 2024-09-10T06:27:34.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507400+0000", 2024-09-10T06:27:34.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9483000000000001e-05 2024-09-10T06:27:34.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507450+0000", 2024-09-10T06:27:34.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9669000000000002e-05 2024-09-10T06:27:34.928 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.928 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.928 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.928 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:477 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.928 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:34.928 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.349567974999999, 2024-09-10T06:27:34.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038544, 2024-09-10T06:27:34.928 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.929 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.929 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.929 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.929 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.929 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.929 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 477 2024-09-10T06:27:34.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.929 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:34.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:34.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504803+0000", 2024-09-10T06:27:34.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9999999999999996e-07 2024-09-10T06:27:34.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504808+0000", 2024-09-10T06:27:34.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1909999999999999e-06 2024-09-10T06:27:34.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504818+0000", 2024-09-10T06:27:34.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0081999999999999e-05 2024-09-10T06:27:34.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504823+0000", 2024-09-10T06:27:34.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9969999999999998e-06 2024-09-10T06:27:34.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504870+0000", 2024-09-10T06:27:34.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6980000000000001e-05 2024-09-10T06:27:34.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504922+0000", 2024-09-10T06:27:34.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869000000000001e-05 2024-09-10T06:27:34.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505020+0000", 2024-09-10T06:27:34.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8010999999999994e-05 2024-09-10T06:27:34.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507789+0000", 2024-09-10T06:27:34.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027690219999999999 2024-09-10T06:27:34.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508599+0000", 2024-09-10T06:27:34.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081037800000000005 2024-09-10T06:27:34.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508631+0000", 2024-09-10T06:27:34.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.137e-05 2024-09-10T06:27:34.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508656+0000", 2024-09-10T06:27:34.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5599999999999999e-05 2024-09-10T06:27:34.935 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.935 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.935 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.935 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:478 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.935 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:34.935 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.349521072999998, 2024-09-10T06:27:34.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039361880000000002, 2024-09-10T06:27:34.935 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.936 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.936 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.936 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.936 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.936 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.936 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 478 2024-09-10T06:27:34.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.936 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:34.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:34.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:34.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7800000000000001e-07 2024-09-10T06:27:34.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504853+0000", 2024-09-10T06:27:34.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2780000000000002e-06 2024-09-10T06:27:34.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504858+0000", 2024-09-10T06:27:34.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7359999999999998e-06 2024-09-10T06:27:34.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504862+0000", 2024-09-10T06:27:34.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6650000000000001e-06 2024-09-10T06:27:34.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504938+0000", 2024-09-10T06:27:34.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6286999999999997e-05 2024-09-10T06:27:34.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505091+0000", 2024-09-10T06:27:34.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152385 2024-09-10T06:27:34.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:34.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505335+0000", 2024-09-10T06:27:34.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244281 2024-09-10T06:27:34.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507764+0000", 2024-09-10T06:27:34.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002429624 2024-09-10T06:27:34.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508681+0000", 2024-09-10T06:27:34.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00091630100000000001 2024-09-10T06:27:34.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508747+0000", 2024-09-10T06:27:34.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5733000000000002e-05 2024-09-10T06:27:34.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508785+0000", 2024-09-10T06:27:34.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8319999999999999e-05 2024-09-10T06:27:34.943 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.943 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.943 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.943 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.943 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:34.943 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.103389153000002, 2024-09-10T06:27:34.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030732350000000001, 2024-09-10T06:27:34.943 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.943 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.943 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.943 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.944 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.944 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.944 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 733 2024-09-10T06:27:34.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.944 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:34.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:34.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750983+0000", 2024-09-10T06:27:34.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8880000000000001e-06 2024-09-10T06:27:34.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750996+0000", 2024-09-10T06:27:34.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2048999999999999e-05 2024-09-10T06:27:34.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751024+0000", 2024-09-10T06:27:34.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8802e-05 2024-09-10T06:27:34.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751043+0000", 2024-09-10T06:27:34.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8266000000000001e-05 2024-09-10T06:27:34.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751191+0000", 2024-09-10T06:27:34.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014818200000000001 2024-09-10T06:27:34.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751417+0000", 2024-09-10T06:27:34.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022648199999999999 2024-09-10T06:27:34.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.947 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751747+0000", 2024-09-10T06:27:34.947 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032945000000000001 2024-09-10T06:27:34.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.752752+0000", 2024-09-10T06:27:34.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010054790000000001 2024-09-10T06:27:34.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753896+0000", 2024-09-10T06:27:34.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001143638 2024-09-10T06:27:34.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753989+0000", 2024-09-10T06:27:34.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3466000000000003e-05 2024-09-10T06:27:34.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.754054+0000", 2024-09-10T06:27:34.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4533e-05 2024-09-10T06:27:34.949 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.949 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.949 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.949 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.950 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:34.950 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.062908606999997, 2024-09-10T06:27:34.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002896722, 2024-09-10T06:27:34.950 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.950 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.950 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.950 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.950 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 751 2024-09-10T06:27:34.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.950 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:34.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:34.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791464+0000", 2024-09-10T06:27:34.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7140000000000002e-06 2024-09-10T06:27:34.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791475+0000", 2024-09-10T06:27:34.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1535999999999999e-05 2024-09-10T06:27:34.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791501+0000", 2024-09-10T06:27:34.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5276e-05 2024-09-10T06:27:34.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791514+0000", 2024-09-10T06:27:34.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3203e-05 2024-09-10T06:27:34.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791643+0000", 2024-09-10T06:27:34.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012961900000000001 2024-09-10T06:27:34.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791857+0000", 2024-09-10T06:27:34.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021351599999999999 2024-09-10T06:27:34.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.792178+0000", 2024-09-10T06:27:34.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032090999999999999 2024-09-10T06:27:34.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.793281+0000", 2024-09-10T06:27:34.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001103319 2024-09-10T06:27:34.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794209+0000", 2024-09-10T06:27:34.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000927676 2024-09-10T06:27:34.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794295+0000", 2024-09-10T06:27:34.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5682999999999999e-05 2024-09-10T06:27:34.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794358+0000", 2024-09-10T06:27:34.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3269999999999996e-05 2024-09-10T06:27:34.956 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.956 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.956 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.956 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.956 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:34.956 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.059021110000003, 2024-09-10T06:27:34.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030558059999999999, 2024-09-10T06:27:34.957 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.957 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.957 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.957 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.957 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 753 2024-09-10T06:27:34.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.957 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:34.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:34.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795352+0000", 2024-09-10T06:27:34.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0130000000000002e-06 2024-09-10T06:27:34.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795364+0000", 2024-09-10T06:27:34.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1939999999999999e-05 2024-09-10T06:27:34.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795395+0000", 2024-09-10T06:27:34.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0976999999999998e-05 2024-09-10T06:27:34.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795413+0000", 2024-09-10T06:27:34.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7980000000000001e-05 2024-09-10T06:27:34.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795533+0000", 2024-09-10T06:27:34.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120732 2024-09-10T06:27:34.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795665+0000", 2024-09-10T06:27:34.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013215899999999999 2024-09-10T06:27:34.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795931+0000", 2024-09-10T06:27:34.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026536499999999999 2024-09-10T06:27:34.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.796995+0000", 2024-09-10T06:27:34.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001064611 2024-09-10T06:27:34.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798256+0000", 2024-09-10T06:27:34.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00126022 2024-09-10T06:27:34.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798340+0000", 2024-09-10T06:27:34.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4753000000000007e-05 2024-09-10T06:27:34.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798404+0000", 2024-09-10T06:27:34.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4055999999999998e-05 2024-09-10T06:27:34.962 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.962 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.962 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.962 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.962 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:34.963 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.943812868999998, 2024-09-10T06:27:34.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031632380000000001, 2024-09-10T06:27:34.963 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.963 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.963 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.963 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.963 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.963 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.963 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 805 2024-09-10T06:27:34.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.963 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:34.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:34.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910560+0000", 2024-09-10T06:27:34.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2200000000000001e-06 2024-09-10T06:27:34.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910574+0000", 2024-09-10T06:27:34.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3536000000000001e-05 2024-09-10T06:27:34.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910604+0000", 2024-09-10T06:27:34.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0645999999999998e-05 2024-09-10T06:27:34.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910619+0000", 2024-09-10T06:27:34.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5064e-05 2024-09-10T06:27:34.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910759+0000", 2024-09-10T06:27:34.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013943899999999999 2024-09-10T06:27:34.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910984+0000", 2024-09-10T06:27:34.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000225381 2024-09-10T06:27:34.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.911312+0000", 2024-09-10T06:27:34.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032782800000000001 2024-09-10T06:27:34.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.912402+0000", 2024-09-10T06:27:34.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010895639999999999 2024-09-10T06:27:34.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913576+0000", 2024-09-10T06:27:34.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174591 2024-09-10T06:27:34.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913657+0000", 2024-09-10T06:27:34.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1223000000000005e-05 2024-09-10T06:27:34.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913720+0000", 2024-09-10T06:27:34.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2745999999999999e-05 2024-09-10T06:27:34.969 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.969 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.969 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.969 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.969 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:34.969 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.884035134000001, 2024-09-10T06:27:34.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030680099999999999, 2024-09-10T06:27:34.969 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.969 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.969 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.970 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.970 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.970 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.970 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 832 2024-09-10T06:27:34.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.970 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:34.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:34.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970337+0000", 2024-09-10T06:27:34.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6230000000000001e-06 2024-09-10T06:27:34.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970349+0000", 2024-09-10T06:27:34.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1557e-05 2024-09-10T06:27:34.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970379+0000", 2024-09-10T06:27:34.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0456000000000001e-05 2024-09-10T06:27:34.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970394+0000", 2024-09-10T06:27:34.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4683e-05 2024-09-10T06:27:34.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970509+0000", 2024-09-10T06:27:34.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114613 2024-09-10T06:27:34.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970753+0000", 2024-09-10T06:27:34.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244295 2024-09-10T06:27:34.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:34.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.971078+0000", 2024-09-10T06:27:34.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000325583 2024-09-10T06:27:34.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.972162+0000", 2024-09-10T06:27:34.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010834519999999999 2024-09-10T06:27:34.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973200+0000", 2024-09-10T06:27:34.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010376560000000001 2024-09-10T06:27:34.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973287+0000", 2024-09-10T06:27:34.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7163000000000006e-05 2024-09-10T06:27:34.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973403+0000", 2024-09-10T06:27:34.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011592899999999999 2024-09-10T06:27:34.976 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.976 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.976 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.976 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.976 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:34.976 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.728963907000001, 2024-09-10T06:27:34.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030018599999999999, 2024-09-10T06:27:34.977 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.977 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.977 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.977 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.977 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.977 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.977 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 901 2024-09-10T06:27:34.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.977 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:34.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:34.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125409+0000", 2024-09-10T06:27:34.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.253e-06 2024-09-10T06:27:34.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125425+0000", 2024-09-10T06:27:34.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5636000000000001e-05 2024-09-10T06:27:34.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125456+0000", 2024-09-10T06:27:34.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1130000000000002e-05 2024-09-10T06:27:34.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125470+0000", 2024-09-10T06:27:34.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.464e-05 2024-09-10T06:27:34.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125581+0000", 2024-09-10T06:27:34.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110612 2024-09-10T06:27:34.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125814+0000", 2024-09-10T06:27:34.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023266899999999999 2024-09-10T06:27:34.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.126159+0000", 2024-09-10T06:27:34.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034565399999999998 2024-09-10T06:27:34.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.127161+0000", 2024-09-10T06:27:34.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010020890000000001 2024-09-10T06:27:34.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128202+0000", 2024-09-10T06:27:34.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001040242 2024-09-10T06:27:34.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128288+0000", 2024-09-10T06:27:34.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6156000000000007e-05 2024-09-10T06:27:34.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128408+0000", 2024-09-10T06:27:34.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011977900000000001 2024-09-10T06:27:34.982 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.982 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.983 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.983 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.983 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:34.983 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.694871538000001, 2024-09-10T06:27:34.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029016649999999999, 2024-09-10T06:27:34.983 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.983 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.983 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.983 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.984 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 916 2024-09-10T06:27:34.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.984 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:34.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:34.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159501+0000", 2024-09-10T06:27:34.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:34.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159512+0000", 2024-09-10T06:27:34.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1564e-05 2024-09-10T06:27:34.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159543+0000", 2024-09-10T06:27:34.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0942999999999998e-05 2024-09-10T06:27:34.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159558+0000", 2024-09-10T06:27:34.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.436e-05 2024-09-10T06:27:34.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159701+0000", 2024-09-10T06:27:34.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014363599999999999 2024-09-10T06:27:34.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159927+0000", 2024-09-10T06:27:34.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022535099999999999 2024-09-10T06:27:34.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.160260+0000", 2024-09-10T06:27:34.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033321700000000002 2024-09-10T06:27:34.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.161312+0000", 2024-09-10T06:27:34.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001052222 2024-09-10T06:27:34.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162261+0000", 2024-09-10T06:27:34.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00094912600000000001 2024-09-10T06:27:34.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162337+0000", 2024-09-10T06:27:34.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6268999999999998e-05 2024-09-10T06:27:34.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162400+0000", 2024-09-10T06:27:34.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2477000000000005e-05 2024-09-10T06:27:34.989 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.989 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.989 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.990 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:34.990 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:34.990 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 52.624562027000003, 2024-09-10T06:27:34.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030045179999999999, 2024-09-10T06:27:34.990 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:34.990 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:34.990 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:34.990 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:34.990 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:34.990 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:34.990 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 946 2024-09-10T06:27:34.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.990 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:34.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:34.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:34.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:34.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:34.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:34.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:34.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229810+0000", 2024-09-10T06:27:34.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:27:34.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:34.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229838+0000", 2024-09-10T06:27:34.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7776e-05 2024-09-10T06:27:34.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:34.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229869+0000", 2024-09-10T06:27:34.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0766999999999999e-05 2024-09-10T06:27:34.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:34.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229883+0000", 2024-09-10T06:27:34.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4423000000000001e-05 2024-09-10T06:27:34.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:34.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230005+0000", 2024-09-10T06:27:34.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121919 2024-09-10T06:27:34.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:34.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230219+0000", 2024-09-10T06:27:34.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000214098 2024-09-10T06:27:34.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:34.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230588+0000", 2024-09-10T06:27:34.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036857099999999999 2024-09-10T06:27:34.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:34.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.231707+0000", 2024-09-10T06:27:34.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011193349999999999 2024-09-10T06:27:34.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:34.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232662+0000", 2024-09-10T06:27:34.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095513300000000005 2024-09-10T06:27:34.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:34.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232748+0000", 2024-09-10T06:27:34.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6151999999999998e-05 2024-09-10T06:27:34.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:34.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:34.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:34.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232812+0000", 2024-09-10T06:27:34.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3876999999999998e-05 2024-09-10T06:27:34.996 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.996 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.996 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.996 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:34.996 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:34.996 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:34.998 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:27:34.998 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:34.999 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:34.999 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:35.000 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:35.000 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:34.997+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:35.099 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:35.097+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:35.200 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:35.201+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:35.209 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:35.209 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:35.210 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:35.210 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:35.227 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:27:35.313 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:35.313+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:35.402 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:35.401+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:35.435 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:35.435 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:35.435 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:35.436 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:35.436 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:35.453 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:27:35.502 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:35.501+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:35.603 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:35.601+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:35.671 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:35.671 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:35.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:35.672 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:35.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.672 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4236.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T06:27:35.672 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:35.672 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.161985381999997, 2024-09-10T06:27:35.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049682550000000004, 2024-09-10T06:27:35.672 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.672 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.673 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.673 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:35.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:35.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507427+0000", 2024-09-10T06:27:35.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5629999999999999e-06 2024-09-10T06:27:35.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507439+0000", 2024-09-10T06:27:35.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.19e-05 2024-09-10T06:27:35.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507460+0000", 2024-09-10T06:27:35.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1693000000000001e-05 2024-09-10T06:27:35.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507480+0000", 2024-09-10T06:27:35.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9947000000000001e-05 2024-09-10T06:27:35.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507613+0000", 2024-09-10T06:27:35.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000132409 2024-09-10T06:27:35.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507696+0000", 2024-09-10T06:27:35.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2953000000000004e-05 2024-09-10T06:27:35.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512288+0000", 2024-09-10T06:27:35.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045927110000000002 2024-09-10T06:27:35.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512393+0000", 2024-09-10T06:27:35.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105079 2024-09-10T06:27:35.676 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.676 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.677 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.677 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:35.677 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:35.677 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 61.338521350000001, 2024-09-10T06:27:35.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025692739999999999, 2024-09-10T06:27:35.677 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.677 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.677 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.677 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.677 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:35.677 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:35.678 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 42 2024-09-10T06:27:35.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.678 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:35.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:35.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330891+0000", 2024-09-10T06:27:35.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9700000000000002e-06 2024-09-10T06:27:35.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330901+0000", 2024-09-10T06:27:35.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2909999999999996e-06 2024-09-10T06:27:35.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330924+0000", 2024-09-10T06:27:35.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3132000000000001e-05 2024-09-10T06:27:35.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330935+0000", 2024-09-10T06:27:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0893999999999999e-05 2024-09-10T06:27:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331021+0000", 2024-09-10T06:27:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6205000000000006e-05 2024-09-10T06:27:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331160+0000", 2024-09-10T06:27:35.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013973600000000001 2024-09-10T06:27:35.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:35.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331336+0000", 2024-09-10T06:27:35.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017578799999999999 2024-09-10T06:27:35.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.332381+0000", 2024-09-10T06:27:35.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001044627 2024-09-10T06:27:35.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333371+0000", 2024-09-10T06:27:35.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098979800000000007 2024-09-10T06:27:35.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333421+0000", 2024-09-10T06:27:35.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9872e-05 2024-09-10T06:27:35.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333459+0000", 2024-09-10T06:27:35.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7960999999999998e-05 2024-09-10T06:27:35.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.683 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.683 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.683 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:35.683 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:35.683 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 57.35333043, 2024-09-10T06:27:35.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025247730000000001, 2024-09-10T06:27:35.683 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 52 2024-09-10T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:35.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316084+0000", 2024-09-10T06:27:35.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8260000000000003e-06 2024-09-10T06:27:35.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316095+0000", 2024-09-10T06:27:35.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1229999999999999e-05 2024-09-10T06:27:35.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316131+0000", 2024-09-10T06:27:35.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5499e-05 2024-09-10T06:27:35.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316150+0000", 2024-09-10T06:27:35.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9510000000000001e-05 2024-09-10T06:27:35.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316275+0000", 2024-09-10T06:27:35.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012501600000000001 2024-09-10T06:27:35.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316507+0000", 2024-09-10T06:27:35.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000231404 2024-09-10T06:27:35.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:35.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316712+0000", 2024-09-10T06:27:35.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204873 2024-09-10T06:27:35.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.317603+0000", 2024-09-10T06:27:35.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089174399999999998 2024-09-10T06:27:35.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318470+0000", 2024-09-10T06:27:35.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086713399999999998 2024-09-10T06:27:35.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318552+0000", 2024-09-10T06:27:35.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1279999999999994e-05 2024-09-10T06:27:35.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318605+0000", 2024-09-10T06:27:35.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3257000000000002e-05 2024-09-10T06:27:35.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.690 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.690 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.691 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.691 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:35.691 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.249552100999999, 2024-09-10T06:27:35.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033383480000000001, 2024-09-10T06:27:35.691 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.691 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.691 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.691 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.692 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.692 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.692 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 236 2024-09-10T06:27:35.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.692 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.692 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:35.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:35.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419861+0000", 2024-09-10T06:27:35.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.734e-06 2024-09-10T06:27:35.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419873+0000", 2024-09-10T06:27:35.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1789e-05 2024-09-10T06:27:35.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419904+0000", 2024-09-10T06:27:35.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1377000000000001e-05 2024-09-10T06:27:35.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419921+0000", 2024-09-10T06:27:35.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6878999999999999e-05 2024-09-10T06:27:35.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420052+0000", 2024-09-10T06:27:35.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013025600000000001 2024-09-10T06:27:35.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420263+0000", 2024-09-10T06:27:35.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021196600000000001 2024-09-10T06:27:35.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:35.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420649+0000", 2024-09-10T06:27:35.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038507 2024-09-10T06:27:35.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.422366+0000", 2024-09-10T06:27:35.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017172000000000001 2024-09-10T06:27:35.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423048+0000", 2024-09-10T06:27:35.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00068254100000000005 2024-09-10T06:27:35.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423127+0000", 2024-09-10T06:27:35.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8207000000000005e-05 2024-09-10T06:27:35.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423197+0000", 2024-09-10T06:27:35.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0328999999999997e-05 2024-09-10T06:27:35.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.699 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.699 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.699 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.699 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:35.699 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.232950827000003, 2024-09-10T06:27:35.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003575235, 2024-09-10T06:27:35.699 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.700 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.700 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.700 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.700 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 299 2024-09-10T06:27:35.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.700 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:35.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:35.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436461+0000", 2024-09-10T06:27:35.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.144e-06 2024-09-10T06:27:35.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436466+0000", 2024-09-10T06:27:35.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8409999999999999e-06 2024-09-10T06:27:35.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436477+0000", 2024-09-10T06:27:35.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1253000000000001e-05 2024-09-10T06:27:35.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436483+0000", 2024-09-10T06:27:35.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7010000000000001e-06 2024-09-10T06:27:35.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436527+0000", 2024-09-10T06:27:35.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4381000000000001e-05 2024-09-10T06:27:35.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436569+0000", 2024-09-10T06:27:35.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2208e-05 2024-09-10T06:27:35.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:35.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436687+0000", 2024-09-10T06:27:35.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118093 2024-09-10T06:27:35.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.437455+0000", 2024-09-10T06:27:35.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076799599999999996 2024-09-10T06:27:35.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439950+0000", 2024-09-10T06:27:35.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024946040000000001 2024-09-10T06:27:35.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439988+0000", 2024-09-10T06:27:35.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8405999999999998e-05 2024-09-10T06:27:35.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.440035+0000", 2024-09-10T06:27:35.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6607999999999998e-05 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.898274745000002, 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028833040000000002, 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.706 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.707 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 742 2024-09-10T06:27:35.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.707 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:35.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:35.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771139+0000", 2024-09-10T06:27:35.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5269999999999999e-06 2024-09-10T06:27:35.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771153+0000", 2024-09-10T06:27:35.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4036000000000001e-05 2024-09-10T06:27:35.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771186+0000", 2024-09-10T06:27:35.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2113000000000002e-05 2024-09-10T06:27:35.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771201+0000", 2024-09-10T06:27:35.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:35.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771320+0000", 2024-09-10T06:27:35.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119265 2024-09-10T06:27:35.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771557+0000", 2024-09-10T06:27:35.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023640600000000001 2024-09-10T06:27:35.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:35.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771890+0000", 2024-09-10T06:27:35.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033302000000000001 2024-09-10T06:27:35.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773204+0000", 2024-09-10T06:27:35.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013142239999999999 2024-09-10T06:27:35.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773864+0000", 2024-09-10T06:27:35.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066005100000000004 2024-09-10T06:27:35.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773948+0000", 2024-09-10T06:27:35.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4625999999999999e-05 2024-09-10T06:27:35.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774019+0000", 2024-09-10T06:27:35.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0705999999999997e-05 2024-09-10T06:27:35.712 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.712 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.712 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.712 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.712 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:35.713 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.894495495000001, 2024-09-10T06:27:35.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025263479999999999, 2024-09-10T06:27:35.713 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.713 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.713 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.713 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.713 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.713 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.713 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 744 2024-09-10T06:27:35.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.713 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:35.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:35.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774917+0000", 2024-09-10T06:27:35.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0540000000000002e-06 2024-09-10T06:27:35.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774926+0000", 2024-09-10T06:27:35.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5660000000000007e-06 2024-09-10T06:27:35.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774947+0000", 2024-09-10T06:27:35.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0852999999999998e-05 2024-09-10T06:27:35.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774958+0000", 2024-09-10T06:27:35.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1216999999999999e-05 2024-09-10T06:27:35.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775045+0000", 2024-09-10T06:27:35.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7643000000000001e-05 2024-09-10T06:27:35.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775167+0000", 2024-09-10T06:27:35.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012163900000000001 2024-09-10T06:27:35.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:35.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775427+0000", 2024-09-10T06:27:35.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000259678 2024-09-10T06:27:35.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.776736+0000", 2024-09-10T06:27:35.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013093429999999999 2024-09-10T06:27:35.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777296+0000", 2024-09-10T06:27:35.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056029599999999995 2024-09-10T06:27:35.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777374+0000", 2024-09-10T06:27:35.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7721999999999999e-05 2024-09-10T06:27:35.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777441+0000", 2024-09-10T06:27:35.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7336999999999996e-05 2024-09-10T06:27:35.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.720 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.721 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.722 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.722 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:35.722 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.857179948999999, 2024-09-10T06:27:35.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036412979999999998, 2024-09-10T06:27:35.722 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.722 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.722 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.722 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.722 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.722 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.723 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 760 2024-09-10T06:27:35.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.723 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:35.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:35.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812233+0000", 2024-09-10T06:27:35.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:35.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812244+0000", 2024-09-10T06:27:35.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1273e-05 2024-09-10T06:27:35.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812276+0000", 2024-09-10T06:27:35.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1253e-05 2024-09-10T06:27:35.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812290+0000", 2024-09-10T06:27:35.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4576000000000001e-05 2024-09-10T06:27:35.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812438+0000", 2024-09-10T06:27:35.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014775899999999999 2024-09-10T06:27:35.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812821+0000", 2024-09-10T06:27:35.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000383187 2024-09-10T06:27:35.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:35.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.813398+0000", 2024-09-10T06:27:35.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000576619 2024-09-10T06:27:35.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.814658+0000", 2024-09-10T06:27:35.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001260207 2024-09-10T06:27:35.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815591+0000", 2024-09-10T06:27:35.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00093332899999999999 2024-09-10T06:27:35.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815745+0000", 2024-09-10T06:27:35.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153392 2024-09-10T06:27:35.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815872+0000", 2024-09-10T06:27:35.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012715599999999999 2024-09-10T06:27:35.728 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.728 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.728 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.728 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.729 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:35.730 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.852544565000002, 2024-09-10T06:27:35.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029417369999999998, 2024-09-10T06:27:35.730 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.730 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.730 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.730 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 762 2024-09-10T06:27:35.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.730 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:35.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:35.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816868+0000", 2024-09-10T06:27:35.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.283e-06 2024-09-10T06:27:35.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816879+0000", 2024-09-10T06:27:35.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0523000000000001e-05 2024-09-10T06:27:35.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816910+0000", 2024-09-10T06:27:35.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0732999999999999e-05 2024-09-10T06:27:35.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816926+0000", 2024-09-10T06:27:35.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.677e-05 2024-09-10T06:27:35.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817058+0000", 2024-09-10T06:27:35.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013195599999999999 2024-09-10T06:27:35.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817299+0000", 2024-09-10T06:27:35.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000241091 2024-09-10T06:27:35.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:35.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817761+0000", 2024-09-10T06:27:35.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046188400000000003 2024-09-10T06:27:35.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.818948+0000", 2024-09-10T06:27:35.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:35.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819662+0000", 2024-09-10T06:27:35.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071398399999999997 2024-09-10T06:27:35.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819745+0000", 2024-09-10T06:27:35.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3560000000000006e-05 2024-09-10T06:27:35.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819808+0000", 2024-09-10T06:27:35.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2329000000000006e-05 2024-09-10T06:27:35.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.736 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.736 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.736 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.736 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:35.737 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.732083848000002, 2024-09-10T06:27:35.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002834175, 2024-09-10T06:27:35.737 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.737 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.737 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.737 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.737 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 817 2024-09-10T06:27:35.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.737 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:35.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:35.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937330+0000", 2024-09-10T06:27:35.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9869999999999999e-06 2024-09-10T06:27:35.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937342+0000", 2024-09-10T06:27:35.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2595999999999999e-05 2024-09-10T06:27:35.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937375+0000", 2024-09-10T06:27:35.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2320000000000002e-05 2024-09-10T06:27:35.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937390+0000", 2024-09-10T06:27:35.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4977000000000001e-05 2024-09-10T06:27:35.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937529+0000", 2024-09-10T06:27:35.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013937199999999999 2024-09-10T06:27:35.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937753+0000", 2024-09-10T06:27:35.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000224358 2024-09-10T06:27:35.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:35.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.938061+0000", 2024-09-10T06:27:35.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030808799999999998 2024-09-10T06:27:35.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.939112+0000", 2024-09-10T06:27:35.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010503050000000001 2024-09-10T06:27:35.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940005+0000", 2024-09-10T06:27:35.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089366599999999999 2024-09-10T06:27:35.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940093+0000", 2024-09-10T06:27:35.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8053000000000006e-05 2024-09-10T06:27:35.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940161+0000", 2024-09-10T06:27:35.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7453000000000006e-05 2024-09-10T06:27:35.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.744 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.744 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.744 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.744 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:35.744 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.679155805999997, 2024-09-10T06:27:35.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027552649999999998, 2024-09-10T06:27:35.745 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.745 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.745 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.745 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.745 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.745 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.745 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 841 2024-09-10T06:27:35.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.745 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:35.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990257+0000", 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6869999999999999e-06 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990270+0000", 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2843000000000001e-05 2024-09-10T06:27:35.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990300+0000", 2024-09-10T06:27:35.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9252999999999999e-05 2024-09-10T06:27:35.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990314+0000", 2024-09-10T06:27:35.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4796e-05 2024-09-10T06:27:35.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990427+0000", 2024-09-10T06:27:35.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112649 2024-09-10T06:27:35.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990671+0000", 2024-09-10T06:27:35.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244408 2024-09-10T06:27:35.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:35.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990987+0000", 2024-09-10T06:27:35.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031593099999999998 2024-09-10T06:27:35.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992073+0000", 2024-09-10T06:27:35.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010854549999999999 2024-09-10T06:27:35.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992862+0000", 2024-09-10T06:27:35.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00078889400000000005 2024-09-10T06:27:35.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992944+0000", 2024-09-10T06:27:35.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2152999999999998e-05 2024-09-10T06:27:35.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993010+0000", 2024-09-10T06:27:35.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6196000000000001e-05 2024-09-10T06:27:35.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.750 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.750 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.750 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.751 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:35.751 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.675419871999999, 2024-09-10T06:27:35.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025373539999999999, 2024-09-10T06:27:35.751 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.751 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.751 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.751 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.751 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 843 2024-09-10T06:27:35.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.752 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:35.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:35.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993993+0000", 2024-09-10T06:27:35.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3630000000000001e-06 2024-09-10T06:27:35.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994004+0000", 2024-09-10T06:27:35.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0557000000000001e-05 2024-09-10T06:27:35.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994035+0000", 2024-09-10T06:27:35.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0969000000000001e-05 2024-09-10T06:27:35.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994055+0000", 2024-09-10T06:27:35.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0497e-05 2024-09-10T06:27:35.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994150+0000", 2024-09-10T06:27:35.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5363000000000002e-05 2024-09-10T06:27:35.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994275+0000", 2024-09-10T06:27:35.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012453200000000001 2024-09-10T06:27:35.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:35.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994570+0000", 2024-09-10T06:27:35.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029522100000000003 2024-09-10T06:27:35.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.995569+0000", 2024-09-10T06:27:35.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00099913200000000001 2024-09-10T06:27:35.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996384+0000", 2024-09-10T06:27:35.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081451099999999997 2024-09-10T06:27:35.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996462+0000", 2024-09-10T06:27:35.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8502000000000002e-05 2024-09-10T06:27:35.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996528+0000", 2024-09-10T06:27:35.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5707e-05 2024-09-10T06:27:35.758 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.758 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.758 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.758 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.759 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:35.759 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.665972725000003, 2024-09-10T06:27:35.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033145539999999999, 2024-09-10T06:27:35.759 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.759 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.759 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.759 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.759 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 847 2024-09-10T06:27:35.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.760 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:35.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:35.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003440+0000", 2024-09-10T06:27:35.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5299999999999999e-06 2024-09-10T06:27:35.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003452+0000", 2024-09-10T06:27:35.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:35.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003482+0000", 2024-09-10T06:27:35.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0790000000000002e-05 2024-09-10T06:27:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003497+0000", 2024-09-10T06:27:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.489e-05 2024-09-10T06:27:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003645+0000", 2024-09-10T06:27:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014771900000000001 2024-09-10T06:27:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003996+0000", 2024-09-10T06:27:35.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000350861 2024-09-10T06:27:35.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:35.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.004540+0000", 2024-09-10T06:27:35.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054383199999999995 2024-09-10T06:27:35.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.005831+0000", 2024-09-10T06:27:35.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001291366 2024-09-10T06:27:35.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006461+0000", 2024-09-10T06:27:35.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062943899999999998 2024-09-10T06:27:35.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006631+0000", 2024-09-10T06:27:35.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000170228 2024-09-10T06:27:35.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006752+0000", 2024-09-10T06:27:35.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012160899999999999 2024-09-10T06:27:35.765 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.765 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.765 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.765 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.765 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:35.765 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.661719558000001, 2024-09-10T06:27:35.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002619953, 2024-09-10T06:27:35.765 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.765 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.765 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.766 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.766 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.766 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.766 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 849 2024-09-10T06:27:35.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.766 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:35.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:35.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007693+0000", 2024-09-10T06:27:35.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3099999999999999e-06 2024-09-10T06:27:35.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007704+0000", 2024-09-10T06:27:35.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0387000000000001e-05 2024-09-10T06:27:35.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007734+0000", 2024-09-10T06:27:35.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0676000000000002e-05 2024-09-10T06:27:35.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007753+0000", 2024-09-10T06:27:35.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.836e-05 2024-09-10T06:27:35.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007857+0000", 2024-09-10T06:27:35.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103836 2024-09-10T06:27:35.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007980+0000", 2024-09-10T06:27:35.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123843 2024-09-10T06:27:35.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:35.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.008241+0000", 2024-09-10T06:27:35.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026085799999999999 2024-09-10T06:27:35.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.009475+0000", 2024-09-10T06:27:35.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012340230000000001 2024-09-10T06:27:35.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010168+0000", 2024-09-10T06:27:35.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00069220800000000004 2024-09-10T06:27:35.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010247+0000", 2024-09-10T06:27:35.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9929e-05 2024-09-10T06:27:35.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010311+0000", 2024-09-10T06:27:35.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3522999999999995e-05 2024-09-10T06:27:35.771 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.771 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.772 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.772 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:35.772 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.617239736999998, 2024-09-10T06:27:35.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026646590000000002, 2024-09-10T06:27:35.772 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.772 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.772 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.773 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 868 2024-09-10T06:27:35.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.773 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:35.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:35.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052173+0000", 2024-09-10T06:27:35.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-10T06:27:35.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052186+0000", 2024-09-10T06:27:35.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2787e-05 2024-09-10T06:27:35.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052216+0000", 2024-09-10T06:27:35.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9618999999999999e-05 2024-09-10T06:27:35.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052231+0000", 2024-09-10T06:27:35.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4929999999999999e-05 2024-09-10T06:27:35.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052349+0000", 2024-09-10T06:27:35.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011830200000000001 2024-09-10T06:27:35.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052561+0000", 2024-09-10T06:27:35.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000212182 2024-09-10T06:27:35.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:35.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052874+0000", 2024-09-10T06:27:35.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031299399999999998 2024-09-10T06:27:35.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054049+0000", 2024-09-10T06:27:35.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174825 2024-09-10T06:27:35.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054635+0000", 2024-09-10T06:27:35.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058643900000000001 2024-09-10T06:27:35.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054721+0000", 2024-09-10T06:27:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5185999999999994e-05 2024-09-10T06:27:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054836+0000", 2024-09-10T06:27:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114922 2024-09-10T06:27:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.530583636000003, 2024-09-10T06:27:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028453739999999999, 2024-09-10T06:27:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.780 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 907 2024-09-10T06:27:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138830+0000", 2024-09-10T06:27:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8600000000000001e-06 2024-09-10T06:27:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138842+0000", 2024-09-10T06:27:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2126e-05 2024-09-10T06:27:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138874+0000", 2024-09-10T06:27:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2047e-05 2024-09-10T06:27:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138889+0000", 2024-09-10T06:27:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4966999999999999e-05 2024-09-10T06:27:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139007+0000", 2024-09-10T06:27:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118479 2024-09-10T06:27:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139238+0000", 2024-09-10T06:27:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023031399999999999 2024-09-10T06:27:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139566+0000", 2024-09-10T06:27:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032816099999999999 2024-09-10T06:27:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.140631+0000", 2024-09-10T06:27:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010653679999999999 2024-09-10T06:27:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141393+0000", 2024-09-10T06:27:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076187100000000001 2024-09-10T06:27:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141561+0000", 2024-09-10T06:27:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016755599999999999 2024-09-10T06:27:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141672+0000", 2024-09-10T06:27:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111625 2024-09-10T06:27:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:35.787 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.526660120000003, 2024-09-10T06:27:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002857268, 2024-09-10T06:27:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 909 2024-09-10T06:27:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:35.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:35.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142753+0000", 2024-09-10T06:27:35.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4040000000000002e-06 2024-09-10T06:27:35.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142764+0000", 2024-09-10T06:27:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0789e-05 2024-09-10T06:27:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142795+0000", 2024-09-10T06:27:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0982999999999998e-05 2024-09-10T06:27:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142810+0000", 2024-09-10T06:27:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4960000000000001e-05 2024-09-10T06:27:35.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142908+0000", 2024-09-10T06:27:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8726000000000003e-05 2024-09-10T06:27:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143030+0000", 2024-09-10T06:27:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121649 2024-09-10T06:27:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143294+0000", 2024-09-10T06:27:35.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000263875 2024-09-10T06:27:35.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.144530+0000", 2024-09-10T06:27:35.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001236067 2024-09-10T06:27:35.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145340+0000", 2024-09-10T06:27:35.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080966700000000003 2024-09-10T06:27:35.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145497+0000", 2024-09-10T06:27:35.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015773499999999999 2024-09-10T06:27:35.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145608+0000", 2024-09-10T06:27:35.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110413 2024-09-10T06:27:35.793 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.793 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.793 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.793 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.793 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:35.794 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.432962623000002, 2024-09-10T06:27:35.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029166940000000001, 2024-09-10T06:27:35.794 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.794 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.794 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.794 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.794 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.794 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.794 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 949 2024-09-10T06:27:35.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.794 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:35.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:35.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236451+0000", 2024-09-10T06:27:35.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:27:35.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236464+0000", 2024-09-10T06:27:35.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3223e-05 2024-09-10T06:27:35.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236497+0000", 2024-09-10T06:27:35.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2672999999999997e-05 2024-09-10T06:27:35.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236515+0000", 2024-09-10T06:27:35.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8386999999999999e-05 2024-09-10T06:27:35.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236636+0000", 2024-09-10T06:27:35.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120752 2024-09-10T06:27:35.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236857+0000", 2024-09-10T06:27:35.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022134499999999999 2024-09-10T06:27:35.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:35.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.237188+0000", 2024-09-10T06:27:35.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033057799999999999 2024-09-10T06:27:35.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.238353+0000", 2024-09-10T06:27:35.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001164841 2024-09-10T06:27:35.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239160+0000", 2024-09-10T06:27:35.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080743000000000004 2024-09-10T06:27:35.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239245+0000", 2024-09-10T06:27:35.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5189e-05 2024-09-10T06:27:35.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239365+0000", 2024-09-10T06:27:35.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119406 2024-09-10T06:27:35.800 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.800 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.800 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.800 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.800 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:35.800 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.429101516000003, 2024-09-10T06:27:35.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025033970000000001, 2024-09-10T06:27:35.800 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.801 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.801 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.801 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.801 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.801 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.801 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 951 2024-09-10T06:27:35.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.801 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:35.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:35.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240311+0000", 2024-09-10T06:27:35.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8899999999999999e-06 2024-09-10T06:27:35.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240320+0000", 2024-09-10T06:27:35.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6799999999999999e-06 2024-09-10T06:27:35.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240341+0000", 2024-09-10T06:27:35.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1379e-05 2024-09-10T06:27:35.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240352+0000", 2024-09-10T06:27:35.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1354e-05 2024-09-10T06:27:35.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240450+0000", 2024-09-10T06:27:35.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7866000000000001e-05 2024-09-10T06:27:35.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240580+0000", 2024-09-10T06:27:35.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012970899999999999 2024-09-10T06:27:35.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:35.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240851+0000", 2024-09-10T06:27:35.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027059099999999998 2024-09-10T06:27:35.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242052+0000", 2024-09-10T06:27:35.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001201014 2024-09-10T06:27:35.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242662+0000", 2024-09-10T06:27:35.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061076800000000003 2024-09-10T06:27:35.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242747+0000", 2024-09-10T06:27:35.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5019999999999996e-05 2024-09-10T06:27:35.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242812+0000", 2024-09-10T06:27:35.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5126e-05 2024-09-10T06:27:35.807 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.807 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.807 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.807 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:35.807 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:35.807 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 53.418652096999999, 2024-09-10T06:27:35.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027897120000000002, 2024-09-10T06:27:35.808 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:35.808 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:35.808 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:35.808 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:35.808 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:35.808 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:35.808 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 955 2024-09-10T06:27:35.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.808 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:35.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:35.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:35.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:35.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:35.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:35.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:35.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250761+0000", 2024-09-10T06:27:35.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:35.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:35.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250772+0000", 2024-09-10T06:27:35.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1153e-05 2024-09-10T06:27:35.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:35.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250802+0000", 2024-09-10T06:27:35.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-05 2024-09-10T06:27:35.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:35.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250817+0000", 2024-09-10T06:27:35.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4883e-05 2024-09-10T06:27:35.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:35.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250925+0000", 2024-09-10T06:27:35.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108249 2024-09-10T06:27:35.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:35.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251139+0000", 2024-09-10T06:27:35.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000213568 2024-09-10T06:27:35.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:35.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251450+0000", 2024-09-10T06:27:35.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031139200000000002 2024-09-10T06:27:35.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:35.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.252574+0000", 2024-09-10T06:27:35.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011239139999999999 2024-09-10T06:27:35.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:35.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253377+0000", 2024-09-10T06:27:35.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080306400000000003 2024-09-10T06:27:35.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:35.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253466+0000", 2024-09-10T06:27:35.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8436000000000005e-05 2024-09-10T06:27:35.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:35.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:35.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:35.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253548+0000", 2024-09-10T06:27:35.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2496000000000004e-05 2024-09-10T06:27:35.814 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.814 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.815 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.815 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:35.815 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:35.815 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:35.817 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:27:35.818 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-10T06:27:35.818 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:35.813+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:35.917 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:35.917+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:36.018 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:36.017+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:36.030 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:36.030 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:36.031 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:36.031 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:36.049 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:27:36.119 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:36.117+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:36.220 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:36.217+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:36.261 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:36.261 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:36.261 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:36.261 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:36.262 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:36.279 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:27:36.321 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:36.321+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:36.422 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:36.421+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:36.491 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:36.491 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.165288365999999, 2024-09-10T06:27:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030326279999999999, 2024-09-10T06:27:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 58 2024-09-10T06:27:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-10T06:27:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324169+0000", 2024-09-10T06:27:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9020000000000004e-06 2024-09-10T06:27:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324182+0000", 2024-09-10T06:27:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2166e-05 2024-09-10T06:27:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324190+0000", 2024-09-10T06:27:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.337e-06 2024-09-10T06:27:36.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324282+0000", 2024-09-10T06:27:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2331999999999996e-05 2024-09-10T06:27:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324486+0000", 2024-09-10T06:27:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020347400000000001 2024-09-10T06:27:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:36.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324719+0000", 2024-09-10T06:27:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023289900000000001 2024-09-10T06:27:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.325993+0000", 2024-09-10T06:27:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012746929999999999 2024-09-10T06:27:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327088+0000", 2024-09-10T06:27:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010947330000000001 2024-09-10T06:27:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327147+0000", 2024-09-10T06:27:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8677000000000001e-05 2024-09-10T06:27:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327195+0000", 2024-09-10T06:27:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8469e-05 2024-09-10T06:27:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.183467784000001, 2024-09-10T06:27:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003846917, 2024-09-10T06:27:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 207 2024-09-10T06:27:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.498 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305987+0000", 2024-09-10T06:27:36.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6069999999999999e-06 2024-09-10T06:27:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306002+0000", 2024-09-10T06:27:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5406000000000001e-05 2024-09-10T06:27:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306036+0000", 2024-09-10T06:27:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4146000000000001e-05 2024-09-10T06:27:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306061+0000", 2024-09-10T06:27:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4470000000000001e-05 2024-09-10T06:27:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306325+0000", 2024-09-10T06:27:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026382800000000002 2024-09-10T06:27:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306569+0000", 2024-09-10T06:27:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024445499999999998 2024-09-10T06:27:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.307017+0000", 2024-09-10T06:27:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044774000000000002 2024-09-10T06:27:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.308517+0000", 2024-09-10T06:27:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001500075 2024-09-10T06:27:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309685+0000", 2024-09-10T06:27:36.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001168505 2024-09-10T06:27:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309767+0000", 2024-09-10T06:27:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1992999999999999e-05 2024-09-10T06:27:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309830+0000", 2024-09-10T06:27:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2692000000000002e-05 2024-09-10T06:27:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.139215735999997, 2024-09-10T06:27:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003433888, 2024-09-10T06:27:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 216 2024-09-10T06:27:36.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350239+0000", 2024-09-10T06:27:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.377e-06 2024-09-10T06:27:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350254+0000", 2024-09-10T06:27:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.501e-05 2024-09-10T06:27:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350288+0000", 2024-09-10T06:27:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4746000000000002e-05 2024-09-10T06:27:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350312+0000", 2024-09-10T06:27:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3249999999999999e-05 2024-09-10T06:27:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350456+0000", 2024-09-10T06:27:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014483899999999999 2024-09-10T06:27:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350704+0000", 2024-09-10T06:27:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024719100000000001 2024-09-10T06:27:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.351117+0000", 2024-09-10T06:27:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000412934 2024-09-10T06:27:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.352644+0000", 2024-09-10T06:27:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015271079999999999 2024-09-10T06:27:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353397+0000", 2024-09-10T06:27:36.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075311799999999999 2024-09-10T06:27:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353556+0000", 2024-09-10T06:27:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159612 2024-09-10T06:27:36.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353669+0000", 2024-09-10T06:27:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011270299999999999 2024-09-10T06:27:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.511 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.100536274, 2024-09-10T06:27:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033447479999999998, 2024-09-10T06:27:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.512 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 227 2024-09-10T06:27:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388917+0000", 2024-09-10T06:27:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6900000000000001e-06 2024-09-10T06:27:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388931+0000", 2024-09-10T06:27:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3900000000000001e-05 2024-09-10T06:27:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388964+0000", 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2985999999999999e-05 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388980+0000", 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.535e-05 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389123+0000", 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014337900000000001 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389341+0000", 2024-09-10T06:27:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021765099999999999 2024-09-10T06:27:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389765+0000", 2024-09-10T06:27:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042423100000000001 2024-09-10T06:27:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.391433+0000", 2024-09-10T06:27:36.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016681000000000001 2024-09-10T06:27:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392104+0000", 2024-09-10T06:27:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067064800000000003 2024-09-10T06:27:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392191+0000", 2024-09-10T06:27:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7912999999999997e-05 2024-09-10T06:27:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392259+0000", 2024-09-10T06:27:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7899999999999997e-05 2024-09-10T06:27:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.093279500000001, 2024-09-10T06:27:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029995500000000001, 2024-09-10T06:27:36.518 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 229 2024-09-10T06:27:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396174+0000", 2024-09-10T06:27:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.774e-06 2024-09-10T06:27:36.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396186+0000", 2024-09-10T06:27:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2055999999999999e-05 2024-09-10T06:27:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396216+0000", 2024-09-10T06:27:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9640000000000001e-05 2024-09-10T06:27:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396231+0000", 2024-09-10T06:27:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396356+0000", 2024-09-10T06:27:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012504500000000001 2024-09-10T06:27:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396568+0000", 2024-09-10T06:27:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000211709 2024-09-10T06:27:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396954+0000", 2024-09-10T06:27:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386027 2024-09-10T06:27:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.398287+0000", 2024-09-10T06:27:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013331560000000001 2024-09-10T06:27:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399004+0000", 2024-09-10T06:27:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071720499999999995 2024-09-10T06:27:36.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399091+0000", 2024-09-10T06:27:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6714999999999999e-05 2024-09-10T06:27:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399171+0000", 2024-09-10T06:27:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9893000000000002e-05 2024-09-10T06:27:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.086720931000002, 2024-09-10T06:27:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030468270000000002, 2024-09-10T06:27:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 231 2024-09-10T06:27:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.525 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402732+0000", 2024-09-10T06:27:36.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-06 2024-09-10T06:27:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402744+0000", 2024-09-10T06:27:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1633e-05 2024-09-10T06:27:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402774+0000", 2024-09-10T06:27:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9666999999999999e-05 2024-09-10T06:27:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402789+0000", 2024-09-10T06:27:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5466000000000001e-05 2024-09-10T06:27:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402904+0000", 2024-09-10T06:27:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114466 2024-09-10T06:27:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403119+0000", 2024-09-10T06:27:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215572 2024-09-10T06:27:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403516+0000", 2024-09-10T06:27:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039663300000000002 2024-09-10T06:27:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405012+0000", 2024-09-10T06:27:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014961919999999999 2024-09-10T06:27:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405634+0000", 2024-09-10T06:27:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062145199999999999 2024-09-10T06:27:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405715+0000", 2024-09-10T06:27:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1619000000000006e-05 2024-09-10T06:27:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405777+0000", 2024-09-10T06:27:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1639999999999999e-05 2024-09-10T06:27:36.530 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:377 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.027965600000002, 2024-09-10T06:27:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058485480000000003, 2024-09-10T06:27:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.531 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 377 2024-09-10T06:27:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461486+0000", 2024-09-10T06:27:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0720000000000001e-06 2024-09-10T06:27:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461504+0000", 2024-09-10T06:27:36.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8002000000000001e-05 2024-09-10T06:27:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461519+0000", 2024-09-10T06:27:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4584e-05 2024-09-10T06:27:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461526+0000", 2024-09-10T06:27:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5560000000000004e-06 2024-09-10T06:27:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461597+0000", 2024-09-10T06:27:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1311999999999998e-05 2024-09-10T06:27:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461709+0000", 2024-09-10T06:27:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011191100000000001 2024-09-10T06:27:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461871+0000", 2024-09-10T06:27:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016254900000000001 2024-09-10T06:27:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.462777+0000", 2024-09-10T06:27:36.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00090547100000000003 2024-09-10T06:27:36.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467265+0000", 2024-09-10T06:27:36.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004488222 2024-09-10T06:27:36.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467308+0000", 2024-09-10T06:27:36.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2975000000000001e-05 2024-09-10T06:27:36.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467334+0000", 2024-09-10T06:27:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5894e-05 2024-09-10T06:27:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:384 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.025832745000002, 2024-09-10T06:27:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031588900000000001, 2024-09-10T06:27:36.537 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 384 2024-09-10T06:27:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463620+0000", 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463625+0000", 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6450000000000002e-06 2024-09-10T06:27:36.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463639+0000", 2024-09-10T06:27:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3540000000000001e-05 2024-09-10T06:27:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463648+0000", 2024-09-10T06:27:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0259999999999996e-06 2024-09-10T06:27:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463713+0000", 2024-09-10T06:27:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5438000000000006e-05 2024-09-10T06:27:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463774+0000", 2024-09-10T06:27:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0582999999999999e-05 2024-09-10T06:27:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:36.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463899+0000", 2024-09-10T06:27:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-10T06:27:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.464371+0000", 2024-09-10T06:27:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047201600000000002 2024-09-10T06:27:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466707+0000", 2024-09-10T06:27:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023354999999999999 2024-09-10T06:27:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466742+0000", 2024-09-10T06:27:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4686e-05 2024-09-10T06:27:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466777+0000", 2024-09-10T06:27:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5537000000000002e-05 2024-09-10T06:27:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.543 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:436 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.010585698, 2024-09-10T06:27:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040690570000000001, 2024-09-10T06:27:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.544 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 436 2024-09-10T06:27:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:36.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478866+0000", 2024-09-10T06:27:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1960000000000001e-06 2024-09-10T06:27:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478871+0000", 2024-09-10T06:27:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6879999999999998e-06 2024-09-10T06:27:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478883+0000", 2024-09-10T06:27:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1790999999999999e-05 2024-09-10T06:27:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478890+0000", 2024-09-10T06:27:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8569999999999997e-06 2024-09-10T06:27:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478958+0000", 2024-09-10T06:27:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7774999999999994e-05 2024-09-10T06:27:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479072+0000", 2024-09-10T06:27:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114577 2024-09-10T06:27:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479255+0000", 2024-09-10T06:27:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018297300000000001 2024-09-10T06:27:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482448+0000", 2024-09-10T06:27:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031933389999999999 2024-09-10T06:27:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482828+0000", 2024-09-10T06:27:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037961800000000002 2024-09-10T06:27:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482891+0000", 2024-09-10T06:27:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3316000000000002e-05 2024-09-10T06:27:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482934+0000", 2024-09-10T06:27:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2926999999999997e-05 2024-09-10T06:27:36.549 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:441 6.7 e34/28 6:e1cdb60d:reshard::reshard.0000000008:head v 34'7, mlcod=34'5)", 2024-09-10T06:27:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 55.006984780000003, 2024-09-10T06:27:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060368319999999998, 2024-09-10T06:27:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482467+0000", 2024-09-10T06:27:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8800000000000003e-07 2024-09-10T06:27:36.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482472+0000", 2024-09-10T06:27:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8730000000000004e-06 2024-09-10T06:27:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482481+0000", 2024-09-10T06:27:36.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1980000000000001e-06 2024-09-10T06:27:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482485+0000", 2024-09-10T06:27:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.386e-06 2024-09-10T06:27:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482541+0000", 2024-09-10T06:27:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5788000000000002e-05 2024-09-10T06:27:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.553 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482563+0000", 2024-09-10T06:27:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2303999999999999e-05 2024-09-10T06:27:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488465+0000", 2024-09-10T06:27:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059014810000000001 2024-09-10T06:27:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488503+0000", 2024-09-10T06:27:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8313999999999999e-05 2024-09-10T06:27:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.554 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:466 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.99182553, 2024-09-10T06:27:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039032810000000002, 2024-09-10T06:27:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.555 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 466 2024-09-10T06:27:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:36.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497626+0000", 2024-09-10T06:27:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9099999999999991e-07 2024-09-10T06:27:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497634+0000", 2024-09-10T06:27:36.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.994e-06 2024-09-10T06:27:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497644+0000", 2024-09-10T06:27:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6260000000000007e-06 2024-09-10T06:27:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.559 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497650+0000", 2024-09-10T06:27:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5160000000000002e-06 2024-09-10T06:27:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.560 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497718+0000", 2024-09-10T06:27:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8862999999999994e-05 2024-09-10T06:27:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497775+0000", 2024-09-10T06:27:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6156000000000002e-05 2024-09-10T06:27:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.561 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497903+0000", 2024-09-10T06:27:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012879800000000001 2024-09-10T06:27:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.562 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499630+0000", 2024-09-10T06:27:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017268139999999999 2024-09-10T06:27:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501439+0000", 2024-09-10T06:27:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018086669999999999 2024-09-10T06:27:36.563 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501478+0000", 2024-09-10T06:27:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9269e-05 2024-09-10T06:27:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.564 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501529+0000", 2024-09-10T06:27:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0587000000000002e-05 2024-09-10T06:27:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:469 6.0 e34/28 6:02683654:reshard::reshard.0000000010:head v 34'6, mlcod=34'4)", 2024-09-10T06:27:36.565 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.989822707000002, 2024-09-10T06:27:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048323109999999997, 2024-09-10T06:27:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.566 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499629+0000", 2024-09-10T06:27:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9199999999999999e-07 2024-09-10T06:27:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499634+0000", 2024-09-10T06:27:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2530000000000004e-06 2024-09-10T06:27:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.567 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499644+0000", 2024-09-10T06:27:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5820000000000008e-06 2024-09-10T06:27:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499650+0000", 2024-09-10T06:27:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7919999999999998e-06 2024-09-10T06:27:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499697+0000", 2024-09-10T06:27:36.568 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7564000000000001e-05 2024-09-10T06:27:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499719+0000", 2024-09-10T06:27:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1297999999999998e-05 2024-09-10T06:27:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504413+0000", 2024-09-10T06:27:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004694419 2024-09-10T06:27:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.569 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504461+0000", 2024-09-10T06:27:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7511e-05 2024-09-10T06:27:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:621 6.0 e34/28 6:0705c68b:::obj_delete_at_hint.0000000028:head v 34'11, mlcod=34'9)", 2024-09-10T06:27:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.884621562, 2024-09-10T06:27:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003196562, 2024-09-10T06:27:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.570 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.571 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604831+0000", 2024-09-10T06:27:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.823e-06 2024-09-10T06:27:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604843+0000", 2024-09-10T06:27:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1437000000000001e-05 2024-09-10T06:27:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604868+0000", 2024-09-10T06:27:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5837e-05 2024-09-10T06:27:36.572 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604885+0000", 2024-09-10T06:27:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6759999999999999e-05 2024-09-10T06:27:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604971+0000", 2024-09-10T06:27:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5512000000000004e-05 2024-09-10T06:27:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.573 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604991+0000", 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0197999999999999e-05 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.607960+0000", 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002969307 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608026+0000", 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5687999999999999e-05 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.574 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:636 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.875711908, 2024-09-10T06:27:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048306950000000003, 2024-09-10T06:27:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 636 2024-09-10T06:27:36.575 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.576 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613740+0000", 2024-09-10T06:27:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613747+0000", 2024-09-10T06:27:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8090000000000004e-06 2024-09-10T06:27:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613762+0000", 2024-09-10T06:27:36.577 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5037e-05 2024-09-10T06:27:36.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613772+0000", 2024-09-10T06:27:36.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7510000000000003e-06 2024-09-10T06:27:36.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.578 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.578 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613834+0000", 2024-09-10T06:27:36.578 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2458000000000004e-05 2024-09-10T06:27:36.578 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.578 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613916+0000", 2024-09-10T06:27:36.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1630000000000003e-05 2024-09-10T06:27:36.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:36.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.614071+0000", 2024-09-10T06:27:36.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015480800000000001 2024-09-10T06:27:36.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.579 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.579 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.579 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.615885+0000", 2024-09-10T06:27:36.579 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001814607 2024-09-10T06:27:36.579 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618438+0000", 2024-09-10T06:27:36.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025529459999999999 2024-09-10T06:27:36.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618503+0000", 2024-09-10T06:27:36.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4851000000000006e-05 2024-09-10T06:27:36.580 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.580 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.580 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.580 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618570+0000", 2024-09-10T06:27:36.580 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6418e-05 2024-09-10T06:27:36.581 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.581 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.581 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.581 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.581 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.581 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:646 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.581 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:36.581 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.866250117999996, 2024-09-10T06:27:36.581 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049103549999999999, 2024-09-10T06:27:36.581 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.581 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.581 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.581 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.582 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.582 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.582 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 646 2024-09-10T06:27:36.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.582 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:36.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.582 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.582 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.582 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.582 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:36.582 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623202+0000", 2024-09-10T06:27:36.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9800000000000002e-07 2024-09-10T06:27:36.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623206+0000", 2024-09-10T06:27:36.583 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6380000000000003e-06 2024-09-10T06:27:36.583 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.583 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.583 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.583 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623216+0000", 2024-09-10T06:27:36.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4439999999999997e-06 2024-09-10T06:27:36.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623221+0000", 2024-09-10T06:27:36.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6400000000000002e-06 2024-09-10T06:27:36.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.584 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.584 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623300+0000", 2024-09-10T06:27:36.584 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8677999999999994e-05 2024-09-10T06:27:36.584 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.584 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623410+0000", 2024-09-10T06:27:36.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010954399999999999 2024-09-10T06:27:36.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:36.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623629+0000", 2024-09-10T06:27:36.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000219836 2024-09-10T06:27:36.585 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.585 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.585 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.585 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.625072+0000", 2024-09-10T06:27:36.585 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014427929999999999 2024-09-10T06:27:36.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.627982+0000", 2024-09-10T06:27:36.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029097620000000002 2024-09-10T06:27:36.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628058+0000", 2024-09-10T06:27:36.586 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6390999999999994e-05 2024-09-10T06:27:36.586 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.586 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.586 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.586 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628111+0000", 2024-09-10T06:27:36.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2731e-05 2024-09-10T06:27:36.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.587 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.587 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.587 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.587 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.587 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.587 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:36.587 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.803575846000001, 2024-09-10T06:27:36.587 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033783509999999999, 2024-09-10T06:27:36.587 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.587 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.587 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.587 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.588 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.588 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.588 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 703 2024-09-10T06:27:36.588 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.588 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.588 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.588 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.588 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:36.588 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:36.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.589 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.589 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.589 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685878+0000", 2024-09-10T06:27:36.589 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5900000000000002e-06 2024-09-10T06:27:36.589 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685889+0000", 2024-09-10T06:27:36.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:36.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685919+0000", 2024-09-10T06:27:36.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0307e-05 2024-09-10T06:27:36.590 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.590 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.590 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.590 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685935+0000", 2024-09-10T06:27:36.590 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5336e-05 2024-09-10T06:27:36.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686092+0000", 2024-09-10T06:27:36.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015776200000000001 2024-09-10T06:27:36.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.591 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686462+0000", 2024-09-10T06:27:36.591 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036925700000000001 2024-09-10T06:27:36.591 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.591 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.591 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:36.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.687048+0000", 2024-09-10T06:27:36.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000586266 2024-09-10T06:27:36.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688261+0000", 2024-09-10T06:27:36.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012132670000000001 2024-09-10T06:27:36.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.592 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.592 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688974+0000", 2024-09-10T06:27:36.592 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071248800000000005 2024-09-10T06:27:36.592 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.592 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689129+0000", 2024-09-10T06:27:36.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155499 2024-09-10T06:27:36.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.593 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.593 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689253+0000", 2024-09-10T06:27:36.593 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124289 2024-09-10T06:27:36.593 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.593 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.593 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.593 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.593 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.594 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.594 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:36.594 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.445010343, 2024-09-10T06:27:36.594 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032750980000000002, 2024-09-10T06:27:36.594 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.594 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.594 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.594 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.594 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.594 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.594 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 865 2024-09-10T06:27:36.594 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.594 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.594 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:36.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:36.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.595 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.595 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.595 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044443+0000", 2024-09-10T06:27:36.595 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6929999999999999e-06 2024-09-10T06:27:36.595 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044456+0000", 2024-09-10T06:27:36.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.224e-05 2024-09-10T06:27:36.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044486+0000", 2024-09-10T06:27:36.596 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.095e-05 2024-09-10T06:27:36.596 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.596 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.596 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.596 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044501+0000", 2024-09-10T06:27:36.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4932999999999999e-05 2024-09-10T06:27:36.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044646+0000", 2024-09-10T06:27:36.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014465600000000001 2024-09-10T06:27:36.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.597 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045001+0000", 2024-09-10T06:27:36.597 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035473999999999998 2024-09-10T06:27:36.597 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.597 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.597 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:36.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045549+0000", 2024-09-10T06:27:36.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054870299999999999 2024-09-10T06:27:36.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.046956+0000", 2024-09-10T06:27:36.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014061189999999999 2024-09-10T06:27:36.598 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.598 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.598 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.598 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047452+0000", 2024-09-10T06:27:36.598 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049682199999999995 2024-09-10T06:27:36.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047606+0000", 2024-09-10T06:27:36.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015379599999999999 2024-09-10T06:27:36.599 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.599 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.599 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.599 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047716+0000", 2024-09-10T06:27:36.599 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109446 2024-09-10T06:27:36.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.599 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.599 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.600 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.600 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.600 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:36.600 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.440547191, 2024-09-10T06:27:36.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030837989999999999, 2024-09-10T06:27:36.600 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.600 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.600 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.600 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.600 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 867 2024-09-10T06:27:36.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.601 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:36.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:36.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048906+0000", 2024-09-10T06:27:36.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1770000000000001e-06 2024-09-10T06:27:36.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048916+0000", 2024-09-10T06:27:36.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.025e-05 2024-09-10T06:27:36.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048948+0000", 2024-09-10T06:27:36.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1859000000000001e-05 2024-09-10T06:27:36.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048968+0000", 2024-09-10T06:27:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9647e-05 2024-09-10T06:27:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049090+0000", 2024-09-10T06:27:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122645 2024-09-10T06:27:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049314+0000", 2024-09-10T06:27:36.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022372900000000001 2024-09-10T06:27:36.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:36.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049785+0000", 2024-09-10T06:27:36.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047121899999999999 2024-09-10T06:27:36.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.050979+0000", 2024-09-10T06:27:36.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001193408 2024-09-10T06:27:36.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051729+0000", 2024-09-10T06:27:36.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075039699999999998 2024-09-10T06:27:36.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051874+0000", 2024-09-10T06:27:36.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000145253 2024-09-10T06:27:36.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051988+0000", 2024-09-10T06:27:36.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011321500000000001 2024-09-10T06:27:36.605 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.606 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.606 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.606 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.606 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:36.606 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.371680009999999, 2024-09-10T06:27:36.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035511029999999999, 2024-09-10T06:27:36.606 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.606 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.606 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.606 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.606 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.606 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.607 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 898 2024-09-10T06:27:36.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.607 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:36.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:36.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117772+0000", 2024-09-10T06:27:36.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5340000000000001e-06 2024-09-10T06:27:36.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117781+0000", 2024-09-10T06:27:36.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.276e-06 2024-09-10T06:27:36.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117804+0000", 2024-09-10T06:27:36.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3093999999999999e-05 2024-09-10T06:27:36.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117816+0000", 2024-09-10T06:27:36.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1986e-05 2024-09-10T06:27:36.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117954+0000", 2024-09-10T06:27:36.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013856900000000001 2024-09-10T06:27:36.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118327+0000", 2024-09-10T06:27:36.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000372841 2024-09-10T06:27:36.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:36.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118919+0000", 2024-09-10T06:27:36.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059172800000000002 2024-09-10T06:27:36.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.120253+0000", 2024-09-10T06:27:36.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001333643 2024-09-10T06:27:36.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121060+0000", 2024-09-10T06:27:36.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080731100000000001 2024-09-10T06:27:36.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121210+0000", 2024-09-10T06:27:36.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014980500000000001 2024-09-10T06:27:36.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121322+0000", 2024-09-10T06:27:36.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112316 2024-09-10T06:27:36.613 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.613 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.613 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.613 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:36.613 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:36.613 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 54.282410198000001, 2024-09-10T06:27:36.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051838630000000004, 2024-09-10T06:27:36.613 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:36.613 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 937 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:36.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:36.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:36.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:36.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207042+0000", 2024-09-10T06:27:36.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7439999999999999e-06 2024-09-10T06:27:36.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:36.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207051+0000", 2024-09-10T06:27:36.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7299999999999994e-06 2024-09-10T06:27:36.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:36.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207072+0000", 2024-09-10T06:27:36.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1209e-05 2024-09-10T06:27:36.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:36.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207089+0000", 2024-09-10T06:27:36.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6297e-05 2024-09-10T06:27:36.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:36.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207231+0000", 2024-09-10T06:27:36.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014233200000000001 2024-09-10T06:27:36.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:36.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207463+0000", 2024-09-10T06:27:36.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023155199999999999 2024-09-10T06:27:36.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:36.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207797+0000", 2024-09-10T06:27:36.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033413699999999998 2024-09-10T06:27:36.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:36.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.209053+0000", 2024-09-10T06:27:36.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012560029999999999 2024-09-10T06:27:36.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:36.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212076+0000", 2024-09-10T06:27:36.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030234239999999998 2024-09-10T06:27:36.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:36.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212162+0000", 2024-09-10T06:27:36.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5506000000000004e-05 2024-09-10T06:27:36.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:36.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:36.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:36.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212225+0000", 2024-09-10T06:27:36.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2928999999999993e-05 2024-09-10T06:27:36.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.619 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.619 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:36.620 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:36.620 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:36.621 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:27:36.622 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:36.621+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:36.722 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:36.721+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:36.751 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:36.752 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:36.752 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:36.752 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:36.766 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:27:36.852 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:36.853+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:36.923 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:36.925+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:36.930 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:36.931 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:36.945 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:27:37.000 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:27:37.032 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:37.033+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:37.115 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.115 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-10T06:27:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.821443481999999, 2024-09-10T06:27:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047108059999999997, 2024-09-10T06:27:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291391+0000", 2024-09-10T06:27:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8700000000000001e-06 2024-09-10T06:27:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291405+0000", 2024-09-10T06:27:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4623e-05 2024-09-10T06:27:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291438+0000", 2024-09-10T06:27:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2616000000000001e-05 2024-09-10T06:27:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291461+0000", 2024-09-10T06:27:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2883000000000001e-05 2024-09-10T06:27:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293024+0000", 2024-09-10T06:27:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015627709999999999 2024-09-10T06:27:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293071+0000", 2024-09-10T06:27:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7797000000000003e-05 2024-09-10T06:27:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295983+0000", 2024-09-10T06:27:37.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029113640000000001 2024-09-10T06:27:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296100+0000", 2024-09-10T06:27:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116882 2024-09-10T06:27:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:37.120 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.780085704000001, 2024-09-10T06:27:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00338296, 2024-09-10T06:27:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 211 2024-09-10T06:27:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332750+0000", 2024-09-10T06:27:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-10T06:27:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332767+0000", 2024-09-10T06:27:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.702e-05 2024-09-10T06:27:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332805+0000", 2024-09-10T06:27:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7950000000000001e-05 2024-09-10T06:27:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332824+0000", 2024-09-10T06:27:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8462999999999999e-05 2024-09-10T06:27:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332950+0000", 2024-09-10T06:27:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012653600000000001 2024-09-10T06:27:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333177+0000", 2024-09-10T06:27:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022626800000000001 2024-09-10T06:27:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333604+0000", 2024-09-10T06:27:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042759999999999999 2024-09-10T06:27:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335279+0000", 2024-09-10T06:27:37.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001674481 2024-09-10T06:27:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335976+0000", 2024-09-10T06:27:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069707099999999995 2024-09-10T06:27:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336063+0000", 2024-09-10T06:27:37.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6916000000000006e-05 2024-09-10T06:27:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336130+0000", 2024-09-10T06:27:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6971999999999995e-05 2024-09-10T06:27:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.127 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.706810828999998, 2024-09-10T06:27:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034123389999999999, 2024-09-10T06:27:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232 2024-09-10T06:27:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406025+0000", 2024-09-10T06:27:37.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-10T06:27:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406040+0000", 2024-09-10T06:27:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5299999999999999e-05 2024-09-10T06:27:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406072+0000", 2024-09-10T06:27:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2543000000000003e-05 2024-09-10T06:27:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406088+0000", 2024-09-10T06:27:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5699999999999999e-05 2024-09-10T06:27:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406206+0000", 2024-09-10T06:27:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011828900000000001 2024-09-10T06:27:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406416+0000", 2024-09-10T06:27:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020969900000000001 2024-09-10T06:27:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406804+0000", 2024-09-10T06:27:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038783699999999998 2024-09-10T06:27:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.408490+0000", 2024-09-10T06:27:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001686353 2024-09-10T06:27:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409152+0000", 2024-09-10T06:27:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066160800000000005 2024-09-10T06:27:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409314+0000", 2024-09-10T06:27:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000162285 2024-09-10T06:27:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409434+0000", 2024-09-10T06:27:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119639 2024-09-10T06:27:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.686881384000003, 2024-09-10T06:27:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034077650000000001, 2024-09-10T06:27:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241 2024-09-10T06:27:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425954+0000", 2024-09-10T06:27:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425965+0000", 2024-09-10T06:27:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.181e-05 2024-09-10T06:27:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425996+0000", 2024-09-10T06:27:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0759000000000001e-05 2024-09-10T06:27:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426011+0000", 2024-09-10T06:27:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4507e-05 2024-09-10T06:27:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426153+0000", 2024-09-10T06:27:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014206599999999999 2024-09-10T06:27:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426491+0000", 2024-09-10T06:27:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033830399999999999 2024-09-10T06:27:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426973+0000", 2024-09-10T06:27:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000482113 2024-09-10T06:27:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.428378+0000", 2024-09-10T06:27:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001404539 2024-09-10T06:27:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429113+0000", 2024-09-10T06:27:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073537799999999996 2024-09-10T06:27:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429251+0000", 2024-09-10T06:27:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013789600000000001 2024-09-10T06:27:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429359+0000", 2024-09-10T06:27:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107846 2024-09-10T06:27:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:266 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.682148359999999, 2024-09-10T06:27:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030966560000000001, 2024-09-10T06:27:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 266 2024-09-10T06:27:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430687+0000", 2024-09-10T06:27:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0299999999999998e-06 2024-09-10T06:27:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430702+0000", 2024-09-10T06:27:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5316999999999999e-05 2024-09-10T06:27:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430741+0000", 2024-09-10T06:27:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8336e-05 2024-09-10T06:27:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430762+0000", 2024-09-10T06:27:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.162e-05 2024-09-10T06:27:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430923+0000", 2024-09-10T06:27:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016044599999999999 2024-09-10T06:27:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431103+0000", 2024-09-10T06:27:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018030100000000001 2024-09-10T06:27:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431513+0000", 2024-09-10T06:27:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040992999999999997 2024-09-10T06:27:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432715+0000", 2024-09-10T06:27:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001202411 2024-09-10T06:27:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433624+0000", 2024-09-10T06:27:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090863000000000001 2024-09-10T06:27:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433718+0000", 2024-09-10T06:27:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3749e-05 2024-09-10T06:27:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433781+0000", 2024-09-10T06:27:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2885999999999994e-05 2024-09-10T06:27:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:273 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.680574759000002, 2024-09-10T06:27:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028009850000000002, 2024-09-10T06:27:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 273 2024-09-10T06:27:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432260+0000", 2024-09-10T06:27:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1900000000000002e-06 2024-09-10T06:27:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432271+0000", 2024-09-10T06:27:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1353e-05 2024-09-10T06:27:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432296+0000", 2024-09-10T06:27:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4817e-05 2024-09-10T06:27:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432318+0000", 2024-09-10T06:27:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1963e-05 2024-09-10T06:27:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432465+0000", 2024-09-10T06:27:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014658299999999999 2024-09-10T06:27:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432801+0000", 2024-09-10T06:27:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033681299999999999 2024-09-10T06:27:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433188+0000", 2024-09-10T06:27:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000386857 2024-09-10T06:27:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434552+0000", 2024-09-10T06:27:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013634400000000001 2024-09-10T06:27:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434872+0000", 2024-09-10T06:27:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031998399999999999 2024-09-10T06:27:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434973+0000", 2024-09-10T06:27:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100962 2024-09-10T06:27:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.435059+0000", 2024-09-10T06:27:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6023e-05 2024-09-10T06:27:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:299 6.14 e34/28 6:2c0c0c23:reshard::reshard.0000000001:head v 34'2, mlcod=0'0)", 2024-09-10T06:27:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.675958907999998, 2024-09-10T06:27:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029099109999999998, 2024-09-10T06:27:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436875+0000", 2024-09-10T06:27:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0430000000000002e-06 2024-09-10T06:27:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436890+0000", 2024-09-10T06:27:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4766999999999999e-05 2024-09-10T06:27:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436918+0000", 2024-09-10T06:27:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.76e-05 2024-09-10T06:27:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436937+0000", 2024-09-10T06:27:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9539999999999999e-05 2024-09-10T06:27:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437081+0000", 2024-09-10T06:27:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144065 2024-09-10T06:27:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437130+0000", 2024-09-10T06:27:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8609999999999997e-05 2024-09-10T06:27:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439676+0000", 2024-09-10T06:27:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002546137 2024-09-10T06:27:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439783+0000", 2024-09-10T06:27:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107149 2024-09-10T06:27:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:341 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.667039213000002, 2024-09-10T06:27:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030260230000000001, 2024-09-10T06:27:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 341 2024-09-10T06:27:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445796+0000", 2024-09-10T06:27:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7130000000000001e-06 2024-09-10T06:27:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445810+0000", 2024-09-10T06:27:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4564e-05 2024-09-10T06:27:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445886+0000", 2024-09-10T06:27:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5921999999999996e-05 2024-09-10T06:27:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445902+0000", 2024-09-10T06:27:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5800000000000001e-05 2024-09-10T06:27:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446057+0000", 2024-09-10T06:27:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015475600000000001 2024-09-10T06:27:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446347+0000", 2024-09-10T06:27:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029057699999999998 2024-09-10T06:27:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446669+0000", 2024-09-10T06:27:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032102399999999999 2024-09-10T06:27:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.447891+0000", 2024-09-10T06:27:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012226680000000001 2024-09-10T06:27:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448550+0000", 2024-09-10T06:27:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065925800000000002 2024-09-10T06:27:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448699+0000", 2024-09-10T06:27:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014831800000000001 2024-09-10T06:27:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448819+0000", 2024-09-10T06:27:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120423 2024-09-10T06:27:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:505 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.585360682999998, 2024-09-10T06:27:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028092249999999998, 2024-09-10T06:27:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 505 2024-09-10T06:27:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527474+0000", 2024-09-10T06:27:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-10T06:27:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527495+0000", 2024-09-10T06:27:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0910000000000001e-05 2024-09-10T06:27:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527549+0000", 2024-09-10T06:27:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3223000000000002e-05 2024-09-10T06:27:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527583+0000", 2024-09-10T06:27:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4773000000000001e-05 2024-09-10T06:27:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527737+0000", 2024-09-10T06:27:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325199999999999 2024-09-10T06:27:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528092+0000", 2024-09-10T06:27:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000354951 2024-09-10T06:27:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528657+0000", 2024-09-10T06:27:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00056537500000000001 2024-09-10T06:27:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.529771+0000", 2024-09-10T06:27:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011136519999999999 2024-09-10T06:27:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530072+0000", 2024-09-10T06:27:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030151700000000001 2024-09-10T06:27:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530213+0000", 2024-09-10T06:27:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014100500000000001 2024-09-10T06:27:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530281+0000", 2024-09-10T06:27:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7793999999999995e-05 2024-09-10T06:27:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.581691405999997, 2024-09-10T06:27:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051813969999999999, 2024-09-10T06:27:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 513 2024-09-10T06:27:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531143+0000", 2024-09-10T06:27:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7400000000000001e-06 2024-09-10T06:27:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531153+0000", 2024-09-10T06:27:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.815e-06 2024-09-10T06:27:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531178+0000", 2024-09-10T06:27:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5755e-05 2024-09-10T06:27:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531190+0000", 2024-09-10T06:27:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1250000000000001e-05 2024-09-10T06:27:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531322+0000", 2024-09-10T06:27:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013239299999999999 2024-09-10T06:27:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531550+0000", 2024-09-10T06:27:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000227598 2024-09-10T06:27:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531966+0000", 2024-09-10T06:27:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041634400000000002 2024-09-10T06:27:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533197+0000", 2024-09-10T06:27:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012308810000000001 2024-09-10T06:27:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536097+0000", 2024-09-10T06:27:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029007159999999998 2024-09-10T06:27:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536245+0000", 2024-09-10T06:27:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000147816 2024-09-10T06:27:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536322+0000", 2024-09-10T06:27:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7088999999999993e-05 2024-09-10T06:27:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:514 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.581619209000003, 2024-09-10T06:27:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048258260000000001, 2024-09-10T06:27:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 514 2024-09-10T06:27:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531214+0000", 2024-09-10T06:27:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2699999999999998e-07 2024-09-10T06:27:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531219+0000", 2024-09-10T06:27:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-10T06:27:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531233+0000", 2024-09-10T06:27:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.38e-05 2024-09-10T06:27:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531240+0000", 2024-09-10T06:27:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7399999999999998e-06 2024-09-10T06:27:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531378+0000", 2024-09-10T06:27:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013860399999999999 2024-09-10T06:27:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531600+0000", 2024-09-10T06:27:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221287 2024-09-10T06:27:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532007+0000", 2024-09-10T06:27:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040728500000000001 2024-09-10T06:27:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533131+0000", 2024-09-10T06:27:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011240429999999999 2024-09-10T06:27:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535894+0000", 2024-09-10T06:27:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027628650000000002 2024-09-10T06:27:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535973+0000", 2024-09-10T06:27:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9399000000000003e-05 2024-09-10T06:27:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536039+0000", 2024-09-10T06:27:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5619999999999999e-05 2024-09-10T06:27:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:655 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.481676671000002, 2024-09-10T06:27:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003017207, 2024-09-10T06:27:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 655 2024-09-10T06:27:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631159+0000", 2024-09-10T06:27:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8270000000000002e-06 2024-09-10T06:27:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631173+0000", 2024-09-10T06:27:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4739999999999999e-05 2024-09-10T06:27:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631206+0000", 2024-09-10T06:27:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2425999999999998e-05 2024-09-10T06:27:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631221+0000", 2024-09-10T06:27:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4927e-05 2024-09-10T06:27:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631336+0000", 2024-09-10T06:27:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115062 2024-09-10T06:27:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631547+0000", 2024-09-10T06:27:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021178200000000001 2024-09-10T06:27:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.632034+0000", 2024-09-10T06:27:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000486899 2024-09-10T06:27:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633413+0000", 2024-09-10T06:27:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001379077 2024-09-10T06:27:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633891+0000", 2024-09-10T06:27:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000477489 2024-09-10T06:27:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634057+0000", 2024-09-10T06:27:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016608500000000001 2024-09-10T06:27:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634173+0000", 2024-09-10T06:27:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115893 2024-09-10T06:27:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:658 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.477662426999999, 2024-09-10T06:27:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030550820000000002, 2024-09-10T06:27:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 658 2024-09-10T06:27:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635171+0000", 2024-09-10T06:27:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.322e-06 2024-09-10T06:27:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635178+0000", 2024-09-10T06:27:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7950000000000002e-06 2024-09-10T06:27:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635197+0000", 2024-09-10T06:27:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8845e-05 2024-09-10T06:27:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635215+0000", 2024-09-10T06:27:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7822e-05 2024-09-10T06:27:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635329+0000", 2024-09-10T06:27:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011433 2024-09-10T06:27:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635554+0000", 2024-09-10T06:27:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022527800000000001 2024-09-10T06:27:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.636007+0000", 2024-09-10T06:27:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045297099999999998 2024-09-10T06:27:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637198+0000", 2024-09-10T06:27:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011902740000000001 2024-09-10T06:27:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637961+0000", 2024-09-10T06:27:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000763234 2024-09-10T06:27:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638110+0000", 2024-09-10T06:27:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149259 2024-09-10T06:27:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638225+0000", 2024-09-10T06:27:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011495200000000001 2024-09-10T06:27:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.381330484999999, 2024-09-10T06:27:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028070980000000001, 2024-09-10T06:27:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 724 2024-09-10T06:27:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731504+0000", 2024-09-10T06:27:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731516+0000", 2024-09-10T06:27:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1885999999999999e-05 2024-09-10T06:27:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731547+0000", 2024-09-10T06:27:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0923000000000002e-05 2024-09-10T06:27:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731563+0000", 2024-09-10T06:27:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5342999999999999e-05 2024-09-10T06:27:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731704+0000", 2024-09-10T06:27:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014128599999999999 2024-09-10T06:27:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731917+0000", 2024-09-10T06:27:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021280800000000001 2024-09-10T06:27:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.732227+0000", 2024-09-10T06:27:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031024500000000001 2024-09-10T06:27:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.733258+0000", 2024-09-10T06:27:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010306880000000001 2024-09-10T06:27:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734163+0000", 2024-09-10T06:27:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090502400000000004 2024-09-10T06:27:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734247+0000", 2024-09-10T06:27:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4363000000000005e-05 2024-09-10T06:27:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734309+0000", 2024-09-10T06:27:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2005e-05 2024-09-10T06:27:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.374484351, 2024-09-10T06:27:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030399789999999999, 2024-09-10T06:27:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 727 2024-09-10T06:27:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738350+0000", 2024-09-10T06:27:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2199999999999999e-06 2024-09-10T06:27:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738360+0000", 2024-09-10T06:27:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0122999999999999e-05 2024-09-10T06:27:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738384+0000", 2024-09-10T06:27:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3390000000000001e-05 2024-09-10T06:27:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738397+0000", 2024-09-10T06:27:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2896e-05 2024-09-10T06:27:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738524+0000", 2024-09-10T06:27:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126883 2024-09-10T06:27:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738752+0000", 2024-09-10T06:27:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022864200000000001 2024-09-10T06:27:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.739080+0000", 2024-09-10T06:27:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032783699999999999 2024-09-10T06:27:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.740085+0000", 2024-09-10T06:27:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001005438 2024-09-10T06:27:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741203+0000", 2024-09-10T06:27:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011175919999999999 2024-09-10T06:27:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741280+0000", 2024-09-10T06:27:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6545999999999995e-05 2024-09-10T06:27:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741388+0000", 2024-09-10T06:27:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108412 2024-09-10T06:27:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.182461846000002, 2024-09-10T06:27:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028715709999999998, 2024-09-10T06:27:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 814 2024-09-10T06:27:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930373+0000", 2024-09-10T06:27:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-10T06:27:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930384+0000", 2024-09-10T06:27:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1357e-05 2024-09-10T06:27:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930417+0000", 2024-09-10T06:27:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2289000000000002e-05 2024-09-10T06:27:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930438+0000", 2024-09-10T06:27:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1399999999999998e-05 2024-09-10T06:27:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930626+0000", 2024-09-10T06:27:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018812899999999999 2024-09-10T06:27:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930843+0000", 2024-09-10T06:27:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021719400000000001 2024-09-10T06:27:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.931152+0000", 2024-09-10T06:27:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030821199999999998 2024-09-10T06:27:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.932258+0000", 2024-09-10T06:27:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001106304 2024-09-10T06:27:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933092+0000", 2024-09-10T06:27:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00083364699999999997 2024-09-10T06:27:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933179+0000", 2024-09-10T06:27:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7383e-05 2024-09-10T06:27:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933242+0000", 2024-09-10T06:27:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3072999999999997e-05 2024-09-10T06:27:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 55.034910365000002, 2024-09-10T06:27:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029601670000000001, 2024-09-10T06:27:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 880 2024-09-10T06:27:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077925+0000", 2024-09-10T06:27:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-10T06:27:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077938+0000", 2024-09-10T06:27:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2836999999999999e-05 2024-09-10T06:27:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077970+0000", 2024-09-10T06:27:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1542999999999999e-05 2024-09-10T06:27:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077984+0000", 2024-09-10T06:27:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4963999999999999e-05 2024-09-10T06:27:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078118+0000", 2024-09-10T06:27:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134015 2024-09-10T06:27:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078344+0000", 2024-09-10T06:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225038 2024-09-10T06:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078696+0000", 2024-09-10T06:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035250100000000002 2024-09-10T06:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.079793+0000", 2024-09-10T06:27:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010967049999999999 2024-09-10T06:27:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080714+0000", 2024-09-10T06:27:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00092153600000000003 2024-09-10T06:27:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080802+0000", 2024-09-10T06:27:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7446000000000003e-05 2024-09-10T06:27:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080882+0000", 2024-09-10T06:27:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0445999999999995e-05 2024-09-10T06:27:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 54.960290137999998, 2024-09-10T06:27:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002919091, 2024-09-10T06:27:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 913 2024-09-10T06:27:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152545+0000", 2024-09-10T06:27:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6529999999999998e-06 2024-09-10T06:27:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152557+0000", 2024-09-10T06:27:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919999999999999e-05 2024-09-10T06:27:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152587+0000", 2024-09-10T06:27:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0097e-05 2024-09-10T06:27:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152601+0000", 2024-09-10T06:27:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4579999999999999e-05 2024-09-10T06:27:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152732+0000", 2024-09-10T06:27:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013085500000000001 2024-09-10T06:27:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153007+0000", 2024-09-10T06:27:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027469499999999998 2024-09-10T06:27:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153344+0000", 2024-09-10T06:27:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033742400000000001 2024-09-10T06:27:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.154351+0000", 2024-09-10T06:27:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010067590000000001 2024-09-10T06:27:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155301+0000", 2024-09-10T06:27:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095000900000000003 2024-09-10T06:27:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155387+0000", 2024-09-10T06:27:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6136000000000003e-05 2024-09-10T06:27:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155461+0000", 2024-09-10T06:27:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3962999999999996e-05 2024-09-10T06:27:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 54.928643456000003, 2024-09-10T06:27:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029321239999999999, 2024-09-10T06:27:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 927 2024-09-10T06:27:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184191+0000", 2024-09-10T06:27:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.764e-06 2024-09-10T06:27:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184199+0000", 2024-09-10T06:27:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4630000000000001e-06 2024-09-10T06:27:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184221+0000", 2024-09-10T06:27:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1603e-05 2024-09-10T06:27:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184233+0000", 2024-09-10T06:27:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.189e-05 2024-09-10T06:27:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184382+0000", 2024-09-10T06:27:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014939900000000001 2024-09-10T06:27:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184495+0000", 2024-09-10T06:27:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113459 2024-09-10T06:27:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184735+0000", 2024-09-10T06:27:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000239554 2024-09-10T06:27:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186036+0000", 2024-09-10T06:27:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00130072 2024-09-10T06:27:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186929+0000", 2024-09-10T06:27:37.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000893694 2024-09-10T06:27:37.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187014+0000", 2024-09-10T06:27:37.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4222999999999996e-05 2024-09-10T06:27:37.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187121+0000", 2024-09-10T06:27:37.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107355 2024-09-10T06:27:37.239 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.240 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.240 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.240 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:37.240 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:37.240 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 54.925382591000002, 2024-09-10T06:27:37.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028243320000000001, 2024-09-10T06:27:37.240 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:37.240 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:37.240 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:37.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:37.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:37.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:37.241 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 928 2024-09-10T06:27:37.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.241 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:37.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:37.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:37.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:37.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:37.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:37.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:37.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187452+0000", 2024-09-10T06:27:37.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5069999999999999e-06 2024-09-10T06:27:37.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:37.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187464+0000", 2024-09-10T06:27:37.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1243000000000001e-05 2024-09-10T06:27:37.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:37.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187495+0000", 2024-09-10T06:27:37.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1136000000000001e-05 2024-09-10T06:27:37.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:37.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187511+0000", 2024-09-10T06:27:37.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6710000000000001e-05 2024-09-10T06:27:37.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:37.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187648+0000", 2024-09-10T06:27:37.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013657599999999999 2024-09-10T06:27:37.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:37.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187866+0000", 2024-09-10T06:27:37.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021853500000000001 2024-09-10T06:27:37.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:37.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.188168+0000", 2024-09-10T06:27:37.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030161100000000002 2024-09-10T06:27:37.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:37.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.189334+0000", 2024-09-10T06:27:37.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001166048 2024-09-10T06:27:37.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190086+0000", 2024-09-10T06:27:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075159399999999996 2024-09-10T06:27:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190165+0000", 2024-09-10T06:27:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8953000000000001e-05 2024-09-10T06:27:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190274+0000", 2024-09-10T06:27:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109419 2024-09-10T06:27:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.245 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:37.246 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:37.246 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:37.247 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:37.247 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:37.248 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:37.248 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:37.248 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:27:37.249 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:37.245+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:37.257 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:37.257 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:37.287 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:37.287 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:37.319 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:37.320 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:37.348 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:37.345+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:37.350 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:37.350 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:37.382 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:37.382 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:37.414 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:37.414 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:37.422 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:37.422 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:37.436 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:27:37.484 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:37.485+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:37.549 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:37.549+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:37.563 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:37.563 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:37.577 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:27:37.664 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:37.665+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:37.738 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:37.738 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:37.751 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:37.749+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:37.752 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:27:37.819 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T06:27:37.865 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:37.865+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:37.924 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:37.925 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:37.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:27:37.984 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:37.985+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:38.054 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:38.053+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:38.061 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:38.061 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:38.075 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:27:38.168 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:38.169+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:38.241 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:38.242 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:38.256 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:27:38.256 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:38.253+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:38.357 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:38.357+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:38.423 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:38.424 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:38.438 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:27:38.480 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:38.481+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:38.560 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:38.561+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:38.604 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:38.604 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:38.618 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:27:38.660 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:38.661+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:38.761 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:38.761+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:38.773 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-10T06:27:38.784 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:38.784 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:38.798 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:27:38.861 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:38.861+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:38.962 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:38.961+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:38.968 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:38.968 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:38.984 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:27:39.064 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:39.065+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:39.165 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:39.165+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:39.192 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:39.192 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:39.210 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:27:39.266 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:39.265+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:39.367 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:39.365+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:39.377 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:39.377 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:39.396 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:27:39.438 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:27:39.485 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:39.485+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:39.568 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:39.568 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:39.568 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:39.569+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:39.587 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:27:39.640 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:39.640 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:39.669 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:39.665+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:39.671 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:39.671 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:39.701 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:39.702 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:39.732 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:39.732 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:39.765 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:39.765 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:39.770 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:39.769+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:39.796 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:39.796 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:39.797 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:39.797 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:39.797 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:39.799 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:39.799 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:39.815 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:27:39.832 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:39.832 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:39.865 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:39.865 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:39.870 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:39.869+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:39.971 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:39.969+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:40.004 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:40.004 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:40.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:40.004 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:40.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.004 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:40.005 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:40.005 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 65.726502690000004, 2024-09-10T06:27:40.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069538480000000003, 2024-09-10T06:27:40.005 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.005 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.005 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-10T06:27:40.005 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.005 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:40.005 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:40.005 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2 2024-09-10T06:27:40.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.005 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:40.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:40.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275742+0000", 2024-09-10T06:27:40.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7460000000000001e-06 2024-09-10T06:27:40.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275751+0000", 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3979999999999999e-06 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275769+0000", 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8637000000000001e-05 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275784+0000", 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4518000000000001e-05 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275905+0000", 2024-09-10T06:27:40.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012092899999999999 2024-09-10T06:27:40.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-10T06:27:40.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275920+0000", 2024-09-10T06:27:40.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5325999999999999e-05 2024-09-10T06:27:40.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282541+0000", 2024-09-10T06:27:40.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066208400000000002 2024-09-10T06:27:40.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282693+0000", 2024-09-10T06:27:40.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152454 2024-09-10T06:27:40.009 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.009 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.009 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.009 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:40.009 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:40.009 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 61.589674129000002, 2024-09-10T06:27:40.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029204980000000001, 2024-09-10T06:27:40.009 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.010 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.010 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.010 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.010 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.010 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.010 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 193 2024-09-10T06:27:40.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.010 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:40.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:40.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412570+0000", 2024-09-10T06:27:40.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4530000000000001e-06 2024-09-10T06:27:40.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412582+0000", 2024-09-10T06:27:40.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1524e-05 2024-09-10T06:27:40.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412612+0000", 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0436000000000001e-05 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412627+0000", 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4306e-05 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412723+0000", 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6075000000000004e-05 2024-09-10T06:27:40.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412831+0000", 2024-09-10T06:27:40.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108453 2024-09-10T06:27:40.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412972+0000", 2024-09-10T06:27:40.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141225 2024-09-10T06:27:40.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.414147+0000", 2024-09-10T06:27:40.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174989 2024-09-10T06:27:40.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415334+0000", 2024-09-10T06:27:40.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:40.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415420+0000", 2024-09-10T06:27:40.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6009999999999998e-05 2024-09-10T06:27:40.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415489+0000", 2024-09-10T06:27:40.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8403000000000002e-05 2024-09-10T06:27:40.015 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.015 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.015 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.015 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.015 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:40.015 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.692190486999998, 2024-09-10T06:27:40.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092944310000000006, 2024-09-10T06:27:40.015 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.015 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.015 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 208 2024-09-10T06:27:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310055+0000", 2024-09-10T06:27:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-10T06:27:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310066+0000", 2024-09-10T06:27:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1739999999999999e-05 2024-09-10T06:27:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310096+0000", 2024-09-10T06:27:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0159e-05 2024-09-10T06:27:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310111+0000", 2024-09-10T06:27:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5007e-05 2024-09-10T06:27:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310235+0000", 2024-09-10T06:27:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123132 2024-09-10T06:27:40.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:27:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310246+0000", 2024-09-10T06:27:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1487e-05 2024-09-10T06:27:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315594+0000", 2024-09-10T06:27:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005347592 2024-09-10T06:27:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315932+0000", 2024-09-10T06:27:40.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033789099999999999 2024-09-10T06:27:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.316549+0000", 2024-09-10T06:27:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061698099999999995 2024-09-10T06:27:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.317898+0000", 2024-09-10T06:27:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013498799999999999 2024-09-10T06:27:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319207+0000", 2024-09-10T06:27:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013086969999999999 2024-09-10T06:27:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319289+0000", 2024-09-10T06:27:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2259e-05 2024-09-10T06:27:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319346+0000", 2024-09-10T06:27:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6675999999999997e-05 2024-09-10T06:27:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.021 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.665853763999998, 2024-09-10T06:27:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003262778, 2024-09-10T06:27:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.022 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 212 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336391+0000", 2024-09-10T06:27:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5770000000000001e-06 2024-09-10T06:27:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336403+0000", 2024-09-10T06:27:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2286000000000001e-05 2024-09-10T06:27:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336425+0000", 2024-09-10T06:27:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2164e-05 2024-09-10T06:27:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336440+0000", 2024-09-10T06:27:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4222999999999999e-05 2024-09-10T06:27:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336621+0000", 2024-09-10T06:27:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018136500000000001 2024-09-10T06:27:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336830+0000", 2024-09-10T06:27:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209125 2024-09-10T06:27:40.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.337206+0000", 2024-09-10T06:27:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037553700000000001 2024-09-10T06:27:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.338527+0000", 2024-09-10T06:27:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00132142 2024-09-10T06:27:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339502+0000", 2024-09-10T06:27:40.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00097512599999999999 2024-09-10T06:27:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339585+0000", 2024-09-10T06:27:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2466000000000006e-05 2024-09-10T06:27:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339651+0000", 2024-09-10T06:27:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6489000000000007e-05 2024-09-10T06:27:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.641540225, 2024-09-10T06:27:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032440849999999999, 2024-09-10T06:27:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 219 2024-09-10T06:27:40.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360705+0000", 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.593e-06 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360716+0000", 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1717e-05 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360746+0000", 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0233e-05 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360761+0000", 2024-09-10T06:27:40.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4593000000000001e-05 2024-09-10T06:27:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360873+0000", 2024-09-10T06:27:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111809 2024-09-10T06:27:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361105+0000", 2024-09-10T06:27:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023171800000000001 2024-09-10T06:27:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361523+0000", 2024-09-10T06:27:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000418694 2024-09-10T06:27:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.362840+0000", 2024-09-10T06:27:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013165570000000001 2024-09-10T06:27:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363793+0000", 2024-09-10T06:27:40.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095323200000000004 2024-09-10T06:27:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363880+0000", 2024-09-10T06:27:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6689999999999998e-05 2024-09-10T06:27:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363946+0000", 2024-09-10T06:27:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6248999999999995e-05 2024-09-10T06:27:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.624273371999998, 2024-09-10T06:27:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003271422, 2024-09-10T06:27:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 224 2024-09-10T06:27:40.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377971+0000", 2024-09-10T06:27:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377983+0000", 2024-09-10T06:27:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1517e-05 2024-09-10T06:27:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378013+0000", 2024-09-10T06:27:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0476000000000001e-05 2024-09-10T06:27:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378028+0000", 2024-09-10T06:27:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5173e-05 2024-09-10T06:27:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378134+0000", 2024-09-10T06:27:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010533 2024-09-10T06:27:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378346+0000", 2024-09-10T06:27:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021175499999999999 2024-09-10T06:27:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378787+0000", 2024-09-10T06:27:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044190899999999999 2024-09-10T06:27:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.380237+0000", 2024-09-10T06:27:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001449093 2024-09-10T06:27:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381097+0000", 2024-09-10T06:27:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086022300000000002 2024-09-10T06:27:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381181+0000", 2024-09-10T06:27:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3973000000000004e-05 2024-09-10T06:27:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381240+0000", 2024-09-10T06:27:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9472999999999998e-05 2024-09-10T06:27:40.039 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.592605919, 2024-09-10T06:27:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031998719999999999, 2024-09-10T06:27:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.040 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.041 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 233 2024-09-10T06:27:40.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.041 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:40.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:40.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409639+0000", 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4770000000000002e-06 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409652+0000", 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3692999999999999e-05 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409683+0000", 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1080000000000001e-05 2024-09-10T06:27:40.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409699+0000", 2024-09-10T06:27:40.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5245999999999999e-05 2024-09-10T06:27:40.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409881+0000", 2024-09-10T06:27:40.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000182709 2024-09-10T06:27:40.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410088+0000", 2024-09-10T06:27:40.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020630799999999999 2024-09-10T06:27:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410495+0000", 2024-09-10T06:27:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00040682700000000001 2024-09-10T06:27:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.411805+0000", 2024-09-10T06:27:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013101059999999999 2024-09-10T06:27:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412672+0000", 2024-09-10T06:27:40.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086778699999999996 2024-09-10T06:27:40.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412769+0000", 2024-09-10T06:27:40.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6565999999999997e-05 2024-09-10T06:27:40.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412836+0000", 2024-09-10T06:27:40.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7073e-05 2024-09-10T06:27:40.045 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.045 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.045 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.046 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:353 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.046 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:40.046 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.551698604999999, 2024-09-10T06:27:40.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059710450000000003, 2024-09-10T06:27:40.046 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.046 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.046 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.046 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.046 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.046 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.046 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 353 2024-09-10T06:27:40.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.047 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:40.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:40.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450545+0000", 2024-09-10T06:27:40.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.423e-06 2024-09-10T06:27:40.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450551+0000", 2024-09-10T06:27:40.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7370000000000003e-06 2024-09-10T06:27:40.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.048 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.048 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450565+0000", 2024-09-10T06:27:40.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4649e-05 2024-09-10T06:27:40.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450574+0000", 2024-09-10T06:27:40.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5129999999999996e-06 2024-09-10T06:27:40.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450644+0000", 2024-09-10T06:27:40.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0387000000000002e-05 2024-09-10T06:27:40.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450818+0000", 2024-09-10T06:27:40.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017368400000000001 2024-09-10T06:27:40.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451030+0000", 2024-09-10T06:27:40.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021189599999999999 2024-09-10T06:27:40.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451607+0000", 2024-09-10T06:27:40.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057672599999999995 2024-09-10T06:27:40.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456437+0000", 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048301940000000003 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456472+0000", 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5178000000000001e-05 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456515+0000", 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2657999999999997e-05 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.051 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.052 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:362 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.052 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:40.052 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.545251082999997, 2024-09-10T06:27:40.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044032239999999999, 2024-09-10T06:27:40.052 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.052 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.052 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.052 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.052 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.052 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.052 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 362 2024-09-10T06:27:40.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.053 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:40.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:40.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456992+0000", 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6700000000000002e-07 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456997+0000", 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6249999999999998e-06 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457005+0000", 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6719999999999993e-06 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457010+0000", 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7360000000000001e-06 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457054+0000", 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4138999999999999e-05 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457163+0000", 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108558 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457340+0000", 2024-09-10T06:27:40.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017730600000000001 2024-09-10T06:27:40.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.458065+0000", 2024-09-10T06:27:40.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00072480400000000001 2024-09-10T06:27:40.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461294+0000", 2024-09-10T06:27:40.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032287890000000001 2024-09-10T06:27:40.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461352+0000", 2024-09-10T06:27:40.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8502000000000003e-05 2024-09-10T06:27:40.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461394+0000", 2024-09-10T06:27:40.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2225999999999999e-05 2024-09-10T06:27:40.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.057 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.057 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:475 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.499401517999999, 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046091930000000001, 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 475 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6100000000000001e-07 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502844+0000", 2024-09-10T06:27:40.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0529999999999998e-06 2024-09-10T06:27:40.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502852+0000", 2024-09-10T06:27:40.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2579999999999995e-06 2024-09-10T06:27:40.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.060 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502857+0000", 2024-09-10T06:27:40.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3460000000000004e-06 2024-09-10T06:27:40.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502894+0000", 2024-09-10T06:27:40.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6884000000000001e-05 2024-09-10T06:27:40.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502942+0000", 2024-09-10T06:27:40.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7791999999999999e-05 2024-09-10T06:27:40.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.503048+0000", 2024-09-10T06:27:40.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010678799999999999 2024-09-10T06:27:40.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.506079+0000", 2024-09-10T06:27:40.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030311510000000002 2024-09-10T06:27:40.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507361+0000", 2024-09-10T06:27:40.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001281208 2024-09-10T06:27:40.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507400+0000", 2024-09-10T06:27:40.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9483000000000001e-05 2024-09-10T06:27:40.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507450+0000", 2024-09-10T06:27:40.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9669000000000002e-05 2024-09-10T06:27:40.063 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.063 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.063 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.064 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:477 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.064 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:40.064 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.497440400999999, 2024-09-10T06:27:40.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038544, 2024-09-10T06:27:40.064 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.064 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.064 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.064 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.064 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 477 2024-09-10T06:27:40.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.064 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:40.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:40.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504803+0000", 2024-09-10T06:27:40.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9999999999999996e-07 2024-09-10T06:27:40.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504808+0000", 2024-09-10T06:27:40.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1909999999999999e-06 2024-09-10T06:27:40.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.066 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504818+0000", 2024-09-10T06:27:40.066 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0081999999999999e-05 2024-09-10T06:27:40.066 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.066 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.066 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504823+0000", 2024-09-10T06:27:40.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9969999999999998e-06 2024-09-10T06:27:40.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504870+0000", 2024-09-10T06:27:40.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6980000000000001e-05 2024-09-10T06:27:40.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.067 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.067 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.067 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504922+0000", 2024-09-10T06:27:40.067 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869000000000001e-05 2024-09-10T06:27:40.067 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505020+0000", 2024-09-10T06:27:40.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8010999999999994e-05 2024-09-10T06:27:40.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.068 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507789+0000", 2024-09-10T06:27:40.068 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027690219999999999 2024-09-10T06:27:40.068 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.068 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.068 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508599+0000", 2024-09-10T06:27:40.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081037800000000005 2024-09-10T06:27:40.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.069 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.069 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508631+0000", 2024-09-10T06:27:40.069 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.137e-05 2024-09-10T06:27:40.069 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.069 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.070 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.070 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508656+0000", 2024-09-10T06:27:40.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5599999999999999e-05 2024-09-10T06:27:40.070 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.070 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.070 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.070 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.070 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.070 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:478 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.070 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:40.070 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.497393498999998, 2024-09-10T06:27:40.070 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039361880000000002, 2024-09-10T06:27:40.070 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.071 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.071 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.071 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.071 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.071 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.071 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 478 2024-09-10T06:27:40.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.071 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.071 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.071 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.071 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:40.071 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.071 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:40.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:40.072 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7800000000000001e-07 2024-09-10T06:27:40.072 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.072 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.072 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.072 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504853+0000", 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2780000000000002e-06 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504858+0000", 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7359999999999998e-06 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504862+0000", 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6650000000000001e-06 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.073 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504938+0000", 2024-09-10T06:27:40.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6286999999999997e-05 2024-09-10T06:27:40.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505091+0000", 2024-09-10T06:27:40.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152385 2024-09-10T06:27:40.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.074 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:40.074 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505335+0000", 2024-09-10T06:27:40.074 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244281 2024-09-10T06:27:40.074 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.074 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507764+0000", 2024-09-10T06:27:40.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002429624 2024-09-10T06:27:40.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508681+0000", 2024-09-10T06:27:40.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00091630100000000001 2024-09-10T06:27:40.075 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.075 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.075 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.075 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508747+0000", 2024-09-10T06:27:40.075 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5733000000000002e-05 2024-09-10T06:27:40.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.076 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.076 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508785+0000", 2024-09-10T06:27:40.076 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8319999999999999e-05 2024-09-10T06:27:40.076 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.076 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.076 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.076 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.076 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.076 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.076 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:40.076 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.251261579000001, 2024-09-10T06:27:40.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030732350000000001, 2024-09-10T06:27:40.077 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.077 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.077 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.077 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.077 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.077 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.077 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 733 2024-09-10T06:27:40.077 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.077 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.077 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.077 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.077 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:40.077 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750983+0000", 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8880000000000001e-06 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750996+0000", 2024-09-10T06:27:40.078 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2048999999999999e-05 2024-09-10T06:27:40.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751024+0000", 2024-09-10T06:27:40.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8802e-05 2024-09-10T06:27:40.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.079 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751043+0000", 2024-09-10T06:27:40.079 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8266000000000001e-05 2024-09-10T06:27:40.079 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.079 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.079 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751191+0000", 2024-09-10T06:27:40.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014818200000000001 2024-09-10T06:27:40.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751417+0000", 2024-09-10T06:27:40.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022648199999999999 2024-09-10T06:27:40.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.080 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.080 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.080 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751747+0000", 2024-09-10T06:27:40.080 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032945000000000001 2024-09-10T06:27:40.080 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.752752+0000", 2024-09-10T06:27:40.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010054790000000001 2024-09-10T06:27:40.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753896+0000", 2024-09-10T06:27:40.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001143638 2024-09-10T06:27:40.081 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.081 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.081 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.081 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753989+0000", 2024-09-10T06:27:40.081 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3466000000000003e-05 2024-09-10T06:27:40.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.082 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.082 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.754054+0000", 2024-09-10T06:27:40.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4533e-05 2024-09-10T06:27:40.082 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.082 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.082 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.082 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.082 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.082 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.082 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:40.082 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.210781033000004, 2024-09-10T06:27:40.082 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002896722, 2024-09-10T06:27:40.083 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.083 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.083 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.083 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.083 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.083 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.083 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 751 2024-09-10T06:27:40.083 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.083 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.083 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.083 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.083 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:40.083 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:40.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791464+0000", 2024-09-10T06:27:40.084 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7140000000000002e-06 2024-09-10T06:27:40.084 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.084 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.084 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.084 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791475+0000", 2024-09-10T06:27:40.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1535999999999999e-05 2024-09-10T06:27:40.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791501+0000", 2024-09-10T06:27:40.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5276e-05 2024-09-10T06:27:40.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.085 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.085 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791514+0000", 2024-09-10T06:27:40.085 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3203e-05 2024-09-10T06:27:40.085 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.085 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791643+0000", 2024-09-10T06:27:40.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012961900000000001 2024-09-10T06:27:40.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791857+0000", 2024-09-10T06:27:40.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021351599999999999 2024-09-10T06:27:40.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.086 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.086 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.086 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.792178+0000", 2024-09-10T06:27:40.086 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032090999999999999 2024-09-10T06:27:40.086 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.793281+0000", 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001103319 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794209+0000", 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000927676 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794295+0000", 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5682999999999999e-05 2024-09-10T06:27:40.087 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.088 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.088 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794358+0000", 2024-09-10T06:27:40.088 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3269999999999996e-05 2024-09-10T06:27:40.088 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.088 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.088 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.088 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.088 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.088 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.088 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:40.088 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.206893536000003, 2024-09-10T06:27:40.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030558059999999999, 2024-09-10T06:27:40.089 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.089 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.089 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.089 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.089 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.089 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.089 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 753 2024-09-10T06:27:40.089 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.089 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.089 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.089 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.089 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:40.089 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:40.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795352+0000", 2024-09-10T06:27:40.090 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0130000000000002e-06 2024-09-10T06:27:40.090 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.090 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.090 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.090 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795364+0000", 2024-09-10T06:27:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1939999999999999e-05 2024-09-10T06:27:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795395+0000", 2024-09-10T06:27:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0976999999999998e-05 2024-09-10T06:27:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795413+0000", 2024-09-10T06:27:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7980000000000001e-05 2024-09-10T06:27:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.091 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795533+0000", 2024-09-10T06:27:40.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120732 2024-09-10T06:27:40.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795665+0000", 2024-09-10T06:27:40.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013215899999999999 2024-09-10T06:27:40.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.092 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.092 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.092 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795931+0000", 2024-09-10T06:27:40.092 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026536499999999999 2024-09-10T06:27:40.092 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.796995+0000", 2024-09-10T06:27:40.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001064611 2024-09-10T06:27:40.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798256+0000", 2024-09-10T06:27:40.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00126022 2024-09-10T06:27:40.093 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.093 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.093 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.093 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798340+0000", 2024-09-10T06:27:40.093 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4753000000000007e-05 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798404+0000", 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4055999999999998e-05 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.091685294999998, 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031632380000000001, 2024-09-10T06:27:40.094 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 805 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.095 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:40.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910560+0000", 2024-09-10T06:27:40.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2200000000000001e-06 2024-09-10T06:27:40.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.096 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.096 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.096 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910574+0000", 2024-09-10T06:27:40.096 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3536000000000001e-05 2024-09-10T06:27:40.096 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910604+0000", 2024-09-10T06:27:40.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0645999999999998e-05 2024-09-10T06:27:40.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910619+0000", 2024-09-10T06:27:40.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5064e-05 2024-09-10T06:27:40.097 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.097 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.097 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.097 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910759+0000", 2024-09-10T06:27:40.097 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013943899999999999 2024-09-10T06:27:40.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910984+0000", 2024-09-10T06:27:40.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000225381 2024-09-10T06:27:40.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.098 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.911312+0000", 2024-09-10T06:27:40.098 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032782800000000001 2024-09-10T06:27:40.098 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.098 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.098 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.912402+0000", 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010895639999999999 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913576+0000", 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174591 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913657+0000", 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1223000000000005e-05 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.099 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913720+0000", 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2745999999999999e-05 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.031907560000001, 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030680099999999999, 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.100 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.101 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.101 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 832 2024-09-10T06:27:40.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.101 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:40.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.101 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.101 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.101 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.101 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:40.101 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970337+0000", 2024-09-10T06:27:40.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6230000000000001e-06 2024-09-10T06:27:40.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.102 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970349+0000", 2024-09-10T06:27:40.102 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1557e-05 2024-09-10T06:27:40.102 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.102 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.102 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970379+0000", 2024-09-10T06:27:40.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0456000000000001e-05 2024-09-10T06:27:40.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970394+0000", 2024-09-10T06:27:40.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4683e-05 2024-09-10T06:27:40.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.103 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.103 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970509+0000", 2024-09-10T06:27:40.103 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114613 2024-09-10T06:27:40.103 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.103 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970753+0000", 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244295 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.971078+0000", 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000325583 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.972162+0000", 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010834519999999999 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.104 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973200+0000", 2024-09-10T06:27:40.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010376560000000001 2024-09-10T06:27:40.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973287+0000", 2024-09-10T06:27:40.105 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7163000000000006e-05 2024-09-10T06:27:40.105 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.105 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.105 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.105 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973403+0000", 2024-09-10T06:27:40.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011592899999999999 2024-09-10T06:27:40.106 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.106 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.106 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.106 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.106 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.106 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.106 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:40.106 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 57.876836333, 2024-09-10T06:27:40.106 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030018599999999999, 2024-09-10T06:27:40.106 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.106 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.106 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.106 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.107 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.107 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 901 2024-09-10T06:27:40.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.107 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:40.107 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.107 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.107 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.107 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.107 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:40.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125409+0000", 2024-09-10T06:27:40.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.253e-06 2024-09-10T06:27:40.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.108 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125425+0000", 2024-09-10T06:27:40.108 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5636000000000001e-05 2024-09-10T06:27:40.108 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.108 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.108 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125456+0000", 2024-09-10T06:27:40.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1130000000000002e-05 2024-09-10T06:27:40.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125470+0000", 2024-09-10T06:27:40.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.464e-05 2024-09-10T06:27:40.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.109 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.109 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125581+0000", 2024-09-10T06:27:40.109 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110612 2024-09-10T06:27:40.109 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.109 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125814+0000", 2024-09-10T06:27:40.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023266899999999999 2024-09-10T06:27:40.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.126159+0000", 2024-09-10T06:27:40.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034565399999999998 2024-09-10T06:27:40.110 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.110 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.110 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.110 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.127161+0000", 2024-09-10T06:27:40.110 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010020890000000001 2024-09-10T06:27:40.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128202+0000", 2024-09-10T06:27:40.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001040242 2024-09-10T06:27:40.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.111 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128288+0000", 2024-09-10T06:27:40.111 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6156000000000007e-05 2024-09-10T06:27:40.111 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.111 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.111 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.112 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128408+0000", 2024-09-10T06:27:40.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011977900000000001 2024-09-10T06:27:40.112 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.112 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.112 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.112 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.112 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.112 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.112 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:40.112 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 57.842743964, 2024-09-10T06:27:40.112 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029016649999999999, 2024-09-10T06:27:40.112 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.112 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.113 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.113 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.113 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.113 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.113 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 916 2024-09-10T06:27:40.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.113 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.113 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.113 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:40.113 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.113 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.113 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:40.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159501+0000", 2024-09-10T06:27:40.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:40.114 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.114 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.114 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.114 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159512+0000", 2024-09-10T06:27:40.114 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1564e-05 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159543+0000", 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0942999999999998e-05 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159558+0000", 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.436e-05 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159701+0000", 2024-09-10T06:27:40.115 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014363599999999999 2024-09-10T06:27:40.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159927+0000", 2024-09-10T06:27:40.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022535099999999999 2024-09-10T06:27:40.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.116 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.160260+0000", 2024-09-10T06:27:40.116 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033321700000000002 2024-09-10T06:27:40.116 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.116 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.116 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.161312+0000", 2024-09-10T06:27:40.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001052222 2024-09-10T06:27:40.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162261+0000", 2024-09-10T06:27:40.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00094912600000000001 2024-09-10T06:27:40.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.117 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.117 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.117 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162337+0000", 2024-09-10T06:27:40.117 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6268999999999998e-05 2024-09-10T06:27:40.117 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.118 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.118 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162400+0000", 2024-09-10T06:27:40.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2477000000000005e-05 2024-09-10T06:27:40.118 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.118 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.118 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.118 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.118 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.118 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.118 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:40.118 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 57.772434453000002, 2024-09-10T06:27:40.118 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030045179999999999, 2024-09-10T06:27:40.118 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.119 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.119 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.119 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.119 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 946 2024-09-10T06:27:40.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.119 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.119 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.119 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:40.119 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.119 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.119 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:40.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229810+0000", 2024-09-10T06:27:40.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:27:40.120 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.120 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.120 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.120 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229838+0000", 2024-09-10T06:27:40.120 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7776e-05 2024-09-10T06:27:40.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229869+0000", 2024-09-10T06:27:40.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0766999999999999e-05 2024-09-10T06:27:40.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229883+0000", 2024-09-10T06:27:40.121 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4423000000000001e-05 2024-09-10T06:27:40.121 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.121 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.121 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.121 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230005+0000", 2024-09-10T06:27:40.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121919 2024-09-10T06:27:40.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230219+0000", 2024-09-10T06:27:40.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000214098 2024-09-10T06:27:40.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.122 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230588+0000", 2024-09-10T06:27:40.122 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036857099999999999 2024-09-10T06:27:40.122 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.122 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.122 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.231707+0000", 2024-09-10T06:27:40.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011193349999999999 2024-09-10T06:27:40.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232662+0000", 2024-09-10T06:27:40.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095513300000000005 2024-09-10T06:27:40.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.123 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.123 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.123 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232748+0000", 2024-09-10T06:27:40.123 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6151999999999998e-05 2024-09-10T06:27:40.123 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.124 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.124 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232812+0000", 2024-09-10T06:27:40.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3876999999999998e-05 2024-09-10T06:27:40.124 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.124 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.124 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.124 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.124 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.124 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:40.126 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:27:40.126 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:40.125+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:40.226 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:40.225+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:40.327 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:40.325+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:40.338 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:40.338 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:40.338 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:40.339 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:40.357 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:27:40.445 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:40.445+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:40.529 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:40.525+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:40.570 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:40.570 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:40.571 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:40.571 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:40.571 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:40.589 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:27:40.633 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:40.633+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:40.731 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:40.729+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:40.804 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T06:27:40.805 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:40.805 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:40.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:40.806 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:40.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.806 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4236.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T06:27:40.806 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:40.806 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.295052717000004, 2024-09-10T06:27:40.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049682550000000004, 2024-09-10T06:27:40.806 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.806 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.806 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.806 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:40.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:40.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507427+0000", 2024-09-10T06:27:40.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5629999999999999e-06 2024-09-10T06:27:40.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507439+0000", 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.19e-05 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507460+0000", 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1693000000000001e-05 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507480+0000", 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9947000000000001e-05 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507613+0000", 2024-09-10T06:27:40.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000132409 2024-09-10T06:27:40.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507696+0000", 2024-09-10T06:27:40.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2953000000000004e-05 2024-09-10T06:27:40.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512288+0000", 2024-09-10T06:27:40.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045927110000000002 2024-09-10T06:27:40.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512393+0000", 2024-09-10T06:27:40.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105079 2024-09-10T06:27:40.810 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.810 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.810 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.810 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:40.810 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:40.810 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.471588685, 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025692739999999999, 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 42 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:40.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330891+0000", 2024-09-10T06:27:40.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9700000000000002e-06 2024-09-10T06:27:40.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330901+0000", 2024-09-10T06:27:40.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2909999999999996e-06 2024-09-10T06:27:40.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330924+0000", 2024-09-10T06:27:40.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3132000000000001e-05 2024-09-10T06:27:40.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330935+0000", 2024-09-10T06:27:40.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0893999999999999e-05 2024-09-10T06:27:40.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331021+0000", 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6205000000000006e-05 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331160+0000", 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013973600000000001 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331336+0000", 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017578799999999999 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.332381+0000", 2024-09-10T06:27:40.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001044627 2024-09-10T06:27:40.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333371+0000", 2024-09-10T06:27:40.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098979800000000007 2024-09-10T06:27:40.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333421+0000", 2024-09-10T06:27:40.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9872e-05 2024-09-10T06:27:40.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333459+0000", 2024-09-10T06:27:40.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7960999999999998e-05 2024-09-10T06:27:40.816 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.816 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.816 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.816 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:40.816 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:40.816 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 62.486397765, 2024-09-10T06:27:40.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025247730000000001, 2024-09-10T06:27:40.816 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.816 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.816 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.817 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.817 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.817 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.817 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 52 2024-09-10T06:27:40.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.817 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:40.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:40.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316084+0000", 2024-09-10T06:27:40.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8260000000000003e-06 2024-09-10T06:27:40.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316095+0000", 2024-09-10T06:27:40.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1229999999999999e-05 2024-09-10T06:27:40.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316131+0000", 2024-09-10T06:27:40.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5499e-05 2024-09-10T06:27:40.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316150+0000", 2024-09-10T06:27:40.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9510000000000001e-05 2024-09-10T06:27:40.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316275+0000", 2024-09-10T06:27:40.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012501600000000001 2024-09-10T06:27:40.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316507+0000", 2024-09-10T06:27:40.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000231404 2024-09-10T06:27:40.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:40.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316712+0000", 2024-09-10T06:27:40.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204873 2024-09-10T06:27:40.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.820 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.820 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.317603+0000", 2024-09-10T06:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089174399999999998 2024-09-10T06:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318470+0000", 2024-09-10T06:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086713399999999998 2024-09-10T06:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318552+0000", 2024-09-10T06:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1279999999999994e-05 2024-09-10T06:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318605+0000", 2024-09-10T06:27:40.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3257000000000002e-05 2024-09-10T06:27:40.822 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.822 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.822 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.822 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.822 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:40.822 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.382619435999999, 2024-09-10T06:27:40.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033383480000000001, 2024-09-10T06:27:40.822 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.822 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.823 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.823 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.823 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.823 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.823 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 236 2024-09-10T06:27:40.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.823 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:40.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:40.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419861+0000", 2024-09-10T06:27:40.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.734e-06 2024-09-10T06:27:40.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419873+0000", 2024-09-10T06:27:40.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1789e-05 2024-09-10T06:27:40.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419904+0000", 2024-09-10T06:27:40.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1377000000000001e-05 2024-09-10T06:27:40.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419921+0000", 2024-09-10T06:27:40.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6878999999999999e-05 2024-09-10T06:27:40.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420052+0000", 2024-09-10T06:27:40.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013025600000000001 2024-09-10T06:27:40.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420263+0000", 2024-09-10T06:27:40.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021196600000000001 2024-09-10T06:27:40.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:40.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420649+0000", 2024-09-10T06:27:40.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038507 2024-09-10T06:27:40.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.422366+0000", 2024-09-10T06:27:40.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017172000000000001 2024-09-10T06:27:40.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423048+0000", 2024-09-10T06:27:40.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00068254100000000005 2024-09-10T06:27:40.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423127+0000", 2024-09-10T06:27:40.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8207000000000005e-05 2024-09-10T06:27:40.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423197+0000", 2024-09-10T06:27:40.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0328999999999997e-05 2024-09-10T06:27:40.828 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.828 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.828 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.828 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.828 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:40.828 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.366018162000003, 2024-09-10T06:27:40.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003575235, 2024-09-10T06:27:40.828 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.828 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.829 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.829 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.829 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.829 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.829 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 299 2024-09-10T06:27:40.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.829 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:40.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:40.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436461+0000", 2024-09-10T06:27:40.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.144e-06 2024-09-10T06:27:40.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436466+0000", 2024-09-10T06:27:40.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8409999999999999e-06 2024-09-10T06:27:40.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436477+0000", 2024-09-10T06:27:40.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1253000000000001e-05 2024-09-10T06:27:40.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436483+0000", 2024-09-10T06:27:40.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7010000000000001e-06 2024-09-10T06:27:40.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436527+0000", 2024-09-10T06:27:40.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4381000000000001e-05 2024-09-10T06:27:40.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436569+0000", 2024-09-10T06:27:40.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2208e-05 2024-09-10T06:27:40.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:40.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436687+0000", 2024-09-10T06:27:40.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118093 2024-09-10T06:27:40.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.437455+0000", 2024-09-10T06:27:40.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076799599999999996 2024-09-10T06:27:40.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439950+0000", 2024-09-10T06:27:40.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024946040000000001 2024-09-10T06:27:40.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439988+0000", 2024-09-10T06:27:40.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8405999999999998e-05 2024-09-10T06:27:40.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.440035+0000", 2024-09-10T06:27:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6607999999999998e-05 2024-09-10T06:27:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.031342080000002, 2024-09-10T06:27:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028833040000000002, 2024-09-10T06:27:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.834 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.835 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.835 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.835 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.835 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.835 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 742 2024-09-10T06:27:40.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.835 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:40.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:40.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771139+0000", 2024-09-10T06:27:40.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5269999999999999e-06 2024-09-10T06:27:40.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771153+0000", 2024-09-10T06:27:40.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4036000000000001e-05 2024-09-10T06:27:40.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771186+0000", 2024-09-10T06:27:40.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2113000000000002e-05 2024-09-10T06:27:40.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771201+0000", 2024-09-10T06:27:40.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:40.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771320+0000", 2024-09-10T06:27:40.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119265 2024-09-10T06:27:40.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771557+0000", 2024-09-10T06:27:40.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023640600000000001 2024-09-10T06:27:40.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:40.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771890+0000", 2024-09-10T06:27:40.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033302000000000001 2024-09-10T06:27:40.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773204+0000", 2024-09-10T06:27:40.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013142239999999999 2024-09-10T06:27:40.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773864+0000", 2024-09-10T06:27:40.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066005100000000004 2024-09-10T06:27:40.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773948+0000", 2024-09-10T06:27:40.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4625999999999999e-05 2024-09-10T06:27:40.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774019+0000", 2024-09-10T06:27:40.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0705999999999997e-05 2024-09-10T06:27:40.840 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.840 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.840 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.840 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.840 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:40.840 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.027562830000001, 2024-09-10T06:27:40.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025263479999999999, 2024-09-10T06:27:40.841 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.841 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.841 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.841 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.841 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.841 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.841 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 744 2024-09-10T06:27:40.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.841 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:40.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:40.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774917+0000", 2024-09-10T06:27:40.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0540000000000002e-06 2024-09-10T06:27:40.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774926+0000", 2024-09-10T06:27:40.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5660000000000007e-06 2024-09-10T06:27:40.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774947+0000", 2024-09-10T06:27:40.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0852999999999998e-05 2024-09-10T06:27:40.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774958+0000", 2024-09-10T06:27:40.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1216999999999999e-05 2024-09-10T06:27:40.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775045+0000", 2024-09-10T06:27:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7643000000000001e-05 2024-09-10T06:27:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775167+0000", 2024-09-10T06:27:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012163900000000001 2024-09-10T06:27:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775427+0000", 2024-09-10T06:27:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000259678 2024-09-10T06:27:40.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.776736+0000", 2024-09-10T06:27:40.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013093429999999999 2024-09-10T06:27:40.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777296+0000", 2024-09-10T06:27:40.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056029599999999995 2024-09-10T06:27:40.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777374+0000", 2024-09-10T06:27:40.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7721999999999999e-05 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777441+0000", 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7336999999999996e-05 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.990247283999999, 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036412979999999998, 2024-09-10T06:27:40.846 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 760 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:40.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812233+0000", 2024-09-10T06:27:40.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:40.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812244+0000", 2024-09-10T06:27:40.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1273e-05 2024-09-10T06:27:40.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812276+0000", 2024-09-10T06:27:40.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1253e-05 2024-09-10T06:27:40.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812290+0000", 2024-09-10T06:27:40.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4576000000000001e-05 2024-09-10T06:27:40.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812438+0000", 2024-09-10T06:27:40.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014775899999999999 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812821+0000", 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000383187 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.813398+0000", 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000576619 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.814658+0000", 2024-09-10T06:27:40.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001260207 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815591+0000", 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00093332899999999999 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815745+0000", 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153392 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815872+0000", 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012715599999999999 2024-09-10T06:27:40.851 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.852 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.852 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.852 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.852 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:40.852 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.985611900000002, 2024-09-10T06:27:40.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029417369999999998, 2024-09-10T06:27:40.852 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.852 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.852 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.852 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.852 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.853 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.853 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 762 2024-09-10T06:27:40.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.853 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:40.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:40.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816868+0000", 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.283e-06 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816879+0000", 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0523000000000001e-05 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816910+0000", 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0732999999999999e-05 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816926+0000", 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.677e-05 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817058+0000", 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013195599999999999 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817299+0000", 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000241091 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:40.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817761+0000", 2024-09-10T06:27:40.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046188400000000003 2024-09-10T06:27:40.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.818948+0000", 2024-09-10T06:27:40.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:40.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.856 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819662+0000", 2024-09-10T06:27:40.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071398399999999997 2024-09-10T06:27:40.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819745+0000", 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3560000000000006e-05 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819808+0000", 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2329000000000006e-05 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.857 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.865151183000002, 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002834175, 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 817 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:40.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937330+0000", 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9869999999999999e-06 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937342+0000", 2024-09-10T06:27:40.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2595999999999999e-05 2024-09-10T06:27:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937375+0000", 2024-09-10T06:27:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2320000000000002e-05 2024-09-10T06:27:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937390+0000", 2024-09-10T06:27:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4977000000000001e-05 2024-09-10T06:27:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937529+0000", 2024-09-10T06:27:40.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013937199999999999 2024-09-10T06:27:40.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937753+0000", 2024-09-10T06:27:40.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000224358 2024-09-10T06:27:40.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:40.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.938061+0000", 2024-09-10T06:27:40.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030808799999999998 2024-09-10T06:27:40.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.939112+0000", 2024-09-10T06:27:40.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010503050000000001 2024-09-10T06:27:40.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940005+0000", 2024-09-10T06:27:40.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089366599999999999 2024-09-10T06:27:40.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940093+0000", 2024-09-10T06:27:40.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8053000000000006e-05 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940161+0000", 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7453000000000006e-05 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.812223140999997, 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027552649999999998, 2024-09-10T06:27:40.863 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.864 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.864 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.864 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.864 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 841 2024-09-10T06:27:40.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.864 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:40.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:40.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990257+0000", 2024-09-10T06:27:40.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6869999999999999e-06 2024-09-10T06:27:40.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990270+0000", 2024-09-10T06:27:40.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2843000000000001e-05 2024-09-10T06:27:40.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990300+0000", 2024-09-10T06:27:40.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9252999999999999e-05 2024-09-10T06:27:40.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990314+0000", 2024-09-10T06:27:40.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4796e-05 2024-09-10T06:27:40.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990427+0000", 2024-09-10T06:27:40.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112649 2024-09-10T06:27:40.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990671+0000", 2024-09-10T06:27:40.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244408 2024-09-10T06:27:40.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:40.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990987+0000", 2024-09-10T06:27:40.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031593099999999998 2024-09-10T06:27:40.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992073+0000", 2024-09-10T06:27:40.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010854549999999999 2024-09-10T06:27:40.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992862+0000", 2024-09-10T06:27:40.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00078889400000000005 2024-09-10T06:27:40.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992944+0000", 2024-09-10T06:27:40.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2152999999999998e-05 2024-09-10T06:27:40.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.869 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.869 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993010+0000", 2024-09-10T06:27:40.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6196000000000001e-05 2024-09-10T06:27:40.869 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.869 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.869 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.869 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.869 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.869 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:40.869 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.808487206999999, 2024-09-10T06:27:40.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025373539999999999, 2024-09-10T06:27:40.869 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 843 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:40.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993993+0000", 2024-09-10T06:27:40.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3630000000000001e-06 2024-09-10T06:27:40.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994004+0000", 2024-09-10T06:27:40.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0557000000000001e-05 2024-09-10T06:27:40.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994035+0000", 2024-09-10T06:27:40.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0969000000000001e-05 2024-09-10T06:27:40.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994055+0000", 2024-09-10T06:27:40.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0497e-05 2024-09-10T06:27:40.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994150+0000", 2024-09-10T06:27:40.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5363000000000002e-05 2024-09-10T06:27:40.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994275+0000", 2024-09-10T06:27:40.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012453200000000001 2024-09-10T06:27:40.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:40.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994570+0000", 2024-09-10T06:27:40.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029522100000000003 2024-09-10T06:27:40.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.995569+0000", 2024-09-10T06:27:40.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00099913200000000001 2024-09-10T06:27:40.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996384+0000", 2024-09-10T06:27:40.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081451099999999997 2024-09-10T06:27:40.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996462+0000", 2024-09-10T06:27:40.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8502000000000002e-05 2024-09-10T06:27:40.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996528+0000", 2024-09-10T06:27:40.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5707e-05 2024-09-10T06:27:40.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.875 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.875 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.875 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:40.876 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.799040060000003, 2024-09-10T06:27:40.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033145539999999999, 2024-09-10T06:27:40.876 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.876 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.876 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.876 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 847 2024-09-10T06:27:40.876 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.876 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.876 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.876 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003440+0000", 2024-09-10T06:27:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5299999999999999e-06 2024-09-10T06:27:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003452+0000", 2024-09-10T06:27:40.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:40.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003482+0000", 2024-09-10T06:27:40.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0790000000000002e-05 2024-09-10T06:27:40.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003497+0000", 2024-09-10T06:27:40.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.489e-05 2024-09-10T06:27:40.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003645+0000", 2024-09-10T06:27:40.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014771900000000001 2024-09-10T06:27:40.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003996+0000", 2024-09-10T06:27:40.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000350861 2024-09-10T06:27:40.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:40.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.004540+0000", 2024-09-10T06:27:40.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054383199999999995 2024-09-10T06:27:40.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.005831+0000", 2024-09-10T06:27:40.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001291366 2024-09-10T06:27:40.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006461+0000", 2024-09-10T06:27:40.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062943899999999998 2024-09-10T06:27:40.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006631+0000", 2024-09-10T06:27:40.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000170228 2024-09-10T06:27:40.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006752+0000", 2024-09-10T06:27:40.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012160899999999999 2024-09-10T06:27:40.881 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.881 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.881 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.881 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.881 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:40.881 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.794786893000001, 2024-09-10T06:27:40.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002619953, 2024-09-10T06:27:40.882 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.882 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.882 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.882 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.882 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.882 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.882 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 849 2024-09-10T06:27:40.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.882 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:40.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007693+0000", 2024-09-10T06:27:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3099999999999999e-06 2024-09-10T06:27:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007704+0000", 2024-09-10T06:27:40.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0387000000000001e-05 2024-09-10T06:27:40.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007734+0000", 2024-09-10T06:27:40.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0676000000000002e-05 2024-09-10T06:27:40.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.884 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007753+0000", 2024-09-10T06:27:40.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.836e-05 2024-09-10T06:27:40.884 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.884 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.884 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007857+0000", 2024-09-10T06:27:40.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103836 2024-09-10T06:27:40.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007980+0000", 2024-09-10T06:27:40.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123843 2024-09-10T06:27:40.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:40.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.008241+0000", 2024-09-10T06:27:40.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026085799999999999 2024-09-10T06:27:40.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.009475+0000", 2024-09-10T06:27:40.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012340230000000001 2024-09-10T06:27:40.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010168+0000", 2024-09-10T06:27:40.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00069220800000000004 2024-09-10T06:27:40.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010247+0000", 2024-09-10T06:27:40.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9929e-05 2024-09-10T06:27:40.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010311+0000", 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3522999999999995e-05 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.750307071999998, 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026646590000000002, 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.887 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.888 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.888 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.888 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 868 2024-09-10T06:27:40.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.888 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:40.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052173+0000", 2024-09-10T06:27:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-10T06:27:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052186+0000", 2024-09-10T06:27:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2787e-05 2024-09-10T06:27:40.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052216+0000", 2024-09-10T06:27:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9618999999999999e-05 2024-09-10T06:27:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052231+0000", 2024-09-10T06:27:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4929999999999999e-05 2024-09-10T06:27:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052349+0000", 2024-09-10T06:27:40.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011830200000000001 2024-09-10T06:27:40.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052561+0000", 2024-09-10T06:27:40.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000212182 2024-09-10T06:27:40.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:40.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052874+0000", 2024-09-10T06:27:40.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031299399999999998 2024-09-10T06:27:40.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.891 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.891 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.891 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054049+0000", 2024-09-10T06:27:40.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174825 2024-09-10T06:27:40.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054635+0000", 2024-09-10T06:27:40.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058643900000000001 2024-09-10T06:27:40.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054721+0000", 2024-09-10T06:27:40.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5185999999999994e-05 2024-09-10T06:27:40.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054836+0000", 2024-09-10T06:27:40.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114922 2024-09-10T06:27:40.893 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.893 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.893 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.893 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.893 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:40.893 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.663650971000003, 2024-09-10T06:27:40.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028453739999999999, 2024-09-10T06:27:40.893 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.893 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 907 2024-09-10T06:27:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138830+0000", 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8600000000000001e-06 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138842+0000", 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2126e-05 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138874+0000", 2024-09-10T06:27:40.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2047e-05 2024-09-10T06:27:40.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138889+0000", 2024-09-10T06:27:40.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4966999999999999e-05 2024-09-10T06:27:40.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139007+0000", 2024-09-10T06:27:40.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118479 2024-09-10T06:27:40.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139238+0000", 2024-09-10T06:27:40.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023031399999999999 2024-09-10T06:27:40.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:40.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139566+0000", 2024-09-10T06:27:40.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032816099999999999 2024-09-10T06:27:40.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.897 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.897 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.140631+0000", 2024-09-10T06:27:40.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010653679999999999 2024-09-10T06:27:40.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141393+0000", 2024-09-10T06:27:40.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076187100000000001 2024-09-10T06:27:40.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141561+0000", 2024-09-10T06:27:40.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016755599999999999 2024-09-10T06:27:40.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141672+0000", 2024-09-10T06:27:40.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111625 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.659727455000002, 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002857268, 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.899 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.900 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 909 2024-09-10T06:27:40.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.900 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:40.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:40.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142753+0000", 2024-09-10T06:27:40.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4040000000000002e-06 2024-09-10T06:27:40.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142764+0000", 2024-09-10T06:27:40.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0789e-05 2024-09-10T06:27:40.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142795+0000", 2024-09-10T06:27:40.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0982999999999998e-05 2024-09-10T06:27:40.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142810+0000", 2024-09-10T06:27:40.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4960000000000001e-05 2024-09-10T06:27:40.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142908+0000", 2024-09-10T06:27:40.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8726000000000003e-05 2024-09-10T06:27:40.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143030+0000", 2024-09-10T06:27:40.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121649 2024-09-10T06:27:40.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:40.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143294+0000", 2024-09-10T06:27:40.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000263875 2024-09-10T06:27:40.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.144530+0000", 2024-09-10T06:27:40.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001236067 2024-09-10T06:27:40.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145340+0000", 2024-09-10T06:27:40.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080966700000000003 2024-09-10T06:27:40.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145497+0000", 2024-09-10T06:27:40.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015773499999999999 2024-09-10T06:27:40.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145608+0000", 2024-09-10T06:27:40.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110413 2024-09-10T06:27:40.904 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.566029958000001, 2024-09-10T06:27:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029166940000000001, 2024-09-10T06:27:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.905 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 949 2024-09-10T06:27:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236451+0000", 2024-09-10T06:27:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:27:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236464+0000", 2024-09-10T06:27:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3223e-05 2024-09-10T06:27:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236497+0000", 2024-09-10T06:27:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2672999999999997e-05 2024-09-10T06:27:40.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236515+0000", 2024-09-10T06:27:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8386999999999999e-05 2024-09-10T06:27:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236636+0000", 2024-09-10T06:27:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120752 2024-09-10T06:27:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236857+0000", 2024-09-10T06:27:40.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022134499999999999 2024-09-10T06:27:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.237188+0000", 2024-09-10T06:27:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033057799999999999 2024-09-10T06:27:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.238353+0000", 2024-09-10T06:27:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001164841 2024-09-10T06:27:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.909 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239160+0000", 2024-09-10T06:27:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080743000000000004 2024-09-10T06:27:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239245+0000", 2024-09-10T06:27:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5189e-05 2024-09-10T06:27:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239365+0000", 2024-09-10T06:27:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119406 2024-09-10T06:27:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.910 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.562168851000003, 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025033970000000001, 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 951 2024-09-10T06:27:40.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.912 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:40.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:40.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240311+0000", 2024-09-10T06:27:40.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8899999999999999e-06 2024-09-10T06:27:40.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240320+0000", 2024-09-10T06:27:40.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6799999999999999e-06 2024-09-10T06:27:40.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240341+0000", 2024-09-10T06:27:40.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1379e-05 2024-09-10T06:27:40.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240352+0000", 2024-09-10T06:27:40.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1354e-05 2024-09-10T06:27:40.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240450+0000", 2024-09-10T06:27:40.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7866000000000001e-05 2024-09-10T06:27:40.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240580+0000", 2024-09-10T06:27:40.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012970899999999999 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240851+0000", 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027059099999999998 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242052+0000", 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001201014 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242662+0000", 2024-09-10T06:27:40.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061076800000000003 2024-09-10T06:27:40.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242747+0000", 2024-09-10T06:27:40.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5019999999999996e-05 2024-09-10T06:27:40.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.916 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.916 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.916 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242812+0000", 2024-09-10T06:27:40.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5126e-05 2024-09-10T06:27:40.916 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.916 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.916 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.917 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:40.917 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:40.917 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 58.551719431999999, 2024-09-10T06:27:40.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027897120000000002, 2024-09-10T06:27:40.917 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:40.917 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:40.917 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:40.917 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:40.917 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:40.917 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:40.917 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 955 2024-09-10T06:27:40.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.918 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:40.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:40.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:40.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:40.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:40.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:40.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:40.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250761+0000", 2024-09-10T06:27:40.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:40.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:40.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250772+0000", 2024-09-10T06:27:40.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1153e-05 2024-09-10T06:27:40.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:40.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250802+0000", 2024-09-10T06:27:40.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-05 2024-09-10T06:27:40.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:40.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250817+0000", 2024-09-10T06:27:40.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4883e-05 2024-09-10T06:27:40.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:40.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250925+0000", 2024-09-10T06:27:40.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108249 2024-09-10T06:27:40.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:40.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251139+0000", 2024-09-10T06:27:40.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000213568 2024-09-10T06:27:40.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:40.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251450+0000", 2024-09-10T06:27:40.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031139200000000002 2024-09-10T06:27:40.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:40.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.252574+0000", 2024-09-10T06:27:40.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011239139999999999 2024-09-10T06:27:40.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:40.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253377+0000", 2024-09-10T06:27:40.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080306400000000003 2024-09-10T06:27:40.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253466+0000", 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8436000000000005e-05 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253548+0000", 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2496000000000004e-05 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:40.922 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:40.924 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:27:40.925 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:40.925+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:41.025 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:41.025+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:41.126 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:41.125+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:41.135 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:41.136 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:41.136 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:41.136 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:41.153 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:27:41.241 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:41.241+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:41.328 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:41.325+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:41.365 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:41.365 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:41.365 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:41.365 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:41.365 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:41.383 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:27:41.429 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:41.429+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:41.523 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-10T06:27:41.530 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:41.529+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:41.600 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:41.600 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:41.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:41.600 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:41.600 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.600 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:41.600 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:41.600 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.273932336000001, 2024-09-10T06:27:41.600 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030326279999999999, 2024-09-10T06:27:41.600 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.600 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.601 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.601 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.601 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.601 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.601 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 58 2024-09-10T06:27:41.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.601 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.601 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:41.601 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.601 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.601 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.601 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324169+0000", 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9020000000000004e-06 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.602 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324182+0000", 2024-09-10T06:27:41.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2166e-05 2024-09-10T06:27:41.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324190+0000", 2024-09-10T06:27:41.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.337e-06 2024-09-10T06:27:41.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.603 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.603 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324282+0000", 2024-09-10T06:27:41.603 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2331999999999996e-05 2024-09-10T06:27:41.603 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.603 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324486+0000", 2024-09-10T06:27:41.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020347400000000001 2024-09-10T06:27:41.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:41.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324719+0000", 2024-09-10T06:27:41.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023289900000000001 2024-09-10T06:27:41.604 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.604 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.604 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.604 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.325993+0000", 2024-09-10T06:27:41.604 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012746929999999999 2024-09-10T06:27:41.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327088+0000", 2024-09-10T06:27:41.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010947330000000001 2024-09-10T06:27:41.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.605 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327147+0000", 2024-09-10T06:27:41.605 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8677000000000001e-05 2024-09-10T06:27:41.605 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.605 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.605 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.606 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327195+0000", 2024-09-10T06:27:41.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8469e-05 2024-09-10T06:27:41.606 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.606 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.606 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.606 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.606 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.606 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:41.606 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:41.606 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.292111753999997, 2024-09-10T06:27:41.606 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003846917, 2024-09-10T06:27:41.606 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.606 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.606 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.607 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.607 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.607 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.607 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 207 2024-09-10T06:27:41.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.607 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.607 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:41.607 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.607 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.607 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.607 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:41.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305987+0000", 2024-09-10T06:27:41.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6069999999999999e-06 2024-09-10T06:27:41.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.608 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.608 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.608 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306002+0000", 2024-09-10T06:27:41.608 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5406000000000001e-05 2024-09-10T06:27:41.608 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306036+0000", 2024-09-10T06:27:41.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4146000000000001e-05 2024-09-10T06:27:41.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306061+0000", 2024-09-10T06:27:41.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4470000000000001e-05 2024-09-10T06:27:41.609 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.609 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.609 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.609 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306325+0000", 2024-09-10T06:27:41.609 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026382800000000002 2024-09-10T06:27:41.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306569+0000", 2024-09-10T06:27:41.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024445499999999998 2024-09-10T06:27:41.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:41.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.307017+0000", 2024-09-10T06:27:41.610 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044774000000000002 2024-09-10T06:27:41.610 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.610 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.610 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.610 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.308517+0000", 2024-09-10T06:27:41.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001500075 2024-09-10T06:27:41.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309685+0000", 2024-09-10T06:27:41.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001168505 2024-09-10T06:27:41.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.611 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.611 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309767+0000", 2024-09-10T06:27:41.611 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1992999999999999e-05 2024-09-10T06:27:41.611 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.611 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.612 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.612 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309830+0000", 2024-09-10T06:27:41.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2692000000000002e-05 2024-09-10T06:27:41.612 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.612 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.612 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.612 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.612 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.612 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.612 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:41.612 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.247859706, 2024-09-10T06:27:41.612 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003433888, 2024-09-10T06:27:41.612 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.613 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.613 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.613 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.613 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.613 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.613 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 216 2024-09-10T06:27:41.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.613 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.613 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.613 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:41.613 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.613 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.613 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:41.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350239+0000", 2024-09-10T06:27:41.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.377e-06 2024-09-10T06:27:41.614 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.614 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.614 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.614 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350254+0000", 2024-09-10T06:27:41.614 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.501e-05 2024-09-10T06:27:41.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350288+0000", 2024-09-10T06:27:41.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4746000000000002e-05 2024-09-10T06:27:41.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.615 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350312+0000", 2024-09-10T06:27:41.615 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3249999999999999e-05 2024-09-10T06:27:41.615 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.615 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.615 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350456+0000", 2024-09-10T06:27:41.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014483899999999999 2024-09-10T06:27:41.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350704+0000", 2024-09-10T06:27:41.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024719100000000001 2024-09-10T06:27:41.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.616 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.616 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:41.616 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.351117+0000", 2024-09-10T06:27:41.616 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000412934 2024-09-10T06:27:41.616 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.352644+0000", 2024-09-10T06:27:41.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015271079999999999 2024-09-10T06:27:41.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353397+0000", 2024-09-10T06:27:41.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075311799999999999 2024-09-10T06:27:41.617 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.617 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.617 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.617 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353556+0000", 2024-09-10T06:27:41.617 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159612 2024-09-10T06:27:41.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.618 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.618 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353669+0000", 2024-09-10T06:27:41.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011270299999999999 2024-09-10T06:27:41.618 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.618 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.618 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.618 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.618 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.618 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.618 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:41.618 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.209180244000002, 2024-09-10T06:27:41.618 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033447479999999998, 2024-09-10T06:27:41.619 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.619 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.619 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.619 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.619 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.619 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.619 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 227 2024-09-10T06:27:41.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.619 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.619 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.619 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.619 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:41.619 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.619 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:41.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388917+0000", 2024-09-10T06:27:41.620 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6900000000000001e-06 2024-09-10T06:27:41.620 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.620 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.620 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.620 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388931+0000", 2024-09-10T06:27:41.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3900000000000001e-05 2024-09-10T06:27:41.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388964+0000", 2024-09-10T06:27:41.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2985999999999999e-05 2024-09-10T06:27:41.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.621 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388980+0000", 2024-09-10T06:27:41.621 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.535e-05 2024-09-10T06:27:41.621 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.621 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.621 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389123+0000", 2024-09-10T06:27:41.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014337900000000001 2024-09-10T06:27:41.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389341+0000", 2024-09-10T06:27:41.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021765099999999999 2024-09-10T06:27:41.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.622 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.622 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:41.622 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389765+0000", 2024-09-10T06:27:41.622 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042423100000000001 2024-09-10T06:27:41.622 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.391433+0000", 2024-09-10T06:27:41.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016681000000000001 2024-09-10T06:27:41.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392104+0000", 2024-09-10T06:27:41.623 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067064800000000003 2024-09-10T06:27:41.623 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.623 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.623 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.623 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392191+0000", 2024-09-10T06:27:41.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7912999999999997e-05 2024-09-10T06:27:41.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.624 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.624 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392259+0000", 2024-09-10T06:27:41.624 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7899999999999997e-05 2024-09-10T06:27:41.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.624 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.624 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.624 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.624 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.624 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.624 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:41.625 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.201923469999997, 2024-09-10T06:27:41.625 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029995500000000001, 2024-09-10T06:27:41.625 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.625 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.625 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.625 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.625 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 229 2024-09-10T06:27:41.625 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.625 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.625 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.625 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.625 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:41.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:41.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.626 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.626 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396174+0000", 2024-09-10T06:27:41.626 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.774e-06 2024-09-10T06:27:41.626 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.626 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396186+0000", 2024-09-10T06:27:41.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2055999999999999e-05 2024-09-10T06:27:41.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396216+0000", 2024-09-10T06:27:41.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9640000000000001e-05 2024-09-10T06:27:41.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.627 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.627 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.627 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396231+0000", 2024-09-10T06:27:41.627 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:41.627 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396356+0000", 2024-09-10T06:27:41.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012504500000000001 2024-09-10T06:27:41.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396568+0000", 2024-09-10T06:27:41.628 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000211709 2024-09-10T06:27:41.628 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.628 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.628 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:41.628 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396954+0000", 2024-09-10T06:27:41.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386027 2024-09-10T06:27:41.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.398287+0000", 2024-09-10T06:27:41.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013331560000000001 2024-09-10T06:27:41.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.629 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399004+0000", 2024-09-10T06:27:41.629 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071720499999999995 2024-09-10T06:27:41.629 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.629 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.629 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399091+0000", 2024-09-10T06:27:41.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6714999999999999e-05 2024-09-10T06:27:41.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.630 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.630 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399171+0000", 2024-09-10T06:27:41.630 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9893000000000002e-05 2024-09-10T06:27:41.630 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.630 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.630 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.630 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.630 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.630 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.630 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:41.631 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.195364900999998, 2024-09-10T06:27:41.631 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030468270000000002, 2024-09-10T06:27:41.631 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.631 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.631 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.631 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.631 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.631 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.631 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 231 2024-09-10T06:27:41.631 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.631 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.631 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.631 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:41.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:41.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.632 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.632 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.632 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402732+0000", 2024-09-10T06:27:41.632 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-06 2024-09-10T06:27:41.632 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402744+0000", 2024-09-10T06:27:41.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1633e-05 2024-09-10T06:27:41.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402774+0000", 2024-09-10T06:27:41.633 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9666999999999999e-05 2024-09-10T06:27:41.633 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.633 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.633 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.633 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402789+0000", 2024-09-10T06:27:41.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5466000000000001e-05 2024-09-10T06:27:41.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402904+0000", 2024-09-10T06:27:41.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114466 2024-09-10T06:27:41.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.634 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403119+0000", 2024-09-10T06:27:41.634 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215572 2024-09-10T06:27:41.634 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.634 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.634 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:41.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403516+0000", 2024-09-10T06:27:41.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039663300000000002 2024-09-10T06:27:41.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405012+0000", 2024-09-10T06:27:41.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014961919999999999 2024-09-10T06:27:41.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.635 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.635 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405634+0000", 2024-09-10T06:27:41.635 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062145199999999999 2024-09-10T06:27:41.635 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.635 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405715+0000", 2024-09-10T06:27:41.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1619000000000006e-05 2024-09-10T06:27:41.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.636 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.636 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405777+0000", 2024-09-10T06:27:41.636 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1639999999999999e-05 2024-09-10T06:27:41.636 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.636 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.636 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.636 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.636 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.636 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:377 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.637 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:41.637 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.136609569999997, 2024-09-10T06:27:41.637 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058485480000000003, 2024-09-10T06:27:41.637 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.637 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.637 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.637 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.637 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.637 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.637 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 377 2024-09-10T06:27:41.637 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.637 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.637 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:41.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:41.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.638 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.638 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.638 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.638 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461486+0000", 2024-09-10T06:27:41.638 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0720000000000001e-06 2024-09-10T06:27:41.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461504+0000", 2024-09-10T06:27:41.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8002000000000001e-05 2024-09-10T06:27:41.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461519+0000", 2024-09-10T06:27:41.639 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4584e-05 2024-09-10T06:27:41.639 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.639 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.639 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.639 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461526+0000", 2024-09-10T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5560000000000004e-06 2024-09-10T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461597+0000", 2024-09-10T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1311999999999998e-05 2024-09-10T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461709+0000", 2024-09-10T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011191100000000001 2024-09-10T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.640 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:41.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461871+0000", 2024-09-10T06:27:41.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016254900000000001 2024-09-10T06:27:41.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.462777+0000", 2024-09-10T06:27:41.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00090547100000000003 2024-09-10T06:27:41.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.641 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.641 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.641 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467265+0000", 2024-09-10T06:27:41.641 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004488222 2024-09-10T06:27:41.641 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467308+0000", 2024-09-10T06:27:41.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2975000000000001e-05 2024-09-10T06:27:41.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.642 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.642 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.642 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467334+0000", 2024-09-10T06:27:41.642 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5894e-05 2024-09-10T06:27:41.642 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.642 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.642 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.642 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.643 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.643 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:384 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.643 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:41.643 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.134476714999998, 2024-09-10T06:27:41.643 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031588900000000001, 2024-09-10T06:27:41.643 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.643 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.643 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.643 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.643 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 384 2024-09-10T06:27:41.643 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.644 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463620+0000", 2024-09-10T06:27:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463625+0000", 2024-09-10T06:27:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6450000000000002e-06 2024-09-10T06:27:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463639+0000", 2024-09-10T06:27:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3540000000000001e-05 2024-09-10T06:27:41.645 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463648+0000", 2024-09-10T06:27:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0259999999999996e-06 2024-09-10T06:27:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463713+0000", 2024-09-10T06:27:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5438000000000006e-05 2024-09-10T06:27:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463774+0000", 2024-09-10T06:27:41.646 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0582999999999999e-05 2024-09-10T06:27:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463899+0000", 2024-09-10T06:27:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-10T06:27:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.464371+0000", 2024-09-10T06:27:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047201600000000002 2024-09-10T06:27:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.647 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466707+0000", 2024-09-10T06:27:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023354999999999999 2024-09-10T06:27:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466742+0000", 2024-09-10T06:27:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4686e-05 2024-09-10T06:27:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466777+0000", 2024-09-10T06:27:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5537000000000002e-05 2024-09-10T06:27:41.648 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.649 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.649 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.649 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.649 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.649 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:436 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.649 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:41.649 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.119229668000003, 2024-09-10T06:27:41.649 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040690570000000001, 2024-09-10T06:27:41.649 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.649 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.649 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.649 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.649 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.650 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.650 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 436 2024-09-10T06:27:41.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.650 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:41.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.650 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.650 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.650 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:41.650 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.650 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478866+0000", 2024-09-10T06:27:41.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1960000000000001e-06 2024-09-10T06:27:41.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478871+0000", 2024-09-10T06:27:41.651 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6879999999999998e-06 2024-09-10T06:27:41.651 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.651 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.651 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.651 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478883+0000", 2024-09-10T06:27:41.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1790999999999999e-05 2024-09-10T06:27:41.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478890+0000", 2024-09-10T06:27:41.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8569999999999997e-06 2024-09-10T06:27:41.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.652 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478958+0000", 2024-09-10T06:27:41.652 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7774999999999994e-05 2024-09-10T06:27:41.652 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.652 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.652 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479072+0000", 2024-09-10T06:27:41.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114577 2024-09-10T06:27:41.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:41.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479255+0000", 2024-09-10T06:27:41.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018297300000000001 2024-09-10T06:27:41.653 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.653 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.653 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.653 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482448+0000", 2024-09-10T06:27:41.653 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031933389999999999 2024-09-10T06:27:41.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482828+0000", 2024-09-10T06:27:41.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037961800000000002 2024-09-10T06:27:41.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482891+0000", 2024-09-10T06:27:41.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3316000000000002e-05 2024-09-10T06:27:41.654 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.654 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.654 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482934+0000", 2024-09-10T06:27:41.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2926999999999997e-05 2024-09-10T06:27:41.655 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.655 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.655 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.655 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.655 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:441 6.7 e34/28 6:e1cdb60d:reshard::reshard.0000000008:head v 34'7, mlcod=34'5)", 2024-09-10T06:27:41.655 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:41.655 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.115628749999999, 2024-09-10T06:27:41.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060368319999999998, 2024-09-10T06:27:41.655 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.655 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.655 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.656 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:41.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:41.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482467+0000", 2024-09-10T06:27:41.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8800000000000003e-07 2024-09-10T06:27:41.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482472+0000", 2024-09-10T06:27:41.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8730000000000004e-06 2024-09-10T06:27:41.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482481+0000", 2024-09-10T06:27:41.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1980000000000001e-06 2024-09-10T06:27:41.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482485+0000", 2024-09-10T06:27:41.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.386e-06 2024-09-10T06:27:41.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482541+0000", 2024-09-10T06:27:41.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5788000000000002e-05 2024-09-10T06:27:41.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482563+0000", 2024-09-10T06:27:41.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2303999999999999e-05 2024-09-10T06:27:41.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488465+0000", 2024-09-10T06:27:41.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059014810000000001 2024-09-10T06:27:41.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488503+0000", 2024-09-10T06:27:41.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8313999999999999e-05 2024-09-10T06:27:41.659 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.659 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.659 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.659 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:466 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.660 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:41.660 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.100469500000003, 2024-09-10T06:27:41.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039032810000000002, 2024-09-10T06:27:41.660 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.660 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.660 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.660 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.660 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.660 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.660 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 466 2024-09-10T06:27:41.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.660 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:41.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:41.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497626+0000", 2024-09-10T06:27:41.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9099999999999991e-07 2024-09-10T06:27:41.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497634+0000", 2024-09-10T06:27:41.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.994e-06 2024-09-10T06:27:41.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497644+0000", 2024-09-10T06:27:41.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6260000000000007e-06 2024-09-10T06:27:41.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497650+0000", 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5160000000000002e-06 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497718+0000", 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8862999999999994e-05 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497775+0000", 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6156000000000002e-05 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:41.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497903+0000", 2024-09-10T06:27:41.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012879800000000001 2024-09-10T06:27:41.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499630+0000", 2024-09-10T06:27:41.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017268139999999999 2024-09-10T06:27:41.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501439+0000", 2024-09-10T06:27:41.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018086669999999999 2024-09-10T06:27:41.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501478+0000", 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9269e-05 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501529+0000", 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0587000000000002e-05 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:469 6.0 e34/28 6:02683654:reshard::reshard.0000000010:head v 34'6, mlcod=34'4)", 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:41.665 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 60.098466676999998, 2024-09-10T06:27:41.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048323109999999997, 2024-09-10T06:27:41.666 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.666 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.666 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.666 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:41.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:41.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499629+0000", 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9199999999999999e-07 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499634+0000", 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2530000000000004e-06 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499644+0000", 2024-09-10T06:27:41.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5820000000000008e-06 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499650+0000", 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7919999999999998e-06 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499697+0000", 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7564000000000001e-05 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499719+0000", 2024-09-10T06:27:41.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1297999999999998e-05 2024-09-10T06:27:41.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504413+0000", 2024-09-10T06:27:41.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004694419 2024-09-10T06:27:41.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504461+0000", 2024-09-10T06:27:41.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7511e-05 2024-09-10T06:27:41.669 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.669 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.669 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:621 6.0 e34/28 6:0705c68b:::obj_delete_at_hint.0000000028:head v 34'11, mlcod=34'9)", 2024-09-10T06:27:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.993265532000002, 2024-09-10T06:27:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003196562, 2024-09-10T06:27:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:41.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604831+0000", 2024-09-10T06:27:41.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.823e-06 2024-09-10T06:27:41.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604843+0000", 2024-09-10T06:27:41.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1437000000000001e-05 2024-09-10T06:27:41.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604868+0000", 2024-09-10T06:27:41.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5837e-05 2024-09-10T06:27:41.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604885+0000", 2024-09-10T06:27:41.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6759999999999999e-05 2024-09-10T06:27:41.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604971+0000", 2024-09-10T06:27:41.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5512000000000004e-05 2024-09-10T06:27:41.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604991+0000", 2024-09-10T06:27:41.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0197999999999999e-05 2024-09-10T06:27:41.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.607960+0000", 2024-09-10T06:27:41.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002969307 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608026+0000", 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5687999999999999e-05 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:636 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.984355878000002, 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048306950000000003, 2024-09-10T06:27:41.674 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.675 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.675 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.675 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.675 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 636 2024-09-10T06:27:41.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.675 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:41.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:41.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613740+0000", 2024-09-10T06:27:41.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:41.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613747+0000", 2024-09-10T06:27:41.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8090000000000004e-06 2024-09-10T06:27:41.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613762+0000", 2024-09-10T06:27:41.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5037e-05 2024-09-10T06:27:41.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613772+0000", 2024-09-10T06:27:41.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7510000000000003e-06 2024-09-10T06:27:41.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613834+0000", 2024-09-10T06:27:41.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2458000000000004e-05 2024-09-10T06:27:41.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613916+0000", 2024-09-10T06:27:41.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1630000000000003e-05 2024-09-10T06:27:41.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:41.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.614071+0000", 2024-09-10T06:27:41.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015480800000000001 2024-09-10T06:27:41.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.615885+0000", 2024-09-10T06:27:41.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001814607 2024-09-10T06:27:41.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618438+0000", 2024-09-10T06:27:41.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025529459999999999 2024-09-10T06:27:41.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618503+0000", 2024-09-10T06:27:41.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4851000000000006e-05 2024-09-10T06:27:41.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.680 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.680 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618570+0000", 2024-09-10T06:27:41.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6418e-05 2024-09-10T06:27:41.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.680 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.681 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:646 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.681 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:41.681 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.974894087999999, 2024-09-10T06:27:41.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049103549999999999, 2024-09-10T06:27:41.681 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.681 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.681 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.681 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 646 2024-09-10T06:27:41.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.681 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:41.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:41.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623202+0000", 2024-09-10T06:27:41.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9800000000000002e-07 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623206+0000", 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6380000000000003e-06 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623216+0000", 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4439999999999997e-06 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623221+0000", 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6400000000000002e-06 2024-09-10T06:27:41.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623300+0000", 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8677999999999994e-05 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623410+0000", 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010954399999999999 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623629+0000", 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000219836 2024-09-10T06:27:41.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.625072+0000", 2024-09-10T06:27:41.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014427929999999999 2024-09-10T06:27:41.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.627982+0000", 2024-09-10T06:27:41.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029097620000000002 2024-09-10T06:27:41.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628058+0000", 2024-09-10T06:27:41.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6390999999999994e-05 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628111+0000", 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2731e-05 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.912219815999997, 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033783509999999999, 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.686 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 703 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.687 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685878+0000", 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5900000000000002e-06 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685889+0000", 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685919+0000", 2024-09-10T06:27:41.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0307e-05 2024-09-10T06:27:41.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685935+0000", 2024-09-10T06:27:41.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5336e-05 2024-09-10T06:27:41.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.689 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686092+0000", 2024-09-10T06:27:41.689 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015776200000000001 2024-09-10T06:27:41.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.689 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686462+0000", 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036925700000000001 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.687048+0000", 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000586266 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688261+0000", 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012132670000000001 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.690 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688974+0000", 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071248800000000005 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689129+0000", 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155499 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689253+0000", 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124289 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.691 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.692 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.692 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.692 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:41.692 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.553654313000003, 2024-09-10T06:27:41.692 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032750980000000002, 2024-09-10T06:27:41.692 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.692 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.692 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.692 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.692 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.692 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.692 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 865 2024-09-10T06:27:41.692 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.693 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:41.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:41.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044443+0000", 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6929999999999999e-06 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044456+0000", 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.224e-05 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044486+0000", 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.095e-05 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044501+0000", 2024-09-10T06:27:41.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4932999999999999e-05 2024-09-10T06:27:41.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044646+0000", 2024-09-10T06:27:41.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014465600000000001 2024-09-10T06:27:41.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045001+0000", 2024-09-10T06:27:41.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035473999999999998 2024-09-10T06:27:41.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:41.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045549+0000", 2024-09-10T06:27:41.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054870299999999999 2024-09-10T06:27:41.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.046956+0000", 2024-09-10T06:27:41.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014061189999999999 2024-09-10T06:27:41.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047452+0000", 2024-09-10T06:27:41.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049682199999999995 2024-09-10T06:27:41.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047606+0000", 2024-09-10T06:27:41.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015379599999999999 2024-09-10T06:27:41.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047716+0000", 2024-09-10T06:27:41.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109446 2024-09-10T06:27:41.697 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.697 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.697 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.549191161000003, 2024-09-10T06:27:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030837989999999999, 2024-09-10T06:27:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 867 2024-09-10T06:27:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.698 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048906+0000", 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1770000000000001e-06 2024-09-10T06:27:41.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048916+0000", 2024-09-10T06:27:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.025e-05 2024-09-10T06:27:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048948+0000", 2024-09-10T06:27:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1859000000000001e-05 2024-09-10T06:27:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048968+0000", 2024-09-10T06:27:41.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9647e-05 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049090+0000", 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122645 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049314+0000", 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022372900000000001 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049785+0000", 2024-09-10T06:27:41.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047121899999999999 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.050979+0000", 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001193408 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051729+0000", 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075039699999999998 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051874+0000", 2024-09-10T06:27:41.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000145253 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051988+0000", 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011321500000000001 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.480323980000001, 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035511029999999999, 2024-09-10T06:27:41.703 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.704 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.704 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.704 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 898 2024-09-10T06:27:41.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.704 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:41.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:41.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117772+0000", 2024-09-10T06:27:41.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5340000000000001e-06 2024-09-10T06:27:41.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117781+0000", 2024-09-10T06:27:41.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.276e-06 2024-09-10T06:27:41.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117804+0000", 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3093999999999999e-05 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117816+0000", 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1986e-05 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117954+0000", 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013856900000000001 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118327+0000", 2024-09-10T06:27:41.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000372841 2024-09-10T06:27:41.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:41.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118919+0000", 2024-09-10T06:27:41.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059172800000000002 2024-09-10T06:27:41.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.120253+0000", 2024-09-10T06:27:41.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001333643 2024-09-10T06:27:41.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121060+0000", 2024-09-10T06:27:41.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080731100000000001 2024-09-10T06:27:41.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121210+0000", 2024-09-10T06:27:41.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014980500000000001 2024-09-10T06:27:41.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121322+0000", 2024-09-10T06:27:41.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112316 2024-09-10T06:27:41.709 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.709 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.709 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.709 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:41.709 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:41.709 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 59.391054167999997, 2024-09-10T06:27:41.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051838630000000004, 2024-09-10T06:27:41.709 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:41.709 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:41.709 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:41.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:41.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 937 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207042+0000", 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7439999999999999e-06 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207051+0000", 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7299999999999994e-06 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207072+0000", 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1209e-05 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:41.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207089+0000", 2024-09-10T06:27:41.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6297e-05 2024-09-10T06:27:41.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:41.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207231+0000", 2024-09-10T06:27:41.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014233200000000001 2024-09-10T06:27:41.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:41.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207463+0000", 2024-09-10T06:27:41.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023155199999999999 2024-09-10T06:27:41.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:41.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207797+0000", 2024-09-10T06:27:41.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033413699999999998 2024-09-10T06:27:41.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:41.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.209053+0000", 2024-09-10T06:27:41.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012560029999999999 2024-09-10T06:27:41.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:41.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212076+0000", 2024-09-10T06:27:41.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030234239999999998 2024-09-10T06:27:41.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:41.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212162+0000", 2024-09-10T06:27:41.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5506000000000004e-05 2024-09-10T06:27:41.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:41.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:41.714 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:41.714 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212225+0000", 2024-09-10T06:27:41.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2928999999999993e-05 2024-09-10T06:27:41.714 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.714 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.715 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:41.715 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:41.715 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:41.716 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:27:41.717 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:41.717+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:41.817 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:41.817+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:41.847 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:41.848 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:41.862 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:27:41.890 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:27:41.933 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:41.933+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:41.983 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:41.984 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:41.984 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:41.984 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:41.984 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:41.998 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:27:42.020 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:42.017+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:42.086 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:42.087 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:42.116 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:42.116 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:42.119 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:42.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-10T06:27:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 63.826269717999999, 2024-09-10T06:27:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047108059999999997, 2024-09-10T06:27:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291391+0000", 2024-09-10T06:27:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8700000000000001e-06 2024-09-10T06:27:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291405+0000", 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4623e-05 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291438+0000", 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2616000000000001e-05 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291461+0000", 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2883000000000001e-05 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293024+0000", 2024-09-10T06:27:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015627709999999999 2024-09-10T06:27:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293071+0000", 2024-09-10T06:27:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7797000000000003e-05 2024-09-10T06:27:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295983+0000", 2024-09-10T06:27:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029113640000000001 2024-09-10T06:27:42.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296100+0000", 2024-09-10T06:27:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116882 2024-09-10T06:27:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.784911940000001, 2024-09-10T06:27:42.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00338296, 2024-09-10T06:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 211 2024-09-10T06:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332750+0000", 2024-09-10T06:27:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-10T06:27:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332767+0000", 2024-09-10T06:27:42.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.702e-05 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332805+0000", 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7950000000000001e-05 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332824+0000", 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8462999999999999e-05 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332950+0000", 2024-09-10T06:27:42.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012653600000000001 2024-09-10T06:27:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333177+0000", 2024-09-10T06:27:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022626800000000001 2024-09-10T06:27:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333604+0000", 2024-09-10T06:27:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042759999999999999 2024-09-10T06:27:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335279+0000", 2024-09-10T06:27:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001674481 2024-09-10T06:27:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335976+0000", 2024-09-10T06:27:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069707099999999995 2024-09-10T06:27:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336063+0000", 2024-09-10T06:27:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6916000000000006e-05 2024-09-10T06:27:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336130+0000", 2024-09-10T06:27:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6971999999999995e-05 2024-09-10T06:27:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.711637064999998, 2024-09-10T06:27:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034123389999999999, 2024-09-10T06:27:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.130 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232 2024-09-10T06:27:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406025+0000", 2024-09-10T06:27:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-10T06:27:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406040+0000", 2024-09-10T06:27:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5299999999999999e-05 2024-09-10T06:27:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406072+0000", 2024-09-10T06:27:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2543000000000003e-05 2024-09-10T06:27:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406088+0000", 2024-09-10T06:27:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5699999999999999e-05 2024-09-10T06:27:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406206+0000", 2024-09-10T06:27:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011828900000000001 2024-09-10T06:27:42.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406416+0000", 2024-09-10T06:27:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020969900000000001 2024-09-10T06:27:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406804+0000", 2024-09-10T06:27:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038783699999999998 2024-09-10T06:27:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.408490+0000", 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001686353 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409152+0000", 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066160800000000005 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409314+0000", 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000162285 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409434+0000", 2024-09-10T06:27:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119639 2024-09-10T06:27:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.691707620000003, 2024-09-10T06:27:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034077650000000001, 2024-09-10T06:27:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.136 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241 2024-09-10T06:27:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425954+0000", 2024-09-10T06:27:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425965+0000", 2024-09-10T06:27:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.181e-05 2024-09-10T06:27:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425996+0000", 2024-09-10T06:27:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0759000000000001e-05 2024-09-10T06:27:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426011+0000", 2024-09-10T06:27:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4507e-05 2024-09-10T06:27:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426153+0000", 2024-09-10T06:27:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014206599999999999 2024-09-10T06:27:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426491+0000", 2024-09-10T06:27:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033830399999999999 2024-09-10T06:27:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426973+0000", 2024-09-10T06:27:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000482113 2024-09-10T06:27:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.428378+0000", 2024-09-10T06:27:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001404539 2024-09-10T06:27:42.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429113+0000", 2024-09-10T06:27:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073537799999999996 2024-09-10T06:27:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429251+0000", 2024-09-10T06:27:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013789600000000001 2024-09-10T06:27:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429359+0000", 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107846 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:266 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.686974595999999, 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030966560000000001, 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 266 2024-09-10T06:27:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430687+0000", 2024-09-10T06:27:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0299999999999998e-06 2024-09-10T06:27:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430702+0000", 2024-09-10T06:27:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5316999999999999e-05 2024-09-10T06:27:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430741+0000", 2024-09-10T06:27:42.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8336e-05 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430762+0000", 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.162e-05 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430923+0000", 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016044599999999999 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431103+0000", 2024-09-10T06:27:42.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018030100000000001 2024-09-10T06:27:42.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:42.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431513+0000", 2024-09-10T06:27:42.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040992999999999997 2024-09-10T06:27:42.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432715+0000", 2024-09-10T06:27:42.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001202411 2024-09-10T06:27:42.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433624+0000", 2024-09-10T06:27:42.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090863000000000001 2024-09-10T06:27:42.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433718+0000", 2024-09-10T06:27:42.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3749e-05 2024-09-10T06:27:42.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433781+0000", 2024-09-10T06:27:42.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2885999999999994e-05 2024-09-10T06:27:42.147 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.147 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.148 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:273 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.148 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:42.148 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.685400995000002, 2024-09-10T06:27:42.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028009850000000002, 2024-09-10T06:27:42.148 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.148 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.148 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.148 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.148 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.148 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 273 2024-09-10T06:27:42.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.149 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:42.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:42.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432260+0000", 2024-09-10T06:27:42.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1900000000000002e-06 2024-09-10T06:27:42.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432271+0000", 2024-09-10T06:27:42.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1353e-05 2024-09-10T06:27:42.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432296+0000", 2024-09-10T06:27:42.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4817e-05 2024-09-10T06:27:42.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432318+0000", 2024-09-10T06:27:42.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1963e-05 2024-09-10T06:27:42.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432465+0000", 2024-09-10T06:27:42.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014658299999999999 2024-09-10T06:27:42.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432801+0000", 2024-09-10T06:27:42.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033681299999999999 2024-09-10T06:27:42.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:42.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433188+0000", 2024-09-10T06:27:42.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000386857 2024-09-10T06:27:42.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434552+0000", 2024-09-10T06:27:42.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013634400000000001 2024-09-10T06:27:42.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434872+0000", 2024-09-10T06:27:42.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031998399999999999 2024-09-10T06:27:42.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434973+0000", 2024-09-10T06:27:42.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100962 2024-09-10T06:27:42.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.435059+0000", 2024-09-10T06:27:42.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6023e-05 2024-09-10T06:27:42.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.154 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.154 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:299 6.14 e34/28 6:2c0c0c23:reshard::reshard.0000000001:head v 34'2, mlcod=0'0)", 2024-09-10T06:27:42.154 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:42.154 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.680785143999998, 2024-09-10T06:27:42.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029099109999999998, 2024-09-10T06:27:42.154 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.154 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.154 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.154 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:42.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:42.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436875+0000", 2024-09-10T06:27:42.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0430000000000002e-06 2024-09-10T06:27:42.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436890+0000", 2024-09-10T06:27:42.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4766999999999999e-05 2024-09-10T06:27:42.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436918+0000", 2024-09-10T06:27:42.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.76e-05 2024-09-10T06:27:42.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436937+0000", 2024-09-10T06:27:42.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9539999999999999e-05 2024-09-10T06:27:42.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437081+0000", 2024-09-10T06:27:42.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144065 2024-09-10T06:27:42.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437130+0000", 2024-09-10T06:27:42.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8609999999999997e-05 2024-09-10T06:27:42.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439676+0000", 2024-09-10T06:27:42.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002546137 2024-09-10T06:27:42.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439783+0000", 2024-09-10T06:27:42.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107149 2024-09-10T06:27:42.158 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.158 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.158 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:341 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.671865449000002, 2024-09-10T06:27:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030260230000000001, 2024-09-10T06:27:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 341 2024-09-10T06:27:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445796+0000", 2024-09-10T06:27:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7130000000000001e-06 2024-09-10T06:27:42.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445810+0000", 2024-09-10T06:27:42.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4564e-05 2024-09-10T06:27:42.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445886+0000", 2024-09-10T06:27:42.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5921999999999996e-05 2024-09-10T06:27:42.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445902+0000", 2024-09-10T06:27:42.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5800000000000001e-05 2024-09-10T06:27:42.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446057+0000", 2024-09-10T06:27:42.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015475600000000001 2024-09-10T06:27:42.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446347+0000", 2024-09-10T06:27:42.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029057699999999998 2024-09-10T06:27:42.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:42.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446669+0000", 2024-09-10T06:27:42.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032102399999999999 2024-09-10T06:27:42.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.447891+0000", 2024-09-10T06:27:42.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012226680000000001 2024-09-10T06:27:42.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448550+0000", 2024-09-10T06:27:42.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065925800000000002 2024-09-10T06:27:42.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448699+0000", 2024-09-10T06:27:42.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014831800000000001 2024-09-10T06:27:42.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448819+0000", 2024-09-10T06:27:42.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120423 2024-09-10T06:27:42.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.164 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.164 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:505 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.165 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:42.165 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.590186918999997, 2024-09-10T06:27:42.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028092249999999998, 2024-09-10T06:27:42.165 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.165 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.165 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.165 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 505 2024-09-10T06:27:42.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.165 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:42.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:42.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527474+0000", 2024-09-10T06:27:42.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-10T06:27:42.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527495+0000", 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0910000000000001e-05 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527549+0000", 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3223000000000002e-05 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527583+0000", 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4773000000000001e-05 2024-09-10T06:27:42.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527737+0000", 2024-09-10T06:27:42.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325199999999999 2024-09-10T06:27:42.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528092+0000", 2024-09-10T06:27:42.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000354951 2024-09-10T06:27:42.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:42.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528657+0000", 2024-09-10T06:27:42.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00056537500000000001 2024-09-10T06:27:42.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.529771+0000", 2024-09-10T06:27:42.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011136519999999999 2024-09-10T06:27:42.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530072+0000", 2024-09-10T06:27:42.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030151700000000001 2024-09-10T06:27:42.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530213+0000", 2024-09-10T06:27:42.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014100500000000001 2024-09-10T06:27:42.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530281+0000", 2024-09-10T06:27:42.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7793999999999995e-05 2024-09-10T06:27:42.170 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.170 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.170 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.170 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.171 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:42.171 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.586517641999997, 2024-09-10T06:27:42.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051813969999999999, 2024-09-10T06:27:42.171 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.171 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.171 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.171 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 513 2024-09-10T06:27:42.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.171 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:42.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:42.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531143+0000", 2024-09-10T06:27:42.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7400000000000001e-06 2024-09-10T06:27:42.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531153+0000", 2024-09-10T06:27:42.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.815e-06 2024-09-10T06:27:42.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531178+0000", 2024-09-10T06:27:42.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5755e-05 2024-09-10T06:27:42.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531190+0000", 2024-09-10T06:27:42.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1250000000000001e-05 2024-09-10T06:27:42.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531322+0000", 2024-09-10T06:27:42.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013239299999999999 2024-09-10T06:27:42.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531550+0000", 2024-09-10T06:27:42.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000227598 2024-09-10T06:27:42.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:42.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531966+0000", 2024-09-10T06:27:42.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041634400000000002 2024-09-10T06:27:42.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533197+0000", 2024-09-10T06:27:42.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012308810000000001 2024-09-10T06:27:42.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536097+0000", 2024-09-10T06:27:42.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029007159999999998 2024-09-10T06:27:42.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536245+0000", 2024-09-10T06:27:42.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000147816 2024-09-10T06:27:42.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536322+0000", 2024-09-10T06:27:42.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7088999999999993e-05 2024-09-10T06:27:42.176 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.176 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.176 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.177 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:514 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.177 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:42.177 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.586445445000003, 2024-09-10T06:27:42.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048258260000000001, 2024-09-10T06:27:42.177 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.177 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.177 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.177 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.177 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.177 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.177 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 514 2024-09-10T06:27:42.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531214+0000", 2024-09-10T06:27:42.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2699999999999998e-07 2024-09-10T06:27:42.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531219+0000", 2024-09-10T06:27:42.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-10T06:27:42.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531233+0000", 2024-09-10T06:27:42.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.38e-05 2024-09-10T06:27:42.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531240+0000", 2024-09-10T06:27:42.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7399999999999998e-06 2024-09-10T06:27:42.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531378+0000", 2024-09-10T06:27:42.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013860399999999999 2024-09-10T06:27:42.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531600+0000", 2024-09-10T06:27:42.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221287 2024-09-10T06:27:42.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:42.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532007+0000", 2024-09-10T06:27:42.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040728500000000001 2024-09-10T06:27:42.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533131+0000", 2024-09-10T06:27:42.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011240429999999999 2024-09-10T06:27:42.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535894+0000", 2024-09-10T06:27:42.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027628650000000002 2024-09-10T06:27:42.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535973+0000", 2024-09-10T06:27:42.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9399000000000003e-05 2024-09-10T06:27:42.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536039+0000", 2024-09-10T06:27:42.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5619999999999999e-05 2024-09-10T06:27:42.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.182 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:655 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.486502907000002, 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003017207, 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 655 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:42.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:42.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631159+0000", 2024-09-10T06:27:42.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8270000000000002e-06 2024-09-10T06:27:42.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631173+0000", 2024-09-10T06:27:42.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4739999999999999e-05 2024-09-10T06:27:42.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631206+0000", 2024-09-10T06:27:42.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2425999999999998e-05 2024-09-10T06:27:42.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631221+0000", 2024-09-10T06:27:42.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4927e-05 2024-09-10T06:27:42.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631336+0000", 2024-09-10T06:27:42.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115062 2024-09-10T06:27:42.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631547+0000", 2024-09-10T06:27:42.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021178200000000001 2024-09-10T06:27:42.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:42.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.632034+0000", 2024-09-10T06:27:42.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000486899 2024-09-10T06:27:42.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633413+0000", 2024-09-10T06:27:42.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001379077 2024-09-10T06:27:42.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633891+0000", 2024-09-10T06:27:42.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000477489 2024-09-10T06:27:42.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634057+0000", 2024-09-10T06:27:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016608500000000001 2024-09-10T06:27:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634173+0000", 2024-09-10T06:27:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115893 2024-09-10T06:27:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.189 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:658 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.189 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:42.189 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.482488662999998, 2024-09-10T06:27:42.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030550820000000002, 2024-09-10T06:27:42.189 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.189 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.189 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 658 2024-09-10T06:27:42.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.189 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:42.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:42.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635171+0000", 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.322e-06 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635178+0000", 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7950000000000002e-06 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635197+0000", 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8845e-05 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635215+0000", 2024-09-10T06:27:42.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7822e-05 2024-09-10T06:27:42.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635329+0000", 2024-09-10T06:27:42.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011433 2024-09-10T06:27:42.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635554+0000", 2024-09-10T06:27:42.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022527800000000001 2024-09-10T06:27:42.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:42.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.636007+0000", 2024-09-10T06:27:42.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045297099999999998 2024-09-10T06:27:42.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637198+0000", 2024-09-10T06:27:42.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011902740000000001 2024-09-10T06:27:42.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637961+0000", 2024-09-10T06:27:42.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000763234 2024-09-10T06:27:42.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638110+0000", 2024-09-10T06:27:42.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149259 2024-09-10T06:27:42.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638225+0000", 2024-09-10T06:27:42.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011495200000000001 2024-09-10T06:27:42.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.194 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.195 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.195 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:42.195 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.386156720999999, 2024-09-10T06:27:42.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028070980000000001, 2024-09-10T06:27:42.195 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.195 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.195 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.195 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 724 2024-09-10T06:27:42.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.196 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:42.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:42.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731504+0000", 2024-09-10T06:27:42.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:42.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731516+0000", 2024-09-10T06:27:42.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1885999999999999e-05 2024-09-10T06:27:42.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731547+0000", 2024-09-10T06:27:42.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0923000000000002e-05 2024-09-10T06:27:42.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731563+0000", 2024-09-10T06:27:42.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5342999999999999e-05 2024-09-10T06:27:42.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731704+0000", 2024-09-10T06:27:42.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014128599999999999 2024-09-10T06:27:42.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731917+0000", 2024-09-10T06:27:42.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021280800000000001 2024-09-10T06:27:42.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:42.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.732227+0000", 2024-09-10T06:27:42.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031024500000000001 2024-09-10T06:27:42.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.733258+0000", 2024-09-10T06:27:42.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010306880000000001 2024-09-10T06:27:42.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734163+0000", 2024-09-10T06:27:42.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090502400000000004 2024-09-10T06:27:42.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734247+0000", 2024-09-10T06:27:42.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4363000000000005e-05 2024-09-10T06:27:42.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734309+0000", 2024-09-10T06:27:42.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2005e-05 2024-09-10T06:27:42.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.200 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.379310586999999, 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030399789999999999, 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 727 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:42.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:42.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738350+0000", 2024-09-10T06:27:42.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2199999999999999e-06 2024-09-10T06:27:42.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738360+0000", 2024-09-10T06:27:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0122999999999999e-05 2024-09-10T06:27:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738384+0000", 2024-09-10T06:27:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3390000000000001e-05 2024-09-10T06:27:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738397+0000", 2024-09-10T06:27:42.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2896e-05 2024-09-10T06:27:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738524+0000", 2024-09-10T06:27:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126883 2024-09-10T06:27:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738752+0000", 2024-09-10T06:27:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022864200000000001 2024-09-10T06:27:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:42.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.739080+0000", 2024-09-10T06:27:42.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032783699999999999 2024-09-10T06:27:42.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.740085+0000", 2024-09-10T06:27:42.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001005438 2024-09-10T06:27:42.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741203+0000", 2024-09-10T06:27:42.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011175919999999999 2024-09-10T06:27:42.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741280+0000", 2024-09-10T06:27:42.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6545999999999995e-05 2024-09-10T06:27:42.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741388+0000", 2024-09-10T06:27:42.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108412 2024-09-10T06:27:42.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.206 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.207 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.207 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:42.207 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.187288082000002, 2024-09-10T06:27:42.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028715709999999998, 2024-09-10T06:27:42.207 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.207 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.207 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.207 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 814 2024-09-10T06:27:42.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.207 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:42.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:42.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930373+0000", 2024-09-10T06:27:42.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-10T06:27:42.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930384+0000", 2024-09-10T06:27:42.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1357e-05 2024-09-10T06:27:42.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930417+0000", 2024-09-10T06:27:42.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2289000000000002e-05 2024-09-10T06:27:42.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930438+0000", 2024-09-10T06:27:42.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1399999999999998e-05 2024-09-10T06:27:42.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930626+0000", 2024-09-10T06:27:42.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018812899999999999 2024-09-10T06:27:42.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930843+0000", 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021719400000000001 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.931152+0000", 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030821199999999998 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.932258+0000", 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001106304 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933092+0000", 2024-09-10T06:27:42.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00083364699999999997 2024-09-10T06:27:42.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933179+0000", 2024-09-10T06:27:42.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7383e-05 2024-09-10T06:27:42.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933242+0000", 2024-09-10T06:27:42.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3072999999999997e-05 2024-09-10T06:27:42.212 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.212 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.213 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.213 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:42.213 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.039736601000001, 2024-09-10T06:27:42.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029601670000000001, 2024-09-10T06:27:42.213 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.213 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.213 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.213 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 880 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077925+0000", 2024-09-10T06:27:42.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077938+0000", 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2836999999999999e-05 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077970+0000", 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1542999999999999e-05 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077984+0000", 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4963999999999999e-05 2024-09-10T06:27:42.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078118+0000", 2024-09-10T06:27:42.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134015 2024-09-10T06:27:42.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078344+0000", 2024-09-10T06:27:42.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225038 2024-09-10T06:27:42.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:42.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078696+0000", 2024-09-10T06:27:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035250100000000002 2024-09-10T06:27:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.079793+0000", 2024-09-10T06:27:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010967049999999999 2024-09-10T06:27:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080714+0000", 2024-09-10T06:27:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00092153600000000003 2024-09-10T06:27:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080802+0000", 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7446000000000003e-05 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080882+0000", 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0445999999999995e-05 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.218 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 59.965116373999997, 2024-09-10T06:27:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002919091, 2024-09-10T06:27:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 913 2024-09-10T06:27:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152545+0000", 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6529999999999998e-06 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152557+0000", 2024-09-10T06:27:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919999999999999e-05 2024-09-10T06:27:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152587+0000", 2024-09-10T06:27:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0097e-05 2024-09-10T06:27:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152601+0000", 2024-09-10T06:27:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4579999999999999e-05 2024-09-10T06:27:42.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152732+0000", 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013085500000000001 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153007+0000", 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027469499999999998 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153344+0000", 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033742400000000001 2024-09-10T06:27:42.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.154351+0000", 2024-09-10T06:27:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010067590000000001 2024-09-10T06:27:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155301+0000", 2024-09-10T06:27:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095000900000000003 2024-09-10T06:27:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155387+0000", 2024-09-10T06:27:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6136000000000003e-05 2024-09-10T06:27:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155461+0000", 2024-09-10T06:27:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3962999999999996e-05 2024-09-10T06:27:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:42.224 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 59.933469692000003, 2024-09-10T06:27:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029321239999999999, 2024-09-10T06:27:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 927 2024-09-10T06:27:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:42.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184191+0000", 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.764e-06 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184199+0000", 2024-09-10T06:27:42.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4630000000000001e-06 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184221+0000", 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1603e-05 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184233+0000", 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.189e-05 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184382+0000", 2024-09-10T06:27:42.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014939900000000001 2024-09-10T06:27:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184495+0000", 2024-09-10T06:27:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113459 2024-09-10T06:27:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184735+0000", 2024-09-10T06:27:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000239554 2024-09-10T06:27:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186036+0000", 2024-09-10T06:27:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00130072 2024-09-10T06:27:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186929+0000", 2024-09-10T06:27:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000893694 2024-09-10T06:27:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187014+0000", 2024-09-10T06:27:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4222999999999996e-05 2024-09-10T06:27:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187121+0000", 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107355 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 59.930208827000001, 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028243320000000001, 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:42.230 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 928 2024-09-10T06:27:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:42.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187452+0000", 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5069999999999999e-06 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187464+0000", 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1243000000000001e-05 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187495+0000", 2024-09-10T06:27:42.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1136000000000001e-05 2024-09-10T06:27:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187511+0000", 2024-09-10T06:27:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6710000000000001e-05 2024-09-10T06:27:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187648+0000", 2024-09-10T06:27:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013657599999999999 2024-09-10T06:27:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187866+0000", 2024-09-10T06:27:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021853500000000001 2024-09-10T06:27:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.188168+0000", 2024-09-10T06:27:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030161100000000002 2024-09-10T06:27:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.189334+0000", 2024-09-10T06:27:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001166048 2024-09-10T06:27:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190086+0000", 2024-09-10T06:27:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075159399999999996 2024-09-10T06:27:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190165+0000", 2024-09-10T06:27:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8953000000000001e-05 2024-09-10T06:27:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190274+0000", 2024-09-10T06:27:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109419 2024-09-10T06:27:42.235 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:42.236 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:42.236 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:42.237 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:42.237 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:42.238 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:42.238 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:42.238 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:27:42.239 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:42.239 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:42.240 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:42.237+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:42.240 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:42.240 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:42.269 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:42.269 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:42.299 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:42.299 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:42.365 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:42.365+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:42.368 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:42.368 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:42.382 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:27:42.439 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:42.437+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:42.504 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:42.504 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:42.518 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:27:42.560 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:42.561+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:42.641 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:42.641+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:42.687 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:42.687 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:42.701 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:27:42.741 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:42.741+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:42.844 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:42.841+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:42.872 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:42.872 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:42.887 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:27:42.946 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:42.945+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:43.008 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:43.009 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:43.022 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:27:43.064 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:43.065+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:43.148 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:43.145+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:43.186 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:43.186 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:43.201 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:27:43.249 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:43.249+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:43.324 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:43.324 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:43.339 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:27:43.349 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:43.349+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:43.451 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:43.448+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:43.508 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:43.508 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:43.523 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:27:43.550 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T06:27:43.551 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:43.548+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:43.639 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:43.639 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:43.652 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:43.653+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:43.653 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:27:43.753 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:43.753+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:43.823 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:43.823 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:43.842 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:27:43.855 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:43.853+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:43.956 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:43.957+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:44.010 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:44.010 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:44.027 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:27:44.076 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:44.072+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:44.157 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:44.152+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:44.196 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:44.196 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:44.214 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:27:44.257 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:44.256+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:44.323 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:27:44.359 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:44.357+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:44.379 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:44.379 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:44.393 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:27:44.459 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:44.456+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:44.507 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:44.508 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:44.523 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-10T06:27:44.527 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:27:44.536 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:44.536 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:44.568 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:44.569 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:44.569 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:44.564+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:44.599 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:44.599 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:44.629 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:44.629 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:44.654 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:44.654 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:44.654 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:44.654 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:44.654 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.655 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:44.655 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:44.655 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 70.377679564000005, 2024-09-10T06:27:44.655 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069538480000000003, 2024-09-10T06:27:44.655 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.655 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.655 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "reached pg", 2024-09-10T06:27:44.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:44.655 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:44.655 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 2 2024-09-10T06:27:44.655 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.655 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:44.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.656 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275739+0000", 2024-09-10T06:27:44.656 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.656 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.656 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.656 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275742+0000", 2024-09-10T06:27:44.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7460000000000001e-06 2024-09-10T06:27:44.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275751+0000", 2024-09-10T06:27:44.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3979999999999999e-06 2024-09-10T06:27:44.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.657 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.657 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.657 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275769+0000", 2024-09-10T06:27:44.657 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8637000000000001e-05 2024-09-10T06:27:44.657 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275784+0000", 2024-09-10T06:27:44.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4518000000000001e-05 2024-09-10T06:27:44.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.658 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275905+0000", 2024-09-10T06:27:44.658 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012092899999999999 2024-09-10T06:27:44.658 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.658 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.658 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for peered", 2024-09-10T06:27:44.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.275920+0000", 2024-09-10T06:27:44.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5325999999999999e-05 2024-09-10T06:27:44.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282541+0000", 2024-09-10T06:27:44.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066208400000000002 2024-09-10T06:27:44.659 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.659 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.659 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.659 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.282693+0000", 2024-09-10T06:27:44.659 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152454 2024-09-10T06:27:44.659 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.660 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.660 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.660 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.660 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.660 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:44.660 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:44.660 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 66.240851003000003, 2024-09-10T06:27:44.660 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029204980000000001, 2024-09-10T06:27:44.660 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.660 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.660 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.660 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.661 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.661 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.661 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 193 2024-09-10T06:27:44.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.661 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:44.661 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.661 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.661 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.661 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.661 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412568+0000", 2024-09-10T06:27:44.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412570+0000", 2024-09-10T06:27:44.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4530000000000001e-06 2024-09-10T06:27:44.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.662 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.662 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412582+0000", 2024-09-10T06:27:44.662 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1524e-05 2024-09-10T06:27:44.662 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.662 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412612+0000", 2024-09-10T06:27:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0436000000000001e-05 2024-09-10T06:27:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412627+0000", 2024-09-10T06:27:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4306e-05 2024-09-10T06:27:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412723+0000", 2024-09-10T06:27:44.663 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6075000000000004e-05 2024-09-10T06:27:44.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412831+0000", 2024-09-10T06:27:44.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108453 2024-09-10T06:27:44.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.412972+0000", 2024-09-10T06:27:44.664 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141225 2024-09-10T06:27:44.664 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.664 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.664 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.664 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.414147+0000", 2024-09-10T06:27:44.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174989 2024-09-10T06:27:44.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415334+0000", 2024-09-10T06:27:44.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:44.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.665 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.665 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.665 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415420+0000", 2024-09-10T06:27:44.665 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6009999999999998e-05 2024-09-10T06:27:44.665 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.666 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.666 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.415489+0000", 2024-09-10T06:27:44.666 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8403000000000002e-05 2024-09-10T06:27:44.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.666 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.666 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.666 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.666 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.666 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.666 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:44.667 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.343367360999999, 2024-09-10T06:27:44.667 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092944310000000006, 2024-09-10T06:27:44.667 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.667 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.667 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.667 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.667 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 208 2024-09-10T06:27:44.667 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.667 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.667 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.667 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.667 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:44.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310052+0000", 2024-09-10T06:27:44.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.668 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310055+0000", 2024-09-10T06:27:44.668 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9299999999999999e-06 2024-09-10T06:27:44.668 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.668 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.668 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310066+0000", 2024-09-10T06:27:44.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1739999999999999e-05 2024-09-10T06:27:44.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310096+0000", 2024-09-10T06:27:44.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0159e-05 2024-09-10T06:27:44.669 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.669 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.669 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.669 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310111+0000", 2024-09-10T06:27:44.669 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5007e-05 2024-09-10T06:27:44.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310235+0000", 2024-09-10T06:27:44.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123132 2024-09-10T06:27:44.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.670 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.670 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:27:44.670 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.310246+0000", 2024-09-10T06:27:44.670 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1487e-05 2024-09-10T06:27:44.670 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315594+0000", 2024-09-10T06:27:44.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005347592 2024-09-10T06:27:44.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.671 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.315932+0000", 2024-09-10T06:27:44.671 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033789099999999999 2024-09-10T06:27:44.671 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.671 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.671 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.316549+0000", 2024-09-10T06:27:44.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061698099999999995 2024-09-10T06:27:44.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.317898+0000", 2024-09-10T06:27:44.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013498799999999999 2024-09-10T06:27:44.672 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.672 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.672 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.672 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319207+0000", 2024-09-10T06:27:44.672 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013086969999999999 2024-09-10T06:27:44.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319289+0000", 2024-09-10T06:27:44.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2259e-05 2024-09-10T06:27:44.673 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.673 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.673 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.673 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.319346+0000", 2024-09-10T06:27:44.673 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6675999999999997e-05 2024-09-10T06:27:44.673 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.673 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.673 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.674 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.674 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.674 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:44.674 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.317030637999999, 2024-09-10T06:27:44.674 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003262778, 2024-09-10T06:27:44.674 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.674 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.674 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.674 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.674 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.674 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.674 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 212 2024-09-10T06:27:44.674 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.675 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:44.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336388+0000", 2024-09-10T06:27:44.675 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.675 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.675 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.675 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.675 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336391+0000", 2024-09-10T06:27:44.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5770000000000001e-06 2024-09-10T06:27:44.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336403+0000", 2024-09-10T06:27:44.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2286000000000001e-05 2024-09-10T06:27:44.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.676 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.676 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.676 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336425+0000", 2024-09-10T06:27:44.676 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2164e-05 2024-09-10T06:27:44.676 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336440+0000", 2024-09-10T06:27:44.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4222999999999999e-05 2024-09-10T06:27:44.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.677 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336621+0000", 2024-09-10T06:27:44.677 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018136500000000001 2024-09-10T06:27:44.677 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.677 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.677 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.336830+0000", 2024-09-10T06:27:44.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000209125 2024-09-10T06:27:44.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.337206+0000", 2024-09-10T06:27:44.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037553700000000001 2024-09-10T06:27:44.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.678 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.678 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.338527+0000", 2024-09-10T06:27:44.678 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00132142 2024-09-10T06:27:44.678 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.678 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339502+0000", 2024-09-10T06:27:44.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00097512599999999999 2024-09-10T06:27:44.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339585+0000", 2024-09-10T06:27:44.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2466000000000006e-05 2024-09-10T06:27:44.679 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.679 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.679 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.679 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.339651+0000", 2024-09-10T06:27:44.679 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6489000000000007e-05 2024-09-10T06:27:44.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.680 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.680 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.680 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.680 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.680 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.680 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:44.680 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.292717099000001, 2024-09-10T06:27:44.680 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032440849999999999, 2024-09-10T06:27:44.680 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.680 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.680 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.681 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.681 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 219 2024-09-10T06:27:44.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.681 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.681 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:44.681 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.681 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.681 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.681 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360702+0000", 2024-09-10T06:27:44.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360705+0000", 2024-09-10T06:27:44.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.593e-06 2024-09-10T06:27:44.682 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.682 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.682 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.682 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360716+0000", 2024-09-10T06:27:44.682 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1717e-05 2024-09-10T06:27:44.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360746+0000", 2024-09-10T06:27:44.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0233e-05 2024-09-10T06:27:44.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.683 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.683 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360761+0000", 2024-09-10T06:27:44.683 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4593000000000001e-05 2024-09-10T06:27:44.683 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.683 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.360873+0000", 2024-09-10T06:27:44.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111809 2024-09-10T06:27:44.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361105+0000", 2024-09-10T06:27:44.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023171800000000001 2024-09-10T06:27:44.684 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.684 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.684 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.684 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.361523+0000", 2024-09-10T06:27:44.684 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000418694 2024-09-10T06:27:44.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.362840+0000", 2024-09-10T06:27:44.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013165570000000001 2024-09-10T06:27:44.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.685 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.685 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363793+0000", 2024-09-10T06:27:44.685 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095323200000000004 2024-09-10T06:27:44.685 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.685 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363880+0000", 2024-09-10T06:27:44.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6689999999999998e-05 2024-09-10T06:27:44.686 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.686 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.686 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.686 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.363946+0000", 2024-09-10T06:27:44.686 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6248999999999995e-05 2024-09-10T06:27:44.687 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.687 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.687 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.687 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.687 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.687 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.687 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:44.687 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.275450245999998, 2024-09-10T06:27:44.687 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003271422, 2024-09-10T06:27:44.687 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.687 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.688 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.688 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.688 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.688 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.688 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 224 2024-09-10T06:27:44.688 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.688 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.688 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.688 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.688 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:44.688 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.689 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.689 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.692 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377969+0000", 2024-09-10T06:27:44.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377971+0000", 2024-09-10T06:27:44.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:44.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.693 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.693 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.693 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.377983+0000", 2024-09-10T06:27:44.693 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1517e-05 2024-09-10T06:27:44.693 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378013+0000", 2024-09-10T06:27:44.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0476000000000001e-05 2024-09-10T06:27:44.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378028+0000", 2024-09-10T06:27:44.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5173e-05 2024-09-10T06:27:44.694 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.694 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.694 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.694 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378134+0000", 2024-09-10T06:27:44.694 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010533 2024-09-10T06:27:44.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378346+0000", 2024-09-10T06:27:44.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021175499999999999 2024-09-10T06:27:44.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.695 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.378787+0000", 2024-09-10T06:27:44.695 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044190899999999999 2024-09-10T06:27:44.695 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.695 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.695 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.380237+0000", 2024-09-10T06:27:44.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001449093 2024-09-10T06:27:44.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381097+0000", 2024-09-10T06:27:44.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086022300000000002 2024-09-10T06:27:44.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.696 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.696 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.696 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381181+0000", 2024-09-10T06:27:44.696 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3973000000000004e-05 2024-09-10T06:27:44.696 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.697 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.697 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.381240+0000", 2024-09-10T06:27:44.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9472999999999998e-05 2024-09-10T06:27:44.697 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.697 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.697 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.697 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.697 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.697 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.697 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:44.697 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.243782793000001, 2024-09-10T06:27:44.697 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031998719999999999, 2024-09-10T06:27:44.697 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 233 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.698 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409636+0000", 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409639+0000", 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4770000000000002e-06 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409652+0000", 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3692999999999999e-05 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.699 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409683+0000", 2024-09-10T06:27:44.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1080000000000001e-05 2024-09-10T06:27:44.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409699+0000", 2024-09-10T06:27:44.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5245999999999999e-05 2024-09-10T06:27:44.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.700 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.700 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.409881+0000", 2024-09-10T06:27:44.700 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000182709 2024-09-10T06:27:44.700 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.700 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410088+0000", 2024-09-10T06:27:44.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020630799999999999 2024-09-10T06:27:44.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.410495+0000", 2024-09-10T06:27:44.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00040682700000000001 2024-09-10T06:27:44.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.701 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.701 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.701 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.411805+0000", 2024-09-10T06:27:44.701 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013101059999999999 2024-09-10T06:27:44.701 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412672+0000", 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086778699999999996 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412769+0000", 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6565999999999997e-05 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.412836+0000", 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7073e-05 2024-09-10T06:27:44.702 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.703 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.703 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.703 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.703 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.703 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:353 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.703 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:44.703 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.202875478999999, 2024-09-10T06:27:44.703 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059710450000000003, 2024-09-10T06:27:44.703 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.703 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.703 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.703 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 353 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450544+0000", 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.704 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450545+0000", 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.423e-06 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450551+0000", 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7370000000000003e-06 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450565+0000", 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4649e-05 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.705 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450574+0000", 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5129999999999996e-06 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450644+0000", 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0387000000000002e-05 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.450818+0000", 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017368400000000001 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.706 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451030+0000", 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021189599999999999 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.451607+0000", 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00057672599999999995 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456437+0000", 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048301940000000003 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.707 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456472+0000", 2024-09-10T06:27:44.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5178000000000001e-05 2024-09-10T06:27:44.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.708 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.708 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456515+0000", 2024-09-10T06:27:44.708 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2657999999999997e-05 2024-09-10T06:27:44.708 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.708 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.708 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.708 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.708 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.708 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:362 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.708 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:44.709 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.196427956999997, 2024-09-10T06:27:44.709 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044032239999999999, 2024-09-10T06:27:44.709 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.709 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.709 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.709 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.709 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 362 2024-09-10T06:27:44.709 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.709 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.709 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.709 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.709 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456991+0000", 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456992+0000", 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6700000000000002e-07 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.456997+0000", 2024-09-10T06:27:44.710 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6249999999999998e-06 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457005+0000", 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6719999999999993e-06 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457010+0000", 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7360000000000001e-06 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457054+0000", 2024-09-10T06:27:44.711 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4138999999999999e-05 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457163+0000", 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108558 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.457340+0000", 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017730600000000001 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.458065+0000", 2024-09-10T06:27:44.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00072480400000000001 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461294+0000", 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032287890000000001 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461352+0000", 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8502000000000003e-05 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461394+0000", 2024-09-10T06:27:44.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2225999999999999e-05 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:475 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.150578392, 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046091930000000001, 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.714 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 475 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.715 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502841+0000", 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6100000000000001e-07 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502844+0000", 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0529999999999998e-06 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502852+0000", 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2579999999999995e-06 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502857+0000", 2024-09-10T06:27:44.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3460000000000004e-06 2024-09-10T06:27:44.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502894+0000", 2024-09-10T06:27:44.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6884000000000001e-05 2024-09-10T06:27:44.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.502942+0000", 2024-09-10T06:27:44.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7791999999999999e-05 2024-09-10T06:27:44.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.503048+0000", 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010678799999999999 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.506079+0000", 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030311510000000002 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507361+0000", 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001281208 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507400+0000", 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9483000000000001e-05 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507450+0000", 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9669000000000002e-05 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:477 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:44.719 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.148617274999999, 2024-09-10T06:27:44.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0038544, 2024-09-10T06:27:44.720 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.720 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.720 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.720 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.720 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 477 2024-09-10T06:27:44.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.720 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:44.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504802+0000", 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504803+0000", 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9999999999999996e-07 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504808+0000", 2024-09-10T06:27:44.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1909999999999999e-06 2024-09-10T06:27:44.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504818+0000", 2024-09-10T06:27:44.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0081999999999999e-05 2024-09-10T06:27:44.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504823+0000", 2024-09-10T06:27:44.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9969999999999998e-06 2024-09-10T06:27:44.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504870+0000", 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6980000000000001e-05 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504922+0000", 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1869000000000001e-05 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505020+0000", 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8010999999999994e-05 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507789+0000", 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027690219999999999 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508599+0000", 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081037800000000005 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508631+0000", 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.137e-05 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508656+0000", 2024-09-10T06:27:44.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5599999999999999e-05 2024-09-10T06:27:44.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.725 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.725 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.725 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:478 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.725 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:44.725 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.148570372999998, 2024-09-10T06:27:44.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039361880000000002, 2024-09-10T06:27:44.725 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.725 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.725 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 478 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504849+0000", 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7800000000000001e-07 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504853+0000", 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2780000000000002e-06 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504858+0000", 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7359999999999998e-06 2024-09-10T06:27:44.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504862+0000", 2024-09-10T06:27:44.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6650000000000001e-06 2024-09-10T06:27:44.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504938+0000", 2024-09-10T06:27:44.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6286999999999997e-05 2024-09-10T06:27:44.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505091+0000", 2024-09-10T06:27:44.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000152385 2024-09-10T06:27:44.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:44.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.505335+0000", 2024-09-10T06:27:44.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244281 2024-09-10T06:27:44.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.507764+0000", 2024-09-10T06:27:44.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002429624 2024-09-10T06:27:44.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508681+0000", 2024-09-10T06:27:44.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00091630100000000001 2024-09-10T06:27:44.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508747+0000", 2024-09-10T06:27:44.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5733000000000002e-05 2024-09-10T06:27:44.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.508785+0000", 2024-09-10T06:27:44.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8319999999999999e-05 2024-09-10T06:27:44.730 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.730 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.731 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.731 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.731 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:44.731 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 62.902438453000002, 2024-09-10T06:27:44.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030732350000000001, 2024-09-10T06:27:44.731 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.731 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.731 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.731 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.731 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 733 2024-09-10T06:27:44.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.732 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:44.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750981+0000", 2024-09-10T06:27:44.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750983+0000", 2024-09-10T06:27:44.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8880000000000001e-06 2024-09-10T06:27:44.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.750996+0000", 2024-09-10T06:27:44.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2048999999999999e-05 2024-09-10T06:27:44.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751024+0000", 2024-09-10T06:27:44.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8802e-05 2024-09-10T06:27:44.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751043+0000", 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8266000000000001e-05 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751191+0000", 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014818200000000001 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751417+0000", 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022648199999999999 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.751747+0000", 2024-09-10T06:27:44.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032945000000000001 2024-09-10T06:27:44.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.752752+0000", 2024-09-10T06:27:44.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010054790000000001 2024-09-10T06:27:44.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753896+0000", 2024-09-10T06:27:44.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001143638 2024-09-10T06:27:44.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.753989+0000", 2024-09-10T06:27:44.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3466000000000003e-05 2024-09-10T06:27:44.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.754054+0000", 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4533e-05 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 62.861957906999997, 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002896722, 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.737 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.738 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.738 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.738 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.738 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 751 2024-09-10T06:27:44.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.738 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:44.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791461+0000", 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791464+0000", 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7140000000000002e-06 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791475+0000", 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1535999999999999e-05 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791501+0000", 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5276e-05 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791514+0000", 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3203e-05 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791643+0000", 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012961900000000001 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.791857+0000", 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021351599999999999 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.792178+0000", 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032090999999999999 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.793281+0000", 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001103319 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794209+0000", 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000927676 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794295+0000", 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5682999999999999e-05 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.794358+0000", 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3269999999999996e-05 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 62.858070410000003, 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030558059999999999, 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 753 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795349+0000", 2024-09-10T06:27:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795352+0000", 2024-09-10T06:27:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0130000000000002e-06 2024-09-10T06:27:44.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795364+0000", 2024-09-10T06:27:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1939999999999999e-05 2024-09-10T06:27:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795395+0000", 2024-09-10T06:27:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0976999999999998e-05 2024-09-10T06:27:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795413+0000", 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7980000000000001e-05 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795533+0000", 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120732 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795665+0000", 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013215899999999999 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.795931+0000", 2024-09-10T06:27:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026536499999999999 2024-09-10T06:27:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.796995+0000", 2024-09-10T06:27:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001064611 2024-09-10T06:27:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798256+0000", 2024-09-10T06:27:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00126022 2024-09-10T06:27:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798340+0000", 2024-09-10T06:27:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4753000000000007e-05 2024-09-10T06:27:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.798404+0000", 2024-09-10T06:27:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4055999999999998e-05 2024-09-10T06:27:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 62.742862168999999, 2024-09-10T06:27:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031632380000000001, 2024-09-10T06:27:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 805 2024-09-10T06:27:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.749 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:44.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910557+0000", 2024-09-10T06:27:44.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910560+0000", 2024-09-10T06:27:44.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2200000000000001e-06 2024-09-10T06:27:44.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910574+0000", 2024-09-10T06:27:44.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3536000000000001e-05 2024-09-10T06:27:44.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910604+0000", 2024-09-10T06:27:44.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0645999999999998e-05 2024-09-10T06:27:44.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910619+0000", 2024-09-10T06:27:44.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5064e-05 2024-09-10T06:27:44.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910759+0000", 2024-09-10T06:27:44.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013943899999999999 2024-09-10T06:27:44.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.910984+0000", 2024-09-10T06:27:44.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000225381 2024-09-10T06:27:44.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.911312+0000", 2024-09-10T06:27:44.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032782800000000001 2024-09-10T06:27:44.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.912402+0000", 2024-09-10T06:27:44.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010895639999999999 2024-09-10T06:27:44.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913576+0000", 2024-09-10T06:27:44.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174591 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913657+0000", 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1223000000000005e-05 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.913720+0000", 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2745999999999999e-05 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.754 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 62.683084434000001, 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030680099999999999, 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 832 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:44.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970335+0000", 2024-09-10T06:27:44.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970337+0000", 2024-09-10T06:27:44.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6230000000000001e-06 2024-09-10T06:27:44.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970349+0000", 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1557e-05 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970379+0000", 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0456000000000001e-05 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970394+0000", 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4683e-05 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970509+0000", 2024-09-10T06:27:44.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114613 2024-09-10T06:27:44.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.970753+0000", 2024-09-10T06:27:44.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244295 2024-09-10T06:27:44.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:44.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.971078+0000", 2024-09-10T06:27:44.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000325583 2024-09-10T06:27:44.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.972162+0000", 2024-09-10T06:27:44.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010834519999999999 2024-09-10T06:27:44.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973200+0000", 2024-09-10T06:27:44.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010376560000000001 2024-09-10T06:27:44.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973287+0000", 2024-09-10T06:27:44.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7163000000000006e-05 2024-09-10T06:27:44.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.973403+0000", 2024-09-10T06:27:44.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011592899999999999 2024-09-10T06:27:44.760 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.760 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.760 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.760 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:901 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.760 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:44.761 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 62.528013207000001, 2024-09-10T06:27:44.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030018599999999999, 2024-09-10T06:27:44.761 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.761 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.761 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.761 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.761 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.761 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.761 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 901 2024-09-10T06:27:44.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.761 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:44.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125406+0000", 2024-09-10T06:27:44.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125409+0000", 2024-09-10T06:27:44.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.253e-06 2024-09-10T06:27:44.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125425+0000", 2024-09-10T06:27:44.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5636000000000001e-05 2024-09-10T06:27:44.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125456+0000", 2024-09-10T06:27:44.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1130000000000002e-05 2024-09-10T06:27:44.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125470+0000", 2024-09-10T06:27:44.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.464e-05 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125581+0000", 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110612 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.125814+0000", 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023266899999999999 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.126159+0000", 2024-09-10T06:27:44.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034565399999999998 2024-09-10T06:27:44.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.127161+0000", 2024-09-10T06:27:44.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010020890000000001 2024-09-10T06:27:44.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128202+0000", 2024-09-10T06:27:44.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001040242 2024-09-10T06:27:44.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128288+0000", 2024-09-10T06:27:44.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6156000000000007e-05 2024-09-10T06:27:44.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.128408+0000", 2024-09-10T06:27:44.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011977900000000001 2024-09-10T06:27:44.766 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.766 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.766 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.766 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.766 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:44.766 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 62.493920838000001, 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029016649999999999, 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 916 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159498+0000", 2024-09-10T06:27:44.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159501+0000", 2024-09-10T06:27:44.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5000000000000002e-06 2024-09-10T06:27:44.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.768 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.768 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159512+0000", 2024-09-10T06:27:44.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1564e-05 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159543+0000", 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0942999999999998e-05 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159558+0000", 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.436e-05 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159701+0000", 2024-09-10T06:27:44.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014363599999999999 2024-09-10T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.159927+0000", 2024-09-10T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022535099999999999 2024-09-10T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.160260+0000", 2024-09-10T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033321700000000002 2024-09-10T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.161312+0000", 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001052222 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162261+0000", 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00094912600000000001 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162337+0000", 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6268999999999998e-05 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.162400+0000", 2024-09-10T06:27:44.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2477000000000005e-05 2024-09-10T06:27:44.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.772 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.772 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.772 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:44.772 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:44.772 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 62.423611327000003, 2024-09-10T06:27:44.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030045179999999999, 2024-09-10T06:27:44.772 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:44.772 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:44.772 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:44.772 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:44.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:44.773 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:44.773 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 946 2024-09-10T06:27:44.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.773 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:44.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:44.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:44.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:44.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229808+0000", 2024-09-10T06:27:44.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229810+0000", 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229838+0000", 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7776e-05 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229869+0000", 2024-09-10T06:27:44.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0766999999999999e-05 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.229883+0000", 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4423000000000001e-05 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230005+0000", 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121919 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230219+0000", 2024-09-10T06:27:44.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000214098 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.230588+0000", 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036857099999999999 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.231707+0000", 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011193349999999999 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232662+0000", 2024-09-10T06:27:44.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095513300000000005 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232748+0000", 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6151999999999998e-05 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.232812+0000", 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3876999999999998e-05 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:44.777 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:44.778 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:44.778 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:44.779 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:44.780 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:27:44.780 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:44.781 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:44.781 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:44.781 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:44.781 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:44.782 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:44.782 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:44.776+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:44.880 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:44.881+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:44.981 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:44.981+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:44.993 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:44.993 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:44.994 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:44.994 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:45.012 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:27:45.082 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:45.081+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:45.180 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:45.180 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:45.180 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:45.180 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:45.181 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:45.183 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:45.180+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:45.198 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:27:45.284 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:45.285+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:45.384 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:45.380+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:45.411 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:45.411 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:45.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:45.412 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:45.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.412 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4236.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T06:27:45.412 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:45.412 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 81.901524738000006, 2024-09-10T06:27:45.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049682550000000004, 2024-09-10T06:27:45.412 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.413 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.413 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.413 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:45.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:45.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507427+0000", 2024-09-10T06:27:45.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5629999999999999e-06 2024-09-10T06:27:45.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507439+0000", 2024-09-10T06:27:45.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.19e-05 2024-09-10T06:27:45.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507460+0000", 2024-09-10T06:27:45.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1693000000000001e-05 2024-09-10T06:27:45.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507480+0000", 2024-09-10T06:27:45.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9947000000000001e-05 2024-09-10T06:27:45.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507613+0000", 2024-09-10T06:27:45.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000132409 2024-09-10T06:27:45.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507696+0000", 2024-09-10T06:27:45.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2953000000000004e-05 2024-09-10T06:27:45.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512288+0000", 2024-09-10T06:27:45.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045927110000000002 2024-09-10T06:27:45.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512393+0000", 2024-09-10T06:27:45.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105079 2024-09-10T06:27:45.420 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.420 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.420 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.420 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:45.421 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:45.421 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.078060706000002, 2024-09-10T06:27:45.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025692739999999999, 2024-09-10T06:27:45.421 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.421 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.421 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.422 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.422 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:45.422 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:45.422 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 42 2024-09-10T06:27:45.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.422 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:45.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:45.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330891+0000", 2024-09-10T06:27:45.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9700000000000002e-06 2024-09-10T06:27:45.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330901+0000", 2024-09-10T06:27:45.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2909999999999996e-06 2024-09-10T06:27:45.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330924+0000", 2024-09-10T06:27:45.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3132000000000001e-05 2024-09-10T06:27:45.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330935+0000", 2024-09-10T06:27:45.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0893999999999999e-05 2024-09-10T06:27:45.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331021+0000", 2024-09-10T06:27:45.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6205000000000006e-05 2024-09-10T06:27:45.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331160+0000", 2024-09-10T06:27:45.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013973600000000001 2024-09-10T06:27:45.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:45.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331336+0000", 2024-09-10T06:27:45.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017578799999999999 2024-09-10T06:27:45.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.332381+0000", 2024-09-10T06:27:45.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001044627 2024-09-10T06:27:45.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333371+0000", 2024-09-10T06:27:45.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098979800000000007 2024-09-10T06:27:45.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333421+0000", 2024-09-10T06:27:45.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9872e-05 2024-09-10T06:27:45.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333459+0000", 2024-09-10T06:27:45.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7960999999999998e-05 2024-09-10T06:27:45.431 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.432 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.432 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.432 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:45.432 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:45.432 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.092869785999994, 2024-09-10T06:27:45.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025247730000000001, 2024-09-10T06:27:45.433 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.433 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.433 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.433 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 52 2024-09-10T06:27:45.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.434 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:45.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:45.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316084+0000", 2024-09-10T06:27:45.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8260000000000003e-06 2024-09-10T06:27:45.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316095+0000", 2024-09-10T06:27:45.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1229999999999999e-05 2024-09-10T06:27:45.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316131+0000", 2024-09-10T06:27:45.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5499e-05 2024-09-10T06:27:45.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316150+0000", 2024-09-10T06:27:45.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9510000000000001e-05 2024-09-10T06:27:45.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316275+0000", 2024-09-10T06:27:45.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012501600000000001 2024-09-10T06:27:45.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316507+0000", 2024-09-10T06:27:45.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000231404 2024-09-10T06:27:45.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:45.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316712+0000", 2024-09-10T06:27:45.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204873 2024-09-10T06:27:45.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.317603+0000", 2024-09-10T06:27:45.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089174399999999998 2024-09-10T06:27:45.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318470+0000", 2024-09-10T06:27:45.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086713399999999998 2024-09-10T06:27:45.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318552+0000", 2024-09-10T06:27:45.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1279999999999994e-05 2024-09-10T06:27:45.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318605+0000", 2024-09-10T06:27:45.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3257000000000002e-05 2024-09-10T06:27:45.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.443 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.444 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.444 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:45.444 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.989091457000001, 2024-09-10T06:27:45.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033383480000000001, 2024-09-10T06:27:45.444 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.444 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.444 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.445 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 236 2024-09-10T06:27:45.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.445 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:45.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:45.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419861+0000", 2024-09-10T06:27:45.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.734e-06 2024-09-10T06:27:45.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419873+0000", 2024-09-10T06:27:45.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1789e-05 2024-09-10T06:27:45.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419904+0000", 2024-09-10T06:27:45.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1377000000000001e-05 2024-09-10T06:27:45.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419921+0000", 2024-09-10T06:27:45.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6878999999999999e-05 2024-09-10T06:27:45.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420052+0000", 2024-09-10T06:27:45.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013025600000000001 2024-09-10T06:27:45.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420263+0000", 2024-09-10T06:27:45.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021196600000000001 2024-09-10T06:27:45.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:45.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420649+0000", 2024-09-10T06:27:45.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038507 2024-09-10T06:27:45.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.422366+0000", 2024-09-10T06:27:45.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017172000000000001 2024-09-10T06:27:45.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423048+0000", 2024-09-10T06:27:45.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00068254100000000005 2024-09-10T06:27:45.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423127+0000", 2024-09-10T06:27:45.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8207000000000005e-05 2024-09-10T06:27:45.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423197+0000", 2024-09-10T06:27:45.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0328999999999997e-05 2024-09-10T06:27:45.453 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.453 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.453 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.454 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.454 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:45.454 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.972490182999998, 2024-09-10T06:27:45.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003575235, 2024-09-10T06:27:45.454 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.454 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.455 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.455 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.455 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.455 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.455 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 299 2024-09-10T06:27:45.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.455 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:45.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:45.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436461+0000", 2024-09-10T06:27:45.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.144e-06 2024-09-10T06:27:45.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436466+0000", 2024-09-10T06:27:45.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8409999999999999e-06 2024-09-10T06:27:45.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436477+0000", 2024-09-10T06:27:45.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1253000000000001e-05 2024-09-10T06:27:45.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436483+0000", 2024-09-10T06:27:45.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7010000000000001e-06 2024-09-10T06:27:45.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436527+0000", 2024-09-10T06:27:45.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4381000000000001e-05 2024-09-10T06:27:45.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436569+0000", 2024-09-10T06:27:45.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2208e-05 2024-09-10T06:27:45.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:45.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436687+0000", 2024-09-10T06:27:45.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118093 2024-09-10T06:27:45.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.437455+0000", 2024-09-10T06:27:45.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076799599999999996 2024-09-10T06:27:45.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439950+0000", 2024-09-10T06:27:45.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024946040000000001 2024-09-10T06:27:45.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439988+0000", 2024-09-10T06:27:45.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8405999999999998e-05 2024-09-10T06:27:45.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.440035+0000", 2024-09-10T06:27:45.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6607999999999998e-05 2024-09-10T06:27:45.464 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.464 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.464 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.464 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.464 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:45.465 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.637814101000004, 2024-09-10T06:27:45.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028833040000000002, 2024-09-10T06:27:45.465 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.465 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.465 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.465 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.465 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.465 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.466 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 742 2024-09-10T06:27:45.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.466 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:45.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:45.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771139+0000", 2024-09-10T06:27:45.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5269999999999999e-06 2024-09-10T06:27:45.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771153+0000", 2024-09-10T06:27:45.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4036000000000001e-05 2024-09-10T06:27:45.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771186+0000", 2024-09-10T06:27:45.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2113000000000002e-05 2024-09-10T06:27:45.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771201+0000", 2024-09-10T06:27:45.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:45.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771320+0000", 2024-09-10T06:27:45.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119265 2024-09-10T06:27:45.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771557+0000", 2024-09-10T06:27:45.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023640600000000001 2024-09-10T06:27:45.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:45.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771890+0000", 2024-09-10T06:27:45.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033302000000000001 2024-09-10T06:27:45.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773204+0000", 2024-09-10T06:27:45.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013142239999999999 2024-09-10T06:27:45.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773864+0000", 2024-09-10T06:27:45.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066005100000000004 2024-09-10T06:27:45.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773948+0000", 2024-09-10T06:27:45.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4625999999999999e-05 2024-09-10T06:27:45.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774019+0000", 2024-09-10T06:27:45.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0705999999999997e-05 2024-09-10T06:27:45.473 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.473 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.473 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.473 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.473 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:45.473 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.634034851000003, 2024-09-10T06:27:45.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025263479999999999, 2024-09-10T06:27:45.474 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.474 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.474 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.474 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.474 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.474 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.474 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 744 2024-09-10T06:27:45.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774917+0000", 2024-09-10T06:27:45.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0540000000000002e-06 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774926+0000", 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5660000000000007e-06 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774947+0000", 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0852999999999998e-05 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774958+0000", 2024-09-10T06:27:45.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1216999999999999e-05 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775045+0000", 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7643000000000001e-05 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775167+0000", 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012163900000000001 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775427+0000", 2024-09-10T06:27:45.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000259678 2024-09-10T06:27:45.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.776736+0000", 2024-09-10T06:27:45.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013093429999999999 2024-09-10T06:27:45.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777296+0000", 2024-09-10T06:27:45.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056029599999999995 2024-09-10T06:27:45.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777374+0000", 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7721999999999999e-05 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777441+0000", 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7336999999999996e-05 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.596719305000001, 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036412979999999998, 2024-09-10T06:27:45.479 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.480 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.480 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.480 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.480 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 760 2024-09-10T06:27:45.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.480 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:45.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812233+0000", 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812244+0000", 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1273e-05 2024-09-10T06:27:45.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812276+0000", 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1253e-05 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812290+0000", 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4576000000000001e-05 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812438+0000", 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014775899999999999 2024-09-10T06:27:45.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812821+0000", 2024-09-10T06:27:45.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000383187 2024-09-10T06:27:45.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:45.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.813398+0000", 2024-09-10T06:27:45.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000576619 2024-09-10T06:27:45.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.814658+0000", 2024-09-10T06:27:45.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001260207 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815591+0000", 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00093332899999999999 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815745+0000", 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153392 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815872+0000", 2024-09-10T06:27:45.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012715599999999999 2024-09-10T06:27:45.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.485 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.485 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.485 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:45.485 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.592083920999997, 2024-09-10T06:27:45.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029417369999999998, 2024-09-10T06:27:45.485 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.485 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.486 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.486 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 762 2024-09-10T06:27:45.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.486 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:45.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816868+0000", 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.283e-06 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816879+0000", 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0523000000000001e-05 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816910+0000", 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0732999999999999e-05 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816926+0000", 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.677e-05 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817058+0000", 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013195599999999999 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817299+0000", 2024-09-10T06:27:45.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000241091 2024-09-10T06:27:45.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:45.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817761+0000", 2024-09-10T06:27:45.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046188400000000003 2024-09-10T06:27:45.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.818948+0000", 2024-09-10T06:27:45.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:45.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819662+0000", 2024-09-10T06:27:45.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071398399999999997 2024-09-10T06:27:45.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819745+0000", 2024-09-10T06:27:45.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3560000000000006e-05 2024-09-10T06:27:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819808+0000", 2024-09-10T06:27:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2329000000000006e-05 2024-09-10T06:27:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.471623203999997, 2024-09-10T06:27:45.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002834175, 2024-09-10T06:27:45.492 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.492 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.492 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.492 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.492 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 817 2024-09-10T06:27:45.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.492 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:45.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:45.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937330+0000", 2024-09-10T06:27:45.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9869999999999999e-06 2024-09-10T06:27:45.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937342+0000", 2024-09-10T06:27:45.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2595999999999999e-05 2024-09-10T06:27:45.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937375+0000", 2024-09-10T06:27:45.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2320000000000002e-05 2024-09-10T06:27:45.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937390+0000", 2024-09-10T06:27:45.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4977000000000001e-05 2024-09-10T06:27:45.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937529+0000", 2024-09-10T06:27:45.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013937199999999999 2024-09-10T06:27:45.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937753+0000", 2024-09-10T06:27:45.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000224358 2024-09-10T06:27:45.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:45.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.938061+0000", 2024-09-10T06:27:45.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030808799999999998 2024-09-10T06:27:45.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.939112+0000", 2024-09-10T06:27:45.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010503050000000001 2024-09-10T06:27:45.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940005+0000", 2024-09-10T06:27:45.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089366599999999999 2024-09-10T06:27:45.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940093+0000", 2024-09-10T06:27:45.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8053000000000006e-05 2024-09-10T06:27:45.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940161+0000", 2024-09-10T06:27:45.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7453000000000006e-05 2024-09-10T06:27:45.497 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.497 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.497 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.497 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.497 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:45.497 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.418695161999999, 2024-09-10T06:27:45.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027552649999999998, 2024-09-10T06:27:45.498 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.498 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.498 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.498 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.498 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 841 2024-09-10T06:27:45.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.498 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:45.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:45.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990257+0000", 2024-09-10T06:27:45.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6869999999999999e-06 2024-09-10T06:27:45.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990270+0000", 2024-09-10T06:27:45.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2843000000000001e-05 2024-09-10T06:27:45.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990300+0000", 2024-09-10T06:27:45.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9252999999999999e-05 2024-09-10T06:27:45.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990314+0000", 2024-09-10T06:27:45.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4796e-05 2024-09-10T06:27:45.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990427+0000", 2024-09-10T06:27:45.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112649 2024-09-10T06:27:45.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990671+0000", 2024-09-10T06:27:45.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244408 2024-09-10T06:27:45.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:45.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990987+0000", 2024-09-10T06:27:45.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031593099999999998 2024-09-10T06:27:45.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992073+0000", 2024-09-10T06:27:45.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010854549999999999 2024-09-10T06:27:45.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992862+0000", 2024-09-10T06:27:45.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00078889400000000005 2024-09-10T06:27:45.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992944+0000", 2024-09-10T06:27:45.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2152999999999998e-05 2024-09-10T06:27:45.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993010+0000", 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6196000000000001e-05 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.414959228000001, 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025373539999999999, 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.503 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.504 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.504 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.504 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.504 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.504 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 843 2024-09-10T06:27:45.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.504 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:45.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:45.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993993+0000", 2024-09-10T06:27:45.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3630000000000001e-06 2024-09-10T06:27:45.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994004+0000", 2024-09-10T06:27:45.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0557000000000001e-05 2024-09-10T06:27:45.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994035+0000", 2024-09-10T06:27:45.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0969000000000001e-05 2024-09-10T06:27:45.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994055+0000", 2024-09-10T06:27:45.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0497e-05 2024-09-10T06:27:45.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994150+0000", 2024-09-10T06:27:45.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5363000000000002e-05 2024-09-10T06:27:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994275+0000", 2024-09-10T06:27:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012453200000000001 2024-09-10T06:27:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994570+0000", 2024-09-10T06:27:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029522100000000003 2024-09-10T06:27:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.995569+0000", 2024-09-10T06:27:45.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00099913200000000001 2024-09-10T06:27:45.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996384+0000", 2024-09-10T06:27:45.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081451099999999997 2024-09-10T06:27:45.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996462+0000", 2024-09-10T06:27:45.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8502000000000002e-05 2024-09-10T06:27:45.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996528+0000", 2024-09-10T06:27:45.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5707e-05 2024-09-10T06:27:45.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.509 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.509 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.509 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.509 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:45.509 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.405512080999998, 2024-09-10T06:27:45.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033145539999999999, 2024-09-10T06:27:45.509 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 847 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:45.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003440+0000", 2024-09-10T06:27:45.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5299999999999999e-06 2024-09-10T06:27:45.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003452+0000", 2024-09-10T06:27:45.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:45.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003482+0000", 2024-09-10T06:27:45.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0790000000000002e-05 2024-09-10T06:27:45.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003497+0000", 2024-09-10T06:27:45.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.489e-05 2024-09-10T06:27:45.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003645+0000", 2024-09-10T06:27:45.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014771900000000001 2024-09-10T06:27:45.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003996+0000", 2024-09-10T06:27:45.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000350861 2024-09-10T06:27:45.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:45.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.004540+0000", 2024-09-10T06:27:45.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054383199999999995 2024-09-10T06:27:45.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.005831+0000", 2024-09-10T06:27:45.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001291366 2024-09-10T06:27:45.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006461+0000", 2024-09-10T06:27:45.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062943899999999998 2024-09-10T06:27:45.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006631+0000", 2024-09-10T06:27:45.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000170228 2024-09-10T06:27:45.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006752+0000", 2024-09-10T06:27:45.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012160899999999999 2024-09-10T06:27:45.516 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.516 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.516 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.517 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.517 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:45.517 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.401258914000003, 2024-09-10T06:27:45.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002619953, 2024-09-10T06:27:45.517 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.517 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.517 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.517 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.517 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.517 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.517 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 849 2024-09-10T06:27:45.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.518 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:45.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:45.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007693+0000", 2024-09-10T06:27:45.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3099999999999999e-06 2024-09-10T06:27:45.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007704+0000", 2024-09-10T06:27:45.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0387000000000001e-05 2024-09-10T06:27:45.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007734+0000", 2024-09-10T06:27:45.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0676000000000002e-05 2024-09-10T06:27:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007753+0000", 2024-09-10T06:27:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.836e-05 2024-09-10T06:27:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007857+0000", 2024-09-10T06:27:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103836 2024-09-10T06:27:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007980+0000", 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123843 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.008241+0000", 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026085799999999999 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.009475+0000", 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012340230000000001 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010168+0000", 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00069220800000000004 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010247+0000", 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9929e-05 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010311+0000", 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3522999999999995e-05 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.523 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.523 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:45.523 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.356779093, 2024-09-10T06:27:45.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026646590000000002, 2024-09-10T06:27:45.523 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.523 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.523 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.523 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.523 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 868 2024-09-10T06:27:45.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.524 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:45.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:45.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052173+0000", 2024-09-10T06:27:45.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-10T06:27:45.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052186+0000", 2024-09-10T06:27:45.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2787e-05 2024-09-10T06:27:45.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052216+0000", 2024-09-10T06:27:45.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9618999999999999e-05 2024-09-10T06:27:45.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052231+0000", 2024-09-10T06:27:45.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4929999999999999e-05 2024-09-10T06:27:45.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052349+0000", 2024-09-10T06:27:45.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011830200000000001 2024-09-10T06:27:45.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052561+0000", 2024-09-10T06:27:45.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000212182 2024-09-10T06:27:45.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:45.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052874+0000", 2024-09-10T06:27:45.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031299399999999998 2024-09-10T06:27:45.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054049+0000", 2024-09-10T06:27:45.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174825 2024-09-10T06:27:45.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054635+0000", 2024-09-10T06:27:45.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058643900000000001 2024-09-10T06:27:45.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054721+0000", 2024-09-10T06:27:45.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5185999999999994e-05 2024-09-10T06:27:45.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054836+0000", 2024-09-10T06:27:45.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114922 2024-09-10T06:27:45.528 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.529 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.529 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.529 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.529 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:45.529 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.270122991999997, 2024-09-10T06:27:45.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028453739999999999, 2024-09-10T06:27:45.529 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.529 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.529 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.529 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 907 2024-09-10T06:27:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:45.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138830+0000", 2024-09-10T06:27:45.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8600000000000001e-06 2024-09-10T06:27:45.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138842+0000", 2024-09-10T06:27:45.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2126e-05 2024-09-10T06:27:45.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138874+0000", 2024-09-10T06:27:45.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2047e-05 2024-09-10T06:27:45.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138889+0000", 2024-09-10T06:27:45.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4966999999999999e-05 2024-09-10T06:27:45.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139007+0000", 2024-09-10T06:27:45.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118479 2024-09-10T06:27:45.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139238+0000", 2024-09-10T06:27:45.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023031399999999999 2024-09-10T06:27:45.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:45.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139566+0000", 2024-09-10T06:27:45.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032816099999999999 2024-09-10T06:27:45.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.140631+0000", 2024-09-10T06:27:45.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010653679999999999 2024-09-10T06:27:45.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141393+0000", 2024-09-10T06:27:45.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076187100000000001 2024-09-10T06:27:45.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141561+0000", 2024-09-10T06:27:45.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016755599999999999 2024-09-10T06:27:45.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141672+0000", 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111625 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.266199475999997, 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002857268, 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.535 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.536 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.536 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.536 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 909 2024-09-10T06:27:45.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.536 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:45.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:45.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142753+0000", 2024-09-10T06:27:45.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4040000000000002e-06 2024-09-10T06:27:45.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142764+0000", 2024-09-10T06:27:45.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0789e-05 2024-09-10T06:27:45.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142795+0000", 2024-09-10T06:27:45.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0982999999999998e-05 2024-09-10T06:27:45.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142810+0000", 2024-09-10T06:27:45.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4960000000000001e-05 2024-09-10T06:27:45.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142908+0000", 2024-09-10T06:27:45.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8726000000000003e-05 2024-09-10T06:27:45.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143030+0000", 2024-09-10T06:27:45.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121649 2024-09-10T06:27:45.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:45.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143294+0000", 2024-09-10T06:27:45.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000263875 2024-09-10T06:27:45.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.144530+0000", 2024-09-10T06:27:45.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001236067 2024-09-10T06:27:45.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145340+0000", 2024-09-10T06:27:45.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080966700000000003 2024-09-10T06:27:45.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145497+0000", 2024-09-10T06:27:45.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015773499999999999 2024-09-10T06:27:45.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145608+0000", 2024-09-10T06:27:45.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110413 2024-09-10T06:27:45.541 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.541 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.541 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.541 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.541 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:45.541 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.172501979000003, 2024-09-10T06:27:45.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029166940000000001, 2024-09-10T06:27:45.541 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.541 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.542 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.542 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.542 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 949 2024-09-10T06:27:45.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.542 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:45.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236451+0000", 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236464+0000", 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3223e-05 2024-09-10T06:27:45.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236497+0000", 2024-09-10T06:27:45.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2672999999999997e-05 2024-09-10T06:27:45.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236515+0000", 2024-09-10T06:27:45.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8386999999999999e-05 2024-09-10T06:27:45.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236636+0000", 2024-09-10T06:27:45.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120752 2024-09-10T06:27:45.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236857+0000", 2024-09-10T06:27:45.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022134499999999999 2024-09-10T06:27:45.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:45.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.237188+0000", 2024-09-10T06:27:45.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033057799999999999 2024-09-10T06:27:45.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.238353+0000", 2024-09-10T06:27:45.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001164841 2024-09-10T06:27:45.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239160+0000", 2024-09-10T06:27:45.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080743000000000004 2024-09-10T06:27:45.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.546 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.546 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239245+0000", 2024-09-10T06:27:45.546 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5189e-05 2024-09-10T06:27:45.546 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.546 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.547 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.547 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239365+0000", 2024-09-10T06:27:45.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119406 2024-09-10T06:27:45.547 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.547 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.547 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.547 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.547 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.547 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.547 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:45.547 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.168640871999997, 2024-09-10T06:27:45.547 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025033970000000001, 2024-09-10T06:27:45.547 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.547 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.548 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.548 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.548 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.548 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.548 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 951 2024-09-10T06:27:45.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.548 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.548 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:45.548 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.548 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.548 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.548 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:45.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240311+0000", 2024-09-10T06:27:45.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8899999999999999e-06 2024-09-10T06:27:45.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.549 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.549 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240320+0000", 2024-09-10T06:27:45.549 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6799999999999999e-06 2024-09-10T06:27:45.549 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.549 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240341+0000", 2024-09-10T06:27:45.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1379e-05 2024-09-10T06:27:45.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240352+0000", 2024-09-10T06:27:45.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1354e-05 2024-09-10T06:27:45.550 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.550 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.550 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.550 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240450+0000", 2024-09-10T06:27:45.550 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7866000000000001e-05 2024-09-10T06:27:45.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240580+0000", 2024-09-10T06:27:45.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012970899999999999 2024-09-10T06:27:45.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:45.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240851+0000", 2024-09-10T06:27:45.551 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027059099999999998 2024-09-10T06:27:45.551 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.551 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.551 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.551 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242052+0000", 2024-09-10T06:27:45.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001201014 2024-09-10T06:27:45.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242662+0000", 2024-09-10T06:27:45.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061076800000000003 2024-09-10T06:27:45.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.552 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242747+0000", 2024-09-10T06:27:45.552 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5019999999999996e-05 2024-09-10T06:27:45.552 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.552 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.552 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.553 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242812+0000", 2024-09-10T06:27:45.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5126e-05 2024-09-10T06:27:45.553 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.553 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.553 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.553 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.553 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.553 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:45.553 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:45.553 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 63.158191453000001, 2024-09-10T06:27:45.553 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027897120000000002, 2024-09-10T06:27:45.553 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:45.553 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:45.553 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:45.554 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:45.554 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:45.554 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:45.554 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 955 2024-09-10T06:27:45.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.554 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:45.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:45.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:45.554 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.554 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.554 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.554 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:45.554 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:45.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:45.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:45.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250761+0000", 2024-09-10T06:27:45.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:45.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:45.555 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250772+0000", 2024-09-10T06:27:45.555 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1153e-05 2024-09-10T06:27:45.555 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.555 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.555 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:45.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250802+0000", 2024-09-10T06:27:45.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-05 2024-09-10T06:27:45.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:45.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250817+0000", 2024-09-10T06:27:45.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4883e-05 2024-09-10T06:27:45.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.556 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:45.556 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250925+0000", 2024-09-10T06:27:45.556 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108249 2024-09-10T06:27:45.556 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.556 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251139+0000", 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000213568 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251450+0000", 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031139200000000002 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.252574+0000", 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011239139999999999 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.557 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:45.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253377+0000", 2024-09-10T06:27:45.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080306400000000003 2024-09-10T06:27:45.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:45.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253466+0000", 2024-09-10T06:27:45.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8436000000000005e-05 2024-09-10T06:27:45.558 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:45.558 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:45.558 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:45.558 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253548+0000", 2024-09-10T06:27:45.558 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2496000000000004e-05 2024-09-10T06:27:45.558 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.559 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.559 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:45.559 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:45.559 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:45.560 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:27:45.561 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:45.556+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:45.661 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:45.656+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:45.762 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:45.761+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:45.769 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:45.769 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:45.769 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:45.770 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:45.788 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:27:45.873 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:45.872+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:45.965 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:45.965+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:45.996 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:45.997 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:45.997 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:45.997 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:45.997 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:46.014 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:27:46.066 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:46.065+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:46.166 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:46.164+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:46.226 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:46.227 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:46.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:46.227 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:46.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.227 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:46.227 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:46.227 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.900804649999998, 2024-09-10T06:27:46.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030326279999999999, 2024-09-10T06:27:46.227 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.227 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.227 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.227 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.228 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.228 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.228 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 58 2024-09-10T06:27:46.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.228 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:46.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:46.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:46.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-10T06:27:46.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324169+0000", 2024-09-10T06:27:46.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9020000000000004e-06 2024-09-10T06:27:46.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324182+0000", 2024-09-10T06:27:46.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2166e-05 2024-09-10T06:27:46.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324190+0000", 2024-09-10T06:27:46.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.337e-06 2024-09-10T06:27:46.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324282+0000", 2024-09-10T06:27:46.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2331999999999996e-05 2024-09-10T06:27:46.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324486+0000", 2024-09-10T06:27:46.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020347400000000001 2024-09-10T06:27:46.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:46.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324719+0000", 2024-09-10T06:27:46.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023289900000000001 2024-09-10T06:27:46.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.325993+0000", 2024-09-10T06:27:46.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012746929999999999 2024-09-10T06:27:46.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327088+0000", 2024-09-10T06:27:46.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010947330000000001 2024-09-10T06:27:46.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327147+0000", 2024-09-10T06:27:46.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8677000000000001e-05 2024-09-10T06:27:46.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327195+0000", 2024-09-10T06:27:46.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8469e-05 2024-09-10T06:27:46.233 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.233 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.233 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.233 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:46.233 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:46.233 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.918984068, 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003846917, 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 207 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:46.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305987+0000", 2024-09-10T06:27:46.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6069999999999999e-06 2024-09-10T06:27:46.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306002+0000", 2024-09-10T06:27:46.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5406000000000001e-05 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306036+0000", 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4146000000000001e-05 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306061+0000", 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4470000000000001e-05 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306325+0000", 2024-09-10T06:27:46.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026382800000000002 2024-09-10T06:27:46.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306569+0000", 2024-09-10T06:27:46.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024445499999999998 2024-09-10T06:27:46.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:46.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.307017+0000", 2024-09-10T06:27:46.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044774000000000002 2024-09-10T06:27:46.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.308517+0000", 2024-09-10T06:27:46.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001500075 2024-09-10T06:27:46.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309685+0000", 2024-09-10T06:27:46.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001168505 2024-09-10T06:27:46.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309767+0000", 2024-09-10T06:27:46.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1992999999999999e-05 2024-09-10T06:27:46.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309830+0000", 2024-09-10T06:27:46.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2692000000000002e-05 2024-09-10T06:27:46.239 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.239 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.239 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.239 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.239 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:46.239 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.874732019999996, 2024-09-10T06:27:46.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003433888, 2024-09-10T06:27:46.239 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.240 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.240 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.240 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.240 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 216 2024-09-10T06:27:46.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.240 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:46.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350239+0000", 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.377e-06 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350254+0000", 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.501e-05 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350288+0000", 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4746000000000002e-05 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350312+0000", 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3249999999999999e-05 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350456+0000", 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014483899999999999 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350704+0000", 2024-09-10T06:27:46.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024719100000000001 2024-09-10T06:27:46.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:46.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.351117+0000", 2024-09-10T06:27:46.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000412934 2024-09-10T06:27:46.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.243 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.243 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.352644+0000", 2024-09-10T06:27:46.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015271079999999999 2024-09-10T06:27:46.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353397+0000", 2024-09-10T06:27:46.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075311799999999999 2024-09-10T06:27:46.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353556+0000", 2024-09-10T06:27:46.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159612 2024-09-10T06:27:46.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353669+0000", 2024-09-10T06:27:46.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011270299999999999 2024-09-10T06:27:46.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.245 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.245 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.245 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.245 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:46.245 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.836052558000006, 2024-09-10T06:27:46.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033447479999999998, 2024-09-10T06:27:46.245 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.245 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.245 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.245 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 227 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388917+0000", 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6900000000000001e-06 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388931+0000", 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3900000000000001e-05 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388964+0000", 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2985999999999999e-05 2024-09-10T06:27:46.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388980+0000", 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.535e-05 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389123+0000", 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014337900000000001 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389341+0000", 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021765099999999999 2024-09-10T06:27:46.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:46.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389765+0000", 2024-09-10T06:27:46.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042423100000000001 2024-09-10T06:27:46.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.391433+0000", 2024-09-10T06:27:46.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016681000000000001 2024-09-10T06:27:46.249 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.249 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.249 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.249 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392104+0000", 2024-09-10T06:27:46.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067064800000000003 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392191+0000", 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7912999999999997e-05 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392259+0000", 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7899999999999997e-05 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.250 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.251 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.251 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:46.251 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.828795783999993, 2024-09-10T06:27:46.251 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029995500000000001, 2024-09-10T06:27:46.251 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.251 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.251 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.251 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.251 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.251 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.252 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 229 2024-09-10T06:27:46.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.252 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:46.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.252 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.252 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:46.252 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.252 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.252 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396174+0000", 2024-09-10T06:27:46.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.774e-06 2024-09-10T06:27:46.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396186+0000", 2024-09-10T06:27:46.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2055999999999999e-05 2024-09-10T06:27:46.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.253 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.253 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.253 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396216+0000", 2024-09-10T06:27:46.253 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9640000000000001e-05 2024-09-10T06:27:46.253 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396231+0000", 2024-09-10T06:27:46.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:46.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.254 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.254 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396356+0000", 2024-09-10T06:27:46.254 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012504500000000001 2024-09-10T06:27:46.254 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.254 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396568+0000", 2024-09-10T06:27:46.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000211709 2024-09-10T06:27:46.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:46.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396954+0000", 2024-09-10T06:27:46.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386027 2024-09-10T06:27:46.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.255 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.255 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.255 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.398287+0000", 2024-09-10T06:27:46.255 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013331560000000001 2024-09-10T06:27:46.255 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399004+0000", 2024-09-10T06:27:46.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071720499999999995 2024-09-10T06:27:46.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399091+0000", 2024-09-10T06:27:46.256 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6714999999999999e-05 2024-09-10T06:27:46.256 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.256 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.256 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.256 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399171+0000", 2024-09-10T06:27:46.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9893000000000002e-05 2024-09-10T06:27:46.257 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.257 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.257 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.257 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.257 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.257 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.257 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:46.257 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.822237215000001, 2024-09-10T06:27:46.257 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030468270000000002, 2024-09-10T06:27:46.257 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.257 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.257 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 231 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:46.258 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402732+0000", 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-06 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402744+0000", 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1633e-05 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402774+0000", 2024-09-10T06:27:46.259 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9666999999999999e-05 2024-09-10T06:27:46.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402789+0000", 2024-09-10T06:27:46.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5466000000000001e-05 2024-09-10T06:27:46.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402904+0000", 2024-09-10T06:27:46.260 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114466 2024-09-10T06:27:46.260 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.260 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.260 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.260 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403119+0000", 2024-09-10T06:27:46.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215572 2024-09-10T06:27:46.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:46.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403516+0000", 2024-09-10T06:27:46.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039663300000000002 2024-09-10T06:27:46.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.261 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405012+0000", 2024-09-10T06:27:46.261 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014961919999999999 2024-09-10T06:27:46.261 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.261 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.261 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405634+0000", 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062145199999999999 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405715+0000", 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1619000000000006e-05 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405777+0000", 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1639999999999999e-05 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.262 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.263 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.263 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:377 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.263 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:46.263 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.763481884000001, 2024-09-10T06:27:46.263 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058485480000000003, 2024-09-10T06:27:46.263 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.263 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.263 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.263 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.263 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.263 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.263 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 377 2024-09-10T06:27:46.263 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461486+0000", 2024-09-10T06:27:46.264 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0720000000000001e-06 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461504+0000", 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8002000000000001e-05 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461519+0000", 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4584e-05 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461526+0000", 2024-09-10T06:27:46.265 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5560000000000004e-06 2024-09-10T06:27:46.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461597+0000", 2024-09-10T06:27:46.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1311999999999998e-05 2024-09-10T06:27:46.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461709+0000", 2024-09-10T06:27:46.266 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011191100000000001 2024-09-10T06:27:46.266 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.266 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.266 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:46.266 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461871+0000", 2024-09-10T06:27:46.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016254900000000001 2024-09-10T06:27:46.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.462777+0000", 2024-09-10T06:27:46.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00090547100000000003 2024-09-10T06:27:46.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.267 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.267 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.267 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467265+0000", 2024-09-10T06:27:46.267 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004488222 2024-09-10T06:27:46.267 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467308+0000", 2024-09-10T06:27:46.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2975000000000001e-05 2024-09-10T06:27:46.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.268 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.268 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.268 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467334+0000", 2024-09-10T06:27:46.268 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5894e-05 2024-09-10T06:27:46.268 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.268 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.268 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.268 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.269 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.269 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:384 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.269 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:46.269 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.761349029000002, 2024-09-10T06:27:46.269 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031588900000000001, 2024-09-10T06:27:46.269 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.269 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.269 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.269 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.269 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.269 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.269 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 384 2024-09-10T06:27:46.269 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.270 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:46.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:46.270 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.270 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.270 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.270 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.270 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463620+0000", 2024-09-10T06:27:46.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:46.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463625+0000", 2024-09-10T06:27:46.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6450000000000002e-06 2024-09-10T06:27:46.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.271 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463639+0000", 2024-09-10T06:27:46.271 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3540000000000001e-05 2024-09-10T06:27:46.271 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.271 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.271 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463648+0000", 2024-09-10T06:27:46.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0259999999999996e-06 2024-09-10T06:27:46.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463713+0000", 2024-09-10T06:27:46.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5438000000000006e-05 2024-09-10T06:27:46.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.272 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.272 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463774+0000", 2024-09-10T06:27:46.272 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0582999999999999e-05 2024-09-10T06:27:46.272 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.272 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:46.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463899+0000", 2024-09-10T06:27:46.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-10T06:27:46.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.464371+0000", 2024-09-10T06:27:46.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047201600000000002 2024-09-10T06:27:46.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.273 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.273 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.273 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466707+0000", 2024-09-10T06:27:46.273 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023354999999999999 2024-09-10T06:27:46.273 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466742+0000", 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4686e-05 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466777+0000", 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5537000000000002e-05 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.274 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:436 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.746101981999999, 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040690570000000001, 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 436 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:46.275 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:46.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.276 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478866+0000", 2024-09-10T06:27:46.276 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1960000000000001e-06 2024-09-10T06:27:46.276 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.276 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.276 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478871+0000", 2024-09-10T06:27:46.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6879999999999998e-06 2024-09-10T06:27:46.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478883+0000", 2024-09-10T06:27:46.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1790999999999999e-05 2024-09-10T06:27:46.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.277 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.277 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478890+0000", 2024-09-10T06:27:46.277 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8569999999999997e-06 2024-09-10T06:27:46.277 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.277 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478958+0000", 2024-09-10T06:27:46.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7774999999999994e-05 2024-09-10T06:27:46.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479072+0000", 2024-09-10T06:27:46.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114577 2024-09-10T06:27:46.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.278 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.278 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:46.278 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479255+0000", 2024-09-10T06:27:46.278 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018297300000000001 2024-09-10T06:27:46.278 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482448+0000", 2024-09-10T06:27:46.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031933389999999999 2024-09-10T06:27:46.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482828+0000", 2024-09-10T06:27:46.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037961800000000002 2024-09-10T06:27:46.279 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.279 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.279 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.279 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482891+0000", 2024-09-10T06:27:46.279 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3316000000000002e-05 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482934+0000", 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2926999999999997e-05 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:441 6.7 e34/28 6:e1cdb60d:reshard::reshard.0000000008:head v 34'7, mlcod=34'5)", 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.742501063999995, 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060368319999999998, 2024-09-10T06:27:46.280 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.281 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482467+0000", 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8800000000000003e-07 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482472+0000", 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8730000000000004e-06 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482481+0000", 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1980000000000001e-06 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.282 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482485+0000", 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.386e-06 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482541+0000", 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5788000000000002e-05 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482563+0000", 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2303999999999999e-05 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.283 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488465+0000", 2024-09-10T06:27:46.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059014810000000001 2024-09-10T06:27:46.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.284 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.284 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488503+0000", 2024-09-10T06:27:46.284 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8313999999999999e-05 2024-09-10T06:27:46.284 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.284 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.284 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.284 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.284 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.284 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:466 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.285 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:46.285 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.727341813999999, 2024-09-10T06:27:46.285 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039032810000000002, 2024-09-10T06:27:46.285 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.285 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.285 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.285 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.285 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.285 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.285 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 466 2024-09-10T06:27:46.285 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.285 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.285 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.285 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:46.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:46.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.286 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.286 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497626+0000", 2024-09-10T06:27:46.286 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9099999999999991e-07 2024-09-10T06:27:46.286 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.286 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497634+0000", 2024-09-10T06:27:46.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.994e-06 2024-09-10T06:27:46.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497644+0000", 2024-09-10T06:27:46.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6260000000000007e-06 2024-09-10T06:27:46.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.287 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.287 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.287 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497650+0000", 2024-09-10T06:27:46.287 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5160000000000002e-06 2024-09-10T06:27:46.287 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497718+0000", 2024-09-10T06:27:46.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8862999999999994e-05 2024-09-10T06:27:46.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.288 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.288 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497775+0000", 2024-09-10T06:27:46.288 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6156000000000002e-05 2024-09-10T06:27:46.288 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.288 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:46.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497903+0000", 2024-09-10T06:27:46.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012879800000000001 2024-09-10T06:27:46.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499630+0000", 2024-09-10T06:27:46.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017268139999999999 2024-09-10T06:27:46.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.289 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.289 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.289 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501439+0000", 2024-09-10T06:27:46.289 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018086669999999999 2024-09-10T06:27:46.289 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501478+0000", 2024-09-10T06:27:46.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9269e-05 2024-09-10T06:27:46.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.290 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.290 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501529+0000", 2024-09-10T06:27:46.290 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0587000000000002e-05 2024-09-10T06:27:46.290 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.290 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.290 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.290 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.290 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.291 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:469 6.0 e34/28 6:02683654:reshard::reshard.0000000010:head v 34'6, mlcod=34'4)", 2024-09-10T06:27:46.291 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:46.291 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.725338991000001, 2024-09-10T06:27:46.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048323109999999997, 2024-09-10T06:27:46.291 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.291 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.291 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.291 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.291 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.291 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:46.291 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.291 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.291 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:46.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499629+0000", 2024-09-10T06:27:46.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9199999999999999e-07 2024-09-10T06:27:46.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.292 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.292 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.292 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499634+0000", 2024-09-10T06:27:46.292 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2530000000000004e-06 2024-09-10T06:27:46.292 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499644+0000", 2024-09-10T06:27:46.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5820000000000008e-06 2024-09-10T06:27:46.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499650+0000", 2024-09-10T06:27:46.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7919999999999998e-06 2024-09-10T06:27:46.293 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.293 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.293 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.293 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499697+0000", 2024-09-10T06:27:46.293 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7564000000000001e-05 2024-09-10T06:27:46.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499719+0000", 2024-09-10T06:27:46.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1297999999999998e-05 2024-09-10T06:27:46.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.294 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.294 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.294 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504413+0000", 2024-09-10T06:27:46.294 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004694419 2024-09-10T06:27:46.294 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504461+0000", 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7511e-05 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:621 6.0 e34/28 6:0705c68b:::obj_delete_at_hint.0000000028:head v 34'11, mlcod=34'9)", 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.620137846000006, 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003196562, 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.295 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.296 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.296 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:46.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.296 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:46.296 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.296 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.296 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.296 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604831+0000", 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.823e-06 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604843+0000", 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1437000000000001e-05 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604868+0000", 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5837e-05 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.297 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604885+0000", 2024-09-10T06:27:46.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6759999999999999e-05 2024-09-10T06:27:46.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604971+0000", 2024-09-10T06:27:46.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5512000000000004e-05 2024-09-10T06:27:46.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.298 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.298 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604991+0000", 2024-09-10T06:27:46.298 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0197999999999999e-05 2024-09-10T06:27:46.298 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.298 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.607960+0000", 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002969307 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608026+0000", 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5687999999999999e-05 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:636 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.299 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.611228191999999, 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048306950000000003, 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 636 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:46.300 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613740+0000", 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613747+0000", 2024-09-10T06:27:46.301 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8090000000000004e-06 2024-09-10T06:27:46.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613762+0000", 2024-09-10T06:27:46.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5037e-05 2024-09-10T06:27:46.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613772+0000", 2024-09-10T06:27:46.302 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7510000000000003e-06 2024-09-10T06:27:46.302 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.302 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.302 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.302 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613834+0000", 2024-09-10T06:27:46.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2458000000000004e-05 2024-09-10T06:27:46.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613916+0000", 2024-09-10T06:27:46.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1630000000000003e-05 2024-09-10T06:27:46.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.303 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:46.303 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.614071+0000", 2024-09-10T06:27:46.303 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015480800000000001 2024-09-10T06:27:46.303 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.303 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.615885+0000", 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001814607 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618438+0000", 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025529459999999999 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618503+0000", 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4851000000000006e-05 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.304 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618570+0000", 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6418e-05 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:646 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.601766401999996, 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049103549999999999, 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.305 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.306 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.306 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.306 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.306 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 646 2024-09-10T06:27:46.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.306 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:46.306 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.306 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.306 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.306 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.306 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623202+0000", 2024-09-10T06:27:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9800000000000002e-07 2024-09-10T06:27:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623206+0000", 2024-09-10T06:27:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6380000000000003e-06 2024-09-10T06:27:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.307 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623216+0000", 2024-09-10T06:27:46.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4439999999999997e-06 2024-09-10T06:27:46.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623221+0000", 2024-09-10T06:27:46.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6400000000000002e-06 2024-09-10T06:27:46.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.308 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.308 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623300+0000", 2024-09-10T06:27:46.308 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8677999999999994e-05 2024-09-10T06:27:46.308 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.308 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623410+0000", 2024-09-10T06:27:46.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010954399999999999 2024-09-10T06:27:46.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:46.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623629+0000", 2024-09-10T06:27:46.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000219836 2024-09-10T06:27:46.309 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.309 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.309 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.309 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.625072+0000", 2024-09-10T06:27:46.309 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014427929999999999 2024-09-10T06:27:46.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.627982+0000", 2024-09-10T06:27:46.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029097620000000002 2024-09-10T06:27:46.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628058+0000", 2024-09-10T06:27:46.310 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6390999999999994e-05 2024-09-10T06:27:46.310 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.310 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.310 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.310 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628111+0000", 2024-09-10T06:27:46.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2731e-05 2024-09-10T06:27:46.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.311 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.311 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.311 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.311 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.311 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.311 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:46.311 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.53909213, 2024-09-10T06:27:46.311 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033783509999999999, 2024-09-10T06:27:46.311 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.311 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.311 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.312 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.312 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 703 2024-09-10T06:27:46.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.312 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:46.312 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.312 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.312 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.312 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.312 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:46.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685878+0000", 2024-09-10T06:27:46.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5900000000000002e-06 2024-09-10T06:27:46.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.313 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.313 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.313 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685889+0000", 2024-09-10T06:27:46.313 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:46.313 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685919+0000", 2024-09-10T06:27:46.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0307e-05 2024-09-10T06:27:46.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685935+0000", 2024-09-10T06:27:46.314 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5336e-05 2024-09-10T06:27:46.314 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.314 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.314 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.314 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686092+0000", 2024-09-10T06:27:46.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015776200000000001 2024-09-10T06:27:46.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686462+0000", 2024-09-10T06:27:46.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036925700000000001 2024-09-10T06:27:46.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:46.315 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.687048+0000", 2024-09-10T06:27:46.315 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000586266 2024-09-10T06:27:46.315 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.315 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.315 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688261+0000", 2024-09-10T06:27:46.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012132670000000001 2024-09-10T06:27:46.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688974+0000", 2024-09-10T06:27:46.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071248800000000005 2024-09-10T06:27:46.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.316 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.316 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689129+0000", 2024-09-10T06:27:46.316 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155499 2024-09-10T06:27:46.316 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.316 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.317 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.317 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689253+0000", 2024-09-10T06:27:46.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124289 2024-09-10T06:27:46.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.317 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.317 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.317 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.317 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.317 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.317 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:46.317 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.180526627000006, 2024-09-10T06:27:46.317 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032750980000000002, 2024-09-10T06:27:46.317 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.318 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.318 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.318 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.318 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 865 2024-09-10T06:27:46.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.318 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.318 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.318 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:46.318 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.318 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.318 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:46.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044443+0000", 2024-09-10T06:27:46.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6929999999999999e-06 2024-09-10T06:27:46.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.319 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.319 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.319 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044456+0000", 2024-09-10T06:27:46.319 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.224e-05 2024-09-10T06:27:46.319 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044486+0000", 2024-09-10T06:27:46.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.095e-05 2024-09-10T06:27:46.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044501+0000", 2024-09-10T06:27:46.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4932999999999999e-05 2024-09-10T06:27:46.320 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.320 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.320 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.320 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044646+0000", 2024-09-10T06:27:46.320 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014465600000000001 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045001+0000", 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035473999999999998 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045549+0000", 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054870299999999999 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.046956+0000", 2024-09-10T06:27:46.321 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014061189999999999 2024-09-10T06:27:46.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047452+0000", 2024-09-10T06:27:46.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049682199999999995 2024-09-10T06:27:46.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.322 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047606+0000", 2024-09-10T06:27:46.322 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015379599999999999 2024-09-10T06:27:46.322 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.322 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.322 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.323 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047716+0000", 2024-09-10T06:27:46.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109446 2024-09-10T06:27:46.323 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.323 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.323 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.323 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.323 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.323 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.323 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:46.323 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.176063475000007, 2024-09-10T06:27:46.323 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030837989999999999, 2024-09-10T06:27:46.323 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.323 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.324 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.324 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.324 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.324 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.324 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 867 2024-09-10T06:27:46.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.324 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.324 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.324 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:46.324 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.324 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.324 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:46.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048906+0000", 2024-09-10T06:27:46.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1770000000000001e-06 2024-09-10T06:27:46.325 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.325 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.325 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.325 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048916+0000", 2024-09-10T06:27:46.325 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.025e-05 2024-09-10T06:27:46.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048948+0000", 2024-09-10T06:27:46.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1859000000000001e-05 2024-09-10T06:27:46.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048968+0000", 2024-09-10T06:27:46.326 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9647e-05 2024-09-10T06:27:46.326 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.326 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.326 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.326 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049090+0000", 2024-09-10T06:27:46.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122645 2024-09-10T06:27:46.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049314+0000", 2024-09-10T06:27:46.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022372900000000001 2024-09-10T06:27:46.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.327 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:46.327 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049785+0000", 2024-09-10T06:27:46.327 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047121899999999999 2024-09-10T06:27:46.327 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.327 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.050979+0000", 2024-09-10T06:27:46.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001193408 2024-09-10T06:27:46.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051729+0000", 2024-09-10T06:27:46.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075039699999999998 2024-09-10T06:27:46.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.328 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.328 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.328 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051874+0000", 2024-09-10T06:27:46.328 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000145253 2024-09-10T06:27:46.328 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.329 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.329 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051988+0000", 2024-09-10T06:27:46.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011321500000000001 2024-09-10T06:27:46.329 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.329 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.329 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.329 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.329 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.329 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.329 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:46.329 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.107196294000005, 2024-09-10T06:27:46.329 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035511029999999999, 2024-09-10T06:27:46.330 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.330 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.330 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.330 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.330 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.330 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.330 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 898 2024-09-10T06:27:46.330 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.330 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.330 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.330 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.330 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:46.330 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:46.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117772+0000", 2024-09-10T06:27:46.331 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5340000000000001e-06 2024-09-10T06:27:46.331 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.331 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.331 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.331 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117781+0000", 2024-09-10T06:27:46.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.276e-06 2024-09-10T06:27:46.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117804+0000", 2024-09-10T06:27:46.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3093999999999999e-05 2024-09-10T06:27:46.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.332 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.332 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117816+0000", 2024-09-10T06:27:46.332 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1986e-05 2024-09-10T06:27:46.332 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.332 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117954+0000", 2024-09-10T06:27:46.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013856900000000001 2024-09-10T06:27:46.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118327+0000", 2024-09-10T06:27:46.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000372841 2024-09-10T06:27:46.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.333 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.333 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:46.333 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118919+0000", 2024-09-10T06:27:46.333 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059172800000000002 2024-09-10T06:27:46.333 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.120253+0000", 2024-09-10T06:27:46.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001333643 2024-09-10T06:27:46.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121060+0000", 2024-09-10T06:27:46.334 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080731100000000001 2024-09-10T06:27:46.334 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.334 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.334 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.334 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121210+0000", 2024-09-10T06:27:46.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014980500000000001 2024-09-10T06:27:46.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.335 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.335 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121322+0000", 2024-09-10T06:27:46.335 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112316 2024-09-10T06:27:46.335 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.335 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.335 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.335 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.335 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.335 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.335 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:46.336 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 64.017926481999993, 2024-09-10T06:27:46.336 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051838630000000004, 2024-09-10T06:27:46.336 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:46.336 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:46.336 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.336 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:46.336 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:46.336 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.336 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 937 2024-09-10T06:27:46.336 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.336 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:46.336 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.336 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:46.336 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:46.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:46.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:46.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:46.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:46.337 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207042+0000", 2024-09-10T06:27:46.337 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7439999999999999e-06 2024-09-10T06:27:46.337 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.337 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.337 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:46.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207051+0000", 2024-09-10T06:27:46.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7299999999999994e-06 2024-09-10T06:27:46.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:46.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207072+0000", 2024-09-10T06:27:46.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1209e-05 2024-09-10T06:27:46.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.338 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.338 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.338 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207089+0000", 2024-09-10T06:27:46.338 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6297e-05 2024-09-10T06:27:46.338 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:46.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207231+0000", 2024-09-10T06:27:46.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014233200000000001 2024-09-10T06:27:46.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:46.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207463+0000", 2024-09-10T06:27:46.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023155199999999999 2024-09-10T06:27:46.339 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.339 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:46.339 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207797+0000", 2024-09-10T06:27:46.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033413699999999998 2024-09-10T06:27:46.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:46.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.209053+0000", 2024-09-10T06:27:46.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012560029999999999 2024-09-10T06:27:46.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.340 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212076+0000", 2024-09-10T06:27:46.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030234239999999998 2024-09-10T06:27:46.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.340 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.340 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:46.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212162+0000", 2024-09-10T06:27:46.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5506000000000004e-05 2024-09-10T06:27:46.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:46.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:46.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:46.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212225+0000", 2024-09-10T06:27:46.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2928999999999993e-05 2024-09-10T06:27:46.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.341 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.341 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:46.341 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:46.341 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:46.343 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:27:46.343 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:46.341+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:46.444 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:46.440+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:46.475 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:46.475 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:46.475 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:46.475 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:46.490 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:27:46.545 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:46.544+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:46.550 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T06:27:46.611 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:46.611 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:46.611 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:46.611 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:46.611 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:46.626 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:27:46.676 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:46.677+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:46.748 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:46.749+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:46.753 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:46.753 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:46.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:46.753 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:46.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.753 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-10T06:27:46.753 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 68.460570288, 2024-09-10T06:27:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047108059999999997, 2024-09-10T06:27:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291391+0000", 2024-09-10T06:27:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8700000000000001e-06 2024-09-10T06:27:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291405+0000", 2024-09-10T06:27:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4623e-05 2024-09-10T06:27:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291438+0000", 2024-09-10T06:27:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2616000000000001e-05 2024-09-10T06:27:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291461+0000", 2024-09-10T06:27:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2883000000000001e-05 2024-09-10T06:27:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293024+0000", 2024-09-10T06:27:46.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015627709999999999 2024-09-10T06:27:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293071+0000", 2024-09-10T06:27:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7797000000000003e-05 2024-09-10T06:27:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295983+0000", 2024-09-10T06:27:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029113640000000001 2024-09-10T06:27:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296100+0000", 2024-09-10T06:27:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116882 2024-09-10T06:27:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.419212509999994, 2024-09-10T06:27:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00338296, 2024-09-10T06:27:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.758 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.759 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 211 2024-09-10T06:27:46.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.759 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332750+0000", 2024-09-10T06:27:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-10T06:27:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332767+0000", 2024-09-10T06:27:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.702e-05 2024-09-10T06:27:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332805+0000", 2024-09-10T06:27:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7950000000000001e-05 2024-09-10T06:27:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332824+0000", 2024-09-10T06:27:46.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8462999999999999e-05 2024-09-10T06:27:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332950+0000", 2024-09-10T06:27:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012653600000000001 2024-09-10T06:27:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333177+0000", 2024-09-10T06:27:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022626800000000001 2024-09-10T06:27:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:46.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333604+0000", 2024-09-10T06:27:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042759999999999999 2024-09-10T06:27:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335279+0000", 2024-09-10T06:27:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001674481 2024-09-10T06:27:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335976+0000", 2024-09-10T06:27:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069707099999999995 2024-09-10T06:27:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336063+0000", 2024-09-10T06:27:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6916000000000006e-05 2024-09-10T06:27:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336130+0000", 2024-09-10T06:27:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6971999999999995e-05 2024-09-10T06:27:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.764 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.345937634999999, 2024-09-10T06:27:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034123389999999999, 2024-09-10T06:27:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232 2024-09-10T06:27:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406025+0000", 2024-09-10T06:27:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-10T06:27:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406040+0000", 2024-09-10T06:27:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5299999999999999e-05 2024-09-10T06:27:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406072+0000", 2024-09-10T06:27:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2543000000000003e-05 2024-09-10T06:27:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406088+0000", 2024-09-10T06:27:46.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5699999999999999e-05 2024-09-10T06:27:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406206+0000", 2024-09-10T06:27:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011828900000000001 2024-09-10T06:27:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406416+0000", 2024-09-10T06:27:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020969900000000001 2024-09-10T06:27:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406804+0000", 2024-09-10T06:27:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038783699999999998 2024-09-10T06:27:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.408490+0000", 2024-09-10T06:27:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001686353 2024-09-10T06:27:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409152+0000", 2024-09-10T06:27:46.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066160800000000005 2024-09-10T06:27:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409314+0000", 2024-09-10T06:27:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000162285 2024-09-10T06:27:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409434+0000", 2024-09-10T06:27:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119639 2024-09-10T06:27:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.326008189999996, 2024-09-10T06:27:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034077650000000001, 2024-09-10T06:27:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241 2024-09-10T06:27:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.771 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425954+0000", 2024-09-10T06:27:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425965+0000", 2024-09-10T06:27:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.181e-05 2024-09-10T06:27:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425996+0000", 2024-09-10T06:27:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0759000000000001e-05 2024-09-10T06:27:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426011+0000", 2024-09-10T06:27:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4507e-05 2024-09-10T06:27:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426153+0000", 2024-09-10T06:27:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014206599999999999 2024-09-10T06:27:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426491+0000", 2024-09-10T06:27:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033830399999999999 2024-09-10T06:27:46.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426973+0000", 2024-09-10T06:27:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000482113 2024-09-10T06:27:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.428378+0000", 2024-09-10T06:27:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001404539 2024-09-10T06:27:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429113+0000", 2024-09-10T06:27:46.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073537799999999996 2024-09-10T06:27:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429251+0000", 2024-09-10T06:27:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013789600000000001 2024-09-10T06:27:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429359+0000", 2024-09-10T06:27:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107846 2024-09-10T06:27:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:266 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.321275166000007, 2024-09-10T06:27:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030966560000000001, 2024-09-10T06:27:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 266 2024-09-10T06:27:46.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430687+0000", 2024-09-10T06:27:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0299999999999998e-06 2024-09-10T06:27:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430702+0000", 2024-09-10T06:27:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5316999999999999e-05 2024-09-10T06:27:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430741+0000", 2024-09-10T06:27:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8336e-05 2024-09-10T06:27:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430762+0000", 2024-09-10T06:27:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.162e-05 2024-09-10T06:27:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430923+0000", 2024-09-10T06:27:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016044599999999999 2024-09-10T06:27:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431103+0000", 2024-09-10T06:27:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018030100000000001 2024-09-10T06:27:46.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431513+0000", 2024-09-10T06:27:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040992999999999997 2024-09-10T06:27:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432715+0000", 2024-09-10T06:27:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001202411 2024-09-10T06:27:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433624+0000", 2024-09-10T06:27:46.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090863000000000001 2024-09-10T06:27:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433718+0000", 2024-09-10T06:27:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3749e-05 2024-09-10T06:27:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433781+0000", 2024-09-10T06:27:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2885999999999994e-05 2024-09-10T06:27:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.782 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:273 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.319701565000003, 2024-09-10T06:27:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028009850000000002, 2024-09-10T06:27:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.783 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 273 2024-09-10T06:27:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432260+0000", 2024-09-10T06:27:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1900000000000002e-06 2024-09-10T06:27:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432271+0000", 2024-09-10T06:27:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1353e-05 2024-09-10T06:27:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432296+0000", 2024-09-10T06:27:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4817e-05 2024-09-10T06:27:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432318+0000", 2024-09-10T06:27:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1963e-05 2024-09-10T06:27:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432465+0000", 2024-09-10T06:27:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014658299999999999 2024-09-10T06:27:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432801+0000", 2024-09-10T06:27:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033681299999999999 2024-09-10T06:27:46.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433188+0000", 2024-09-10T06:27:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000386857 2024-09-10T06:27:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434552+0000", 2024-09-10T06:27:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013634400000000001 2024-09-10T06:27:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434872+0000", 2024-09-10T06:27:46.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031998399999999999 2024-09-10T06:27:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434973+0000", 2024-09-10T06:27:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100962 2024-09-10T06:27:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.435059+0000", 2024-09-10T06:27:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6023e-05 2024-09-10T06:27:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:299 6.14 e34/28 6:2c0c0c23:reshard::reshard.0000000001:head v 34'2, mlcod=0'0)", 2024-09-10T06:27:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.315085714000006, 2024-09-10T06:27:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029099109999999998, 2024-09-10T06:27:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:46.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:46.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436875+0000", 2024-09-10T06:27:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0430000000000002e-06 2024-09-10T06:27:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436890+0000", 2024-09-10T06:27:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4766999999999999e-05 2024-09-10T06:27:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436918+0000", 2024-09-10T06:27:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.76e-05 2024-09-10T06:27:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436937+0000", 2024-09-10T06:27:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9539999999999999e-05 2024-09-10T06:27:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437081+0000", 2024-09-10T06:27:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144065 2024-09-10T06:27:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437130+0000", 2024-09-10T06:27:46.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8609999999999997e-05 2024-09-10T06:27:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439676+0000", 2024-09-10T06:27:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002546137 2024-09-10T06:27:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439783+0000", 2024-09-10T06:27:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107149 2024-09-10T06:27:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:341 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.306166019000003, 2024-09-10T06:27:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030260230000000001, 2024-09-10T06:27:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 341 2024-09-10T06:27:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.794 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:46.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445796+0000", 2024-09-10T06:27:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7130000000000001e-06 2024-09-10T06:27:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445810+0000", 2024-09-10T06:27:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4564e-05 2024-09-10T06:27:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445886+0000", 2024-09-10T06:27:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5921999999999996e-05 2024-09-10T06:27:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445902+0000", 2024-09-10T06:27:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5800000000000001e-05 2024-09-10T06:27:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446057+0000", 2024-09-10T06:27:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015475600000000001 2024-09-10T06:27:46.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446347+0000", 2024-09-10T06:27:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029057699999999998 2024-09-10T06:27:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446669+0000", 2024-09-10T06:27:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032102399999999999 2024-09-10T06:27:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.447891+0000", 2024-09-10T06:27:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012226680000000001 2024-09-10T06:27:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448550+0000", 2024-09-10T06:27:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065925800000000002 2024-09-10T06:27:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448699+0000", 2024-09-10T06:27:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014831800000000001 2024-09-10T06:27:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448819+0000", 2024-09-10T06:27:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120423 2024-09-10T06:27:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:505 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.224487488999998, 2024-09-10T06:27:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028092249999999998, 2024-09-10T06:27:46.800 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 505 2024-09-10T06:27:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527474+0000", 2024-09-10T06:27:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-10T06:27:46.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527495+0000", 2024-09-10T06:27:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0910000000000001e-05 2024-09-10T06:27:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527549+0000", 2024-09-10T06:27:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3223000000000002e-05 2024-09-10T06:27:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527583+0000", 2024-09-10T06:27:46.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4773000000000001e-05 2024-09-10T06:27:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527737+0000", 2024-09-10T06:27:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325199999999999 2024-09-10T06:27:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528092+0000", 2024-09-10T06:27:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000354951 2024-09-10T06:27:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528657+0000", 2024-09-10T06:27:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00056537500000000001 2024-09-10T06:27:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.529771+0000", 2024-09-10T06:27:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011136519999999999 2024-09-10T06:27:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530072+0000", 2024-09-10T06:27:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030151700000000001 2024-09-10T06:27:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530213+0000", 2024-09-10T06:27:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014100500000000001 2024-09-10T06:27:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530281+0000", 2024-09-10T06:27:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7793999999999995e-05 2024-09-10T06:27:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.220818211999998, 2024-09-10T06:27:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051813969999999999, 2024-09-10T06:27:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 513 2024-09-10T06:27:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531143+0000", 2024-09-10T06:27:46.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7400000000000001e-06 2024-09-10T06:27:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531153+0000", 2024-09-10T06:27:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.815e-06 2024-09-10T06:27:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531178+0000", 2024-09-10T06:27:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5755e-05 2024-09-10T06:27:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531190+0000", 2024-09-10T06:27:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1250000000000001e-05 2024-09-10T06:27:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531322+0000", 2024-09-10T06:27:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013239299999999999 2024-09-10T06:27:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531550+0000", 2024-09-10T06:27:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000227598 2024-09-10T06:27:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531966+0000", 2024-09-10T06:27:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041634400000000002 2024-09-10T06:27:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533197+0000", 2024-09-10T06:27:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012308810000000001 2024-09-10T06:27:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536097+0000", 2024-09-10T06:27:46.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029007159999999998 2024-09-10T06:27:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536245+0000", 2024-09-10T06:27:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000147816 2024-09-10T06:27:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536322+0000", 2024-09-10T06:27:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7088999999999993e-05 2024-09-10T06:27:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:514 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.220746015000003, 2024-09-10T06:27:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048258260000000001, 2024-09-10T06:27:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 514 2024-09-10T06:27:46.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531214+0000", 2024-09-10T06:27:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2699999999999998e-07 2024-09-10T06:27:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531219+0000", 2024-09-10T06:27:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-10T06:27:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531233+0000", 2024-09-10T06:27:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.38e-05 2024-09-10T06:27:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531240+0000", 2024-09-10T06:27:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7399999999999998e-06 2024-09-10T06:27:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531378+0000", 2024-09-10T06:27:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013860399999999999 2024-09-10T06:27:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531600+0000", 2024-09-10T06:27:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221287 2024-09-10T06:27:46.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532007+0000", 2024-09-10T06:27:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040728500000000001 2024-09-10T06:27:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533131+0000", 2024-09-10T06:27:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011240429999999999 2024-09-10T06:27:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535894+0000", 2024-09-10T06:27:46.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027628650000000002 2024-09-10T06:27:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535973+0000", 2024-09-10T06:27:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9399000000000003e-05 2024-09-10T06:27:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536039+0000", 2024-09-10T06:27:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5619999999999999e-05 2024-09-10T06:27:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:655 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.120803476999995, 2024-09-10T06:27:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003017207, 2024-09-10T06:27:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 655 2024-09-10T06:27:46.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631159+0000", 2024-09-10T06:27:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8270000000000002e-06 2024-09-10T06:27:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631173+0000", 2024-09-10T06:27:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4739999999999999e-05 2024-09-10T06:27:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631206+0000", 2024-09-10T06:27:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2425999999999998e-05 2024-09-10T06:27:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631221+0000", 2024-09-10T06:27:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4927e-05 2024-09-10T06:27:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631336+0000", 2024-09-10T06:27:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115062 2024-09-10T06:27:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631547+0000", 2024-09-10T06:27:46.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021178200000000001 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.632034+0000", 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000486899 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633413+0000", 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001379077 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633891+0000", 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000477489 2024-09-10T06:27:46.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634057+0000", 2024-09-10T06:27:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016608500000000001 2024-09-10T06:27:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634173+0000", 2024-09-10T06:27:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115893 2024-09-10T06:27:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:658 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.116789233000006, 2024-09-10T06:27:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030550820000000002, 2024-09-10T06:27:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 658 2024-09-10T06:27:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635171+0000", 2024-09-10T06:27:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.322e-06 2024-09-10T06:27:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635178+0000", 2024-09-10T06:27:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7950000000000002e-06 2024-09-10T06:27:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635197+0000", 2024-09-10T06:27:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8845e-05 2024-09-10T06:27:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635215+0000", 2024-09-10T06:27:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7822e-05 2024-09-10T06:27:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635329+0000", 2024-09-10T06:27:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011433 2024-09-10T06:27:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635554+0000", 2024-09-10T06:27:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022527800000000001 2024-09-10T06:27:46.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.636007+0000", 2024-09-10T06:27:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045297099999999998 2024-09-10T06:27:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637198+0000", 2024-09-10T06:27:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011902740000000001 2024-09-10T06:27:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637961+0000", 2024-09-10T06:27:46.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000763234 2024-09-10T06:27:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638110+0000", 2024-09-10T06:27:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149259 2024-09-10T06:27:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638225+0000", 2024-09-10T06:27:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011495200000000001 2024-09-10T06:27:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.020457291, 2024-09-10T06:27:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028070980000000001, 2024-09-10T06:27:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 724 2024-09-10T06:27:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.831 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731504+0000", 2024-09-10T06:27:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731516+0000", 2024-09-10T06:27:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1885999999999999e-05 2024-09-10T06:27:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731547+0000", 2024-09-10T06:27:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0923000000000002e-05 2024-09-10T06:27:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731563+0000", 2024-09-10T06:27:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5342999999999999e-05 2024-09-10T06:27:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731704+0000", 2024-09-10T06:27:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014128599999999999 2024-09-10T06:27:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731917+0000", 2024-09-10T06:27:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021280800000000001 2024-09-10T06:27:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.732227+0000", 2024-09-10T06:27:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031024500000000001 2024-09-10T06:27:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.733258+0000", 2024-09-10T06:27:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010306880000000001 2024-09-10T06:27:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734163+0000", 2024-09-10T06:27:46.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090502400000000004 2024-09-10T06:27:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734247+0000", 2024-09-10T06:27:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4363000000000005e-05 2024-09-10T06:27:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734309+0000", 2024-09-10T06:27:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2005e-05 2024-09-10T06:27:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.013611157, 2024-09-10T06:27:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030399789999999999, 2024-09-10T06:27:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 727 2024-09-10T06:27:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.837 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738350+0000", 2024-09-10T06:27:46.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2199999999999999e-06 2024-09-10T06:27:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738360+0000", 2024-09-10T06:27:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0122999999999999e-05 2024-09-10T06:27:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738384+0000", 2024-09-10T06:27:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3390000000000001e-05 2024-09-10T06:27:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738397+0000", 2024-09-10T06:27:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2896e-05 2024-09-10T06:27:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738524+0000", 2024-09-10T06:27:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126883 2024-09-10T06:27:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738752+0000", 2024-09-10T06:27:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022864200000000001 2024-09-10T06:27:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.739080+0000", 2024-09-10T06:27:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032783699999999999 2024-09-10T06:27:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.740085+0000", 2024-09-10T06:27:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001005438 2024-09-10T06:27:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741203+0000", 2024-09-10T06:27:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011175919999999999 2024-09-10T06:27:46.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741280+0000", 2024-09-10T06:27:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6545999999999995e-05 2024-09-10T06:27:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741388+0000", 2024-09-10T06:27:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108412 2024-09-10T06:27:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.821588652000003, 2024-09-10T06:27:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028715709999999998, 2024-09-10T06:27:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 814 2024-09-10T06:27:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930373+0000", 2024-09-10T06:27:46.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-10T06:27:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930384+0000", 2024-09-10T06:27:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1357e-05 2024-09-10T06:27:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930417+0000", 2024-09-10T06:27:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2289000000000002e-05 2024-09-10T06:27:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930438+0000", 2024-09-10T06:27:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1399999999999998e-05 2024-09-10T06:27:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930626+0000", 2024-09-10T06:27:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018812899999999999 2024-09-10T06:27:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930843+0000", 2024-09-10T06:27:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021719400000000001 2024-09-10T06:27:46.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.931152+0000", 2024-09-10T06:27:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030821199999999998 2024-09-10T06:27:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.932258+0000", 2024-09-10T06:27:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001106304 2024-09-10T06:27:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933092+0000", 2024-09-10T06:27:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00083364699999999997 2024-09-10T06:27:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933179+0000", 2024-09-10T06:27:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7383e-05 2024-09-10T06:27:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933242+0000", 2024-09-10T06:27:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3072999999999997e-05 2024-09-10T06:27:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.848 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.674037170999995, 2024-09-10T06:27:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029601670000000001, 2024-09-10T06:27:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.849 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 880 2024-09-10T06:27:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077925+0000", 2024-09-10T06:27:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-10T06:27:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077938+0000", 2024-09-10T06:27:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2836999999999999e-05 2024-09-10T06:27:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077970+0000", 2024-09-10T06:27:46.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1542999999999999e-05 2024-09-10T06:27:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077984+0000", 2024-09-10T06:27:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4963999999999999e-05 2024-09-10T06:27:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078118+0000", 2024-09-10T06:27:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134015 2024-09-10T06:27:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078344+0000", 2024-09-10T06:27:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225038 2024-09-10T06:27:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078696+0000", 2024-09-10T06:27:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035250100000000002 2024-09-10T06:27:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.079793+0000", 2024-09-10T06:27:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010967049999999999 2024-09-10T06:27:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080714+0000", 2024-09-10T06:27:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00092153600000000003 2024-09-10T06:27:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080802+0000", 2024-09-10T06:27:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7446000000000003e-05 2024-09-10T06:27:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080882+0000", 2024-09-10T06:27:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0445999999999995e-05 2024-09-10T06:27:46.854 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.599416943999998, 2024-09-10T06:27:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002919091, 2024-09-10T06:27:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 913 2024-09-10T06:27:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:46.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152545+0000", 2024-09-10T06:27:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6529999999999998e-06 2024-09-10T06:27:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152557+0000", 2024-09-10T06:27:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919999999999999e-05 2024-09-10T06:27:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152587+0000", 2024-09-10T06:27:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0097e-05 2024-09-10T06:27:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152601+0000", 2024-09-10T06:27:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4579999999999999e-05 2024-09-10T06:27:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152732+0000", 2024-09-10T06:27:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013085500000000001 2024-09-10T06:27:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153007+0000", 2024-09-10T06:27:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027469499999999998 2024-09-10T06:27:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153344+0000", 2024-09-10T06:27:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033742400000000001 2024-09-10T06:27:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.154351+0000", 2024-09-10T06:27:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010067590000000001 2024-09-10T06:27:46.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155301+0000", 2024-09-10T06:27:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095000900000000003 2024-09-10T06:27:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155387+0000", 2024-09-10T06:27:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6136000000000003e-05 2024-09-10T06:27:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155461+0000", 2024-09-10T06:27:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3962999999999996e-05 2024-09-10T06:27:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.567770261999996, 2024-09-10T06:27:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029321239999999999, 2024-09-10T06:27:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.861 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 927 2024-09-10T06:27:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184191+0000", 2024-09-10T06:27:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.764e-06 2024-09-10T06:27:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184199+0000", 2024-09-10T06:27:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4630000000000001e-06 2024-09-10T06:27:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184221+0000", 2024-09-10T06:27:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1603e-05 2024-09-10T06:27:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184233+0000", 2024-09-10T06:27:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.189e-05 2024-09-10T06:27:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184382+0000", 2024-09-10T06:27:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014939900000000001 2024-09-10T06:27:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184495+0000", 2024-09-10T06:27:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113459 2024-09-10T06:27:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184735+0000", 2024-09-10T06:27:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000239554 2024-09-10T06:27:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186036+0000", 2024-09-10T06:27:46.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00130072 2024-09-10T06:27:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186929+0000", 2024-09-10T06:27:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000893694 2024-09-10T06:27:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187014+0000", 2024-09-10T06:27:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4222999999999996e-05 2024-09-10T06:27:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187121+0000", 2024-09-10T06:27:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107355 2024-09-10T06:27:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.564509396999995, 2024-09-10T06:27:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028243320000000001, 2024-09-10T06:27:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:46.867 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 928 2024-09-10T06:27:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187452+0000", 2024-09-10T06:27:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5069999999999999e-06 2024-09-10T06:27:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187464+0000", 2024-09-10T06:27:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1243000000000001e-05 2024-09-10T06:27:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187495+0000", 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1136000000000001e-05 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187511+0000", 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6710000000000001e-05 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187648+0000", 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013657599999999999 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187866+0000", 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021853500000000001 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.188168+0000", 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030161100000000002 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.189334+0000", 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001166048 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190086+0000", 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075159399999999996 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190165+0000", 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8953000000000001e-05 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190274+0000", 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109419 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.872 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.873 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.873 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:46.873 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:46.873 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:46.873 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:27:46.875 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:27:46.875 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:46.873+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:46.976 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:46.972+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:47.016 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:47.016 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:47.043 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:47.043 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:47.045 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:47.046 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:47.057 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:27:47.075 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:47.075 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:47.104 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:47.105+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:47.105 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:47.105 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:47.136 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:47.136 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:47.168 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:47.169 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:47.174 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:47.174 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:47.177 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:47.176+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:47.188 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:27:47.201 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:47.201 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:47.233 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:47.234 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:47.302 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:47.300+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:47.354 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:47.354 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:47.369 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:27:47.416 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:47.417+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:47.480 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:47.476+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:47.485 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:47.486 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:47.500 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:27:47.546 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-10T06:27:47.613 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:47.612+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:47.668 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:47.668 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:47.682 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:27:47.683 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:47.680+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:47.784 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:47.785+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:47.801 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:47.801 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:47.815 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:27:47.884 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:47.880+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:47.983 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:47.983 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:47.985 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:47.980+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:47.997 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:27:48.086 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:48.085+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:48.115 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:48.115 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:48.129 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:27:48.224 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:48.225+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:48.289 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:48.284+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:48.306 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:48.306 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:48.321 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:27:48.389 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:48.388+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:48.441 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:48.442 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:48.454 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:27:48.491 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:48.489+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:48.592 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:48.593+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:48.615 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:48.616 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:48.629 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:27:48.693 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:48.688+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:48.760 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:48.760 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:48.774 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:27:48.818 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:48.816+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:48.895 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:48.892+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:48.929 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:48.929 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:48.942 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:27:49.037 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:49.036+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:49.097 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:49.097+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:49.111 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:49.111 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:49.127 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:27:49.197 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:49.197+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:49.256 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:27:49.281 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:49.281 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:49.295 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:27:49.298 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:49.297+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:49.402 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:49.400+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:49.410 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:49.410 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:49.441 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:49.442 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:49.472 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:49.472 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:49.482 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:49.483 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:49.483 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:49.483 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:49.489 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:49.489 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:49.497 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:27:49.503 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:49.501+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:49.510 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:49.510 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:49.531 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:49.531 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:49.554 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:49.554 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:49.573 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T06:27:49.575 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:49.575 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:49.608 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:49.609+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:49.626 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:49.626 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:49.626 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:49.626 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:49.626 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:49.642 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:27:49.709 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:49.709+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:49.801 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:49.801 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4236.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T06:27:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 86.291273626000006, 2024-09-10T06:27:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049682550000000004, 2024-09-10T06:27:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507427+0000", 2024-09-10T06:27:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5629999999999999e-06 2024-09-10T06:27:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507439+0000", 2024-09-10T06:27:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.19e-05 2024-09-10T06:27:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507460+0000", 2024-09-10T06:27:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1693000000000001e-05 2024-09-10T06:27:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507480+0000", 2024-09-10T06:27:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9947000000000001e-05 2024-09-10T06:27:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507613+0000", 2024-09-10T06:27:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000132409 2024-09-10T06:27:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507696+0000", 2024-09-10T06:27:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2953000000000004e-05 2024-09-10T06:27:49.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512288+0000", 2024-09-10T06:27:49.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045927110000000002 2024-09-10T06:27:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512393+0000", 2024-09-10T06:27:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105079 2024-09-10T06:27:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 75.467809594000002, 2024-09-10T06:27:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025692739999999999, 2024-09-10T06:27:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.809 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 42 2024-09-10T06:27:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330891+0000", 2024-09-10T06:27:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9700000000000002e-06 2024-09-10T06:27:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330901+0000", 2024-09-10T06:27:49.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2909999999999996e-06 2024-09-10T06:27:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330924+0000", 2024-09-10T06:27:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3132000000000001e-05 2024-09-10T06:27:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330935+0000", 2024-09-10T06:27:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0893999999999999e-05 2024-09-10T06:27:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331021+0000", 2024-09-10T06:27:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6205000000000006e-05 2024-09-10T06:27:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331160+0000", 2024-09-10T06:27:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013973600000000001 2024-09-10T06:27:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331336+0000", 2024-09-10T06:27:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017578799999999999 2024-09-10T06:27:49.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.332381+0000", 2024-09-10T06:27:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001044627 2024-09-10T06:27:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333371+0000", 2024-09-10T06:27:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098979800000000007 2024-09-10T06:27:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333421+0000", 2024-09-10T06:27:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9872e-05 2024-09-10T06:27:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333459+0000", 2024-09-10T06:27:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7960999999999998e-05 2024-09-10T06:27:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.816 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.482618673999994, 2024-09-10T06:27:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025247730000000001, 2024-09-10T06:27:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.817 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 52 2024-09-10T06:27:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316084+0000", 2024-09-10T06:27:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8260000000000003e-06 2024-09-10T06:27:49.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316095+0000", 2024-09-10T06:27:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1229999999999999e-05 2024-09-10T06:27:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316131+0000", 2024-09-10T06:27:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5499e-05 2024-09-10T06:27:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316150+0000", 2024-09-10T06:27:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9510000000000001e-05 2024-09-10T06:27:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316275+0000", 2024-09-10T06:27:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012501600000000001 2024-09-10T06:27:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316507+0000", 2024-09-10T06:27:49.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000231404 2024-09-10T06:27:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316712+0000", 2024-09-10T06:27:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204873 2024-09-10T06:27:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.317603+0000", 2024-09-10T06:27:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089174399999999998 2024-09-10T06:27:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318470+0000", 2024-09-10T06:27:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086713399999999998 2024-09-10T06:27:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318552+0000", 2024-09-10T06:27:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1279999999999994e-05 2024-09-10T06:27:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318605+0000", 2024-09-10T06:27:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3257000000000002e-05 2024-09-10T06:27:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.824 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.378840345, 2024-09-10T06:27:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033383480000000001, 2024-09-10T06:27:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.825 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 236 2024-09-10T06:27:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419861+0000", 2024-09-10T06:27:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.734e-06 2024-09-10T06:27:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419873+0000", 2024-09-10T06:27:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1789e-05 2024-09-10T06:27:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419904+0000", 2024-09-10T06:27:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1377000000000001e-05 2024-09-10T06:27:49.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419921+0000", 2024-09-10T06:27:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6878999999999999e-05 2024-09-10T06:27:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420052+0000", 2024-09-10T06:27:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013025600000000001 2024-09-10T06:27:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420263+0000", 2024-09-10T06:27:49.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021196600000000001 2024-09-10T06:27:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420649+0000", 2024-09-10T06:27:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038507 2024-09-10T06:27:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.422366+0000", 2024-09-10T06:27:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017172000000000001 2024-09-10T06:27:49.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423048+0000", 2024-09-10T06:27:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00068254100000000005 2024-09-10T06:27:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423127+0000", 2024-09-10T06:27:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8207000000000005e-05 2024-09-10T06:27:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423197+0000", 2024-09-10T06:27:49.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0328999999999997e-05 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.362239071000005, 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003575235, 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.831 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 299 2024-09-10T06:27:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436461+0000", 2024-09-10T06:27:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.144e-06 2024-09-10T06:27:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436466+0000", 2024-09-10T06:27:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8409999999999999e-06 2024-09-10T06:27:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436477+0000", 2024-09-10T06:27:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1253000000000001e-05 2024-09-10T06:27:49.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436483+0000", 2024-09-10T06:27:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7010000000000001e-06 2024-09-10T06:27:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436527+0000", 2024-09-10T06:27:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4381000000000001e-05 2024-09-10T06:27:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436569+0000", 2024-09-10T06:27:49.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2208e-05 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436687+0000", 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118093 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.437455+0000", 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076799599999999996 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439950+0000", 2024-09-10T06:27:49.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024946040000000001 2024-09-10T06:27:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439988+0000", 2024-09-10T06:27:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8405999999999998e-05 2024-09-10T06:27:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.440035+0000", 2024-09-10T06:27:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6607999999999998e-05 2024-09-10T06:27:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.836 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.027562989000003, 2024-09-10T06:27:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028833040000000002, 2024-09-10T06:27:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.837 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 742 2024-09-10T06:27:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:49.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771139+0000", 2024-09-10T06:27:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5269999999999999e-06 2024-09-10T06:27:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771153+0000", 2024-09-10T06:27:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4036000000000001e-05 2024-09-10T06:27:49.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771186+0000", 2024-09-10T06:27:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2113000000000002e-05 2024-09-10T06:27:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771201+0000", 2024-09-10T06:27:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771320+0000", 2024-09-10T06:27:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119265 2024-09-10T06:27:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771557+0000", 2024-09-10T06:27:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023640600000000001 2024-09-10T06:27:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771890+0000", 2024-09-10T06:27:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033302000000000001 2024-09-10T06:27:49.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773204+0000", 2024-09-10T06:27:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013142239999999999 2024-09-10T06:27:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773864+0000", 2024-09-10T06:27:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066005100000000004 2024-09-10T06:27:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773948+0000", 2024-09-10T06:27:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4625999999999999e-05 2024-09-10T06:27:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774019+0000", 2024-09-10T06:27:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0705999999999997e-05 2024-09-10T06:27:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.843 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.023783738999995, 2024-09-10T06:27:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025263479999999999, 2024-09-10T06:27:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 744 2024-09-10T06:27:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.844 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774917+0000", 2024-09-10T06:27:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0540000000000002e-06 2024-09-10T06:27:49.845 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774926+0000", 2024-09-10T06:27:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5660000000000007e-06 2024-09-10T06:27:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774947+0000", 2024-09-10T06:27:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0852999999999998e-05 2024-09-10T06:27:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774958+0000", 2024-09-10T06:27:49.846 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1216999999999999e-05 2024-09-10T06:27:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775045+0000", 2024-09-10T06:27:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7643000000000001e-05 2024-09-10T06:27:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775167+0000", 2024-09-10T06:27:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012163900000000001 2024-09-10T06:27:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:49.847 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775427+0000", 2024-09-10T06:27:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000259678 2024-09-10T06:27:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.776736+0000", 2024-09-10T06:27:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013093429999999999 2024-09-10T06:27:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777296+0000", 2024-09-10T06:27:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056029599999999995 2024-09-10T06:27:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.848 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777374+0000", 2024-09-10T06:27:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7721999999999999e-05 2024-09-10T06:27:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777441+0000", 2024-09-10T06:27:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7336999999999996e-05 2024-09-10T06:27:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.849 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.986468192999993, 2024-09-10T06:27:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036412979999999998, 2024-09-10T06:27:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 760 2024-09-10T06:27:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.850 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.851 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812233+0000", 2024-09-10T06:27:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812244+0000", 2024-09-10T06:27:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1273e-05 2024-09-10T06:27:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812276+0000", 2024-09-10T06:27:49.852 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1253e-05 2024-09-10T06:27:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812290+0000", 2024-09-10T06:27:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4576000000000001e-05 2024-09-10T06:27:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812438+0000", 2024-09-10T06:27:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014775899999999999 2024-09-10T06:27:49.853 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812821+0000", 2024-09-10T06:27:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000383187 2024-09-10T06:27:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.813398+0000", 2024-09-10T06:27:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000576619 2024-09-10T06:27:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.814658+0000", 2024-09-10T06:27:49.854 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001260207 2024-09-10T06:27:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815591+0000", 2024-09-10T06:27:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00093332899999999999 2024-09-10T06:27:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815745+0000", 2024-09-10T06:27:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153392 2024-09-10T06:27:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.855 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.856 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815872+0000", 2024-09-10T06:27:49.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012715599999999999 2024-09-10T06:27:49.856 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.856 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.856 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.856 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.856 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.856 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.856 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:49.856 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.981832808999997, 2024-09-10T06:27:49.856 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029417369999999998, 2024-09-10T06:27:49.856 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.856 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 762 2024-09-10T06:27:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.857 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816868+0000", 2024-09-10T06:27:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.283e-06 2024-09-10T06:27:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816879+0000", 2024-09-10T06:27:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0523000000000001e-05 2024-09-10T06:27:49.858 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816910+0000", 2024-09-10T06:27:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0732999999999999e-05 2024-09-10T06:27:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816926+0000", 2024-09-10T06:27:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.677e-05 2024-09-10T06:27:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817058+0000", 2024-09-10T06:27:49.859 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013195599999999999 2024-09-10T06:27:49.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817299+0000", 2024-09-10T06:27:49.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000241091 2024-09-10T06:27:49.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:49.860 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817761+0000", 2024-09-10T06:27:49.860 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046188400000000003 2024-09-10T06:27:49.860 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.860 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.860 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.818948+0000", 2024-09-10T06:27:49.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:49.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819662+0000", 2024-09-10T06:27:49.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071398399999999997 2024-09-10T06:27:49.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.861 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.861 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819745+0000", 2024-09-10T06:27:49.861 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3560000000000006e-05 2024-09-10T06:27:49.861 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.861 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.862 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.862 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819808+0000", 2024-09-10T06:27:49.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2329000000000006e-05 2024-09-10T06:27:49.862 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.862 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.862 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.862 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.862 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.862 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.862 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:49.862 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.861372091999996, 2024-09-10T06:27:49.862 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002834175, 2024-09-10T06:27:49.862 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.862 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 817 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.863 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:49.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937330+0000", 2024-09-10T06:27:49.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9869999999999999e-06 2024-09-10T06:27:49.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.864 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937342+0000", 2024-09-10T06:27:49.864 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2595999999999999e-05 2024-09-10T06:27:49.864 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.864 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.864 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937375+0000", 2024-09-10T06:27:49.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2320000000000002e-05 2024-09-10T06:27:49.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937390+0000", 2024-09-10T06:27:49.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4977000000000001e-05 2024-09-10T06:27:49.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.865 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.865 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.865 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937529+0000", 2024-09-10T06:27:49.865 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013937199999999999 2024-09-10T06:27:49.865 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937753+0000", 2024-09-10T06:27:49.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000224358 2024-09-10T06:27:49.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:49.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.938061+0000", 2024-09-10T06:27:49.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030808799999999998 2024-09-10T06:27:49.866 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.866 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.866 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.866 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.939112+0000", 2024-09-10T06:27:49.866 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010503050000000001 2024-09-10T06:27:49.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940005+0000", 2024-09-10T06:27:49.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089366599999999999 2024-09-10T06:27:49.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.867 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.867 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940093+0000", 2024-09-10T06:27:49.867 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8053000000000006e-05 2024-09-10T06:27:49.867 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.867 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.868 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.868 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940161+0000", 2024-09-10T06:27:49.868 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7453000000000006e-05 2024-09-10T06:27:49.868 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.868 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.868 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.868 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.868 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.868 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.868 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:49.868 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.808444050000006, 2024-09-10T06:27:49.869 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027552649999999998, 2024-09-10T06:27:49.869 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.869 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.869 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.869 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.869 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 841 2024-09-10T06:27:49.869 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.869 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:49.870 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.870 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.870 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.870 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.870 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:49.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990257+0000", 2024-09-10T06:27:49.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6869999999999999e-06 2024-09-10T06:27:49.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.871 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.871 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990270+0000", 2024-09-10T06:27:49.871 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2843000000000001e-05 2024-09-10T06:27:49.871 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.871 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990300+0000", 2024-09-10T06:27:49.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9252999999999999e-05 2024-09-10T06:27:49.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990314+0000", 2024-09-10T06:27:49.872 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4796e-05 2024-09-10T06:27:49.872 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.872 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.872 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.872 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990427+0000", 2024-09-10T06:27:49.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112649 2024-09-10T06:27:49.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990671+0000", 2024-09-10T06:27:49.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244408 2024-09-10T06:27:49.873 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.873 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.873 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:49.873 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990987+0000", 2024-09-10T06:27:49.873 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031593099999999998 2024-09-10T06:27:49.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992073+0000", 2024-09-10T06:27:49.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010854549999999999 2024-09-10T06:27:49.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992862+0000", 2024-09-10T06:27:49.874 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00078889400000000005 2024-09-10T06:27:49.874 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.874 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.874 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.874 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992944+0000", 2024-09-10T06:27:49.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2152999999999998e-05 2024-09-10T06:27:49.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.875 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.875 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993010+0000", 2024-09-10T06:27:49.875 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6196000000000001e-05 2024-09-10T06:27:49.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.875 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.875 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.875 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.875 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.875 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.875 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:49.875 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.804708116, 2024-09-10T06:27:49.876 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025373539999999999, 2024-09-10T06:27:49.876 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.876 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.876 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.876 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.877 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 843 2024-09-10T06:27:49.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.877 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.877 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.877 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.877 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:49.877 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.877 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:49.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.878 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.878 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993993+0000", 2024-09-10T06:27:49.878 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3630000000000001e-06 2024-09-10T06:27:49.878 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.878 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994004+0000", 2024-09-10T06:27:49.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0557000000000001e-05 2024-09-10T06:27:49.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994035+0000", 2024-09-10T06:27:49.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0969000000000001e-05 2024-09-10T06:27:49.879 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.879 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.879 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.879 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994055+0000", 2024-09-10T06:27:49.879 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0497e-05 2024-09-10T06:27:49.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994150+0000", 2024-09-10T06:27:49.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5363000000000002e-05 2024-09-10T06:27:49.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.880 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.880 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994275+0000", 2024-09-10T06:27:49.880 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012453200000000001 2024-09-10T06:27:49.880 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.880 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:49.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994570+0000", 2024-09-10T06:27:49.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029522100000000003 2024-09-10T06:27:49.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.881 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.881 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.995569+0000", 2024-09-10T06:27:49.881 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00099913200000000001 2024-09-10T06:27:49.881 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.881 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996384+0000", 2024-09-10T06:27:49.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081451099999999997 2024-09-10T06:27:49.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.882 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996462+0000", 2024-09-10T06:27:49.882 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8502000000000002e-05 2024-09-10T06:27:49.882 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.882 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.882 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.883 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996528+0000", 2024-09-10T06:27:49.883 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5707e-05 2024-09-10T06:27:49.883 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.883 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.883 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.883 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.883 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.883 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.884 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:49.884 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.795260968999997, 2024-09-10T06:27:49.884 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033145539999999999, 2024-09-10T06:27:49.884 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.884 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.884 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.884 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.884 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.885 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.885 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 847 2024-09-10T06:27:49.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.885 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:49.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.885 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.885 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.885 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.885 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:49.885 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003440+0000", 2024-09-10T06:27:49.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5299999999999999e-06 2024-09-10T06:27:49.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003452+0000", 2024-09-10T06:27:49.886 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:49.886 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.886 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.886 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.886 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003482+0000", 2024-09-10T06:27:49.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0790000000000002e-05 2024-09-10T06:27:49.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003497+0000", 2024-09-10T06:27:49.887 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.489e-05 2024-09-10T06:27:49.887 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.887 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.887 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.887 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003645+0000", 2024-09-10T06:27:49.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014771900000000001 2024-09-10T06:27:49.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003996+0000", 2024-09-10T06:27:49.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000350861 2024-09-10T06:27:49.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.888 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.888 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:49.888 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.004540+0000", 2024-09-10T06:27:49.888 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054383199999999995 2024-09-10T06:27:49.888 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.005831+0000", 2024-09-10T06:27:49.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001291366 2024-09-10T06:27:49.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.889 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.889 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006461+0000", 2024-09-10T06:27:49.889 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062943899999999998 2024-09-10T06:27:49.889 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.889 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006631+0000", 2024-09-10T06:27:49.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000170228 2024-09-10T06:27:49.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.890 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.890 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006752+0000", 2024-09-10T06:27:49.890 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012160899999999999 2024-09-10T06:27:49.890 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.890 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.890 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.890 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.890 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.891 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.891 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:49.891 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.791007801999996, 2024-09-10T06:27:49.891 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002619953, 2024-09-10T06:27:49.891 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.891 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.891 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.891 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.891 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.891 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.891 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 849 2024-09-10T06:27:49.891 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.891 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:49.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:49.892 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.892 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.892 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.892 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.892 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007693+0000", 2024-09-10T06:27:49.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3099999999999999e-06 2024-09-10T06:27:49.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007704+0000", 2024-09-10T06:27:49.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0387000000000001e-05 2024-09-10T06:27:49.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.893 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007734+0000", 2024-09-10T06:27:49.893 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0676000000000002e-05 2024-09-10T06:27:49.893 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.893 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.893 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007753+0000", 2024-09-10T06:27:49.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.836e-05 2024-09-10T06:27:49.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007857+0000", 2024-09-10T06:27:49.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103836 2024-09-10T06:27:49.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.894 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.894 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007980+0000", 2024-09-10T06:27:49.894 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123843 2024-09-10T06:27:49.894 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.894 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:49.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.008241+0000", 2024-09-10T06:27:49.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026085799999999999 2024-09-10T06:27:49.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.009475+0000", 2024-09-10T06:27:49.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012340230000000001 2024-09-10T06:27:49.895 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.895 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.895 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.895 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010168+0000", 2024-09-10T06:27:49.895 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00069220800000000004 2024-09-10T06:27:49.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010247+0000", 2024-09-10T06:27:49.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9929e-05 2024-09-10T06:27:49.896 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.896 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.896 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.896 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010311+0000", 2024-09-10T06:27:49.896 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3522999999999995e-05 2024-09-10T06:27:49.896 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.896 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.896 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.897 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.897 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.897 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.897 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:49.897 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.746527981, 2024-09-10T06:27:49.897 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026646590000000002, 2024-09-10T06:27:49.897 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.897 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.897 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.897 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.898 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.898 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 868 2024-09-10T06:27:49.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.898 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.898 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.898 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.898 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:49.898 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.898 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:49.899 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.899 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.899 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.899 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.899 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052173+0000", 2024-09-10T06:27:49.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-10T06:27:49.900 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.900 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.900 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.900 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052186+0000", 2024-09-10T06:27:49.900 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2787e-05 2024-09-10T06:27:49.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.901 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.901 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.901 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052216+0000", 2024-09-10T06:27:49.901 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9618999999999999e-05 2024-09-10T06:27:49.901 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.902 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052231+0000", 2024-09-10T06:27:49.902 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4929999999999999e-05 2024-09-10T06:27:49.902 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.902 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.902 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052349+0000", 2024-09-10T06:27:49.903 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011830200000000001 2024-09-10T06:27:49.903 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.903 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.903 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.903 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052561+0000", 2024-09-10T06:27:49.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000212182 2024-09-10T06:27:49.904 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.904 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.904 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:49.904 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052874+0000", 2024-09-10T06:27:49.904 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031299399999999998 2024-09-10T06:27:49.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.905 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.905 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054049+0000", 2024-09-10T06:27:49.905 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174825 2024-09-10T06:27:49.905 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.905 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.906 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054635+0000", 2024-09-10T06:27:49.906 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058643900000000001 2024-09-10T06:27:49.906 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.906 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.906 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.907 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054721+0000", 2024-09-10T06:27:49.907 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5185999999999994e-05 2024-09-10T06:27:49.907 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.907 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.907 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.908 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054836+0000", 2024-09-10T06:27:49.908 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114922 2024-09-10T06:27:49.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.908 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.908 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.908 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.908 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.908 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.908 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:49.909 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.659871879999997, 2024-09-10T06:27:49.909 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028453739999999999, 2024-09-10T06:27:49.909 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.909 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.909 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.909 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.909 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.909 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.909 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 907 2024-09-10T06:27:49.909 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.909 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138830+0000", 2024-09-10T06:27:49.910 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8600000000000001e-06 2024-09-10T06:27:49.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138842+0000", 2024-09-10T06:27:49.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2126e-05 2024-09-10T06:27:49.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.911 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138874+0000", 2024-09-10T06:27:49.911 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2047e-05 2024-09-10T06:27:49.911 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.911 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.911 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138889+0000", 2024-09-10T06:27:49.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4966999999999999e-05 2024-09-10T06:27:49.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139007+0000", 2024-09-10T06:27:49.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118479 2024-09-10T06:27:49.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.912 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.912 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139238+0000", 2024-09-10T06:27:49.912 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023031399999999999 2024-09-10T06:27:49.912 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.912 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:49.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139566+0000", 2024-09-10T06:27:49.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032816099999999999 2024-09-10T06:27:49.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.140631+0000", 2024-09-10T06:27:49.913 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010653679999999999 2024-09-10T06:27:49.913 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.913 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.913 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.913 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141393+0000", 2024-09-10T06:27:49.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076187100000000001 2024-09-10T06:27:49.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.914 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.914 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141561+0000", 2024-09-10T06:27:49.914 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016755599999999999 2024-09-10T06:27:49.914 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.914 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.915 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.915 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141672+0000", 2024-09-10T06:27:49.915 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111625 2024-09-10T06:27:49.915 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.915 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.915 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.915 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.915 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.915 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.916 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:49.916 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.655948363999997, 2024-09-10T06:27:49.916 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002857268, 2024-09-10T06:27:49.916 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.916 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.916 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.916 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.916 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.916 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.916 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 909 2024-09-10T06:27:49.916 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.916 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:49.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:49.917 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.917 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.917 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.917 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.917 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142753+0000", 2024-09-10T06:27:49.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4040000000000002e-06 2024-09-10T06:27:49.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142764+0000", 2024-09-10T06:27:49.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0789e-05 2024-09-10T06:27:49.918 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.918 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.918 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.918 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142795+0000", 2024-09-10T06:27:49.918 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0982999999999998e-05 2024-09-10T06:27:49.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.919 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.919 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142810+0000", 2024-09-10T06:27:49.919 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4960000000000001e-05 2024-09-10T06:27:49.919 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.919 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142908+0000", 2024-09-10T06:27:49.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8726000000000003e-05 2024-09-10T06:27:49.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.920 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143030+0000", 2024-09-10T06:27:49.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121649 2024-09-10T06:27:49.920 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.920 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:49.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143294+0000", 2024-09-10T06:27:49.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000263875 2024-09-10T06:27:49.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.144530+0000", 2024-09-10T06:27:49.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001236067 2024-09-10T06:27:49.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145340+0000", 2024-09-10T06:27:49.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080966700000000003 2024-09-10T06:27:49.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145497+0000", 2024-09-10T06:27:49.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015773499999999999 2024-09-10T06:27:49.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145608+0000", 2024-09-10T06:27:49.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110413 2024-09-10T06:27:49.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.922 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.922 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.923 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.923 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:49.923 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.562250867000003, 2024-09-10T06:27:49.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029166940000000001, 2024-09-10T06:27:49.923 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.923 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.923 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.923 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.923 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 949 2024-09-10T06:27:49.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.924 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:49.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:49.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236451+0000", 2024-09-10T06:27:49.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:27:49.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236464+0000", 2024-09-10T06:27:49.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3223e-05 2024-09-10T06:27:49.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236497+0000", 2024-09-10T06:27:49.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2672999999999997e-05 2024-09-10T06:27:49.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236515+0000", 2024-09-10T06:27:49.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8386999999999999e-05 2024-09-10T06:27:49.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236636+0000", 2024-09-10T06:27:49.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120752 2024-09-10T06:27:49.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236857+0000", 2024-09-10T06:27:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022134499999999999 2024-09-10T06:27:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.237188+0000", 2024-09-10T06:27:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033057799999999999 2024-09-10T06:27:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.238353+0000", 2024-09-10T06:27:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001164841 2024-09-10T06:27:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239160+0000", 2024-09-10T06:27:49.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080743000000000004 2024-09-10T06:27:49.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239245+0000", 2024-09-10T06:27:49.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5189e-05 2024-09-10T06:27:49.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239365+0000", 2024-09-10T06:27:49.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119406 2024-09-10T06:27:49.929 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.929 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.929 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.929 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.929 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:49.929 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.558389759999997, 2024-09-10T06:27:49.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025033970000000001, 2024-09-10T06:27:49.929 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.929 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.930 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.930 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.930 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 951 2024-09-10T06:27:49.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.930 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:49.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:49.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240311+0000", 2024-09-10T06:27:49.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8899999999999999e-06 2024-09-10T06:27:49.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240320+0000", 2024-09-10T06:27:49.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6799999999999999e-06 2024-09-10T06:27:49.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240341+0000", 2024-09-10T06:27:49.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1379e-05 2024-09-10T06:27:49.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240352+0000", 2024-09-10T06:27:49.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1354e-05 2024-09-10T06:27:49.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.933 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240450+0000", 2024-09-10T06:27:49.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7866000000000001e-05 2024-09-10T06:27:49.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240580+0000", 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012970899999999999 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240851+0000", 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027059099999999998 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242052+0000", 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001201014 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242662+0000", 2024-09-10T06:27:49.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061076800000000003 2024-09-10T06:27:49.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242747+0000", 2024-09-10T06:27:49.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5019999999999996e-05 2024-09-10T06:27:49.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242812+0000", 2024-09-10T06:27:49.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5126e-05 2024-09-10T06:27:49.935 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.935 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 67.547940341, 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027897120000000002, 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 955 2024-09-10T06:27:49.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.937 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:49.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:49.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:49.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:49.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:49.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:49.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:49.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250761+0000", 2024-09-10T06:27:49.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:49.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:49.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250772+0000", 2024-09-10T06:27:49.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1153e-05 2024-09-10T06:27:49.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:49.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250802+0000", 2024-09-10T06:27:49.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-05 2024-09-10T06:27:49.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:49.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250817+0000", 2024-09-10T06:27:49.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4883e-05 2024-09-10T06:27:49.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:49.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250925+0000", 2024-09-10T06:27:49.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108249 2024-09-10T06:27:49.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:49.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251139+0000", 2024-09-10T06:27:49.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000213568 2024-09-10T06:27:49.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.940 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:49.940 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251450+0000", 2024-09-10T06:27:49.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031139200000000002 2024-09-10T06:27:49.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.940 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:49.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.252574+0000", 2024-09-10T06:27:49.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011239139999999999 2024-09-10T06:27:49.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:49.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253377+0000", 2024-09-10T06:27:49.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080306400000000003 2024-09-10T06:27:49.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:49.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253466+0000", 2024-09-10T06:27:49.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8436000000000005e-05 2024-09-10T06:27:49.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:49.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:49.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:49.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253548+0000", 2024-09-10T06:27:49.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2496000000000004e-05 2024-09-10T06:27:49.942 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.942 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.942 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.942 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:49.942 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:49.942 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:49.944 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:27:49.945 INFO:tasks.workunit.client.0.smithi112.stderr:Updating files: 95% (12071/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-10T06:27:49.945 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:49.940+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:50.044 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:50.040+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:50.112 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:50.112 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:50.112 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:50.113 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:50.126 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:27:50.146 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:50.145+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:50.247 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:50.245+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:50.293 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:50.293 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:50.293 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:50.293 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:50.293 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:50.308 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:27:50.353 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:50.352+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:50.426 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:50.426 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:50.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:50.426 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:50.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.426 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:58 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:50.426 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:50.426 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.098160305999997, 2024-09-10T06:27:50.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030326279999999999, 2024-09-10T06:27:50.426 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.427 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.427 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.427 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.427 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.427 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.427 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 58 2024-09-10T06:27:50.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.427 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.427 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.427 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:50.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:50.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324163+0000", 2024-09-10T06:27:50.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4600000000000003e-07 2024-09-10T06:27:50.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324169+0000", 2024-09-10T06:27:50.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9020000000000004e-06 2024-09-10T06:27:50.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324182+0000", 2024-09-10T06:27:50.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2166e-05 2024-09-10T06:27:50.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324190+0000", 2024-09-10T06:27:50.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.337e-06 2024-09-10T06:27:50.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324282+0000", 2024-09-10T06:27:50.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2331999999999996e-05 2024-09-10T06:27:50.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324486+0000", 2024-09-10T06:27:50.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020347400000000001 2024-09-10T06:27:50.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:50.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.324719+0000", 2024-09-10T06:27:50.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023289900000000001 2024-09-10T06:27:50.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.325993+0000", 2024-09-10T06:27:50.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012746929999999999 2024-09-10T06:27:50.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327088+0000", 2024-09-10T06:27:50.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010947330000000001 2024-09-10T06:27:50.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327147+0000", 2024-09-10T06:27:50.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8677000000000001e-05 2024-09-10T06:27:50.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.433 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.433 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.327195+0000", 2024-09-10T06:27:50.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8469e-05 2024-09-10T06:27:50.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.433 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.433 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:50.433 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:50.433 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 69.116339723999999, 2024-09-10T06:27:50.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003846917, 2024-09-10T06:27:50.433 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 207 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:50.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305987+0000", 2024-09-10T06:27:50.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6069999999999999e-06 2024-09-10T06:27:50.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306002+0000", 2024-09-10T06:27:50.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5406000000000001e-05 2024-09-10T06:27:50.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306036+0000", 2024-09-10T06:27:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4146000000000001e-05 2024-09-10T06:27:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306061+0000", 2024-09-10T06:27:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4470000000000001e-05 2024-09-10T06:27:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306325+0000", 2024-09-10T06:27:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026382800000000002 2024-09-10T06:27:50.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306569+0000", 2024-09-10T06:27:50.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024445499999999998 2024-09-10T06:27:50.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:50.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.307017+0000", 2024-09-10T06:27:50.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044774000000000002 2024-09-10T06:27:50.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.308517+0000", 2024-09-10T06:27:50.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001500075 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309685+0000", 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001168505 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309767+0000", 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1992999999999999e-05 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309830+0000", 2024-09-10T06:27:50.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2692000000000002e-05 2024-09-10T06:27:50.439 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.439 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.439 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.439 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.439 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:50.439 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 69.072087675999995, 2024-09-10T06:27:50.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003433888, 2024-09-10T06:27:50.439 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.439 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.439 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.439 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.439 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.440 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.440 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 216 2024-09-10T06:27:50.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.440 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:50.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:50.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350239+0000", 2024-09-10T06:27:50.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.377e-06 2024-09-10T06:27:50.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350254+0000", 2024-09-10T06:27:50.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.501e-05 2024-09-10T06:27:50.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350288+0000", 2024-09-10T06:27:50.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4746000000000002e-05 2024-09-10T06:27:50.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350312+0000", 2024-09-10T06:27:50.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3249999999999999e-05 2024-09-10T06:27:50.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350456+0000", 2024-09-10T06:27:50.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014483899999999999 2024-09-10T06:27:50.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350704+0000", 2024-09-10T06:27:50.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024719100000000001 2024-09-10T06:27:50.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:50.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.351117+0000", 2024-09-10T06:27:50.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000412934 2024-09-10T06:27:50.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.352644+0000", 2024-09-10T06:27:50.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015271079999999999 2024-09-10T06:27:50.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353397+0000", 2024-09-10T06:27:50.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075311799999999999 2024-09-10T06:27:50.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353556+0000", 2024-09-10T06:27:50.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159612 2024-09-10T06:27:50.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353669+0000", 2024-09-10T06:27:50.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011270299999999999 2024-09-10T06:27:50.444 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.444 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.445 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.445 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.445 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:50.445 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 69.033408214000005, 2024-09-10T06:27:50.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033447479999999998, 2024-09-10T06:27:50.445 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.445 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.445 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.445 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 227 2024-09-10T06:27:50.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.446 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:50.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:50.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388917+0000", 2024-09-10T06:27:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6900000000000001e-06 2024-09-10T06:27:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388931+0000", 2024-09-10T06:27:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3900000000000001e-05 2024-09-10T06:27:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388964+0000", 2024-09-10T06:27:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2985999999999999e-05 2024-09-10T06:27:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388980+0000", 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.535e-05 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389123+0000", 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014337900000000001 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389341+0000", 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021765099999999999 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:50.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389765+0000", 2024-09-10T06:27:50.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042423100000000001 2024-09-10T06:27:50.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.391433+0000", 2024-09-10T06:27:50.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016681000000000001 2024-09-10T06:27:50.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392104+0000", 2024-09-10T06:27:50.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067064800000000003 2024-09-10T06:27:50.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392191+0000", 2024-09-10T06:27:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7912999999999997e-05 2024-09-10T06:27:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392259+0000", 2024-09-10T06:27:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7899999999999997e-05 2024-09-10T06:27:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 69.026151440000007, 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029995500000000001, 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 229 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:50.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396171+0000", 2024-09-10T06:27:50.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396174+0000", 2024-09-10T06:27:50.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.774e-06 2024-09-10T06:27:50.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396186+0000", 2024-09-10T06:27:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2055999999999999e-05 2024-09-10T06:27:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396216+0000", 2024-09-10T06:27:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9640000000000001e-05 2024-09-10T06:27:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396231+0000", 2024-09-10T06:27:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:50.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396356+0000", 2024-09-10T06:27:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012504500000000001 2024-09-10T06:27:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396568+0000", 2024-09-10T06:27:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000211709 2024-09-10T06:27:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:50.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.396954+0000", 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000386027 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.398287+0000", 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013331560000000001 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399004+0000", 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071720499999999995 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399091+0000", 2024-09-10T06:27:50.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6714999999999999e-05 2024-09-10T06:27:50.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.399171+0000", 2024-09-10T06:27:50.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9893000000000002e-05 2024-09-10T06:27:50.456 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.456 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.456 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.456 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.456 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 69.019592871, 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030468270000000002, 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 231 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:50.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402730+0000", 2024-09-10T06:27:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402732+0000", 2024-09-10T06:27:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4870000000000001e-06 2024-09-10T06:27:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402744+0000", 2024-09-10T06:27:50.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1633e-05 2024-09-10T06:27:50.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402774+0000", 2024-09-10T06:27:50.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9666999999999999e-05 2024-09-10T06:27:50.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402789+0000", 2024-09-10T06:27:50.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5466000000000001e-05 2024-09-10T06:27:50.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.402904+0000", 2024-09-10T06:27:50.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114466 2024-09-10T06:27:50.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403119+0000", 2024-09-10T06:27:50.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000215572 2024-09-10T06:27:50.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:50.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.403516+0000", 2024-09-10T06:27:50.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00039663300000000002 2024-09-10T06:27:50.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405012+0000", 2024-09-10T06:27:50.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014961919999999999 2024-09-10T06:27:50.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405634+0000", 2024-09-10T06:27:50.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062145199999999999 2024-09-10T06:27:50.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405715+0000", 2024-09-10T06:27:50.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1619000000000006e-05 2024-09-10T06:27:50.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.405777+0000", 2024-09-10T06:27:50.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1639999999999999e-05 2024-09-10T06:27:50.462 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.462 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.462 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.462 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:377 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.462 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.96083754, 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058485480000000003, 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 377 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:50.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:50.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461486+0000", 2024-09-10T06:27:50.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0720000000000001e-06 2024-09-10T06:27:50.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461504+0000", 2024-09-10T06:27:50.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8002000000000001e-05 2024-09-10T06:27:50.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461519+0000", 2024-09-10T06:27:50.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4584e-05 2024-09-10T06:27:50.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461526+0000", 2024-09-10T06:27:50.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5560000000000004e-06 2024-09-10T06:27:50.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461597+0000", 2024-09-10T06:27:50.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1311999999999998e-05 2024-09-10T06:27:50.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461709+0000", 2024-09-10T06:27:50.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011191100000000001 2024-09-10T06:27:50.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461871+0000", 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016254900000000001 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.462777+0000", 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00090547100000000003 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467265+0000", 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004488222 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467308+0000", 2024-09-10T06:27:50.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2975000000000001e-05 2024-09-10T06:27:50.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467334+0000", 2024-09-10T06:27:50.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5894e-05 2024-09-10T06:27:50.468 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.468 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.468 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.468 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:384 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.469 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:50.469 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.958704685000001, 2024-09-10T06:27:50.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031588900000000001, 2024-09-10T06:27:50.469 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.469 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.469 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.469 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.469 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.469 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.469 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 384 2024-09-10T06:27:50.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.469 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:50.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:50.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463620+0000", 2024-09-10T06:27:50.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:50.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463625+0000", 2024-09-10T06:27:50.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6450000000000002e-06 2024-09-10T06:27:50.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463639+0000", 2024-09-10T06:27:50.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3540000000000001e-05 2024-09-10T06:27:50.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463648+0000", 2024-09-10T06:27:50.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0259999999999996e-06 2024-09-10T06:27:50.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463713+0000", 2024-09-10T06:27:50.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5438000000000006e-05 2024-09-10T06:27:50.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463774+0000", 2024-09-10T06:27:50.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0582999999999999e-05 2024-09-10T06:27:50.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:50.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463899+0000", 2024-09-10T06:27:50.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-10T06:27:50.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.464371+0000", 2024-09-10T06:27:50.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047201600000000002 2024-09-10T06:27:50.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466707+0000", 2024-09-10T06:27:50.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023354999999999999 2024-09-10T06:27:50.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466742+0000", 2024-09-10T06:27:50.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4686e-05 2024-09-10T06:27:50.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466777+0000", 2024-09-10T06:27:50.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5537000000000002e-05 2024-09-10T06:27:50.474 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.474 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.474 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:436 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.943457637999998, 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040690570000000001, 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 436 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.475 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:50.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:50.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478866+0000", 2024-09-10T06:27:50.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1960000000000001e-06 2024-09-10T06:27:50.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478871+0000", 2024-09-10T06:27:50.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6879999999999998e-06 2024-09-10T06:27:50.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478883+0000", 2024-09-10T06:27:50.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1790999999999999e-05 2024-09-10T06:27:50.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478890+0000", 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8569999999999997e-06 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478958+0000", 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7774999999999994e-05 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479072+0000", 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114577 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:50.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479255+0000", 2024-09-10T06:27:50.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018297300000000001 2024-09-10T06:27:50.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482448+0000", 2024-09-10T06:27:50.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031933389999999999 2024-09-10T06:27:50.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482828+0000", 2024-09-10T06:27:50.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037961800000000002 2024-09-10T06:27:50.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482891+0000", 2024-09-10T06:27:50.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3316000000000002e-05 2024-09-10T06:27:50.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482934+0000", 2024-09-10T06:27:50.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2926999999999997e-05 2024-09-10T06:27:50.480 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.480 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.480 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.480 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:441 6.7 e34/28 6:e1cdb60d:reshard::reshard.0000000008:head v 34'7, mlcod=34'5)", 2024-09-10T06:27:50.480 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.939856719999995, 2024-09-10T06:27:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060368319999999998, 2024-09-10T06:27:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:50.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482467+0000", 2024-09-10T06:27:50.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8800000000000003e-07 2024-09-10T06:27:50.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482472+0000", 2024-09-10T06:27:50.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8730000000000004e-06 2024-09-10T06:27:50.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482481+0000", 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1980000000000001e-06 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482485+0000", 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.386e-06 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482541+0000", 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5788000000000002e-05 2024-09-10T06:27:50.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482563+0000", 2024-09-10T06:27:50.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2303999999999999e-05 2024-09-10T06:27:50.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488465+0000", 2024-09-10T06:27:50.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059014810000000001 2024-09-10T06:27:50.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488503+0000", 2024-09-10T06:27:50.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8313999999999999e-05 2024-09-10T06:27:50.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.485 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.485 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.485 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:466 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.485 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:50.485 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.924697469999998, 2024-09-10T06:27:50.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039032810000000002, 2024-09-10T06:27:50.486 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.486 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.486 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.486 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.486 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 466 2024-09-10T06:27:50.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.486 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:50.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:50.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497626+0000", 2024-09-10T06:27:50.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9099999999999991e-07 2024-09-10T06:27:50.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497634+0000", 2024-09-10T06:27:50.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.994e-06 2024-09-10T06:27:50.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497644+0000", 2024-09-10T06:27:50.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6260000000000007e-06 2024-09-10T06:27:50.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497650+0000", 2024-09-10T06:27:50.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5160000000000002e-06 2024-09-10T06:27:50.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497718+0000", 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8862999999999994e-05 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497775+0000", 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6156000000000002e-05 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497903+0000", 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012879800000000001 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499630+0000", 2024-09-10T06:27:50.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017268139999999999 2024-09-10T06:27:50.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501439+0000", 2024-09-10T06:27:50.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018086669999999999 2024-09-10T06:27:50.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501478+0000", 2024-09-10T06:27:50.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9269e-05 2024-09-10T06:27:50.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501529+0000", 2024-09-10T06:27:50.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0587000000000002e-05 2024-09-10T06:27:50.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.491 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.491 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.491 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:469 6.0 e34/28 6:02683654:reshard::reshard.0000000010:head v 34'6, mlcod=34'4)", 2024-09-10T06:27:50.491 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:50.491 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.922694647, 2024-09-10T06:27:50.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048323109999999997, 2024-09-10T06:27:50.491 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.491 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.491 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.492 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:50.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:50.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499629+0000", 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9199999999999999e-07 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499634+0000", 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2530000000000004e-06 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499644+0000", 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5820000000000008e-06 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499650+0000", 2024-09-10T06:27:50.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7919999999999998e-06 2024-09-10T06:27:50.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499697+0000", 2024-09-10T06:27:50.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7564000000000001e-05 2024-09-10T06:27:50.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499719+0000", 2024-09-10T06:27:50.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1297999999999998e-05 2024-09-10T06:27:50.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504413+0000", 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004694419 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504461+0000", 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7511e-05 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:621 6.0 e34/28 6:0705c68b:::obj_delete_at_hint.0000000028:head v 34'11, mlcod=34'9)", 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:50.495 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.817493502000005, 2024-09-10T06:27:50.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003196562, 2024-09-10T06:27:50.496 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.496 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.496 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.496 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:50.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:50.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604831+0000", 2024-09-10T06:27:50.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.823e-06 2024-09-10T06:27:50.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604843+0000", 2024-09-10T06:27:50.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1437000000000001e-05 2024-09-10T06:27:50.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604868+0000", 2024-09-10T06:27:50.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5837e-05 2024-09-10T06:27:50.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604885+0000", 2024-09-10T06:27:50.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6759999999999999e-05 2024-09-10T06:27:50.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604971+0000", 2024-09-10T06:27:50.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5512000000000004e-05 2024-09-10T06:27:50.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604991+0000", 2024-09-10T06:27:50.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0197999999999999e-05 2024-09-10T06:27:50.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.607960+0000", 2024-09-10T06:27:50.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002969307 2024-09-10T06:27:50.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608026+0000", 2024-09-10T06:27:50.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5687999999999999e-05 2024-09-10T06:27:50.499 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.500 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.500 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.500 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:636 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.500 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:50.500 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.808583847999998, 2024-09-10T06:27:50.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048306950000000003, 2024-09-10T06:27:50.500 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.500 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.501 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.501 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.501 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 636 2024-09-10T06:27:50.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.501 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:50.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:50.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613740+0000", 2024-09-10T06:27:50.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:50.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613747+0000", 2024-09-10T06:27:50.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8090000000000004e-06 2024-09-10T06:27:50.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613762+0000", 2024-09-10T06:27:50.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5037e-05 2024-09-10T06:27:50.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613772+0000", 2024-09-10T06:27:50.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7510000000000003e-06 2024-09-10T06:27:50.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613834+0000", 2024-09-10T06:27:50.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2458000000000004e-05 2024-09-10T06:27:50.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613916+0000", 2024-09-10T06:27:50.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1630000000000003e-05 2024-09-10T06:27:50.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:50.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.614071+0000", 2024-09-10T06:27:50.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015480800000000001 2024-09-10T06:27:50.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.615885+0000", 2024-09-10T06:27:50.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001814607 2024-09-10T06:27:50.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618438+0000", 2024-09-10T06:27:50.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025529459999999999 2024-09-10T06:27:50.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618503+0000", 2024-09-10T06:27:50.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4851000000000006e-05 2024-09-10T06:27:50.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618570+0000", 2024-09-10T06:27:50.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6418e-05 2024-09-10T06:27:50.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.506 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.506 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.506 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:646 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.506 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:50.506 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.799122057999995, 2024-09-10T06:27:50.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049103549999999999, 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 646 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:50.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623202+0000", 2024-09-10T06:27:50.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9800000000000002e-07 2024-09-10T06:27:50.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623206+0000", 2024-09-10T06:27:50.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6380000000000003e-06 2024-09-10T06:27:50.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623216+0000", 2024-09-10T06:27:50.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4439999999999997e-06 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623221+0000", 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6400000000000002e-06 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623300+0000", 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8677999999999994e-05 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623410+0000", 2024-09-10T06:27:50.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010954399999999999 2024-09-10T06:27:50.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:50.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623629+0000", 2024-09-10T06:27:50.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000219836 2024-09-10T06:27:50.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.625072+0000", 2024-09-10T06:27:50.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014427929999999999 2024-09-10T06:27:50.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.627982+0000", 2024-09-10T06:27:50.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029097620000000002 2024-09-10T06:27:50.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628058+0000", 2024-09-10T06:27:50.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6390999999999994e-05 2024-09-10T06:27:50.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628111+0000", 2024-09-10T06:27:50.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2731e-05 2024-09-10T06:27:50.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.514 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.514 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.514 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.514 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:50.514 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.736447785999999, 2024-09-10T06:27:50.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033783509999999999, 2024-09-10T06:27:50.514 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.514 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.514 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.515 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.515 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 703 2024-09-10T06:27:50.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.515 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:50.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:50.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685878+0000", 2024-09-10T06:27:50.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5900000000000002e-06 2024-09-10T06:27:50.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685889+0000", 2024-09-10T06:27:50.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:50.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685919+0000", 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0307e-05 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685935+0000", 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5336e-05 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686092+0000", 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015776200000000001 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686462+0000", 2024-09-10T06:27:50.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036925700000000001 2024-09-10T06:27:50.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:50.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.687048+0000", 2024-09-10T06:27:50.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000586266 2024-09-10T06:27:50.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688261+0000", 2024-09-10T06:27:50.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012132670000000001 2024-09-10T06:27:50.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688974+0000", 2024-09-10T06:27:50.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071248800000000005 2024-09-10T06:27:50.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689129+0000", 2024-09-10T06:27:50.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155499 2024-09-10T06:27:50.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689253+0000", 2024-09-10T06:27:50.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124289 2024-09-10T06:27:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.377882283000005, 2024-09-10T06:27:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032750980000000002, 2024-09-10T06:27:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.520 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.521 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.521 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 865 2024-09-10T06:27:50.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.521 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:50.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:50.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044443+0000", 2024-09-10T06:27:50.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6929999999999999e-06 2024-09-10T06:27:50.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044456+0000", 2024-09-10T06:27:50.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.224e-05 2024-09-10T06:27:50.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044486+0000", 2024-09-10T06:27:50.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.095e-05 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044501+0000", 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4932999999999999e-05 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044646+0000", 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014465600000000001 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045001+0000", 2024-09-10T06:27:50.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035473999999999998 2024-09-10T06:27:50.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:50.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045549+0000", 2024-09-10T06:27:50.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054870299999999999 2024-09-10T06:27:50.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.046956+0000", 2024-09-10T06:27:50.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014061189999999999 2024-09-10T06:27:50.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047452+0000", 2024-09-10T06:27:50.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049682199999999995 2024-09-10T06:27:50.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047606+0000", 2024-09-10T06:27:50.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015379599999999999 2024-09-10T06:27:50.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047716+0000", 2024-09-10T06:27:50.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109446 2024-09-10T06:27:50.526 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.526 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.526 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.526 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.526 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:50.526 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.373419131000006, 2024-09-10T06:27:50.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030837989999999999, 2024-09-10T06:27:50.526 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.526 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.526 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.526 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.527 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.527 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.527 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 867 2024-09-10T06:27:50.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.527 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:50.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048904+0000", 2024-09-10T06:27:50.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048906+0000", 2024-09-10T06:27:50.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1770000000000001e-06 2024-09-10T06:27:50.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048916+0000", 2024-09-10T06:27:50.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.025e-05 2024-09-10T06:27:50.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048948+0000", 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1859000000000001e-05 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.048968+0000", 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9647e-05 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049090+0000", 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122645 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.529 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049314+0000", 2024-09-10T06:27:50.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022372900000000001 2024-09-10T06:27:50.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:50.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.049785+0000", 2024-09-10T06:27:50.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047121899999999999 2024-09-10T06:27:50.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.050979+0000", 2024-09-10T06:27:50.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001193408 2024-09-10T06:27:50.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051729+0000", 2024-09-10T06:27:50.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075039699999999998 2024-09-10T06:27:50.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051874+0000", 2024-09-10T06:27:50.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000145253 2024-09-10T06:27:50.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.051988+0000", 2024-09-10T06:27:50.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011321500000000001 2024-09-10T06:27:50.532 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.532 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.532 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.532 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.532 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:50.532 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.304551950000004, 2024-09-10T06:27:50.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035511029999999999, 2024-09-10T06:27:50.532 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.532 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.532 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.532 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.533 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.533 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 898 2024-09-10T06:27:50.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.533 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:50.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:50.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117772+0000", 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5340000000000001e-06 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117781+0000", 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.276e-06 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117804+0000", 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3093999999999999e-05 2024-09-10T06:27:50.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117816+0000", 2024-09-10T06:27:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1986e-05 2024-09-10T06:27:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117954+0000", 2024-09-10T06:27:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013856900000000001 2024-09-10T06:27:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118327+0000", 2024-09-10T06:27:50.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000372841 2024-09-10T06:27:50.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:50.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118919+0000", 2024-09-10T06:27:50.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059172800000000002 2024-09-10T06:27:50.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.120253+0000", 2024-09-10T06:27:50.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001333643 2024-09-10T06:27:50.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121060+0000", 2024-09-10T06:27:50.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080731100000000001 2024-09-10T06:27:50.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121210+0000", 2024-09-10T06:27:50.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014980500000000001 2024-09-10T06:27:50.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121322+0000", 2024-09-10T06:27:50.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112316 2024-09-10T06:27:50.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.537 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.537 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 68.215282138000006, 2024-09-10T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051838630000000004, 2024-09-10T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 937 2024-09-10T06:27:50.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:50.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207042+0000", 2024-09-10T06:27:50.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7439999999999999e-06 2024-09-10T06:27:50.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:50.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207051+0000", 2024-09-10T06:27:50.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7299999999999994e-06 2024-09-10T06:27:50.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:50.540 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207072+0000", 2024-09-10T06:27:50.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1209e-05 2024-09-10T06:27:50.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207089+0000", 2024-09-10T06:27:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6297e-05 2024-09-10T06:27:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207231+0000", 2024-09-10T06:27:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014233200000000001 2024-09-10T06:27:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207463+0000", 2024-09-10T06:27:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023155199999999999 2024-09-10T06:27:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207797+0000", 2024-09-10T06:27:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033413699999999998 2024-09-10T06:27:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.209053+0000", 2024-09-10T06:27:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012560029999999999 2024-09-10T06:27:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212076+0000", 2024-09-10T06:27:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030234239999999998 2024-09-10T06:27:50.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:50.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212162+0000", 2024-09-10T06:27:50.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5506000000000004e-05 2024-09-10T06:27:50.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:50.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:50.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:50.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212225+0000", 2024-09-10T06:27:50.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2928999999999993e-05 2024-09-10T06:27:50.543 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.543 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.543 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.543 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:50.543 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:50.544 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:50.545 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:27:50.545 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:50.545+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:50.550 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-10T06:27:50.645 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:50.645+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:50.678 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:50.678 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:50.678 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:50.678 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:50.692 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:27:50.728 INFO:tasks.workunit.client.0.smithi112.stderr:Note: switching to 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'. 2024-09-10T06:27:50.729 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-10T06:27:50.729 INFO:tasks.workunit.client.0.smithi112.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T06:27:50.729 INFO:tasks.workunit.client.0.smithi112.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T06:27:50.729 INFO:tasks.workunit.client.0.smithi112.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T06:27:50.729 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-10T06:27:50.729 INFO:tasks.workunit.client.0.smithi112.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T06:27:50.729 INFO:tasks.workunit.client.0.smithi112.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T06:27:50.729 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-10T06:27:50.729 INFO:tasks.workunit.client.0.smithi112.stderr: git switch -c 2024-09-10T06:27:50.729 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-10T06:27:50.729 INFO:tasks.workunit.client.0.smithi112.stderr:Or undo this operation with: 2024-09-10T06:27:50.729 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-10T06:27:50.730 INFO:tasks.workunit.client.0.smithi112.stderr: git switch - 2024-09-10T06:27:50.730 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-10T06:27:50.730 INFO:tasks.workunit.client.0.smithi112.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T06:27:50.730 INFO:tasks.workunit.client.0.smithi112.stderr: 2024-09-10T06:27:50.730 INFO:tasks.workunit.client.0.smithi112.stderr:HEAD is now at d011c522bb1 cls/rgw: duplicate reshard checks in all cls_rgw write operations 2024-09-10T06:27:50.735 DEBUG:teuthology.orchestra.run.smithi112:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T06:27:50.742 INFO:tasks.workunit.client.0.smithi112.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T06:27:50.745 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T06:27:50.746 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T06:27:50.746 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:50.744+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:50.847 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:50.845+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:50.860 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:50.860 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:50.860 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:50.874 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:27:50.948 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:50.944+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:51.048 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:51.048 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:51.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:51.048 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:51.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.048 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-10T06:27:51.048 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:51.048 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.754605955000002, 2024-09-10T06:27:51.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047108059999999997, 2024-09-10T06:27:51.048 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.049 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:51.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:51.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291391+0000", 2024-09-10T06:27:51.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8700000000000001e-06 2024-09-10T06:27:51.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291405+0000", 2024-09-10T06:27:51.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4623e-05 2024-09-10T06:27:51.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291438+0000", 2024-09-10T06:27:51.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2616000000000001e-05 2024-09-10T06:27:51.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291461+0000", 2024-09-10T06:27:51.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2883000000000001e-05 2024-09-10T06:27:51.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293024+0000", 2024-09-10T06:27:51.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015627709999999999 2024-09-10T06:27:51.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293071+0000", 2024-09-10T06:27:51.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7797000000000003e-05 2024-09-10T06:27:51.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295983+0000", 2024-09-10T06:27:51.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029113640000000001 2024-09-10T06:27:51.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296100+0000", 2024-09-10T06:27:51.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116882 2024-09-10T06:27:51.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.053 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.053 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.053 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:51.053 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.713248176999997, 2024-09-10T06:27:51.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00338296, 2024-09-10T06:27:51.054 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.054 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.054 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.054 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 211 2024-09-10T06:27:51.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.054 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:51.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:51.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332750+0000", 2024-09-10T06:27:51.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-10T06:27:51.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332767+0000", 2024-09-10T06:27:51.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.702e-05 2024-09-10T06:27:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332805+0000", 2024-09-10T06:27:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7950000000000001e-05 2024-09-10T06:27:51.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332824+0000", 2024-09-10T06:27:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8462999999999999e-05 2024-09-10T06:27:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332950+0000", 2024-09-10T06:27:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012653600000000001 2024-09-10T06:27:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333177+0000", 2024-09-10T06:27:51.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022626800000000001 2024-09-10T06:27:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333604+0000", 2024-09-10T06:27:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042759999999999999 2024-09-10T06:27:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335279+0000", 2024-09-10T06:27:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001674481 2024-09-10T06:27:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335976+0000", 2024-09-10T06:27:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069707099999999995 2024-09-10T06:27:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336063+0000", 2024-09-10T06:27:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6916000000000006e-05 2024-09-10T06:27:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336130+0000", 2024-09-10T06:27:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6971999999999995e-05 2024-09-10T06:27:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.060 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.639973302000001, 2024-09-10T06:27:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034123389999999999, 2024-09-10T06:27:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.061 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232 2024-09-10T06:27:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406025+0000", 2024-09-10T06:27:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-10T06:27:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406040+0000", 2024-09-10T06:27:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5299999999999999e-05 2024-09-10T06:27:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406072+0000", 2024-09-10T06:27:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2543000000000003e-05 2024-09-10T06:27:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406088+0000", 2024-09-10T06:27:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5699999999999999e-05 2024-09-10T06:27:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406206+0000", 2024-09-10T06:27:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011828900000000001 2024-09-10T06:27:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406416+0000", 2024-09-10T06:27:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020969900000000001 2024-09-10T06:27:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406804+0000", 2024-09-10T06:27:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038783699999999998 2024-09-10T06:27:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.408490+0000", 2024-09-10T06:27:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001686353 2024-09-10T06:27:51.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409152+0000", 2024-09-10T06:27:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066160800000000005 2024-09-10T06:27:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409314+0000", 2024-09-10T06:27:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000162285 2024-09-10T06:27:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409434+0000", 2024-09-10T06:27:51.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119639 2024-09-10T06:27:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.620043856999999, 2024-09-10T06:27:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034077650000000001, 2024-09-10T06:27:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241 2024-09-10T06:27:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:51.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425954+0000", 2024-09-10T06:27:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425965+0000", 2024-09-10T06:27:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.181e-05 2024-09-10T06:27:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425996+0000", 2024-09-10T06:27:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0759000000000001e-05 2024-09-10T06:27:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426011+0000", 2024-09-10T06:27:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4507e-05 2024-09-10T06:27:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426153+0000", 2024-09-10T06:27:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014206599999999999 2024-09-10T06:27:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426491+0000", 2024-09-10T06:27:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033830399999999999 2024-09-10T06:27:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426973+0000", 2024-09-10T06:27:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000482113 2024-09-10T06:27:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.428378+0000", 2024-09-10T06:27:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001404539 2024-09-10T06:27:51.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429113+0000", 2024-09-10T06:27:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073537799999999996 2024-09-10T06:27:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429251+0000", 2024-09-10T06:27:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013789600000000001 2024-09-10T06:27:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429359+0000", 2024-09-10T06:27:51.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107846 2024-09-10T06:27:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:266 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.615310832999995, 2024-09-10T06:27:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030966560000000001, 2024-09-10T06:27:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 266 2024-09-10T06:27:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430687+0000", 2024-09-10T06:27:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0299999999999998e-06 2024-09-10T06:27:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430702+0000", 2024-09-10T06:27:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5316999999999999e-05 2024-09-10T06:27:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430741+0000", 2024-09-10T06:27:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8336e-05 2024-09-10T06:27:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430762+0000", 2024-09-10T06:27:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.162e-05 2024-09-10T06:27:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430923+0000", 2024-09-10T06:27:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016044599999999999 2024-09-10T06:27:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431103+0000", 2024-09-10T06:27:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018030100000000001 2024-09-10T06:27:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431513+0000", 2024-09-10T06:27:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040992999999999997 2024-09-10T06:27:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432715+0000", 2024-09-10T06:27:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001202411 2024-09-10T06:27:51.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433624+0000", 2024-09-10T06:27:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090863000000000001 2024-09-10T06:27:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433718+0000", 2024-09-10T06:27:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3749e-05 2024-09-10T06:27:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433781+0000", 2024-09-10T06:27:51.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2885999999999994e-05 2024-09-10T06:27:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:273 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.613737232000005, 2024-09-10T06:27:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028009850000000002, 2024-09-10T06:27:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 273 2024-09-10T06:27:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432258+0000", 2024-09-10T06:27:51.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432260+0000", 2024-09-10T06:27:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1900000000000002e-06 2024-09-10T06:27:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432271+0000", 2024-09-10T06:27:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1353e-05 2024-09-10T06:27:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432296+0000", 2024-09-10T06:27:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4817e-05 2024-09-10T06:27:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432318+0000", 2024-09-10T06:27:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1963e-05 2024-09-10T06:27:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432465+0000", 2024-09-10T06:27:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014658299999999999 2024-09-10T06:27:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432801+0000", 2024-09-10T06:27:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033681299999999999 2024-09-10T06:27:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433188+0000", 2024-09-10T06:27:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000386857 2024-09-10T06:27:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434552+0000", 2024-09-10T06:27:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013634400000000001 2024-09-10T06:27:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434872+0000", 2024-09-10T06:27:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031998399999999999 2024-09-10T06:27:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.434973+0000", 2024-09-10T06:27:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100962 2024-09-10T06:27:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.435059+0000", 2024-09-10T06:27:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6023e-05 2024-09-10T06:27:51.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:299 6.14 e34/28 6:2c0c0c23:reshard::reshard.0000000001:head v 34'2, mlcod=0'0)", 2024-09-10T06:27:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.609121380999994, 2024-09-10T06:27:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029099109999999998, 2024-09-10T06:27:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436873+0000", 2024-09-10T06:27:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436875+0000", 2024-09-10T06:27:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0430000000000002e-06 2024-09-10T06:27:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436890+0000", 2024-09-10T06:27:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4766999999999999e-05 2024-09-10T06:27:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436918+0000", 2024-09-10T06:27:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.76e-05 2024-09-10T06:27:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.436937+0000", 2024-09-10T06:27:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9539999999999999e-05 2024-09-10T06:27:51.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437081+0000", 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144065 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.437130+0000", 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8609999999999997e-05 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439676+0000", 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002546137 2024-09-10T06:27:51.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.439783+0000", 2024-09-10T06:27:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107149 2024-09-10T06:27:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:341 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.600201686000005, 2024-09-10T06:27:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030260230000000001, 2024-09-10T06:27:51.089 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 341 2024-09-10T06:27:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445796+0000", 2024-09-10T06:27:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7130000000000001e-06 2024-09-10T06:27:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445810+0000", 2024-09-10T06:27:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4564e-05 2024-09-10T06:27:51.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445886+0000", 2024-09-10T06:27:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5921999999999996e-05 2024-09-10T06:27:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445902+0000", 2024-09-10T06:27:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5800000000000001e-05 2024-09-10T06:27:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446057+0000", 2024-09-10T06:27:51.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015475600000000001 2024-09-10T06:27:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446347+0000", 2024-09-10T06:27:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029057699999999998 2024-09-10T06:27:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446669+0000", 2024-09-10T06:27:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032102399999999999 2024-09-10T06:27:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.447891+0000", 2024-09-10T06:27:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012226680000000001 2024-09-10T06:27:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448550+0000", 2024-09-10T06:27:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065925800000000002 2024-09-10T06:27:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448699+0000", 2024-09-10T06:27:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014831800000000001 2024-09-10T06:27:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448819+0000", 2024-09-10T06:27:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120423 2024-09-10T06:27:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:505 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.518523156000001, 2024-09-10T06:27:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028092249999999998, 2024-09-10T06:27:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.095 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 505 2024-09-10T06:27:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527472+0000", 2024-09-10T06:27:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527474+0000", 2024-09-10T06:27:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.773e-06 2024-09-10T06:27:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527495+0000", 2024-09-10T06:27:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0910000000000001e-05 2024-09-10T06:27:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527549+0000", 2024-09-10T06:27:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3223000000000002e-05 2024-09-10T06:27:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527583+0000", 2024-09-10T06:27:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4773000000000001e-05 2024-09-10T06:27:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.527737+0000", 2024-09-10T06:27:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325199999999999 2024-09-10T06:27:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528092+0000", 2024-09-10T06:27:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000354951 2024-09-10T06:27:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.528657+0000", 2024-09-10T06:27:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00056537500000000001 2024-09-10T06:27:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.529771+0000", 2024-09-10T06:27:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011136519999999999 2024-09-10T06:27:51.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530072+0000", 2024-09-10T06:27:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030151700000000001 2024-09-10T06:27:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530213+0000", 2024-09-10T06:27:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014100500000000001 2024-09-10T06:27:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.530281+0000", 2024-09-10T06:27:51.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7793999999999995e-05 2024-09-10T06:27:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.514853879, 2024-09-10T06:27:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051813969999999999, 2024-09-10T06:27:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 513 2024-09-10T06:27:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531143+0000", 2024-09-10T06:27:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7400000000000001e-06 2024-09-10T06:27:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531153+0000", 2024-09-10T06:27:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.815e-06 2024-09-10T06:27:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531178+0000", 2024-09-10T06:27:51.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5755e-05 2024-09-10T06:27:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531190+0000", 2024-09-10T06:27:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1250000000000001e-05 2024-09-10T06:27:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531322+0000", 2024-09-10T06:27:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013239299999999999 2024-09-10T06:27:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531550+0000", 2024-09-10T06:27:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000227598 2024-09-10T06:27:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531966+0000", 2024-09-10T06:27:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041634400000000002 2024-09-10T06:27:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533197+0000", 2024-09-10T06:27:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012308810000000001 2024-09-10T06:27:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536097+0000", 2024-09-10T06:27:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029007159999999998 2024-09-10T06:27:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536245+0000", 2024-09-10T06:27:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000147816 2024-09-10T06:27:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536322+0000", 2024-09-10T06:27:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7088999999999993e-05 2024-09-10T06:27:51.106 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:514 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.514781682000006, 2024-09-10T06:27:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048258260000000001, 2024-09-10T06:27:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 514 2024-09-10T06:27:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531214+0000", 2024-09-10T06:27:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2699999999999998e-07 2024-09-10T06:27:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531219+0000", 2024-09-10T06:27:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-10T06:27:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531233+0000", 2024-09-10T06:27:51.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.38e-05 2024-09-10T06:27:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531240+0000", 2024-09-10T06:27:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7399999999999998e-06 2024-09-10T06:27:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531378+0000", 2024-09-10T06:27:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013860399999999999 2024-09-10T06:27:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531600+0000", 2024-09-10T06:27:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221287 2024-09-10T06:27:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532007+0000", 2024-09-10T06:27:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040728500000000001 2024-09-10T06:27:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533131+0000", 2024-09-10T06:27:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011240429999999999 2024-09-10T06:27:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535894+0000", 2024-09-10T06:27:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027628650000000002 2024-09-10T06:27:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535973+0000", 2024-09-10T06:27:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9399000000000003e-05 2024-09-10T06:27:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536039+0000", 2024-09-10T06:27:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5619999999999999e-05 2024-09-10T06:27:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:655 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.414839143999998, 2024-09-10T06:27:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003017207, 2024-09-10T06:27:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.113 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 655 2024-09-10T06:27:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631159+0000", 2024-09-10T06:27:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8270000000000002e-06 2024-09-10T06:27:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631173+0000", 2024-09-10T06:27:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4739999999999999e-05 2024-09-10T06:27:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631206+0000", 2024-09-10T06:27:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2425999999999998e-05 2024-09-10T06:27:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631221+0000", 2024-09-10T06:27:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4927e-05 2024-09-10T06:27:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631336+0000", 2024-09-10T06:27:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115062 2024-09-10T06:27:51.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631547+0000", 2024-09-10T06:27:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021178200000000001 2024-09-10T06:27:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.632034+0000", 2024-09-10T06:27:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000486899 2024-09-10T06:27:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633413+0000", 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001379077 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633891+0000", 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000477489 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634057+0000", 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016608500000000001 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634173+0000", 2024-09-10T06:27:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115893 2024-09-10T06:27:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:658 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.410824899999994, 2024-09-10T06:27:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030550820000000002, 2024-09-10T06:27:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 658 2024-09-10T06:27:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635171+0000", 2024-09-10T06:27:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.322e-06 2024-09-10T06:27:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635178+0000", 2024-09-10T06:27:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7950000000000002e-06 2024-09-10T06:27:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635197+0000", 2024-09-10T06:27:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8845e-05 2024-09-10T06:27:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635215+0000", 2024-09-10T06:27:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7822e-05 2024-09-10T06:27:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635329+0000", 2024-09-10T06:27:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011433 2024-09-10T06:27:51.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635554+0000", 2024-09-10T06:27:51.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022527800000000001 2024-09-10T06:27:51.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:51.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.636007+0000", 2024-09-10T06:27:51.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045297099999999998 2024-09-10T06:27:51.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637198+0000", 2024-09-10T06:27:51.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011902740000000001 2024-09-10T06:27:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637961+0000", 2024-09-10T06:27:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000763234 2024-09-10T06:27:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638110+0000", 2024-09-10T06:27:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149259 2024-09-10T06:27:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638225+0000", 2024-09-10T06:27:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011495200000000001 2024-09-10T06:27:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.314492958000002, 2024-09-10T06:27:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028070980000000001, 2024-09-10T06:27:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.125 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 724 2024-09-10T06:27:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731502+0000", 2024-09-10T06:27:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731504+0000", 2024-09-10T06:27:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731516+0000", 2024-09-10T06:27:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1885999999999999e-05 2024-09-10T06:27:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731547+0000", 2024-09-10T06:27:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0923000000000002e-05 2024-09-10T06:27:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731563+0000", 2024-09-10T06:27:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5342999999999999e-05 2024-09-10T06:27:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731704+0000", 2024-09-10T06:27:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014128599999999999 2024-09-10T06:27:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.731917+0000", 2024-09-10T06:27:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021280800000000001 2024-09-10T06:27:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.732227+0000", 2024-09-10T06:27:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031024500000000001 2024-09-10T06:27:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.733258+0000", 2024-09-10T06:27:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010306880000000001 2024-09-10T06:27:51.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734163+0000", 2024-09-10T06:27:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090502400000000004 2024-09-10T06:27:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734247+0000", 2024-09-10T06:27:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4363000000000005e-05 2024-09-10T06:27:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.734309+0000", 2024-09-10T06:27:51.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2005e-05 2024-09-10T06:27:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.307646824000003, 2024-09-10T06:27:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030399789999999999, 2024-09-10T06:27:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 727 2024-09-10T06:27:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738350+0000", 2024-09-10T06:27:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2199999999999999e-06 2024-09-10T06:27:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738360+0000", 2024-09-10T06:27:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0122999999999999e-05 2024-09-10T06:27:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738384+0000", 2024-09-10T06:27:51.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3390000000000001e-05 2024-09-10T06:27:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738397+0000", 2024-09-10T06:27:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2896e-05 2024-09-10T06:27:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738524+0000", 2024-09-10T06:27:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126883 2024-09-10T06:27:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738752+0000", 2024-09-10T06:27:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022864200000000001 2024-09-10T06:27:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.739080+0000", 2024-09-10T06:27:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032783699999999999 2024-09-10T06:27:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.740085+0000", 2024-09-10T06:27:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001005438 2024-09-10T06:27:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741203+0000", 2024-09-10T06:27:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011175919999999999 2024-09-10T06:27:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741280+0000", 2024-09-10T06:27:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6545999999999995e-05 2024-09-10T06:27:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741388+0000", 2024-09-10T06:27:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108412 2024-09-10T06:27:51.136 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.115624319000005, 2024-09-10T06:27:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028715709999999998, 2024-09-10T06:27:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 814 2024-09-10T06:27:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930371+0000", 2024-09-10T06:27:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930373+0000", 2024-09-10T06:27:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-10T06:27:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930384+0000", 2024-09-10T06:27:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1357e-05 2024-09-10T06:27:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930417+0000", 2024-09-10T06:27:51.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2289000000000002e-05 2024-09-10T06:27:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930438+0000", 2024-09-10T06:27:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1399999999999998e-05 2024-09-10T06:27:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930626+0000", 2024-09-10T06:27:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018812899999999999 2024-09-10T06:27:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.930843+0000", 2024-09-10T06:27:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021719400000000001 2024-09-10T06:27:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.931152+0000", 2024-09-10T06:27:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030821199999999998 2024-09-10T06:27:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.932258+0000", 2024-09-10T06:27:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001106304 2024-09-10T06:27:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933092+0000", 2024-09-10T06:27:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00083364699999999997 2024-09-10T06:27:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933179+0000", 2024-09-10T06:27:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7383e-05 2024-09-10T06:27:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.933242+0000", 2024-09-10T06:27:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3072999999999997e-05 2024-09-10T06:27:51.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 68.968072837999998, 2024-09-10T06:27:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029601670000000001, 2024-09-10T06:27:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 880 2024-09-10T06:27:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077922+0000", 2024-09-10T06:27:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077925+0000", 2024-09-10T06:27:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-10T06:27:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077938+0000", 2024-09-10T06:27:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2836999999999999e-05 2024-09-10T06:27:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077970+0000", 2024-09-10T06:27:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1542999999999999e-05 2024-09-10T06:27:51.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.077984+0000", 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4963999999999999e-05 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078118+0000", 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134015 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078344+0000", 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225038 2024-09-10T06:27:51.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:51.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.078696+0000", 2024-09-10T06:27:51.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035250100000000002 2024-09-10T06:27:51.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.079793+0000", 2024-09-10T06:27:51.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010967049999999999 2024-09-10T06:27:51.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080714+0000", 2024-09-10T06:27:51.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00092153600000000003 2024-09-10T06:27:51.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080802+0000", 2024-09-10T06:27:51.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7446000000000003e-05 2024-09-10T06:27:51.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.080882+0000", 2024-09-10T06:27:51.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0445999999999995e-05 2024-09-10T06:27:51.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.148 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.149 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.149 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:51.149 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 68.893452611000001, 2024-09-10T06:27:51.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002919091, 2024-09-10T06:27:51.149 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.149 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.149 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.149 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 913 2024-09-10T06:27:51.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.150 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:51.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152542+0000", 2024-09-10T06:27:51.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152545+0000", 2024-09-10T06:27:51.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6529999999999998e-06 2024-09-10T06:27:51.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152557+0000", 2024-09-10T06:27:51.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1919999999999999e-05 2024-09-10T06:27:51.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152587+0000", 2024-09-10T06:27:51.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0097e-05 2024-09-10T06:27:51.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152601+0000", 2024-09-10T06:27:51.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4579999999999999e-05 2024-09-10T06:27:51.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.152732+0000", 2024-09-10T06:27:51.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013085500000000001 2024-09-10T06:27:51.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153007+0000", 2024-09-10T06:27:51.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027469499999999998 2024-09-10T06:27:51.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:51.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.153344+0000", 2024-09-10T06:27:51.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033742400000000001 2024-09-10T06:27:51.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.154351+0000", 2024-09-10T06:27:51.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010067590000000001 2024-09-10T06:27:51.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155301+0000", 2024-09-10T06:27:51.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095000900000000003 2024-09-10T06:27:51.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155387+0000", 2024-09-10T06:27:51.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6136000000000003e-05 2024-09-10T06:27:51.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.155461+0000", 2024-09-10T06:27:51.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3962999999999996e-05 2024-09-10T06:27:51.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.154 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.155 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:927 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.155 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:51.155 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 68.861805928999999, 2024-09-10T06:27:51.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029321239999999999, 2024-09-10T06:27:51.155 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.155 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.155 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.155 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 927 2024-09-10T06:27:51.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.156 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:51.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184189+0000", 2024-09-10T06:27:51.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184191+0000", 2024-09-10T06:27:51.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.764e-06 2024-09-10T06:27:51.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184199+0000", 2024-09-10T06:27:51.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4630000000000001e-06 2024-09-10T06:27:51.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184221+0000", 2024-09-10T06:27:51.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1603e-05 2024-09-10T06:27:51.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184233+0000", 2024-09-10T06:27:51.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.189e-05 2024-09-10T06:27:51.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184382+0000", 2024-09-10T06:27:51.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014939900000000001 2024-09-10T06:27:51.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184495+0000", 2024-09-10T06:27:51.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113459 2024-09-10T06:27:51.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:51.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.184735+0000", 2024-09-10T06:27:51.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000239554 2024-09-10T06:27:51.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186036+0000", 2024-09-10T06:27:51.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00130072 2024-09-10T06:27:51.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.186929+0000", 2024-09-10T06:27:51.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000893694 2024-09-10T06:27:51.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187014+0000", 2024-09-10T06:27:51.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4222999999999996e-05 2024-09-10T06:27:51.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187121+0000", 2024-09-10T06:27:51.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107355 2024-09-10T06:27:51.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.160 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.161 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.161 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:51.161 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 68.858545063999998, 2024-09-10T06:27:51.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028243320000000001, 2024-09-10T06:27:51.161 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.161 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.161 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 928 2024-09-10T06:27:51.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.161 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:51.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187450+0000", 2024-09-10T06:27:51.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187452+0000", 2024-09-10T06:27:51.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5069999999999999e-06 2024-09-10T06:27:51.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187464+0000", 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1243000000000001e-05 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187495+0000", 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1136000000000001e-05 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187511+0000", 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6710000000000001e-05 2024-09-10T06:27:51.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187648+0000", 2024-09-10T06:27:51.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013657599999999999 2024-09-10T06:27:51.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.187866+0000", 2024-09-10T06:27:51.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021853500000000001 2024-09-10T06:27:51.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:51.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.188168+0000", 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030161100000000002 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.189334+0000", 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001166048 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190086+0000", 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075159399999999996 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190165+0000", 2024-09-10T06:27:51.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8953000000000001e-05 2024-09-10T06:27:51.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.190274+0000", 2024-09-10T06:27:51.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109419 2024-09-10T06:27:51.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.166 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.166 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.166 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:51.168 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:27:51.168 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:51.164+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:51.269 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:51.264+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:51.297 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:51.297 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:51.297 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:51.311 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:27:51.370 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:51.369+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:51.429 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:51.429 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:51.429 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:51.443 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:27:51.484 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:51.485+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:51.573 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:51.568+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:51.581 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T06:27:51.594 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:27:51.605 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:51.605 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:51.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:51.605 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:51.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.606 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4236.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-10T06:27:51.606 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:23.499464+0000", 2024-09-10T06:27:51.606 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 88.104392543000003, 2024-09-10T06:27:51.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013449099000000001, 2024-09-10T06:27:51.606 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.606 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.606 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.606 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.606 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4236", 2024-09-10T06:27:51.606 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1622831300", 2024-09-10T06:27:51.606 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1 2024-09-10T06:27:51.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.607 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499464+0000", 2024-09-10T06:27:51.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499464+0000", 2024-09-10T06:27:51.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499474+0000", 2024-09-10T06:27:51.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.004e-05 2024-09-10T06:27:51.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499488+0000", 2024-09-10T06:27:51.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3516000000000001e-05 2024-09-10T06:27:51.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499514+0000", 2024-09-10T06:27:51.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6310000000000001e-05 2024-09-10T06:27:51.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499538+0000", 2024-09-10T06:27:51.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3589000000000001e-05 2024-09-10T06:27:51.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.500297+0000", 2024-09-10T06:27:51.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000759908 2024-09-10T06:27:51.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:27:51.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.500351+0000", 2024-09-10T06:27:51.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3285999999999998e-05 2024-09-10T06:27:51.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.506506+0000", 2024-09-10T06:27:51.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061553090000000003 2024-09-10T06:27:51.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.506862+0000", 2024-09-10T06:27:51.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035549099999999999 2024-09-10T06:27:51.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:51.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.507143+0000", 2024-09-10T06:27:51.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000281964 2024-09-10T06:27:51.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.509394+0000", 2024-09-10T06:27:51.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022506700000000002 2024-09-10T06:27:51.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.512769+0000", 2024-09-10T06:27:51.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033745899999999998 2024-09-10T06:27:51.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.512850+0000", 2024-09-10T06:27:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1446000000000006e-05 2024-09-10T06:27:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.512913+0000", 2024-09-10T06:27:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2979999999999997e-05 2024-09-10T06:27:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4236.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-10T06:27:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:24.509270+0000", 2024-09-10T06:27:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.094586741000001, 2024-09-10T06:27:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068216769999999999, 2024-09-10T06:27:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4236", 2024-09-10T06:27:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1622831300", 2024-09-10T06:27:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5 2024-09-10T06:27:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509270+0000", 2024-09-10T06:27:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509270+0000", 2024-09-10T06:27:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509273+0000", 2024-09-10T06:27:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4199999999999999e-06 2024-09-10T06:27:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509288+0000", 2024-09-10T06:27:51.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4732999999999999e-05 2024-09-10T06:27:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509322+0000", 2024-09-10T06:27:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3596000000000002e-05 2024-09-10T06:27:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509345+0000", 2024-09-10T06:27:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3767000000000001e-05 2024-09-10T06:27:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509475+0000", 2024-09-10T06:27:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130099 2024-09-10T06:27:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:27:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509486+0000", 2024-09-10T06:27:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.083e-05 2024-09-10T06:27:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.512854+0000", 2024-09-10T06:27:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00336748 2024-09-10T06:27:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.513079+0000", 2024-09-10T06:27:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225565 2024-09-10T06:27:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.513291+0000", 2024-09-10T06:27:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021120199999999999 2024-09-10T06:27:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.514873+0000", 2024-09-10T06:27:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001582841 2024-09-10T06:27:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.515896+0000", 2024-09-10T06:27:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010226619999999999 2024-09-10T06:27:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.515976+0000", 2024-09-10T06:27:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0055999999999994e-05 2024-09-10T06:27:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.516092+0000", 2024-09-10T06:27:51.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115426 2024-09-10T06:27:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4236.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T06:27:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:25.528375+0000", 2024-09-10T06:27:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 86.075481225000004, 2024-09-10T06:27:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070604630000000003, 2024-09-10T06:27:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.620 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4236", 2024-09-10T06:27:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1622831300", 2024-09-10T06:27:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7 2024-09-10T06:27:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528375+0000", 2024-09-10T06:27:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528375+0000", 2024-09-10T06:27:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528379+0000", 2024-09-10T06:27:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.19e-06 2024-09-10T06:27:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528393+0000", 2024-09-10T06:27:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4474000000000001e-05 2024-09-10T06:27:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528429+0000", 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6273000000000003e-05 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528448+0000", 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.827e-05 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528578+0000", 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013027899999999999 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:27:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528588+0000", 2024-09-10T06:27:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.042e-05 2024-09-10T06:27:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.532249+0000", 2024-09-10T06:27:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003660955 2024-09-10T06:27:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.532448+0000", 2024-09-10T06:27:51.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019897799999999999 2024-09-10T06:27:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.532832+0000", 2024-09-10T06:27:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038408399999999998 2024-09-10T06:27:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.534422+0000", 2024-09-10T06:27:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001589708 2024-09-10T06:27:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.535279+0000", 2024-09-10T06:27:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00085695599999999997 2024-09-10T06:27:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.535365+0000", 2024-09-10T06:27:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6348999999999996e-05 2024-09-10T06:27:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.535436+0000", 2024-09-10T06:27:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0526999999999997e-05 2024-09-10T06:27:51.626 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4349.0:41 5.f 5:f4c53578:::zonegroups_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:34.327633+0000", 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 77.276223731000002, 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031482849999999998, 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4349", 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:51.627 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 41 2024-09-10T06:27:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327633+0000", 2024-09-10T06:27:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327633+0000", 2024-09-10T06:27:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327635+0000", 2024-09-10T06:27:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4559999999999999e-06 2024-09-10T06:27:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327649+0000", 2024-09-10T06:27:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3380000000000001e-05 2024-09-10T06:27:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327680+0000", 2024-09-10T06:27:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1253e-05 2024-09-10T06:27:51.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327696+0000", 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5736999999999999e-05 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.327890+0000", 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000194468 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.328116+0000", 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225746 2024-09-10T06:27:51.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.328401+0000", 2024-09-10T06:27:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028469699999999999 2024-09-10T06:27:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.329688+0000", 2024-09-10T06:27:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001287327 2024-09-10T06:27:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.330628+0000", 2024-09-10T06:27:51.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094027599999999998 2024-09-10T06:27:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.330718+0000", 2024-09-10T06:27:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9676e-05 2024-09-10T06:27:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.330781+0000", 2024-09-10T06:27:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3268999999999993e-05 2024-09-10T06:27:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.632 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.297889+0000", 2024-09-10T06:27:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.305968023999995, 2024-09-10T06:27:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015273603, 2024-09-10T06:27:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48 2024-09-10T06:27:51.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.634 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297889+0000", 2024-09-10T06:27:51.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297889+0000", 2024-09-10T06:27:51.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297892+0000", 2024-09-10T06:27:51.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.703e-06 2024-09-10T06:27:51.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297905+0000", 2024-09-10T06:27:51.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2874000000000001e-05 2024-09-10T06:27:51.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297930+0000", 2024-09-10T06:27:51.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5029999999999999e-05 2024-09-10T06:27:51.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297946+0000", 2024-09-10T06:27:51.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5336e-05 2024-09-10T06:27:51.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298133+0000", 2024-09-10T06:27:51.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187725 2024-09-10T06:27:51.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:27:51.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298154+0000", 2024-09-10T06:27:51.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0953000000000001e-05 2024-09-10T06:27:51.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.310851+0000", 2024-09-10T06:27:51.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012696522999999999 2024-09-10T06:27:51.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.311061+0000", 2024-09-10T06:27:51.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021023799999999999 2024-09-10T06:27:51.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:51.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.311247+0000", 2024-09-10T06:27:51.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018557900000000001 2024-09-10T06:27:51.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.312771+0000", 2024-09-10T06:27:51.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015244119999999999 2024-09-10T06:27:51.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.312957+0000", 2024-09-10T06:27:51.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000185885 2024-09-10T06:27:51.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313037+0000", 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9802999999999995e-05 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313162+0000", 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000125542 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94143734762752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:51.639 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.313369+0000", 2024-09-10T06:27:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.290487106, 2024-09-10T06:27:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034352330000000002, 2024-09-10T06:27:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49 2024-09-10T06:27:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313369+0000", 2024-09-10T06:27:51.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313369+0000", 2024-09-10T06:27:51.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313372+0000", 2024-09-10T06:27:51.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4830000000000002e-06 2024-09-10T06:27:51.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313384+0000", 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2150000000000001e-05 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313410+0000", 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6356999999999999e-05 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313425+0000", 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.437e-05 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313540+0000", 2024-09-10T06:27:51.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115555 2024-09-10T06:27:51.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313739+0000", 2024-09-10T06:27:51.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019832199999999999 2024-09-10T06:27:51.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:51.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.314101+0000", 2024-09-10T06:27:51.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036192499999999997 2024-09-10T06:27:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.315569+0000", 2024-09-10T06:27:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014680089999999999 2024-09-10T06:27:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.316489+0000", 2024-09-10T06:27:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00092051299999999997 2024-09-10T06:27:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.316623+0000", 2024-09-10T06:27:51.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013342399999999999 2024-09-10T06:27:51.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.316805+0000", 2024-09-10T06:27:51.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182125 2024-09-10T06:27:51.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.645 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.645 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:51.645 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.297211+0000", 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.306645274000005, 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041349439999999998, 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297211+0000", 2024-09-10T06:27:51.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297211+0000", 2024-09-10T06:27:51.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297215+0000", 2024-09-10T06:27:51.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1930000000000002e-06 2024-09-10T06:27:51.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297229+0000", 2024-09-10T06:27:51.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.472e-05 2024-09-10T06:27:51.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297265+0000", 2024-09-10T06:27:51.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5407000000000002e-05 2024-09-10T06:27:51.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297290+0000", 2024-09-10T06:27:51.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5153000000000001e-05 2024-09-10T06:27:51.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297482+0000", 2024-09-10T06:27:51.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019209199999999999 2024-09-10T06:27:51.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297721+0000", 2024-09-10T06:27:51.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023919499999999999 2024-09-10T06:27:51.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:51.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.298183+0000", 2024-09-10T06:27:51.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046180899999999998 2024-09-10T06:27:51.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.299918+0000", 2024-09-10T06:27:51.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001734827 2024-09-10T06:27:51.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.301183+0000", 2024-09-10T06:27:51.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001265347 2024-09-10T06:27:51.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.301273+0000", 2024-09-10T06:27:51.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0031999999999995e-05 2024-09-10T06:27:51.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.301346+0000", 2024-09-10T06:27:51.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3169000000000004e-05 2024-09-10T06:27:51.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.653 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.653 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.653 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.364287+0000", 2024-09-10T06:27:51.653 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.239569794999994, 2024-09-10T06:27:51.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003215922, 2024-09-10T06:27:51.653 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.653 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.653 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 220 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364287+0000", 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364287+0000", 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364290+0000", 2024-09-10T06:27:51.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3340000000000002e-06 2024-09-10T06:27:51.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364305+0000", 2024-09-10T06:27:51.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4790000000000001e-05 2024-09-10T06:27:51.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364337+0000", 2024-09-10T06:27:51.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2425999999999998e-05 2024-09-10T06:27:51.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364353+0000", 2024-09-10T06:27:51.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5213e-05 2024-09-10T06:27:51.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364463+0000", 2024-09-10T06:27:51.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110126 2024-09-10T06:27:51.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.364668+0000", 2024-09-10T06:27:51.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020534199999999999 2024-09-10T06:27:51.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:51.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.365077+0000", 2024-09-10T06:27:51.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040907999999999998 2024-09-10T06:27:51.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.366652+0000", 2024-09-10T06:27:51.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015746239999999999 2024-09-10T06:27:51.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.367350+0000", 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069806100000000004 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.367434+0000", 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3819999999999994e-05 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.367503+0000", 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9105999999999999e-05 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.659 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.659 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.374400+0000", 2024-09-10T06:27:51.659 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.229456673000001, 2024-09-10T06:27:51.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033158279999999998, 2024-09-10T06:27:51.659 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.659 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.659 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.659 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223 2024-09-10T06:27:51.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.660 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374400+0000", 2024-09-10T06:27:51.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374400+0000", 2024-09-10T06:27:51.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374402+0000", 2024-09-10T06:27:51.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4030000000000001e-06 2024-09-10T06:27:51.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374414+0000", 2024-09-10T06:27:51.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1260000000000001e-05 2024-09-10T06:27:51.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374447+0000", 2024-09-10T06:27:51.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3149999999999999e-05 2024-09-10T06:27:51.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374462+0000", 2024-09-10T06:27:51.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5495999999999999e-05 2024-09-10T06:27:51.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374582+0000", 2024-09-10T06:27:51.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119999 2024-09-10T06:27:51.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.374775+0000", 2024-09-10T06:27:51.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192556 2024-09-10T06:27:51.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:51.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.375157+0000", 2024-09-10T06:27:51.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038242700000000002 2024-09-10T06:27:51.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.376482+0000", 2024-09-10T06:27:51.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013249329999999999 2024-09-10T06:27:51.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.377533+0000", 2024-09-10T06:27:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010505759999999999 2024-09-10T06:27:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.377610+0000", 2024-09-10T06:27:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7179000000000001e-05 2024-09-10T06:27:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.377716+0000", 2024-09-10T06:27:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105849 2024-09-10T06:27:51.664 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.665 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.665 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.665 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.665 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.385071+0000", 2024-09-10T06:27:51.665 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.218785632000007, 2024-09-10T06:27:51.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034290969999999999, 2024-09-10T06:27:51.665 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.665 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.665 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.666 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.666 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 226 2024-09-10T06:27:51.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.666 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385071+0000", 2024-09-10T06:27:51.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385071+0000", 2024-09-10T06:27:51.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385073+0000", 2024-09-10T06:27:51.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4329999999999998e-06 2024-09-10T06:27:51.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385085+0000", 2024-09-10T06:27:51.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1372999999999999e-05 2024-09-10T06:27:51.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385117+0000", 2024-09-10T06:27:51.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1874e-05 2024-09-10T06:27:51.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385135+0000", 2024-09-10T06:27:51.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8419000000000001e-05 2024-09-10T06:27:51.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385263+0000", 2024-09-10T06:27:51.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012800600000000001 2024-09-10T06:27:51.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385459+0000", 2024-09-10T06:27:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000196128 2024-09-10T06:27:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.385870+0000", 2024-09-10T06:27:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000410417 2024-09-10T06:27:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.387503+0000", 2024-09-10T06:27:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001633671 2024-09-10T06:27:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.388349+0000", 2024-09-10T06:27:51.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00084602400000000002 2024-09-10T06:27:51.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.388436+0000", 2024-09-10T06:27:51.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6706000000000006e-05 2024-09-10T06:27:51.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.388500+0000", 2024-09-10T06:27:51.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4046000000000003e-05 2024-09-10T06:27:51.670 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.670 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.413140+0000", 2024-09-10T06:27:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.190716648999995, 2024-09-10T06:27:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003240962, 2024-09-10T06:27:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.671 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234 2024-09-10T06:27:51.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.672 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413140+0000", 2024-09-10T06:27:51.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413140+0000", 2024-09-10T06:27:51.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413142+0000", 2024-09-10T06:27:51.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3999999999999999e-06 2024-09-10T06:27:51.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413153+0000", 2024-09-10T06:27:51.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.076e-05 2024-09-10T06:27:51.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413180+0000", 2024-09-10T06:27:51.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6746000000000001e-05 2024-09-10T06:27:51.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413195+0000", 2024-09-10T06:27:51.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4674e-05 2024-09-10T06:27:51.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413367+0000", 2024-09-10T06:27:51.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017253200000000001 2024-09-10T06:27:51.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.413594+0000", 2024-09-10T06:27:51.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022710499999999999 2024-09-10T06:27:51.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:51.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.414064+0000", 2024-09-10T06:27:51.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046966599999999999 2024-09-10T06:27:51.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.415286+0000", 2024-09-10T06:27:51.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001222281 2024-09-10T06:27:51.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.416233+0000", 2024-09-10T06:27:51.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094718600000000003 2024-09-10T06:27:51.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.416320+0000", 2024-09-10T06:27:51.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6521999999999996e-05 2024-09-10T06:27:51.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.416381+0000", 2024-09-10T06:27:51.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.109e-05 2024-09-10T06:27:51.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.676 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.677 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:353 6.4 e34/28 6:25ca39bb:::obj_delete_at_hint.0000000005:head v 34'6, mlcod=34'4)", 2024-09-10T06:27:51.677 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.451186+0000", 2024-09-10T06:27:51.677 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.152670936000007, 2024-09-10T06:27:51.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050475579999999997, 2024-09-10T06:27:51.677 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.677 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.677 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.677 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451186+0000", 2024-09-10T06:27:51.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451186+0000", 2024-09-10T06:27:51.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451191+0000", 2024-09-10T06:27:51.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.677e-06 2024-09-10T06:27:51.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451202+0000", 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0777e-05 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451225+0000", 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3329999999999999e-05 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451237+0000", 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1226000000000001e-05 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451356+0000", 2024-09-10T06:27:51.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118989 2024-09-10T06:27:51.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451405+0000", 2024-09-10T06:27:51.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9395999999999999e-05 2024-09-10T06:27:51.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.456155+0000", 2024-09-10T06:27:51.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047504239999999996 2024-09-10T06:27:51.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.456233+0000", 2024-09-10T06:27:51.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7738999999999995e-05 2024-09-10T06:27:51.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.681 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.681 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:362 6.4 e34/28 6:25ca39bb:::obj_delete_at_hint.0000000005:head v 34'7, mlcod=34'5)", 2024-09-10T06:27:51.681 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.457483+0000", 2024-09-10T06:27:51.681 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.146373177000001, 2024-09-10T06:27:51.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036278249999999999, 2024-09-10T06:27:51.681 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457483+0000", 2024-09-10T06:27:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457483+0000", 2024-09-10T06:27:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457485+0000", 2024-09-10T06:27:51.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.573e-06 2024-09-10T06:27:51.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457496+0000", 2024-09-10T06:27:51.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1066999999999999e-05 2024-09-10T06:27:51.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457520+0000", 2024-09-10T06:27:51.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4108999999999999e-05 2024-09-10T06:27:51.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457533+0000", 2024-09-10T06:27:51.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.288e-05 2024-09-10T06:27:51.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457637+0000", 2024-09-10T06:27:51.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103836 2024-09-10T06:27:51.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.457668+0000", 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1507000000000002e-05 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461014+0000", 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033451069999999999 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.461111+0000", 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7745999999999996e-05 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.686 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:441 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.686 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.481408+0000", 2024-09-10T06:27:51.686 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.122449046, 2024-09-10T06:27:51.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076439680000000001, 2024-09-10T06:27:51.686 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.686 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.686 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.686 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 441 2024-09-10T06:27:51.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.687 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481408+0000", 2024-09-10T06:27:51.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481408+0000", 2024-09-10T06:27:51.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481410+0000", 2024-09-10T06:27:51.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6539999999999999e-06 2024-09-10T06:27:51.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481428+0000", 2024-09-10T06:27:51.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7336000000000001e-05 2024-09-10T06:27:51.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481468+0000", 2024-09-10T06:27:51.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0062999999999999e-05 2024-09-10T06:27:51.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481494+0000", 2024-09-10T06:27:51.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6616999999999999e-05 2024-09-10T06:27:51.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481625+0000", 2024-09-10T06:27:51.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013042800000000001 2024-09-10T06:27:51.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481867+0000", 2024-09-10T06:27:51.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024220399999999999 2024-09-10T06:27:51.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.482325+0000", 2024-09-10T06:27:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045814199999999998 2024-09-10T06:27:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483548+0000", 2024-09-10T06:27:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012227900000000001 2024-09-10T06:27:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488857+0000", 2024-09-10T06:27:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053088120000000004 2024-09-10T06:27:51.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488959+0000", 2024-09-10T06:27:51.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102787 2024-09-10T06:27:51.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489052+0000", 2024-09-10T06:27:51.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2134999999999998e-05 2024-09-10T06:27:51.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.691 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.692 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:444 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.692 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.483111+0000", 2024-09-10T06:27:51.692 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.120745858999996, 2024-09-10T06:27:51.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055206379999999996, 2024-09-10T06:27:51.692 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.692 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.692 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.692 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 444 2024-09-10T06:27:51.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.692 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483111+0000", 2024-09-10T06:27:51.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483111+0000", 2024-09-10T06:27:51.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483114+0000", 2024-09-10T06:27:51.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1300000000000001e-06 2024-09-10T06:27:51.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483128+0000", 2024-09-10T06:27:51.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4032999999999999e-05 2024-09-10T06:27:51.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483161+0000", 2024-09-10T06:27:51.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3062999999999998e-05 2024-09-10T06:27:51.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483181+0000", 2024-09-10T06:27:51.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0486999999999999e-05 2024-09-10T06:27:51.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483316+0000", 2024-09-10T06:27:51.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013411099999999999 2024-09-10T06:27:51.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483642+0000", 2024-09-10T06:27:51.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032656299999999998 2024-09-10T06:27:51.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:51.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484153+0000", 2024-09-10T06:27:51.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00051090200000000004 2024-09-10T06:27:51.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.485759+0000", 2024-09-10T06:27:51.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001606215 2024-09-10T06:27:51.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488482+0000", 2024-09-10T06:27:51.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027225079999999998 2024-09-10T06:27:51.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488569+0000", 2024-09-10T06:27:51.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7602999999999995e-05 2024-09-10T06:27:51.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488631+0000", 2024-09-10T06:27:51.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2022999999999999e-05 2024-09-10T06:27:51.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.697 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.698 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:453 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.698 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.489376+0000", 2024-09-10T06:27:51.698 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.114480706999998, 2024-09-10T06:27:51.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052737419999999997, 2024-09-10T06:27:51.698 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.698 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.698 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.698 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 453 2024-09-10T06:27:51.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.698 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489376+0000", 2024-09-10T06:27:51.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489376+0000", 2024-09-10T06:27:51.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489378+0000", 2024-09-10T06:27:51.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9470000000000002e-06 2024-09-10T06:27:51.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489385+0000", 2024-09-10T06:27:51.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5830000000000001e-06 2024-09-10T06:27:51.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489408+0000", 2024-09-10T06:27:51.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2739999999999999e-05 2024-09-10T06:27:51.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489418+0000", 2024-09-10T06:27:51.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8730000000000002e-06 2024-09-10T06:27:51.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.490351+0000", 2024-09-10T06:27:51.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093270600000000005 2024-09-10T06:27:51.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.490602+0000", 2024-09-10T06:27:51.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025102499999999999 2024-09-10T06:27:51.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:51.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.490955+0000", 2024-09-10T06:27:51.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035311000000000001 2024-09-10T06:27:51.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494256+0000", 2024-09-10T06:27:51.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003301109 2024-09-10T06:27:51.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494417+0000", 2024-09-10T06:27:51.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016123799999999999 2024-09-10T06:27:51.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494571+0000", 2024-09-10T06:27:51.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000153425 2024-09-10T06:27:51.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494650+0000", 2024-09-10T06:27:51.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8986000000000006e-05 2024-09-10T06:27:51.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.703 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.704 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:457 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.704 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.492971+0000", 2024-09-10T06:27:51.704 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.110885644999996, 2024-09-10T06:27:51.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038003139999999999, 2024-09-10T06:27:51.704 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.704 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.704 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.704 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 457 2024-09-10T06:27:51.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.705 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492971+0000", 2024-09-10T06:27:51.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492971+0000", 2024-09-10T06:27:51.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492973+0000", 2024-09-10T06:27:51.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0499999999999999e-06 2024-09-10T06:27:51.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492981+0000", 2024-09-10T06:27:51.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1200000000000002e-06 2024-09-10T06:27:51.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493005+0000", 2024-09-10T06:27:51.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4125999999999999e-05 2024-09-10T06:27:51.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493017+0000", 2024-09-10T06:27:51.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.148e-05 2024-09-10T06:27:51.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493092+0000", 2024-09-10T06:27:51.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5112999999999997e-05 2024-09-10T06:27:51.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493294+0000", 2024-09-10T06:27:51.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020212100000000001 2024-09-10T06:27:51.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:51.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493743+0000", 2024-09-10T06:27:51.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000449436 2024-09-10T06:27:51.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494855+0000", 2024-09-10T06:27:51.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00111181 2024-09-10T06:27:51.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.496621+0000", 2024-09-10T06:27:51.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017657090000000001 2024-09-10T06:27:51.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.496701+0000", 2024-09-10T06:27:51.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0259000000000005e-05 2024-09-10T06:27:51.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.496771+0000", 2024-09-10T06:27:51.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0090000000000001e-05 2024-09-10T06:27:51.709 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.709 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.709 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.710 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:477 6.4 e34/28 6:264a8785:::obj_delete_at_hint.0000000011:head v 34'11, mlcod=34'9)", 2024-09-10T06:27:51.710 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.505151+0000", 2024-09-10T06:27:51.710 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.098705237999994, 2024-09-10T06:27:51.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033063839999999999, 2024-09-10T06:27:51.710 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.710 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.710 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.710 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505151+0000", 2024-09-10T06:27:51.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505151+0000", 2024-09-10T06:27:51.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505153+0000", 2024-09-10T06:27:51.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.697e-06 2024-09-10T06:27:51.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505164+0000", 2024-09-10T06:27:51.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1369000000000001e-05 2024-09-10T06:27:51.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505185+0000", 2024-09-10T06:27:51.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0387999999999999e-05 2024-09-10T06:27:51.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505195+0000", 2024-09-10T06:27:51.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166000000000001e-05 2024-09-10T06:27:51.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505281+0000", 2024-09-10T06:27:51.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5605000000000005e-05 2024-09-10T06:27:51.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.505314+0000", 2024-09-10T06:27:51.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3433000000000003e-05 2024-09-10T06:27:51.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.508336+0000", 2024-09-10T06:27:51.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003022313 2024-09-10T06:27:51.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.508458+0000", 2024-09-10T06:27:51.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121413 2024-09-10T06:27:51.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.714 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.715 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:513 6.1a e34/28 6:5c7e8a6d:reshard::reshard.0000000015:head v 34'2, mlcod=0'0)", 2024-09-10T06:27:51.715 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.532129+0000", 2024-09-10T06:27:51.715 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.071727197000001, 2024-09-10T06:27:51.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036491039999999998, 2024-09-10T06:27:51.715 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.715 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.715 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.715 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532129+0000", 2024-09-10T06:27:51.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532129+0000", 2024-09-10T06:27:51.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532132+0000", 2024-09-10T06:27:51.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2800000000000002e-06 2024-09-10T06:27:51.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532146+0000", 2024-09-10T06:27:51.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.452e-05 2024-09-10T06:27:51.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532190+0000", 2024-09-10T06:27:51.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3485999999999997e-05 2024-09-10T06:27:51.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532208+0000", 2024-09-10T06:27:51.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8450000000000001e-05 2024-09-10T06:27:51.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532338+0000", 2024-09-10T06:27:51.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129727 2024-09-10T06:27:51.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532382+0000", 2024-09-10T06:27:51.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4598999999999998e-05 2024-09-10T06:27:51.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535696+0000", 2024-09-10T06:27:51.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033139369999999999 2024-09-10T06:27:51.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535779+0000", 2024-09-10T06:27:51.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2105000000000001e-05 2024-09-10T06:27:51.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.719 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.719 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:51.719 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.243071+0000", 2024-09-10T06:27:51.719 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.360785653999997, 2024-09-10T06:27:51.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033924269999999999, 2024-09-10T06:27:51.720 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:51.720 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:51.720 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:51.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:51.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:51.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:51.720 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 952 2024-09-10T06:27:51.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.720 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:51.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:51.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243071+0000", 2024-09-10T06:27:51.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:51.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243071+0000", 2024-09-10T06:27:51.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:51.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:51.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243073+0000", 2024-09-10T06:27:51.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3659999999999999e-06 2024-09-10T06:27:51.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:51.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243085+0000", 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1440000000000001e-05 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243113+0000", 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8717e-05 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243130+0000", 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6796999999999999e-05 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:51.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243281+0000", 2024-09-10T06:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151228 2024-09-10T06:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.243625+0000", 2024-09-10T06:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034360400000000001 2024-09-10T06:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.244161+0000", 2024-09-10T06:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00053615300000000004 2024-09-10T06:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:51.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.245360+0000", 2024-09-10T06:27:51.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011983740000000001 2024-09-10T06:27:51.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:51.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.246315+0000", 2024-09-10T06:27:51.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00095580299999999997 2024-09-10T06:27:51.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:51.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.246400+0000", 2024-09-10T06:27:51.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4075999999999999e-05 2024-09-10T06:27:51.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:51.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:51.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:51.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.246463+0000", 2024-09-10T06:27:51.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3868999999999994e-05 2024-09-10T06:27:51.725 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.725 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.725 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.725 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:51.725 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:51.725 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:51.726 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T06:27:51.727 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T06:27:51.727 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T06:27:51.727 INFO:tasks.workunit.client.0.smithi112.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T06:27:51.727 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:51.724+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:51.727 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:27:51.734 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:51.734 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:51.746 INFO:tasks.workunit.client.0.smithi112.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T06:27:51.749 DEBUG:teuthology.orchestra.run.smithi112:> set -ex 2024-09-10T06:27:51.750 DEBUG:teuthology.orchestra.run.smithi112:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T06:27:51.751 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:51.751 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:51.755 INFO:tasks.workunit:Running workunits matching rgw/s3_user_quota.pl on client.0... 2024-09-10T06:27:51.756 INFO:tasks.workunit:Running workunit rgw/s3_user_quota.pl... 2024-09-10T06:27:51.756 DEBUG:teuthology.orchestra.run.smithi112:workunit test rgw/s3_user_quota.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_user_quota.pl 2024-09-10T06:27:51.768 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:51.768 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:51.784 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:51.784 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:51.804 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:51.804 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:51.823 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:51.823 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:51.827 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:51.829+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:51.842 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:51.843 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:51.858 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:51.859 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:51.863 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:51.863 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:51.874 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:27:51.928 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:51.924+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:52.029 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:52.029+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:52.039 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:52.039 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:52.054 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:27:52.131 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:52.128+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:52.218 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:52.218 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:52.232 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:52.233+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:52.234 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:27:52.333 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:52.332+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:52.365 INFO:tasks.workunit.client.0.smithi112.stdout:Bucket Created: buck_2024_08_10_06_27_52 2024-09-10T06:27:52.399 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:52.399 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:52.414 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:27:52.434 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:52.432+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:52.530 INFO:tasks.workunit.client.0.smithi112.stderr:1+0 records in 2024-09-10T06:27:52.530 INFO:tasks.workunit.client.0.smithi112.stderr:1+0 records out 2024-09-10T06:27:52.530 INFO:tasks.workunit.client.0.smithi112.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.010053 s, 1.0 GB/s 2024-09-10T06:27:52.535 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:52.537+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:52.541 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:52.541 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:52.556 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:27:52.578 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T06:27:52.636 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:52.632+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:52.723 INFO:tasks.workunit.client.0.smithi112.stdout:quota enabled for the user usr1 2024-09-10T06:27:52.724 INFO:tasks.workunit.client.0.smithi112.stdout:adding file to bucket buck_2024_08_10_06_27_52: 10Mb. 2024-09-10T06:27:52.724 INFO:tasks.workunit.client.0.smithi112.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T06:27:52.724 INFO:tasks.workunit.client.0.smithi112.stdout:Test case: PASSED - quota set for user: usr1 with max_objects=0 passed 2024-09-10T06:27:52.724 INFO:tasks.workunit.client.0.smithi112.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T06:27:52.731 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:52.731 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:52.737 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:52.736+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:52.745 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:27:52.838 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:52.836+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:52.864 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:52.864 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:52.878 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:27:52.965 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:52.964+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:52.979 INFO:tasks.workunit.client.0.smithi112.stdout:user usr1 deleted 2024-09-10T06:27:53.036 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:53.036 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:53.040 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:53.041+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:53.051 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:27:53.141 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:53.141+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:53.154 INFO:tasks.workunit.client.0.smithi112.stdout:Bucket Created: buck_2024_08_10_06_27_53 2024-09-10T06:27:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:53.206 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:53.221 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:27:53.242 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:53.241+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:53.334 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:53.334 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:53.343 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:53.341+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:53.347 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:27:53.417 INFO:tasks.workunit.client.0.smithi112.stderr:1+0 records in 2024-09-10T06:27:53.417 INFO:tasks.workunit.client.0.smithi112.stderr:1+0 records out 2024-09-10T06:27:53.418 INFO:tasks.workunit.client.0.smithi112.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.111273 s, 94.2 MB/s 2024-09-10T06:27:53.444 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:53.440+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:53.453 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:53.453 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:53.468 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:27:53.544 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:53.545+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:53.588 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-10T06:27:53.632 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:53.632 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:53.646 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:53.645+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:53.650 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:27:53.719 INFO:tasks.workunit.client.0.smithi112.stdout:quota enabled for the user usr2 2024-09-10T06:27:53.719 INFO:tasks.workunit.client.0.smithi112.stdout:adding file to bucket buck_2024_08_10_06_27_53: 10Mb. 2024-09-10T06:27:53.719 INFO:tasks.workunit.client.0.smithi112.stdout:upload file successful 2024-09-10T06:27:53.719 INFO:tasks.workunit.client.0.smithi112.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T06:27:53.719 INFO:tasks.workunit.client.0.smithi112.stdout:Test case: PASSED - quota set for user: usr2 with max_objects=1 passed 2024-09-10T06:27:53.719 INFO:tasks.workunit.client.0.smithi112.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T06:27:53.747 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:53.745+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:53.810 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:53.811 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:53.824 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:27:53.869 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:53.868+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:53.881 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:27:53.948 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:53.949+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:53.990 INFO:tasks.workunit.client.0.smithi112.stdout:user usr2 deleted 2024-09-10T06:27:53.990 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:53.990 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:54.005 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:27:54.048 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:54.049 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:54.049 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:54.044+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:54.066 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:54.066 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:54.084 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:54.084 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:54.101 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:54.101 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:54.123 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:54.123 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:54.130 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:54.130 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:54.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:54.130 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:54.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.130 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4236.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T06:27:54.130 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:54.130 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 90.621780802000004, 2024-09-10T06:27:54.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049682550000000004, 2024-09-10T06:27:54.130 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.130 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.130 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.130 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:54.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507425+0000", 2024-09-10T06:27:54.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507427+0000", 2024-09-10T06:27:54.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5629999999999999e-06 2024-09-10T06:27:54.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507439+0000", 2024-09-10T06:27:54.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.19e-05 2024-09-10T06:27:54.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507460+0000", 2024-09-10T06:27:54.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1693000000000001e-05 2024-09-10T06:27:54.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507480+0000", 2024-09-10T06:27:54.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9947000000000001e-05 2024-09-10T06:27:54.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507613+0000", 2024-09-10T06:27:54.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000132409 2024-09-10T06:27:54.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.507696+0000", 2024-09-10T06:27:54.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2953000000000004e-05 2024-09-10T06:27:54.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512288+0000", 2024-09-10T06:27:54.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0045927110000000002 2024-09-10T06:27:54.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:23.512393+0000", 2024-09-10T06:27:54.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000105079 2024-09-10T06:27:54.134 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.134 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.134 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.135 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4349.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:54.135 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:54.135 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 79.79831677, 2024-09-10T06:27:54.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025692739999999999, 2024-09-10T06:27:54.135 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.135 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.135 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4349", 2024-09-10T06:27:54.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:54.135 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 42 2024-09-10T06:27:54.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.136 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:54.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330889+0000", 2024-09-10T06:27:54.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330891+0000", 2024-09-10T06:27:54.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9700000000000002e-06 2024-09-10T06:27:54.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330901+0000", 2024-09-10T06:27:54.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2909999999999996e-06 2024-09-10T06:27:54.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330924+0000", 2024-09-10T06:27:54.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3132000000000001e-05 2024-09-10T06:27:54.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.330935+0000", 2024-09-10T06:27:54.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0893999999999999e-05 2024-09-10T06:27:54.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331021+0000", 2024-09-10T06:27:54.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6205000000000006e-05 2024-09-10T06:27:54.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331160+0000", 2024-09-10T06:27:54.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013973600000000001 2024-09-10T06:27:54.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:54.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.331336+0000", 2024-09-10T06:27:54.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017578799999999999 2024-09-10T06:27:54.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.332381+0000", 2024-09-10T06:27:54.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001044627 2024-09-10T06:27:54.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333371+0000", 2024-09-10T06:27:54.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00098979800000000007 2024-09-10T06:27:54.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333421+0000", 2024-09-10T06:27:54.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9872e-05 2024-09-10T06:27:54.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:34.333459+0000", 2024-09-10T06:27:54.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7960999999999998e-05 2024-09-10T06:27:54.140 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.140 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.141 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.141 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:54.141 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:54.141 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 75.813125850000006, 2024-09-10T06:27:54.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025247730000000001, 2024-09-10T06:27:54.141 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.141 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.141 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.141 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 52 2024-09-10T06:27:54.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.142 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:54.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316080+0000", 2024-09-10T06:27:54.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316084+0000", 2024-09-10T06:27:54.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8260000000000003e-06 2024-09-10T06:27:54.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316095+0000", 2024-09-10T06:27:54.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1229999999999999e-05 2024-09-10T06:27:54.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316131+0000", 2024-09-10T06:27:54.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5499e-05 2024-09-10T06:27:54.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316150+0000", 2024-09-10T06:27:54.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9510000000000001e-05 2024-09-10T06:27:54.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316275+0000", 2024-09-10T06:27:54.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012501600000000001 2024-09-10T06:27:54.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316507+0000", 2024-09-10T06:27:54.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000231404 2024-09-10T06:27:54.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:54.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.316712+0000", 2024-09-10T06:27:54.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000204873 2024-09-10T06:27:54.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.317603+0000", 2024-09-10T06:27:54.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089174399999999998 2024-09-10T06:27:54.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318470+0000", 2024-09-10T06:27:54.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00086713399999999998 2024-09-10T06:27:54.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318552+0000", 2024-09-10T06:27:54.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1279999999999994e-05 2024-09-10T06:27:54.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.147 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:38.318605+0000", 2024-09-10T06:27:54.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3257000000000002e-05 2024-09-10T06:27:54.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.147 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.147 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.147 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:54.147 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.709347520999998, 2024-09-10T06:27:54.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033383480000000001, 2024-09-10T06:27:54.147 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.148 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.148 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.148 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.148 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 236 2024-09-10T06:27:54.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.148 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:54.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419858+0000", 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419861+0000", 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.734e-06 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419873+0000", 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1789e-05 2024-09-10T06:27:54.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419904+0000", 2024-09-10T06:27:54.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1377000000000001e-05 2024-09-10T06:27:54.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.419921+0000", 2024-09-10T06:27:54.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6878999999999999e-05 2024-09-10T06:27:54.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420052+0000", 2024-09-10T06:27:54.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013025600000000001 2024-09-10T06:27:54.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420263+0000", 2024-09-10T06:27:54.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021196600000000001 2024-09-10T06:27:54.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:54.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.420649+0000", 2024-09-10T06:27:54.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038507 2024-09-10T06:27:54.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.422366+0000", 2024-09-10T06:27:54.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017172000000000001 2024-09-10T06:27:54.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423048+0000", 2024-09-10T06:27:54.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00068254100000000005 2024-09-10T06:27:54.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423127+0000", 2024-09-10T06:27:54.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8207000000000005e-05 2024-09-10T06:27:54.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.423197+0000", 2024-09-10T06:27:54.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0328999999999997e-05 2024-09-10T06:27:54.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.153 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.153 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.153 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.153 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:54.153 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.692746247000002, 2024-09-10T06:27:54.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003575235, 2024-09-10T06:27:54.153 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.154 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.154 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.154 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.154 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.154 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.154 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 299 2024-09-10T06:27:54.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.154 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:54.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436460+0000", 2024-09-10T06:27:54.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436461+0000", 2024-09-10T06:27:54.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.144e-06 2024-09-10T06:27:54.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436466+0000", 2024-09-10T06:27:54.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8409999999999999e-06 2024-09-10T06:27:54.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436477+0000", 2024-09-10T06:27:54.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1253000000000001e-05 2024-09-10T06:27:54.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436483+0000", 2024-09-10T06:27:54.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7010000000000001e-06 2024-09-10T06:27:54.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436527+0000", 2024-09-10T06:27:54.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4381000000000001e-05 2024-09-10T06:27:54.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436569+0000", 2024-09-10T06:27:54.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2208e-05 2024-09-10T06:27:54.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:54.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.436687+0000", 2024-09-10T06:27:54.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118093 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.437455+0000", 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076799599999999996 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439950+0000", 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024946040000000001 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.439988+0000", 2024-09-10T06:27:54.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8405999999999998e-05 2024-09-10T06:27:54.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.440035+0000", 2024-09-10T06:27:54.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6607999999999998e-05 2024-09-10T06:27:54.159 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.159 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.159 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.159 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.159 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:54.159 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.358070165000001, 2024-09-10T06:27:54.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028833040000000002, 2024-09-10T06:27:54.160 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.160 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.160 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.160 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.160 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 742 2024-09-10T06:27:54.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.160 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:54.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771136+0000", 2024-09-10T06:27:54.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.161 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771139+0000", 2024-09-10T06:27:54.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5269999999999999e-06 2024-09-10T06:27:54.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771153+0000", 2024-09-10T06:27:54.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4036000000000001e-05 2024-09-10T06:27:54.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771186+0000", 2024-09-10T06:27:54.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2113000000000002e-05 2024-09-10T06:27:54.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771201+0000", 2024-09-10T06:27:54.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5330000000000001e-05 2024-09-10T06:27:54.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771320+0000", 2024-09-10T06:27:54.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119265 2024-09-10T06:27:54.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771557+0000", 2024-09-10T06:27:54.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023640600000000001 2024-09-10T06:27:54.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:54.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.771890+0000", 2024-09-10T06:27:54.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033302000000000001 2024-09-10T06:27:54.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773204+0000", 2024-09-10T06:27:54.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013142239999999999 2024-09-10T06:27:54.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773864+0000", 2024-09-10T06:27:54.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00066005100000000004 2024-09-10T06:27:54.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.773948+0000", 2024-09-10T06:27:54.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4625999999999999e-05 2024-09-10T06:27:54.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774019+0000", 2024-09-10T06:27:54.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0705999999999997e-05 2024-09-10T06:27:54.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.165 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.165 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.354290915000007, 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025263479999999999, 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 744 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774915+0000", 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774917+0000", 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0540000000000002e-06 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.167 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774926+0000", 2024-09-10T06:27:54.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5660000000000007e-06 2024-09-10T06:27:54.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774947+0000", 2024-09-10T06:27:54.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0852999999999998e-05 2024-09-10T06:27:54.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.774958+0000", 2024-09-10T06:27:54.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1216999999999999e-05 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775045+0000", 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7643000000000001e-05 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775167+0000", 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012163900000000001 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.775427+0000", 2024-09-10T06:27:54.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000259678 2024-09-10T06:27:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.776736+0000", 2024-09-10T06:27:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013093429999999999 2024-09-10T06:27:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777296+0000", 2024-09-10T06:27:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00056029599999999995 2024-09-10T06:27:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777374+0000", 2024-09-10T06:27:54.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7721999999999999e-05 2024-09-10T06:27:54.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.777441+0000", 2024-09-10T06:27:54.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7336999999999996e-05 2024-09-10T06:27:54.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.171 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.171 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.171 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.171 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:54.171 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.316975369000005, 2024-09-10T06:27:54.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036412979999999998, 2024-09-10T06:27:54.172 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.172 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.172 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.172 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.172 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 760 2024-09-10T06:27:54.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.172 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:54.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812231+0000", 2024-09-10T06:27:54.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.173 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.173 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812233+0000", 2024-09-10T06:27:54.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:54.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812244+0000", 2024-09-10T06:27:54.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1273e-05 2024-09-10T06:27:54.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812276+0000", 2024-09-10T06:27:54.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1253e-05 2024-09-10T06:27:54.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812290+0000", 2024-09-10T06:27:54.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4576000000000001e-05 2024-09-10T06:27:54.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812438+0000", 2024-09-10T06:27:54.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014775899999999999 2024-09-10T06:27:54.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.812821+0000", 2024-09-10T06:27:54.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000383187 2024-09-10T06:27:54.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:54.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.813398+0000", 2024-09-10T06:27:54.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000576619 2024-09-10T06:27:54.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.814658+0000", 2024-09-10T06:27:54.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001260207 2024-09-10T06:27:54.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815591+0000", 2024-09-10T06:27:54.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00093332899999999999 2024-09-10T06:27:54.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815745+0000", 2024-09-10T06:27:54.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153392 2024-09-10T06:27:54.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.815872+0000", 2024-09-10T06:27:54.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012715599999999999 2024-09-10T06:27:54.177 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:762 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.312339984999994, 2024-09-10T06:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029417369999999998, 2024-09-10T06:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.178 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.179 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 762 2024-09-10T06:27:54.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.179 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:54.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816866+0000", 2024-09-10T06:27:54.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816868+0000", 2024-09-10T06:27:54.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.283e-06 2024-09-10T06:27:54.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816879+0000", 2024-09-10T06:27:54.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0523000000000001e-05 2024-09-10T06:27:54.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816910+0000", 2024-09-10T06:27:54.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0732999999999999e-05 2024-09-10T06:27:54.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.816926+0000", 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.677e-05 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817058+0000", 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013195599999999999 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817299+0000", 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000241091 2024-09-10T06:27:54.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.817761+0000", 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00046188400000000003 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.818948+0000", 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011866240000000001 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819662+0000", 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071398399999999997 2024-09-10T06:27:54.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819745+0000", 2024-09-10T06:27:54.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3560000000000006e-05 2024-09-10T06:27:54.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.819808+0000", 2024-09-10T06:27:54.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2329000000000006e-05 2024-09-10T06:27:54.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.183 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.183 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.184 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.184 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:54.184 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.191879267999994, 2024-09-10T06:27:54.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002834175, 2024-09-10T06:27:54.184 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.184 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.184 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.184 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.184 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 817 2024-09-10T06:27:54.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.184 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937327+0000", 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937330+0000", 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9869999999999999e-06 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.185 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937342+0000", 2024-09-10T06:27:54.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2595999999999999e-05 2024-09-10T06:27:54.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937375+0000", 2024-09-10T06:27:54.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2320000000000002e-05 2024-09-10T06:27:54.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937390+0000", 2024-09-10T06:27:54.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4977000000000001e-05 2024-09-10T06:27:54.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937529+0000", 2024-09-10T06:27:54.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013937199999999999 2024-09-10T06:27:54.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.937753+0000", 2024-09-10T06:27:54.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000224358 2024-09-10T06:27:54.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:54.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.938061+0000", 2024-09-10T06:27:54.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030808799999999998 2024-09-10T06:27:54.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.939112+0000", 2024-09-10T06:27:54.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010503050000000001 2024-09-10T06:27:54.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940005+0000", 2024-09-10T06:27:54.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00089366599999999999 2024-09-10T06:27:54.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940093+0000", 2024-09-10T06:27:54.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8053000000000006e-05 2024-09-10T06:27:54.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.940161+0000", 2024-09-10T06:27:54.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7453000000000006e-05 2024-09-10T06:27:54.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.189 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.189 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.189 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.189 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:54.190 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.138951226000003, 2024-09-10T06:27:54.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027552649999999998, 2024-09-10T06:27:54.190 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.190 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.190 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.190 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.190 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 841 2024-09-10T06:27:54.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.190 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:54.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990255+0000", 2024-09-10T06:27:54.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.191 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990257+0000", 2024-09-10T06:27:54.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6869999999999999e-06 2024-09-10T06:27:54.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990270+0000", 2024-09-10T06:27:54.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2843000000000001e-05 2024-09-10T06:27:54.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990300+0000", 2024-09-10T06:27:54.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9252999999999999e-05 2024-09-10T06:27:54.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990314+0000", 2024-09-10T06:27:54.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4796e-05 2024-09-10T06:27:54.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990427+0000", 2024-09-10T06:27:54.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112649 2024-09-10T06:27:54.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990671+0000", 2024-09-10T06:27:54.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000244408 2024-09-10T06:27:54.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:54.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.990987+0000", 2024-09-10T06:27:54.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031593099999999998 2024-09-10T06:27:54.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992073+0000", 2024-09-10T06:27:54.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010854549999999999 2024-09-10T06:27:54.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992862+0000", 2024-09-10T06:27:54.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00078889400000000005 2024-09-10T06:27:54.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.992944+0000", 2024-09-10T06:27:54.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2152999999999998e-05 2024-09-10T06:27:54.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993010+0000", 2024-09-10T06:27:54.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6196000000000001e-05 2024-09-10T06:27:54.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.195 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.195 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.135215291999998, 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025373539999999999, 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 843 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.196 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:54.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993991+0000", 2024-09-10T06:27:54.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.993993+0000", 2024-09-10T06:27:54.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3630000000000001e-06 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994004+0000", 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0557000000000001e-05 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994035+0000", 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0969000000000001e-05 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994055+0000", 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0497e-05 2024-09-10T06:27:54.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994150+0000", 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5363000000000002e-05 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994275+0000", 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012453200000000001 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.994570+0000", 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00029522100000000003 2024-09-10T06:27:54.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.995569+0000", 2024-09-10T06:27:54.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00099913200000000001 2024-09-10T06:27:54.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996384+0000", 2024-09-10T06:27:54.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00081451099999999997 2024-09-10T06:27:54.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996462+0000", 2024-09-10T06:27:54.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8502000000000002e-05 2024-09-10T06:27:54.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.996528+0000", 2024-09-10T06:27:54.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5707e-05 2024-09-10T06:27:54.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.201 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.201 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.201 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.202 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:54.202 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.125768144999995, 2024-09-10T06:27:54.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033145539999999999, 2024-09-10T06:27:54.202 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.202 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.202 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.202 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.202 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 847 2024-09-10T06:27:54.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.202 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:54.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003438+0000", 2024-09-10T06:27:54.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003440+0000", 2024-09-10T06:27:54.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5299999999999999e-06 2024-09-10T06:27:54.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003452+0000", 2024-09-10T06:27:54.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:54.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003482+0000", 2024-09-10T06:27:54.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0790000000000002e-05 2024-09-10T06:27:54.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003497+0000", 2024-09-10T06:27:54.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.489e-05 2024-09-10T06:27:54.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003645+0000", 2024-09-10T06:27:54.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014771900000000001 2024-09-10T06:27:54.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.003996+0000", 2024-09-10T06:27:54.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000350861 2024-09-10T06:27:54.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:54.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.004540+0000", 2024-09-10T06:27:54.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054383199999999995 2024-09-10T06:27:54.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.005831+0000", 2024-09-10T06:27:54.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001291366 2024-09-10T06:27:54.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006461+0000", 2024-09-10T06:27:54.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00062943899999999998 2024-09-10T06:27:54.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006631+0000", 2024-09-10T06:27:54.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000170228 2024-09-10T06:27:54.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.006752+0000", 2024-09-10T06:27:54.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012160899999999999 2024-09-10T06:27:54.208 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.208 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.208 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.208 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.208 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:54.208 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.121514977999993, 2024-09-10T06:27:54.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002619953, 2024-09-10T06:27:54.208 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.208 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.208 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.208 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 849 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007691+0000", 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007693+0000", 2024-09-10T06:27:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3099999999999999e-06 2024-09-10T06:27:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007704+0000", 2024-09-10T06:27:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0387000000000001e-05 2024-09-10T06:27:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007734+0000", 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0676000000000002e-05 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007753+0000", 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.836e-05 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007857+0000", 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103836 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.007980+0000", 2024-09-10T06:27:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123843 2024-09-10T06:27:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.008241+0000", 2024-09-10T06:27:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026085799999999999 2024-09-10T06:27:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.009475+0000", 2024-09-10T06:27:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012340230000000001 2024-09-10T06:27:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010168+0000", 2024-09-10T06:27:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00069220800000000004 2024-09-10T06:27:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010247+0000", 2024-09-10T06:27:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9929e-05 2024-09-10T06:27:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.010311+0000", 2024-09-10T06:27:54.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3522999999999995e-05 2024-09-10T06:27:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.077035156999997, 2024-09-10T06:27:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026646590000000002, 2024-09-10T06:27:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.214 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 868 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052171+0000", 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052173+0000", 2024-09-10T06:27:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4729999999999999e-06 2024-09-10T06:27:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052186+0000", 2024-09-10T06:27:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2787e-05 2024-09-10T06:27:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052216+0000", 2024-09-10T06:27:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9618999999999999e-05 2024-09-10T06:27:54.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052231+0000", 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4929999999999999e-05 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052349+0000", 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011830200000000001 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052561+0000", 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000212182 2024-09-10T06:27:54.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.052874+0000", 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031299399999999998 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054049+0000", 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001174825 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054635+0000", 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00058643900000000001 2024-09-10T06:27:54.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054721+0000", 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5185999999999994e-05 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.054836+0000", 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114922 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.219 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.990379055999995, 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028453739999999999, 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 907 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:54.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138827+0000", 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138830+0000", 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8600000000000001e-06 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138842+0000", 2024-09-10T06:27:54.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2126e-05 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138874+0000", 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2047e-05 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.138889+0000", 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4966999999999999e-05 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139007+0000", 2024-09-10T06:27:54.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000118479 2024-09-10T06:27:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139238+0000", 2024-09-10T06:27:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023031399999999999 2024-09-10T06:27:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.139566+0000", 2024-09-10T06:27:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00032816099999999999 2024-09-10T06:27:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.140631+0000", 2024-09-10T06:27:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0010653679999999999 2024-09-10T06:27:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141393+0000", 2024-09-10T06:27:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00076187100000000001 2024-09-10T06:27:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141561+0000", 2024-09-10T06:27:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016755599999999999 2024-09-10T06:27:54.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.141672+0000", 2024-09-10T06:27:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111625 2024-09-10T06:27:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.986455539999994, 2024-09-10T06:27:54.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002857268, 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 909 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142750+0000", 2024-09-10T06:27:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142753+0000", 2024-09-10T06:27:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4040000000000002e-06 2024-09-10T06:27:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142764+0000", 2024-09-10T06:27:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0789e-05 2024-09-10T06:27:54.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142795+0000", 2024-09-10T06:27:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0982999999999998e-05 2024-09-10T06:27:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142810+0000", 2024-09-10T06:27:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4960000000000001e-05 2024-09-10T06:27:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.142908+0000", 2024-09-10T06:27:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8726000000000003e-05 2024-09-10T06:27:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143030+0000", 2024-09-10T06:27:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121649 2024-09-10T06:27:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.143294+0000", 2024-09-10T06:27:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000263875 2024-09-10T06:27:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.144530+0000", 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001236067 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145340+0000", 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080966700000000003 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145497+0000", 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015773499999999999 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.145608+0000", 2024-09-10T06:27:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110413 2024-09-10T06:27:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.892758043000001, 2024-09-10T06:27:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029166940000000001, 2024-09-10T06:27:54.231 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 949 2024-09-10T06:27:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236448+0000", 2024-09-10T06:27:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236451+0000", 2024-09-10T06:27:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:27:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236464+0000", 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3223e-05 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236497+0000", 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2672999999999997e-05 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236515+0000", 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8386999999999999e-05 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236636+0000", 2024-09-10T06:27:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000120752 2024-09-10T06:27:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.236857+0000", 2024-09-10T06:27:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022134499999999999 2024-09-10T06:27:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.237188+0000", 2024-09-10T06:27:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033057799999999999 2024-09-10T06:27:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.235 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.238353+0000", 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001164841 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239160+0000", 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080743000000000004 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239245+0000", 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5189e-05 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.236 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.239365+0000", 2024-09-10T06:27:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119406 2024-09-10T06:27:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.888896935999995, 2024-09-10T06:27:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025033970000000001, 2024-09-10T06:27:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.237 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 951 2024-09-10T06:27:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.238 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240309+0000", 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240311+0000", 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8899999999999999e-06 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240320+0000", 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6799999999999999e-06 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.239 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240341+0000", 2024-09-10T06:27:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1379e-05 2024-09-10T06:27:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240352+0000", 2024-09-10T06:27:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1354e-05 2024-09-10T06:27:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240450+0000", 2024-09-10T06:27:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7866000000000001e-05 2024-09-10T06:27:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.240 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240580+0000", 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012970899999999999 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.240851+0000", 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027059099999999998 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242052+0000", 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001201014 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.241 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242662+0000", 2024-09-10T06:27:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00061076800000000003 2024-09-10T06:27:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242747+0000", 2024-09-10T06:27:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5019999999999996e-05 2024-09-10T06:27:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.242812+0000", 2024-09-10T06:27:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5126e-05 2024-09-10T06:27:54.242 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 71.878447516999998, 2024-09-10T06:27:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0027897120000000002, 2024-09-10T06:27:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.243 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 955 2024-09-10T06:27:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.244 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250758+0000", 2024-09-10T06:27:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250761+0000", 2024-09-10T06:27:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5270000000000001e-06 2024-09-10T06:27:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250772+0000", 2024-09-10T06:27:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1153e-05 2024-09-10T06:27:54.245 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250802+0000", 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0029999999999999e-05 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250817+0000", 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4883e-05 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.250925+0000", 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108249 2024-09-10T06:27:54.246 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251139+0000", 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000213568 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.251450+0000", 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031139200000000002 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.252574+0000", 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011239139999999999 2024-09-10T06:27:54.247 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253377+0000", 2024-09-10T06:27:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080306400000000003 2024-09-10T06:27:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253466+0000", 2024-09-10T06:27:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8436000000000005e-05 2024-09-10T06:27:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.248 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.253548+0000", 2024-09-10T06:27:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2496000000000004e-05 2024-09-10T06:27:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.249 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.249 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:54.251 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:27:54.251 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:54.251 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:54.252 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:54.252 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:54.252 INFO:tasks.workunit.client.0.smithi112.stdout:Bucket Created: buck_2024_08_10_06_27_54 2024-09-10T06:27:54.252 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:54.253 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:54.253 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:54.248+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:54.352 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:54.353+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:54.352 INFO:tasks.workunit.client.0.smithi112.stderr:1+0 records in 2024-09-10T06:27:54.352 INFO:tasks.workunit.client.0.smithi112.stderr:1+0 records out 2024-09-10T06:27:54.352 INFO:tasks.workunit.client.0.smithi112.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0247576 s, 424 MB/s 2024-09-10T06:27:54.409 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:54.409 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:54.409 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:27:54.410 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:54.426 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:27:54.469 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:54.468+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:54.530 INFO:tasks.workunit.client.0.smithi112.stdout:quota enabled for the user usr1 2024-09-10T06:27:54.530 INFO:tasks.workunit.client.0.smithi112.stdout:adding file to bucket buck_2024_08_10_06_27_54: 10Mb. 2024-09-10T06:27:54.531 INFO:tasks.workunit.client.0.smithi112.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T06:27:54.531 INFO:tasks.workunit.client.0.smithi112.stdout:Test case: PASSED - quota set for user: usr1 with max_size=0 passed 2024-09-10T06:27:54.531 INFO:tasks.workunit.client.0.smithi112.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T06:27:54.539 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:54.539 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:54.539 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:54.539 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:54.539 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:54.554 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:27:54.554 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:54.552+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:54.653 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:54.652+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:54.712 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:54.712 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:54.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:54.712 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:54.712 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.712 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:54.712 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:54.712 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.405309462999995, 2024-09-10T06:27:54.712 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003846917, 2024-09-10T06:27:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 207 2024-09-10T06:27:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:54.713 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.714 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.716 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.716 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.716 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305983+0000", 2024-09-10T06:27:54.716 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.716 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.305987+0000", 2024-09-10T06:27:54.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6069999999999999e-06 2024-09-10T06:27:54.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306002+0000", 2024-09-10T06:27:54.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5406000000000001e-05 2024-09-10T06:27:54.717 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.717 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.717 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306036+0000", 2024-09-10T06:27:54.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4146000000000001e-05 2024-09-10T06:27:54.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306061+0000", 2024-09-10T06:27:54.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4470000000000001e-05 2024-09-10T06:27:54.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306325+0000", 2024-09-10T06:27:54.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026382800000000002 2024-09-10T06:27:54.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.306569+0000", 2024-09-10T06:27:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024445499999999998 2024-09-10T06:27:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.307017+0000", 2024-09-10T06:27:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00044774000000000002 2024-09-10T06:27:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.308517+0000", 2024-09-10T06:27:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001500075 2024-09-10T06:27:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309685+0000", 2024-09-10T06:27:54.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001168505 2024-09-10T06:27:54.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309767+0000", 2024-09-10T06:27:54.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1992999999999999e-05 2024-09-10T06:27:54.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.309830+0000", 2024-09-10T06:27:54.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2692000000000002e-05 2024-09-10T06:27:54.720 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.720 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.721 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.721 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.721 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:54.721 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.361057415000005, 2024-09-10T06:27:54.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003433888, 2024-09-10T06:27:54.721 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.721 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.721 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.721 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.722 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 216 2024-09-10T06:27:54.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.722 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:54.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.722 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350235+0000", 2024-09-10T06:27:54.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350239+0000", 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.377e-06 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350254+0000", 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.501e-05 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350288+0000", 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4746000000000002e-05 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350312+0000", 2024-09-10T06:27:54.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3249999999999999e-05 2024-09-10T06:27:54.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350456+0000", 2024-09-10T06:27:54.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014483899999999999 2024-09-10T06:27:54.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.350704+0000", 2024-09-10T06:27:54.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024719100000000001 2024-09-10T06:27:54.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:54.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.351117+0000", 2024-09-10T06:27:54.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000412934 2024-09-10T06:27:54.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.352644+0000", 2024-09-10T06:27:54.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015271079999999999 2024-09-10T06:27:54.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353397+0000", 2024-09-10T06:27:54.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00075311799999999999 2024-09-10T06:27:54.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353556+0000", 2024-09-10T06:27:54.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000159612 2024-09-10T06:27:54.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.353669+0000", 2024-09-10T06:27:54.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011270299999999999 2024-09-10T06:27:54.726 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.726 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.726 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.727 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.727 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:54.727 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.322377953, 2024-09-10T06:27:54.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033447479999999998, 2024-09-10T06:27:54.727 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.727 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.727 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.727 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.727 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.727 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.727 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 227 2024-09-10T06:27:54.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388915+0000", 2024-09-10T06:27:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388917+0000", 2024-09-10T06:27:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6900000000000001e-06 2024-09-10T06:27:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388931+0000", 2024-09-10T06:27:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3900000000000001e-05 2024-09-10T06:27:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388964+0000", 2024-09-10T06:27:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2985999999999999e-05 2024-09-10T06:27:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.388980+0000", 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.535e-05 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389123+0000", 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014337900000000001 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389341+0000", 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00021765099999999999 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.730 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.389765+0000", 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00042423100000000001 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.391433+0000", 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016681000000000001 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392104+0000", 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00067064800000000003 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392191+0000", 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7912999999999997e-05 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.392259+0000", 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7899999999999997e-05 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:377 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.249807278999995, 2024-09-10T06:27:54.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058485480000000003, 2024-09-10T06:27:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 377 2024-09-10T06:27:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461486+0000", 2024-09-10T06:27:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0720000000000001e-06 2024-09-10T06:27:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461504+0000", 2024-09-10T06:27:54.734 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8002000000000001e-05 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461519+0000", 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4584e-05 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461526+0000", 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5560000000000004e-06 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461597+0000", 2024-09-10T06:27:54.735 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1311999999999998e-05 2024-09-10T06:27:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461709+0000", 2024-09-10T06:27:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011191100000000001 2024-09-10T06:27:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461871+0000", 2024-09-10T06:27:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016254900000000001 2024-09-10T06:27:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.736 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.462777+0000", 2024-09-10T06:27:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00090547100000000003 2024-09-10T06:27:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467265+0000", 2024-09-10T06:27:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004488222 2024-09-10T06:27:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467308+0000", 2024-09-10T06:27:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2975000000000001e-05 2024-09-10T06:27:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467334+0000", 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5894e-05 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:384 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.247674423999996, 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031588900000000001, 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.738 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 384 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463618+0000", 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463620+0000", 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463625+0000", 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6450000000000002e-06 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463639+0000", 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3540000000000001e-05 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.740 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463648+0000", 2024-09-10T06:27:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0259999999999996e-06 2024-09-10T06:27:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463713+0000", 2024-09-10T06:27:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5438000000000006e-05 2024-09-10T06:27:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463774+0000", 2024-09-10T06:27:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0582999999999999e-05 2024-09-10T06:27:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.463899+0000", 2024-09-10T06:27:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012553900000000001 2024-09-10T06:27:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.464371+0000", 2024-09-10T06:27:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00047201600000000002 2024-09-10T06:27:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466707+0000", 2024-09-10T06:27:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023354999999999999 2024-09-10T06:27:54.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466742+0000", 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4686e-05 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.466777+0000", 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5537000000000002e-05 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.743 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:436 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.232427376999993, 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0040690570000000001, 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 436 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478865+0000", 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478866+0000", 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1960000000000001e-06 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478871+0000", 2024-09-10T06:27:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6879999999999998e-06 2024-09-10T06:27:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478883+0000", 2024-09-10T06:27:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1790999999999999e-05 2024-09-10T06:27:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478890+0000", 2024-09-10T06:27:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8569999999999997e-06 2024-09-10T06:27:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.478958+0000", 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7774999999999994e-05 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479072+0000", 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114577 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.479255+0000", 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018297300000000001 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482448+0000", 2024-09-10T06:27:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031933389999999999 2024-09-10T06:27:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482828+0000", 2024-09-10T06:27:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00037961800000000002 2024-09-10T06:27:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482891+0000", 2024-09-10T06:27:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3316000000000002e-05 2024-09-10T06:27:54.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482934+0000", 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2926999999999997e-05 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:441 6.7 e34/28 6:e1cdb60d:reshard::reshard.0000000008:head v 34'7, mlcod=34'5)", 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.228826459000004, 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060368319999999998, 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.749 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482467+0000", 2024-09-10T06:27:54.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8800000000000003e-07 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482472+0000", 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8730000000000004e-06 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482481+0000", 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1980000000000001e-06 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482485+0000", 2024-09-10T06:27:54.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.386e-06 2024-09-10T06:27:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482541+0000", 2024-09-10T06:27:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5788000000000002e-05 2024-09-10T06:27:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482563+0000", 2024-09-10T06:27:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2303999999999999e-05 2024-09-10T06:27:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488465+0000", 2024-09-10T06:27:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059014810000000001 2024-09-10T06:27:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488503+0000", 2024-09-10T06:27:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8313999999999999e-05 2024-09-10T06:27:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:466 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.753 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.213667208999993, 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039032810000000002, 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 466 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:54.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497625+0000", 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497626+0000", 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9099999999999991e-07 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497634+0000", 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.994e-06 2024-09-10T06:27:54.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497644+0000", 2024-09-10T06:27:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.6260000000000007e-06 2024-09-10T06:27:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497650+0000", 2024-09-10T06:27:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5160000000000002e-06 2024-09-10T06:27:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497718+0000", 2024-09-10T06:27:54.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8862999999999994e-05 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497775+0000", 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6156000000000002e-05 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.497903+0000", 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012879800000000001 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499630+0000", 2024-09-10T06:27:54.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017268139999999999 2024-09-10T06:27:54.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501439+0000", 2024-09-10T06:27:54.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018086669999999999 2024-09-10T06:27:54.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501478+0000", 2024-09-10T06:27:54.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9269e-05 2024-09-10T06:27:54.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.501529+0000", 2024-09-10T06:27:54.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0587000000000002e-05 2024-09-10T06:27:54.759 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.759 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.759 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.759 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:469 6.0 e34/28 6:02683654:reshard::reshard.0000000010:head v 34'6, mlcod=34'4)", 2024-09-10T06:27:54.759 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:54.759 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.211664385999995, 2024-09-10T06:27:54.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048323109999999997, 2024-09-10T06:27:54.759 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.759 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.759 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.760 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:54.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499628+0000", 2024-09-10T06:27:54.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499629+0000", 2024-09-10T06:27:54.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9199999999999999e-07 2024-09-10T06:27:54.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499634+0000", 2024-09-10T06:27:54.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2530000000000004e-06 2024-09-10T06:27:54.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499644+0000", 2024-09-10T06:27:54.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5820000000000008e-06 2024-09-10T06:27:54.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499650+0000", 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7919999999999998e-06 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499697+0000", 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7564000000000001e-05 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.499719+0000", 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1297999999999998e-05 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.762 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504413+0000", 2024-09-10T06:27:54.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004694419 2024-09-10T06:27:54.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.504461+0000", 2024-09-10T06:27:54.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7511e-05 2024-09-10T06:27:54.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.763 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.763 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.763 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:621 6.0 e34/28 6:0705c68b:::obj_delete_at_hint.0000000028:head v 34'11, mlcod=34'9)", 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.106463241, 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.003196562, 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604829+0000", 2024-09-10T06:27:54.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604831+0000", 2024-09-10T06:27:54.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.823e-06 2024-09-10T06:27:54.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604843+0000", 2024-09-10T06:27:54.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1437000000000001e-05 2024-09-10T06:27:54.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604868+0000", 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5837e-05 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604885+0000", 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6759999999999999e-05 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604971+0000", 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5512000000000004e-05 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.604991+0000", 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0197999999999999e-05 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.607960+0000", 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002969307 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.608026+0000", 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5687999999999999e-05 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.767 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:636 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.097553586999993, 2024-09-10T06:27:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048306950000000003, 2024-09-10T06:27:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 636 2024-09-10T06:27:54.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613739+0000", 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613740+0000", 2024-09-10T06:27:54.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613747+0000", 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8090000000000004e-06 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613762+0000", 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5037e-05 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613772+0000", 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7510000000000003e-06 2024-09-10T06:27:54.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613834+0000", 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2458000000000004e-05 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.613916+0000", 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1630000000000003e-05 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.614071+0000", 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015480800000000001 2024-09-10T06:27:54.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.615885+0000", 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001814607 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618438+0000", 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025529459999999999 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618503+0000", 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4851000000000006e-05 2024-09-10T06:27:54.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.618570+0000", 2024-09-10T06:27:54.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6418e-05 2024-09-10T06:27:54.773 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.773 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.773 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.773 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:646 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.773 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:54.773 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.088091797000004, 2024-09-10T06:27:54.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049103549999999999, 2024-09-10T06:27:54.774 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.774 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.774 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.774 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.774 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.774 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.774 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 646 2024-09-10T06:27:54.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.774 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.774 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.774 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:54.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:54.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623202+0000", 2024-09-10T06:27:54.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9800000000000002e-07 2024-09-10T06:27:54.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623206+0000", 2024-09-10T06:27:54.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6380000000000003e-06 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623216+0000", 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4439999999999997e-06 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623221+0000", 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6400000000000002e-06 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623300+0000", 2024-09-10T06:27:54.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8677999999999994e-05 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623410+0000", 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010954399999999999 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623629+0000", 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000219836 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.625072+0000", 2024-09-10T06:27:54.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014427929999999999 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.627982+0000", 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029097620000000002 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628058+0000", 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6390999999999994e-05 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628111+0000", 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2731e-05 2024-09-10T06:27:54.778 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:703 6.1f 6:f93251ce:::obj_delete_at_hint.0000000042:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 73.025417524999995, 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033783509999999999, 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 703 2024-09-10T06:27:54.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685875+0000", 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685878+0000", 2024-09-10T06:27:54.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5900000000000002e-06 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685889+0000", 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.129e-05 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685919+0000", 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0307e-05 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.685935+0000", 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5336e-05 2024-09-10T06:27:54.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686092+0000", 2024-09-10T06:27:54.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015776200000000001 2024-09-10T06:27:54.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.686462+0000", 2024-09-10T06:27:54.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00036925700000000001 2024-09-10T06:27:54.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:54.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.687048+0000", 2024-09-10T06:27:54.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000586266 2024-09-10T06:27:54.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688261+0000", 2024-09-10T06:27:54.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012132670000000001 2024-09-10T06:27:54.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.688974+0000", 2024-09-10T06:27:54.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00071248800000000005 2024-09-10T06:27:54.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689129+0000", 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000155499 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.689253+0000", 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124289 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:54.784 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.666852022, 2024-09-10T06:27:54.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0032750980000000002, 2024-09-10T06:27:54.785 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.785 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.785 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.785 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.785 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.785 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.785 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 865 2024-09-10T06:27:54.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.785 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:54.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044441+0000", 2024-09-10T06:27:54.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044443+0000", 2024-09-10T06:27:54.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6929999999999999e-06 2024-09-10T06:27:54.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044456+0000", 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.224e-05 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044486+0000", 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.095e-05 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044501+0000", 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4932999999999999e-05 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.044646+0000", 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014465600000000001 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045001+0000", 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035473999999999998 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.045549+0000", 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00054870299999999999 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.046956+0000", 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014061189999999999 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047452+0000", 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00049682199999999995 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047606+0000", 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015379599999999999 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.047716+0000", 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000109446 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.593521688999999, 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0035511029999999999, 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.790 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 898 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117771+0000", 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117772+0000", 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5340000000000001e-06 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117781+0000", 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.276e-06 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117804+0000", 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3093999999999999e-05 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117816+0000", 2024-09-10T06:27:54.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1986e-05 2024-09-10T06:27:54.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.117954+0000", 2024-09-10T06:27:54.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013856900000000001 2024-09-10T06:27:54.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118327+0000", 2024-09-10T06:27:54.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000372841 2024-09-10T06:27:54.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:54.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.118919+0000", 2024-09-10T06:27:54.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00059172800000000002 2024-09-10T06:27:54.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.120253+0000", 2024-09-10T06:27:54.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001333643 2024-09-10T06:27:54.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121060+0000", 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00080731100000000001 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121210+0000", 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014980500000000001 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.121322+0000", 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112316 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 72.504251877000002, 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051838630000000004, 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 937 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:54.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:54.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207042+0000", 2024-09-10T06:27:54.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7439999999999999e-06 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207051+0000", 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7299999999999994e-06 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207072+0000", 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1209e-05 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207089+0000", 2024-09-10T06:27:54.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6297e-05 2024-09-10T06:27:54.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207231+0000", 2024-09-10T06:27:54.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014233200000000001 2024-09-10T06:27:54.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207463+0000", 2024-09-10T06:27:54.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023155199999999999 2024-09-10T06:27:54.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:54.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207797+0000", 2024-09-10T06:27:54.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033413699999999998 2024-09-10T06:27:54.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.209053+0000", 2024-09-10T06:27:54.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012560029999999999 2024-09-10T06:27:54.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212076+0000", 2024-09-10T06:27:54.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030234239999999998 2024-09-10T06:27:54.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212162+0000", 2024-09-10T06:27:54.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5506000000000004e-05 2024-09-10T06:27:54.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212225+0000", 2024-09-10T06:27:54.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2928999999999993e-05 2024-09-10T06:27:54.801 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.801 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.801 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.801 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4862.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94420709999008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:54.801 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:54.456826+0000", 2024-09-10T06:27:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.25446686200000002, 2024-09-10T06:27:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041580569999999997, 2024-09-10T06:27:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4862", 2024-09-10T06:27:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/933126221", 2024-09-10T06:27:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 55 2024-09-10T06:27:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.456826+0000", 2024-09-10T06:27:54.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.456826+0000", 2024-09-10T06:27:54.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.456826+0000", 2024-09-10T06:27:54.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3799999999999997e-07 2024-09-10T06:27:54.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.456829+0000", 2024-09-10T06:27:54.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.802e-06 2024-09-10T06:27:54.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.456837+0000", 2024-09-10T06:27:54.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8860000000000004e-06 2024-09-10T06:27:54.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.456841+0000", 2024-09-10T06:27:54.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4680000000000003e-06 2024-09-10T06:27:54.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.456892+0000", 2024-09-10T06:27:54.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0744000000000001e-05 2024-09-10T06:27:54.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.456972+0000", 2024-09-10T06:27:54.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9977999999999999e-05 2024-09-10T06:27:54.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:54.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.457113+0000", 2024-09-10T06:27:54.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014111700000000001 2024-09-10T06:27:54.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.460766+0000", 2024-09-10T06:27:54.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0036528789999999999 2024-09-10T06:27:54.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.460859+0000", 2024-09-10T06:27:54.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3159999999999996e-05 2024-09-10T06:27:54.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.460911+0000", 2024-09-10T06:27:54.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1354999999999999e-05 2024-09-10T06:27:54.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.460984+0000", 2024-09-10T06:27:54.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3129999999999999e-05 2024-09-10T06:27:54.807 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.807 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.807 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.807 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4862.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94420710002608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:54.808 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:54.458120+0000", 2024-09-10T06:27:54.808 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.253172234, 2024-09-10T06:27:54.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005430224, 2024-09-10T06:27:54.808 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.808 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.808 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.808 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.808 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4862", 2024-09-10T06:27:54.808 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/933126221", 2024-09-10T06:27:54.808 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 57 2024-09-10T06:27:54.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.808 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458120+0000", 2024-09-10T06:27:54.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458120+0000", 2024-09-10T06:27:54.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458121+0000", 2024-09-10T06:27:54.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2900000000000003e-07 2024-09-10T06:27:54.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458126+0000", 2024-09-10T06:27:54.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3349999999999997e-06 2024-09-10T06:27:54.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458135+0000", 2024-09-10T06:27:54.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.473e-06 2024-09-10T06:27:54.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458140+0000", 2024-09-10T06:27:54.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8400000000000002e-06 2024-09-10T06:27:54.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458185+0000", 2024-09-10T06:27:54.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5046000000000002e-05 2024-09-10T06:27:54.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458254+0000", 2024-09-10T06:27:54.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8981999999999998e-05 2024-09-10T06:27:54.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:54.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458352+0000", 2024-09-10T06:27:54.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.836e-05 2024-09-10T06:27:54.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.463322+0000", 2024-09-10T06:27:54.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049695240000000003 2024-09-10T06:27:54.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.463460+0000", 2024-09-10T06:27:54.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138047 2024-09-10T06:27:54.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.463490+0000", 2024-09-10T06:27:54.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9842e-05 2024-09-10T06:27:54.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.463551+0000", 2024-09-10T06:27:54.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1045999999999998e-05 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4877.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94135091940656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:54.634362+0000", 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.076930178000000002, 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004389352, 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4877", 2024-09-10T06:27:54.814 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/2435058803", 2024-09-10T06:27:54.815 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 55 2024-09-10T06:27:54.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.815 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.634362+0000", 2024-09-10T06:27:54.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.634362+0000", 2024-09-10T06:27:54.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.634363+0000", 2024-09-10T06:27:54.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2399999999999997e-07 2024-09-10T06:27:54.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.634367+0000", 2024-09-10T06:27:54.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.647e-06 2024-09-10T06:27:54.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.634377+0000", 2024-09-10T06:27:54.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7189999999999996e-06 2024-09-10T06:27:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.634383+0000", 2024-09-10T06:27:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.72e-06 2024-09-10T06:27:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.634432+0000", 2024-09-10T06:27:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8884000000000002e-05 2024-09-10T06:27:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.634496+0000", 2024-09-10T06:27:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3986999999999996e-05 2024-09-10T06:27:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.634646+0000", 2024-09-10T06:27:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015027700000000001 2024-09-10T06:27:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.635948+0000", 2024-09-10T06:27:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013016340000000001 2024-09-10T06:27:54.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.638633+0000", 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026847939999999999 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.638684+0000", 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0659999999999999e-05 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.638752+0000", 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8206000000000004e-05 2024-09-10T06:27:54.819 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.820 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.820 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.820 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.820 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4877.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94135091944208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:54.820 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:54.636077+0000", 2024-09-10T06:27:54.820 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.075215939999999995, 2024-09-10T06:27:54.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0054411140000000004, 2024-09-10T06:27:54.820 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:54.820 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:54.820 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:54.820 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:54.820 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4877", 2024-09-10T06:27:54.820 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/2435058803", 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 57 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636077+0000", 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636077+0000", 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:54.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636078+0000", 2024-09-10T06:27:54.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9299999999999996e-07 2024-09-10T06:27:54.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:54.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636082+0000", 2024-09-10T06:27:54.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.048e-06 2024-09-10T06:27:54.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:54.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636093+0000", 2024-09-10T06:27:54.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1073999999999999e-05 2024-09-10T06:27:54.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:54.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636101+0000", 2024-09-10T06:27:54.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3000000000000002e-06 2024-09-10T06:27:54.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:54.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636150+0000", 2024-09-10T06:27:54.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8677000000000002e-05 2024-09-10T06:27:54.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:54.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636205+0000", 2024-09-10T06:27:54.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4885000000000001e-05 2024-09-10T06:27:54.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:54.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636281+0000", 2024-09-10T06:27:54.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.64e-05 2024-09-10T06:27:54.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:54.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636740+0000", 2024-09-10T06:27:54.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00045915700000000002 2024-09-10T06:27:54.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:54.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.641410+0000", 2024-09-10T06:27:54.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046697880000000002 2024-09-10T06:27:54.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:54.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.641459+0000", 2024-09-10T06:27:54.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8881999999999997e-05 2024-09-10T06:27:54.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:54.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:54.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:54.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.641518+0000", 2024-09-10T06:27:54.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9009999999999999e-05 2024-09-10T06:27:54.825 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.825 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.825 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.826 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:54.826 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:54.826 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:54.827 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:27:54.828 INFO:tasks.workunit.client.0.smithi112.stdout:user usr1 deleted 2024-09-10T06:27:54.828 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:54.824+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:54.927 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:54.924+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:54.929 INFO:tasks.workunit.client.0.smithi112.stdout:Bucket Created: buck_2024_08_10_06_27_54 2024-09-10T06:27:54.964 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:54.964 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:54.964 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:54.964 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:54.978 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:27:55.028 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:55.024+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:55.104 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:55.105 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:55.119 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:27:55.129 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:55.128+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:55.230 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:55.229+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:55.243 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:55.243 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:55.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:55.243 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:55.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.243 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-10T06:27:55.244 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:55.244 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 76.951818509000006, 2024-09-10T06:27:55.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047108059999999997, 2024-09-10T06:27:55.244 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.244 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.244 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.244 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:55.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291389+0000", 2024-09-10T06:27:55.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291391+0000", 2024-09-10T06:27:55.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8700000000000001e-06 2024-09-10T06:27:55.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291405+0000", 2024-09-10T06:27:55.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4623e-05 2024-09-10T06:27:55.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291438+0000", 2024-09-10T06:27:55.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2616000000000001e-05 2024-09-10T06:27:55.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291461+0000", 2024-09-10T06:27:55.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2883000000000001e-05 2024-09-10T06:27:55.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293024+0000", 2024-09-10T06:27:55.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015627709999999999 2024-09-10T06:27:55.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.293071+0000", 2024-09-10T06:27:55.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7797000000000003e-05 2024-09-10T06:27:55.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295983+0000", 2024-09-10T06:27:55.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029113640000000001 2024-09-10T06:27:55.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296100+0000", 2024-09-10T06:27:55.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116882 2024-09-10T06:27:55.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.248 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.248 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:55.248 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:55.248 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.910460731000001, 2024-09-10T06:27:55.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00338296, 2024-09-10T06:27:55.249 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.249 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.249 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 211 2024-09-10T06:27:55.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.249 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:55.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332747+0000", 2024-09-10T06:27:55.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332750+0000", 2024-09-10T06:27:55.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6830000000000001e-06 2024-09-10T06:27:55.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332767+0000", 2024-09-10T06:27:55.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.702e-05 2024-09-10T06:27:55.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332805+0000", 2024-09-10T06:27:55.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7950000000000001e-05 2024-09-10T06:27:55.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332824+0000", 2024-09-10T06:27:55.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8462999999999999e-05 2024-09-10T06:27:55.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.332950+0000", 2024-09-10T06:27:55.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012653600000000001 2024-09-10T06:27:55.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333177+0000", 2024-09-10T06:27:55.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022626800000000001 2024-09-10T06:27:55.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:55.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.333604+0000", 2024-09-10T06:27:55.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042759999999999999 2024-09-10T06:27:55.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335279+0000", 2024-09-10T06:27:55.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001674481 2024-09-10T06:27:55.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.335976+0000", 2024-09-10T06:27:55.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069707099999999995 2024-09-10T06:27:55.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336063+0000", 2024-09-10T06:27:55.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6916000000000006e-05 2024-09-10T06:27:55.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.336130+0000", 2024-09-10T06:27:55.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6971999999999995e-05 2024-09-10T06:27:55.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.254 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.254 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:55.254 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:55.255 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.837185856000005, 2024-09-10T06:27:55.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034123389999999999, 2024-09-10T06:27:55.255 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.255 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.255 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.255 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232 2024-09-10T06:27:55.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.255 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:55.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406022+0000", 2024-09-10T06:27:55.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406025+0000", 2024-09-10T06:27:55.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0860000000000002e-06 2024-09-10T06:27:55.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406040+0000", 2024-09-10T06:27:55.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5299999999999999e-05 2024-09-10T06:27:55.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406072+0000", 2024-09-10T06:27:55.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2543000000000003e-05 2024-09-10T06:27:55.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406088+0000", 2024-09-10T06:27:55.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5699999999999999e-05 2024-09-10T06:27:55.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406206+0000", 2024-09-10T06:27:55.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011828900000000001 2024-09-10T06:27:55.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406416+0000", 2024-09-10T06:27:55.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020969900000000001 2024-09-10T06:27:55.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.406804+0000", 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038783699999999998 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.408490+0000", 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001686353 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409152+0000", 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066160800000000005 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409314+0000", 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000162285 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.409434+0000", 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119639 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.817256411000002, 2024-09-10T06:27:55.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034077650000000001, 2024-09-10T06:27:55.261 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.261 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.261 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.261 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241 2024-09-10T06:27:55.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.261 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:55.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425951+0000", 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425954+0000", 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5469999999999999e-06 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425965+0000", 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.181e-05 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.425996+0000", 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0759000000000001e-05 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426011+0000", 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4507e-05 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426153+0000", 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014206599999999999 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426491+0000", 2024-09-10T06:27:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033830399999999999 2024-09-10T06:27:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.426973+0000", 2024-09-10T06:27:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000482113 2024-09-10T06:27:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.428378+0000", 2024-09-10T06:27:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001404539 2024-09-10T06:27:55.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429113+0000", 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073537799999999996 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429251+0000", 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013789600000000001 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.429359+0000", 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107846 2024-09-10T06:27:55.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:266 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.812523386999999, 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030966560000000001, 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.266 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 266 2024-09-10T06:27:55.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.267 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:55.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430684+0000", 2024-09-10T06:27:55.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430687+0000", 2024-09-10T06:27:55.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0299999999999998e-06 2024-09-10T06:27:55.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430702+0000", 2024-09-10T06:27:55.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5316999999999999e-05 2024-09-10T06:27:55.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430741+0000", 2024-09-10T06:27:55.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8336e-05 2024-09-10T06:27:55.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430762+0000", 2024-09-10T06:27:55.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.162e-05 2024-09-10T06:27:55.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.430923+0000", 2024-09-10T06:27:55.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016044599999999999 2024-09-10T06:27:55.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431103+0000", 2024-09-10T06:27:55.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018030100000000001 2024-09-10T06:27:55.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:55.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.431513+0000", 2024-09-10T06:27:55.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040992999999999997 2024-09-10T06:27:55.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.432715+0000", 2024-09-10T06:27:55.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001202411 2024-09-10T06:27:55.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433624+0000", 2024-09-10T06:27:55.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090863000000000001 2024-09-10T06:27:55.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433718+0000", 2024-09-10T06:27:55.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3749e-05 2024-09-10T06:27:55.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.433781+0000", 2024-09-10T06:27:55.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2885999999999994e-05 2024-09-10T06:27:55.271 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.271 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.272 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.272 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:341 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:55.272 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:55.272 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.797414239999995, 2024-09-10T06:27:55.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030260230000000001, 2024-09-10T06:27:55.272 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.272 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.272 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.272 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 341 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445793+0000", 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445796+0000", 2024-09-10T06:27:55.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7130000000000001e-06 2024-09-10T06:27:55.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445810+0000", 2024-09-10T06:27:55.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4564e-05 2024-09-10T06:27:55.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445886+0000", 2024-09-10T06:27:55.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5921999999999996e-05 2024-09-10T06:27:55.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.445902+0000", 2024-09-10T06:27:55.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5800000000000001e-05 2024-09-10T06:27:55.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446057+0000", 2024-09-10T06:27:55.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015475600000000001 2024-09-10T06:27:55.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446347+0000", 2024-09-10T06:27:55.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029057699999999998 2024-09-10T06:27:55.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:55.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.446669+0000", 2024-09-10T06:27:55.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032102399999999999 2024-09-10T06:27:55.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.447891+0000", 2024-09-10T06:27:55.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012226680000000001 2024-09-10T06:27:55.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448550+0000", 2024-09-10T06:27:55.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065925800000000002 2024-09-10T06:27:55.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448699+0000", 2024-09-10T06:27:55.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014831800000000001 2024-09-10T06:27:55.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.448819+0000", 2024-09-10T06:27:55.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120423 2024-09-10T06:27:55.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.277 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.278 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:513 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:55.278 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:55.278 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.712066433000004, 2024-09-10T06:27:55.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051813969999999999, 2024-09-10T06:27:55.278 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.278 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.278 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.279 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 513 2024-09-10T06:27:55.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.279 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:55.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531141+0000", 2024-09-10T06:27:55.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531143+0000", 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7400000000000001e-06 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531153+0000", 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.815e-06 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531178+0000", 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5755e-05 2024-09-10T06:27:55.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531190+0000", 2024-09-10T06:27:55.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1250000000000001e-05 2024-09-10T06:27:55.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531322+0000", 2024-09-10T06:27:55.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013239299999999999 2024-09-10T06:27:55.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531550+0000", 2024-09-10T06:27:55.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000227598 2024-09-10T06:27:55.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:55.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531966+0000", 2024-09-10T06:27:55.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041634400000000002 2024-09-10T06:27:55.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533197+0000", 2024-09-10T06:27:55.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012308810000000001 2024-09-10T06:27:55.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536097+0000", 2024-09-10T06:27:55.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029007159999999998 2024-09-10T06:27:55.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536245+0000", 2024-09-10T06:27:55.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000147816 2024-09-10T06:27:55.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536322+0000", 2024-09-10T06:27:55.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7088999999999993e-05 2024-09-10T06:27:55.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.283 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:514 6.2 6:4578209b:::obj_delete_at_hint.0000000014:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.711994235999995, 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048258260000000001, 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 514 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.284 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:55.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531213+0000", 2024-09-10T06:27:55.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531214+0000", 2024-09-10T06:27:55.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2699999999999998e-07 2024-09-10T06:27:55.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531219+0000", 2024-09-10T06:27:55.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.356e-06 2024-09-10T06:27:55.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531233+0000", 2024-09-10T06:27:55.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.38e-05 2024-09-10T06:27:55.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531240+0000", 2024-09-10T06:27:55.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7399999999999998e-06 2024-09-10T06:27:55.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531378+0000", 2024-09-10T06:27:55.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013860399999999999 2024-09-10T06:27:55.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.531600+0000", 2024-09-10T06:27:55.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221287 2024-09-10T06:27:55.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.532007+0000", 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040728500000000001 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.533131+0000", 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011240429999999999 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535894+0000", 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027628650000000002 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.535973+0000", 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9399000000000003e-05 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.536039+0000", 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5619999999999999e-05 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:655 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:55.289 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.612051698000002, 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003017207, 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 655 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:55.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631156+0000", 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631159+0000", 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8270000000000002e-06 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631173+0000", 2024-09-10T06:27:55.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4739999999999999e-05 2024-09-10T06:27:55.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631206+0000", 2024-09-10T06:27:55.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2425999999999998e-05 2024-09-10T06:27:55.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631221+0000", 2024-09-10T06:27:55.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4927e-05 2024-09-10T06:27:55.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631336+0000", 2024-09-10T06:27:55.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115062 2024-09-10T06:27:55.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.631547+0000", 2024-09-10T06:27:55.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021178200000000001 2024-09-10T06:27:55.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:55.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.632034+0000", 2024-09-10T06:27:55.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000486899 2024-09-10T06:27:55.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633413+0000", 2024-09-10T06:27:55.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001379077 2024-09-10T06:27:55.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.633891+0000", 2024-09-10T06:27:55.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000477489 2024-09-10T06:27:55.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634057+0000", 2024-09-10T06:27:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016608500000000001 2024-09-10T06:27:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.634173+0000", 2024-09-10T06:27:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115893 2024-09-10T06:27:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:658 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:55.295 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.608037453999998, 2024-09-10T06:27:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030550820000000002, 2024-09-10T06:27:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 658 2024-09-10T06:27:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635170+0000", 2024-09-10T06:27:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635171+0000", 2024-09-10T06:27:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.322e-06 2024-09-10T06:27:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635178+0000", 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7950000000000002e-06 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635197+0000", 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8845e-05 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635215+0000", 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7822e-05 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635329+0000", 2024-09-10T06:27:55.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011433 2024-09-10T06:27:55.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.635554+0000", 2024-09-10T06:27:55.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022527800000000001 2024-09-10T06:27:55.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:55.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.636007+0000", 2024-09-10T06:27:55.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045297099999999998 2024-09-10T06:27:55.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637198+0000", 2024-09-10T06:27:55.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011902740000000001 2024-09-10T06:27:55.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.637961+0000", 2024-09-10T06:27:55.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000763234 2024-09-10T06:27:55.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638110+0000", 2024-09-10T06:27:55.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149259 2024-09-10T06:27:55.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.638225+0000", 2024-09-10T06:27:55.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011495200000000001 2024-09-10T06:27:55.301 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.301 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.301 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.302 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:55.302 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:55.302 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.504859378000006, 2024-09-10T06:27:55.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030399789999999999, 2024-09-10T06:27:55.302 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.302 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.302 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.302 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.302 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 727 2024-09-10T06:27:55.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.303 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:55.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738348+0000", 2024-09-10T06:27:55.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738350+0000", 2024-09-10T06:27:55.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2199999999999999e-06 2024-09-10T06:27:55.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738360+0000", 2024-09-10T06:27:55.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0122999999999999e-05 2024-09-10T06:27:55.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738384+0000", 2024-09-10T06:27:55.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3390000000000001e-05 2024-09-10T06:27:55.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738397+0000", 2024-09-10T06:27:55.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2896e-05 2024-09-10T06:27:55.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738524+0000", 2024-09-10T06:27:55.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126883 2024-09-10T06:27:55.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.738752+0000", 2024-09-10T06:27:55.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022864200000000001 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.739080+0000", 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032783699999999999 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.740085+0000", 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001005438 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741203+0000", 2024-09-10T06:27:55.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011175919999999999 2024-09-10T06:27:55.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741280+0000", 2024-09-10T06:27:55.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6545999999999995e-05 2024-09-10T06:27:55.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.741388+0000", 2024-09-10T06:27:55.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108412 2024-09-10T06:27:55.307 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.307 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.307 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.308 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1184 4.3d 4:bc5efe7d:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:55.308 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.158431+0000", 2024-09-10T06:27:55.308 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.0847768179999999, 2024-09-10T06:27:55.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049660060000000002, 2024-09-10T06:27:55.308 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.308 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.308 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.308 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.308 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.308 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.308 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1184 2024-09-10T06:27:55.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.308 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158431+0000", 2024-09-10T06:27:55.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158431+0000", 2024-09-10T06:27:55.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158435+0000", 2024-09-10T06:27:55.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.053e-06 2024-09-10T06:27:55.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158450+0000", 2024-09-10T06:27:55.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5264000000000002e-05 2024-09-10T06:27:55.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158491+0000", 2024-09-10T06:27:55.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1134999999999998e-05 2024-09-10T06:27:55.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158514+0000", 2024-09-10T06:27:55.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2717e-05 2024-09-10T06:27:55.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158707+0000", 2024-09-10T06:27:55.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019278599999999999 2024-09-10T06:27:55.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.159176+0000", 2024-09-10T06:27:55.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046986899999999998 2024-09-10T06:27:55.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.159550+0000", 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037331300000000001 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.161252+0000", 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001702117 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.163222+0000", 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019696919999999999 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.163331+0000", 2024-09-10T06:27:55.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109905 2024-09-10T06:27:55.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.163397+0000", 2024-09-10T06:27:55.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5154999999999995e-05 2024-09-10T06:27:55.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.313 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.313 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1190 4.30 4:0fbb28cb:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.158580+0000", 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.084627024, 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007565273, 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1190 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158580+0000", 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158580+0000", 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158582+0000", 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7269999999999999e-06 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158592+0000", 2024-09-10T06:27:55.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-09-10T06:27:55.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158626+0000", 2024-09-10T06:27:55.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3893000000000002e-05 2024-09-10T06:27:55.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158646+0000", 2024-09-10T06:27:55.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0152999999999998e-05 2024-09-10T06:27:55.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158797+0000", 2024-09-10T06:27:55.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151151 2024-09-10T06:27:55.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.159191+0000", 2024-09-10T06:27:55.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039390300000000003 2024-09-10T06:27:55.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:55.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.159628+0000", 2024-09-10T06:27:55.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00043659500000000002 2024-09-10T06:27:55.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.163285+0000", 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036576830000000001 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.165947+0000", 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026620849999999998 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.166035+0000", 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7732999999999995e-05 2024-09-10T06:27:55.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.166146+0000", 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011061399999999999 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1192 4.38 e62/24 4:1e517a8a:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.8:head v 62'1, mlcod=0'0)", 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.160902+0000", 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.082305144, 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037291669999999998, 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.319 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160902+0000", 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160902+0000", 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160904+0000", 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9659999999999999e-06 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160916+0000", 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2106999999999999e-05 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160948+0000", 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2008999999999998e-05 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160968+0000", 2024-09-10T06:27:55.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9723000000000001e-05 2024-09-10T06:27:55.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.161092+0000", 2024-09-10T06:27:55.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012387100000000001 2024-09-10T06:27:55.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.161139+0000", 2024-09-10T06:27:55.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6726e-05 2024-09-10T06:27:55.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.164514+0000", 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003375734 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.164631+0000", 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117031 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4877.0:138 4.3d 4:bc5efe7d:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.732626+0000", 2024-09-10T06:27:55.323 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.51058132099999998, 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056758820000000001, 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4877", 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/2435058803", 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 138 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732626+0000", 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732626+0000", 2024-09-10T06:27:55.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732628+0000", 2024-09-10T06:27:55.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4329999999999998e-06 2024-09-10T06:27:55.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732643+0000", 2024-09-10T06:27:55.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.453e-05 2024-09-10T06:27:55.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732709+0000", 2024-09-10T06:27:55.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6235999999999994e-05 2024-09-10T06:27:55.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732732+0000", 2024-09-10T06:27:55.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2742e-05 2024-09-10T06:27:55.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732892+0000", 2024-09-10T06:27:55.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016046100000000001 2024-09-10T06:27:55.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733095+0000", 2024-09-10T06:27:55.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020228999999999999 2024-09-10T06:27:55.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:55.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733427+0000", 2024-09-10T06:27:55.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033189100000000001 2024-09-10T06:27:55.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.735230+0000", 2024-09-10T06:27:55.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018030139999999999 2024-09-10T06:27:55.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.738033+0000", 2024-09-10T06:27:55.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028037769999999999 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.738196+0000", 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016247399999999999 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.738302+0000", 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010603399999999999 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.330 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4877.0:144 4.30 4:0fbb28cb:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:55.330 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.732813+0000", 2024-09-10T06:27:55.330 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.51039464700000003, 2024-09-10T06:27:55.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032530049999999998, 2024-09-10T06:27:55.330 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.330 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.330 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4877", 2024-09-10T06:27:55.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/2435058803", 2024-09-10T06:27:55.330 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 144 2024-09-10T06:27:55.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.330 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732813+0000", 2024-09-10T06:27:55.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732813+0000", 2024-09-10T06:27:55.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732822+0000", 2024-09-10T06:27:55.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1929999999999999e-06 2024-09-10T06:27:55.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732831+0000", 2024-09-10T06:27:55.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1859999999999998e-06 2024-09-10T06:27:55.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732858+0000", 2024-09-10T06:27:55.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7036e-05 2024-09-10T06:27:55.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732875+0000", 2024-09-10T06:27:55.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6387000000000001e-05 2024-09-10T06:27:55.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733005+0000", 2024-09-10T06:27:55.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013019999999999999 2024-09-10T06:27:55.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733197+0000", 2024-09-10T06:27:55.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019247700000000001 2024-09-10T06:27:55.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:55.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733464+0000", 2024-09-10T06:27:55.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026632899999999999 2024-09-10T06:27:55.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.735611+0000", 2024-09-10T06:27:55.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021474319999999999 2024-09-10T06:27:55.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.735817+0000", 2024-09-10T06:27:55.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020566599999999999 2024-09-10T06:27:55.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.735966+0000", 2024-09-10T06:27:55.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014961099999999999 2024-09-10T06:27:55.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.736066+0000", 2024-09-10T06:27:55.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9487999999999993e-05 2024-09-10T06:27:55.335 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.335 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.335 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.336 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4877.0:146 4.38 e62/24 4:1e517a8a:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.8:head v 62'2, mlcod=0'0)", 2024-09-10T06:27:55.336 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.735714+0000", 2024-09-10T06:27:55.336 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50749360600000004, 2024-09-10T06:27:55.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003117758, 2024-09-10T06:27:55.336 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.336 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.336 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.336 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.735714+0000", 2024-09-10T06:27:55.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.735714+0000", 2024-09-10T06:27:55.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.735715+0000", 2024-09-10T06:27:55.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.13e-06 2024-09-10T06:27:55.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.735726+0000", 2024-09-10T06:27:55.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1113e-05 2024-09-10T06:27:55.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.735746+0000", 2024-09-10T06:27:55.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0454000000000001e-05 2024-09-10T06:27:55.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.735761+0000", 2024-09-10T06:27:55.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4792e-05 2024-09-10T06:27:55.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.735975+0000", 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021418000000000001 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.736028+0000", 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2748999999999999e-05 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.738711+0000", 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002682972 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.738832+0000", 2024-09-10T06:27:55.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120368 2024-09-10T06:27:55.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.340 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.340 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1228 4.22 4:44276f69:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.4.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:55.340 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.918525+0000", 2024-09-10T06:27:55.340 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.32468195500000002, 2024-09-10T06:27:55.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052756080000000002, 2024-09-10T06:27:55.340 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.340 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.341 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.341 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1228 2024-09-10T06:27:55.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.341 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918525+0000", 2024-09-10T06:27:55.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918525+0000", 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918530+0000", 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.177e-06 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918550+0000", 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0873000000000002e-05 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918600+0000", 2024-09-10T06:27:55.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9749000000000001e-05 2024-09-10T06:27:55.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918624+0000", 2024-09-10T06:27:55.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3751999999999999e-05 2024-09-10T06:27:55.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918772+0000", 2024-09-10T06:27:55.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014771399999999999 2024-09-10T06:27:55.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918941+0000", 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016907099999999999 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919138+0000", 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019767100000000001 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920759+0000", 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001620776 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923680+0000", 2024-09-10T06:27:55.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029204970000000002 2024-09-10T06:27:55.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923748+0000", 2024-09-10T06:27:55.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7821e-05 2024-09-10T06:27:55.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923801+0000", 2024-09-10T06:27:55.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3507000000000001e-05 2024-09-10T06:27:55.345 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1230 4.c 4:309de729:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.4.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.918785+0000", 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.324421976, 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003026206, 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1230 2024-09-10T06:27:55.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.347 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918785+0000", 2024-09-10T06:27:55.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918785+0000", 2024-09-10T06:27:55.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918787+0000", 2024-09-10T06:27:55.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5230000000000001e-06 2024-09-10T06:27:55.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918795+0000", 2024-09-10T06:27:55.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8630000000000008e-06 2024-09-10T06:27:55.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918814+0000", 2024-09-10T06:27:55.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9616999999999999e-05 2024-09-10T06:27:55.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918829+0000", 2024-09-10T06:27:55.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4912999999999999e-05 2024-09-10T06:27:55.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918983+0000", 2024-09-10T06:27:55.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000153284 2024-09-10T06:27:55.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919282+0000", 2024-09-10T06:27:55.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029972799999999997 2024-09-10T06:27:55.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:55.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919642+0000", 2024-09-10T06:27:55.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000359286 2024-09-10T06:27:55.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920970+0000", 2024-09-10T06:27:55.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00132833 2024-09-10T06:27:55.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.921684+0000", 2024-09-10T06:27:55.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071396399999999998 2024-09-10T06:27:55.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.921753+0000", 2024-09-10T06:27:55.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9082e-05 2024-09-10T06:27:55.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.921812+0000", 2024-09-10T06:27:55.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8616000000000003e-05 2024-09-10T06:27:55.351 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.351 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.351 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.352 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1232 4.5 e62/24 4:a254e6b7:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.4.7:head v 62'1, mlcod=0'0)", 2024-09-10T06:27:55.352 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.920253+0000", 2024-09-10T06:27:55.352 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.32295437399999999, 2024-09-10T06:27:55.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003308737, 2024-09-10T06:27:55.352 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.352 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.352 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.352 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920253+0000", 2024-09-10T06:27:55.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920253+0000", 2024-09-10T06:27:55.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920254+0000", 2024-09-10T06:27:55.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.277e-06 2024-09-10T06:27:55.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920286+0000", 2024-09-10T06:27:55.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1390999999999998e-05 2024-09-10T06:27:55.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920300+0000", 2024-09-10T06:27:55.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4175000000000001e-05 2024-09-10T06:27:55.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920309+0000", 2024-09-10T06:27:55.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5170000000000005e-06 2024-09-10T06:27:55.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920401+0000", 2024-09-10T06:27:55.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1729000000000002e-05 2024-09-10T06:27:55.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920443+0000", 2024-09-10T06:27:55.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1795999999999998e-05 2024-09-10T06:27:55.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923440+0000", 2024-09-10T06:27:55.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029975100000000001 2024-09-10T06:27:55.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923562+0000", 2024-09-10T06:27:55.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121342 2024-09-10T06:27:55.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.356 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.356 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.356 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:55.358 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:27:55.358 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:55.357+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:55.459 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:55.456+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:55.527 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:55.527 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:55.527 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:55.527 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:55.541 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:27:55.592 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:55.593+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:55.617 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T06:27:55.660 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:55.661+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:55.665 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:55.665 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:55.665 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:55.665 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:55.665 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:55.679 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:27:55.692 INFO:tasks.workunit.client.0.smithi112.stderr:100+0 records in 2024-09-10T06:27:55.692 INFO:tasks.workunit.client.0.smithi112.stderr:100+0 records out 2024-09-10T06:27:55.692 INFO:tasks.workunit.client.0.smithi112.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 0.639471 s, 1.6 GB/s 2024-09-10T06:27:55.772 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:55.773+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:55.849 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:55.850 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:55.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:55.850 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:55.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.850 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4236.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-10T06:27:55.850 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:23.499464+0000", 2024-09-10T06:27:55.850 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 92.348487348999996, 2024-09-10T06:27:55.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013449099000000001, 2024-09-10T06:27:55.850 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.850 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.850 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4236", 2024-09-10T06:27:55.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1622831300", 2024-09-10T06:27:55.851 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1 2024-09-10T06:27:55.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.851 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499464+0000", 2024-09-10T06:27:55.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499464+0000", 2024-09-10T06:27:55.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499474+0000", 2024-09-10T06:27:55.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.004e-05 2024-09-10T06:27:55.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499488+0000", 2024-09-10T06:27:55.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3516000000000001e-05 2024-09-10T06:27:55.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499514+0000", 2024-09-10T06:27:55.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6310000000000001e-05 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.499538+0000", 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3589000000000001e-05 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.500297+0000", 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000759908 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.500351+0000", 2024-09-10T06:27:55.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3285999999999998e-05 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.506506+0000", 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061553090000000003 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.506862+0000", 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035549099999999999 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.507143+0000", 2024-09-10T06:27:55.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000281964 2024-09-10T06:27:55.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.509394+0000", 2024-09-10T06:27:55.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022506700000000002 2024-09-10T06:27:55.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.512769+0000", 2024-09-10T06:27:55.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033745899999999998 2024-09-10T06:27:55.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.512850+0000", 2024-09-10T06:27:55.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1446000000000006e-05 2024-09-10T06:27:55.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:23.512913+0000", 2024-09-10T06:27:55.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2979999999999997e-05 2024-09-10T06:27:55.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.856 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.856 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4236.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-10T06:27:55.856 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:24.509270+0000", 2024-09-10T06:27:55.856 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 91.338681546999993, 2024-09-10T06:27:55.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068216769999999999, 2024-09-10T06:27:55.857 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.857 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.857 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4236", 2024-09-10T06:27:55.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1622831300", 2024-09-10T06:27:55.857 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 5 2024-09-10T06:27:55.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.857 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509270+0000", 2024-09-10T06:27:55.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509270+0000", 2024-09-10T06:27:55.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509273+0000", 2024-09-10T06:27:55.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4199999999999999e-06 2024-09-10T06:27:55.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509288+0000", 2024-09-10T06:27:55.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4732999999999999e-05 2024-09-10T06:27:55.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509322+0000", 2024-09-10T06:27:55.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3596000000000002e-05 2024-09-10T06:27:55.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509345+0000", 2024-09-10T06:27:55.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3767000000000001e-05 2024-09-10T06:27:55.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509475+0000", 2024-09-10T06:27:55.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130099 2024-09-10T06:27:55.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:27:55.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.509486+0000", 2024-09-10T06:27:55.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.083e-05 2024-09-10T06:27:55.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.512854+0000", 2024-09-10T06:27:55.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00336748 2024-09-10T06:27:55.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.513079+0000", 2024-09-10T06:27:55.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000225565 2024-09-10T06:27:55.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:55.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.513291+0000", 2024-09-10T06:27:55.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021120199999999999 2024-09-10T06:27:55.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.514873+0000", 2024-09-10T06:27:55.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001582841 2024-09-10T06:27:55.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.515896+0000", 2024-09-10T06:27:55.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010226619999999999 2024-09-10T06:27:55.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.515976+0000", 2024-09-10T06:27:55.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0055999999999994e-05 2024-09-10T06:27:55.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:24.516092+0000", 2024-09-10T06:27:55.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115426 2024-09-10T06:27:55.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.863 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.863 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4236.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T06:27:55.863 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:25.528375+0000", 2024-09-10T06:27:55.863 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 90.319576030999997, 2024-09-10T06:27:55.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070604630000000003, 2024-09-10T06:27:55.863 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.863 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.864 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4236", 2024-09-10T06:27:55.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1622831300", 2024-09-10T06:27:55.864 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 7 2024-09-10T06:27:55.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.864 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528375+0000", 2024-09-10T06:27:55.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528375+0000", 2024-09-10T06:27:55.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528379+0000", 2024-09-10T06:27:55.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.19e-06 2024-09-10T06:27:55.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528393+0000", 2024-09-10T06:27:55.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4474000000000001e-05 2024-09-10T06:27:55.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528429+0000", 2024-09-10T06:27:55.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6273000000000003e-05 2024-09-10T06:27:55.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528448+0000", 2024-09-10T06:27:55.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.827e-05 2024-09-10T06:27:55.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528578+0000", 2024-09-10T06:27:55.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013027899999999999 2024-09-10T06:27:55.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:27:55.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.528588+0000", 2024-09-10T06:27:55.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.042e-05 2024-09-10T06:27:55.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.532249+0000", 2024-09-10T06:27:55.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003660955 2024-09-10T06:27:55.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.532448+0000", 2024-09-10T06:27:55.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019897799999999999 2024-09-10T06:27:55.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:55.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.532832+0000", 2024-09-10T06:27:55.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038408399999999998 2024-09-10T06:27:55.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.534422+0000", 2024-09-10T06:27:55.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001589708 2024-09-10T06:27:55.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.535279+0000", 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00085695599999999997 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.535365+0000", 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6348999999999996e-05 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:25.535436+0000", 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0526999999999997e-05 2024-09-10T06:27:55.869 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.870 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.870 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:55.870 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.297889+0000", 2024-09-10T06:27:55.870 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 77.550062830000002, 2024-09-10T06:27:55.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015273603, 2024-09-10T06:27:55.870 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.870 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.870 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.871 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48 2024-09-10T06:27:55.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.871 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297889+0000", 2024-09-10T06:27:55.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297889+0000", 2024-09-10T06:27:55.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297892+0000", 2024-09-10T06:27:55.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.703e-06 2024-09-10T06:27:55.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297905+0000", 2024-09-10T06:27:55.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2874000000000001e-05 2024-09-10T06:27:55.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297930+0000", 2024-09-10T06:27:55.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5029999999999999e-05 2024-09-10T06:27:55.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297946+0000", 2024-09-10T06:27:55.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5336e-05 2024-09-10T06:27:55.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298133+0000", 2024-09-10T06:27:55.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187725 2024-09-10T06:27:55.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:27:55.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298154+0000", 2024-09-10T06:27:55.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0953000000000001e-05 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.310851+0000", 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012696522999999999 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.311061+0000", 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021023799999999999 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.311247+0000", 2024-09-10T06:27:55.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018557900000000001 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.312771+0000", 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015244119999999999 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.312957+0000", 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000185885 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313037+0000", 2024-09-10T06:27:55.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9802999999999995e-05 2024-09-10T06:27:55.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.313162+0000", 2024-09-10T06:27:55.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000125542 2024-09-10T06:27:55.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.876 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.876 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-10T06:27:55.876 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.297211+0000", 2024-09-10T06:27:55.876 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.550740079999997, 2024-09-10T06:27:55.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041349439999999998, 2024-09-10T06:27:55.877 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.877 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.877 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.877 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205 2024-09-10T06:27:55.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.877 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297211+0000", 2024-09-10T06:27:55.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297211+0000", 2024-09-10T06:27:55.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297215+0000", 2024-09-10T06:27:55.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1930000000000002e-06 2024-09-10T06:27:55.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297229+0000", 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.472e-05 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297265+0000", 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5407000000000002e-05 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297290+0000", 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5153000000000001e-05 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297482+0000", 2024-09-10T06:27:55.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019209199999999999 2024-09-10T06:27:55.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.297721+0000", 2024-09-10T06:27:55.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023919499999999999 2024-09-10T06:27:55.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:55.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.298183+0000", 2024-09-10T06:27:55.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046180899999999998 2024-09-10T06:27:55.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.299918+0000", 2024-09-10T06:27:55.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001734827 2024-09-10T06:27:55.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.301183+0000", 2024-09-10T06:27:55.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001265347 2024-09-10T06:27:55.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.301273+0000", 2024-09-10T06:27:55.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0031999999999995e-05 2024-09-10T06:27:55.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.301346+0000", 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3169000000000004e-05 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:353 6.4 e34/28 6:25ca39bb:::obj_delete_at_hint.0000000005:head v 34'6, mlcod=34'4)", 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.451186+0000", 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.396765741999999, 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050475579999999997, 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.882 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.883 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.883 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451186+0000", 2024-09-10T06:27:55.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451186+0000", 2024-09-10T06:27:55.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451191+0000", 2024-09-10T06:27:55.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.677e-06 2024-09-10T06:27:55.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451202+0000", 2024-09-10T06:27:55.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0777e-05 2024-09-10T06:27:55.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451225+0000", 2024-09-10T06:27:55.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3329999999999999e-05 2024-09-10T06:27:55.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451237+0000", 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1226000000000001e-05 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451356+0000", 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118989 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.451405+0000", 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9395999999999999e-05 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.456155+0000", 2024-09-10T06:27:55.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047504239999999996 2024-09-10T06:27:55.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.456233+0000", 2024-09-10T06:27:55.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7738999999999995e-05 2024-09-10T06:27:55.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.886 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.886 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:441 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.481408+0000", 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.366543852000007, 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076439680000000001, 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 441 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481408+0000", 2024-09-10T06:27:55.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481408+0000", 2024-09-10T06:27:55.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481410+0000", 2024-09-10T06:27:55.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6539999999999999e-06 2024-09-10T06:27:55.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481428+0000", 2024-09-10T06:27:55.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7336000000000001e-05 2024-09-10T06:27:55.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481468+0000", 2024-09-10T06:27:55.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0062999999999999e-05 2024-09-10T06:27:55.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481494+0000", 2024-09-10T06:27:55.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6616999999999999e-05 2024-09-10T06:27:55.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481625+0000", 2024-09-10T06:27:55.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013042800000000001 2024-09-10T06:27:55.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.481867+0000", 2024-09-10T06:27:55.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024220399999999999 2024-09-10T06:27:55.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:27:55.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.482325+0000", 2024-09-10T06:27:55.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045814199999999998 2024-09-10T06:27:55.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483548+0000", 2024-09-10T06:27:55.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012227900000000001 2024-09-10T06:27:55.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488857+0000", 2024-09-10T06:27:55.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053088120000000004 2024-09-10T06:27:55.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488959+0000", 2024-09-10T06:27:55.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102787 2024-09-10T06:27:55.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489052+0000", 2024-09-10T06:27:55.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2134999999999998e-05 2024-09-10T06:27:55.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.892 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.892 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:444 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:55.892 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.483111+0000", 2024-09-10T06:27:55.892 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.364840665000003, 2024-09-10T06:27:55.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055206379999999996, 2024-09-10T06:27:55.893 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.893 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.893 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 444 2024-09-10T06:27:55.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.893 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483111+0000", 2024-09-10T06:27:55.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483111+0000", 2024-09-10T06:27:55.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483114+0000", 2024-09-10T06:27:55.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1300000000000001e-06 2024-09-10T06:27:55.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483128+0000", 2024-09-10T06:27:55.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4032999999999999e-05 2024-09-10T06:27:55.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483161+0000", 2024-09-10T06:27:55.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3062999999999998e-05 2024-09-10T06:27:55.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483181+0000", 2024-09-10T06:27:55.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0486999999999999e-05 2024-09-10T06:27:55.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483316+0000", 2024-09-10T06:27:55.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013411099999999999 2024-09-10T06:27:55.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.483642+0000", 2024-09-10T06:27:55.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032656299999999998 2024-09-10T06:27:55.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:55.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484153+0000", 2024-09-10T06:27:55.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00051090200000000004 2024-09-10T06:27:55.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.485759+0000", 2024-09-10T06:27:55.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001606215 2024-09-10T06:27:55.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488482+0000", 2024-09-10T06:27:55.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027225079999999998 2024-09-10T06:27:55.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488569+0000", 2024-09-10T06:27:55.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7602999999999995e-05 2024-09-10T06:27:55.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488631+0000", 2024-09-10T06:27:55.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2022999999999999e-05 2024-09-10T06:27:55.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.898 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.898 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:453 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:55.898 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.489376+0000", 2024-09-10T06:27:55.898 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.358575513000005, 2024-09-10T06:27:55.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052737419999999997, 2024-09-10T06:27:55.899 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.899 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.899 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.899 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 453 2024-09-10T06:27:55.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.899 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489376+0000", 2024-09-10T06:27:55.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489376+0000", 2024-09-10T06:27:55.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489378+0000", 2024-09-10T06:27:55.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9470000000000002e-06 2024-09-10T06:27:55.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489385+0000", 2024-09-10T06:27:55.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5830000000000001e-06 2024-09-10T06:27:55.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489408+0000", 2024-09-10T06:27:55.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2739999999999999e-05 2024-09-10T06:27:55.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.489418+0000", 2024-09-10T06:27:55.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8730000000000002e-06 2024-09-10T06:27:55.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.490351+0000", 2024-09-10T06:27:55.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093270600000000005 2024-09-10T06:27:55.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.490602+0000", 2024-09-10T06:27:55.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025102499999999999 2024-09-10T06:27:55.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:55.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.490955+0000", 2024-09-10T06:27:55.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035311000000000001 2024-09-10T06:27:55.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494256+0000", 2024-09-10T06:27:55.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003301109 2024-09-10T06:27:55.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494417+0000", 2024-09-10T06:27:55.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016123799999999999 2024-09-10T06:27:55.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494571+0000", 2024-09-10T06:27:55.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000153425 2024-09-10T06:27:55.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494650+0000", 2024-09-10T06:27:55.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8986000000000006e-05 2024-09-10T06:27:55.904 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.904 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.904 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.904 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:457 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:55.904 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.492971+0000", 2024-09-10T06:27:55.904 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.354980451000003, 2024-09-10T06:27:55.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038003139999999999, 2024-09-10T06:27:55.904 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 457 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492971+0000", 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492971+0000", 2024-09-10T06:27:55.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492973+0000", 2024-09-10T06:27:55.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0499999999999999e-06 2024-09-10T06:27:55.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.492981+0000", 2024-09-10T06:27:55.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1200000000000002e-06 2024-09-10T06:27:55.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493005+0000", 2024-09-10T06:27:55.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4125999999999999e-05 2024-09-10T06:27:55.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493017+0000", 2024-09-10T06:27:55.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.148e-05 2024-09-10T06:27:55.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493092+0000", 2024-09-10T06:27:55.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5112999999999997e-05 2024-09-10T06:27:55.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493294+0000", 2024-09-10T06:27:55.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020212100000000001 2024-09-10T06:27:55.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:55.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.493743+0000", 2024-09-10T06:27:55.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000449436 2024-09-10T06:27:55.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.494855+0000", 2024-09-10T06:27:55.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00111181 2024-09-10T06:27:55.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.496621+0000", 2024-09-10T06:27:55.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017657090000000001 2024-09-10T06:27:55.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.496701+0000", 2024-09-10T06:27:55.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0259000000000005e-05 2024-09-10T06:27:55.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.496771+0000", 2024-09-10T06:27:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0090000000000001e-05 2024-09-10T06:27:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1188 4.3e 4:7e120715:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.158442+0000", 2024-09-10T06:27:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.6895089240000001, 2024-09-10T06:27:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051178229999999996, 2024-09-10T06:27:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.911 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1188 2024-09-10T06:27:55.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.911 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158442+0000", 2024-09-10T06:27:55.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158442+0000", 2024-09-10T06:27:55.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158445+0000", 2024-09-10T06:27:55.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8559999999999998e-06 2024-09-10T06:27:55.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158459+0000", 2024-09-10T06:27:55.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3176999999999999e-05 2024-09-10T06:27:55.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158489+0000", 2024-09-10T06:27:55.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0916e-05 2024-09-10T06:27:55.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158505+0000", 2024-09-10T06:27:55.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5503e-05 2024-09-10T06:27:55.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158704+0000", 2024-09-10T06:27:55.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019891 2024-09-10T06:27:55.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.159029+0000", 2024-09-10T06:27:55.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032559400000000001 2024-09-10T06:27:55.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:55.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.159400+0000", 2024-09-10T06:27:55.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037077699999999998 2024-09-10T06:27:55.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.163274+0000", 2024-09-10T06:27:55.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038738620000000001 2024-09-10T06:27:55.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.163335+0000", 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1398999999999999e-05 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.163455+0000", 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011979100000000001 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.163560+0000", 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010503800000000001 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.915 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.916 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1192 4.38 4:1e517a8a:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:55.916 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.158544+0000", 2024-09-10T06:27:55.916 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.6894078700000001, 2024-09-10T06:27:55.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070556660000000004, 2024-09-10T06:27:55.916 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.916 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.916 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.916 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.916 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.916 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1192 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158544+0000", 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158544+0000", 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158545+0000", 2024-09-10T06:27:55.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3799999999999999e-06 2024-09-10T06:27:55.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158552+0000", 2024-09-10T06:27:55.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5399999999999998e-06 2024-09-10T06:27:55.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158752+0000", 2024-09-10T06:27:55.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019928 2024-09-10T06:27:55.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158773+0000", 2024-09-10T06:27:55.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1083000000000001e-05 2024-09-10T06:27:55.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.159033+0000", 2024-09-10T06:27:55.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026015899999999999 2024-09-10T06:27:55.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.159356+0000", 2024-09-10T06:27:55.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032252799999999999 2024-09-10T06:27:55.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:55.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.159726+0000", 2024-09-10T06:27:55.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037012999999999998 2024-09-10T06:27:55.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.163144+0000", 2024-09-10T06:27:55.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034179560000000002 2024-09-10T06:27:55.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.165411+0000", 2024-09-10T06:27:55.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022674000000000001 2024-09-10T06:27:55.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.165537+0000", 2024-09-10T06:27:55.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000125828 2024-09-10T06:27:55.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.165599+0000", 2024-09-10T06:27:55.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2382e-05 2024-09-10T06:27:55.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.921 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.922 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1193 4.25 4:a6ad8dd5:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:55.922 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.158836+0000", 2024-09-10T06:27:55.922 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.689115658, 2024-09-10T06:27:55.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064802289999999997, 2024-09-10T06:27:55.922 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.922 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.922 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:55.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:55.922 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1193 2024-09-10T06:27:55.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158836+0000", 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158836+0000", 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158838+0000", 2024-09-10T06:27:55.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.827e-06 2024-09-10T06:27:55.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158848+0000", 2024-09-10T06:27:55.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0406e-05 2024-09-10T06:27:55.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158872+0000", 2024-09-10T06:27:55.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3915999999999999e-05 2024-09-10T06:27:55.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.158886+0000", 2024-09-10T06:27:55.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3973e-05 2024-09-10T06:27:55.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.159040+0000", 2024-09-10T06:27:55.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015446500000000001 2024-09-10T06:27:55.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.159329+0000", 2024-09-10T06:27:55.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028880799999999999 2024-09-10T06:27:55.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:55.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.159716+0000", 2024-09-10T06:27:55.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038724300000000001 2024-09-10T06:27:55.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.163210+0000", 2024-09-10T06:27:55.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003493562 2024-09-10T06:27:55.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.165098+0000", 2024-09-10T06:27:55.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001888252 2024-09-10T06:27:55.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.165208+0000", 2024-09-10T06:27:55.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109825 2024-09-10T06:27:55.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.165316+0000", 2024-09-10T06:27:55.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107952 2024-09-10T06:27:55.927 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.927 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.927 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.928 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1187 4.7 e62/24 4:e0bd7d6f:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.3:head v 62'5, mlcod=62'3)", 2024-09-10T06:27:55.928 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.160041+0000", 2024-09-10T06:27:55.928 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.6879105160000001, 2024-09-10T06:27:55.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046246120000000002, 2024-09-10T06:27:55.928 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.928 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.928 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160041+0000", 2024-09-10T06:27:55.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160041+0000", 2024-09-10T06:27:55.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160043+0000", 2024-09-10T06:27:55.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4439999999999998e-06 2024-09-10T06:27:55.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160057+0000", 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4126e-05 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160090+0000", 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2042999999999998e-05 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160109+0000", 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9789999999999999e-05 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160385+0000", 2024-09-10T06:27:55.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027576500000000003 2024-09-10T06:27:55.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160437+0000", 2024-09-10T06:27:55.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1755000000000002e-05 2024-09-10T06:27:55.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.164549+0000", 2024-09-10T06:27:55.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041125340000000002 2024-09-10T06:27:55.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.164666+0000", 2024-09-10T06:27:55.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116155 2024-09-10T06:27:55.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.933 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.933 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1185 4.1f e62/24 4:fb778365:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.1:head v 62'3, mlcod=61'1)", 2024-09-10T06:27:55.933 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.160119+0000", 2024-09-10T06:27:55.933 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.687832564, 2024-09-10T06:27:55.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046460379999999999, 2024-09-10T06:27:55.933 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.933 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.934 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.934 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160119+0000", 2024-09-10T06:27:55.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160119+0000", 2024-09-10T06:27:55.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160120+0000", 2024-09-10T06:27:55.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.637e-06 2024-09-10T06:27:55.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160134+0000", 2024-09-10T06:27:55.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3269e-05 2024-09-10T06:27:55.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160159+0000", 2024-09-10T06:27:55.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5164000000000002e-05 2024-09-10T06:27:55.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160180+0000", 2024-09-10T06:27:55.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1259000000000001e-05 2024-09-10T06:27:55.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160572+0000", 2024-09-10T06:27:55.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039158999999999998 2024-09-10T06:27:55.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.160623+0000", 2024-09-10T06:27:55.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1582999999999997e-05 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.164673+0000", 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040501139999999996 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.164765+0000", 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1422000000000007e-05 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.938 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4877.0:142 4.3e 4:7e120715:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:55.938 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.732661+0000", 2024-09-10T06:27:55.938 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.115290348, 2024-09-10T06:27:55.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040930640000000004, 2024-09-10T06:27:55.938 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.938 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.938 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4877", 2024-09-10T06:27:55.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/2435058803", 2024-09-10T06:27:55.938 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 142 2024-09-10T06:27:55.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.938 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732661+0000", 2024-09-10T06:27:55.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732661+0000", 2024-09-10T06:27:55.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732664+0000", 2024-09-10T06:27:55.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.503e-06 2024-09-10T06:27:55.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732674+0000", 2024-09-10T06:27:55.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0593e-05 2024-09-10T06:27:55.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732710+0000", 2024-09-10T06:27:55.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5989999999999999e-05 2024-09-10T06:27:55.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732732+0000", 2024-09-10T06:27:55.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1359e-05 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732969+0000", 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000237746 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733263+0000", 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029335199999999998 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733537+0000", 2024-09-10T06:27:55.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027399199999999997 2024-09-10T06:27:55.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.735732+0000", 2024-09-10T06:27:55.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021953039999999999 2024-09-10T06:27:55.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.736607+0000", 2024-09-10T06:27:55.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000875281 2024-09-10T06:27:55.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.736690+0000", 2024-09-10T06:27:55.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3154999999999999e-05 2024-09-10T06:27:55.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.736754+0000", 2024-09-10T06:27:55.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3788999999999995e-05 2024-09-10T06:27:55.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.943 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4877.0:146 4.38 4:1e517a8a:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:55.943 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.732842+0000", 2024-09-10T06:27:55.943 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.1151092410000001, 2024-09-10T06:27:55.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064091620000000004, 2024-09-10T06:27:55.944 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4877", 2024-09-10T06:27:55.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/2435058803", 2024-09-10T06:27:55.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 146 2024-09-10T06:27:55.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.944 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732842+0000", 2024-09-10T06:27:55.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732842+0000", 2024-09-10T06:27:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732844+0000", 2024-09-10T06:27:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8759999999999999e-06 2024-09-10T06:27:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732854+0000", 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9000000000000001e-06 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732905+0000", 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1208999999999997e-05 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732926+0000", 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0687e-05 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733076+0000", 2024-09-10T06:27:55.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015027399999999999 2024-09-10T06:27:55.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.734025+0000", 2024-09-10T06:27:55.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094912299999999996 2024-09-10T06:27:55.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:55.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.734306+0000", 2024-09-10T06:27:55.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028075499999999999 2024-09-10T06:27:55.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.738347+0000", 2024-09-10T06:27:55.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040413949999999997 2024-09-10T06:27:55.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.739102+0000", 2024-09-10T06:27:55.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075428300000000002 2024-09-10T06:27:55.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.739185+0000", 2024-09-10T06:27:55.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3465000000000001e-05 2024-09-10T06:27:55.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.739251+0000", 2024-09-10T06:27:55.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6194999999999999e-05 2024-09-10T06:27:55.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.949 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.949 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4877.0:147 4.25 4:a6ad8dd5:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:55.949 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.733140+0000", 2024-09-10T06:27:55.949 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.1148118730000001, 2024-09-10T06:27:55.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083649840000000007, 2024-09-10T06:27:55.949 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.949 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4877", 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/2435058803", 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 147 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733140+0000", 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733140+0000", 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733141+0000", 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7099999999999999e-06 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733149+0000", 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1200000000000002e-06 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733172+0000", 2024-09-10T06:27:55.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2895999999999999e-05 2024-09-10T06:27:55.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733190+0000", 2024-09-10T06:27:55.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7363e-05 2024-09-10T06:27:55.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733326+0000", 2024-09-10T06:27:55.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136308 2024-09-10T06:27:55.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733527+0000", 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000200786 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733747+0000", 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022070600000000001 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.738499+0000", 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047515430000000004 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:55.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.741364+0000", 2024-09-10T06:27:55.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028649489999999999 2024-09-10T06:27:55.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.741444+0000", 2024-09-10T06:27:55.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0331e-05 2024-09-10T06:27:55.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.741505+0000", 2024-09-10T06:27:55.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0272000000000002e-05 2024-09-10T06:27:55.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.954 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.955 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4877.0:141 4.7 e62/24 4:e0bd7d6f:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.3:head v 62'6, mlcod=62'4)", 2024-09-10T06:27:55.955 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.733206+0000", 2024-09-10T06:27:55.955 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.1147450670000001, 2024-09-10T06:27:55.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052834659999999997, 2024-09-10T06:27:55.955 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.955 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.955 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733206+0000", 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733206+0000", 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733209+0000", 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.34e-06 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.734360+0000", 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011517020000000001 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.734388+0000", 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7572999999999998e-05 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.734404+0000", 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6436999999999999e-05 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.734550+0000", 2024-09-10T06:27:55.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014567700000000001 2024-09-10T06:27:55.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.734599+0000", 2024-09-10T06:27:55.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9188999999999999e-05 2024-09-10T06:27:55.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.738402+0000", 2024-09-10T06:27:55.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003802279 2024-09-10T06:27:55.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.738490+0000", 2024-09-10T06:27:55.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8269000000000005e-05 2024-09-10T06:27:55.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.959 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.959 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4877.0:139 4.1f e62/24 4:fb778365:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.1:head v 62'4, mlcod=61'2)", 2024-09-10T06:27:55.959 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.733705+0000", 2024-09-10T06:27:55.959 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.114246533, 2024-09-10T06:27:55.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046881400000000004, 2024-09-10T06:27:55.959 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:55.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:55.959 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733705+0000", 2024-09-10T06:27:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733705+0000", 2024-09-10T06:27:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733707+0000", 2024-09-10T06:27:55.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.823e-06 2024-09-10T06:27:55.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:55.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733720+0000", 2024-09-10T06:27:55.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3084e-05 2024-09-10T06:27:55.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:55.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733744+0000", 2024-09-10T06:27:55.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3929000000000001e-05 2024-09-10T06:27:55.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733761+0000", 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7683e-05 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733906+0000", 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144921 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733958+0000", 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1232e-05 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:55.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.738282+0000", 2024-09-10T06:27:55.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043242100000000002 2024-09-10T06:27:55.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:55.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:55.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:55.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.738393+0000", 2024-09-10T06:27:55.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111258 2024-09-10T06:27:55.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.963 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:55.963 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:55.963 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:55.965 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:27:55.965 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:55.965+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:56.066 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:56.064+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:56.134 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:27:56.134 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:56.148 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:27:56.167 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:56.164+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:56.254 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:27:56.266 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:56.267 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:56.267 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:56.267 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:56.267 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:56.267 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:56.265+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:56.281 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:27:56.367 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:56.364+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:56.399 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:56.399 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:56.412 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:56.413 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:56.430 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:56.430 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:56.445 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:56.446 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:56.450 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:27:56.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:27:56.451 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:56.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.451 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4349.0:36 5.1f 5:ff606e21:::zone_info.dfef714d-986b-43cb-b095-512e386c9309:head [create,call version.set in=10b,writefull 0~993] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-10T06:27:56.451 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:34.314860+0000", 2024-09-10T06:27:56.451 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.134289917999993, 2024-09-10T06:27:56.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003107603, 2024-09-10T06:27:56.451 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.451 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.451 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:56.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4349", 2024-09-10T06:27:56.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/3803391124", 2024-09-10T06:27:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 36 2024-09-10T06:27:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314860+0000", 2024-09-10T06:27:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314860+0000", 2024-09-10T06:27:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314861+0000", 2024-09-10T06:27:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9069999999999999e-06 2024-09-10T06:27:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314871+0000", 2024-09-10T06:27:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2969999999999992e-06 2024-09-10T06:27:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314892+0000", 2024-09-10T06:27:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1443000000000001e-05 2024-09-10T06:27:56.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.314904+0000", 2024-09-10T06:27:56.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2072999999999999e-05 2024-09-10T06:27:56.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.315021+0000", 2024-09-10T06:27:56.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117019 2024-09-10T06:27:56.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.315390+0000", 2024-09-10T06:27:56.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036879700000000003 2024-09-10T06:27:56.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:56.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.315847+0000", 2024-09-10T06:27:56.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045647599999999998 2024-09-10T06:27:56.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:56.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317460+0000", 2024-09-10T06:27:56.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001613172 2024-09-10T06:27:56.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:56.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317782+0000", 2024-09-10T06:27:56.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032208300000000003 2024-09-10T06:27:56.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317899+0000", 2024-09-10T06:27:56.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117549 2024-09-10T06:27:56.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:34.317967+0000", 2024-09-10T06:27:56.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7787000000000007e-05 2024-09-10T06:27:56.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.457 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.457 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.457 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:56.457 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:27:56.457 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 78.169132411000007, 2024-09-10T06:27:56.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016848367, 2024-09-10T06:27:56.457 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.457 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.457 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:56.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:56.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:56.458 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 46 2024-09-10T06:27:56.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.458 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:27:56.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:27:56.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280021+0000", 2024-09-10T06:27:56.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0069999999999999e-06 2024-09-10T06:27:56.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280036+0000", 2024-09-10T06:27:56.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.483e-05 2024-09-10T06:27:56.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280070+0000", 2024-09-10T06:27:56.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4106000000000002e-05 2024-09-10T06:27:56.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280094+0000", 2024-09-10T06:27:56.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4037e-05 2024-09-10T06:27:56.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280246+0000", 2024-09-10T06:27:56.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000152199 2024-09-10T06:27:56.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:27:56.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280271+0000", 2024-09-10T06:27:56.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4581999999999999e-05 2024-09-10T06:27:56.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.289388+0000", 2024-09-10T06:27:56.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091175639999999999 2024-09-10T06:27:56.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.290774+0000", 2024-09-10T06:27:56.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013859860000000001 2024-09-10T06:27:56.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:56.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291069+0000", 2024-09-10T06:27:56.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000294534 2024-09-10T06:27:56.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:56.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295828+0000", 2024-09-10T06:27:56.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047595729999999996 2024-09-10T06:27:56.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:56.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296614+0000", 2024-09-10T06:27:56.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00078534700000000004 2024-09-10T06:27:56.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296759+0000", 2024-09-10T06:27:56.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014571300000000001 2024-09-10T06:27:56.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296865+0000", 2024-09-10T06:27:56.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105889 2024-09-10T06:27:56.463 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.464 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.464 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.464 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94143734761600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:27:56.464 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.297713+0000", 2024-09-10T06:27:56.464 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 78.151436220999997, 2024-09-10T06:27:56.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007058847, 2024-09-10T06:27:56.464 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.464 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.464 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.464 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:56.464 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:56.465 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:56.465 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 47 2024-09-10T06:27:56.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.465 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297713+0000", 2024-09-10T06:27:56.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297713+0000", 2024-09-10T06:27:56.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297718+0000", 2024-09-10T06:27:56.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3329999999999998e-06 2024-09-10T06:27:56.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297733+0000", 2024-09-10T06:27:56.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5477000000000001e-05 2024-09-10T06:27:56.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297767+0000", 2024-09-10T06:27:56.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3859999999999998e-05 2024-09-10T06:27:56.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297793+0000", 2024-09-10T06:27:56.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6455999999999999e-05 2024-09-10T06:27:56.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.297941+0000", 2024-09-10T06:27:56.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014803599999999999 2024-09-10T06:27:56.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298148+0000", 2024-09-10T06:27:56.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020703299999999999 2024-09-10T06:27:56.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:56.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.298513+0000", 2024-09-10T06:27:56.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036422599999999999 2024-09-10T06:27:56.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:56.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304449+0000", 2024-09-10T06:27:56.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059367029999999998 2024-09-10T06:27:56.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:56.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304478+0000", 2024-09-10T06:27:56.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8836999999999999e-05 2024-09-10T06:27:56.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304599+0000", 2024-09-10T06:27:56.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012068100000000001 2024-09-10T06:27:56.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304772+0000", 2024-09-10T06:27:56.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017320500000000001 2024-09-10T06:27:56.470 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.470 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.470 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.470 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4358.0:47 7.1f e31/30 ondisk, result = 0)", 2024-09-10T06:27:56.470 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.300682+0000", 2024-09-10T06:27:56.470 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 78.148467742999998, 2024-09-10T06:27:56.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00409582, 2024-09-10T06:27:56.470 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.470 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.470 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-09-10T06:27:56.470 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300682+0000", 2024-09-10T06:27:56.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300682+0000", 2024-09-10T06:27:56.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300684+0000", 2024-09-10T06:27:56.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9829999999999999e-06 2024-09-10T06:27:56.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300695+0000", 2024-09-10T06:27:56.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1347e-05 2024-09-10T06:27:56.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300722+0000", 2024-09-10T06:27:56.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.694e-05 2024-09-10T06:27:56.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.300742+0000", 2024-09-10T06:27:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9772999999999999e-05 2024-09-10T06:27:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304416+0000", 2024-09-10T06:27:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036739339999999998 2024-09-10T06:27:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304436+0000", 2024-09-10T06:27:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9953999999999999e-05 2024-09-10T06:27:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.304777+0000", 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034188900000000001 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:377 6.c e34/28 6:3677c228:::obj_delete_at_hint.0000000006:head v 34'1, mlcod=0'0)", 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.462034+0000", 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.987115098000004, 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050687509999999998, 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.474 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.475 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462034+0000", 2024-09-10T06:27:56.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462034+0000", 2024-09-10T06:27:56.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462036+0000", 2024-09-10T06:27:56.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.827e-06 2024-09-10T06:27:56.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462048+0000", 2024-09-10T06:27:56.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1636e-05 2024-09-10T06:27:56.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462068+0000", 2024-09-10T06:27:56.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0463999999999999e-05 2024-09-10T06:27:56.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462082+0000", 2024-09-10T06:27:56.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4086e-05 2024-09-10T06:27:56.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462200+0000", 2024-09-10T06:27:56.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117769 2024-09-10T06:27:56.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.462250+0000", 2024-09-10T06:27:56.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9790000000000003e-05 2024-09-10T06:27:56.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.466985+0000", 2024-09-10T06:27:56.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047353370000000001 2024-09-10T06:27:56.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.467103+0000", 2024-09-10T06:27:56.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117842 2024-09-10T06:27:56.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.478 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.479 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:444 6.a e34/28 6:50d64734:::obj_delete_at_hint.0000000009:head v 34'2, mlcod=0'0)", 2024-09-10T06:27:56.479 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.484329+0000", 2024-09-10T06:27:56.479 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.964820273000001, 2024-09-10T06:27:56.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038926529999999998, 2024-09-10T06:27:56.479 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.479 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.479 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.479 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484329+0000", 2024-09-10T06:27:56.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484329+0000", 2024-09-10T06:27:56.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484331+0000", 2024-09-10T06:27:56.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.66e-06 2024-09-10T06:27:56.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484342+0000", 2024-09-10T06:27:56.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0986e-05 2024-09-10T06:27:56.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484366+0000", 2024-09-10T06:27:56.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4026999999999999e-05 2024-09-10T06:27:56.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484384+0000", 2024-09-10T06:27:56.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8147000000000001e-05 2024-09-10T06:27:56.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484525+0000", 2024-09-10T06:27:56.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014151499999999999 2024-09-10T06:27:56.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.484595+0000", 2024-09-10T06:27:56.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9085999999999996e-05 2024-09-10T06:27:56.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488044+0000", 2024-09-10T06:27:56.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034494040000000001 2024-09-10T06:27:56.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.488222+0000", 2024-09-10T06:27:56.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017782799999999999 2024-09-10T06:27:56.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.483 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.483 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:480 6.5 e34/28 6:a4a56432:::obj_delete_at_hint.0000000012:head v 34'4, mlcod=34'2)", 2024-09-10T06:27:56.483 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.509954+0000", 2024-09-10T06:27:56.483 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.939195232000003, 2024-09-10T06:27:56.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038074789999999999, 2024-09-10T06:27:56.483 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.483 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.483 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.483 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509954+0000", 2024-09-10T06:27:56.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509954+0000", 2024-09-10T06:27:56.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509955+0000", 2024-09-10T06:27:56.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.266e-06 2024-09-10T06:27:56.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509966+0000", 2024-09-10T06:27:56.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0900000000000001e-05 2024-09-10T06:27:56.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.509993+0000", 2024-09-10T06:27:56.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6633999999999999e-05 2024-09-10T06:27:56.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.510011+0000", 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8377e-05 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.510141+0000", 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130063 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.510193+0000", 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2011000000000001e-05 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.513634+0000", 2024-09-10T06:27:56.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034407119999999999 2024-09-10T06:27:56.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.513762+0000", 2024-09-10T06:27:56.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012751599999999999 2024-09-10T06:27:56.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.487 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.487 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:485 6.5 e34/28 6:a7f90313:reshard::reshard.0000000012:head v 34'5, mlcod=34'2)", 2024-09-10T06:27:56.488 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.512302+0000", 2024-09-10T06:27:56.488 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.936846951999996, 2024-09-10T06:27:56.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041747709999999999, 2024-09-10T06:27:56.488 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.488 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.488 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512302+0000", 2024-09-10T06:27:56.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512302+0000", 2024-09-10T06:27:56.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512304+0000", 2024-09-10T06:27:56.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6929999999999999e-06 2024-09-10T06:27:56.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512318+0000", 2024-09-10T06:27:56.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.344e-05 2024-09-10T06:27:56.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512342+0000", 2024-09-10T06:27:56.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4456000000000001e-05 2024-09-10T06:27:56.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512354+0000", 2024-09-10T06:27:56.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2414e-05 2024-09-10T06:27:56.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512484+0000", 2024-09-10T06:27:56.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012974500000000001 2024-09-10T06:27:56.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.512523+0000", 2024-09-10T06:27:56.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9124e-05 2024-09-10T06:27:56.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.516392+0000", 2024-09-10T06:27:56.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038686060000000001 2024-09-10T06:27:56.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.516477+0000", 2024-09-10T06:27:56.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5292999999999998e-05 2024-09-10T06:27:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:490 6.5 e34/28 6:a4a56432:::obj_delete_at_hint.0000000012:head v 34'6, mlcod=34'3)", 2024-09-10T06:27:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:41.515761+0000", 2024-09-10T06:27:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.933387925000005, 2024-09-10T06:27:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034429859999999999, 2024-09-10T06:27:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515761+0000", 2024-09-10T06:27:56.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515761+0000", 2024-09-10T06:27:56.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515764+0000", 2024-09-10T06:27:56.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2699999999999999e-06 2024-09-10T06:27:56.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515779+0000", 2024-09-10T06:27:56.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4973e-05 2024-09-10T06:27:56.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515812+0000", 2024-09-10T06:27:56.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3713000000000001e-05 2024-09-10T06:27:56.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515832+0000", 2024-09-10T06:27:56.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9176000000000001e-05 2024-09-10T06:27:56.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.515956+0000", 2024-09-10T06:27:56.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123881 2024-09-10T06:27:56.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.516008+0000", 2024-09-10T06:27:56.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2703e-05 2024-09-10T06:27:56.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.519125+0000", 2024-09-10T06:27:56.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003117098 2024-09-10T06:27:56.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:41.519204+0000", 2024-09-10T06:27:56.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9171999999999993e-05 2024-09-10T06:27:56.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.496 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.496 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:937 6.1f e34/28 6:fd6b5df8:::obj_delete_at_hint.0000000120:head v 34'10, mlcod=34'8)", 2024-09-10T06:27:56.496 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:42.208068+0000", 2024-09-10T06:27:56.497 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 74.241081258999998, 2024-09-10T06:27:56.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036467819999999999, 2024-09-10T06:27:56.497 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.497 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.497 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.497 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208068+0000", 2024-09-10T06:27:56.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208068+0000", 2024-09-10T06:27:56.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208070+0000", 2024-09-10T06:27:56.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.283e-06 2024-09-10T06:27:56.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208083+0000", 2024-09-10T06:27:56.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2303999999999999e-05 2024-09-10T06:27:56.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208111+0000", 2024-09-10T06:27:56.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8473e-05 2024-09-10T06:27:56.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208124+0000", 2024-09-10T06:27:56.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2866e-05 2024-09-10T06:27:56.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208273+0000", 2024-09-10T06:27:56.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014932300000000001 2024-09-10T06:27:56.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.208312+0000", 2024-09-10T06:27:56.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8442999999999998e-05 2024-09-10T06:27:56.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.211643+0000", 2024-09-10T06:27:56.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033307609999999998 2024-09-10T06:27:56.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:42.211715+0000", 2024-09-10T06:27:56.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2329000000000005e-05 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4844.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93928265537472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.269814+0000", 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.1793353560000002, 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031997699999999998, 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4844", 2024-09-10T06:27:56.501 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/2352786803", 2024-09-10T06:27:56.502 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45 2024-09-10T06:27:56.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.502 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.269814+0000", 2024-09-10T06:27:56.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.269814+0000", 2024-09-10T06:27:56.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.269816+0000", 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1600000000000001e-06 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.269843+0000", 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6614999999999998e-05 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.269866+0000", 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3654000000000001e-05 2024-09-10T06:27:56.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.269879+0000", 2024-09-10T06:27:56.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2143e-05 2024-09-10T06:27:56.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.269971+0000", 2024-09-10T06:27:56.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2695000000000006e-05 2024-09-10T06:27:56.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.270100+0000", 2024-09-10T06:27:56.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000128224 2024-09-10T06:27:56.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:56.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.270320+0000", 2024-09-10T06:27:56.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000220776 2024-09-10T06:27:56.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:56.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.271710+0000", 2024-09-10T06:27:56.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001390002 2024-09-10T06:27:56.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:56.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.272677+0000", 2024-09-10T06:27:56.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00096648700000000003 2024-09-10T06:27:56.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.272828+0000", 2024-09-10T06:27:56.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015145100000000001 2024-09-10T06:27:56.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.273014+0000", 2024-09-10T06:27:56.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000185563 2024-09-10T06:27:56.506 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.507 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.507 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.507 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4844.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:56.507 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.276900+0000", 2024-09-10T06:27:56.507 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.1722498250000002, 2024-09-10T06:27:56.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003286158, 2024-09-10T06:27:56.507 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.507 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.507 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:56.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4844", 2024-09-10T06:27:56.507 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/2352786803", 2024-09-10T06:27:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 52 2024-09-10T06:27:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.276900+0000", 2024-09-10T06:27:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.276900+0000", 2024-09-10T06:27:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.276902+0000", 2024-09-10T06:27:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0329999999999998e-06 2024-09-10T06:27:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.276909+0000", 2024-09-10T06:27:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0530000000000001e-06 2024-09-10T06:27:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.276938+0000", 2024-09-10T06:27:56.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9003e-05 2024-09-10T06:27:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.276953+0000", 2024-09-10T06:27:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5099999999999999e-05 2024-09-10T06:27:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.277082+0000", 2024-09-10T06:27:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012961400000000001 2024-09-10T06:27:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.277221+0000", 2024-09-10T06:27:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000138758 2024-09-10T06:27:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.277535+0000", 2024-09-10T06:27:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031400699999999999 2024-09-10T06:27:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.278660+0000", 2024-09-10T06:27:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011249400000000001 2024-09-10T06:27:56.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:56.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.280030+0000", 2024-09-10T06:27:56.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00136983 2024-09-10T06:27:56.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.280114+0000", 2024-09-10T06:27:56.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3720999999999993e-05 2024-09-10T06:27:56.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.280186+0000", 2024-09-10T06:27:56.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2099000000000002e-05 2024-09-10T06:27:56.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.513 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.513 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4862.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94420709981040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:56.513 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.447600+0000", 2024-09-10T06:27:56.513 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.0015489930000001, 2024-09-10T06:27:56.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041188639999999999, 2024-09-10T06:27:56.513 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.513 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.513 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.513 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:56.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4862", 2024-09-10T06:27:56.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/933126221", 2024-09-10T06:27:56.514 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45 2024-09-10T06:27:56.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.514 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.447600+0000", 2024-09-10T06:27:56.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.447600+0000", 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.447602+0000", 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8870000000000001e-06 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.447611+0000", 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1589999999999999e-06 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.447640+0000", 2024-09-10T06:27:56.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8425999999999999e-05 2024-09-10T06:27:56.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.447658+0000", 2024-09-10T06:27:56.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7876999999999998e-05 2024-09-10T06:27:56.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.447798+0000", 2024-09-10T06:27:56.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014054000000000001 2024-09-10T06:27:56.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.448029+0000", 2024-09-10T06:27:56.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023096299999999999 2024-09-10T06:27:56.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:56.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.448433+0000", 2024-09-10T06:27:56.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040345600000000001 2024-09-10T06:27:56.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:56.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.451295+0000", 2024-09-10T06:27:56.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002861943 2024-09-10T06:27:56.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:56.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.451358+0000", 2024-09-10T06:27:56.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3199000000000003e-05 2024-09-10T06:27:56.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.451540+0000", 2024-09-10T06:27:56.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018243999999999999 2024-09-10T06:27:56.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.451719+0000", 2024-09-10T06:27:56.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017897400000000001 2024-09-10T06:27:56.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.519 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.519 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4877.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94135091935856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:56.519 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.634310+0000", 2024-09-10T06:27:56.519 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.8148397140000001, 2024-09-10T06:27:56.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057822669999999998, 2024-09-10T06:27:56.519 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.519 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.519 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.520 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:56.520 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4877", 2024-09-10T06:27:56.520 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/2435058803", 2024-09-10T06:27:56.520 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 53 2024-09-10T06:27:56.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.520 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.634310+0000", 2024-09-10T06:27:56.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.634310+0000", 2024-09-10T06:27:56.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.634312+0000", 2024-09-10T06:27:56.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8300000000000001e-06 2024-09-10T06:27:56.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.634325+0000", 2024-09-10T06:27:56.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3506000000000001e-05 2024-09-10T06:27:56.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.634347+0000", 2024-09-10T06:27:56.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2209e-05 2024-09-10T06:27:56.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.634360+0000", 2024-09-10T06:27:56.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.292e-05 2024-09-10T06:27:56.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.634479+0000", 2024-09-10T06:27:56.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011903799999999999 2024-09-10T06:27:56.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.634699+0000", 2024-09-10T06:27:56.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022028600000000001 2024-09-10T06:27:56.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:56.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.635099+0000", 2024-09-10T06:27:56.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039953999999999999 2024-09-10T06:27:56.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:56.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.636235+0000", 2024-09-10T06:27:56.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00113638 2024-09-10T06:27:56.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:56.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.639753+0000", 2024-09-10T06:27:56.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035179640000000002 2024-09-10T06:27:56.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.639907+0000", 2024-09-10T06:27:56.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000153437 2024-09-10T06:27:56.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.640092+0000", 2024-09-10T06:27:56.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000185157 2024-09-10T06:27:56.525 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.525 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.525 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.525 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4877.0:139 4.1f 4:fb778365:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.3.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:56.525 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.732639+0000", 2024-09-10T06:27:56.525 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.71651, 2024-09-10T06:27:56.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062724620000000003, 2024-09-10T06:27:56.525 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.525 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.525 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4877", 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/2435058803", 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 139 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732639+0000", 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732639+0000", 2024-09-10T06:27:56.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732642+0000", 2024-09-10T06:27:56.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9670000000000001e-06 2024-09-10T06:27:56.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732654+0000", 2024-09-10T06:27:56.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1779e-05 2024-09-10T06:27:56.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732696+0000", 2024-09-10T06:27:56.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1680000000000001e-05 2024-09-10T06:27:56.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732718+0000", 2024-09-10T06:27:56.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2096e-05 2024-09-10T06:27:56.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.732902+0000", 2024-09-10T06:27:56.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000184193 2024-09-10T06:27:56.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733135+0000", 2024-09-10T06:27:56.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000232616 2024-09-10T06:27:56.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:56.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.733395+0000", 2024-09-10T06:27:56.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026011200000000001 2024-09-10T06:27:56.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:56.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.737937+0000", 2024-09-10T06:27:56.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045423800000000004 2024-09-10T06:27:56.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:56.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.738727+0000", 2024-09-10T06:27:56.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00078961899999999998 2024-09-10T06:27:56.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.738811+0000", 2024-09-10T06:27:56.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4347999999999999e-05 2024-09-10T06:27:56.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.738912+0000", 2024-09-10T06:27:56.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100672 2024-09-10T06:27:56.531 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.531 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.531 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.532 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1232 4.5 4:a254e6b7:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.4.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:56.532 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.918496+0000", 2024-09-10T06:27:56.532 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.530653458, 2024-09-10T06:27:56.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053561119999999997, 2024-09-10T06:27:56.532 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.532 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.532 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.532 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:56.532 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:56.532 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:56.532 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1232 2024-09-10T06:27:56.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.533 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918496+0000", 2024-09-10T06:27:56.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918496+0000", 2024-09-10T06:27:56.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918498+0000", 2024-09-10T06:27:56.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2230000000000001e-06 2024-09-10T06:27:56.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918507+0000", 2024-09-10T06:27:56.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3130000000000004e-06 2024-09-10T06:27:56.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918530+0000", 2024-09-10T06:27:56.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2475000000000001e-05 2024-09-10T06:27:56.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918543+0000", 2024-09-10T06:27:56.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3176000000000001e-05 2024-09-10T06:27:56.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918660+0000", 2024-09-10T06:27:56.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116519 2024-09-10T06:27:56.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918878+0000", 2024-09-10T06:27:56.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021784500000000001 2024-09-10T06:27:56.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:56.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919060+0000", 2024-09-10T06:27:56.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018245100000000001 2024-09-10T06:27:56.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:56.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920746+0000", 2024-09-10T06:27:56.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001685934 2024-09-10T06:27:56.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:56.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923762+0000", 2024-09-10T06:27:56.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030160819999999998 2024-09-10T06:27:56.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923812+0000", 2024-09-10T06:27:56.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0090999999999999e-05 2024-09-10T06:27:56.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923852+0000", 2024-09-10T06:27:56.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0003000000000003e-05 2024-09-10T06:27:56.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.537 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1233 4.3c 4:3fe2046a:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.4.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.918577+0000", 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.5305728890000001, 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049195690000000004, 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1233 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.538 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918577+0000", 2024-09-10T06:27:56.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918577+0000", 2024-09-10T06:27:56.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918577+0000", 2024-09-10T06:27:56.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3099999999999997e-07 2024-09-10T06:27:56.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918582+0000", 2024-09-10T06:27:56.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8570000000000003e-06 2024-09-10T06:27:56.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918598+0000", 2024-09-10T06:27:56.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5636000000000001e-05 2024-09-10T06:27:56.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918606+0000", 2024-09-10T06:27:56.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9969999999999998e-06 2024-09-10T06:27:56.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.918734+0000", 2024-09-10T06:27:56.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012841400000000001 2024-09-10T06:27:56.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919104+0000", 2024-09-10T06:27:56.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037015399999999998 2024-09-10T06:27:56.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919481+0000", 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037632600000000002 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920665+0000", 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001184594 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923369+0000", 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027035729999999999 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923443+0000", 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4009000000000002e-05 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923496+0000", 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3278e-05 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1225 4.12 e62/24 4:4b853175:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.4.0:head v 62'1, mlcod=0'0)", 2024-09-10T06:27:56.543 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.919725+0000", 2024-09-10T06:27:56.544 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.5294247350000001, 2024-09-10T06:27:56.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037075540000000001, 2024-09-10T06:27:56.544 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.544 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.544 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.544 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919725+0000", 2024-09-10T06:27:56.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919725+0000", 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919726+0000", 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.316e-06 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919735+0000", 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5080000000000005e-06 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919751+0000", 2024-09-10T06:27:56.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6078000000000001e-05 2024-09-10T06:27:56.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919760+0000", 2024-09-10T06:27:56.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4870000000000008e-06 2024-09-10T06:27:56.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919984+0000", 2024-09-10T06:27:56.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022430599999999999 2024-09-10T06:27:56.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920009+0000", 2024-09-10T06:27:56.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-09-10T06:27:56.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923375+0000", 2024-09-10T06:27:56.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003366029 2024-09-10T06:27:56.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923432+0000", 2024-09-10T06:27:56.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7708999999999999e-05 2024-09-10T06:27:56.547 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.548 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.548 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1231 4.12 e62/24 4:4a0c76b0:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.4.6:head v 62'2, mlcod=0'0)", 2024-09-10T06:27:56.548 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.919791+0000", 2024-09-10T06:27:56.548 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.529358792, 2024-09-10T06:27:56.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041255329999999998, 2024-09-10T06:27:56.548 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.548 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.548 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.548 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919791+0000", 2024-09-10T06:27:56.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919791+0000", 2024-09-10T06:27:56.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919791+0000", 2024-09-10T06:27:56.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2699999999999999e-07 2024-09-10T06:27:56.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919802+0000", 2024-09-10T06:27:56.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.063e-05 2024-09-10T06:27:56.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919812+0000", 2024-09-10T06:27:56.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0574000000000001e-05 2024-09-10T06:27:56.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919819+0000", 2024-09-10T06:27:56.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9380000000000003e-06 2024-09-10T06:27:56.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920322+0000", 2024-09-10T06:27:56.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00050314399999999997 2024-09-10T06:27:56.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920375+0000", 2024-09-10T06:27:56.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2405999999999999e-05 2024-09-10T06:27:56.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923877+0000", 2024-09-10T06:27:56.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003502537 2024-09-10T06:27:56.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923916+0000", 2024-09-10T06:27:56.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8776999999999998e-05 2024-09-10T06:27:56.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.554 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.554 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1228 4.22 e62/24 4:44276f69:::.dir.dfef714d-986b-43cb-b095-512e386c9309.4358.4.3:head v 62'1, mlcod=0'0)", 2024-09-10T06:27:56.554 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:54.919844+0000", 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.52930539, 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003632307, 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919844+0000", 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919844+0000", 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:56.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:56.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919845+0000", 2024-09-10T06:27:56.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9299999999999997e-07 2024-09-10T06:27:56.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:56.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919850+0000", 2024-09-10T06:27:56.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2669999999999997e-06 2024-09-10T06:27:56.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:56.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919859+0000", 2024-09-10T06:27:56.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4739999999999994e-06 2024-09-10T06:27:56.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:56.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.919866+0000", 2024-09-10T06:27:56.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0800000000000002e-06 2024-09-10T06:27:56.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:56.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920277+0000", 2024-09-10T06:27:56.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041150799999999999 2024-09-10T06:27:56.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:56.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.920305+0000", 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8085e-05 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923436+0000", 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031311450000000001 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:54.923476+0000", 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0055000000000002e-05 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:56.559 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:56.559 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:56.560 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:56.560 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:56.561 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:56.561 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:56.561 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:27:56.562 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:56.562 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:56.562 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:56.563 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:56.563 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:56.556+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:56.583 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-10T06:27:56.661 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:56.661+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:56.694 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:56.694 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:56.708 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:27:56.800 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:56.801+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:56.862 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:56.861+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:56.875 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:56.875 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:56.889 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:27:56.963 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:56.960+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:57.060 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:57.060 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:57.064 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:57.065+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:57.074 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:27:57.165 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:57.160+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:57.195 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:57.209 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:27:57.297 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:57.296+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:57.367 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:57.364+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:57.372 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:57.372 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:57.386 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:27:57.468 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:57.469+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:57.547 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:57.547 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:57.560 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:27:57.569 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:57.569+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:57.670 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:57.668+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:57.681 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:57.682 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:57.695 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:27:57.781 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:57.780+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:57.871 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:57.868+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:57.878 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:57.879 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:57.898 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:27:57.972 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:57.973+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:58.073 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:58.068+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:58.083 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:58.083 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:58.100 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:27:58.189 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:58.188+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:58.274 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:58.272+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:58.292 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:58.293 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:58.315 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:27:58.375 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:58.372+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:58.476 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:27:58.472+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:27:58.495 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:58.495 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:58.515 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:27:58.564 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:27:58.606 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:58.604+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:27:58.609 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T06:27:58.694 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:58.692+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:58.701 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:27:58.701 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:27:58.734 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:27:58.779 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:58.776+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:58.787 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:27:58.787 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:27:58.815 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:27:58.816 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:27:58.838 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:27:58.838 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:27:58.858 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:27:58.858 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:27:58.879 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:58.876+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:58.888 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:27:58.888 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:27:58.913 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:27:58.914 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:27:58.942 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:27:58.943 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:27:58.944 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-10T06:27:58.944 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-10T06:27:58.944 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-10T06:27:58.944 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-09-10T06:27:58.949 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1356 3.19 e63/22 3:9ae6227a:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_111:head v 63'1, mlcod=0'0)", 2024-09-10T06:27:58.949 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.942487+0000", 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.0075835970000000001, 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.007617937, 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "started", 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.942487+0000", 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.942487+0000", 2024-09-10T06:27:58.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.942489+0000", 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8610000000000001e-06 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.944090+0000", 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001601531 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.944116+0000", 2024-09-10T06:27:58.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5703000000000001e-05 2024-09-10T06:27:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.944129+0000", 2024-09-10T06:27:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3263e-05 2024-09-10T06:27:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.944240+0000", 2024-09-10T06:27:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111137 2024-09-10T06:27:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:58.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.944267+0000", 2024-09-10T06:27:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.633e-05 2024-09-10T06:27:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:58.953 INFO:teuthology.orchestra.run.smithi112.stdout: ], 2024-09-10T06:27:58.954 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 1 2024-09-10T06:27:58.954 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:58.973 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:27:58.973 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:27:58.980 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:27:58.981 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:27:58.980+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:27:59.085 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:27:59.084+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:27:59.182 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:59.180+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:59.192 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:59.192 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:27:59.192 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:27:59.192 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:27:59.192 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:59.220 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:27:59.283 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:59.280+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:59.383 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:27:59.384+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:27:59.391 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-10T06:27:59.388+0000 7f00aadd0640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-09-10T06:27:59.391 INFO:teuthology.orchestra.run.smithi112.stdout:moved 6 / 530 (1.13208%) 2024-09-10T06:27:59.392 INFO:teuthology.orchestra.run.smithi112.stdout:avg 66.25 2024-09-10T06:27:59.392 INFO:teuthology.orchestra.run.smithi112.stdout:stddev 8.3179 -> 9.65337 (expected baseline 7.61372) 2024-09-10T06:27:59.392 INFO:teuthology.orchestra.run.smithi112.stdout:min osd.2 with 51 -> 52 pgs (0.769811 -> 0.784906 * mean) 2024-09-10T06:27:59.392 INFO:teuthology.orchestra.run.smithi112.stdout:max osd.3 with 79 -> 81 pgs (1.19245 -> 1.22264 * mean) 2024-09-10T06:27:59.392 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:27:59.392 INFO:teuthology.orchestra.run.smithi112.stdout:oload 110 2024-09-10T06:27:59.392 INFO:teuthology.orchestra.run.smithi112.stdout:max_change 1 2024-09-10T06:27:59.392 INFO:teuthology.orchestra.run.smithi112.stdout:max_change_osds 4 2024-09-10T06:27:59.392 INFO:teuthology.orchestra.run.smithi112.stdout:average_utilization 0.0003 2024-09-10T06:27:59.392 INFO:teuthology.orchestra.run.smithi112.stdout:overload_utilization 0.0004 2024-09-10T06:27:59.392 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6 weight 1.0000 -> 0.8898 2024-09-10T06:27:59.393 INFO:teuthology.orchestra.run.smithi112.stderr:no change 2024-09-10T06:27:59.408 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:27:59.408 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:27:59.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:27:59.408 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:27:59.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.408 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:377 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:59.408 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:59.408 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.944740840999998, 2024-09-10T06:27:59.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058485480000000003, 2024-09-10T06:27:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 377 2024-09-10T06:27:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461485+0000", 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461486+0000", 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0720000000000001e-06 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461504+0000", 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8002000000000001e-05 2024-09-10T06:27:59.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461519+0000", 2024-09-10T06:27:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4584e-05 2024-09-10T06:27:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461526+0000", 2024-09-10T06:27:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5560000000000004e-06 2024-09-10T06:27:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461597+0000", 2024-09-10T06:27:59.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1311999999999998e-05 2024-09-10T06:27:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461709+0000", 2024-09-10T06:27:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011191100000000001 2024-09-10T06:27:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.461871+0000", 2024-09-10T06:27:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016254900000000001 2024-09-10T06:27:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:59.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.462777+0000", 2024-09-10T06:27:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00090547100000000003 2024-09-10T06:27:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467265+0000", 2024-09-10T06:27:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004488222 2024-09-10T06:27:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467308+0000", 2024-09-10T06:27:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2975000000000001e-05 2024-09-10T06:27:59.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.467334+0000", 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5894e-05 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:441 6.7 e34/28 6:e1cdb60d:reshard::reshard.0000000008:head v 34'7, mlcod=34'5)", 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.923760021000007, 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060368319999999998, 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.414 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482466+0000", 2024-09-10T06:27:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482467+0000", 2024-09-10T06:27:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8800000000000003e-07 2024-09-10T06:27:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482472+0000", 2024-09-10T06:27:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8730000000000004e-06 2024-09-10T06:27:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482481+0000", 2024-09-10T06:27:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1980000000000001e-06 2024-09-10T06:27:59.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482485+0000", 2024-09-10T06:27:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.386e-06 2024-09-10T06:27:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482541+0000", 2024-09-10T06:27:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5788000000000002e-05 2024-09-10T06:27:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.482563+0000", 2024-09-10T06:27:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2303999999999999e-05 2024-09-10T06:27:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488465+0000", 2024-09-10T06:27:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059014810000000001 2024-09-10T06:27:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.488503+0000", 2024-09-10T06:27:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8313999999999999e-05 2024-09-10T06:27:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.418 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:646 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.783025359000007, 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049103549999999999, 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 646 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.419 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623201+0000", 2024-09-10T06:27:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623202+0000", 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9800000000000002e-07 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623206+0000", 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6380000000000003e-06 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623216+0000", 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4439999999999997e-06 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623221+0000", 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6400000000000002e-06 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623300+0000", 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8677999999999994e-05 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623410+0000", 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010954399999999999 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.623629+0000", 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000219836 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.625072+0000", 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014427929999999999 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.627982+0000", 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029097620000000002 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628058+0000", 2024-09-10T06:27:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6390999999999994e-05 2024-09-10T06:27:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:41.628111+0000", 2024-09-10T06:27:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2731e-05 2024-09-10T06:27:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:937 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T06:27:59.424 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 77.199185439000004, 2024-09-10T06:27:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0051838630000000004, 2024-09-10T06:27:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 937 2024-09-10T06:27:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:59.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207041+0000", 2024-09-10T06:27:59.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207042+0000", 2024-09-10T06:27:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7439999999999999e-06 2024-09-10T06:27:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207051+0000", 2024-09-10T06:27:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7299999999999994e-06 2024-09-10T06:27:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207072+0000", 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1209e-05 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207089+0000", 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6297e-05 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207231+0000", 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014233200000000001 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207463+0000", 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00023155199999999999 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.207797+0000", 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00033413699999999998 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.209053+0000", 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012560029999999999 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212076+0000", 2024-09-10T06:27:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030234239999999998 2024-09-10T06:27:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212162+0000", 2024-09-10T06:27:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5506000000000004e-05 2024-09-10T06:27:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:26:42.212225+0000", 2024-09-10T06:27:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2928999999999993e-05 2024-09-10T06:27:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.432 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4862.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94420710002608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:54.458120+0000", 2024-09-10T06:27:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.9481057960000001, 2024-09-10T06:27:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005430224, 2024-09-10T06:27:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4862", 2024-09-10T06:27:59.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/933126221", 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 57 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458120+0000", 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458120+0000", 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458121+0000", 2024-09-10T06:27:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2900000000000003e-07 2024-09-10T06:27:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458126+0000", 2024-09-10T06:27:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3349999999999997e-06 2024-09-10T06:27:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458135+0000", 2024-09-10T06:27:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.473e-06 2024-09-10T06:27:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458140+0000", 2024-09-10T06:27:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8400000000000002e-06 2024-09-10T06:27:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458185+0000", 2024-09-10T06:27:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5046000000000002e-05 2024-09-10T06:27:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458254+0000", 2024-09-10T06:27:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8981999999999998e-05 2024-09-10T06:27:59.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.458352+0000", 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.836e-05 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.463322+0000", 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049695240000000003 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.463460+0000", 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138047 2024-09-10T06:27:59.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.463490+0000", 2024-09-10T06:27:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9842e-05 2024-09-10T06:27:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.463551+0000", 2024-09-10T06:27:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1045999999999998e-05 2024-09-10T06:27:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4877.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94135091944208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:54.636077+0000", 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.7701495019999998, 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0054411140000000004, 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4877", 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/2435058803", 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 57 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636077+0000", 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636077+0000", 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636078+0000", 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9299999999999996e-07 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636082+0000", 2024-09-10T06:27:59.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.048e-06 2024-09-10T06:27:59.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636093+0000", 2024-09-10T06:27:59.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1073999999999999e-05 2024-09-10T06:27:59.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636101+0000", 2024-09-10T06:27:59.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3000000000000002e-06 2024-09-10T06:27:59.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636150+0000", 2024-09-10T06:27:59.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8677000000000002e-05 2024-09-10T06:27:59.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636205+0000", 2024-09-10T06:27:59.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4885000000000001e-05 2024-09-10T06:27:59.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:59.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636281+0000", 2024-09-10T06:27:59.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.64e-05 2024-09-10T06:27:59.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:59.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.636740+0000", 2024-09-10T06:27:59.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00045915700000000002 2024-09-10T06:27:59.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:59.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.641410+0000", 2024-09-10T06:27:59.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046697880000000002 2024-09-10T06:27:59.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.641459+0000", 2024-09-10T06:27:59.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8881999999999997e-05 2024-09-10T06:27:59.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:54.641518+0000", 2024-09-10T06:27:59.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9009999999999999e-05 2024-09-10T06:27:59.444 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.444 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.444 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.444 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4931.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T06:27:59.444 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:55.797039+0000", 2024-09-10T06:27:59.444 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.6091874649999998, 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055258470000000004, 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4931", 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/262096", 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 56 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:55.797039+0000", 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:55.797039+0000", 2024-09-10T06:27:59.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:55.797039+0000", 2024-09-10T06:27:59.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8699999999999995e-07 2024-09-10T06:27:59.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:55.797042+0000", 2024-09-10T06:27:59.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1470000000000001e-06 2024-09-10T06:27:59.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:55.797050+0000", 2024-09-10T06:27:59.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8280000000000003e-06 2024-09-10T06:27:59.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:55.797056+0000", 2024-09-10T06:27:59.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.592e-06 2024-09-10T06:27:59.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:55.797110+0000", 2024-09-10T06:27:59.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4438999999999998e-05 2024-09-10T06:27:59.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:55.797162+0000", 2024-09-10T06:27:59.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2157000000000002e-05 2024-09-10T06:27:59.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:27:59.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:55.797223+0000", 2024-09-10T06:27:59.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0683000000000002e-05 2024-09-10T06:27:59.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:59.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:55.799489+0000", 2024-09-10T06:27:59.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002266306 2024-09-10T06:27:59.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:59.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:55.802485+0000", 2024-09-10T06:27:59.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0029950860000000001 2024-09-10T06:27:59.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:55.802516+0000", 2024-09-10T06:27:59.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1683999999999997e-05 2024-09-10T06:27:59.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:55.802565+0000", 2024-09-10T06:27:59.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8337999999999997e-05 2024-09-10T06:27:59.450 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.450 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.450 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.450 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1349 3.18 3:19632102:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_104:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:27:59.450 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.866476+0000", 2024-09-10T06:27:59.450 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.53975060399999997, 2024-09-10T06:27:59.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013943519999999999, 2024-09-10T06:27:59.451 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.451 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.451 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.451 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:59.451 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:59.451 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:59.451 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1349 2024-09-10T06:27:59.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.451 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.866476+0000", 2024-09-10T06:27:59.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.866476+0000", 2024-09-10T06:27:59.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.866479+0000", 2024-09-10T06:27:59.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.755e-06 2024-09-10T06:27:59.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.867673+0000", 2024-09-10T06:27:59.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0011936939999999999 2024-09-10T06:27:59.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.867708+0000", 2024-09-10T06:27:59.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5445999999999999e-05 2024-09-10T06:27:59.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.867725+0000", 2024-09-10T06:27:59.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6099999999999998e-05 2024-09-10T06:27:59.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.867822+0000", 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7397000000000003e-05 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.868008+0000", 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018629700000000001 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.868162+0000", 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015394900000000001 2024-09-10T06:27:59.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.875615+0000", 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0074531299999999997 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.880290+0000", 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0046741990000000004 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.880369+0000", 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9578000000000003e-05 2024-09-10T06:27:59.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.880419+0000", 2024-09-10T06:27:59.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9975000000000002e-05 2024-09-10T06:27:59.456 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.456 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.456 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.456 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1353 3.22 e63/22 3:46874a4e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_108:head v 63'1, mlcod=0'0)", 2024-09-10T06:27:59.456 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.914397+0000", 2024-09-10T06:27:59.456 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.49182886999999997, 2024-09-10T06:27:59.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01485907, 2024-09-10T06:27:59.457 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.457 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.457 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.457 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.914397+0000", 2024-09-10T06:27:59.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.457 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.457 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.914397+0000", 2024-09-10T06:27:59.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.914400+0000", 2024-09-10T06:27:59.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.413e-06 2024-09-10T06:27:59.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.921511+0000", 2024-09-10T06:27:59.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071116920000000002 2024-09-10T06:27:59.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.921532+0000", 2024-09-10T06:27:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1047999999999999e-05 2024-09-10T06:27:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.921542+0000", 2024-09-10T06:27:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4949999999999997e-06 2024-09-10T06:27:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.921612+0000", 2024-09-10T06:27:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9785999999999999e-05 2024-09-10T06:27:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.921637+0000", 2024-09-10T06:27:59.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5585e-05 2024-09-10T06:27:59.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.929191+0000", 2024-09-10T06:27:59.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0075538719999999997 2024-09-10T06:27:59.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.929256+0000", 2024-09-10T06:27:59.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5178999999999994e-05 2024-09-10T06:27:59.460 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.460 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.461 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.461 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1354 3.5 e63/22 3:a2100466:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_109:head v 63'4, mlcod=63'2)", 2024-09-10T06:27:59.461 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.926709+0000", 2024-09-10T06:27:59.461 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.47951668800000002, 2024-09-10T06:27:59.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013961747, 2024-09-10T06:27:59.461 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.461 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.461 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.461 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.926709+0000", 2024-09-10T06:27:59.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.926709+0000", 2024-09-10T06:27:59.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.926711+0000", 2024-09-10T06:27:59.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8649999999999999e-06 2024-09-10T06:27:59.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.933891+0000", 2024-09-10T06:27:59.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071801139999999996 2024-09-10T06:27:59.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.933902+0000", 2024-09-10T06:27:59.463 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1041e-05 2024-09-10T06:27:59.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.463 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.463 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.933910+0000", 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7239999999999992e-06 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.933975+0000", 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4795999999999994e-05 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.933995+0000", 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9989000000000001e-05 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.464 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.940597+0000", 2024-09-10T06:27:59.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.006601956 2024-09-10T06:27:59.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.940671+0000", 2024-09-10T06:27:59.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4262000000000002e-05 2024-09-10T06:27:59.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.465 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.465 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.465 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1356 3.19 e63/22 3:9ae6227a:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_111:head v 63'1, mlcod=0'0)", 2024-09-10T06:27:59.465 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.942487+0000", 2024-09-10T06:27:59.465 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.46373924900000002, 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011038871, 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.942487+0000", 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.942487+0000", 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.942489+0000", 2024-09-10T06:27:59.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8610000000000001e-06 2024-09-10T06:27:59.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.944090+0000", 2024-09-10T06:27:59.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001601531 2024-09-10T06:27:59.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.944116+0000", 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5703000000000001e-05 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.944129+0000", 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3263e-05 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.944240+0000", 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000111137 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.944267+0000", 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.633e-05 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.953462+0000", 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0091953969999999993 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.953526+0000", 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3649e-05 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1357 3.1e 3:7863b3e2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.957495+0000", 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.448730662, 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019676366000000001, 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1357 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.957495+0000", 2024-09-10T06:27:59.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.957495+0000", 2024-09-10T06:27:59.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.957499+0000", 2024-09-10T06:27:59.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6789999999999998e-06 2024-09-10T06:27:59.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.958828+0000", 2024-09-10T06:27:59.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013292829999999999 2024-09-10T06:27:59.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.958867+0000", 2024-09-10T06:27:59.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8810000000000003e-05 2024-09-10T06:27:59.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.958883+0000", 2024-09-10T06:27:59.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5362999999999998e-05 2024-09-10T06:27:59.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.958975+0000", 2024-09-10T06:27:59.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2200999999999994e-05 2024-09-10T06:27:59.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.959138+0000", 2024-09-10T06:27:59.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000163542 2024-09-10T06:27:59.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:59.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.959288+0000", 2024-09-10T06:27:59.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015009499999999999 2024-09-10T06:27:59.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:59.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.967661+0000", 2024-09-10T06:27:59.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0083720940000000001 2024-09-10T06:27:59.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:59.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.977039+0000", 2024-09-10T06:27:59.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0093786000000000008 2024-09-10T06:27:59.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.977112+0000", 2024-09-10T06:27:59.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3040000000000005e-05 2024-09-10T06:27:59.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.977172+0000", 2024-09-10T06:27:59.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9658999999999999e-05 2024-09-10T06:27:59.475 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.475 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.475 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.476 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1361 3.38 3:1ede1c11:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:27:59.476 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.998802+0000", 2024-09-10T06:27:59.476 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.407423751, 2024-09-10T06:27:59.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017059365999999999, 2024-09-10T06:27:59.476 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.476 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.476 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.476 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:59.476 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:59.476 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:59.476 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1361 2024-09-10T06:27:59.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.998802+0000", 2024-09-10T06:27:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.998802+0000", 2024-09-10T06:27:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.998806+0000", 2024-09-10T06:27:59.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1889999999999999e-06 2024-09-10T06:27:59.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000620+0000", 2024-09-10T06:27:59.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001814485 2024-09-10T06:27:59.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000651+0000", 2024-09-10T06:27:59.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0719999999999997e-05 2024-09-10T06:27:59.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000665+0000", 2024-09-10T06:27:59.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4695000000000001e-05 2024-09-10T06:27:59.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000738+0000", 2024-09-10T06:27:59.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2229000000000003e-05 2024-09-10T06:27:59.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000869+0000", 2024-09-10T06:27:59.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131688 2024-09-10T06:27:59.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:27:59.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000993+0000", 2024-09-10T06:27:59.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012376999999999999 2024-09-10T06:27:59.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:59.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.010762+0000", 2024-09-10T06:27:59.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0097692260000000006 2024-09-10T06:27:59.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.480 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:59.480 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.015691+0000", 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049281660000000003 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.015764+0000", 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3182999999999994e-05 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.015862+0000", 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8015000000000003e-05 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1362 3.b 3:d018b588:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.011479+0000", 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.39474744, 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013883790999999999, 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1362 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.011479+0000", 2024-09-10T06:27:59.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.011479+0000", 2024-09-10T06:27:59.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.011481+0000", 2024-09-10T06:27:59.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5730000000000002e-06 2024-09-10T06:27:59.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.012432+0000", 2024-09-10T06:27:59.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00095082900000000004 2024-09-10T06:27:59.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.012463+0000", 2024-09-10T06:27:59.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0505999999999999e-05 2024-09-10T06:27:59.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.012478+0000", 2024-09-10T06:27:59.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5143999999999999e-05 2024-09-10T06:27:59.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.012565+0000", 2024-09-10T06:27:59.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7628999999999997e-05 2024-09-10T06:27:59.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.012719+0000", 2024-09-10T06:27:59.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015365100000000001 2024-09-10T06:27:59.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:59.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.012877+0000", 2024-09-10T06:27:59.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015763800000000001 2024-09-10T06:27:59.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:59.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.024817+0000", 2024-09-10T06:27:59.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011940533 2024-09-10T06:27:59.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:59.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.025275+0000", 2024-09-10T06:27:59.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00045777600000000002 2024-09-10T06:27:59.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.025312+0000", 2024-09-10T06:27:59.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7385999999999997e-05 2024-09-10T06:27:59.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.025363+0000", 2024-09-10T06:27:59.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0126000000000001e-05 2024-09-10T06:27:59.487 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.487 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.487 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.488 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1369 3.22 e63/22 3:45ffca16:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_124:head v 63'2, mlcod=0'0)", 2024-09-10T06:27:59.488 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.100669+0000", 2024-09-10T06:27:59.488 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.305556824, 2024-09-10T06:27:59.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013340451, 2024-09-10T06:27:59.488 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.488 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.488 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.488 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.100669+0000", 2024-09-10T06:27:59.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.100669+0000", 2024-09-10T06:27:59.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.100671+0000", 2024-09-10T06:27:59.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1579999999999999e-06 2024-09-10T06:27:59.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.105606+0000", 2024-09-10T06:27:59.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00493459 2024-09-10T06:27:59.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.105639+0000", 2024-09-10T06:27:59.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2700000000000002e-05 2024-09-10T06:27:59.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.105653+0000", 2024-09-10T06:27:59.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4687e-05 2024-09-10T06:27:59.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.105724+0000", 2024-09-10T06:27:59.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0963999999999993e-05 2024-09-10T06:27:59.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.105743+0000", 2024-09-10T06:27:59.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8763e-05 2024-09-10T06:27:59.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.491 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.491 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.113960+0000", 2024-09-10T06:27:59.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0082163129999999994 2024-09-10T06:27:59.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.114010+0000", 2024-09-10T06:27:59.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0275999999999998e-05 2024-09-10T06:27:59.492 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.492 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.492 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.492 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1376 3.29 3:94f62a8f:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:27:59.492 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.170001+0000", 2024-09-10T06:27:59.492 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.236224873, 2024-09-10T06:27:59.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017004267999999999, 2024-09-10T06:27:59.492 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.492 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.493 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.493 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:59.493 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:59.493 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:59.493 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1376 2024-09-10T06:27:59.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.493 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.170001+0000", 2024-09-10T06:27:59.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.170001+0000", 2024-09-10T06:27:59.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.170004+0000", 2024-09-10T06:27:59.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8930000000000001e-06 2024-09-10T06:27:59.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.171428+0000", 2024-09-10T06:27:59.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014238429999999999 2024-09-10T06:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.171456+0000", 2024-09-10T06:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7691999999999998e-05 2024-09-10T06:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.171471+0000", 2024-09-10T06:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5400000000000002e-05 2024-09-10T06:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.171561+0000", 2024-09-10T06:27:59.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9777000000000005e-05 2024-09-10T06:27:59.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.171670+0000", 2024-09-10T06:27:59.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108918 2024-09-10T06:27:59.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:27:59.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.171782+0000", 2024-09-10T06:27:59.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112012 2024-09-10T06:27:59.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:59.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.176549+0000", 2024-09-10T06:27:59.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047673120000000001 2024-09-10T06:27:59.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:59.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.186890+0000", 2024-09-10T06:27:59.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010341011000000001 2024-09-10T06:27:59.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.497 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.497 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.186955+0000", 2024-09-10T06:27:59.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5126e-05 2024-09-10T06:27:59.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.187006+0000", 2024-09-10T06:27:59.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0284000000000002e-05 2024-09-10T06:27:59.498 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.498 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.498 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.498 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1377 3.7 3:e1b31464:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:27:59.498 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.180368+0000", 2024-09-10T06:27:59.498 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.22585846000000001, 2024-09-10T06:27:59.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017958923000000002, 2024-09-10T06:27:59.498 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1377 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.180368+0000", 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.180368+0000", 2024-09-10T06:27:59.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.180370+0000", 2024-09-10T06:27:59.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6900000000000001e-06 2024-09-10T06:27:59.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182458+0000", 2024-09-10T06:27:59.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0020876179999999999 2024-09-10T06:27:59.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182485+0000", 2024-09-10T06:27:59.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.694e-05 2024-09-10T06:27:59.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182499+0000", 2024-09-10T06:27:59.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4100000000000001e-05 2024-09-10T06:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182597+0000", 2024-09-10T06:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8309999999999999e-05 2024-09-10T06:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182700+0000", 2024-09-10T06:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010313400000000001 2024-09-10T06:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:27:59.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182801+0000", 2024-09-10T06:27:59.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100065 2024-09-10T06:27:59.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:59.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.191493+0000", 2024-09-10T06:27:59.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0086923150000000008 2024-09-10T06:27:59.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:59.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.198196+0000", 2024-09-10T06:27:59.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.006703166 2024-09-10T06:27:59.503 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.198263+0000", 2024-09-10T06:27:59.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6685000000000003e-05 2024-09-10T06:27:59.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.198327+0000", 2024-09-10T06:27:59.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3899999999999995e-05 2024-09-10T06:27:59.504 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.504 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.504 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.504 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1381 3.18 3:1b2e08f5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.221807+0000", 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.184419587, 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020986388000000002, 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1381 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.221807+0000", 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.221807+0000", 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.221809+0000", 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.571e-06 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.222886+0000", 2024-09-10T06:27:59.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001076547 2024-09-10T06:27:59.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.222909+0000", 2024-09-10T06:27:59.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3028e-05 2024-09-10T06:27:59.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.222919+0000", 2024-09-10T06:27:59.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0509000000000001e-05 2024-09-10T06:27:59.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.222981+0000", 2024-09-10T06:27:59.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1754999999999994e-05 2024-09-10T06:27:59.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.223119+0000", 2024-09-10T06:27:59.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013831299999999999 2024-09-10T06:27:59.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:27:59.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.223228+0000", 2024-09-10T06:27:59.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108424 2024-09-10T06:27:59.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:59.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.237361+0000", 2024-09-10T06:27:59.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014132824 2024-09-10T06:27:59.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:59.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.242666+0000", 2024-09-10T06:27:59.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0053053340000000001 2024-09-10T06:27:59.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.242739+0000", 2024-09-10T06:27:59.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2801999999999999e-05 2024-09-10T06:27:59.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.242793+0000", 2024-09-10T06:27:59.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4280999999999997e-05 2024-09-10T06:27:59.510 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.510 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.510 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.510 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1384 3.33 3:cfe948dc:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:27:59.510 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.251038+0000", 2024-09-10T06:27:59.510 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.15518850000000001, 2024-09-10T06:27:59.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018535228000000001, 2024-09-10T06:27:59.511 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.511 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.511 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:27:59.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:27:59.511 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:59.511 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1384 2024-09-10T06:27:59.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.511 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.251038+0000", 2024-09-10T06:27:59.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.251038+0000", 2024-09-10T06:27:59.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.251040+0000", 2024-09-10T06:27:59.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4590000000000001e-06 2024-09-10T06:27:59.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.512 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.252948+0000", 2024-09-10T06:27:59.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001907658 2024-09-10T06:27:59.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.252976+0000", 2024-09-10T06:27:59.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8673000000000001e-05 2024-09-10T06:27:59.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.252992+0000", 2024-09-10T06:27:59.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5761999999999999e-05 2024-09-10T06:27:59.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.253086+0000", 2024-09-10T06:27:59.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4279999999999999e-05 2024-09-10T06:27:59.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.253243+0000", 2024-09-10T06:27:59.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015613700000000001 2024-09-10T06:27:59.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:27:59.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.253381+0000", 2024-09-10T06:27:59.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013826800000000001 2024-09-10T06:27:59.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262637+0000", 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092563639999999996 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.269454+0000", 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0068171120000000002 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.269522+0000", 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7287999999999997e-05 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.269573+0000", 2024-09-10T06:27:59.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1227000000000003e-05 2024-09-10T06:27:59.516 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.516 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.516 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.516 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1386 3.15 e63/22 3:ab7459e6:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_141:head v 63'1, mlcod=0'0)", 2024-09-10T06:27:59.516 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.276226+0000", 2024-09-10T06:27:59.516 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 0.13000036500000001, 2024-09-10T06:27:59.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011277808, 2024-09-10T06:27:59.516 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:27:59.517 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:27:59.517 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:27:59.517 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:27:59.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:27:59.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.276226+0000", 2024-09-10T06:27:59.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:27:59.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.276226+0000", 2024-09-10T06:27:59.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:27:59.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.276228+0000", 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6180000000000002e-06 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.281026+0000", 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004797422 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.281060+0000", 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4635999999999998e-05 2024-09-10T06:27:59.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.281074+0000", 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3511e-05 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.281171+0000", 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7058000000000005e-05 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.281200+0000", 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8510999999999999e-05 2024-09-10T06:27:59.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:27:59.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.287433+0000", 2024-09-10T06:27:59.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00623297 2024-09-10T06:27:59.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:27:59.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:27:59.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:27:59.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.287504+0000", 2024-09-10T06:27:59.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1081999999999995e-05 2024-09-10T06:27:59.520 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.520 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.520 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.520 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:27:59.521 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:27:59.521 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:27:59.522 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-10T06:27:59.522 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2024-09-10T06:27:59.523 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:27:59.524 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:27:59.520+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:27:59.602 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-10T06:27:59.623 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:59.620+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:59.669 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:59.669 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:27:59.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:59.669 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1433 3.1a 3:59ee0094:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:27:59.669 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:27:59.669 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.023649251999999999, 2024-09-10T06:27:59.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023708687999999999, 2024-09-10T06:27:59.670 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:27:59.670 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:27:59.670 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-09-10T06:27:59.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:27:59.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:27:59.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:27:59.670 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1433 2024-09-10T06:27:59.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:59.670 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:27:59.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:59.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:27:59.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:27:59.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:59.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:59.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:59.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:27:59.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:27:59.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:27:59.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:59.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:59.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:27:59.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646979+0000", 2024-09-10T06:27:59.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.074e-06 2024-09-10T06:27:59.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:59.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:59.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:27:59.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.650998+0000", 2024-09-10T06:27:59.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040192470000000001 2024-09-10T06:27:59.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:59.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:59.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:27:59.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651031+0000", 2024-09-10T06:27:59.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2821000000000003e-05 2024-09-10T06:27:59.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:59.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:59.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:27:59.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651050+0000", 2024-09-10T06:27:59.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9556e-05 2024-09-10T06:27:59.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:59.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:59.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:27:59.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651150+0000", 2024-09-10T06:27:59.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9689e-05 2024-09-10T06:27:59.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:59.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:59.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:27:59.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651325+0000", 2024-09-10T06:27:59.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017529199999999999 2024-09-10T06:27:59.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:59.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:59.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:27:59.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651496+0000", 2024-09-10T06:27:59.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000170531 2024-09-10T06:27:59.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:27:59.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:27:59.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:27:59.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.659894+0000", 2024-09-10T06:27:59.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083978049999999995 2024-09-10T06:27:59.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:59.674 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:27:59.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:59.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:27:59.674 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-09-10T06:27:59.674 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 1 2024-09-10T06:27:59.674 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:59.689 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:27:59.732 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:27:59.732+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:27:59.825 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:27:59.824+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:27:59.875 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:27:59.876 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:27:59.876 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:27:59.876 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:27:59.876 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:27:59.891 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:27:59.926 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:27:59.924+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:00.018 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-10T06:28:00.016+0000 7f00aadd0640 -1 mgr.server reply reply (1) Operation not permitted no change 2024-09-10T06:28:00.018 INFO:teuthology.orchestra.run.smithi112.stdout:moved 2 / 530 (0.377358%) 2024-09-10T06:28:00.019 INFO:teuthology.orchestra.run.smithi112.stdout:avg 66.25 2024-09-10T06:28:00.019 INFO:teuthology.orchestra.run.smithi112.stdout:stddev 8.3179 -> 8.43727 (expected baseline 7.61372) 2024-09-10T06:28:00.019 INFO:teuthology.orchestra.run.smithi112.stdout:min osd.2 with 51 -> 52 pgs (0.769811 -> 0.784906 * mean) 2024-09-10T06:28:00.019 INFO:teuthology.orchestra.run.smithi112.stdout:max osd.3 with 79 -> 79 pgs (1.19245 -> 1.19245 * mean) 2024-09-10T06:28:00.019 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:28:00.019 INFO:teuthology.orchestra.run.smithi112.stdout:oload 110 2024-09-10T06:28:00.019 INFO:teuthology.orchestra.run.smithi112.stdout:max_change 0.05 2024-09-10T06:28:00.019 INFO:teuthology.orchestra.run.smithi112.stdout:max_change_osds 4 2024-09-10T06:28:00.019 INFO:teuthology.orchestra.run.smithi112.stdout:average_utilization 0.0003 2024-09-10T06:28:00.019 INFO:teuthology.orchestra.run.smithi112.stdout:overload_utilization 0.0004 2024-09-10T06:28:00.019 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6 weight 1.0000 -> 0.9500 2024-09-10T06:28:00.020 INFO:teuthology.orchestra.run.smithi112.stderr:no change 2024-09-10T06:28:00.027 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:00.024+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:00.041 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-10T06:28:00.041 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 1.0 2024-09-10T06:28:00.099 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:00.099 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:00.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:00.099 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:00.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.100 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1351 3.1d e63/41 3:b8f5f32e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_106:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:00.100 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.891127+0000", 2024-09-10T06:28:00.100 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.2081813590000001, 2024-09-10T06:28:00.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016439619999999999, 2024-09-10T06:28:00.100 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.100 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.100 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.100 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.891127+0000", 2024-09-10T06:28:00.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.891127+0000", 2024-09-10T06:28:00.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.891129+0000", 2024-09-10T06:28:00.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7089999999999998e-06 2024-09-10T06:28:00.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895096+0000", 2024-09-10T06:28:00.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039671309999999996 2024-09-10T06:28:00.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895128+0000", 2024-09-10T06:28:00.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1664e-05 2024-09-10T06:28:00.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895158+0000", 2024-09-10T06:28:00.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0168e-05 2024-09-10T06:28:00.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895311+0000", 2024-09-10T06:28:00.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015315899999999999 2024-09-10T06:28:00.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895380+0000", 2024-09-10T06:28:00.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8559000000000005e-05 2024-09-10T06:28:00.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.907398+0000", 2024-09-10T06:28:00.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012017798 2024-09-10T06:28:00.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.907566+0000", 2024-09-10T06:28:00.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016843199999999999 2024-09-10T06:28:00.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.104 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.104 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1352 3.1c e63/22 3:3adb07ef:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_107:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:00.104 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.904909+0000", 2024-09-10T06:28:00.104 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.194399204, 2024-09-10T06:28:00.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016373502000000002, 2024-09-10T06:28:00.104 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.105 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.105 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.105 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.904909+0000", 2024-09-10T06:28:00.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.904909+0000", 2024-09-10T06:28:00.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.904911+0000", 2024-09-10T06:28:00.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.916e-06 2024-09-10T06:28:00.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908660+0000", 2024-09-10T06:28:00.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037489490000000001 2024-09-10T06:28:00.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908697+0000", 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7761e-05 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908724+0000", 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6361000000000001e-05 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908878+0000", 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000153936 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908921+0000", 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3000999999999997e-05 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.921179+0000", 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012257901999999999 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.921282+0000", 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103676 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.109 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1359 3.34 3:2ece4e0b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.109 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:00.109 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.1220780399999999, 2024-09-10T06:28:00.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021482449000000001, 2024-09-10T06:28:00.109 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.109 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.109 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.109 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1359 2024-09-10T06:28:00.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.110 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:00.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:00.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977234+0000", 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7969999999999998e-06 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981211+0000", 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039768329999999999 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981247+0000", 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6457e-05 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981274+0000", 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6917999999999999e-05 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981446+0000", 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171831 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981719+0000", 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027282800000000002 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:00.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981975+0000", 2024-09-10T06:28:00.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000256782 2024-09-10T06:28:00.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.991319+0000", 2024-09-10T06:28:00.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093433820000000008 2024-09-10T06:28:00.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998330+0000", 2024-09-10T06:28:00.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070108549999999999 2024-09-10T06:28:00.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998549+0000", 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021944400000000001 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998712+0000", 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016332200000000001 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.114 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1367 3.34 3:2f444f7f:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.115 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:00.115 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.0289963369999999, 2024-09-10T06:28:00.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020931903000000002, 2024-09-10T06:28:00.115 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1367 2024-09-10T06:28:00.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.115 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:00.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:00.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070316+0000", 2024-09-10T06:28:00.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9029999999999997e-06 2024-09-10T06:28:00.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074255+0000", 2024-09-10T06:28:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039391679999999998 2024-09-10T06:28:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074291+0000", 2024-09-10T06:28:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5970000000000003e-05 2024-09-10T06:28:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074309+0000", 2024-09-10T06:28:00.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8399000000000001e-05 2024-09-10T06:28:00.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074436+0000", 2024-09-10T06:28:00.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012683099999999999 2024-09-10T06:28:00.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074686+0000", 2024-09-10T06:28:00.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024971699999999999 2024-09-10T06:28:00.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:00.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074907+0000", 2024-09-10T06:28:00.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022124800000000001 2024-09-10T06:28:00.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.084332+0000", 2024-09-10T06:28:00.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094253449999999999 2024-09-10T06:28:00.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.090954+0000", 2024-09-10T06:28:00.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066213649999999997 2024-09-10T06:28:00.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.091123+0000", 2024-09-10T06:28:00.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169216 2024-09-10T06:28:00.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.091244+0000", 2024-09-10T06:28:00.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120741 2024-09-10T06:28:00.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.120 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.120 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1375 3.1 e63/22 3:82031a0e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_130:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:00.121 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:00.121 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.93594030100000003, 2024-09-10T06:28:00.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018270307999999999, 2024-09-10T06:28:00.121 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.121 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.121 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.121 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:00.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163370+0000", 2024-09-10T06:28:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8289999999999999e-06 2024-09-10T06:28:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167665+0000", 2024-09-10T06:28:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042940499999999998 2024-09-10T06:28:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167698+0000", 2024-09-10T06:28:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3484e-05 2024-09-10T06:28:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167714+0000", 2024-09-10T06:28:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-09-10T06:28:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167847+0000", 2024-09-10T06:28:00.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013299300000000001 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167890+0000", 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2434000000000001e-05 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181507+0000", 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013616872 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181638+0000", 2024-09-10T06:28:00.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013123099999999999 2024-09-10T06:28:00.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.125 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.125 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1380 3.3 3:c3afb574:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.125 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:00.125 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.88788616600000003, 2024-09-10T06:28:00.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027193374999999999, 2024-09-10T06:28:00.125 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.125 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.126 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1380 2024-09-10T06:28:00.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.126 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:00.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:00.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211426+0000", 2024-09-10T06:28:00.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3599999999999998e-06 2024-09-10T06:28:00.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215383+0000", 2024-09-10T06:28:00.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039567450000000002 2024-09-10T06:28:00.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215417+0000", 2024-09-10T06:28:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4051000000000003e-05 2024-09-10T06:28:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215435+0000", 2024-09-10T06:28:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8459000000000001e-05 2024-09-10T06:28:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215626+0000", 2024-09-10T06:28:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019018299999999999 2024-09-10T06:28:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215991+0000", 2024-09-10T06:28:00.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036566099999999998 2024-09-10T06:28:00.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:00.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.216360+0000", 2024-09-10T06:28:00.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000368995 2024-09-10T06:28:00.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.226152+0000", 2024-09-10T06:28:00.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097914319999999992 2024-09-10T06:28:00.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238448+0000", 2024-09-10T06:28:00.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012295834 2024-09-10T06:28:00.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238538+0000", 2024-09-10T06:28:00.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0539999999999997e-05 2024-09-10T06:28:00.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238615+0000", 2024-09-10T06:28:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7114999999999996e-05 2024-09-10T06:28:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1383 3.3 3:c2c34097:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.85654445199999996, 2024-09-10T06:28:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020753975000000001, 2024-09-10T06:28:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.131 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1383 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:00.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242767+0000", 2024-09-10T06:28:00.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6169999999999998e-06 2024-09-10T06:28:00.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246704+0000", 2024-09-10T06:28:00.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003936485 2024-09-10T06:28:00.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246733+0000", 2024-09-10T06:28:00.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9819999999999999e-05 2024-09-10T06:28:00.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246748+0000", 2024-09-10T06:28:00.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4334e-05 2024-09-10T06:28:00.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246902+0000", 2024-09-10T06:28:00.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015468 2024-09-10T06:28:00.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.247286+0000", 2024-09-10T06:28:00.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038366799999999999 2024-09-10T06:28:00.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:00.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.247687+0000", 2024-09-10T06:28:00.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000401252 2024-09-10T06:28:00.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.257963+0000", 2024-09-10T06:28:00.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010275584000000001 2024-09-10T06:28:00.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263287+0000", 2024-09-10T06:28:00.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053238499999999998 2024-09-10T06:28:00.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263412+0000", 2024-09-10T06:28:00.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012516200000000001 2024-09-10T06:28:00.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263517+0000", 2024-09-10T06:28:00.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105523 2024-09-10T06:28:00.136 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1391 3.1c e63/22 3:3a76b5ac:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_146:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.77223843800000003, 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026554852, 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:00.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:00.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327072+0000", 2024-09-10T06:28:00.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6970000000000002e-06 2024-09-10T06:28:00.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330874+0000", 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038016590000000002 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330928+0000", 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3729e-05 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330956+0000", 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8694999999999999e-05 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.331147+0000", 2024-09-10T06:28:00.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190841 2024-09-10T06:28:00.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.331216+0000", 2024-09-10T06:28:00.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8948999999999993e-05 2024-09-10T06:28:00.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.353521+0000", 2024-09-10T06:28:00.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022304781999999999 2024-09-10T06:28:00.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.353624+0000", 2024-09-10T06:28:00.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010349999999999999 2024-09-10T06:28:00.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.141 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.141 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1392 3.14 3:2b02aaa8:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.141 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:00.141 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.76725964899999999, 2024-09-10T06:28:00.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024102582000000001, 2024-09-10T06:28:00.142 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.142 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.142 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1392 2024-09-10T06:28:00.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.142 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332052+0000", 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8999999999999999e-06 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.335987+0000", 2024-09-10T06:28:00.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039349800000000002 2024-09-10T06:28:00.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336020+0000", 2024-09-10T06:28:00.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2968e-05 2024-09-10T06:28:00.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336040+0000", 2024-09-10T06:28:00.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9956e-05 2024-09-10T06:28:00.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336155+0000", 2024-09-10T06:28:00.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115275 2024-09-10T06:28:00.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336404+0000", 2024-09-10T06:28:00.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024874599999999999 2024-09-10T06:28:00.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:00.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336626+0000", 2024-09-10T06:28:00.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022168200000000001 2024-09-10T06:28:00.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.355854+0000", 2024-09-10T06:28:00.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019228624999999999 2024-09-10T06:28:00.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.355890+0000", 2024-09-10T06:28:00.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5901000000000001e-05 2024-09-10T06:28:00.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.356040+0000", 2024-09-10T06:28:00.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014919600000000001 2024-09-10T06:28:00.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.356151+0000", 2024-09-10T06:28:00.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111353 2024-09-10T06:28:00.147 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.147 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.148 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1398 3.2c e63/22 3:350a23e7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_153:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:00.148 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:00.148 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.69616666299999996, 2024-09-10T06:28:00.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021444181, 2024-09-10T06:28:00.148 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.148 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.148 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:00.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:00.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403144+0000", 2024-09-10T06:28:00.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.734e-06 2024-09-10T06:28:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406432+0000", 2024-09-10T06:28:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032884500000000001 2024-09-10T06:28:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406473+0000", 2024-09-10T06:28:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0834000000000002e-05 2024-09-10T06:28:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406492+0000", 2024-09-10T06:28:00.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8868999999999998e-05 2024-09-10T06:28:00.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406632+0000", 2024-09-10T06:28:00.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140183 2024-09-10T06:28:00.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406698+0000", 2024-09-10T06:28:00.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5913000000000004e-05 2024-09-10T06:28:00.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424483+0000", 2024-09-10T06:28:00.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017785108000000001 2024-09-10T06:28:00.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424585+0000", 2024-09-10T06:28:00.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010208999999999999 2024-09-10T06:28:00.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.152 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.153 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1415 3.2c e63/22 3:34c14757:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_160:head v 63'5, mlcod=63'3)", 2024-09-10T06:28:00.153 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:00.153 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.63131620499999996, 2024-09-10T06:28:00.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023773743999999999, 2024-09-10T06:28:00.153 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.153 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.153 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.153 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:00.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467994+0000", 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471376+0000", 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033818099999999999 2024-09-10T06:28:00.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471426+0000", 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9846999999999999e-05 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471452+0000", 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6327999999999999e-05 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471621+0000", 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016928200000000001 2024-09-10T06:28:00.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.472399+0000", 2024-09-10T06:28:00.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000777171 2024-09-10T06:28:00.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.491634+0000", 2024-09-10T06:28:00.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019235070999999999 2024-09-10T06:28:00.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.491766+0000", 2024-09-10T06:28:00.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013176799999999999 2024-09-10T06:28:00.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.157 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.157 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1417 3.14 3:29141a67:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.157 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:00.157 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.61838220799999999, 2024-09-10T06:28:00.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026932543, 2024-09-10T06:28:00.157 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.157 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.157 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1417 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:00.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480929+0000", 2024-09-10T06:28:00.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-10T06:28:00.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486391+0000", 2024-09-10T06:28:00.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054618599999999998 2024-09-10T06:28:00.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486425+0000", 2024-09-10T06:28:00.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4031e-05 2024-09-10T06:28:00.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486443+0000", 2024-09-10T06:28:00.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7878999999999999e-05 2024-09-10T06:28:00.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486581+0000", 2024-09-10T06:28:00.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013773400000000001 2024-09-10T06:28:00.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486836+0000", 2024-09-10T06:28:00.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025529900000000001 2024-09-10T06:28:00.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:00.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.487064+0000", 2024-09-10T06:28:00.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000228438 2024-09-10T06:28:00.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.505216+0000", 2024-09-10T06:28:00.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018152130999999998 2024-09-10T06:28:00.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507597+0000", 2024-09-10T06:28:00.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023807260000000001 2024-09-10T06:28:00.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507690+0000", 2024-09-10T06:28:00.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2305999999999993e-05 2024-09-10T06:28:00.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507858+0000", 2024-09-10T06:28:00.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016879199999999999 2024-09-10T06:28:00.162 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.163 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.163 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.163 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1418 3.24 e63/22 3:26ca0de9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_163:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:00.163 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.493351+0000", 2024-09-10T06:28:00.163 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.60595744799999995, 2024-09-10T06:28:00.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01657111, 2024-09-10T06:28:00.163 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.163 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.163 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.163 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493351+0000", 2024-09-10T06:28:00.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493351+0000", 2024-09-10T06:28:00.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493353+0000", 2024-09-10T06:28:00.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-10T06:28:00.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499691+0000", 2024-09-10T06:28:00.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063376029999999998 2024-09-10T06:28:00.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499724+0000", 2024-09-10T06:28:00.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3124999999999999e-05 2024-09-10T06:28:00.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499741+0000", 2024-09-10T06:28:00.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6852000000000001e-05 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499853+0000", 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011278899999999999 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499897+0000", 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3789999999999999e-05 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.509788+0000", 2024-09-10T06:28:00.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098906770000000005 2024-09-10T06:28:00.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.509922+0000", 2024-09-10T06:28:00.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013369099999999999 2024-09-10T06:28:00.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.167 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.167 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1424 3.14 3:28df499c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.167 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:00.167 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.55181048499999996, 2024-09-10T06:28:00.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017872099999999998, 2024-09-10T06:28:00.168 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.168 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.168 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.168 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.168 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.168 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.168 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1424 2024-09-10T06:28:00.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.168 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:00.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:00.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547500+0000", 2024-09-10T06:28:00.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.999e-06 2024-09-10T06:28:00.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551376+0000", 2024-09-10T06:28:00.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038754010000000001 2024-09-10T06:28:00.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551401+0000", 2024-09-10T06:28:00.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5476000000000001e-05 2024-09-10T06:28:00.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551413+0000", 2024-09-10T06:28:00.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2082999999999999e-05 2024-09-10T06:28:00.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551486+0000", 2024-09-10T06:28:00.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2793999999999995e-05 2024-09-10T06:28:00.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551610+0000", 2024-09-10T06:28:00.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123993 2024-09-10T06:28:00.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:00.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551718+0000", 2024-09-10T06:28:00.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107357 2024-09-10T06:28:00.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.559898+0000", 2024-09-10T06:28:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081805860000000001 2024-09-10T06:28:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565204+0000", 2024-09-10T06:28:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053053589999999999 2024-09-10T06:28:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565296+0000", 2024-09-10T06:28:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2291000000000001e-05 2024-09-10T06:28:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565370+0000", 2024-09-10T06:28:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3761000000000001e-05 2024-09-10T06:28:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1429 3.1a 3:5acc80b6:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.501945427, 2024-09-10T06:28:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020448872999999999, 2024-09-10T06:28:00.174 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.174 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.174 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.174 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1429 2024-09-10T06:28:00.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.174 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:00.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:00.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597365+0000", 2024-09-10T06:28:00.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2759999999999999e-06 2024-09-10T06:28:00.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601186+0000", 2024-09-10T06:28:00.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038214410000000001 2024-09-10T06:28:00.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601212+0000", 2024-09-10T06:28:00.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5522999999999999e-05 2024-09-10T06:28:00.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601222+0000", 2024-09-10T06:28:00.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0584999999999999e-05 2024-09-10T06:28:00.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601314+0000", 2024-09-10T06:28:00.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1484999999999996e-05 2024-09-10T06:28:00.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601494+0000", 2024-09-10T06:28:00.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018006899999999999 2024-09-10T06:28:00.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:00.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601655+0000", 2024-09-10T06:28:00.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016119999999999999 2024-09-10T06:28:00.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.607352+0000", 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056970500000000004 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617735+0000", 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010382769 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617780+0000", 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5145999999999998e-05 2024-09-10T06:28:00.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617811+0000", 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1328999999999998e-05 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1433 3.1a 3:59ee0094:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.452331443, 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024407437000000001, 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.180 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.180 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1433 2024-09-10T06:28:00.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.180 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:00.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:00.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646979+0000", 2024-09-10T06:28:00.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.074e-06 2024-09-10T06:28:00.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.650998+0000", 2024-09-10T06:28:00.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040192470000000001 2024-09-10T06:28:00.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651031+0000", 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2821000000000003e-05 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651050+0000", 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9556e-05 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651150+0000", 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9689e-05 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651325+0000", 2024-09-10T06:28:00.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017529199999999999 2024-09-10T06:28:00.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:00.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651496+0000", 2024-09-10T06:28:00.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000170531 2024-09-10T06:28:00.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.659894+0000", 2024-09-10T06:28:00.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083978049999999995 2024-09-10T06:28:00.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671085+0000", 2024-09-10T06:28:00.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011190989 2024-09-10T06:28:00.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671261+0000", 2024-09-10T06:28:00.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017616800000000001 2024-09-10T06:28:00.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671384+0000", 2024-09-10T06:28:00.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012326500000000001 2024-09-10T06:28:00.185 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.185 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.185 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.185 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1446 3.29 e64/22 3:97120176:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_191:head v 64'4, mlcod=63'2)", 2024-09-10T06:28:00.185 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.780199+0000", 2024-09-10T06:28:00.185 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.31910929700000001, 2024-09-10T06:28:00.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015204845999999999, 2024-09-10T06:28:00.185 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.185 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.185 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.185 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.780199+0000", 2024-09-10T06:28:00.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.780199+0000", 2024-09-10T06:28:00.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.780201+0000", 2024-09-10T06:28:00.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0660000000000002e-06 2024-09-10T06:28:00.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.783963+0000", 2024-09-10T06:28:00.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037619649999999999 2024-09-10T06:28:00.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.783986+0000", 2024-09-10T06:28:00.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3482999999999999e-05 2024-09-10T06:28:00.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.783996+0000", 2024-09-10T06:28:00.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0165e-05 2024-09-10T06:28:00.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.784176+0000", 2024-09-10T06:28:00.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017985000000000001 2024-09-10T06:28:00.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.784218+0000", 2024-09-10T06:28:00.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2203999999999998e-05 2024-09-10T06:28:00.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.795331+0000", 2024-09-10T06:28:00.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011112541 2024-09-10T06:28:00.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.795404+0000", 2024-09-10T06:28:00.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2571999999999996e-05 2024-09-10T06:28:00.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.189 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.189 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1450 3.27 e64/22 3:e710f600:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_195:head v 64'2, mlcod=0'0)", 2024-09-10T06:28:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.826079+0000", 2024-09-10T06:28:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.27322920699999997, 2024-09-10T06:28:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015110722, 2024-09-10T06:28:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.826079+0000", 2024-09-10T06:28:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.826079+0000", 2024-09-10T06:28:00.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.826081+0000", 2024-09-10T06:28:00.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9240000000000001e-06 2024-09-10T06:28:00.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.830155+0000", 2024-09-10T06:28:00.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040744120000000003 2024-09-10T06:28:00.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.830188+0000", 2024-09-10T06:28:00.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3145999999999997e-05 2024-09-10T06:28:00.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.830215+0000", 2024-09-10T06:28:00.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6611999999999999e-05 2024-09-10T06:28:00.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.830407+0000", 2024-09-10T06:28:00.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000191738 2024-09-10T06:28:00.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.830448+0000", 2024-09-10T06:28:00.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1196999999999999e-05 2024-09-10T06:28:00.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.841006+0000", 2024-09-10T06:28:00.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010558514999999999 2024-09-10T06:28:00.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.841189+0000", 2024-09-10T06:28:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018317799999999999 2024-09-10T06:28:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1470 3.34 3:2e4989bb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.055139516999999999, 2024-09-10T06:28:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019466533000000001, 2024-09-10T06:28:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.195 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1470 2024-09-10T06:28:00.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.195 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:00.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:00.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044172+0000", 2024-09-10T06:28:00.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5939999999999998e-06 2024-09-10T06:28:00.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048101+0000", 2024-09-10T06:28:00.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003929325 2024-09-10T06:28:00.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048135+0000", 2024-09-10T06:28:00.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3856000000000002e-05 2024-09-10T06:28:00.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048150+0000", 2024-09-10T06:28:00.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.523e-05 2024-09-10T06:28:00.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048258+0000", 2024-09-10T06:28:00.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108025 2024-09-10T06:28:00.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048437+0000", 2024-09-10T06:28:00.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017811199999999999 2024-09-10T06:28:00.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:00.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048550+0000", 2024-09-10T06:28:00.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113181 2024-09-10T06:28:00.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063173+0000", 2024-09-10T06:28:00.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014623565 2024-09-10T06:28:00.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063361+0000", 2024-09-10T06:28:00.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018807599999999999 2024-09-10T06:28:00.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063499+0000", 2024-09-10T06:28:00.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013745000000000001 2024-09-10T06:28:00.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063635+0000", 2024-09-10T06:28:00.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136119 2024-09-10T06:28:00.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.200 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.200 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1472 3.34 3:2e34818b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:00.200 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.062471+0000", 2024-09-10T06:28:00.200 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.036837288000000003, 2024-09-10T06:28:00.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016070911, 2024-09-10T06:28:00.200 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.200 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.200 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.201 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1472 2024-09-10T06:28:00.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.201 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.062471+0000", 2024-09-10T06:28:00.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.062471+0000", 2024-09-10T06:28:00.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.062473+0000", 2024-09-10T06:28:00.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0190000000000001e-06 2024-09-10T06:28:00.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066284+0000", 2024-09-10T06:28:00.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038111659999999999 2024-09-10T06:28:00.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066302+0000", 2024-09-10T06:28:00.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8216e-05 2024-09-10T06:28:00.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066311+0000", 2024-09-10T06:28:00.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7460000000000006e-06 2024-09-10T06:28:00.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066370+0000", 2024-09-10T06:28:00.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9292000000000001e-05 2024-09-10T06:28:00.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066526+0000", 2024-09-10T06:28:00.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155783 2024-09-10T06:28:00.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:00.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066639+0000", 2024-09-10T06:28:00.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113212 2024-09-10T06:28:00.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078013+0000", 2024-09-10T06:28:00.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011373822 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078408+0000", 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000395086 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078486+0000", 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8176999999999994e-05 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078542+0000", 2024-09-10T06:28:00.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5392000000000001e-05 2024-09-10T06:28:00.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.206 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.206 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.206 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:00.207 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:28:00.208 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:00.204+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:00.308 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:00.308+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:00.393 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:00.394 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:00.394 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:00.408 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:28:00.409 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:00.408+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:00.421 INFO:tasks.workunit.client.0.smithi112.stdout:quota enabled for the user usr2 2024-09-10T06:28:00.421 INFO:tasks.workunit.client.0.smithi112.stdout:adding file to bucket buck_2024_08_10_06_27_54: 1Gb. 2024-09-10T06:28:00.421 INFO:tasks.workunit.client.0.smithi112.stdout:upload file successful 2024-09-10T06:28:00.421 INFO:tasks.workunit.client.0.smithi112.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T06:28:00.421 INFO:tasks.workunit.client.0.smithi112.stdout:Test case: PASSED - quota set for user: usr2 with max_size=1048576000 passed 2024-09-10T06:28:00.421 INFO:tasks.workunit.client.0.smithi112.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T06:28:00.442 INFO:teuthology.orchestra.run.smithi112.stdout:moved 0 / 530 (0%) 2024-09-10T06:28:00.442 INFO:teuthology.orchestra.run.smithi112.stdout:avg 66.25 2024-09-10T06:28:00.442 INFO:teuthology.orchestra.run.smithi112.stdout:stddev 8.3179 -> 8.3179 (expected baseline 7.61372) 2024-09-10T06:28:00.442 INFO:teuthology.orchestra.run.smithi112.stdout:min osd.2 with 51 -> 51 pgs (0.769811 -> 0.769811 * mean) 2024-09-10T06:28:00.442 INFO:teuthology.orchestra.run.smithi112.stdout:max osd.3 with 79 -> 79 pgs (1.19245 -> 1.19245 * mean) 2024-09-10T06:28:00.442 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:28:00.442 INFO:teuthology.orchestra.run.smithi112.stdout:oload 1000 2024-09-10T06:28:00.442 INFO:teuthology.orchestra.run.smithi112.stdout:max_change 1 2024-09-10T06:28:00.443 INFO:teuthology.orchestra.run.smithi112.stdout:max_change_osds 4 2024-09-10T06:28:00.443 INFO:teuthology.orchestra.run.smithi112.stdout:average_utilization 0.0003 2024-09-10T06:28:00.443 INFO:teuthology.orchestra.run.smithi112.stdout:overload_utilization 0.0034 2024-09-10T06:28:00.443 INFO:teuthology.orchestra.run.smithi112.stderr:no change 2024-09-10T06:28:00.465 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-10T06:28:00.465 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2024-09-10T06:28:00.549 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:00.548+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:00.571 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:00.571 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:00.571 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:00.589 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:28:00.610 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:00.608+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:00.619 INFO:tasks.workunit.client.0.smithi112.stdout:user usr2 deleted 2024-09-10T06:28:00.706 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1354 3.5 3:a2100466:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.78628973, 2024-09-10T06:28:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022320934000000001, 2024-09-10T06:28:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1354 2024-09-10T06:28:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919975+0000", 2024-09-10T06:28:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4369999999999999e-06 2024-09-10T06:28:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926675+0000", 2024-09-10T06:28:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066993529999999999 2024-09-10T06:28:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926705+0000", 2024-09-10T06:28:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0391000000000001e-05 2024-09-10T06:28:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926722+0000", 2024-09-10T06:28:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7159e-05 2024-09-10T06:28:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926840+0000", 2024-09-10T06:28:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117459 2024-09-10T06:28:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.927092+0000", 2024-09-10T06:28:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025180899999999997 2024-09-10T06:28:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.927353+0000", 2024-09-10T06:28:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026148499999999999 2024-09-10T06:28:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.940116+0000", 2024-09-10T06:28:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01276245 2024-09-10T06:28:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.941993+0000", 2024-09-10T06:28:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001877079 2024-09-10T06:28:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.942164+0000", 2024-09-10T06:28:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171378 2024-09-10T06:28:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.942293+0000", 2024-09-10T06:28:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012893400000000001 2024-09-10T06:28:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1355 3.16 3:6be207af:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.7755401289999999, 2024-09-10T06:28:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023027044, 2024-09-10T06:28:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1355 2024-09-10T06:28:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930724+0000", 2024-09-10T06:28:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5100000000000001e-06 2024-09-10T06:28:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937234+0000", 2024-09-10T06:28:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065097760000000001 2024-09-10T06:28:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937259+0000", 2024-09-10T06:28:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4915000000000001e-05 2024-09-10T06:28:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937275+0000", 2024-09-10T06:28:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6659000000000001e-05 2024-09-10T06:28:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937437+0000", 2024-09-10T06:28:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161259 2024-09-10T06:28:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937718+0000", 2024-09-10T06:28:00.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028092699999999999 2024-09-10T06:28:00.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:00.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937955+0000", 2024-09-10T06:28:00.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023767300000000001 2024-09-10T06:28:00.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.952527+0000", 2024-09-10T06:28:00.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014571850000000001 2024-09-10T06:28:00.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953577+0000", 2024-09-10T06:28:00.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001049601 2024-09-10T06:28:00.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953671+0000", 2024-09-10T06:28:00.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4580000000000006e-05 2024-09-10T06:28:00.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953749+0000", 2024-09-10T06:28:00.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7293999999999996e-05 2024-09-10T06:28:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1364 3.36 e63/22 3:6e968b0d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_119:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.040414+0000", 2024-09-10T06:28:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.665848183, 2024-09-10T06:28:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016263488, 2024-09-10T06:28:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.040414+0000", 2024-09-10T06:28:00.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.040414+0000", 2024-09-10T06:28:00.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.040417+0000", 2024-09-10T06:28:00.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1690000000000001e-06 2024-09-10T06:28:00.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.043132+0000", 2024-09-10T06:28:00.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00271544 2024-09-10T06:28:00.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.043181+0000", 2024-09-10T06:28:00.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8986000000000002e-05 2024-09-10T06:28:00.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.043206+0000", 2024-09-10T06:28:00.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4712e-05 2024-09-10T06:28:00.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.043387+0000", 2024-09-10T06:28:00.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018164400000000001 2024-09-10T06:28:00.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.043444+0000", 2024-09-10T06:28:00.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6162999999999997e-05 2024-09-10T06:28:00.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.056505+0000", 2024-09-10T06:28:00.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013061372 2024-09-10T06:28:00.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.056677+0000", 2024-09-10T06:28:00.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017200200000000001 2024-09-10T06:28:00.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.723 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.724 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1369 3.22 3:45ffca16:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.724 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:00.724 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.611486628, 2024-09-10T06:28:00.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020833028999999999, 2024-09-10T06:28:00.724 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.724 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.724 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.724 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1369 2024-09-10T06:28:00.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.725 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:00.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:00.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094779+0000", 2024-09-10T06:28:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1099999999999996e-06 2024-09-10T06:28:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100674+0000", 2024-09-10T06:28:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058944740000000002 2024-09-10T06:28:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100714+0000", 2024-09-10T06:28:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0527e-05 2024-09-10T06:28:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100732+0000", 2024-09-10T06:28:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8034999999999999e-05 2024-09-10T06:28:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100871+0000", 2024-09-10T06:28:00.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013849399999999999 2024-09-10T06:28:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.101123+0000", 2024-09-10T06:28:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025259000000000002 2024-09-10T06:28:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.101372+0000", 2024-09-10T06:28:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024846599999999998 2024-09-10T06:28:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.111593+0000", 2024-09-10T06:28:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010221165000000001 2024-09-10T06:28:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115305+0000", 2024-09-10T06:28:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037123249999999998 2024-09-10T06:28:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115476+0000", 2024-09-10T06:28:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017085200000000001 2024-09-10T06:28:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115608+0000", 2024-09-10T06:28:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131991 2024-09-10T06:28:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1372 3.36 e63/22 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.567864122, 2024-09-10T06:28:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018914395000000001, 2024-09-10T06:28:00.730 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:00.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138401+0000", 2024-09-10T06:28:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3859999999999999e-06 2024-09-10T06:28:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142599+0000", 2024-09-10T06:28:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041982190000000004 2024-09-10T06:28:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142649+0000", 2024-09-10T06:28:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9477000000000001e-05 2024-09-10T06:28:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142674+0000", 2024-09-10T06:28:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5558000000000002e-05 2024-09-10T06:28:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142832+0000", 2024-09-10T06:28:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158159 2024-09-10T06:28:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142879+0000", 2024-09-10T06:28:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6650000000000002e-05 2024-09-10T06:28:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157209+0000", 2024-09-10T06:28:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014330209999999999 2024-09-10T06:28:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157312+0000", 2024-09-10T06:28:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102736 2024-09-10T06:28:00.734 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1373 3.35 e63/22 3:ac8a3287:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_128:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.148374+0000", 2024-09-10T06:28:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.557887405, 2024-09-10T06:28:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017663458999999999, 2024-09-10T06:28:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148374+0000", 2024-09-10T06:28:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148374+0000", 2024-09-10T06:28:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148378+0000", 2024-09-10T06:28:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4869999999999998e-06 2024-09-10T06:28:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153210+0000", 2024-09-10T06:28:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048319130000000002 2024-09-10T06:28:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153243+0000", 2024-09-10T06:28:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3794000000000002e-05 2024-09-10T06:28:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153266+0000", 2024-09-10T06:28:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2841999999999999e-05 2024-09-10T06:28:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153394+0000", 2024-09-10T06:28:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012804099999999999 2024-09-10T06:28:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153432+0000", 2024-09-10T06:28:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7194000000000003e-05 2024-09-10T06:28:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.165933+0000", 2024-09-10T06:28:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012501583 2024-09-10T06:28:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166038+0000", 2024-09-10T06:28:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010460500000000001 2024-09-10T06:28:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1374 3.2f 3:f735f5eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.552839823, 2024-09-10T06:28:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028841426, 2024-09-10T06:28:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1374 2024-09-10T06:28:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.740 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153425+0000", 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8030000000000001e-06 2024-09-10T06:28:00.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157050+0000", 2024-09-10T06:28:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036249070000000001 2024-09-10T06:28:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157081+0000", 2024-09-10T06:28:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1525000000000001e-05 2024-09-10T06:28:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157103+0000", 2024-09-10T06:28:00.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1599000000000001e-05 2024-09-10T06:28:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157253+0000", 2024-09-10T06:28:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150266 2024-09-10T06:28:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157545+0000", 2024-09-10T06:28:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029204399999999998 2024-09-10T06:28:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:00.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157898+0000", 2024-09-10T06:28:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035326200000000002 2024-09-10T06:28:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181021+0000", 2024-09-10T06:28:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023123008 2024-09-10T06:28:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181894+0000", 2024-09-10T06:28:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00087308700000000004 2024-09-10T06:28:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.182128+0000", 2024-09-10T06:28:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000233811 2024-09-10T06:28:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.182263+0000", 2024-09-10T06:28:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013511400000000001 2024-09-10T06:28:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1388 3.21 e63/22 3:8602187c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_143:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.293970+0000", 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.4122913210000001, 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015593093000000001, 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.293970+0000", 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.293970+0000", 2024-09-10T06:28:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.293973+0000", 2024-09-10T06:28:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9359999999999999e-06 2024-09-10T06:28:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.298507+0000", 2024-09-10T06:28:00.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045332330000000002 2024-09-10T06:28:00.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.298537+0000", 2024-09-10T06:28:00.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0638e-05 2024-09-10T06:28:00.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.298560+0000", 2024-09-10T06:28:00.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2415000000000001e-05 2024-09-10T06:28:00.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.298696+0000", 2024-09-10T06:28:00.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013598399999999999 2024-09-10T06:28:00.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.298737+0000", 2024-09-10T06:28:00.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1857000000000003e-05 2024-09-10T06:28:00.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.309410+0000", 2024-09-10T06:28:00.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010672554000000001 2024-09-10T06:28:00.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.309563+0000", 2024-09-10T06:28:00.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015347599999999999 2024-09-10T06:28:00.750 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.750 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.750 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.750 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1391 3.1c 3:3a76b5ac:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.750 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:00.750 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.384102817, 2024-09-10T06:28:00.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032016492000000001, 2024-09-10T06:28:00.751 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.751 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.751 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.751 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.751 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.751 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.751 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1391 2024-09-10T06:28:00.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.751 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:00.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322162+0000", 2024-09-10T06:28:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.523e-06 2024-09-10T06:28:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326140+0000", 2024-09-10T06:28:00.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039776000000000004 2024-09-10T06:28:00.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326177+0000", 2024-09-10T06:28:00.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6878000000000002e-05 2024-09-10T06:28:00.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326195+0000", 2024-09-10T06:28:00.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8576e-05 2024-09-10T06:28:00.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326334+0000", 2024-09-10T06:28:00.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013836600000000001 2024-09-10T06:28:00.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326608+0000", 2024-09-10T06:28:00.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000274586 2024-09-10T06:28:00.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:00.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326847+0000", 2024-09-10T06:28:00.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023812 2024-09-10T06:28:00.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.338793+0000", 2024-09-10T06:28:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011946141 2024-09-10T06:28:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354011+0000", 2024-09-10T06:28:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015217856 2024-09-10T06:28:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354100+0000", 2024-09-10T06:28:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9497e-05 2024-09-10T06:28:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354175+0000", 2024-09-10T06:28:00.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5349e-05 2024-09-10T06:28:00.756 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.756 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.756 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.756 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1399 3.38 e63/22 3:1dcd0b88:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_154:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:00.756 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:00.756 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.30053171, 2024-09-10T06:28:00.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019306528999999999, 2024-09-10T06:28:00.756 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.757 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.757 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.757 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:00.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:00.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405734+0000", 2024-09-10T06:28:00.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2529999999999998e-06 2024-09-10T06:28:00.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410725+0000", 2024-09-10T06:28:00.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049902849999999997 2024-09-10T06:28:00.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410776+0000", 2024-09-10T06:28:00.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1762999999999999e-05 2024-09-10T06:28:00.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410805+0000", 2024-09-10T06:28:00.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8274999999999999e-05 2024-09-10T06:28:00.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410984+0000", 2024-09-10T06:28:00.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017977800000000001 2024-09-10T06:28:00.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.411050+0000", 2024-09-10T06:28:00.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6115e-05 2024-09-10T06:28:00.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424826+0000", 2024-09-10T06:28:00.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013775267000000001 2024-09-10T06:28:00.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.425037+0000", 2024-09-10T06:28:00.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000210793 2024-09-10T06:28:00.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.760 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1412 3.38 e63/22 3:1da1fffe:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_157:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.436021+0000", 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.270240815, 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01561039, 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.436021+0000", 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.436021+0000", 2024-09-10T06:28:00.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.436024+0000", 2024-09-10T06:28:00.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6699999999999998e-06 2024-09-10T06:28:00.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.440005+0000", 2024-09-10T06:28:00.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039817730000000001 2024-09-10T06:28:00.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.440039+0000", 2024-09-10T06:28:00.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3902000000000002e-05 2024-09-10T06:28:00.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.440056+0000", 2024-09-10T06:28:00.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7062e-05 2024-09-10T06:28:00.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.440180+0000", 2024-09-10T06:28:00.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012350100000000001 2024-09-10T06:28:00.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.440224+0000", 2024-09-10T06:28:00.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4131000000000001e-05 2024-09-10T06:28:00.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.451533+0000", 2024-09-10T06:28:00.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011308604 2024-09-10T06:28:00.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.451631+0000", 2024-09-10T06:28:00.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8746999999999995e-05 2024-09-10T06:28:00.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.765 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.765 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1421 3.16 3:69839037:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.765 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:00.765 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.1872073249999999, 2024-09-10T06:28:00.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022412087000000001, 2024-09-10T06:28:00.765 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.766 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.766 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1421 2024-09-10T06:28:00.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.766 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:00.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519058+0000", 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.354e-06 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.522967+0000", 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003909231 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523003+0000", 2024-09-10T06:28:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5981e-05 2024-09-10T06:28:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523021+0000", 2024-09-10T06:28:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8362000000000001e-05 2024-09-10T06:28:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523166+0000", 2024-09-10T06:28:00.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014476699999999999 2024-09-10T06:28:00.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523435+0000", 2024-09-10T06:28:00.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026895800000000002 2024-09-10T06:28:00.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:00.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523671+0000", 2024-09-10T06:28:00.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023608099999999999 2024-09-10T06:28:00.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538600+0000", 2024-09-10T06:28:00.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014929318 2024-09-10T06:28:00.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541356+0000", 2024-09-10T06:28:00.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002755216 2024-09-10T06:28:00.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541420+0000", 2024-09-10T06:28:00.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4775000000000002e-05 2024-09-10T06:28:00.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541466+0000", 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6044000000000002e-05 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1423 3.5 3:a38f4fc9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.538548+0000", 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.1677136850000001, 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017201465999999999, 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.771 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.772 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.772 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1423 2024-09-10T06:28:00.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.772 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538548+0000", 2024-09-10T06:28:00.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538548+0000", 2024-09-10T06:28:00.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538553+0000", 2024-09-10T06:28:00.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7249999999999997e-06 2024-09-10T06:28:00.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542507+0000", 2024-09-10T06:28:00.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039544719999999997 2024-09-10T06:28:00.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542538+0000", 2024-09-10T06:28:00.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1161000000000002e-05 2024-09-10T06:28:00.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542559+0000", 2024-09-10T06:28:00.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0953000000000001e-05 2024-09-10T06:28:00.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542674+0000", 2024-09-10T06:28:00.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114788 2024-09-10T06:28:00.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542804+0000", 2024-09-10T06:28:00.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013024600000000001 2024-09-10T06:28:00.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:00.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542912+0000", 2024-09-10T06:28:00.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107738 2024-09-10T06:28:00.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.550500+0000", 2024-09-10T06:28:00.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075878769999999998 2024-09-10T06:28:00.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.555620+0000", 2024-09-10T06:28:00.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051202009999999996 2024-09-10T06:28:00.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.555693+0000", 2024-09-10T06:28:00.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2719000000000006e-05 2024-09-10T06:28:00.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.555749+0000", 2024-09-10T06:28:00.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6586000000000003e-05 2024-09-10T06:28:00.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.777 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.777 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1439 3.3c 3:3e1c16d9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:00.777 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:00.777 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.0003363860000001, 2024-09-10T06:28:00.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020786124999999999, 2024-09-10T06:28:00.777 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.777 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.777 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.778 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1439 2024-09-10T06:28:00.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.778 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:00.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:00.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705929+0000", 2024-09-10T06:28:00.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1620000000000001e-06 2024-09-10T06:28:00.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.709954+0000", 2024-09-10T06:28:00.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004024344 2024-09-10T06:28:00.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.709991+0000", 2024-09-10T06:28:00.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6868e-05 2024-09-10T06:28:00.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710009+0000", 2024-09-10T06:28:00.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8422000000000001e-05 2024-09-10T06:28:00.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710091+0000", 2024-09-10T06:28:00.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1440000000000006e-05 2024-09-10T06:28:00.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:00.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710105+0000", 2024-09-10T06:28:00.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4072e-05 2024-09-10T06:28:00.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.713970+0000", 2024-09-10T06:28:00.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038651699999999998 2024-09-10T06:28:00.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.714137+0000", 2024-09-10T06:28:00.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016704999999999999 2024-09-10T06:28:00.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:00.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.714352+0000", 2024-09-10T06:28:00.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021503099999999999 2024-09-10T06:28:00.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.721589+0000", 2024-09-10T06:28:00.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072370680000000001 2024-09-10T06:28:00.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726578+0000", 2024-09-10T06:28:00.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049887300000000002 2024-09-10T06:28:00.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726659+0000", 2024-09-10T06:28:00.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0972999999999999e-05 2024-09-10T06:28:00.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726711+0000", 2024-09-10T06:28:00.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2794999999999999e-05 2024-09-10T06:28:00.783 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.784 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.784 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1447 3.16 3:6989ebe4:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:00.784 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.789776+0000", 2024-09-10T06:28:00.784 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.91648577600000003, 2024-09-10T06:28:00.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015756097, 2024-09-10T06:28:00.784 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.784 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.784 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1447 2024-09-10T06:28:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.789776+0000", 2024-09-10T06:28:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.789776+0000", 2024-09-10T06:28:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.789778+0000", 2024-09-10T06:28:00.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3580000000000001e-06 2024-09-10T06:28:00.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.793507+0000", 2024-09-10T06:28:00.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037289570000000002 2024-09-10T06:28:00.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.793532+0000", 2024-09-10T06:28:00.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4932000000000001e-05 2024-09-10T06:28:00.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.793545+0000", 2024-09-10T06:28:00.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3185e-05 2024-09-10T06:28:00.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.793616+0000", 2024-09-10T06:28:00.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0604000000000004e-05 2024-09-10T06:28:00.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.793753+0000", 2024-09-10T06:28:00.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000137133 2024-09-10T06:28:00.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:00.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.793879+0000", 2024-09-10T06:28:00.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012596999999999999 2024-09-10T06:28:00.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.805059+0000", 2024-09-10T06:28:00.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011179493 2024-09-10T06:28:00.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.805240+0000", 2024-09-10T06:28:00.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018151800000000001 2024-09-10T06:28:00.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.805395+0000", 2024-09-10T06:28:00.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155143 2024-09-10T06:28:00.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.805532+0000", 2024-09-10T06:28:00.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136804 2024-09-10T06:28:00.789 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.789 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.790 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.790 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1454 3.5 3:a08a9c17:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:00.790 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:00.790 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.83585869499999998, 2024-09-10T06:28:00.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018980882000000001, 2024-09-10T06:28:00.790 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.790 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.790 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.791 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1454 2024-09-10T06:28:00.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.791 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:00.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:00.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870407+0000", 2024-09-10T06:28:00.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9090000000000002e-06 2024-09-10T06:28:00.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874434+0000", 2024-09-10T06:28:00.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040275700000000003 2024-09-10T06:28:00.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874471+0000", 2024-09-10T06:28:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6528e-05 2024-09-10T06:28:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874496+0000", 2024-09-10T06:28:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4751000000000001e-05 2024-09-10T06:28:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874624+0000", 2024-09-10T06:28:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012825600000000001 2024-09-10T06:28:00.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874828+0000", 2024-09-10T06:28:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020377700000000001 2024-09-10T06:28:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.875010+0000", 2024-09-10T06:28:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018253200000000001 2024-09-10T06:28:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.883337+0000", 2024-09-10T06:28:00.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083265860000000004 2024-09-10T06:28:00.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889239+0000", 2024-09-10T06:28:00.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059024409999999996 2024-09-10T06:28:00.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889322+0000", 2024-09-10T06:28:00.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2216e-05 2024-09-10T06:28:00.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889384+0000", 2024-09-10T06:28:00.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2316000000000004e-05 2024-09-10T06:28:00.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.796 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.796 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1463 3.c 3:32b18461:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:00.796 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:00.796 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.73288697999999997, 2024-09-10T06:28:00.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019470828999999999, 2024-09-10T06:28:00.796 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.796 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.797 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1463 2024-09-10T06:28:00.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.797 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:00.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:00.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973377+0000", 2024-09-10T06:28:00.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5749999999999999e-06 2024-09-10T06:28:00.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977213+0000", 2024-09-10T06:28:00.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038358789999999999 2024-09-10T06:28:00.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977239+0000", 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5965999999999998e-05 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977252+0000", 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2472e-05 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977406+0000", 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000154809 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977687+0000", 2024-09-10T06:28:00.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028013400000000003 2024-09-10T06:28:00.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:00.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977963+0000", 2024-09-10T06:28:00.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027642500000000001 2024-09-10T06:28:00.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.987026+0000", 2024-09-10T06:28:00.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090629430000000004 2024-09-10T06:28:00.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992655+0000", 2024-09-10T06:28:00.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056288320000000003 2024-09-10T06:28:00.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992765+0000", 2024-09-10T06:28:00.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110276 2024-09-10T06:28:00.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992846+0000", 2024-09-10T06:28:00.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0518000000000004e-05 2024-09-10T06:28:00.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.802 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.802 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1469 3.d e64/22 3:b3f21559:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_214:head v 64'1, mlcod=0'0)", 2024-09-10T06:28:00.802 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:00.802 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.66658202300000002, 2024-09-10T06:28:00.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01994638, 2024-09-10T06:28:00.802 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.802 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039683+0000", 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0929999999999999e-06 2024-09-10T06:28:00.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044782+0000", 2024-09-10T06:28:00.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050988240000000001 2024-09-10T06:28:00.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044821+0000", 2024-09-10T06:28:00.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9764000000000001e-05 2024-09-10T06:28:00.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044839+0000", 2024-09-10T06:28:00.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7598999999999999e-05 2024-09-10T06:28:00.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044936+0000", 2024-09-10T06:28:00.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7388999999999999e-05 2024-09-10T06:28:00.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044962+0000", 2024-09-10T06:28:00.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5967999999999999e-05 2024-09-10T06:28:00.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059554+0000", 2024-09-10T06:28:00.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014592055 2024-09-10T06:28:00.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059626+0000", 2024-09-10T06:28:00.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1687999999999995e-05 2024-09-10T06:28:00.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.806 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.806 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1482 3.35 e64/22 3:ad9242de:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_227:head v 64'5, mlcod=63'3)", 2024-09-10T06:28:00.806 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.164584+0000", 2024-09-10T06:28:00.807 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.54167734599999995, 2024-09-10T06:28:00.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017917325000000001, 2024-09-10T06:28:00.807 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.807 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.807 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.807 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164584+0000", 2024-09-10T06:28:00.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164584+0000", 2024-09-10T06:28:00.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164585+0000", 2024-09-10T06:28:00.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8700000000000002e-07 2024-09-10T06:28:00.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166303+0000", 2024-09-10T06:28:00.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001718853 2024-09-10T06:28:00.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166326+0000", 2024-09-10T06:28:00.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2432000000000001e-05 2024-09-10T06:28:00.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166337+0000", 2024-09-10T06:28:00.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0706999999999999e-05 2024-09-10T06:28:00.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166414+0000", 2024-09-10T06:28:00.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7855999999999995e-05 2024-09-10T06:28:00.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166443+0000", 2024-09-10T06:28:00.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8827999999999999e-05 2024-09-10T06:28:00.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182419+0000", 2024-09-10T06:28:00.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015975432000000001 2024-09-10T06:28:00.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182502+0000", 2024-09-10T06:28:00.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2929999999999994e-05 2024-09-10T06:28:00.811 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.811 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.811 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.811 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1503 3.1c 3:383b1d54:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_248:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:00.811 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.369146+0000", 2024-09-10T06:28:00.811 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.33711535500000001, 2024-09-10T06:28:00.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016922006999999999, 2024-09-10T06:28:00.811 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:00.811 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:00.811 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:00.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:00.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:00.812 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:00.812 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1503 2024-09-10T06:28:00.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.812 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:00.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:00.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.369146+0000", 2024-09-10T06:28:00.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:00.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.369146+0000", 2024-09-10T06:28:00.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:00.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:00.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.369149+0000", 2024-09-10T06:28:00.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4339999999999999e-06 2024-09-10T06:28:00.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:00.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.372988+0000", 2024-09-10T06:28:00.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003839248 2024-09-10T06:28:00.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:00.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373020+0000", 2024-09-10T06:28:00.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2293999999999999e-05 2024-09-10T06:28:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373036+0000", 2024-09-10T06:28:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5875e-05 2024-09-10T06:28:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373142+0000", 2024-09-10T06:28:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105469 2024-09-10T06:28:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:00.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373265+0000", 2024-09-10T06:28:00.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012343799999999999 2024-09-10T06:28:00.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:00.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373374+0000", 2024-09-10T06:28:00.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108656 2024-09-10T06:28:00.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:00.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.383143+0000", 2024-09-10T06:28:00.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097691649999999998 2024-09-10T06:28:00.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.385934+0000", 2024-09-10T06:28:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027914419999999999 2024-09-10T06:28:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.386009+0000", 2024-09-10T06:28:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4734000000000006e-05 2024-09-10T06:28:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.386068+0000", 2024-09-10T06:28:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252000000000001e-05 2024-09-10T06:28:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.816 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:00.817 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:00.817 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:00.818 INFO:tasks.workunit.client.0.smithi112.stdout:Bucket Created: buck_2024_08_10_06_28_00 2024-09-10T06:28:00.818 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:28:00.819 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:00.816+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:00.919 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:00.916+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:00.949 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:00.949 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:00.949 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:00.963 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:28:00.989 INFO:tasks.workunit.client.0.smithi112.stderr:10+0 records in 2024-09-10T06:28:00.989 INFO:tasks.workunit.client.0.smithi112.stderr:10+0 records out 2024-09-10T06:28:00.989 INFO:tasks.workunit.client.0.smithi112.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0655017 s, 1.6 GB/s 2024-09-10T06:28:00.997 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:28:01.041 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:01.040+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:01.083 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:01.083 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:01.099 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:28:01.144 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:01.144+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:01.155 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:28:01.155 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:28:01.171 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:28:01.171 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:28:01.186 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:28:01.186 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:28:01.201 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:28:01.201 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:28:01.220 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:28:01.220 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:28:01.223 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:01.220+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:01.225 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:01.225 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:01.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:01.226 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:01.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.226 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:28:01.226 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:28:01.226 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 82.943777675999996, 2024-09-10T06:28:01.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016848367, 2024-09-10T06:28:01.226 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.226 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.226 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.226 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:01.226 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:01.226 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:01.226 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 46 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280021+0000", 2024-09-10T06:28:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0069999999999999e-06 2024-09-10T06:28:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280036+0000", 2024-09-10T06:28:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.483e-05 2024-09-10T06:28:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280070+0000", 2024-09-10T06:28:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4106000000000002e-05 2024-09-10T06:28:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280094+0000", 2024-09-10T06:28:01.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4037e-05 2024-09-10T06:28:01.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280246+0000", 2024-09-10T06:28:01.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000152199 2024-09-10T06:28:01.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:28:01.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280271+0000", 2024-09-10T06:28:01.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4581999999999999e-05 2024-09-10T06:28:01.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.289388+0000", 2024-09-10T06:28:01.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091175639999999999 2024-09-10T06:28:01.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.290774+0000", 2024-09-10T06:28:01.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013859860000000001 2024-09-10T06:28:01.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:01.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291069+0000", 2024-09-10T06:28:01.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000294534 2024-09-10T06:28:01.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:01.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295828+0000", 2024-09-10T06:28:01.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047595729999999996 2024-09-10T06:28:01.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:01.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296614+0000", 2024-09-10T06:28:01.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00078534700000000004 2024-09-10T06:28:01.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296759+0000", 2024-09-10T06:28:01.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014571300000000001 2024-09-10T06:28:01.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296865+0000", 2024-09-10T06:28:01.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105889 2024-09-10T06:28:01.232 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.232 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.232 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.232 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1357 3.1e e63/22 3:7863b3e2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_112:head v 63'1, mlcod=0'0)", 2024-09-10T06:28:01.232 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.960485+0000", 2024-09-10T06:28:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.263310068, 2024-09-10T06:28:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017126476000000002, 2024-09-10T06:28:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.960485+0000", 2024-09-10T06:28:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.960485+0000", 2024-09-10T06:28:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.960487+0000", 2024-09-10T06:28:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6230000000000001e-06 2024-09-10T06:28:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966394+0000", 2024-09-10T06:28:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059067119999999997 2024-09-10T06:28:01.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966432+0000", 2024-09-10T06:28:01.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8133000000000002e-05 2024-09-10T06:28:01.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966453+0000", 2024-09-10T06:28:01.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0536000000000001e-05 2024-09-10T06:28:01.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966585+0000", 2024-09-10T06:28:01.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013260400000000001 2024-09-10T06:28:01.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966628+0000", 2024-09-10T06:28:01.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3273999999999999e-05 2024-09-10T06:28:01.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977524+0000", 2024-09-10T06:28:01.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010895207000000001 2024-09-10T06:28:01.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977611+0000", 2024-09-10T06:28:01.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7386999999999995e-05 2024-09-10T06:28:01.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.237 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.237 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1359 3.34 e63/22 3:2ece4e0b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_114:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:01.237 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.982175+0000", 2024-09-10T06:28:01.237 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.241619837, 2024-09-10T06:28:01.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015763586999999999, 2024-09-10T06:28:01.237 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.237 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.237 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.238 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.982175+0000", 2024-09-10T06:28:01.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.982175+0000", 2024-09-10T06:28:01.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.982177+0000", 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.616e-06 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984716+0000", 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00253885 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984752+0000", 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6060999999999999e-05 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984773+0000", 2024-09-10T06:28:01.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0288e-05 2024-09-10T06:28:01.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984930+0000", 2024-09-10T06:28:01.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157446 2024-09-10T06:28:01.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.985015+0000", 2024-09-10T06:28:01.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4744e-05 2024-09-10T06:28:01.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.997786+0000", 2024-09-10T06:28:01.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012770826000000001 2024-09-10T06:28:01.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.997938+0000", 2024-09-10T06:28:01.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015275600000000001 2024-09-10T06:28:01.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.241 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.242 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1363 3.a 3:52044754:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:01.242 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:01.242 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.2005662539999999, 2024-09-10T06:28:01.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021475438999999999, 2024-09-10T06:28:01.242 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.242 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.242 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:01.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:01.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:01.242 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1363 2024-09-10T06:28:01.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.242 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:01.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:01.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023232+0000", 2024-09-10T06:28:01.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6500000000000002e-06 2024-09-10T06:28:01.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027903+0000", 2024-09-10T06:28:01.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046709569999999999 2024-09-10T06:28:01.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027944+0000", 2024-09-10T06:28:01.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1e-05 2024-09-10T06:28:01.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027963+0000", 2024-09-10T06:28:01.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9363000000000001e-05 2024-09-10T06:28:01.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028108+0000", 2024-09-10T06:28:01.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144306 2024-09-10T06:28:01.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028370+0000", 2024-09-10T06:28:01.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026210300000000002 2024-09-10T06:28:01.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028610+0000", 2024-09-10T06:28:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024058 2024-09-10T06:28:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.036472+0000", 2024-09-10T06:28:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078620170000000007 2024-09-10T06:28:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044306+0000", 2024-09-10T06:28:01.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078340070000000005 2024-09-10T06:28:01.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044496+0000", 2024-09-10T06:28:01.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189507 2024-09-10T06:28:01.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044704+0000", 2024-09-10T06:28:01.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207949 2024-09-10T06:28:01.247 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.247 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.247 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.248 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1364 3.36 3:6e968b0d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:01.248 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:01.248 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.1885747160000002, 2024-09-10T06:28:01.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022135317000000002, 2024-09-10T06:28:01.248 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.248 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.248 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.248 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:01.248 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:01.248 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:01.248 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1364 2024-09-10T06:28:01.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.248 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:01.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:01.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035266+0000", 2024-09-10T06:28:01.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6529999999999997e-05 2024-09-10T06:28:01.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039528+0000", 2024-09-10T06:28:01.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042612580000000004 2024-09-10T06:28:01.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039570+0000", 2024-09-10T06:28:01.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2481000000000002e-05 2024-09-10T06:28:01.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039594+0000", 2024-09-10T06:28:01.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3564999999999999e-05 2024-09-10T06:28:01.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039735+0000", 2024-09-10T06:28:01.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014147000000000001 2024-09-10T06:28:01.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039983+0000", 2024-09-10T06:28:01.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024765399999999998 2024-09-10T06:28:01.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:01.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.040216+0000", 2024-09-10T06:28:01.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023322999999999999 2024-09-10T06:28:01.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:01.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.049930+0000", 2024-09-10T06:28:01.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097135920000000001 2024-09-10T06:28:01.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:01.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057061+0000", 2024-09-10T06:28:01.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071309570000000003 2024-09-10T06:28:01.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057234+0000", 2024-09-10T06:28:01.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173308 2024-09-10T06:28:01.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057355+0000", 2024-09-10T06:28:01.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121272 2024-09-10T06:28:01.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.254 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.254 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1367 3.34 e63/22 3:2f444f7f:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_122:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:01.254 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.075154+0000", 2024-09-10T06:28:01.254 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.1486404499999998, 2024-09-10T06:28:01.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014819129, 2024-09-10T06:28:01.254 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.254 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.254 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.254 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.075154+0000", 2024-09-10T06:28:01.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.075154+0000", 2024-09-10T06:28:01.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.075158+0000", 2024-09-10T06:28:01.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3629999999999998e-06 2024-09-10T06:28:01.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.078040+0000", 2024-09-10T06:28:01.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002882375 2024-09-10T06:28:01.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.078086+0000", 2024-09-10T06:28:01.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5982999999999997e-05 2024-09-10T06:28:01.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.078112+0000", 2024-09-10T06:28:01.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6364999999999999e-05 2024-09-10T06:28:01.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.078284+0000", 2024-09-10T06:28:01.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017119499999999999 2024-09-10T06:28:01.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.078351+0000", 2024-09-10T06:28:01.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7708999999999998e-05 2024-09-10T06:28:01.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.089873+0000", 2024-09-10T06:28:01.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011521579000000001 2024-09-10T06:28:01.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.089973+0000", 2024-09-10T06:28:01.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010056 2024-09-10T06:28:01.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.258 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.259 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1370 3.26 3:64e41eab:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:01.259 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:01.259 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.1138391840000001, 2024-09-10T06:28:01.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022030800999999999, 2024-09-10T06:28:01.259 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.259 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.259 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.259 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:01.259 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:01.259 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:01.259 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1370 2024-09-10T06:28:01.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.259 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:01.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:01.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109960+0000", 2024-09-10T06:28:01.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3930000000000001e-06 2024-09-10T06:28:01.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114711+0000", 2024-09-10T06:28:01.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047511580000000001 2024-09-10T06:28:01.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114749+0000", 2024-09-10T06:28:01.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8417999999999997e-05 2024-09-10T06:28:01.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114768+0000", 2024-09-10T06:28:01.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8352e-05 2024-09-10T06:28:01.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114926+0000", 2024-09-10T06:28:01.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015819599999999999 2024-09-10T06:28:01.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115321+0000", 2024-09-10T06:28:01.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039507300000000002 2024-09-10T06:28:01.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115735+0000", 2024-09-10T06:28:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041369900000000001 2024-09-10T06:28:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.125212+0000", 2024-09-10T06:28:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094774109999999998 2024-09-10T06:28:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131666+0000", 2024-09-10T06:28:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064533730000000001 2024-09-10T06:28:01.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131847+0000", 2024-09-10T06:28:01.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018112400000000001 2024-09-10T06:28:01.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131986+0000", 2024-09-10T06:28:01.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013960399999999999 2024-09-10T06:28:01.264 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.264 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.264 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1371 3.2e e63/22 3:741ddced:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_126:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.0988787200000001, 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440024000000001, 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:01.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124919+0000", 2024-09-10T06:28:01.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-10T06:28:01.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130095+0000", 2024-09-10T06:28:01.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00517645 2024-09-10T06:28:01.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130125+0000", 2024-09-10T06:28:01.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9944e-05 2024-09-10T06:28:01.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130142+0000", 2024-09-10T06:28:01.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6515999999999999e-05 2024-09-10T06:28:01.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130252+0000", 2024-09-10T06:28:01.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110473 2024-09-10T06:28:01.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130297+0000", 2024-09-10T06:28:01.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5012999999999997e-05 2024-09-10T06:28:01.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149096+0000", 2024-09-10T06:28:01.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018799429999999999 2024-09-10T06:28:01.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149356+0000", 2024-09-10T06:28:01.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000259499 2024-09-10T06:28:01.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.269 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.272 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1372 3.36 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:01.272 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:01.272 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.0913220959999999, 2024-09-10T06:28:01.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026714723999999999, 2024-09-10T06:28:01.272 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.272 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.273 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:01.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:01.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:01.273 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1372 2024-09-10T06:28:01.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.273 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:01.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:01.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132475+0000", 2024-09-10T06:28:01.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.65e-06 2024-09-10T06:28:01.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137399+0000", 2024-09-10T06:28:01.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049236530000000001 2024-09-10T06:28:01.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137432+0000", 2024-09-10T06:28:01.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3050999999999999e-05 2024-09-10T06:28:01.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137449+0000", 2024-09-10T06:28:01.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6976000000000001e-05 2024-09-10T06:28:01.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137569+0000", 2024-09-10T06:28:01.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012016899999999999 2024-09-10T06:28:01.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137884+0000", 2024-09-10T06:28:01.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031455799999999999 2024-09-10T06:28:01.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:01.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138191+0000", 2024-09-10T06:28:01.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000307466 2024-09-10T06:28:01.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:01.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157760+0000", 2024-09-10T06:28:01.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019569128000000002 2024-09-10T06:28:01.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:01.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157954+0000", 2024-09-10T06:28:01.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019375300000000001 2024-09-10T06:28:01.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158118+0000", 2024-09-10T06:28:01.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016390900000000001 2024-09-10T06:28:01.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.159187+0000", 2024-09-10T06:28:01.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010694109999999999 2024-09-10T06:28:01.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.278 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.278 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1373 3.35 3:ac8a3287:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:01.278 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:01.279 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.080989105, 2024-09-10T06:28:01.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023907627000000001, 2024-09-10T06:28:01.279 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.279 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.279 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:01.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:01.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:01.279 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1373 2024-09-10T06:28:01.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.279 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:01.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:01.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142810+0000", 2024-09-10T06:28:01.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6129999999999997e-06 2024-09-10T06:28:01.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.146972+0000", 2024-09-10T06:28:01.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041615180000000003 2024-09-10T06:28:01.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147029+0000", 2024-09-10T06:28:01.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7476000000000003e-05 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147056+0000", 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7021000000000001e-05 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147249+0000", 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019260999999999999 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147702+0000", 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045347999999999997 2024-09-10T06:28:01.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148113+0000", 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041051899999999998 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161583+0000", 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013470278 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166410+0000", 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048270199999999996 2024-09-10T06:28:01.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166579+0000", 2024-09-10T06:28:01.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016839099999999999 2024-09-10T06:28:01.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166713+0000", 2024-09-10T06:28:01.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013470100000000001 2024-09-10T06:28:01.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.284 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.285 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1384 3.33 e63/22 3:cfe948dc:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_139:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:01.285 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.254532+0000", 2024-09-10T06:28:01.285 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.9692627950000001, 2024-09-10T06:28:01.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015554659, 2024-09-10T06:28:01.285 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.285 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.285 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.285 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.254532+0000", 2024-09-10T06:28:01.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.254532+0000", 2024-09-10T06:28:01.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.254535+0000", 2024-09-10T06:28:01.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9170000000000002e-06 2024-09-10T06:28:01.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260133+0000", 2024-09-10T06:28:01.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055976969999999996 2024-09-10T06:28:01.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260168+0000", 2024-09-10T06:28:01.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5917000000000002e-05 2024-09-10T06:28:01.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260186+0000", 2024-09-10T06:28:01.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7538999999999999e-05 2024-09-10T06:28:01.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260307+0000", 2024-09-10T06:28:01.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121382 2024-09-10T06:28:01.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260354+0000", 2024-09-10T06:28:01.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6507e-05 2024-09-10T06:28:01.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.269997+0000", 2024-09-10T06:28:01.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096426900000000006 2024-09-10T06:28:01.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.270087+0000", 2024-09-10T06:28:01.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.001e-05 2024-09-10T06:28:01.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.289 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.289 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1387 3.35 3:adfbe02e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:01.289 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:01.289 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.9418608179999999, 2024-09-10T06:28:01.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021055645000000001, 2024-09-10T06:28:01.289 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.289 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.290 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:01.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:01.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:01.290 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1387 2024-09-10T06:28:01.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.290 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:01.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:01.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281938+0000", 2024-09-10T06:28:01.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0659999999999997e-06 2024-09-10T06:28:01.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286048+0000", 2024-09-10T06:28:01.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041104560000000002 2024-09-10T06:28:01.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286097+0000", 2024-09-10T06:28:01.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8715999999999999e-05 2024-09-10T06:28:01.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286126+0000", 2024-09-10T06:28:01.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9308000000000001e-05 2024-09-10T06:28:01.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286279+0000", 2024-09-10T06:28:01.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015285400000000001 2024-09-10T06:28:01.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286520+0000", 2024-09-10T06:28:01.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024062000000000001 2024-09-10T06:28:01.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:01.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286772+0000", 2024-09-10T06:28:01.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025170599999999998 2024-09-10T06:28:01.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:01.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.301846+0000", 2024-09-10T06:28:01.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015074363 2024-09-10T06:28:01.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:01.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302698+0000", 2024-09-10T06:28:01.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000852179 2024-09-10T06:28:01.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302864+0000", 2024-09-10T06:28:01.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016568900000000001 2024-09-10T06:28:01.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302990+0000", 2024-09-10T06:28:01.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012568799999999999 2024-09-10T06:28:01.295 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.295 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.295 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.295 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1397 3.3f e63/41 3:ff95a35c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_152:head v 63'5, mlcod=63'3)", 2024-09-10T06:28:01.295 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.385363+0000", 2024-09-10T06:28:01.295 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.8384315760000001, 2024-09-10T06:28:01.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017789975999999999, 2024-09-10T06:28:01.296 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.296 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.296 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.296 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.385363+0000", 2024-09-10T06:28:01.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.385363+0000", 2024-09-10T06:28:01.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.385366+0000", 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7329999999999999e-06 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390582+0000", 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052160740000000002 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390618+0000", 2024-09-10T06:28:01.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5818000000000002e-05 2024-09-10T06:28:01.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390637+0000", 2024-09-10T06:28:01.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9096000000000001e-05 2024-09-10T06:28:01.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390769+0000", 2024-09-10T06:28:01.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013195700000000001 2024-09-10T06:28:01.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390810+0000", 2024-09-10T06:28:01.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0734e-05 2024-09-10T06:28:01.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403047+0000", 2024-09-10T06:28:01.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012237534 2024-09-10T06:28:01.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403153+0000", 2024-09-10T06:28:01.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010603 2024-09-10T06:28:01.299 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.299 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.300 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1398 3.2c 3:350a23e7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:01.300 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:01.300 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.8288174989999999, 2024-09-10T06:28:01.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032248536000000001, 2024-09-10T06:28:01.300 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.300 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.300 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:01.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:01.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:01.300 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1398 2024-09-10T06:28:01.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.301 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:01.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:01.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394981+0000", 2024-09-10T06:28:01.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7359999999999999e-06 2024-09-10T06:28:01.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402145+0000", 2024-09-10T06:28:01.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071643540000000004 2024-09-10T06:28:01.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402182+0000", 2024-09-10T06:28:01.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6318e-05 2024-09-10T06:28:01.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402200+0000", 2024-09-10T06:28:01.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8439000000000001e-05 2024-09-10T06:28:01.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402391+0000", 2024-09-10T06:28:01.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190917 2024-09-10T06:28:01.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402649+0000", 2024-09-10T06:28:01.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025817599999999999 2024-09-10T06:28:01.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:01.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402908+0000", 2024-09-10T06:28:01.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025864300000000002 2024-09-10T06:28:01.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:01.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424973+0000", 2024-09-10T06:28:01.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022065004999999999 2024-09-10T06:28:01.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:01.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.426990+0000", 2024-09-10T06:28:01.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020169340000000002 2024-09-10T06:28:01.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427129+0000", 2024-09-10T06:28:01.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139436 2024-09-10T06:28:01.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427226+0000", 2024-09-10T06:28:01.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6577999999999996e-05 2024-09-10T06:28:01.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.305 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1413 3.1e e63/22 3:79ea7bee:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_158:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.445858+0000", 2024-09-10T06:28:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.777936916, 2024-09-10T06:28:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015385619, 2024-09-10T06:28:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.445858+0000", 2024-09-10T06:28:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.445858+0000", 2024-09-10T06:28:01.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.445860+0000", 2024-09-10T06:28:01.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.706e-06 2024-09-10T06:28:01.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450317+0000", 2024-09-10T06:28:01.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044569060000000001 2024-09-10T06:28:01.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450355+0000", 2024-09-10T06:28:01.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7293999999999999e-05 2024-09-10T06:28:01.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450372+0000", 2024-09-10T06:28:01.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7492000000000001e-05 2024-09-10T06:28:01.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450488+0000", 2024-09-10T06:28:01.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011576199999999999 2024-09-10T06:28:01.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450533+0000", 2024-09-10T06:28:01.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5046999999999997e-05 2024-09-10T06:28:01.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.461119+0000", 2024-09-10T06:28:01.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010585796 2024-09-10T06:28:01.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.461243+0000", 2024-09-10T06:28:01.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000124616 2024-09-10T06:28:01.310 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.310 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.310 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.310 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1415 3.2c 3:34c14757:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:01.310 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:01.310 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.7609705010000001, 2024-09-10T06:28:01.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029598765999999999, 2024-09-10T06:28:01.311 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.311 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.311 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:01.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:01.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:01.311 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1415 2024-09-10T06:28:01.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.311 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:01.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:01.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462828+0000", 2024-09-10T06:28:01.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1999999999999996e-06 2024-09-10T06:28:01.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.466974+0000", 2024-09-10T06:28:01.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041452989999999999 2024-09-10T06:28:01.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467026+0000", 2024-09-10T06:28:01.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2416000000000001e-05 2024-09-10T06:28:01.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467055+0000", 2024-09-10T06:28:01.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9081000000000002e-05 2024-09-10T06:28:01.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467207+0000", 2024-09-10T06:28:01.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015225699999999999 2024-09-10T06:28:01.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467468+0000", 2024-09-10T06:28:01.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026093500000000001 2024-09-10T06:28:01.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:01.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467755+0000", 2024-09-10T06:28:01.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000287101 2024-09-10T06:28:01.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:01.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477312+0000", 2024-09-10T06:28:01.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095560300000000001 2024-09-10T06:28:01.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:01.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492136+0000", 2024-09-10T06:28:01.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014824936 2024-09-10T06:28:01.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492301+0000", 2024-09-10T06:28:01.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016411600000000001 2024-09-10T06:28:01.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492423+0000", 2024-09-10T06:28:01.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122395 2024-09-10T06:28:01.316 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.316 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.316 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.316 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1416 3.10 3:084717f7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:01.316 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:01.316 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.751936253, 2024-09-10T06:28:01.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021526931999999999, 2024-09-10T06:28:01.317 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.317 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.317 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.317 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:01.317 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:01.317 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:01.317 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1416 2024-09-10T06:28:01.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.317 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:01.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471863+0000", 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477370+0000", 2024-09-10T06:28:01.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055071549999999997 2024-09-10T06:28:01.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477402+0000", 2024-09-10T06:28:01.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1498000000000002e-05 2024-09-10T06:28:01.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477423+0000", 2024-09-10T06:28:01.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1098e-05 2024-09-10T06:28:01.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477559+0000", 2024-09-10T06:28:01.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136627 2024-09-10T06:28:01.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477936+0000", 2024-09-10T06:28:01.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037718099999999998 2024-09-10T06:28:01.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:01.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.478271+0000", 2024-09-10T06:28:01.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033427799999999997 2024-09-10T06:28:01.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.490997+0000", 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012725858 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493126+0000", 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002129499 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493263+0000", 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013682500000000001 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493385+0000", 2024-09-10T06:28:01.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122414 2024-09-10T06:28:01.322 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.322 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.322 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.322 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1466 3.a 3:52715822:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:01.322 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.004814+0000", 2024-09-10T06:28:01.322 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.2189809229999999, 2024-09-10T06:28:01.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01610396, 2024-09-10T06:28:01.322 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.322 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.322 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1466 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.004814+0000", 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.004814+0000", 2024-09-10T06:28:01.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.004817+0000", 2024-09-10T06:28:01.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.993e-06 2024-09-10T06:28:01.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.009941+0000", 2024-09-10T06:28:01.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051237699999999997 2024-09-10T06:28:01.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.009977+0000", 2024-09-10T06:28:01.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6021e-05 2024-09-10T06:28:01.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010002+0000", 2024-09-10T06:28:01.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5114999999999999e-05 2024-09-10T06:28:01.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010104+0000", 2024-09-10T06:28:01.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010259699999999999 2024-09-10T06:28:01.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010243+0000", 2024-09-10T06:28:01.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000138858 2024-09-10T06:28:01.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:01.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010361+0000", 2024-09-10T06:28:01.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117751 2024-09-10T06:28:01.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:01.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.019657+0000", 2024-09-10T06:28:01.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092965689999999993 2024-09-10T06:28:01.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:01.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.020775+0000", 2024-09-10T06:28:01.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001117266 2024-09-10T06:28:01.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.020853+0000", 2024-09-10T06:28:01.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-10T06:28:01.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.020918+0000", 2024-09-10T06:28:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4243000000000001e-05 2024-09-10T06:28:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1482 3.35 3:ad9242de:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.0636305189999999, 2024-09-10T06:28:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022710764000000001, 2024-09-10T06:28:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:01.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:01.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:01.329 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1482 2024-09-10T06:28:01.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.329 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:01.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:01.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160166+0000", 2024-09-10T06:28:01.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1069999999999999e-06 2024-09-10T06:28:01.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163977+0000", 2024-09-10T06:28:01.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003810843 2024-09-10T06:28:01.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163995+0000", 2024-09-10T06:28:01.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7648000000000001e-05 2024-09-10T06:28:01.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164010+0000", 2024-09-10T06:28:01.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4754e-05 2024-09-10T06:28:01.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164094+0000", 2024-09-10T06:28:01.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4473000000000003e-05 2024-09-10T06:28:01.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164281+0000", 2024-09-10T06:28:01.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018659699999999999 2024-09-10T06:28:01.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:01.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164458+0000", 2024-09-10T06:28:01.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017758300000000001 2024-09-10T06:28:01.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:01.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.179923+0000", 2024-09-10T06:28:01.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015465269 2024-09-10T06:28:01.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:01.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182736+0000", 2024-09-10T06:28:01.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028130579999999998 2024-09-10T06:28:01.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182816+0000", 2024-09-10T06:28:01.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9976999999999997e-05 2024-09-10T06:28:01.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182875+0000", 2024-09-10T06:28:01.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8455000000000002e-05 2024-09-10T06:28:01.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.334 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.334 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1488 3.26 3:643e6113:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_233:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:01.334 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.216389+0000", 2024-09-10T06:28:01.334 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.0074056469999999, 2024-09-10T06:28:01.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015015430999999999, 2024-09-10T06:28:01.334 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:01.334 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:01.335 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:01.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:01.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:01.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:01.335 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1488 2024-09-10T06:28:01.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.335 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:01.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:01.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.216389+0000", 2024-09-10T06:28:01.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:01.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.216389+0000", 2024-09-10T06:28:01.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:01.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:01.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.216391+0000", 2024-09-10T06:28:01.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.357e-06 2024-09-10T06:28:01.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:01.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.220451+0000", 2024-09-10T06:28:01.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040599929999999996 2024-09-10T06:28:01.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:01.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.220484+0000", 2024-09-10T06:28:01.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2583000000000003e-05 2024-09-10T06:28:01.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:01.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.220500+0000", 2024-09-10T06:28:01.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5710999999999999e-05 2024-09-10T06:28:01.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:01.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.220582+0000", 2024-09-10T06:28:01.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1913e-05 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.220715+0000", 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133545 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.220828+0000", 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112883 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.226706+0000", 2024-09-10T06:28:01.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058780730000000002 2024-09-10T06:28:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.231278+0000", 2024-09-10T06:28:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045717470000000001 2024-09-10T06:28:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.231345+0000", 2024-09-10T06:28:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6837999999999999e-05 2024-09-10T06:28:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:01.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.231404+0000", 2024-09-10T06:28:01.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9787999999999997e-05 2024-09-10T06:28:01.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.340 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:01.340 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:01.340 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:01.341 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:28:01.341 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:28:01.342 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:28:01.342 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:28:01.343 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:28:01.343 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:01.340+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:01.343 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:28:01.344 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:28:01.442 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:01.440+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:01.521 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:01.521 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:01.536 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:28:01.542 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:01.540+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:01.621 INFO:teuthology.orchestra.run.smithi112.stdout:moved 6 / 530 (1.13208%) 2024-09-10T06:28:01.621 INFO:teuthology.orchestra.run.smithi112.stdout:avg 66.25 2024-09-10T06:28:01.621 INFO:teuthology.orchestra.run.smithi112.stdout:stddev 8.3179 -> 9.65337 (expected baseline 7.61372) 2024-09-10T06:28:01.621 INFO:teuthology.orchestra.run.smithi112.stdout:min osd.2 with 51 -> 52 pgs (0.769811 -> 0.784906 * mean) 2024-09-10T06:28:01.621 INFO:teuthology.orchestra.run.smithi112.stdout:max osd.3 with 79 -> 81 pgs (1.19245 -> 1.22264 * mean) 2024-09-10T06:28:01.621 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:28:01.621 INFO:teuthology.orchestra.run.smithi112.stdout:oload 110 2024-09-10T06:28:01.621 INFO:teuthology.orchestra.run.smithi112.stdout:max_change 3 2024-09-10T06:28:01.621 INFO:teuthology.orchestra.run.smithi112.stdout:max_change_osds 4 2024-09-10T06:28:01.621 INFO:teuthology.orchestra.run.smithi112.stdout:average_utilization 0.0003 2024-09-10T06:28:01.621 INFO:teuthology.orchestra.run.smithi112.stdout:overload_utilization 0.0004 2024-09-10T06:28:01.621 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6 weight 1.0000 -> 0.8898 2024-09-10T06:28:01.641 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T06:28:01.646 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:01.640+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:01.655 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-10T06:28:01.655 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 3.0 2024-09-10T06:28:01.675 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:01.675 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:01.690 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:28:01.722 INFO:tasks.workunit.client.0.smithi112.stdout:quota enabled for the user 0.668735795728029 2024-09-10T06:28:01.722 INFO:tasks.workunit.client.0.smithi112.stdout:adding file to bucket buck_2024_08_10_06_28_00: 100Mb. 2024-09-10T06:28:01.722 INFO:tasks.workunit.client.0.smithi112.stdout:upload file successful 2024-09-10T06:28:01.744 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:01.740+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:01.845 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:01.840+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:01.860 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:01.860 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:01.876 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:28:01.882 INFO:tasks.workunit.client.0.smithi112.stdout:Bucket Created: buck_2024_08_10_06_28_01 2024-09-10T06:28:01.945 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:01.944+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:01.992 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:01.992 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:02.007 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:28:02.032 INFO:tasks.ceph.mgr.y.smithi112.stderr:2024-09-10T06:28:02.028+0000 7f00aadd0640 -1 mgr.server reply reply (3) No such process no change 2024-09-10T06:28:02.033 INFO:teuthology.orchestra.run.smithi112.stdout:moved 35 / 530 (6.60377%) 2024-09-10T06:28:02.033 INFO:teuthology.orchestra.run.smithi112.stdout:avg 66.25 2024-09-10T06:28:02.033 INFO:teuthology.orchestra.run.smithi112.stdout:stddev 9.65337 -> 10.6154 (expected baseline 7.61372) 2024-09-10T06:28:02.033 INFO:teuthology.orchestra.run.smithi112.stdout:min osd.6 with 50 -> 58 pgs (0.754717 -> 0.875472 * mean) 2024-09-10T06:28:02.033 INFO:teuthology.orchestra.run.smithi112.stdout:max osd.3 with 81 -> 83 pgs (1.22264 -> 1.25283 * mean) 2024-09-10T06:28:02.033 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:28:02.033 INFO:teuthology.orchestra.run.smithi112.stdout:oload 110 2024-09-10T06:28:02.033 INFO:teuthology.orchestra.run.smithi112.stdout:max_change 3 2024-09-10T06:28:02.033 INFO:teuthology.orchestra.run.smithi112.stdout:max_change_osds 4 2024-09-10T06:28:02.033 INFO:teuthology.orchestra.run.smithi112.stdout:average_utilization 0.0025 2024-09-10T06:28:02.034 INFO:teuthology.orchestra.run.smithi112.stdout:overload_utilization 0.0028 2024-09-10T06:28:02.034 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4 weight 1.0000 -> 0.7435 2024-09-10T06:28:02.034 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7 weight 1.0000 -> 0.8257 2024-09-10T06:28:02.034 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6 weight 0.8898 -> 0.9872 2024-09-10T06:28:02.034 INFO:teuthology.orchestra.run.smithi112.stderr:no change 2024-09-10T06:28:02.053 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:02.052+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:02.145 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:02.145 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:02.147 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:02.144+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:02.158 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:28:02.249 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:02.248+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:02.263 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:02.263 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:02.277 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:28:02.350 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:02.348+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:02.396 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:02.396 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:02.410 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:28:02.453 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:02.452+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:02.532 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:02.532 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:02.546 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:28:02.590 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:02.588+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:02.624 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-10T06:28:02.652 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:02.652+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:02.721 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:02.722 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:02.735 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:28:02.752 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:02.752+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:02.753 INFO:tasks.workunit.client.0.smithi112.stderr:10+0 records in 2024-09-10T06:28:02.754 INFO:tasks.workunit.client.0.smithi112.stderr:10+0 records out 2024-09-10T06:28:02.754 INFO:tasks.workunit.client.0.smithi112.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.691434 s, 152 MB/s 2024-09-10T06:28:02.852 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:02.852+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:02.868 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:02.868 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:02.885 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:28:02.953 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:02.952+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:03.041 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:03.041 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:03.054 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:28:03.055 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:03.052+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:03.155 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:03.152+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:03.233 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:03.233 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:03.250 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:28:03.298 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:03.296+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:03.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:28:03.356 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:03.356+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:03.417 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:03.417 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:03.441 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:28:03.457 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:03.456+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:03.473 INFO:tasks.workunit.client.0.smithi112.stdout:quota enabled for the user 0.668735795728029 2024-09-10T06:28:03.473 INFO:tasks.workunit.client.0.smithi112.stdout:adding file to bucket buck_2024_08_10_06_28_01: 100Mb. 2024-09-10T06:28:03.473 INFO:tasks.workunit.client.0.smithi112.stdout:upload file successful 2024-09-10T06:28:03.510 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:28:03.511 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:28:03.544 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:28:03.545 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:28:03.557 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:03.552+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:03.563 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:28:03.563 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:28:03.567 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:03.568 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:03.587 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:28:03.591 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:28:03.591 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:28:03.611 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:28:03.612 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:28:03.636 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:28:03.637 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:28:03.642 INFO:tasks.workunit.client.0.smithi112.stdout:Bucket Created: buck_2024_08_10_06_28_03 2024-09-10T06:28:03.658 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:03.656+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:03.659 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:28:03.659 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:28:03.678 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:28:03.678 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:28:03.717 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:03.717 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:28:03.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:28:03.717 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:28:03.717 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.717 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1353 3.22 e63/22 3:46874a4e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_108:head v 63'1, mlcod=0'0)", 2024-09-10T06:28:03.717 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.914397+0000", 2024-09-10T06:28:03.717 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.8006768539999998, 2024-09-10T06:28:03.717 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01485907, 2024-09-10T06:28:03.717 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.717 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.718 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.718 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.914397+0000", 2024-09-10T06:28:03.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.718 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.718 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.914397+0000", 2024-09-10T06:28:03.718 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.718 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.718 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.914400+0000", 2024-09-10T06:28:03.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.413e-06 2024-09-10T06:28:03.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.719 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.719 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.921511+0000", 2024-09-10T06:28:03.719 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071116920000000002 2024-09-10T06:28:03.719 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.719 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.921532+0000", 2024-09-10T06:28:03.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1047999999999999e-05 2024-09-10T06:28:03.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.921542+0000", 2024-09-10T06:28:03.720 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4949999999999997e-06 2024-09-10T06:28:03.720 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.720 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.720 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.720 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.921612+0000", 2024-09-10T06:28:03.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9785999999999999e-05 2024-09-10T06:28:03.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.921637+0000", 2024-09-10T06:28:03.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5585e-05 2024-09-10T06:28:03.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.721 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.929191+0000", 2024-09-10T06:28:03.721 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0075538719999999997 2024-09-10T06:28:03.721 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.721 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.721 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.722 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.929256+0000", 2024-09-10T06:28:03.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5178999999999994e-05 2024-09-10T06:28:03.722 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.722 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.722 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.722 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.722 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.722 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1357 3.1e 3:7863b3e2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:03.722 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.957495+0000", 2024-09-10T06:28:03.722 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.7575786459999998, 2024-09-10T06:28:03.722 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019676366000000001, 2024-09-10T06:28:03.722 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.722 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.722 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.723 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.723 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.723 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.723 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1357 2024-09-10T06:28:03.723 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.723 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.723 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.957495+0000", 2024-09-10T06:28:03.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.724 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.957495+0000", 2024-09-10T06:28:03.724 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.724 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.724 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.724 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.957499+0000", 2024-09-10T06:28:03.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6789999999999998e-06 2024-09-10T06:28:03.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.958828+0000", 2024-09-10T06:28:03.725 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013292829999999999 2024-09-10T06:28:03.725 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.725 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.725 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.725 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.958867+0000", 2024-09-10T06:28:03.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8810000000000003e-05 2024-09-10T06:28:03.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.958883+0000", 2024-09-10T06:28:03.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5362999999999998e-05 2024-09-10T06:28:03.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.726 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.726 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.726 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.958975+0000", 2024-09-10T06:28:03.726 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2200999999999994e-05 2024-09-10T06:28:03.726 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.959138+0000", 2024-09-10T06:28:03.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000163542 2024-09-10T06:28:03.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.727 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.727 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:03.727 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.959288+0000", 2024-09-10T06:28:03.727 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015009499999999999 2024-09-10T06:28:03.727 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.967661+0000", 2024-09-10T06:28:03.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0083720940000000001 2024-09-10T06:28:03.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.977039+0000", 2024-09-10T06:28:03.728 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0093786000000000008 2024-09-10T06:28:03.728 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.728 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.728 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.728 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.977112+0000", 2024-09-10T06:28:03.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3040000000000005e-05 2024-09-10T06:28:03.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.729 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.729 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.977172+0000", 2024-09-10T06:28:03.729 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9658999999999999e-05 2024-09-10T06:28:03.729 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.729 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.729 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.729 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.729 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.730 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1361 3.38 3:1ede1c11:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:03.730 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.998802+0000", 2024-09-10T06:28:03.730 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.7162717350000003, 2024-09-10T06:28:03.730 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017059365999999999, 2024-09-10T06:28:03.730 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.730 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.730 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.730 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.730 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1361 2024-09-10T06:28:03.730 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.731 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.998802+0000", 2024-09-10T06:28:03.731 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.731 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.731 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.731 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.731 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.998802+0000", 2024-09-10T06:28:03.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.998806+0000", 2024-09-10T06:28:03.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1889999999999999e-06 2024-09-10T06:28:03.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.732 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000620+0000", 2024-09-10T06:28:03.732 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001814485 2024-09-10T06:28:03.732 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.732 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.732 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000651+0000", 2024-09-10T06:28:03.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0719999999999997e-05 2024-09-10T06:28:03.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000665+0000", 2024-09-10T06:28:03.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4695000000000001e-05 2024-09-10T06:28:03.733 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.733 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.733 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.733 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000738+0000", 2024-09-10T06:28:03.733 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2229000000000003e-05 2024-09-10T06:28:03.734 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.736 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000869+0000", 2024-09-10T06:28:03.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131688 2024-09-10T06:28:03.737 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.737 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.737 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:03.737 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000993+0000", 2024-09-10T06:28:03.737 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012376999999999999 2024-09-10T06:28:03.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.010762+0000", 2024-09-10T06:28:03.738 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0097692260000000006 2024-09-10T06:28:03.738 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.738 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.738 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.738 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.015691+0000", 2024-09-10T06:28:03.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049281660000000003 2024-09-10T06:28:03.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.015764+0000", 2024-09-10T06:28:03.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3182999999999994e-05 2024-09-10T06:28:03.739 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.739 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.739 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.739 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.015862+0000", 2024-09-10T06:28:03.739 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8015000000000003e-05 2024-09-10T06:28:03.739 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.739 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.739 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.740 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.740 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1376 3.29 3:94f62a8f:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:03.740 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.170001+0000", 2024-09-10T06:28:03.740 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.5450728570000001, 2024-09-10T06:28:03.740 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017004267999999999, 2024-09-10T06:28:03.740 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.740 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.740 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.740 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.740 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1376 2024-09-10T06:28:03.740 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.741 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.741 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.741 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.170001+0000", 2024-09-10T06:28:03.741 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.741 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.741 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.170001+0000", 2024-09-10T06:28:03.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.742 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.170004+0000", 2024-09-10T06:28:03.742 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8930000000000001e-06 2024-09-10T06:28:03.742 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.742 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.742 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.171428+0000", 2024-09-10T06:28:03.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014238429999999999 2024-09-10T06:28:03.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.743 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.171456+0000", 2024-09-10T06:28:03.743 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7691999999999998e-05 2024-09-10T06:28:03.743 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.743 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.743 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.171471+0000", 2024-09-10T06:28:03.744 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5400000000000002e-05 2024-09-10T06:28:03.744 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.744 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.744 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.744 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.171561+0000", 2024-09-10T06:28:03.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9777000000000005e-05 2024-09-10T06:28:03.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.171670+0000", 2024-09-10T06:28:03.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108918 2024-09-10T06:28:03.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.745 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.745 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:03.745 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.171782+0000", 2024-09-10T06:28:03.745 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112012 2024-09-10T06:28:03.745 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.176549+0000", 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047673120000000001 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.186890+0000", 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010341011000000001 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.186955+0000", 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5126e-05 2024-09-10T06:28:03.746 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.747 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.747 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.747 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.187006+0000", 2024-09-10T06:28:03.747 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0284000000000002e-05 2024-09-10T06:28:03.747 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.747 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.747 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.748 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.748 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1377 3.7 3:e1b31464:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:03.748 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.180368+0000", 2024-09-10T06:28:03.748 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.5347064440000002, 2024-09-10T06:28:03.748 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017958923000000002, 2024-09-10T06:28:03.748 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.748 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.748 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.748 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.748 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1377 2024-09-10T06:28:03.748 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.749 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.180368+0000", 2024-09-10T06:28:03.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.180368+0000", 2024-09-10T06:28:03.749 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.749 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.749 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.749 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.749 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.180370+0000", 2024-09-10T06:28:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6900000000000001e-06 2024-09-10T06:28:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182458+0000", 2024-09-10T06:28:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0020876179999999999 2024-09-10T06:28:03.750 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182485+0000", 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.694e-05 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182499+0000", 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4100000000000001e-05 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182597+0000", 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8309999999999999e-05 2024-09-10T06:28:03.751 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182700+0000", 2024-09-10T06:28:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010313400000000001 2024-09-10T06:28:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182801+0000", 2024-09-10T06:28:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100065 2024-09-10T06:28:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.752 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.191493+0000", 2024-09-10T06:28:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0086923150000000008 2024-09-10T06:28:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.198196+0000", 2024-09-10T06:28:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.006703166 2024-09-10T06:28:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.198263+0000", 2024-09-10T06:28:03.753 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6685000000000003e-05 2024-09-10T06:28:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.198327+0000", 2024-09-10T06:28:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3899999999999995e-05 2024-09-10T06:28:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.754 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1381 3.18 3:1b2e08f5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.221807+0000", 2024-09-10T06:28:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.4932675709999996, 2024-09-10T06:28:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020986388000000002, 2024-09-10T06:28:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1381 2024-09-10T06:28:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.755 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.221807+0000", 2024-09-10T06:28:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.221807+0000", 2024-09-10T06:28:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.221809+0000", 2024-09-10T06:28:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.571e-06 2024-09-10T06:28:03.756 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.222886+0000", 2024-09-10T06:28:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001076547 2024-09-10T06:28:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.757 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.222909+0000", 2024-09-10T06:28:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3028e-05 2024-09-10T06:28:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.222919+0000", 2024-09-10T06:28:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0509000000000001e-05 2024-09-10T06:28:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.222981+0000", 2024-09-10T06:28:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1754999999999994e-05 2024-09-10T06:28:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.758 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.223119+0000", 2024-09-10T06:28:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013831299999999999 2024-09-10T06:28:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.223228+0000", 2024-09-10T06:28:03.759 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108424 2024-09-10T06:28:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.237361+0000", 2024-09-10T06:28:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014132824 2024-09-10T06:28:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.242666+0000", 2024-09-10T06:28:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0053053340000000001 2024-09-10T06:28:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.760 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.242739+0000", 2024-09-10T06:28:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2801999999999999e-05 2024-09-10T06:28:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.242793+0000", 2024-09-10T06:28:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4280999999999997e-05 2024-09-10T06:28:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.761 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.762 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1384 3.33 3:cfe948dc:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:03.762 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.251038+0000", 2024-09-10T06:28:03.762 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.4640364840000002, 2024-09-10T06:28:03.762 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018535228000000001, 2024-09-10T06:28:03.762 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.763 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.763 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.763 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.763 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.763 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.763 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1384 2024-09-10T06:28:03.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.763 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.763 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.763 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.251038+0000", 2024-09-10T06:28:03.763 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.763 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.763 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.251038+0000", 2024-09-10T06:28:03.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.251040+0000", 2024-09-10T06:28:03.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4590000000000001e-06 2024-09-10T06:28:03.764 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.764 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.764 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.764 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.252948+0000", 2024-09-10T06:28:03.764 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001907658 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.252976+0000", 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8673000000000001e-05 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.252992+0000", 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5761999999999999e-05 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.253086+0000", 2024-09-10T06:28:03.765 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4279999999999999e-05 2024-09-10T06:28:03.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.253243+0000", 2024-09-10T06:28:03.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015613700000000001 2024-09-10T06:28:03.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:03.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.253381+0000", 2024-09-10T06:28:03.766 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013826800000000001 2024-09-10T06:28:03.766 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.766 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.766 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.766 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262637+0000", 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092563639999999996 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.269454+0000", 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0068171120000000002 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.269522+0000", 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7287999999999997e-05 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.767 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.269573+0000", 2024-09-10T06:28:03.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1227000000000003e-05 2024-09-10T06:28:03.768 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.768 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.768 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.768 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.768 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.768 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1395 3.24 3:24edd8eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:03.768 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.360953+0000", 2024-09-10T06:28:03.768 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3541207269999997, 2024-09-10T06:28:03.768 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017333182999999999, 2024-09-10T06:28:03.768 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.768 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.768 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.768 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.769 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.769 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.769 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1395 2024-09-10T06:28:03.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.769 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.360953+0000", 2024-09-10T06:28:03.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.769 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.769 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.769 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.769 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.360953+0000", 2024-09-10T06:28:03.769 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.360956+0000", 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5840000000000002e-06 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.362555+0000", 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001599329 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.362584+0000", 2024-09-10T06:28:03.770 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8986e-05 2024-09-10T06:28:03.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.362617+0000", 2024-09-10T06:28:03.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2327999999999999e-05 2024-09-10T06:28:03.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.771 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.362695+0000", 2024-09-10T06:28:03.771 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8392000000000004e-05 2024-09-10T06:28:03.771 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.771 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.771 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.362872+0000", 2024-09-10T06:28:03.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017744200000000001 2024-09-10T06:28:03.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:03.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.362978+0000", 2024-09-10T06:28:03.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010545800000000001 2024-09-10T06:28:03.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.772 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.772 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.369228+0000", 2024-09-10T06:28:03.772 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0062498789999999999 2024-09-10T06:28:03.772 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.772 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.378141+0000", 2024-09-10T06:28:03.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0089135240000000008 2024-09-10T06:28:03.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.378224+0000", 2024-09-10T06:28:03.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3066999999999996e-05 2024-09-10T06:28:03.773 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.773 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.773 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.773 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.378287+0000", 2024-09-10T06:28:03.773 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2193999999999994e-05 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1399 3.38 3:1dcd0b88:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.402210+0000", 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3128642880000001, 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022347520999999999, 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.774 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1399 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.402210+0000", 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.402210+0000", 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.775 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.402212+0000", 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1229999999999998e-06 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.404083+0000", 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018714440000000001 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.404116+0000", 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2347e-05 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.776 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.404130+0000", 2024-09-10T06:28:03.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4729000000000001e-05 2024-09-10T06:28:03.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.404218+0000", 2024-09-10T06:28:03.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7576000000000003e-05 2024-09-10T06:28:03.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.777 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.777 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.404399+0000", 2024-09-10T06:28:03.777 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000181196 2024-09-10T06:28:03.777 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.777 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.404571+0000", 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000171578 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.411199+0000", 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066279800000000003 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.424426+0000", 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013226897 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.778 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.424494+0000", 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8280000000000004e-05 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.424557+0000", 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3371e-05 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1400 3.7 3:e1237548:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.413228+0000", 2024-09-10T06:28:03.779 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.3018457449999996, 2024-09-10T06:28:03.780 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017167168, 2024-09-10T06:28:03.780 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.780 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.780 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.780 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.780 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.780 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.780 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1400 2024-09-10T06:28:03.780 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.780 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.780 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.780 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.413228+0000", 2024-09-10T06:28:03.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.413228+0000", 2024-09-10T06:28:03.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.781 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.781 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.781 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.413231+0000", 2024-09-10T06:28:03.781 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7039999999999999e-06 2024-09-10T06:28:03.781 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.414994+0000", 2024-09-10T06:28:03.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017624279999999999 2024-09-10T06:28:03.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.415029+0000", 2024-09-10T06:28:03.782 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5420000000000003e-05 2024-09-10T06:28:03.782 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.782 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.782 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.782 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.415045+0000", 2024-09-10T06:28:03.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6166000000000001e-05 2024-09-10T06:28:03.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.415125+0000", 2024-09-10T06:28:03.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9783999999999994e-05 2024-09-10T06:28:03.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.783 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.415250+0000", 2024-09-10T06:28:03.783 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000125485 2024-09-10T06:28:03.783 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.783 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.783 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:03.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.415363+0000", 2024-09-10T06:28:03.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112185 2024-09-10T06:28:03.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.421713+0000", 2024-09-10T06:28:03.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0063500969999999999 2024-09-10T06:28:03.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.784 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.784 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.430316+0000", 2024-09-10T06:28:03.784 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0086033299999999993 2024-09-10T06:28:03.784 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.784 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.430353+0000", 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6718999999999999e-05 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.430396+0000", 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2849999999999998e-05 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1412 3.38 3:1da1fffe:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:03.785 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.433157+0000", 2024-09-10T06:28:03.786 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.2819175339999997, 2024-09-10T06:28:03.786 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017894383, 2024-09-10T06:28:03.786 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.786 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.786 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.786 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.786 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1412 2024-09-10T06:28:03.786 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.786 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.786 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.786 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.786 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.433157+0000", 2024-09-10T06:28:03.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.433157+0000", 2024-09-10T06:28:03.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.787 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.433159+0000", 2024-09-10T06:28:03.787 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9539999999999998e-06 2024-09-10T06:28:03.787 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.787 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.787 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.434562+0000", 2024-09-10T06:28:03.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014031810000000001 2024-09-10T06:28:03.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.434586+0000", 2024-09-10T06:28:03.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4244e-05 2024-09-10T06:28:03.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.788 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.788 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.788 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.434600+0000", 2024-09-10T06:28:03.788 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4173e-05 2024-09-10T06:28:03.788 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.434662+0000", 2024-09-10T06:28:03.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1890999999999994e-05 2024-09-10T06:28:03.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.434777+0000", 2024-09-10T06:28:03.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011537200000000001 2024-09-10T06:28:03.789 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.789 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.789 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:03.789 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.434881+0000", 2024-09-10T06:28:03.789 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103984 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.442157+0000", 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072760400000000001 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.450923+0000", 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0087658289999999993 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.450992+0000", 2024-09-10T06:28:03.790 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9176000000000003e-05 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.451051+0000", 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8539000000000003e-05 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1413 3.1e 3:79ea7bee:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.442985+0000", 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.2720889260000003, 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017707302000000001, 2024-09-10T06:28:03.791 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1413 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.442985+0000", 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.792 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.442985+0000", 2024-09-10T06:28:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.442987+0000", 2024-09-10T06:28:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.77e-06 2024-09-10T06:28:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.444274+0000", 2024-09-10T06:28:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001287009 2024-09-10T06:28:03.793 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.444306+0000", 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2369000000000001e-05 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.444319+0000", 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3057000000000001e-05 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.444385+0000", 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5629999999999993e-05 2024-09-10T06:28:03.794 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.444539+0000", 2024-09-10T06:28:03.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015395200000000001 2024-09-10T06:28:03.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:03.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.444699+0000", 2024-09-10T06:28:03.795 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000160204 2024-09-10T06:28:03.795 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.795 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.795 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.795 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.450971+0000", 2024-09-10T06:28:03.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0062716430000000004 2024-09-10T06:28:03.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.460580+0000", 2024-09-10T06:28:03.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0096087829999999992 2024-09-10T06:28:03.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.796 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.796 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.460644+0000", 2024-09-10T06:28:03.796 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4664000000000003e-05 2024-09-10T06:28:03.796 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.796 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.797 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.797 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.460693+0000", 2024-09-10T06:28:03.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8220999999999998e-05 2024-09-10T06:28:03.797 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.797 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.797 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.797 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.797 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.797 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1418 3.24 3:26ca0de9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:03.797 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.490364+0000", 2024-09-10T06:28:03.797 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.2247103140000002, 2024-09-10T06:28:03.797 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019039736000000002, 2024-09-10T06:28:03.798 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.798 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.798 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.798 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.798 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.798 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.798 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1418 2024-09-10T06:28:03.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.798 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.798 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.798 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.798 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.490364+0000", 2024-09-10T06:28:03.798 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.798 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.490364+0000", 2024-09-10T06:28:03.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.490367+0000", 2024-09-10T06:28:03.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5039999999999998e-06 2024-09-10T06:28:03.799 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.799 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.799 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.799 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.491928+0000", 2024-09-10T06:28:03.799 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001560875 2024-09-10T06:28:03.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.491948+0000", 2024-09-10T06:28:03.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9706000000000001e-05 2024-09-10T06:28:03.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.491960+0000", 2024-09-10T06:28:03.800 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1855000000000001e-05 2024-09-10T06:28:03.800 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.800 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.800 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.800 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.492032+0000", 2024-09-10T06:28:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1796000000000002e-05 2024-09-10T06:28:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.492141+0000", 2024-09-10T06:28:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010906199999999999 2024-09-10T06:28:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.492238+0000", 2024-09-10T06:28:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7513e-05 2024-09-10T06:28:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.801 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.497020+0000", 2024-09-10T06:28:03.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004781731 2024-09-10T06:28:03.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.509272+0000", 2024-09-10T06:28:03.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012251811 2024-09-10T06:28:03.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.802 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.802 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.802 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.509345+0000", 2024-09-10T06:28:03.802 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2977000000000003e-05 2024-09-10T06:28:03.802 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.803 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.803 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.509404+0000", 2024-09-10T06:28:03.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8906000000000001e-05 2024-09-10T06:28:03.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.803 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.803 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.803 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.803 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.803 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1432 3.27 3:e6a1bf6b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:03.803 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.633065+0000", 2024-09-10T06:28:03.803 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.0820095729999997, 2024-09-10T06:28:03.803 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015127684000000001, 2024-09-10T06:28:03.803 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.804 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.804 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.804 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.804 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1432 2024-09-10T06:28:03.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.804 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.804 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.804 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.804 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.633065+0000", 2024-09-10T06:28:03.804 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.804 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.633065+0000", 2024-09-10T06:28:03.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.633067+0000", 2024-09-10T06:28:03.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5600000000000001e-06 2024-09-10T06:28:03.805 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.805 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.805 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.805 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.635123+0000", 2024-09-10T06:28:03.805 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0020559369999999999 2024-09-10T06:28:03.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.635148+0000", 2024-09-10T06:28:03.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5315000000000001e-05 2024-09-10T06:28:03.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.635158+0000", 2024-09-10T06:28:03.806 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9310000000000003e-06 2024-09-10T06:28:03.806 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.806 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.806 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.806 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.635233+0000", 2024-09-10T06:28:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4789999999999994e-05 2024-09-10T06:28:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.635398+0000", 2024-09-10T06:28:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016529899999999999 2024-09-10T06:28:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.635531+0000", 2024-09-10T06:28:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000132187 2024-09-10T06:28:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.807 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.642188+0000", 2024-09-10T06:28:03.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066577520000000003 2024-09-10T06:28:03.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.648071+0000", 2024-09-10T06:28:03.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058830080000000003 2024-09-10T06:28:03.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.808 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.808 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.808 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.648138+0000", 2024-09-10T06:28:03.808 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6885999999999996e-05 2024-09-10T06:28:03.808 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.809 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.809 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.648192+0000", 2024-09-10T06:28:03.809 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4018999999999999e-05 2024-09-10T06:28:03.809 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.809 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.809 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.809 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.809 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.809 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1434 3.25 e64/22 3:a4872046:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_179:head v 64'4, mlcod=63'2)", 2024-09-10T06:28:03.809 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.655965+0000", 2024-09-10T06:28:03.809 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.0591088920000002, 2024-09-10T06:28:03.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014906137999999999, 2024-09-10T06:28:03.810 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.810 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.810 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.810 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.655965+0000", 2024-09-10T06:28:03.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.810 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.810 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.810 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.810 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.655965+0000", 2024-09-10T06:28:03.810 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.655966+0000", 2024-09-10T06:28:03.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0100000000000001e-07 2024-09-10T06:28:03.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.658643+0000", 2024-09-10T06:28:03.811 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026777950000000002 2024-09-10T06:28:03.811 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.811 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.811 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.811 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.658667+0000", 2024-09-10T06:28:03.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3855000000000001e-05 2024-09-10T06:28:03.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.658680+0000", 2024-09-10T06:28:03.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.287e-05 2024-09-10T06:28:03.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.812 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.812 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.658766+0000", 2024-09-10T06:28:03.812 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5506000000000004e-05 2024-09-10T06:28:03.812 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.812 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.658791+0000", 2024-09-10T06:28:03.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5618000000000001e-05 2024-09-10T06:28:03.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.670829+0000", 2024-09-10T06:28:03.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012037696000000001 2024-09-10T06:28:03.813 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.813 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.813 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.813 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.670871+0000", 2024-09-10T06:28:03.813 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2497000000000003e-05 2024-09-10T06:28:03.814 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.814 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.814 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.814 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.814 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.814 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1440 3.33 3:ccd67be5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_185:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:03.814 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.713103+0000", 2024-09-10T06:28:03.814 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 4.0019715849999997, 2024-09-10T06:28:03.814 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014884371, 2024-09-10T06:28:03.814 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.814 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.814 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.814 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.814 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.815 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.815 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1440 2024-09-10T06:28:03.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.815 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.713103+0000", 2024-09-10T06:28:03.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.815 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.815 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.815 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.713103+0000", 2024-09-10T06:28:03.815 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.815 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.713106+0000", 2024-09-10T06:28:03.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5209999999999998e-06 2024-09-10T06:28:03.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.714650+0000", 2024-09-10T06:28:03.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015437300000000001 2024-09-10T06:28:03.816 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.816 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.816 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.816 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.714672+0000", 2024-09-10T06:28:03.816 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2208000000000002e-05 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.714686+0000", 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.396e-05 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.714754+0000", 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8126000000000005e-05 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.714937+0000", 2024-09-10T06:28:03.817 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000182876 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.715093+0000", 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000156083 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.724862+0000", 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0097688940000000002 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.727891+0000", 2024-09-10T06:28:03.818 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0030288509999999999 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.727940+0000", 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8795999999999998e-05 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.727987+0000", 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7326000000000001e-05 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.819 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1446 3.29 3:97120176:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:03.820 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.777351+0000", 2024-09-10T06:28:03.820 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.9377233459999998, 2024-09-10T06:28:03.820 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017481667999999999, 2024-09-10T06:28:03.820 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.820 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.820 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.820 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.820 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.820 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.820 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1446 2024-09-10T06:28:03.820 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.820 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.777351+0000", 2024-09-10T06:28:03.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.777351+0000", 2024-09-10T06:28:03.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.821 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.821 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.821 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.821 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.777354+0000", 2024-09-10T06:28:03.821 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1889999999999999e-06 2024-09-10T06:28:03.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.778750+0000", 2024-09-10T06:28:03.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001396088 2024-09-10T06:28:03.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.822 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.778760+0000", 2024-09-10T06:28:03.822 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5049999999999996e-06 2024-09-10T06:28:03.822 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.822 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.822 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.778765+0000", 2024-09-10T06:28:03.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9679999999999997e-06 2024-09-10T06:28:03.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.778821+0000", 2024-09-10T06:28:03.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6728999999999998e-05 2024-09-10T06:28:03.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.823 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.823 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.778968+0000", 2024-09-10T06:28:03.823 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014646 2024-09-10T06:28:03.823 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.823 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:03.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.779069+0000", 2024-09-10T06:28:03.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100905 2024-09-10T06:28:03.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.787361+0000", 2024-09-10T06:28:03.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0082922780000000001 2024-09-10T06:28:03.824 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.824 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.824 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.824 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.794713+0000", 2024-09-10T06:28:03.824 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073517870000000003 2024-09-10T06:28:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.794780+0000", 2024-09-10T06:28:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7415000000000004e-05 2024-09-10T06:28:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.794832+0000", 2024-09-10T06:28:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2343999999999999e-05 2024-09-10T06:28:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.825 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.826 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.826 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1450 3.27 3:e710f600:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:03.826 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.823335+0000", 2024-09-10T06:28:03.826 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.8917392299999998, 2024-09-10T06:28:03.826 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017310316999999999, 2024-09-10T06:28:03.826 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.826 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.826 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.826 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.826 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.826 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.826 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1450 2024-09-10T06:28:03.826 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.826 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.823335+0000", 2024-09-10T06:28:03.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.823335+0000", 2024-09-10T06:28:03.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.827 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.827 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.827 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.827 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.823338+0000", 2024-09-10T06:28:03.827 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1709999999999998e-06 2024-09-10T06:28:03.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.824588+0000", 2024-09-10T06:28:03.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001249642 2024-09-10T06:28:03.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.824615+0000", 2024-09-10T06:28:03.828 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7593000000000002e-05 2024-09-10T06:28:03.828 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.828 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.828 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.828 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.824626+0000", 2024-09-10T06:28:03.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0540000000000001e-05 2024-09-10T06:28:03.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.824704+0000", 2024-09-10T06:28:03.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.805e-05 2024-09-10T06:28:03.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.829 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.824869+0000", 2024-09-10T06:28:03.829 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016499700000000001 2024-09-10T06:28:03.829 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.829 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.829 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.825028+0000", 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000158839 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.833009+0000", 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0079817329999999995 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.840527+0000", 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0075173180000000003 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.830 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.840593+0000", 2024-09-10T06:28:03.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6536000000000001e-05 2024-09-10T06:28:03.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.831 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.831 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.840645+0000", 2024-09-10T06:28:03.831 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1897999999999997e-05 2024-09-10T06:28:03.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.831 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.831 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.831 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.831 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.831 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1455 3.24 3:266d8e79:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_200:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:03.831 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.881376+0000", 2024-09-10T06:28:03.832 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.8336977709999998, 2024-09-10T06:28:03.832 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016335404000000001, 2024-09-10T06:28:03.832 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.832 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.832 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.832 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.832 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.832 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.832 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1455 2024-09-10T06:28:03.832 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.832 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.832 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.832 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.832 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.881376+0000", 2024-09-10T06:28:03.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.881376+0000", 2024-09-10T06:28:03.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.833 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.833 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.881379+0000", 2024-09-10T06:28:03.833 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.773e-06 2024-09-10T06:28:03.833 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.833 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.884049+0000", 2024-09-10T06:28:03.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026701289999999998 2024-09-10T06:28:03.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.884084+0000", 2024-09-10T06:28:03.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4666000000000003e-05 2024-09-10T06:28:03.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.834 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.834 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.834 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.884099+0000", 2024-09-10T06:28:03.834 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4759e-05 2024-09-10T06:28:03.834 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.884174+0000", 2024-09-10T06:28:03.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5437000000000003e-05 2024-09-10T06:28:03.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.884300+0000", 2024-09-10T06:28:03.835 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012569400000000001 2024-09-10T06:28:03.835 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.835 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.835 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:03.835 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.884420+0000", 2024-09-10T06:28:03.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012037 2024-09-10T06:28:03.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.891178+0000", 2024-09-10T06:28:03.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0067574389999999996 2024-09-10T06:28:03.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.836 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.836 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.897623+0000", 2024-09-10T06:28:03.836 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0064453679999999999 2024-09-10T06:28:03.836 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.836 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.897679+0000", 2024-09-10T06:28:03.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5513000000000002e-05 2024-09-10T06:28:03.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.837 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.837 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.897712+0000", 2024-09-10T06:28:03.837 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3256000000000001e-05 2024-09-10T06:28:03.837 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.837 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.837 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.837 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.837 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.838 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1456 3.1e 3:784f2f47:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:03.838 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.892736+0000", 2024-09-10T06:28:03.838 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 3.8223385169999999, 2024-09-10T06:28:03.838 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015607688999999999, 2024-09-10T06:28:03.838 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:03.838 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:03.838 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:03.838 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:03.838 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:03.838 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:03.838 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1456 2024-09-10T06:28:03.838 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.838 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:03.838 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:03.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.892736+0000", 2024-09-10T06:28:03.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:03.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.892736+0000", 2024-09-10T06:28:03.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:03.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.839 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.839 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:03.839 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.892737+0000", 2024-09-10T06:28:03.839 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7060000000000001e-06 2024-09-10T06:28:03.839 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:03.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.894771+0000", 2024-09-10T06:28:03.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0020339550000000001 2024-09-10T06:28:03.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:03.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.894794+0000", 2024-09-10T06:28:03.840 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2427999999999999e-05 2024-09-10T06:28:03.840 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.840 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.840 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:03.840 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.894804+0000", 2024-09-10T06:28:03.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0022e-05 2024-09-10T06:28:03.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:03.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.894873+0000", 2024-09-10T06:28:03.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9494999999999998e-05 2024-09-10T06:28:03.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:03.841 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.895014+0000", 2024-09-10T06:28:03.841 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014098299999999999 2024-09-10T06:28:03.841 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.841 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.841 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:03.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.895118+0000", 2024-09-10T06:28:03.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103873 2024-09-10T06:28:03.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:03.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.903181+0000", 2024-09-10T06:28:03.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0080630470000000003 2024-09-10T06:28:03.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.842 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:03.842 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.908251+0000", 2024-09-10T06:28:03.842 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0050695050000000002 2024-09-10T06:28:03.842 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.842 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:03.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.908305+0000", 2024-09-10T06:28:03.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4218999999999997e-05 2024-09-10T06:28:03.843 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:03.843 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:03.843 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:03.843 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.908343+0000", 2024-09-10T06:28:03.843 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8455999999999999e-05 2024-09-10T06:28:03.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.843 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.843 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:03.843 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:03.843 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:03.845 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:28:03.846 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:03.844+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:03.946 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:03.944+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:03.975 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:03.975 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:03.975 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:03.989 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:28:04.048 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:04.044+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:04.113 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:04.113 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:04.113 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:04.127 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:28:04.172 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:04.172+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:04.248 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1351 3.1d e63/41 3:b8f5f32e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_106:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.891127+0000", 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3558462200000001, 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016439619999999999, 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.249 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.891127+0000", 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.891127+0000", 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.891129+0000", 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7089999999999998e-06 2024-09-10T06:28:04.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895096+0000", 2024-09-10T06:28:04.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039671309999999996 2024-09-10T06:28:04.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895128+0000", 2024-09-10T06:28:04.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1664e-05 2024-09-10T06:28:04.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895158+0000", 2024-09-10T06:28:04.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0168e-05 2024-09-10T06:28:04.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895311+0000", 2024-09-10T06:28:04.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015315899999999999 2024-09-10T06:28:04.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895380+0000", 2024-09-10T06:28:04.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8559000000000005e-05 2024-09-10T06:28:04.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.907398+0000", 2024-09-10T06:28:04.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012017798 2024-09-10T06:28:04.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.907566+0000", 2024-09-10T06:28:04.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016843199999999999 2024-09-10T06:28:04.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.253 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1352 3.1c e63/22 3:3adb07ef:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_107:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.904909+0000", 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3420640649999998, 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016373502000000002, 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.904909+0000", 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.904909+0000", 2024-09-10T06:28:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.904911+0000", 2024-09-10T06:28:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.916e-06 2024-09-10T06:28:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908660+0000", 2024-09-10T06:28:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037489490000000001 2024-09-10T06:28:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908697+0000", 2024-09-10T06:28:04.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7761e-05 2024-09-10T06:28:04.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908724+0000", 2024-09-10T06:28:04.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6361000000000001e-05 2024-09-10T06:28:04.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908878+0000", 2024-09-10T06:28:04.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000153936 2024-09-10T06:28:04.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908921+0000", 2024-09-10T06:28:04.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3000999999999997e-05 2024-09-10T06:28:04.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.921179+0000", 2024-09-10T06:28:04.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012257901999999999 2024-09-10T06:28:04.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.921282+0000", 2024-09-10T06:28:04.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103676 2024-09-10T06:28:04.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.258 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.258 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1359 3.34 3:2ece4e0b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.258 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:04.258 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.2697429009999999, 2024-09-10T06:28:04.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021482449000000001, 2024-09-10T06:28:04.258 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.258 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.258 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1359 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:04.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977234+0000", 2024-09-10T06:28:04.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7969999999999998e-06 2024-09-10T06:28:04.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981211+0000", 2024-09-10T06:28:04.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039768329999999999 2024-09-10T06:28:04.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981247+0000", 2024-09-10T06:28:04.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6457e-05 2024-09-10T06:28:04.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981274+0000", 2024-09-10T06:28:04.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6917999999999999e-05 2024-09-10T06:28:04.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981446+0000", 2024-09-10T06:28:04.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171831 2024-09-10T06:28:04.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981719+0000", 2024-09-10T06:28:04.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027282800000000002 2024-09-10T06:28:04.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:04.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981975+0000", 2024-09-10T06:28:04.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000256782 2024-09-10T06:28:04.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.991319+0000", 2024-09-10T06:28:04.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093433820000000008 2024-09-10T06:28:04.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998330+0000", 2024-09-10T06:28:04.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070108549999999999 2024-09-10T06:28:04.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998549+0000", 2024-09-10T06:28:04.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021944400000000001 2024-09-10T06:28:04.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998712+0000", 2024-09-10T06:28:04.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016332200000000001 2024-09-10T06:28:04.264 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.264 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.264 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.264 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1367 3.34 3:2f444f7f:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.264 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:04.264 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.1766611979999997, 2024-09-10T06:28:04.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020931903000000002, 2024-09-10T06:28:04.264 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.264 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.264 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.265 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.265 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.265 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.265 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1367 2024-09-10T06:28:04.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.265 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:04.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070316+0000", 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9029999999999997e-06 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074255+0000", 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039391679999999998 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074291+0000", 2024-09-10T06:28:04.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5970000000000003e-05 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074309+0000", 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8399000000000001e-05 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074436+0000", 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012683099999999999 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074686+0000", 2024-09-10T06:28:04.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024971699999999999 2024-09-10T06:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074907+0000", 2024-09-10T06:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022124800000000001 2024-09-10T06:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.084332+0000", 2024-09-10T06:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094253449999999999 2024-09-10T06:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.090954+0000", 2024-09-10T06:28:04.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066213649999999997 2024-09-10T06:28:04.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.091123+0000", 2024-09-10T06:28:04.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169216 2024-09-10T06:28:04.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.091244+0000", 2024-09-10T06:28:04.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120741 2024-09-10T06:28:04.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.269 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1375 3.1 e63/22 3:82031a0e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_130:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0836051619999996, 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018270307999999999, 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163370+0000", 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8289999999999999e-06 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167665+0000", 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042940499999999998 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167698+0000", 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3484e-05 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167714+0000", 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167847+0000", 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013299300000000001 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167890+0000", 2024-09-10T06:28:04.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2434000000000001e-05 2024-09-10T06:28:04.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181507+0000", 2024-09-10T06:28:04.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013616872 2024-09-10T06:28:04.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181638+0000", 2024-09-10T06:28:04.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013123099999999999 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1380 3.3 3:c3afb574:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0355510270000003, 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027193374999999999, 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.275 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1380 2024-09-10T06:28:04.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.275 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:04.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:04.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211426+0000", 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3599999999999998e-06 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215383+0000", 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039567450000000002 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215417+0000", 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4051000000000003e-05 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215435+0000", 2024-09-10T06:28:04.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8459000000000001e-05 2024-09-10T06:28:04.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215626+0000", 2024-09-10T06:28:04.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019018299999999999 2024-09-10T06:28:04.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215991+0000", 2024-09-10T06:28:04.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036566099999999998 2024-09-10T06:28:04.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:04.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.216360+0000", 2024-09-10T06:28:04.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000368995 2024-09-10T06:28:04.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.226152+0000", 2024-09-10T06:28:04.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097914319999999992 2024-09-10T06:28:04.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238448+0000", 2024-09-10T06:28:04.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012295834 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238538+0000", 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0539999999999997e-05 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238615+0000", 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7114999999999996e-05 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.279 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1383 3.3 3:c2c34097:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.280 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:04.280 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0042093129999996, 2024-09-10T06:28:04.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020753975000000001, 2024-09-10T06:28:04.280 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.280 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.280 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.280 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.280 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.280 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.280 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1383 2024-09-10T06:28:04.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.280 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:04.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:04.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242767+0000", 2024-09-10T06:28:04.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6169999999999998e-06 2024-09-10T06:28:04.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246704+0000", 2024-09-10T06:28:04.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003936485 2024-09-10T06:28:04.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246733+0000", 2024-09-10T06:28:04.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9819999999999999e-05 2024-09-10T06:28:04.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246748+0000", 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4334e-05 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246902+0000", 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015468 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.247286+0000", 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038366799999999999 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.247687+0000", 2024-09-10T06:28:04.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000401252 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.257963+0000", 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010275584000000001 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263287+0000", 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053238499999999998 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263412+0000", 2024-09-10T06:28:04.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012516200000000001 2024-09-10T06:28:04.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263517+0000", 2024-09-10T06:28:04.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105523 2024-09-10T06:28:04.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.285 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.285 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1391 3.1c e63/22 3:3a76b5ac:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_146:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:04.285 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:04.285 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.9199032989999996, 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026554852, 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327072+0000", 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6970000000000002e-06 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330874+0000", 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038016590000000002 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330928+0000", 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3729e-05 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330956+0000", 2024-09-10T06:28:04.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8694999999999999e-05 2024-09-10T06:28:04.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.331147+0000", 2024-09-10T06:28:04.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190841 2024-09-10T06:28:04.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.331216+0000", 2024-09-10T06:28:04.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8948999999999993e-05 2024-09-10T06:28:04.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.353521+0000", 2024-09-10T06:28:04.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022304781999999999 2024-09-10T06:28:04.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.353624+0000", 2024-09-10T06:28:04.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010349999999999999 2024-09-10T06:28:04.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.289 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1392 3.14 3:2b02aaa8:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.9149245099999996, 2024-09-10T06:28:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024102582000000001, 2024-09-10T06:28:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1392 2024-09-10T06:28:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332052+0000", 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8999999999999999e-06 2024-09-10T06:28:04.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.335987+0000", 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039349800000000002 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336020+0000", 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2968e-05 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336040+0000", 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9956e-05 2024-09-10T06:28:04.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336155+0000", 2024-09-10T06:28:04.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115275 2024-09-10T06:28:04.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336404+0000", 2024-09-10T06:28:04.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024874599999999999 2024-09-10T06:28:04.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:04.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336626+0000", 2024-09-10T06:28:04.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022168200000000001 2024-09-10T06:28:04.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.355854+0000", 2024-09-10T06:28:04.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019228624999999999 2024-09-10T06:28:04.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.355890+0000", 2024-09-10T06:28:04.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5901000000000001e-05 2024-09-10T06:28:04.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.356040+0000", 2024-09-10T06:28:04.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014919600000000001 2024-09-10T06:28:04.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.356151+0000", 2024-09-10T06:28:04.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111353 2024-09-10T06:28:04.295 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.295 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.295 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.295 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1398 3.2c e63/22 3:350a23e7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_153:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:04.295 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:04.295 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.8438315240000005, 2024-09-10T06:28:04.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021444181, 2024-09-10T06:28:04.296 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.296 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.296 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.296 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:04.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403144+0000", 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.734e-06 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406432+0000", 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032884500000000001 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406473+0000", 2024-09-10T06:28:04.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0834000000000002e-05 2024-09-10T06:28:04.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406492+0000", 2024-09-10T06:28:04.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8868999999999998e-05 2024-09-10T06:28:04.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406632+0000", 2024-09-10T06:28:04.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140183 2024-09-10T06:28:04.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406698+0000", 2024-09-10T06:28:04.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5913000000000004e-05 2024-09-10T06:28:04.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424483+0000", 2024-09-10T06:28:04.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017785108000000001 2024-09-10T06:28:04.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424585+0000", 2024-09-10T06:28:04.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010208999999999999 2024-09-10T06:28:04.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.300 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.300 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1415 3.2c e63/22 3:34c14757:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_160:head v 63'5, mlcod=63'3)", 2024-09-10T06:28:04.300 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:04.300 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7789810660000001, 2024-09-10T06:28:04.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023773743999999999, 2024-09-10T06:28:04.300 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.300 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.300 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.300 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467994+0000", 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471376+0000", 2024-09-10T06:28:04.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033818099999999999 2024-09-10T06:28:04.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471426+0000", 2024-09-10T06:28:04.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9846999999999999e-05 2024-09-10T06:28:04.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471452+0000", 2024-09-10T06:28:04.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6327999999999999e-05 2024-09-10T06:28:04.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471621+0000", 2024-09-10T06:28:04.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016928200000000001 2024-09-10T06:28:04.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.472399+0000", 2024-09-10T06:28:04.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000777171 2024-09-10T06:28:04.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.491634+0000", 2024-09-10T06:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019235070999999999 2024-09-10T06:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.491766+0000", 2024-09-10T06:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013176799999999999 2024-09-10T06:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1417 3.14 3:29141a67:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:04.304 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7660470689999999, 2024-09-10T06:28:04.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026932543, 2024-09-10T06:28:04.305 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.305 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1417 2024-09-10T06:28:04.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.305 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:04.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:04.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480929+0000", 2024-09-10T06:28:04.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-10T06:28:04.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486391+0000", 2024-09-10T06:28:04.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054618599999999998 2024-09-10T06:28:04.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486425+0000", 2024-09-10T06:28:04.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4031e-05 2024-09-10T06:28:04.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486443+0000", 2024-09-10T06:28:04.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7878999999999999e-05 2024-09-10T06:28:04.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486581+0000", 2024-09-10T06:28:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013773400000000001 2024-09-10T06:28:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486836+0000", 2024-09-10T06:28:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025529900000000001 2024-09-10T06:28:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.487064+0000", 2024-09-10T06:28:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000228438 2024-09-10T06:28:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.505216+0000", 2024-09-10T06:28:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018152130999999998 2024-09-10T06:28:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507597+0000", 2024-09-10T06:28:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023807260000000001 2024-09-10T06:28:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507690+0000", 2024-09-10T06:28:04.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2305999999999993e-05 2024-09-10T06:28:04.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507858+0000", 2024-09-10T06:28:04.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016879199999999999 2024-09-10T06:28:04.310 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.310 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.310 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.310 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1418 3.24 e63/22 3:26ca0de9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_163:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:04.310 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.493351+0000", 2024-09-10T06:28:04.310 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7536223089999998, 2024-09-10T06:28:04.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01657111, 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493351+0000", 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493351+0000", 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493353+0000", 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499691+0000", 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063376029999999998 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499724+0000", 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3124999999999999e-05 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499741+0000", 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6852000000000001e-05 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499853+0000", 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011278899999999999 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499897+0000", 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3789999999999999e-05 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.509788+0000", 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098906770000000005 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.509922+0000", 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013369099999999999 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1424 3.14 3:28df499c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:04.314 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6994753459999998, 2024-09-10T06:28:04.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017872099999999998, 2024-09-10T06:28:04.315 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.315 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.315 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.315 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.315 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1424 2024-09-10T06:28:04.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.315 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:04.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:04.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547500+0000", 2024-09-10T06:28:04.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.999e-06 2024-09-10T06:28:04.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551376+0000", 2024-09-10T06:28:04.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038754010000000001 2024-09-10T06:28:04.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551401+0000", 2024-09-10T06:28:04.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5476000000000001e-05 2024-09-10T06:28:04.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551413+0000", 2024-09-10T06:28:04.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2082999999999999e-05 2024-09-10T06:28:04.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551486+0000", 2024-09-10T06:28:04.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2793999999999995e-05 2024-09-10T06:28:04.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551610+0000", 2024-09-10T06:28:04.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123993 2024-09-10T06:28:04.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:04.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551718+0000", 2024-09-10T06:28:04.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107357 2024-09-10T06:28:04.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.559898+0000", 2024-09-10T06:28:04.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081805860000000001 2024-09-10T06:28:04.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565204+0000", 2024-09-10T06:28:04.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053053589999999999 2024-09-10T06:28:04.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565296+0000", 2024-09-10T06:28:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2291000000000001e-05 2024-09-10T06:28:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565370+0000", 2024-09-10T06:28:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3761000000000001e-05 2024-09-10T06:28:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1429 3.1a 3:5acc80b6:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6496102879999999, 2024-09-10T06:28:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020448872999999999, 2024-09-10T06:28:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1429 2024-09-10T06:28:04.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597365+0000", 2024-09-10T06:28:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2759999999999999e-06 2024-09-10T06:28:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601186+0000", 2024-09-10T06:28:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038214410000000001 2024-09-10T06:28:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601212+0000", 2024-09-10T06:28:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5522999999999999e-05 2024-09-10T06:28:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601222+0000", 2024-09-10T06:28:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0584999999999999e-05 2024-09-10T06:28:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601314+0000", 2024-09-10T06:28:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1484999999999996e-05 2024-09-10T06:28:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601494+0000", 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018006899999999999 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601655+0000", 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016119999999999999 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.607352+0000", 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056970500000000004 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617735+0000", 2024-09-10T06:28:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010382769 2024-09-10T06:28:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617780+0000", 2024-09-10T06:28:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5145999999999998e-05 2024-09-10T06:28:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617811+0000", 2024-09-10T06:28:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1328999999999998e-05 2024-09-10T06:28:04.326 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1433 3.1a 3:59ee0094:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5999963040000003, 2024-09-10T06:28:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024407437000000001, 2024-09-10T06:28:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1433 2024-09-10T06:28:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:04.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646979+0000", 2024-09-10T06:28:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.074e-06 2024-09-10T06:28:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.650998+0000", 2024-09-10T06:28:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040192470000000001 2024-09-10T06:28:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651031+0000", 2024-09-10T06:28:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2821000000000003e-05 2024-09-10T06:28:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651050+0000", 2024-09-10T06:28:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9556e-05 2024-09-10T06:28:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651150+0000", 2024-09-10T06:28:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9689e-05 2024-09-10T06:28:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651325+0000", 2024-09-10T06:28:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017529199999999999 2024-09-10T06:28:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651496+0000", 2024-09-10T06:28:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000170531 2024-09-10T06:28:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.659894+0000", 2024-09-10T06:28:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083978049999999995 2024-09-10T06:28:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671085+0000", 2024-09-10T06:28:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011190989 2024-09-10T06:28:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671261+0000", 2024-09-10T06:28:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017616800000000001 2024-09-10T06:28:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671384+0000", 2024-09-10T06:28:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012326500000000001 2024-09-10T06:28:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1446 3.29 e64/22 3:97120176:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_191:head v 64'4, mlcod=63'2)", 2024-09-10T06:28:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.780199+0000", 2024-09-10T06:28:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.4667741579999998, 2024-09-10T06:28:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015204845999999999, 2024-09-10T06:28:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.780199+0000", 2024-09-10T06:28:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.780199+0000", 2024-09-10T06:28:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.780201+0000", 2024-09-10T06:28:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0660000000000002e-06 2024-09-10T06:28:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.783963+0000", 2024-09-10T06:28:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037619649999999999 2024-09-10T06:28:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.783986+0000", 2024-09-10T06:28:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3482999999999999e-05 2024-09-10T06:28:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.783996+0000", 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0165e-05 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.784176+0000", 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017985000000000001 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.784218+0000", 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2203999999999998e-05 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.795331+0000", 2024-09-10T06:28:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011112541 2024-09-10T06:28:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.795404+0000", 2024-09-10T06:28:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2571999999999996e-05 2024-09-10T06:28:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1470 3.34 3:2e4989bb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2028043779999997, 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019466533000000001, 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1470 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044172+0000", 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5939999999999998e-06 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048101+0000", 2024-09-10T06:28:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003929325 2024-09-10T06:28:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048135+0000", 2024-09-10T06:28:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3856000000000002e-05 2024-09-10T06:28:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048150+0000", 2024-09-10T06:28:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.523e-05 2024-09-10T06:28:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048258+0000", 2024-09-10T06:28:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108025 2024-09-10T06:28:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048437+0000", 2024-09-10T06:28:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017811199999999999 2024-09-10T06:28:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048550+0000", 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113181 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063173+0000", 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014623565 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063361+0000", 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018807599999999999 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063499+0000", 2024-09-10T06:28:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013745000000000001 2024-09-10T06:28:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063635+0000", 2024-09-10T06:28:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136119 2024-09-10T06:28:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.343 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1472 3.34 3:2e34818b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.062471+0000", 2024-09-10T06:28:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.1845021490000001, 2024-09-10T06:28:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016070911, 2024-09-10T06:28:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1472 2024-09-10T06:28:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.062471+0000", 2024-09-10T06:28:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.062471+0000", 2024-09-10T06:28:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.062473+0000", 2024-09-10T06:28:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0190000000000001e-06 2024-09-10T06:28:04.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066284+0000", 2024-09-10T06:28:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038111659999999999 2024-09-10T06:28:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066302+0000", 2024-09-10T06:28:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8216e-05 2024-09-10T06:28:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066311+0000", 2024-09-10T06:28:04.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7460000000000006e-06 2024-09-10T06:28:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066370+0000", 2024-09-10T06:28:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9292000000000001e-05 2024-09-10T06:28:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066526+0000", 2024-09-10T06:28:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155783 2024-09-10T06:28:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:04.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066639+0000", 2024-09-10T06:28:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113212 2024-09-10T06:28:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078013+0000", 2024-09-10T06:28:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011373822 2024-09-10T06:28:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078408+0000", 2024-09-10T06:28:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000395086 2024-09-10T06:28:04.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078486+0000", 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8176999999999994e-05 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078542+0000", 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5392000000000001e-05 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.350 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1477 3.14 3:2806720c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_222:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.111004+0000", 2024-09-10T06:28:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.1359690349999996, 2024-09-10T06:28:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015271776000000001, 2024-09-10T06:28:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1477 2024-09-10T06:28:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.111004+0000", 2024-09-10T06:28:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.111004+0000", 2024-09-10T06:28:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.111006+0000", 2024-09-10T06:28:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9810000000000002e-06 2024-09-10T06:28:04.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.114853+0000", 2024-09-10T06:28:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038473270000000002 2024-09-10T06:28:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.114885+0000", 2024-09-10T06:28:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2237999999999999e-05 2024-09-10T06:28:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.114899+0000", 2024-09-10T06:28:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3661e-05 2024-09-10T06:28:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.114985+0000", 2024-09-10T06:28:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6261000000000006e-05 2024-09-10T06:28:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.115165+0000", 2024-09-10T06:28:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017939 2024-09-10T06:28:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.115335+0000", 2024-09-10T06:28:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017080700000000001 2024-09-10T06:28:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.125460+0000", 2024-09-10T06:28:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010124542 2024-09-10T06:28:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.126120+0000", 2024-09-10T06:28:04.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00066047700000000003 2024-09-10T06:28:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.126203+0000", 2024-09-10T06:28:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2913999999999999e-05 2024-09-10T06:28:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.126276+0000", 2024-09-10T06:28:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2177999999999999e-05 2024-09-10T06:28:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.357 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.357 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:04.358 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:28:04.359 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:04.356+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:04.408 INFO:tasks.workunit.client.0.smithi112.stderr:10+0 records in 2024-09-10T06:28:04.408 INFO:tasks.workunit.client.0.smithi112.stderr:10+0 records out 2024-09-10T06:28:04.408 INFO:tasks.workunit.client.0.smithi112.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.603499 s, 174 MB/s 2024-09-10T06:28:04.458 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:04.456+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:04.541 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:04.542 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:04.542 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:04.542 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:04.558 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:28:04.600 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:04.600+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:04.660 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:04.660+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:04.660 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T06:28:04.724 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:04.724 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:04.738 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:28:04.760 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:04.756+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:04.861 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:04.856+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:04.944 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:04.944 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:04.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:04.944 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:04.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.945 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1354 3.5 3:a2100466:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.945 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:04.945 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.0189184920000001, 2024-09-10T06:28:04.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022320934000000001, 2024-09-10T06:28:04.945 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.945 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.945 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.945 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1354 2024-09-10T06:28:04.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.946 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:04.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:04.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919975+0000", 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4369999999999999e-06 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926675+0000", 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066993529999999999 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926705+0000", 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0391000000000001e-05 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926722+0000", 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7159e-05 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926840+0000", 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117459 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.927092+0000", 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025180899999999997 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.927353+0000", 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026148499999999999 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.940116+0000", 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01276245 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.941993+0000", 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001877079 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.942164+0000", 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171378 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.942293+0000", 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012893400000000001 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1355 3.16 3:6be207af:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:04.950 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.0081688910000004, 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023027044, 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1355 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:04.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930724+0000", 2024-09-10T06:28:04.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5100000000000001e-06 2024-09-10T06:28:04.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937234+0000", 2024-09-10T06:28:04.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065097760000000001 2024-09-10T06:28:04.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937259+0000", 2024-09-10T06:28:04.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4915000000000001e-05 2024-09-10T06:28:04.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937275+0000", 2024-09-10T06:28:04.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6659000000000001e-05 2024-09-10T06:28:04.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937437+0000", 2024-09-10T06:28:04.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161259 2024-09-10T06:28:04.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937718+0000", 2024-09-10T06:28:04.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028092699999999999 2024-09-10T06:28:04.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:04.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937955+0000", 2024-09-10T06:28:04.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023767300000000001 2024-09-10T06:28:04.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.952527+0000", 2024-09-10T06:28:04.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014571850000000001 2024-09-10T06:28:04.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953577+0000", 2024-09-10T06:28:04.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001049601 2024-09-10T06:28:04.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953671+0000", 2024-09-10T06:28:04.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4580000000000006e-05 2024-09-10T06:28:04.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953749+0000", 2024-09-10T06:28:04.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7293999999999996e-05 2024-09-10T06:28:04.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.956 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.956 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1364 3.36 e63/22 3:6e968b0d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_119:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:04.957 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.040414+0000", 2024-09-10T06:28:04.957 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.8984769449999996, 2024-09-10T06:28:04.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016263488, 2024-09-10T06:28:04.957 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.957 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.957 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.957 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.040414+0000", 2024-09-10T06:28:04.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.040414+0000", 2024-09-10T06:28:04.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.040417+0000", 2024-09-10T06:28:04.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1690000000000001e-06 2024-09-10T06:28:04.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.043132+0000", 2024-09-10T06:28:04.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00271544 2024-09-10T06:28:04.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.043181+0000", 2024-09-10T06:28:04.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8986000000000002e-05 2024-09-10T06:28:04.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.043206+0000", 2024-09-10T06:28:04.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4712e-05 2024-09-10T06:28:04.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.043387+0000", 2024-09-10T06:28:04.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018164400000000001 2024-09-10T06:28:04.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.043444+0000", 2024-09-10T06:28:04.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6162999999999997e-05 2024-09-10T06:28:04.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.056505+0000", 2024-09-10T06:28:04.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013061372 2024-09-10T06:28:04.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.056677+0000", 2024-09-10T06:28:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017200200000000001 2024-09-10T06:28:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1369 3.22 3:45ffca16:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.8441153899999998, 2024-09-10T06:28:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020833028999999999, 2024-09-10T06:28:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.962 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1369 2024-09-10T06:28:04.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.962 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:04.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094779+0000", 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1099999999999996e-06 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100674+0000", 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058944740000000002 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100714+0000", 2024-09-10T06:28:04.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0527e-05 2024-09-10T06:28:04.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100732+0000", 2024-09-10T06:28:04.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8034999999999999e-05 2024-09-10T06:28:04.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100871+0000", 2024-09-10T06:28:04.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013849399999999999 2024-09-10T06:28:04.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.101123+0000", 2024-09-10T06:28:04.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025259000000000002 2024-09-10T06:28:04.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:04.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.101372+0000", 2024-09-10T06:28:04.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024846599999999998 2024-09-10T06:28:04.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.111593+0000", 2024-09-10T06:28:04.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010221165000000001 2024-09-10T06:28:04.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115305+0000", 2024-09-10T06:28:04.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037123249999999998 2024-09-10T06:28:04.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115476+0000", 2024-09-10T06:28:04.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017085200000000001 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115608+0000", 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131991 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1372 3.36 e63/22 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.8004928839999996, 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018914395000000001, 2024-09-10T06:28:04.967 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.968 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.968 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.968 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:04.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:04.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138401+0000", 2024-09-10T06:28:04.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3859999999999999e-06 2024-09-10T06:28:04.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142599+0000", 2024-09-10T06:28:04.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041982190000000004 2024-09-10T06:28:04.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142649+0000", 2024-09-10T06:28:04.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9477000000000001e-05 2024-09-10T06:28:04.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142674+0000", 2024-09-10T06:28:04.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5558000000000002e-05 2024-09-10T06:28:04.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142832+0000", 2024-09-10T06:28:04.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158159 2024-09-10T06:28:04.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142879+0000", 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6650000000000002e-05 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157209+0000", 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014330209999999999 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157312+0000", 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102736 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.971 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.972 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1373 3.35 e63/22 3:ac8a3287:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_128:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:04.972 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.148374+0000", 2024-09-10T06:28:04.972 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.7905161669999998, 2024-09-10T06:28:04.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017663458999999999, 2024-09-10T06:28:04.972 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.972 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.972 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148374+0000", 2024-09-10T06:28:04.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148374+0000", 2024-09-10T06:28:04.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148378+0000", 2024-09-10T06:28:04.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4869999999999998e-06 2024-09-10T06:28:04.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153210+0000", 2024-09-10T06:28:04.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048319130000000002 2024-09-10T06:28:04.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153243+0000", 2024-09-10T06:28:04.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3794000000000002e-05 2024-09-10T06:28:04.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153266+0000", 2024-09-10T06:28:04.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2841999999999999e-05 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153394+0000", 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012804099999999999 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153432+0000", 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7194000000000003e-05 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.165933+0000", 2024-09-10T06:28:04.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012501583 2024-09-10T06:28:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166038+0000", 2024-09-10T06:28:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010460500000000001 2024-09-10T06:28:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1374 3.2f 3:f735f5eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.7854685850000003, 2024-09-10T06:28:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028841426, 2024-09-10T06:28:04.977 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.977 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.977 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.977 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1374 2024-09-10T06:28:04.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.977 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:04.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:04.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153425+0000", 2024-09-10T06:28:04.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8030000000000001e-06 2024-09-10T06:28:04.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157050+0000", 2024-09-10T06:28:04.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036249070000000001 2024-09-10T06:28:04.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157081+0000", 2024-09-10T06:28:04.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1525000000000001e-05 2024-09-10T06:28:04.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157103+0000", 2024-09-10T06:28:04.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1599000000000001e-05 2024-09-10T06:28:04.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157253+0000", 2024-09-10T06:28:04.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150266 2024-09-10T06:28:04.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157545+0000", 2024-09-10T06:28:04.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029204399999999998 2024-09-10T06:28:04.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:04.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157898+0000", 2024-09-10T06:28:04.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035326200000000002 2024-09-10T06:28:04.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181021+0000", 2024-09-10T06:28:04.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023123008 2024-09-10T06:28:04.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181894+0000", 2024-09-10T06:28:04.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00087308700000000004 2024-09-10T06:28:04.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.182128+0000", 2024-09-10T06:28:04.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000233811 2024-09-10T06:28:04.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.182263+0000", 2024-09-10T06:28:04.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013511400000000001 2024-09-10T06:28:04.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.982 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.982 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1391 3.1c 3:3a76b5ac:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.982 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:04.982 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.6167315789999996, 2024-09-10T06:28:04.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032016492000000001, 2024-09-10T06:28:04.982 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.983 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1391 2024-09-10T06:28:04.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.983 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:04.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:04.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322162+0000", 2024-09-10T06:28:04.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.523e-06 2024-09-10T06:28:04.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326140+0000", 2024-09-10T06:28:04.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039776000000000004 2024-09-10T06:28:04.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326177+0000", 2024-09-10T06:28:04.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6878000000000002e-05 2024-09-10T06:28:04.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326195+0000", 2024-09-10T06:28:04.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8576e-05 2024-09-10T06:28:04.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326334+0000", 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013836600000000001 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326608+0000", 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000274586 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326847+0000", 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023812 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.338793+0000", 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011946141 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354011+0000", 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015217856 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354100+0000", 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9497e-05 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354175+0000", 2024-09-10T06:28:04.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5349e-05 2024-09-10T06:28:04.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.988 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.988 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1399 3.38 e63/22 3:1dcd0b88:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_154:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:04.988 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:04.988 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.5331604720000005, 2024-09-10T06:28:04.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019306528999999999, 2024-09-10T06:28:04.988 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.989 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.989 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:04.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:04.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405734+0000", 2024-09-10T06:28:04.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2529999999999998e-06 2024-09-10T06:28:04.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410725+0000", 2024-09-10T06:28:04.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049902849999999997 2024-09-10T06:28:04.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410776+0000", 2024-09-10T06:28:04.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1762999999999999e-05 2024-09-10T06:28:04.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410805+0000", 2024-09-10T06:28:04.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8274999999999999e-05 2024-09-10T06:28:04.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410984+0000", 2024-09-10T06:28:04.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017977800000000001 2024-09-10T06:28:04.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.411050+0000", 2024-09-10T06:28:04.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6115e-05 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424826+0000", 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013775267000000001 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.425037+0000", 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000210793 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.993 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1421 3.16 3:69839037:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.993 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:04.993 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4198360870000002, 2024-09-10T06:28:04.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022412087000000001, 2024-09-10T06:28:04.993 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.993 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.993 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.993 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1421 2024-09-10T06:28:04.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.993 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519058+0000", 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.354e-06 2024-09-10T06:28:04.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:04.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.522967+0000", 2024-09-10T06:28:04.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003909231 2024-09-10T06:28:04.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:04.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523003+0000", 2024-09-10T06:28:04.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5981e-05 2024-09-10T06:28:04.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:04.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523021+0000", 2024-09-10T06:28:04.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8362000000000001e-05 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523166+0000", 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014476699999999999 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523435+0000", 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026895800000000002 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523671+0000", 2024-09-10T06:28:04.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023608099999999999 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538600+0000", 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014929318 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541356+0000", 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002755216 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541420+0000", 2024-09-10T06:28:04.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4775000000000002e-05 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541466+0000", 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6044000000000002e-05 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1423 3.5 3:a38f4fc9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.538548+0000", 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4003424469999999, 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017201465999999999, 2024-09-10T06:28:04.998 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:04.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:04.999 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:04.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:04.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:04.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:04.999 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1423 2024-09-10T06:28:04.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.999 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:04.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:04.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:04.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538548+0000", 2024-09-10T06:28:04.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:04.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:04.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538548+0000", 2024-09-10T06:28:05.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538553+0000", 2024-09-10T06:28:05.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7249999999999997e-06 2024-09-10T06:28:05.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542507+0000", 2024-09-10T06:28:05.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039544719999999997 2024-09-10T06:28:05.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542538+0000", 2024-09-10T06:28:05.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1161000000000002e-05 2024-09-10T06:28:05.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542559+0000", 2024-09-10T06:28:05.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0953000000000001e-05 2024-09-10T06:28:05.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542674+0000", 2024-09-10T06:28:05.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114788 2024-09-10T06:28:05.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542804+0000", 2024-09-10T06:28:05.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013024600000000001 2024-09-10T06:28:05.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:05.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542912+0000", 2024-09-10T06:28:05.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107738 2024-09-10T06:28:05.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.550500+0000", 2024-09-10T06:28:05.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075878769999999998 2024-09-10T06:28:05.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.555620+0000", 2024-09-10T06:28:05.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051202009999999996 2024-09-10T06:28:05.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.555693+0000", 2024-09-10T06:28:05.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2719000000000006e-05 2024-09-10T06:28:05.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.555749+0000", 2024-09-10T06:28:05.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6586000000000003e-05 2024-09-10T06:28:05.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.004 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.004 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1439 3.3c 3:3e1c16d9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:05.004 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:05.004 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.2329651479999999, 2024-09-10T06:28:05.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020786124999999999, 2024-09-10T06:28:05.004 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.004 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1439 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:05.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705929+0000", 2024-09-10T06:28:05.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1620000000000001e-06 2024-09-10T06:28:05.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.709954+0000", 2024-09-10T06:28:05.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004024344 2024-09-10T06:28:05.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.709991+0000", 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6868e-05 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710009+0000", 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8422000000000001e-05 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710091+0000", 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1440000000000006e-05 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:05.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710105+0000", 2024-09-10T06:28:05.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4072e-05 2024-09-10T06:28:05.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.713970+0000", 2024-09-10T06:28:05.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038651699999999998 2024-09-10T06:28:05.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.714137+0000", 2024-09-10T06:28:05.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016704999999999999 2024-09-10T06:28:05.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:05.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.714352+0000", 2024-09-10T06:28:05.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021503099999999999 2024-09-10T06:28:05.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.721589+0000", 2024-09-10T06:28:05.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072370680000000001 2024-09-10T06:28:05.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726578+0000", 2024-09-10T06:28:05.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049887300000000002 2024-09-10T06:28:05.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726659+0000", 2024-09-10T06:28:05.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0972999999999999e-05 2024-09-10T06:28:05.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726711+0000", 2024-09-10T06:28:05.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2794999999999999e-05 2024-09-10T06:28:05.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.010 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.011 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1447 3.16 3:6989ebe4:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_192:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:05.011 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.789776+0000", 2024-09-10T06:28:05.011 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.1491145380000001, 2024-09-10T06:28:05.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015756097, 2024-09-10T06:28:05.011 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.011 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.011 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.011 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1447 2024-09-10T06:28:05.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.011 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.789776+0000", 2024-09-10T06:28:05.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.789776+0000", 2024-09-10T06:28:05.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.789778+0000", 2024-09-10T06:28:05.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3580000000000001e-06 2024-09-10T06:28:05.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.793507+0000", 2024-09-10T06:28:05.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037289570000000002 2024-09-10T06:28:05.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.793532+0000", 2024-09-10T06:28:05.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4932000000000001e-05 2024-09-10T06:28:05.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.793545+0000", 2024-09-10T06:28:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3185e-05 2024-09-10T06:28:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.793616+0000", 2024-09-10T06:28:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0604000000000004e-05 2024-09-10T06:28:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.793753+0000", 2024-09-10T06:28:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000137133 2024-09-10T06:28:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:05.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.793879+0000", 2024-09-10T06:28:05.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012596999999999999 2024-09-10T06:28:05.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.805059+0000", 2024-09-10T06:28:05.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011179493 2024-09-10T06:28:05.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.805240+0000", 2024-09-10T06:28:05.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018151800000000001 2024-09-10T06:28:05.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.805395+0000", 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155143 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.805532+0000", 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136804 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.016 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1454 3.5 3:a08a9c17:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:05.017 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:05.017 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0684874569999998, 2024-09-10T06:28:05.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018980882000000001, 2024-09-10T06:28:05.017 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.017 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.017 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.017 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1454 2024-09-10T06:28:05.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.017 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870407+0000", 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9090000000000002e-06 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874434+0000", 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040275700000000003 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874471+0000", 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6528e-05 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874496+0000", 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4751000000000001e-05 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874624+0000", 2024-09-10T06:28:05.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012825600000000001 2024-09-10T06:28:05.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874828+0000", 2024-09-10T06:28:05.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020377700000000001 2024-09-10T06:28:05.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:05.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.875010+0000", 2024-09-10T06:28:05.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018253200000000001 2024-09-10T06:28:05.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.883337+0000", 2024-09-10T06:28:05.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083265860000000004 2024-09-10T06:28:05.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889239+0000", 2024-09-10T06:28:05.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059024409999999996 2024-09-10T06:28:05.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889322+0000", 2024-09-10T06:28:05.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2216e-05 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889384+0000", 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2316000000000004e-05 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1463 3.c 3:32b18461:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.965515742, 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019470828999999999, 2024-09-10T06:28:05.022 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.023 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.023 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1463 2024-09-10T06:28:05.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.023 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:05.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973377+0000", 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5749999999999999e-06 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977213+0000", 2024-09-10T06:28:05.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038358789999999999 2024-09-10T06:28:05.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977239+0000", 2024-09-10T06:28:05.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5965999999999998e-05 2024-09-10T06:28:05.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977252+0000", 2024-09-10T06:28:05.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2472e-05 2024-09-10T06:28:05.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977406+0000", 2024-09-10T06:28:05.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000154809 2024-09-10T06:28:05.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977687+0000", 2024-09-10T06:28:05.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028013400000000003 2024-09-10T06:28:05.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:05.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977963+0000", 2024-09-10T06:28:05.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027642500000000001 2024-09-10T06:28:05.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.987026+0000", 2024-09-10T06:28:05.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090629430000000004 2024-09-10T06:28:05.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992655+0000", 2024-09-10T06:28:05.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056288320000000003 2024-09-10T06:28:05.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992765+0000", 2024-09-10T06:28:05.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110276 2024-09-10T06:28:05.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992846+0000", 2024-09-10T06:28:05.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0518000000000004e-05 2024-09-10T06:28:05.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.028 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.028 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1469 3.d e64/22 3:b3f21559:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_214:head v 64'1, mlcod=0'0)", 2024-09-10T06:28:05.028 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:05.028 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.8992107850000002, 2024-09-10T06:28:05.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01994638, 2024-09-10T06:28:05.028 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039683+0000", 2024-09-10T06:28:05.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0929999999999999e-06 2024-09-10T06:28:05.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044782+0000", 2024-09-10T06:28:05.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050988240000000001 2024-09-10T06:28:05.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044821+0000", 2024-09-10T06:28:05.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9764000000000001e-05 2024-09-10T06:28:05.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044839+0000", 2024-09-10T06:28:05.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7598999999999999e-05 2024-09-10T06:28:05.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044936+0000", 2024-09-10T06:28:05.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7388999999999999e-05 2024-09-10T06:28:05.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044962+0000", 2024-09-10T06:28:05.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5967999999999999e-05 2024-09-10T06:28:05.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059554+0000", 2024-09-10T06:28:05.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014592055 2024-09-10T06:28:05.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059626+0000", 2024-09-10T06:28:05.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1687999999999995e-05 2024-09-10T06:28:05.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.032 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1482 3.35 e64/22 3:ad9242de:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_227:head v 64'5, mlcod=63'3)", 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.164584+0000", 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7743061080000002, 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017917325000000001, 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164584+0000", 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164584+0000", 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164585+0000", 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8700000000000002e-07 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166303+0000", 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001718853 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166326+0000", 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2432000000000001e-05 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166337+0000", 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0706999999999999e-05 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166414+0000", 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7855999999999995e-05 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166443+0000", 2024-09-10T06:28:05.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8827999999999999e-05 2024-09-10T06:28:05.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182419+0000", 2024-09-10T06:28:05.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015975432000000001 2024-09-10T06:28:05.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182502+0000", 2024-09-10T06:28:05.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2929999999999994e-05 2024-09-10T06:28:05.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1503 3.1c 3:383b1d54:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_248:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.369146+0000", 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5697441169999999, 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016922006999999999, 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.037 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1503 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.369146+0000", 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.369146+0000", 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.369149+0000", 2024-09-10T06:28:05.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4339999999999999e-06 2024-09-10T06:28:05.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.372988+0000", 2024-09-10T06:28:05.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003839248 2024-09-10T06:28:05.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373020+0000", 2024-09-10T06:28:05.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2293999999999999e-05 2024-09-10T06:28:05.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373036+0000", 2024-09-10T06:28:05.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5875e-05 2024-09-10T06:28:05.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373142+0000", 2024-09-10T06:28:05.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105469 2024-09-10T06:28:05.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373265+0000", 2024-09-10T06:28:05.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012343799999999999 2024-09-10T06:28:05.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:05.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373374+0000", 2024-09-10T06:28:05.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108656 2024-09-10T06:28:05.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.383143+0000", 2024-09-10T06:28:05.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097691649999999998 2024-09-10T06:28:05.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.385934+0000", 2024-09-10T06:28:05.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027914419999999999 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.386009+0000", 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4734000000000006e-05 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.386068+0000", 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252000000000001e-05 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.043 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1668 3.3a 3:5e7d16ce:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:05.043 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.863936+0000", 2024-09-10T06:28:05.043 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.074954820000000005, 2024-09-10T06:28:05.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015703383000000001, 2024-09-10T06:28:05.043 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.043 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1668 2024-09-10T06:28:05.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.043 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.863936+0000", 2024-09-10T06:28:05.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.863936+0000", 2024-09-10T06:28:05.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.863938+0000", 2024-09-10T06:28:05.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1770000000000001e-06 2024-09-10T06:28:05.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.868521+0000", 2024-09-10T06:28:05.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004582956 2024-09-10T06:28:05.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.868544+0000", 2024-09-10T06:28:05.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3504999999999999e-05 2024-09-10T06:28:05.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.868559+0000", 2024-09-10T06:28:05.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5019e-05 2024-09-10T06:28:05.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.868633+0000", 2024-09-10T06:28:05.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4043999999999998e-05 2024-09-10T06:28:05.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.868771+0000", 2024-09-10T06:28:05.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013760899999999999 2024-09-10T06:28:05.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.868919+0000", 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000148355 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.875016+0000", 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006096209 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.879477+0000", 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044618879999999998 2024-09-10T06:28:05.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.879569+0000", 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1187999999999995e-05 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.879639+0000", 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0432999999999995e-05 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.048 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1671 3.37 e66/22 3:ed354b67:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_11:head v 66'6, mlcod=63'4)", 2024-09-10T06:28:05.049 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.902594+0000", 2024-09-10T06:28:05.049 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.036296532999999999, 2024-09-10T06:28:05.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016672485000000001, 2024-09-10T06:28:05.049 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.049 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902594+0000", 2024-09-10T06:28:05.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902594+0000", 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902596+0000", 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.232e-06 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906073+0000", 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034771849999999998 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906111+0000", 2024-09-10T06:28:05.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-10T06:28:05.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906134+0000", 2024-09-10T06:28:05.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3697999999999999e-05 2024-09-10T06:28:05.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906262+0000", 2024-09-10T06:28:05.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012822300000000001 2024-09-10T06:28:05.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906304+0000", 2024-09-10T06:28:05.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1106999999999998e-05 2024-09-10T06:28:05.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919150+0000", 2024-09-10T06:28:05.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012846781999999999 2024-09-10T06:28:05.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919266+0000", 2024-09-10T06:28:05.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011608 2024-09-10T06:28:05.052 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.053 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.053 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.053 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:05.054 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:28:05.055 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:05.052+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:05.081 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-10T06:28:05.146 INFO:tasks.workunit.client.0.smithi112.stdout:quota enabled for the user 0.668735795728029 2024-09-10T06:28:05.146 INFO:tasks.workunit.client.0.smithi112.stdout:adding file to bucket buck_2024_08_10_06_28_03: 100Mb. 2024-09-10T06:28:05.146 INFO:tasks.workunit.client.0.smithi112.stdout:upload file successful 2024-09-10T06:28:05.146 INFO:tasks.workunit.client.0.smithi112.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T06:28:05.146 INFO:tasks.workunit.client.0.smithi112.stdout:Test case: PASSED - user quota max size for 0.668735795728029 passed on 3 buckets 2024-09-10T06:28:05.146 INFO:tasks.workunit.client.0.smithi112.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T06:28:05.155 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:05.152+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:05.187 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:05.187 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:05.187 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:05.201 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:28:05.255 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:05.252+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:05.356 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:05.352+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:05.388 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:05.388 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:05.388 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:05.388 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:05.388 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:05.404 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:28:05.420 INFO:tasks.workunit.client.0.smithi112.stdout:user 0.668735795728029 deleted 2024-09-10T06:28:05.457 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:05.452+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:05.529 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:05.529 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:05.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:05.529 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:05.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.530 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:28:05.530 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:28:05.530 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 87.249036970000006, 2024-09-10T06:28:05.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016848367, 2024-09-10T06:28:05.530 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.530 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.530 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.530 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 46 2024-09-10T06:28:05.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.530 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280021+0000", 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0069999999999999e-06 2024-09-10T06:28:05.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280036+0000", 2024-09-10T06:28:05.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.483e-05 2024-09-10T06:28:05.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280070+0000", 2024-09-10T06:28:05.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4106000000000002e-05 2024-09-10T06:28:05.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280094+0000", 2024-09-10T06:28:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4037e-05 2024-09-10T06:28:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280246+0000", 2024-09-10T06:28:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000152199 2024-09-10T06:28:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:28:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280271+0000", 2024-09-10T06:28:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4581999999999999e-05 2024-09-10T06:28:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.289388+0000", 2024-09-10T06:28:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091175639999999999 2024-09-10T06:28:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.290774+0000", 2024-09-10T06:28:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013859860000000001 2024-09-10T06:28:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291069+0000", 2024-09-10T06:28:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000294534 2024-09-10T06:28:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295828+0000", 2024-09-10T06:28:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047595729999999996 2024-09-10T06:28:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296614+0000", 2024-09-10T06:28:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00078534700000000004 2024-09-10T06:28:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296759+0000", 2024-09-10T06:28:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014571300000000001 2024-09-10T06:28:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296865+0000", 2024-09-10T06:28:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105889 2024-09-10T06:28:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1357 3.1e e63/22 3:7863b3e2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_112:head v 63'1, mlcod=0'0)", 2024-09-10T06:28:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.960485+0000", 2024-09-10T06:28:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.5685693619999999, 2024-09-10T06:28:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017126476000000002, 2024-09-10T06:28:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.960485+0000", 2024-09-10T06:28:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.960485+0000", 2024-09-10T06:28:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.960487+0000", 2024-09-10T06:28:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6230000000000001e-06 2024-09-10T06:28:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966394+0000", 2024-09-10T06:28:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059067119999999997 2024-09-10T06:28:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966432+0000", 2024-09-10T06:28:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8133000000000002e-05 2024-09-10T06:28:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966453+0000", 2024-09-10T06:28:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0536000000000001e-05 2024-09-10T06:28:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966585+0000", 2024-09-10T06:28:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013260400000000001 2024-09-10T06:28:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966628+0000", 2024-09-10T06:28:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3273999999999999e-05 2024-09-10T06:28:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977524+0000", 2024-09-10T06:28:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010895207000000001 2024-09-10T06:28:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977611+0000", 2024-09-10T06:28:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7386999999999995e-05 2024-09-10T06:28:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1359 3.34 e63/22 3:2ece4e0b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_114:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.982175+0000", 2024-09-10T06:28:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.5468791309999999, 2024-09-10T06:28:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015763586999999999, 2024-09-10T06:28:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.982175+0000", 2024-09-10T06:28:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.982175+0000", 2024-09-10T06:28:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.982177+0000", 2024-09-10T06:28:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.616e-06 2024-09-10T06:28:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984716+0000", 2024-09-10T06:28:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00253885 2024-09-10T06:28:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984752+0000", 2024-09-10T06:28:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6060999999999999e-05 2024-09-10T06:28:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984773+0000", 2024-09-10T06:28:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0288e-05 2024-09-10T06:28:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984930+0000", 2024-09-10T06:28:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157446 2024-09-10T06:28:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.985015+0000", 2024-09-10T06:28:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4744e-05 2024-09-10T06:28:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.997786+0000", 2024-09-10T06:28:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012770826000000001 2024-09-10T06:28:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.997938+0000", 2024-09-10T06:28:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015275600000000001 2024-09-10T06:28:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1363 3.a 3:52044754:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.5058255479999998, 2024-09-10T06:28:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021475438999999999, 2024-09-10T06:28:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1363 2024-09-10T06:28:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023232+0000", 2024-09-10T06:28:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6500000000000002e-06 2024-09-10T06:28:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027903+0000", 2024-09-10T06:28:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046709569999999999 2024-09-10T06:28:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027944+0000", 2024-09-10T06:28:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1e-05 2024-09-10T06:28:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027963+0000", 2024-09-10T06:28:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9363000000000001e-05 2024-09-10T06:28:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028108+0000", 2024-09-10T06:28:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144306 2024-09-10T06:28:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028370+0000", 2024-09-10T06:28:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026210300000000002 2024-09-10T06:28:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028610+0000", 2024-09-10T06:28:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024058 2024-09-10T06:28:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.036472+0000", 2024-09-10T06:28:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078620170000000007 2024-09-10T06:28:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044306+0000", 2024-09-10T06:28:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078340070000000005 2024-09-10T06:28:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044496+0000", 2024-09-10T06:28:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189507 2024-09-10T06:28:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044704+0000", 2024-09-10T06:28:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207949 2024-09-10T06:28:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1364 3.36 3:6e968b0d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.4938340099999996, 2024-09-10T06:28:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022135317000000002, 2024-09-10T06:28:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1364 2024-09-10T06:28:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035266+0000", 2024-09-10T06:28:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6529999999999997e-05 2024-09-10T06:28:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039528+0000", 2024-09-10T06:28:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042612580000000004 2024-09-10T06:28:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039570+0000", 2024-09-10T06:28:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2481000000000002e-05 2024-09-10T06:28:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039594+0000", 2024-09-10T06:28:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3564999999999999e-05 2024-09-10T06:28:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039735+0000", 2024-09-10T06:28:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014147000000000001 2024-09-10T06:28:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039983+0000", 2024-09-10T06:28:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024765399999999998 2024-09-10T06:28:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.040216+0000", 2024-09-10T06:28:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023322999999999999 2024-09-10T06:28:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.049930+0000", 2024-09-10T06:28:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097135920000000001 2024-09-10T06:28:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057061+0000", 2024-09-10T06:28:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071309570000000003 2024-09-10T06:28:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057234+0000", 2024-09-10T06:28:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173308 2024-09-10T06:28:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057355+0000", 2024-09-10T06:28:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121272 2024-09-10T06:28:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1370 3.26 3:64e41eab:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.4190984780000004, 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022030800999999999, 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1370 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109960+0000", 2024-09-10T06:28:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3930000000000001e-06 2024-09-10T06:28:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114711+0000", 2024-09-10T06:28:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047511580000000001 2024-09-10T06:28:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114749+0000", 2024-09-10T06:28:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8417999999999997e-05 2024-09-10T06:28:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114768+0000", 2024-09-10T06:28:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8352e-05 2024-09-10T06:28:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114926+0000", 2024-09-10T06:28:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015819599999999999 2024-09-10T06:28:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115321+0000", 2024-09-10T06:28:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039507300000000002 2024-09-10T06:28:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115735+0000", 2024-09-10T06:28:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041369900000000001 2024-09-10T06:28:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.125212+0000", 2024-09-10T06:28:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094774109999999998 2024-09-10T06:28:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131666+0000", 2024-09-10T06:28:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064533730000000001 2024-09-10T06:28:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131847+0000", 2024-09-10T06:28:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018112400000000001 2024-09-10T06:28:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131986+0000", 2024-09-10T06:28:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013960399999999999 2024-09-10T06:28:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1371 3.2e e63/22 3:741ddced:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_126:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.4041380139999999, 2024-09-10T06:28:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440024000000001, 2024-09-10T06:28:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124919+0000", 2024-09-10T06:28:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-10T06:28:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130095+0000", 2024-09-10T06:28:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00517645 2024-09-10T06:28:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130125+0000", 2024-09-10T06:28:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9944e-05 2024-09-10T06:28:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130142+0000", 2024-09-10T06:28:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6515999999999999e-05 2024-09-10T06:28:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130252+0000", 2024-09-10T06:28:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110473 2024-09-10T06:28:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130297+0000", 2024-09-10T06:28:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5012999999999997e-05 2024-09-10T06:28:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149096+0000", 2024-09-10T06:28:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018799429999999999 2024-09-10T06:28:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149356+0000", 2024-09-10T06:28:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000259499 2024-09-10T06:28:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1372 3.36 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.3965813899999997, 2024-09-10T06:28:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026714723999999999, 2024-09-10T06:28:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1372 2024-09-10T06:28:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132475+0000", 2024-09-10T06:28:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.65e-06 2024-09-10T06:28:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137399+0000", 2024-09-10T06:28:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049236530000000001 2024-09-10T06:28:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137432+0000", 2024-09-10T06:28:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3050999999999999e-05 2024-09-10T06:28:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137449+0000", 2024-09-10T06:28:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6976000000000001e-05 2024-09-10T06:28:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137569+0000", 2024-09-10T06:28:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012016899999999999 2024-09-10T06:28:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137884+0000", 2024-09-10T06:28:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031455799999999999 2024-09-10T06:28:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138191+0000", 2024-09-10T06:28:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000307466 2024-09-10T06:28:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157760+0000", 2024-09-10T06:28:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019569128000000002 2024-09-10T06:28:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157954+0000", 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019375300000000001 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158118+0000", 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016390900000000001 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.159187+0000", 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010694109999999999 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1373 3.35 3:ac8a3287:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.3862483990000003, 2024-09-10T06:28:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023907627000000001, 2024-09-10T06:28:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1373 2024-09-10T06:28:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142810+0000", 2024-09-10T06:28:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6129999999999997e-06 2024-09-10T06:28:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.146972+0000", 2024-09-10T06:28:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041615180000000003 2024-09-10T06:28:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147029+0000", 2024-09-10T06:28:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7476000000000003e-05 2024-09-10T06:28:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147056+0000", 2024-09-10T06:28:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7021000000000001e-05 2024-09-10T06:28:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147249+0000", 2024-09-10T06:28:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019260999999999999 2024-09-10T06:28:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147702+0000", 2024-09-10T06:28:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045347999999999997 2024-09-10T06:28:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148113+0000", 2024-09-10T06:28:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041051899999999998 2024-09-10T06:28:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161583+0000", 2024-09-10T06:28:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013470278 2024-09-10T06:28:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166410+0000", 2024-09-10T06:28:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048270199999999996 2024-09-10T06:28:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166579+0000", 2024-09-10T06:28:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016839099999999999 2024-09-10T06:28:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166713+0000", 2024-09-10T06:28:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013470100000000001 2024-09-10T06:28:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1384 3.33 e63/22 3:cfe948dc:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_139:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.254532+0000", 2024-09-10T06:28:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.2745220890000004, 2024-09-10T06:28:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015554659, 2024-09-10T06:28:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.254532+0000", 2024-09-10T06:28:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.254532+0000", 2024-09-10T06:28:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.254535+0000", 2024-09-10T06:28:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9170000000000002e-06 2024-09-10T06:28:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260133+0000", 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055976969999999996 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260168+0000", 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5917000000000002e-05 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260186+0000", 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7538999999999999e-05 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260307+0000", 2024-09-10T06:28:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121382 2024-09-10T06:28:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260354+0000", 2024-09-10T06:28:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6507e-05 2024-09-10T06:28:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.269997+0000", 2024-09-10T06:28:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096426900000000006 2024-09-10T06:28:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.270087+0000", 2024-09-10T06:28:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.001e-05 2024-09-10T06:28:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1387 3.35 3:adfbe02e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.2471201120000002, 2024-09-10T06:28:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021055645000000001, 2024-09-10T06:28:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1387 2024-09-10T06:28:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281938+0000", 2024-09-10T06:28:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0659999999999997e-06 2024-09-10T06:28:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286048+0000", 2024-09-10T06:28:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041104560000000002 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286097+0000", 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8715999999999999e-05 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286126+0000", 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9308000000000001e-05 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286279+0000", 2024-09-10T06:28:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015285400000000001 2024-09-10T06:28:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286520+0000", 2024-09-10T06:28:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024062000000000001 2024-09-10T06:28:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286772+0000", 2024-09-10T06:28:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025170599999999998 2024-09-10T06:28:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.301846+0000", 2024-09-10T06:28:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015074363 2024-09-10T06:28:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302698+0000", 2024-09-10T06:28:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000852179 2024-09-10T06:28:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302864+0000", 2024-09-10T06:28:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016568900000000001 2024-09-10T06:28:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302990+0000", 2024-09-10T06:28:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012568799999999999 2024-09-10T06:28:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1397 3.3f e63/41 3:ff95a35c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_152:head v 63'5, mlcod=63'3)", 2024-09-10T06:28:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.385363+0000", 2024-09-10T06:28:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.1436908700000004, 2024-09-10T06:28:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017789975999999999, 2024-09-10T06:28:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.385363+0000", 2024-09-10T06:28:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.385363+0000", 2024-09-10T06:28:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.385366+0000", 2024-09-10T06:28:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7329999999999999e-06 2024-09-10T06:28:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390582+0000", 2024-09-10T06:28:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052160740000000002 2024-09-10T06:28:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390618+0000", 2024-09-10T06:28:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5818000000000002e-05 2024-09-10T06:28:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390637+0000", 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9096000000000001e-05 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390769+0000", 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013195700000000001 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390810+0000", 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0734e-05 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403047+0000", 2024-09-10T06:28:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012237534 2024-09-10T06:28:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403153+0000", 2024-09-10T06:28:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010603 2024-09-10T06:28:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.598 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1398 3.2c 3:350a23e7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.1340767930000002, 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032248536000000001, 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1398 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394981+0000", 2024-09-10T06:28:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7359999999999999e-06 2024-09-10T06:28:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402145+0000", 2024-09-10T06:28:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071643540000000004 2024-09-10T06:28:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402182+0000", 2024-09-10T06:28:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6318e-05 2024-09-10T06:28:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402200+0000", 2024-09-10T06:28:05.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8439000000000001e-05 2024-09-10T06:28:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402391+0000", 2024-09-10T06:28:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190917 2024-09-10T06:28:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402649+0000", 2024-09-10T06:28:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025817599999999999 2024-09-10T06:28:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402908+0000", 2024-09-10T06:28:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025864300000000002 2024-09-10T06:28:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424973+0000", 2024-09-10T06:28:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022065004999999999 2024-09-10T06:28:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.426990+0000", 2024-09-10T06:28:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020169340000000002 2024-09-10T06:28:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427129+0000", 2024-09-10T06:28:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139436 2024-09-10T06:28:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427226+0000", 2024-09-10T06:28:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6577999999999996e-05 2024-09-10T06:28:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1413 3.1e e63/22 3:79ea7bee:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_158:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.445858+0000", 2024-09-10T06:28:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.0831962099999997, 2024-09-10T06:28:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015385619, 2024-09-10T06:28:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.445858+0000", 2024-09-10T06:28:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.445858+0000", 2024-09-10T06:28:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.445860+0000", 2024-09-10T06:28:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.706e-06 2024-09-10T06:28:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450317+0000", 2024-09-10T06:28:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044569060000000001 2024-09-10T06:28:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450355+0000", 2024-09-10T06:28:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7293999999999999e-05 2024-09-10T06:28:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450372+0000", 2024-09-10T06:28:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7492000000000001e-05 2024-09-10T06:28:05.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450488+0000", 2024-09-10T06:28:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011576199999999999 2024-09-10T06:28:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450533+0000", 2024-09-10T06:28:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5046999999999997e-05 2024-09-10T06:28:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.461119+0000", 2024-09-10T06:28:05.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010585796 2024-09-10T06:28:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.461243+0000", 2024-09-10T06:28:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000124616 2024-09-10T06:28:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1415 3.2c 3:34c14757:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:05.609 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.0662297949999999, 2024-09-10T06:28:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029598765999999999, 2024-09-10T06:28:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1415 2024-09-10T06:28:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.610 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462828+0000", 2024-09-10T06:28:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1999999999999996e-06 2024-09-10T06:28:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.466974+0000", 2024-09-10T06:28:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041452989999999999 2024-09-10T06:28:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467026+0000", 2024-09-10T06:28:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2416000000000001e-05 2024-09-10T06:28:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467055+0000", 2024-09-10T06:28:05.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9081000000000002e-05 2024-09-10T06:28:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467207+0000", 2024-09-10T06:28:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015225699999999999 2024-09-10T06:28:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467468+0000", 2024-09-10T06:28:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026093500000000001 2024-09-10T06:28:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467755+0000", 2024-09-10T06:28:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000287101 2024-09-10T06:28:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477312+0000", 2024-09-10T06:28:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095560300000000001 2024-09-10T06:28:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492136+0000", 2024-09-10T06:28:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014824936 2024-09-10T06:28:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492301+0000", 2024-09-10T06:28:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016411600000000001 2024-09-10T06:28:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492423+0000", 2024-09-10T06:28:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122395 2024-09-10T06:28:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1416 3.10 3:084717f7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.0571955470000001, 2024-09-10T06:28:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021526931999999999, 2024-09-10T06:28:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1416 2024-09-10T06:28:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471863+0000", 2024-09-10T06:28:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-10T06:28:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477370+0000", 2024-09-10T06:28:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055071549999999997 2024-09-10T06:28:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477402+0000", 2024-09-10T06:28:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1498000000000002e-05 2024-09-10T06:28:05.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477423+0000", 2024-09-10T06:28:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1098e-05 2024-09-10T06:28:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477559+0000", 2024-09-10T06:28:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136627 2024-09-10T06:28:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477936+0000", 2024-09-10T06:28:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037718099999999998 2024-09-10T06:28:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.478271+0000", 2024-09-10T06:28:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033427799999999997 2024-09-10T06:28:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.490997+0000", 2024-09-10T06:28:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012725858 2024-09-10T06:28:05.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493126+0000", 2024-09-10T06:28:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002129499 2024-09-10T06:28:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493263+0000", 2024-09-10T06:28:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013682500000000001 2024-09-10T06:28:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493385+0000", 2024-09-10T06:28:05.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122414 2024-09-10T06:28:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1466 3.a 3:52715822:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.004814+0000", 2024-09-10T06:28:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.524240217, 2024-09-10T06:28:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01610396, 2024-09-10T06:28:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1466 2024-09-10T06:28:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.004814+0000", 2024-09-10T06:28:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.004814+0000", 2024-09-10T06:28:05.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.004817+0000", 2024-09-10T06:28:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.993e-06 2024-09-10T06:28:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.009941+0000", 2024-09-10T06:28:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051237699999999997 2024-09-10T06:28:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.009977+0000", 2024-09-10T06:28:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6021e-05 2024-09-10T06:28:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010002+0000", 2024-09-10T06:28:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5114999999999999e-05 2024-09-10T06:28:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010104+0000", 2024-09-10T06:28:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010259699999999999 2024-09-10T06:28:05.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010243+0000", 2024-09-10T06:28:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000138858 2024-09-10T06:28:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010361+0000", 2024-09-10T06:28:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117751 2024-09-10T06:28:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.019657+0000", 2024-09-10T06:28:05.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092965689999999993 2024-09-10T06:28:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.020775+0000", 2024-09-10T06:28:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001117266 2024-09-10T06:28:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.020853+0000", 2024-09-10T06:28:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-10T06:28:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.020918+0000", 2024-09-10T06:28:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4243000000000001e-05 2024-09-10T06:28:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1482 3.35 3:ad9242de:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.368889813, 2024-09-10T06:28:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022710764000000001, 2024-09-10T06:28:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.629 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1482 2024-09-10T06:28:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160166+0000", 2024-09-10T06:28:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1069999999999999e-06 2024-09-10T06:28:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163977+0000", 2024-09-10T06:28:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003810843 2024-09-10T06:28:05.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163995+0000", 2024-09-10T06:28:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7648000000000001e-05 2024-09-10T06:28:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164010+0000", 2024-09-10T06:28:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4754e-05 2024-09-10T06:28:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164094+0000", 2024-09-10T06:28:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4473000000000003e-05 2024-09-10T06:28:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164281+0000", 2024-09-10T06:28:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018659699999999999 2024-09-10T06:28:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164458+0000", 2024-09-10T06:28:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017758300000000001 2024-09-10T06:28:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.179923+0000", 2024-09-10T06:28:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015465269 2024-09-10T06:28:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182736+0000", 2024-09-10T06:28:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028130579999999998 2024-09-10T06:28:05.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182816+0000", 2024-09-10T06:28:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9976999999999997e-05 2024-09-10T06:28:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182875+0000", 2024-09-10T06:28:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8455000000000002e-05 2024-09-10T06:28:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1664 3.a 3:52f62ee7:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.70486457400000002, 2024-09-10T06:28:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020253482999999999, 2024-09-10T06:28:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1664 2024-09-10T06:28:05.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824193+0000", 2024-09-10T06:28:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6059999999999999e-06 2024-09-10T06:28:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829549+0000", 2024-09-10T06:28:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053562189999999997 2024-09-10T06:28:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829584+0000", 2024-09-10T06:28:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4925000000000002e-05 2024-09-10T06:28:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829602+0000", 2024-09-10T06:28:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8034999999999999e-05 2024-09-10T06:28:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829716+0000", 2024-09-10T06:28:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113522 2024-09-10T06:28:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829903+0000", 2024-09-10T06:28:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187443 2024-09-10T06:28:05.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.830162+0000", 2024-09-10T06:28:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025917900000000001 2024-09-10T06:28:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.843459+0000", 2024-09-10T06:28:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01329675 2024-09-10T06:28:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844211+0000", 2024-09-10T06:28:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075213700000000005 2024-09-10T06:28:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844286+0000", 2024-09-10T06:28:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4453e-05 2024-09-10T06:28:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844443+0000", 2024-09-10T06:28:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157214 2024-09-10T06:28:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1666 3.35 3:ad92e5c9:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.844780+0000", 2024-09-10T06:28:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.68427386000000001, 2024-09-10T06:28:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016844930000000001, 2024-09-10T06:28:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1666 2024-09-10T06:28:05.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844780+0000", 2024-09-10T06:28:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844780+0000", 2024-09-10T06:28:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:05.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844782+0000", 2024-09-10T06:28:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5740000000000001e-06 2024-09-10T06:28:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848542+0000", 2024-09-10T06:28:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037601620000000001 2024-09-10T06:28:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:05.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848564+0000", 2024-09-10T06:28:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2405999999999999e-05 2024-09-10T06:28:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848574+0000", 2024-09-10T06:28:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6989999999999998e-06 2024-09-10T06:28:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848714+0000", 2024-09-10T06:28:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014004100000000001 2024-09-10T06:28:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848964+0000", 2024-09-10T06:28:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024983600000000003 2024-09-10T06:28:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.849193+0000", 2024-09-10T06:28:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000228693 2024-09-10T06:28:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.861129+0000", 2024-09-10T06:28:05.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01193658 2024-09-10T06:28:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.861509+0000", 2024-09-10T06:28:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037939899999999999 2024-09-10T06:28:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.861574+0000", 2024-09-10T06:28:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5471999999999999e-05 2024-09-10T06:28:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:05.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.861625+0000", 2024-09-10T06:28:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1068e-05 2024-09-10T06:28:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:05.648 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:05.648 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:05.649 INFO:tasks.workunit.client.0.smithi112.stdout:Bucket Created: buck_2024_08_10_06_28_05 2024-09-10T06:28:05.650 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:28:05.650 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:05.648+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:05.698 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:28:05.750 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:05.748+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:05.822 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:05.822 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:05.822 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:05.823 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:05.826 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:28:05.826 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:28:05.837 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:28:05.842 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:28:05.843 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:28:05.851 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:05.848+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:05.859 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:28:05.859 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:28:05.875 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:28:05.875 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:28:05.892 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:28:05.892 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:28:05.909 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:28:05.909 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:28:05.926 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:28:05.926 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:28:05.946 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:28:05.946 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:28:05.951 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:05.948+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:05.961 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:05.975 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:28:06.053 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:06.048+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:06.099 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:06.099 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:06.115 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:28:06.162 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:06.160+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:06.235 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:06.235 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:06.252 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:28:06.294 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:06.292+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:06.355 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:06.351+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:06.405 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:06.405 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:06.422 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:28:06.456 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:06.456+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:06.557 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:06.551+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:06.596 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:06.597 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:06.608 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:28:06.701 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:06.695+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:06.759 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:06.756+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:06.768 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:06.769 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:06.782 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:28:06.860 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:06.860+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:06.946 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:06.946 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:06.958 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:28:06.961 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:06.955+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:07.062 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:07.060+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:07.079 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:07.079 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:07.092 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:28:07.106 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T06:28:07.186 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:07.183+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:07.212 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:07.213 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:07.226 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:28:07.264 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:07.260+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:07.364 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:07.359+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:07.375 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:07.375 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:07.388 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:28:07.465 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:07.464+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:07.495 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-10T06:28:07.559 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:07.559 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:07.566 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:07.563+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:07.571 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:28:07.667 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:07.663+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:07.734 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:07.734 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:07.749 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:28:07.768 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:07.768+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:07.870 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:07.868+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:07.908 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:07.908 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:07.921 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:28:07.965 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:28:07.971 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:07.968+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:08.031 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:08.032 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:08.045 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:28:08.072 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:08.067+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:08.101 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:28:08.102 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:28:08.118 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:28:08.119 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:28:08.136 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:28:08.136 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:28:08.153 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:28:08.154 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:28:08.173 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:08.172+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:08.173 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:28:08.174 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:28:08.178 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:08.178 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:08.178 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:08.179 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:08.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:28:08.194 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:28:08.194 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:28:08.212 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:28:08.212 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:28:08.232 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:28:08.232 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:28:08.280 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:08.280+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:08.361 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:08.361 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:08.361 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:08.361 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:08.361 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:08.375 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:28:08.375 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:08.371+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:08.476 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:08.475+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:08.546 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:08.546 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:08.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:08.546 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:08.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.547 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1351 3.1d e63/41 3:b8f5f32e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_106:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:08.547 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.891127+0000", 2024-09-10T06:28:08.547 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6548735400000005, 2024-09-10T06:28:08.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016439619999999999, 2024-09-10T06:28:08.547 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.547 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.547 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.547 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.891127+0000", 2024-09-10T06:28:08.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.891127+0000", 2024-09-10T06:28:08.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.891129+0000", 2024-09-10T06:28:08.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7089999999999998e-06 2024-09-10T06:28:08.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895096+0000", 2024-09-10T06:28:08.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039671309999999996 2024-09-10T06:28:08.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895128+0000", 2024-09-10T06:28:08.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1664e-05 2024-09-10T06:28:08.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895158+0000", 2024-09-10T06:28:08.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0168e-05 2024-09-10T06:28:08.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895311+0000", 2024-09-10T06:28:08.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015315899999999999 2024-09-10T06:28:08.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895380+0000", 2024-09-10T06:28:08.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8559000000000005e-05 2024-09-10T06:28:08.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.907398+0000", 2024-09-10T06:28:08.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012017798 2024-09-10T06:28:08.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.907566+0000", 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016843199999999999 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1352 3.1c e63/22 3:3adb07ef:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_107:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.904909+0000", 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6410913849999993, 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016373502000000002, 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.551 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.552 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.904909+0000", 2024-09-10T06:28:08.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.904909+0000", 2024-09-10T06:28:08.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.904911+0000", 2024-09-10T06:28:08.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.916e-06 2024-09-10T06:28:08.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908660+0000", 2024-09-10T06:28:08.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037489490000000001 2024-09-10T06:28:08.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908697+0000", 2024-09-10T06:28:08.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7761e-05 2024-09-10T06:28:08.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908724+0000", 2024-09-10T06:28:08.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6361000000000001e-05 2024-09-10T06:28:08.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908878+0000", 2024-09-10T06:28:08.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000153936 2024-09-10T06:28:08.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908921+0000", 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3000999999999997e-05 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.921179+0000", 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012257901999999999 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.921282+0000", 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103676 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.556 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1359 3.34 3:2ece4e0b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:08.556 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:08.556 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5687702209999994, 2024-09-10T06:28:08.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021482449000000001, 2024-09-10T06:28:08.556 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.556 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.556 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:08.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:08.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:08.556 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1359 2024-09-10T06:28:08.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.556 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977234+0000", 2024-09-10T06:28:08.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7969999999999998e-06 2024-09-10T06:28:08.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981211+0000", 2024-09-10T06:28:08.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039768329999999999 2024-09-10T06:28:08.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981247+0000", 2024-09-10T06:28:08.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6457e-05 2024-09-10T06:28:08.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981274+0000", 2024-09-10T06:28:08.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6917999999999999e-05 2024-09-10T06:28:08.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981446+0000", 2024-09-10T06:28:08.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171831 2024-09-10T06:28:08.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981719+0000", 2024-09-10T06:28:08.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027282800000000002 2024-09-10T06:28:08.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:08.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981975+0000", 2024-09-10T06:28:08.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000256782 2024-09-10T06:28:08.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:08.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.991319+0000", 2024-09-10T06:28:08.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093433820000000008 2024-09-10T06:28:08.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:08.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998330+0000", 2024-09-10T06:28:08.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070108549999999999 2024-09-10T06:28:08.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998549+0000", 2024-09-10T06:28:08.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021944400000000001 2024-09-10T06:28:08.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998712+0000", 2024-09-10T06:28:08.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016332200000000001 2024-09-10T06:28:08.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.561 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1367 3.34 3:2f444f7f:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.4756885180000001, 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020931903000000002, 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1367 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:08.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:08.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070316+0000", 2024-09-10T06:28:08.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9029999999999997e-06 2024-09-10T06:28:08.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074255+0000", 2024-09-10T06:28:08.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039391679999999998 2024-09-10T06:28:08.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074291+0000", 2024-09-10T06:28:08.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5970000000000003e-05 2024-09-10T06:28:08.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074309+0000", 2024-09-10T06:28:08.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8399000000000001e-05 2024-09-10T06:28:08.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074436+0000", 2024-09-10T06:28:08.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012683099999999999 2024-09-10T06:28:08.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074686+0000", 2024-09-10T06:28:08.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024971699999999999 2024-09-10T06:28:08.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:08.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074907+0000", 2024-09-10T06:28:08.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022124800000000001 2024-09-10T06:28:08.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:08.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.084332+0000", 2024-09-10T06:28:08.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094253449999999999 2024-09-10T06:28:08.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:08.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.090954+0000", 2024-09-10T06:28:08.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066213649999999997 2024-09-10T06:28:08.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.091123+0000", 2024-09-10T06:28:08.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169216 2024-09-10T06:28:08.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.091244+0000", 2024-09-10T06:28:08.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120741 2024-09-10T06:28:08.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.567 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.568 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1375 3.1 e63/22 3:82031a0e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_130:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:08.568 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:08.568 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.382632482, 2024-09-10T06:28:08.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018270307999999999, 2024-09-10T06:28:08.568 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.568 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.568 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.568 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:08.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:08.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163370+0000", 2024-09-10T06:28:08.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8289999999999999e-06 2024-09-10T06:28:08.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167665+0000", 2024-09-10T06:28:08.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042940499999999998 2024-09-10T06:28:08.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167698+0000", 2024-09-10T06:28:08.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3484e-05 2024-09-10T06:28:08.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167714+0000", 2024-09-10T06:28:08.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-09-10T06:28:08.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167847+0000", 2024-09-10T06:28:08.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013299300000000001 2024-09-10T06:28:08.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167890+0000", 2024-09-10T06:28:08.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2434000000000001e-05 2024-09-10T06:28:08.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181507+0000", 2024-09-10T06:28:08.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013616872 2024-09-10T06:28:08.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181638+0000", 2024-09-10T06:28:08.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013123099999999999 2024-09-10T06:28:08.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.572 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.572 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1380 3.3 3:c3afb574:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:08.572 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:08.572 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.3345783470000008, 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027193374999999999, 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1380 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:08.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211426+0000", 2024-09-10T06:28:08.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3599999999999998e-06 2024-09-10T06:28:08.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215383+0000", 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039567450000000002 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215417+0000", 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4051000000000003e-05 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215435+0000", 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8459000000000001e-05 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215626+0000", 2024-09-10T06:28:08.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019018299999999999 2024-09-10T06:28:08.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215991+0000", 2024-09-10T06:28:08.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036566099999999998 2024-09-10T06:28:08.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:08.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.216360+0000", 2024-09-10T06:28:08.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000368995 2024-09-10T06:28:08.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:08.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.226152+0000", 2024-09-10T06:28:08.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097914319999999992 2024-09-10T06:28:08.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:08.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238448+0000", 2024-09-10T06:28:08.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012295834 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238538+0000", 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0539999999999997e-05 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238615+0000", 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7114999999999996e-05 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1383 3.3 3:c2c34097:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.3032366329999991, 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020753975000000001, 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1383 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:08.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:08.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242767+0000", 2024-09-10T06:28:08.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6169999999999998e-06 2024-09-10T06:28:08.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246704+0000", 2024-09-10T06:28:08.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003936485 2024-09-10T06:28:08.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246733+0000", 2024-09-10T06:28:08.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9819999999999999e-05 2024-09-10T06:28:08.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246748+0000", 2024-09-10T06:28:08.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4334e-05 2024-09-10T06:28:08.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246902+0000", 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015468 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.247286+0000", 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038366799999999999 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.247687+0000", 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000401252 2024-09-10T06:28:08.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:08.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.257963+0000", 2024-09-10T06:28:08.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010275584000000001 2024-09-10T06:28:08.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:08.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263287+0000", 2024-09-10T06:28:08.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053238499999999998 2024-09-10T06:28:08.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263412+0000", 2024-09-10T06:28:08.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012516200000000001 2024-09-10T06:28:08.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263517+0000", 2024-09-10T06:28:08.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105523 2024-09-10T06:28:08.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.585 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.585 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1391 3.1c e63/22 3:3a76b5ac:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_146:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:08.585 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:08.585 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.218930619, 2024-09-10T06:28:08.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026554852, 2024-09-10T06:28:08.585 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.585 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.585 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.586 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:08.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:08.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327072+0000", 2024-09-10T06:28:08.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6970000000000002e-06 2024-09-10T06:28:08.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330874+0000", 2024-09-10T06:28:08.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038016590000000002 2024-09-10T06:28:08.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330928+0000", 2024-09-10T06:28:08.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3729e-05 2024-09-10T06:28:08.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330956+0000", 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8694999999999999e-05 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.331147+0000", 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190841 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.331216+0000", 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8948999999999993e-05 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.353521+0000", 2024-09-10T06:28:08.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022304781999999999 2024-09-10T06:28:08.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.353624+0000", 2024-09-10T06:28:08.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010349999999999999 2024-09-10T06:28:08.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.589 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.589 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1392 3.14 3:2b02aaa8:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.2139518299999992, 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024102582000000001, 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1392 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332052+0000", 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8999999999999999e-06 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.335987+0000", 2024-09-10T06:28:08.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039349800000000002 2024-09-10T06:28:08.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336020+0000", 2024-09-10T06:28:08.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2968e-05 2024-09-10T06:28:08.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336040+0000", 2024-09-10T06:28:08.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9956e-05 2024-09-10T06:28:08.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336155+0000", 2024-09-10T06:28:08.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115275 2024-09-10T06:28:08.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336404+0000", 2024-09-10T06:28:08.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024874599999999999 2024-09-10T06:28:08.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:08.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336626+0000", 2024-09-10T06:28:08.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022168200000000001 2024-09-10T06:28:08.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.355854+0000", 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019228624999999999 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.355890+0000", 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5901000000000001e-05 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.356040+0000", 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014919600000000001 2024-09-10T06:28:08.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.356151+0000", 2024-09-10T06:28:08.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111353 2024-09-10T06:28:08.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.595 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.595 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1398 3.2c e63/22 3:350a23e7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_153:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:08.595 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:08.595 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.1428588439999992, 2024-09-10T06:28:08.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021444181, 2024-09-10T06:28:08.595 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.596 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.596 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.596 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:08.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:08.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403144+0000", 2024-09-10T06:28:08.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.734e-06 2024-09-10T06:28:08.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406432+0000", 2024-09-10T06:28:08.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032884500000000001 2024-09-10T06:28:08.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406473+0000", 2024-09-10T06:28:08.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0834000000000002e-05 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406492+0000", 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8868999999999998e-05 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406632+0000", 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140183 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406698+0000", 2024-09-10T06:28:08.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5913000000000004e-05 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424483+0000", 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017785108000000001 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424585+0000", 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010208999999999999 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1415 3.2c e63/22 3:34c14757:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_160:head v 63'5, mlcod=63'3)", 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.0780083860000005, 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023773743999999999, 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467994+0000", 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471376+0000", 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033818099999999999 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471426+0000", 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9846999999999999e-05 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471452+0000", 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6327999999999999e-05 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471621+0000", 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016928200000000001 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.472399+0000", 2024-09-10T06:28:08.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000777171 2024-09-10T06:28:08.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.491634+0000", 2024-09-10T06:28:08.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019235070999999999 2024-09-10T06:28:08.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.491766+0000", 2024-09-10T06:28:08.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013176799999999999 2024-09-10T06:28:08.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.603 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1417 3.14 3:29141a67:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:08.604 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:08.604 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.0650743889999994, 2024-09-10T06:28:08.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026932543, 2024-09-10T06:28:08.604 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.604 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:08.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:08.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:08.604 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1417 2024-09-10T06:28:08.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:08.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:08.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480929+0000", 2024-09-10T06:28:08.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-10T06:28:08.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486391+0000", 2024-09-10T06:28:08.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054618599999999998 2024-09-10T06:28:08.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486425+0000", 2024-09-10T06:28:08.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4031e-05 2024-09-10T06:28:08.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486443+0000", 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7878999999999999e-05 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486581+0000", 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013773400000000001 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486836+0000", 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025529900000000001 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:08.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.487064+0000", 2024-09-10T06:28:08.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000228438 2024-09-10T06:28:08.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:08.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.505216+0000", 2024-09-10T06:28:08.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018152130999999998 2024-09-10T06:28:08.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:08.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507597+0000", 2024-09-10T06:28:08.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023807260000000001 2024-09-10T06:28:08.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507690+0000", 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2305999999999993e-05 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507858+0000", 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016879199999999999 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1418 3.24 e63/22 3:26ca0de9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_163:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.493351+0000", 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.0526496289999994, 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01657111, 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493351+0000", 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493351+0000", 2024-09-10T06:28:08.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493353+0000", 2024-09-10T06:28:08.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-10T06:28:08.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499691+0000", 2024-09-10T06:28:08.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063376029999999998 2024-09-10T06:28:08.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499724+0000", 2024-09-10T06:28:08.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3124999999999999e-05 2024-09-10T06:28:08.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499741+0000", 2024-09-10T06:28:08.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6852000000000001e-05 2024-09-10T06:28:08.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499853+0000", 2024-09-10T06:28:08.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011278899999999999 2024-09-10T06:28:08.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499897+0000", 2024-09-10T06:28:08.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3789999999999999e-05 2024-09-10T06:28:08.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.509788+0000", 2024-09-10T06:28:08.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098906770000000005 2024-09-10T06:28:08.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.509922+0000", 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013369099999999999 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1424 3.14 3:28df499c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.9985026660000003, 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017872099999999998, 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:08.614 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:08.615 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:08.615 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1424 2024-09-10T06:28:08.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.615 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:08.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:08.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547500+0000", 2024-09-10T06:28:08.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.999e-06 2024-09-10T06:28:08.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551376+0000", 2024-09-10T06:28:08.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038754010000000001 2024-09-10T06:28:08.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551401+0000", 2024-09-10T06:28:08.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5476000000000001e-05 2024-09-10T06:28:08.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551413+0000", 2024-09-10T06:28:08.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2082999999999999e-05 2024-09-10T06:28:08.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551486+0000", 2024-09-10T06:28:08.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2793999999999995e-05 2024-09-10T06:28:08.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551610+0000", 2024-09-10T06:28:08.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123993 2024-09-10T06:28:08.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:08.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551718+0000", 2024-09-10T06:28:08.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107357 2024-09-10T06:28:08.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:08.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.559898+0000", 2024-09-10T06:28:08.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081805860000000001 2024-09-10T06:28:08.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:08.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565204+0000", 2024-09-10T06:28:08.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053053589999999999 2024-09-10T06:28:08.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565296+0000", 2024-09-10T06:28:08.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2291000000000001e-05 2024-09-10T06:28:08.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565370+0000", 2024-09-10T06:28:08.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3761000000000001e-05 2024-09-10T06:28:08.620 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.620 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.620 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.620 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1429 3.1a 3:5acc80b6:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:08.620 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:08.620 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.9486376080000003, 2024-09-10T06:28:08.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020448872999999999, 2024-09-10T06:28:08.620 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.620 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.620 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.620 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1429 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597365+0000", 2024-09-10T06:28:08.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2759999999999999e-06 2024-09-10T06:28:08.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601186+0000", 2024-09-10T06:28:08.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038214410000000001 2024-09-10T06:28:08.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601212+0000", 2024-09-10T06:28:08.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5522999999999999e-05 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601222+0000", 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0584999999999999e-05 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601314+0000", 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1484999999999996e-05 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601494+0000", 2024-09-10T06:28:08.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018006899999999999 2024-09-10T06:28:08.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:08.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601655+0000", 2024-09-10T06:28:08.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016119999999999999 2024-09-10T06:28:08.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:08.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.607352+0000", 2024-09-10T06:28:08.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056970500000000004 2024-09-10T06:28:08.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:08.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617735+0000", 2024-09-10T06:28:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010382769 2024-09-10T06:28:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617780+0000", 2024-09-10T06:28:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5145999999999998e-05 2024-09-10T06:28:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617811+0000", 2024-09-10T06:28:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1328999999999998e-05 2024-09-10T06:28:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1433 3.1a 3:59ee0094:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8990236239999998, 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024407437000000001, 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1433 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.626 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:08.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:08.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646979+0000", 2024-09-10T06:28:08.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.074e-06 2024-09-10T06:28:08.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.650998+0000", 2024-09-10T06:28:08.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040192470000000001 2024-09-10T06:28:08.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651031+0000", 2024-09-10T06:28:08.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2821000000000003e-05 2024-09-10T06:28:08.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651050+0000", 2024-09-10T06:28:08.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9556e-05 2024-09-10T06:28:08.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651150+0000", 2024-09-10T06:28:08.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9689e-05 2024-09-10T06:28:08.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651325+0000", 2024-09-10T06:28:08.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017529199999999999 2024-09-10T06:28:08.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:08.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651496+0000", 2024-09-10T06:28:08.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000170531 2024-09-10T06:28:08.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:08.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.659894+0000", 2024-09-10T06:28:08.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083978049999999995 2024-09-10T06:28:08.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:08.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671085+0000", 2024-09-10T06:28:08.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011190989 2024-09-10T06:28:08.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671261+0000", 2024-09-10T06:28:08.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017616800000000001 2024-09-10T06:28:08.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671384+0000", 2024-09-10T06:28:08.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012326500000000001 2024-09-10T06:28:08.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.631 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.632 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1470 3.34 3:2e4989bb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:08.632 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:08.632 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.5018316980000002, 2024-09-10T06:28:08.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019466533000000001, 2024-09-10T06:28:08.632 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.632 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.632 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:08.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:08.632 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:08.632 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1470 2024-09-10T06:28:08.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.632 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:08.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:08.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044172+0000", 2024-09-10T06:28:08.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5939999999999998e-06 2024-09-10T06:28:08.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048101+0000", 2024-09-10T06:28:08.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003929325 2024-09-10T06:28:08.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048135+0000", 2024-09-10T06:28:08.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3856000000000002e-05 2024-09-10T06:28:08.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048150+0000", 2024-09-10T06:28:08.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.523e-05 2024-09-10T06:28:08.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048258+0000", 2024-09-10T06:28:08.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108025 2024-09-10T06:28:08.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048437+0000", 2024-09-10T06:28:08.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017811199999999999 2024-09-10T06:28:08.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:08.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048550+0000", 2024-09-10T06:28:08.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113181 2024-09-10T06:28:08.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:08.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063173+0000", 2024-09-10T06:28:08.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014623565 2024-09-10T06:28:08.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:08.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063361+0000", 2024-09-10T06:28:08.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018807599999999999 2024-09-10T06:28:08.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063499+0000", 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013745000000000001 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063635+0000", 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136119 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1472 3.34 3:2e34818b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:08.637 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.062471+0000", 2024-09-10T06:28:08.638 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4835294690000005, 2024-09-10T06:28:08.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016070911, 2024-09-10T06:28:08.638 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.638 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.638 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.638 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:08.638 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:08.638 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:08.638 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1472 2024-09-10T06:28:08.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.638 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.062471+0000", 2024-09-10T06:28:08.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.062471+0000", 2024-09-10T06:28:08.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.062473+0000", 2024-09-10T06:28:08.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0190000000000001e-06 2024-09-10T06:28:08.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066284+0000", 2024-09-10T06:28:08.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038111659999999999 2024-09-10T06:28:08.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066302+0000", 2024-09-10T06:28:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8216e-05 2024-09-10T06:28:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066311+0000", 2024-09-10T06:28:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7460000000000006e-06 2024-09-10T06:28:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066370+0000", 2024-09-10T06:28:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9292000000000001e-05 2024-09-10T06:28:08.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066526+0000", 2024-09-10T06:28:08.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155783 2024-09-10T06:28:08.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:08.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066639+0000", 2024-09-10T06:28:08.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113212 2024-09-10T06:28:08.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:08.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078013+0000", 2024-09-10T06:28:08.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011373822 2024-09-10T06:28:08.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:08.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078408+0000", 2024-09-10T06:28:08.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000395086 2024-09-10T06:28:08.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078486+0000", 2024-09-10T06:28:08.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8176999999999994e-05 2024-09-10T06:28:08.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078542+0000", 2024-09-10T06:28:08.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5392000000000001e-05 2024-09-10T06:28:08.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.645 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.645 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1674 3.e e66/22 3:71dde5c5:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_14:head v 66'6, mlcod=64'4)", 2024-09-10T06:28:08.645 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.936559+0000", 2024-09-10T06:28:08.645 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.6094415020000001, 2024-09-10T06:28:08.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020541475999999999, 2024-09-10T06:28:08.645 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.645 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936559+0000", 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936559+0000", 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936562+0000", 2024-09-10T06:28:08.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9000000000000002e-06 2024-09-10T06:28:08.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939051+0000", 2024-09-10T06:28:08.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024898899999999998 2024-09-10T06:28:08.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939094+0000", 2024-09-10T06:28:08.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2874999999999999e-05 2024-09-10T06:28:08.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939115+0000", 2024-09-10T06:28:08.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0213000000000001e-05 2024-09-10T06:28:08.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939294+0000", 2024-09-10T06:28:08.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017977299999999999 2024-09-10T06:28:08.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939359+0000", 2024-09-10T06:28:08.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4596000000000003e-05 2024-09-10T06:28:08.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.956969+0000", 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017610223000000001 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957100+0000", 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131006 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.649 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1677 3.34 3:2e18bed5:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:08.650 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.968824+0000", 2024-09-10T06:28:08.650 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.5771758810000001, 2024-09-10T06:28:08.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017983664999999999, 2024-09-10T06:28:08.650 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:08.650 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:08.650 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:08.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:08.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:08.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:08.650 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1677 2024-09-10T06:28:08.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.650 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:08.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.968824+0000", 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.968824+0000", 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.968827+0000", 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7489999999999999e-06 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:08.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974158+0000", 2024-09-10T06:28:08.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005330942 2024-09-10T06:28:08.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:08.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974178+0000", 2024-09-10T06:28:08.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0143e-05 2024-09-10T06:28:08.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:08.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974187+0000", 2024-09-10T06:28:08.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0250000000000008e-06 2024-09-10T06:28:08.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974240+0000", 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3341000000000003e-05 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974350+0000", 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109874 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974445+0000", 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4730999999999998e-05 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.980411+0000", 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059658100000000002 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.986640+0000", 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062289110000000002 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.986733+0000", 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3646000000000004e-05 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:08.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:08.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.986808+0000", 2024-09-10T06:28:08.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4493000000000007e-05 2024-09-10T06:28:08.655 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.655 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.655 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.655 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:08.655 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:08.655 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:08.656 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:28:08.657 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:08.656+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:08.757 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:08.756+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:08.828 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:08.829 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:08.829 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:08.845 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:28:08.888 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:08.888+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:08.959 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:08.955+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:09.007 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:09.007 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:09.007 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:09.007 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:09.007 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:09.021 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:28:09.060 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:09.055+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:09.144 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:09.144 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:09.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:09.144 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:09.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1354 3.5 3:a2100466:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.223836030999999, 2024-09-10T06:28:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022320934000000001, 2024-09-10T06:28:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1354 2024-09-10T06:28:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:09.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:09.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919975+0000", 2024-09-10T06:28:09.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4369999999999999e-06 2024-09-10T06:28:09.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926675+0000", 2024-09-10T06:28:09.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066993529999999999 2024-09-10T06:28:09.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926705+0000", 2024-09-10T06:28:09.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0391000000000001e-05 2024-09-10T06:28:09.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926722+0000", 2024-09-10T06:28:09.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7159e-05 2024-09-10T06:28:09.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926840+0000", 2024-09-10T06:28:09.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117459 2024-09-10T06:28:09.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.927092+0000", 2024-09-10T06:28:09.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025180899999999997 2024-09-10T06:28:09.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:09.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.927353+0000", 2024-09-10T06:28:09.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026148499999999999 2024-09-10T06:28:09.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.940116+0000", 2024-09-10T06:28:09.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01276245 2024-09-10T06:28:09.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.941993+0000", 2024-09-10T06:28:09.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001877079 2024-09-10T06:28:09.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.942164+0000", 2024-09-10T06:28:09.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171378 2024-09-10T06:28:09.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.942293+0000", 2024-09-10T06:28:09.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012893400000000001 2024-09-10T06:28:09.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.151 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.151 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1355 3.16 3:6be207af:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.151 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:09.151 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.213086430000001, 2024-09-10T06:28:09.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023027044, 2024-09-10T06:28:09.151 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.151 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.152 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.152 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1355 2024-09-10T06:28:09.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.152 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:09.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:09.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930724+0000", 2024-09-10T06:28:09.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5100000000000001e-06 2024-09-10T06:28:09.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937234+0000", 2024-09-10T06:28:09.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065097760000000001 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937259+0000", 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4915000000000001e-05 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937275+0000", 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6659000000000001e-05 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937437+0000", 2024-09-10T06:28:09.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161259 2024-09-10T06:28:09.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937718+0000", 2024-09-10T06:28:09.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028092699999999999 2024-09-10T06:28:09.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:09.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937955+0000", 2024-09-10T06:28:09.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023767300000000001 2024-09-10T06:28:09.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.952527+0000", 2024-09-10T06:28:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014571850000000001 2024-09-10T06:28:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953577+0000", 2024-09-10T06:28:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001049601 2024-09-10T06:28:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953671+0000", 2024-09-10T06:28:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4580000000000006e-05 2024-09-10T06:28:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953749+0000", 2024-09-10T06:28:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7293999999999996e-05 2024-09-10T06:28:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1369 3.22 3:45ffca16:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.049032928999999, 2024-09-10T06:28:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020833028999999999, 2024-09-10T06:28:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.157 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.158 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1369 2024-09-10T06:28:09.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.158 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:09.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:09.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094779+0000", 2024-09-10T06:28:09.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1099999999999996e-06 2024-09-10T06:28:09.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100674+0000", 2024-09-10T06:28:09.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058944740000000002 2024-09-10T06:28:09.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100714+0000", 2024-09-10T06:28:09.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0527e-05 2024-09-10T06:28:09.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100732+0000", 2024-09-10T06:28:09.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8034999999999999e-05 2024-09-10T06:28:09.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100871+0000", 2024-09-10T06:28:09.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013849399999999999 2024-09-10T06:28:09.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.101123+0000", 2024-09-10T06:28:09.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025259000000000002 2024-09-10T06:28:09.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:09.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.101372+0000", 2024-09-10T06:28:09.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024846599999999998 2024-09-10T06:28:09.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.111593+0000", 2024-09-10T06:28:09.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010221165000000001 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115305+0000", 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037123249999999998 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115476+0000", 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017085200000000001 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115608+0000", 2024-09-10T06:28:09.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131991 2024-09-10T06:28:09.163 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.163 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.163 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.163 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1372 3.36 e63/22 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:09.163 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:09.163 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.005410423000001, 2024-09-10T06:28:09.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018914395000000001, 2024-09-10T06:28:09.163 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.163 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.163 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.163 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:09.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:09.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138401+0000", 2024-09-10T06:28:09.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3859999999999999e-06 2024-09-10T06:28:09.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142599+0000", 2024-09-10T06:28:09.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041982190000000004 2024-09-10T06:28:09.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142649+0000", 2024-09-10T06:28:09.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9477000000000001e-05 2024-09-10T06:28:09.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142674+0000", 2024-09-10T06:28:09.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5558000000000002e-05 2024-09-10T06:28:09.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142832+0000", 2024-09-10T06:28:09.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158159 2024-09-10T06:28:09.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142879+0000", 2024-09-10T06:28:09.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6650000000000002e-05 2024-09-10T06:28:09.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157209+0000", 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014330209999999999 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157312+0000", 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102736 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1373 3.35 e63/22 3:ac8a3287:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_128:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.148374+0000", 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.995433706, 2024-09-10T06:28:09.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017663458999999999, 2024-09-10T06:28:09.168 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.168 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.168 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.168 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148374+0000", 2024-09-10T06:28:09.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148374+0000", 2024-09-10T06:28:09.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148378+0000", 2024-09-10T06:28:09.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4869999999999998e-06 2024-09-10T06:28:09.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153210+0000", 2024-09-10T06:28:09.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048319130000000002 2024-09-10T06:28:09.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153243+0000", 2024-09-10T06:28:09.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3794000000000002e-05 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153266+0000", 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2841999999999999e-05 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153394+0000", 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012804099999999999 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153432+0000", 2024-09-10T06:28:09.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7194000000000003e-05 2024-09-10T06:28:09.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.165933+0000", 2024-09-10T06:28:09.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012501583 2024-09-10T06:28:09.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166038+0000", 2024-09-10T06:28:09.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010460500000000001 2024-09-10T06:28:09.171 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.171 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.171 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.172 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1374 3.2f 3:f735f5eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.172 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:09.172 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.9903861240000005, 2024-09-10T06:28:09.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028841426, 2024-09-10T06:28:09.172 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.172 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.172 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.172 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.172 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.172 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.172 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1374 2024-09-10T06:28:09.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.172 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:09.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:09.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153425+0000", 2024-09-10T06:28:09.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8030000000000001e-06 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157050+0000", 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036249070000000001 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157081+0000", 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1525000000000001e-05 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157103+0000", 2024-09-10T06:28:09.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1599000000000001e-05 2024-09-10T06:28:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157253+0000", 2024-09-10T06:28:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150266 2024-09-10T06:28:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157545+0000", 2024-09-10T06:28:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029204399999999998 2024-09-10T06:28:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:09.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157898+0000", 2024-09-10T06:28:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035326200000000002 2024-09-10T06:28:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181021+0000", 2024-09-10T06:28:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023123008 2024-09-10T06:28:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181894+0000", 2024-09-10T06:28:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00087308700000000004 2024-09-10T06:28:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.182128+0000", 2024-09-10T06:28:09.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000233811 2024-09-10T06:28:09.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.182263+0000", 2024-09-10T06:28:09.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013511400000000001 2024-09-10T06:28:09.177 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.177 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.177 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.177 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1391 3.1c 3:3a76b5ac:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.177 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.8216491179999998, 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032016492000000001, 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1391 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:09.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:09.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322162+0000", 2024-09-10T06:28:09.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.523e-06 2024-09-10T06:28:09.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326140+0000", 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039776000000000004 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326177+0000", 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6878000000000002e-05 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326195+0000", 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8576e-05 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326334+0000", 2024-09-10T06:28:09.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013836600000000001 2024-09-10T06:28:09.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326608+0000", 2024-09-10T06:28:09.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000274586 2024-09-10T06:28:09.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:09.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326847+0000", 2024-09-10T06:28:09.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023812 2024-09-10T06:28:09.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.338793+0000", 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011946141 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354011+0000", 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015217856 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354100+0000", 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9497e-05 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354175+0000", 2024-09-10T06:28:09.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5349e-05 2024-09-10T06:28:09.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.183 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.183 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1399 3.38 e63/22 3:1dcd0b88:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_154:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:09.183 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:09.183 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.7380780110000007, 2024-09-10T06:28:09.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019306528999999999, 2024-09-10T06:28:09.183 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.183 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405734+0000", 2024-09-10T06:28:09.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2529999999999998e-06 2024-09-10T06:28:09.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410725+0000", 2024-09-10T06:28:09.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049902849999999997 2024-09-10T06:28:09.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410776+0000", 2024-09-10T06:28:09.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1762999999999999e-05 2024-09-10T06:28:09.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410805+0000", 2024-09-10T06:28:09.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8274999999999999e-05 2024-09-10T06:28:09.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410984+0000", 2024-09-10T06:28:09.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017977800000000001 2024-09-10T06:28:09.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.411050+0000", 2024-09-10T06:28:09.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6115e-05 2024-09-10T06:28:09.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424826+0000", 2024-09-10T06:28:09.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013775267000000001 2024-09-10T06:28:09.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.425037+0000", 2024-09-10T06:28:09.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000210793 2024-09-10T06:28:09.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.188 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.188 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1421 3.16 3:69839037:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.188 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:09.188 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6247536260000004, 2024-09-10T06:28:09.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022412087000000001, 2024-09-10T06:28:09.188 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.188 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.188 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.189 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1421 2024-09-10T06:28:09.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.189 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:09.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:09.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519058+0000", 2024-09-10T06:28:09.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.354e-06 2024-09-10T06:28:09.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.522967+0000", 2024-09-10T06:28:09.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003909231 2024-09-10T06:28:09.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523003+0000", 2024-09-10T06:28:09.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5981e-05 2024-09-10T06:28:09.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523021+0000", 2024-09-10T06:28:09.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8362000000000001e-05 2024-09-10T06:28:09.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523166+0000", 2024-09-10T06:28:09.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014476699999999999 2024-09-10T06:28:09.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523435+0000", 2024-09-10T06:28:09.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026895800000000002 2024-09-10T06:28:09.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:09.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523671+0000", 2024-09-10T06:28:09.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023608099999999999 2024-09-10T06:28:09.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538600+0000", 2024-09-10T06:28:09.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014929318 2024-09-10T06:28:09.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541356+0000", 2024-09-10T06:28:09.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002755216 2024-09-10T06:28:09.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541420+0000", 2024-09-10T06:28:09.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4775000000000002e-05 2024-09-10T06:28:09.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541466+0000", 2024-09-10T06:28:09.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6044000000000002e-05 2024-09-10T06:28:09.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.194 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.194 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1423 3.5 3:a38f4fc9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.194 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.538548+0000", 2024-09-10T06:28:09.194 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6052599860000001, 2024-09-10T06:28:09.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017201465999999999, 2024-09-10T06:28:09.194 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.194 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.194 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.195 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1423 2024-09-10T06:28:09.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.195 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538548+0000", 2024-09-10T06:28:09.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538548+0000", 2024-09-10T06:28:09.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538553+0000", 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7249999999999997e-06 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542507+0000", 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039544719999999997 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542538+0000", 2024-09-10T06:28:09.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1161000000000002e-05 2024-09-10T06:28:09.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542559+0000", 2024-09-10T06:28:09.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0953000000000001e-05 2024-09-10T06:28:09.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542674+0000", 2024-09-10T06:28:09.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114788 2024-09-10T06:28:09.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542804+0000", 2024-09-10T06:28:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013024600000000001 2024-09-10T06:28:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542912+0000", 2024-09-10T06:28:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107738 2024-09-10T06:28:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.550500+0000", 2024-09-10T06:28:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075878769999999998 2024-09-10T06:28:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.555620+0000", 2024-09-10T06:28:09.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051202009999999996 2024-09-10T06:28:09.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.555693+0000", 2024-09-10T06:28:09.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2719000000000006e-05 2024-09-10T06:28:09.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.555749+0000", 2024-09-10T06:28:09.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6586000000000003e-05 2024-09-10T06:28:09.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.200 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.200 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1439 3.3c 3:3e1c16d9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:09.200 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:09.200 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.4378826870000001, 2024-09-10T06:28:09.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020786124999999999, 2024-09-10T06:28:09.200 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.200 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.200 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1439 2024-09-10T06:28:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705929+0000", 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1620000000000001e-06 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.709954+0000", 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004024344 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.709991+0000", 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6868e-05 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710009+0000", 2024-09-10T06:28:09.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8422000000000001e-05 2024-09-10T06:28:09.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710091+0000", 2024-09-10T06:28:09.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1440000000000006e-05 2024-09-10T06:28:09.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:09.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710105+0000", 2024-09-10T06:28:09.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4072e-05 2024-09-10T06:28:09.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.713970+0000", 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038651699999999998 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.714137+0000", 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016704999999999999 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.714352+0000", 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021503099999999999 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.721589+0000", 2024-09-10T06:28:09.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072370680000000001 2024-09-10T06:28:09.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726578+0000", 2024-09-10T06:28:09.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049887300000000002 2024-09-10T06:28:09.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726659+0000", 2024-09-10T06:28:09.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0972999999999999e-05 2024-09-10T06:28:09.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726711+0000", 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2794999999999999e-05 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1454 3.5 3:a08a9c17:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.273404996, 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018980882000000001, 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.206 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.207 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.207 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.207 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1454 2024-09-10T06:28:09.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.207 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:09.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:09.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870407+0000", 2024-09-10T06:28:09.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9090000000000002e-06 2024-09-10T06:28:09.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874434+0000", 2024-09-10T06:28:09.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040275700000000003 2024-09-10T06:28:09.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874471+0000", 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6528e-05 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874496+0000", 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4751000000000001e-05 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874624+0000", 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012825600000000001 2024-09-10T06:28:09.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874828+0000", 2024-09-10T06:28:09.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020377700000000001 2024-09-10T06:28:09.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:09.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.875010+0000", 2024-09-10T06:28:09.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018253200000000001 2024-09-10T06:28:09.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.883337+0000", 2024-09-10T06:28:09.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083265860000000004 2024-09-10T06:28:09.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889239+0000", 2024-09-10T06:28:09.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059024409999999996 2024-09-10T06:28:09.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889322+0000", 2024-09-10T06:28:09.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2216e-05 2024-09-10T06:28:09.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889384+0000", 2024-09-10T06:28:09.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2316000000000004e-05 2024-09-10T06:28:09.212 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.212 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.212 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.212 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1463 3.c 3:32b18461:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:09.212 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:09.212 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.1704332809999993, 2024-09-10T06:28:09.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019470828999999999, 2024-09-10T06:28:09.212 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.212 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.212 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.213 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.213 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1463 2024-09-10T06:28:09.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.213 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:09.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973377+0000", 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5749999999999999e-06 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977213+0000", 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038358789999999999 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977239+0000", 2024-09-10T06:28:09.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5965999999999998e-05 2024-09-10T06:28:09.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977252+0000", 2024-09-10T06:28:09.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2472e-05 2024-09-10T06:28:09.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977406+0000", 2024-09-10T06:28:09.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000154809 2024-09-10T06:28:09.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977687+0000", 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028013400000000003 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977963+0000", 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027642500000000001 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.987026+0000", 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090629430000000004 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992655+0000", 2024-09-10T06:28:09.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056288320000000003 2024-09-10T06:28:09.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992765+0000", 2024-09-10T06:28:09.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110276 2024-09-10T06:28:09.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992846+0000", 2024-09-10T06:28:09.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0518000000000004e-05 2024-09-10T06:28:09.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.218 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.218 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.218 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1469 3.d e64/22 3:b3f21559:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_214:head v 64'1, mlcod=0'0)", 2024-09-10T06:28:09.218 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:09.218 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.1041283239999995, 2024-09-10T06:28:09.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01994638, 2024-09-10T06:28:09.218 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.218 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.218 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039683+0000", 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0929999999999999e-06 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044782+0000", 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050988240000000001 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044821+0000", 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9764000000000001e-05 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044839+0000", 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7598999999999999e-05 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044936+0000", 2024-09-10T06:28:09.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7388999999999999e-05 2024-09-10T06:28:09.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044962+0000", 2024-09-10T06:28:09.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5967999999999999e-05 2024-09-10T06:28:09.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059554+0000", 2024-09-10T06:28:09.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014592055 2024-09-10T06:28:09.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059626+0000", 2024-09-10T06:28:09.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1687999999999995e-05 2024-09-10T06:28:09.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.222 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.222 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1482 3.35 e64/22 3:ad9242de:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_227:head v 64'5, mlcod=63'3)", 2024-09-10T06:28:09.222 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.164584+0000", 2024-09-10T06:28:09.222 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.9792236469999995, 2024-09-10T06:28:09.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017917325000000001, 2024-09-10T06:28:09.222 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.222 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164584+0000", 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164584+0000", 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164585+0000", 2024-09-10T06:28:09.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8700000000000002e-07 2024-09-10T06:28:09.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166303+0000", 2024-09-10T06:28:09.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001718853 2024-09-10T06:28:09.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166326+0000", 2024-09-10T06:28:09.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2432000000000001e-05 2024-09-10T06:28:09.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166337+0000", 2024-09-10T06:28:09.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0706999999999999e-05 2024-09-10T06:28:09.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166414+0000", 2024-09-10T06:28:09.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7855999999999995e-05 2024-09-10T06:28:09.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166443+0000", 2024-09-10T06:28:09.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8827999999999999e-05 2024-09-10T06:28:09.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182419+0000", 2024-09-10T06:28:09.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015975432000000001 2024-09-10T06:28:09.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182502+0000", 2024-09-10T06:28:09.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2929999999999994e-05 2024-09-10T06:28:09.226 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.226 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.226 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.226 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1503 3.1c 3:383b1d54:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_248:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:09.227 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.369146+0000", 2024-09-10T06:28:09.227 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.7746616559999993, 2024-09-10T06:28:09.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016922006999999999, 2024-09-10T06:28:09.227 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.227 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.227 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.227 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1503 2024-09-10T06:28:09.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.227 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.369146+0000", 2024-09-10T06:28:09.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.369146+0000", 2024-09-10T06:28:09.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.369149+0000", 2024-09-10T06:28:09.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4339999999999999e-06 2024-09-10T06:28:09.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.372988+0000", 2024-09-10T06:28:09.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003839248 2024-09-10T06:28:09.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373020+0000", 2024-09-10T06:28:09.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2293999999999999e-05 2024-09-10T06:28:09.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373036+0000", 2024-09-10T06:28:09.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5875e-05 2024-09-10T06:28:09.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373142+0000", 2024-09-10T06:28:09.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105469 2024-09-10T06:28:09.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373265+0000", 2024-09-10T06:28:09.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012343799999999999 2024-09-10T06:28:09.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:09.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373374+0000", 2024-09-10T06:28:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108656 2024-09-10T06:28:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.383143+0000", 2024-09-10T06:28:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097691649999999998 2024-09-10T06:28:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.385934+0000", 2024-09-10T06:28:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027914419999999999 2024-09-10T06:28:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.386009+0000", 2024-09-10T06:28:09.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4734000000000006e-05 2024-09-10T06:28:09.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.386068+0000", 2024-09-10T06:28:09.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252000000000001e-05 2024-09-10T06:28:09.232 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.232 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.232 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.232 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1671 3.37 e66/22 3:ed354b67:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_11:head v 66'6, mlcod=63'4)", 2024-09-10T06:28:09.233 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.902594+0000", 2024-09-10T06:28:09.233 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.241214072, 2024-09-10T06:28:09.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016672485000000001, 2024-09-10T06:28:09.233 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.233 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.233 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.233 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902594+0000", 2024-09-10T06:28:09.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902594+0000", 2024-09-10T06:28:09.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902596+0000", 2024-09-10T06:28:09.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.232e-06 2024-09-10T06:28:09.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906073+0000", 2024-09-10T06:28:09.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034771849999999998 2024-09-10T06:28:09.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906111+0000", 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906134+0000", 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3697999999999999e-05 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906262+0000", 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012822300000000001 2024-09-10T06:28:09.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906304+0000", 2024-09-10T06:28:09.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1106999999999998e-05 2024-09-10T06:28:09.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919150+0000", 2024-09-10T06:28:09.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012846781999999999 2024-09-10T06:28:09.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919266+0000", 2024-09-10T06:28:09.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011608 2024-09-10T06:28:09.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.237 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.237 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1672 3.c 3:33a5f042:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:09.237 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:09.237 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2364549450000002, 2024-09-10T06:28:09.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019487879999999999, 2024-09-10T06:28:09.237 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.237 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.237 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.238 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1672 2024-09-10T06:28:09.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.238 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:09.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:09.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907355+0000", 2024-09-10T06:28:09.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.43e-06 2024-09-10T06:28:09.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.911999+0000", 2024-09-10T06:28:09.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046435979999999996 2024-09-10T06:28:09.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912047+0000", 2024-09-10T06:28:09.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8204000000000001e-05 2024-09-10T06:28:09.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912078+0000", 2024-09-10T06:28:09.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0998999999999999e-05 2024-09-10T06:28:09.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912197+0000", 2024-09-10T06:28:09.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119165 2024-09-10T06:28:09.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912368+0000", 2024-09-10T06:28:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000170111 2024-09-10T06:28:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912532+0000", 2024-09-10T06:28:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016403000000000001 2024-09-10T06:28:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.920064+0000", 2024-09-10T06:28:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007531973 2024-09-10T06:28:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926719+0000", 2024-09-10T06:28:09.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066550840000000003 2024-09-10T06:28:09.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926786+0000", 2024-09-10T06:28:09.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7267999999999994e-05 2024-09-10T06:28:09.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926841+0000", 2024-09-10T06:28:09.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5018000000000001e-05 2024-09-10T06:28:09.242 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.242 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.243 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.243 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1676 3.3c 3:3fe08b90:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:09.243 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.956218+0000", 2024-09-10T06:28:09.243 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.1875896499999996, 2024-09-10T06:28:09.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017380520999999999, 2024-09-10T06:28:09.243 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.243 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.243 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.243 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1676 2024-09-10T06:28:09.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.244 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.956218+0000", 2024-09-10T06:28:09.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.956218+0000", 2024-09-10T06:28:09.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.956223+0000", 2024-09-10T06:28:09.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6970000000000001e-06 2024-09-10T06:28:09.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.960875+0000", 2024-09-10T06:28:09.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046524269999999998 2024-09-10T06:28:09.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.960911+0000", 2024-09-10T06:28:09.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5689000000000003e-05 2024-09-10T06:28:09.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.960930+0000", 2024-09-10T06:28:09.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9110000000000002e-05 2024-09-10T06:28:09.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.961057+0000", 2024-09-10T06:28:09.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001272 2024-09-10T06:28:09.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.961319+0000", 2024-09-10T06:28:09.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000261041 2024-09-10T06:28:09.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:09.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.961552+0000", 2024-09-10T06:28:09.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000233129 2024-09-10T06:28:09.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.970290+0000", 2024-09-10T06:28:09.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087384939999999994 2024-09-10T06:28:09.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.973498+0000", 2024-09-10T06:28:09.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032079489999999999 2024-09-10T06:28:09.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.973545+0000", 2024-09-10T06:28:09.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6971000000000001e-05 2024-09-10T06:28:09.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.973599+0000", 2024-09-10T06:28:09.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3813999999999997e-05 2024-09-10T06:28:09.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.249 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.249 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.249 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1679 3.22 3:44bf1ad9:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:09.249 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.991719+0000", 2024-09-10T06:28:09.249 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.15208873, 2024-09-10T06:28:09.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017288846, 2024-09-10T06:28:09.249 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1679 2024-09-10T06:28:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.991719+0000", 2024-09-10T06:28:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.991719+0000", 2024-09-10T06:28:09.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.991721+0000", 2024-09-10T06:28:09.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1019999999999999e-06 2024-09-10T06:28:09.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.995487+0000", 2024-09-10T06:28:09.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003765975 2024-09-10T06:28:09.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.995506+0000", 2024-09-10T06:28:09.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8966000000000001e-05 2024-09-10T06:28:09.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.995516+0000", 2024-09-10T06:28:09.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6509999999999996e-06 2024-09-10T06:28:09.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.995574+0000", 2024-09-10T06:28:09.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8486999999999998e-05 2024-09-10T06:28:09.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.995698+0000", 2024-09-10T06:28:09.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012344799999999999 2024-09-10T06:28:09.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:09.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.995796+0000", 2024-09-10T06:28:09.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8422000000000001e-05 2024-09-10T06:28:09.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.001740+0000", 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059432629999999998 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.008886+0000", 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071467320000000003 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.008956+0000", 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9636999999999998e-05 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.009008+0000", 2024-09-10T06:28:09.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2163000000000002e-05 2024-09-10T06:28:09.255 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.255 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.255 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.255 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.255 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.255 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:09.257 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:28:09.257 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:09.256+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:09.357 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:09.355+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:09.429 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:09.429 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:09.430 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:09.430 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:09.444 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:28:09.492 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:09.492+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:09.521 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T06:28:09.566 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:09.563+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:09.574 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:09.574 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:09.574 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:09.589 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:28:09.660 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:09.655+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:09.758 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:09.758 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:09.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:09.758 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:09.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.758 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:28:09.758 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:28:09.758 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 91.477152910000001, 2024-09-10T06:28:09.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016848367, 2024-09-10T06:28:09.758 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.758 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.758 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.759 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 46 2024-09-10T06:28:09.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.759 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:28:09.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:28:09.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280021+0000", 2024-09-10T06:28:09.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0069999999999999e-06 2024-09-10T06:28:09.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280036+0000", 2024-09-10T06:28:09.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.483e-05 2024-09-10T06:28:09.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280070+0000", 2024-09-10T06:28:09.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4106000000000002e-05 2024-09-10T06:28:09.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280094+0000", 2024-09-10T06:28:09.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4037e-05 2024-09-10T06:28:09.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280246+0000", 2024-09-10T06:28:09.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000152199 2024-09-10T06:28:09.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280271+0000", 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4581999999999999e-05 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.289388+0000", 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091175639999999999 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.290774+0000", 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013859860000000001 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:09.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291069+0000", 2024-09-10T06:28:09.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000294534 2024-09-10T06:28:09.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295828+0000", 2024-09-10T06:28:09.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047595729999999996 2024-09-10T06:28:09.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296614+0000", 2024-09-10T06:28:09.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00078534700000000004 2024-09-10T06:28:09.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296759+0000", 2024-09-10T06:28:09.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014571300000000001 2024-09-10T06:28:09.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296865+0000", 2024-09-10T06:28:09.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105889 2024-09-10T06:28:09.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.764 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1357 3.1e e63/22 3:7863b3e2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_112:head v 63'1, mlcod=0'0)", 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.960485+0000", 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.796685302, 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017126476000000002, 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.960485+0000", 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.960485+0000", 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.960487+0000", 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6230000000000001e-06 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966394+0000", 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059067119999999997 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966432+0000", 2024-09-10T06:28:09.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8133000000000002e-05 2024-09-10T06:28:09.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966453+0000", 2024-09-10T06:28:09.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0536000000000001e-05 2024-09-10T06:28:09.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966585+0000", 2024-09-10T06:28:09.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013260400000000001 2024-09-10T06:28:09.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966628+0000", 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3273999999999999e-05 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977524+0000", 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010895207000000001 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977611+0000", 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7386999999999995e-05 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.768 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.769 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1359 3.34 e63/22 3:2ece4e0b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_114:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:09.769 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.982175+0000", 2024-09-10T06:28:09.769 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.774995070999999, 2024-09-10T06:28:09.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015763586999999999, 2024-09-10T06:28:09.769 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.769 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.769 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.769 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.982175+0000", 2024-09-10T06:28:09.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.982175+0000", 2024-09-10T06:28:09.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.982177+0000", 2024-09-10T06:28:09.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.616e-06 2024-09-10T06:28:09.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984716+0000", 2024-09-10T06:28:09.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00253885 2024-09-10T06:28:09.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984752+0000", 2024-09-10T06:28:09.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6060999999999999e-05 2024-09-10T06:28:09.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984773+0000", 2024-09-10T06:28:09.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0288e-05 2024-09-10T06:28:09.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984930+0000", 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157446 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.985015+0000", 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4744e-05 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.997786+0000", 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012770826000000001 2024-09-10T06:28:09.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.997938+0000", 2024-09-10T06:28:09.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015275600000000001 2024-09-10T06:28:09.773 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.773 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.773 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.773 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1363 3.a 3:52044754:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.773 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:09.773 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.733941487999999, 2024-09-10T06:28:09.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021475438999999999, 2024-09-10T06:28:09.773 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1363 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023232+0000", 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6500000000000002e-06 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027903+0000", 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046709569999999999 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027944+0000", 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1e-05 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027963+0000", 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9363000000000001e-05 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028108+0000", 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144306 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028370+0000", 2024-09-10T06:28:09.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026210300000000002 2024-09-10T06:28:09.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:09.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028610+0000", 2024-09-10T06:28:09.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024058 2024-09-10T06:28:09.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.036472+0000", 2024-09-10T06:28:09.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078620170000000007 2024-09-10T06:28:09.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044306+0000", 2024-09-10T06:28:09.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078340070000000005 2024-09-10T06:28:09.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044496+0000", 2024-09-10T06:28:09.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189507 2024-09-10T06:28:09.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044704+0000", 2024-09-10T06:28:09.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207949 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1364 3.36 3:6e968b0d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.721949949999999, 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022135317000000002, 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.779 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1364 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035266+0000", 2024-09-10T06:28:09.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6529999999999997e-05 2024-09-10T06:28:09.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039528+0000", 2024-09-10T06:28:09.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042612580000000004 2024-09-10T06:28:09.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039570+0000", 2024-09-10T06:28:09.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2481000000000002e-05 2024-09-10T06:28:09.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039594+0000", 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3564999999999999e-05 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039735+0000", 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014147000000000001 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039983+0000", 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024765399999999998 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:09.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.040216+0000", 2024-09-10T06:28:09.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023322999999999999 2024-09-10T06:28:09.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.049930+0000", 2024-09-10T06:28:09.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097135920000000001 2024-09-10T06:28:09.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057061+0000", 2024-09-10T06:28:09.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071309570000000003 2024-09-10T06:28:09.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057234+0000", 2024-09-10T06:28:09.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173308 2024-09-10T06:28:09.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057355+0000", 2024-09-10T06:28:09.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121272 2024-09-10T06:28:09.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.784 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.784 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1370 3.26 3:64e41eab:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.784 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:09.785 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.647214418000001, 2024-09-10T06:28:09.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022030800999999999, 2024-09-10T06:28:09.785 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.785 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.785 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.785 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1370 2024-09-10T06:28:09.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.785 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109960+0000", 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3930000000000001e-06 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114711+0000", 2024-09-10T06:28:09.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047511580000000001 2024-09-10T06:28:09.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114749+0000", 2024-09-10T06:28:09.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8417999999999997e-05 2024-09-10T06:28:09.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114768+0000", 2024-09-10T06:28:09.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8352e-05 2024-09-10T06:28:09.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114926+0000", 2024-09-10T06:28:09.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015819599999999999 2024-09-10T06:28:09.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115321+0000", 2024-09-10T06:28:09.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039507300000000002 2024-09-10T06:28:09.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:09.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115735+0000", 2024-09-10T06:28:09.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041369900000000001 2024-09-10T06:28:09.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.125212+0000", 2024-09-10T06:28:09.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094774109999999998 2024-09-10T06:28:09.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131666+0000", 2024-09-10T06:28:09.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064533730000000001 2024-09-10T06:28:09.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131847+0000", 2024-09-10T06:28:09.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018112400000000001 2024-09-10T06:28:09.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131986+0000", 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013960399999999999 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1371 3.2e e63/22 3:741ddced:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_126:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.632253953999999, 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440024000000001, 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:09.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:09.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124919+0000", 2024-09-10T06:28:09.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-10T06:28:09.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130095+0000", 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00517645 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130125+0000", 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9944e-05 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130142+0000", 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6515999999999999e-05 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130252+0000", 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110473 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130297+0000", 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5012999999999997e-05 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149096+0000", 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018799429999999999 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149356+0000", 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000259499 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1372 3.36 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.62469733, 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026714723999999999, 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.795 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1372 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:09.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132475+0000", 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.65e-06 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137399+0000", 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049236530000000001 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137432+0000", 2024-09-10T06:28:09.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3050999999999999e-05 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137449+0000", 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6976000000000001e-05 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137569+0000", 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012016899999999999 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137884+0000", 2024-09-10T06:28:09.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031455799999999999 2024-09-10T06:28:09.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:09.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138191+0000", 2024-09-10T06:28:09.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000307466 2024-09-10T06:28:09.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157760+0000", 2024-09-10T06:28:09.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019569128000000002 2024-09-10T06:28:09.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157954+0000", 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019375300000000001 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158118+0000", 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016390900000000001 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.159187+0000", 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010694109999999999 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.801 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1373 3.35 3:ac8a3287:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.801 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:09.801 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.614364339, 2024-09-10T06:28:09.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023907627000000001, 2024-09-10T06:28:09.801 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.801 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.801 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1373 2024-09-10T06:28:09.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.801 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142810+0000", 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6129999999999997e-06 2024-09-10T06:28:09.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.146972+0000", 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041615180000000003 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147029+0000", 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7476000000000003e-05 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147056+0000", 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7021000000000001e-05 2024-09-10T06:28:09.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147249+0000", 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019260999999999999 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147702+0000", 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045347999999999997 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148113+0000", 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041051899999999998 2024-09-10T06:28:09.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161583+0000", 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013470278 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166410+0000", 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048270199999999996 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166579+0000", 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016839099999999999 2024-09-10T06:28:09.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166713+0000", 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013470100000000001 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1384 3.33 e63/22 3:cfe948dc:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_139:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.254532+0000", 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.502638029, 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015554659, 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.806 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.254532+0000", 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.254532+0000", 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.254535+0000", 2024-09-10T06:28:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9170000000000002e-06 2024-09-10T06:28:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260133+0000", 2024-09-10T06:28:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055976969999999996 2024-09-10T06:28:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260168+0000", 2024-09-10T06:28:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5917000000000002e-05 2024-09-10T06:28:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260186+0000", 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7538999999999999e-05 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260307+0000", 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121382 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260354+0000", 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6507e-05 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.269997+0000", 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096426900000000006 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.270087+0000", 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.001e-05 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1387 3.35 3:adfbe02e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:09.810 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.475236052, 2024-09-10T06:28:09.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021055645000000001, 2024-09-10T06:28:09.811 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.811 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.811 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1387 2024-09-10T06:28:09.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.811 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:09.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:09.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281938+0000", 2024-09-10T06:28:09.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0659999999999997e-06 2024-09-10T06:28:09.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286048+0000", 2024-09-10T06:28:09.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041104560000000002 2024-09-10T06:28:09.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286097+0000", 2024-09-10T06:28:09.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8715999999999999e-05 2024-09-10T06:28:09.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286126+0000", 2024-09-10T06:28:09.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9308000000000001e-05 2024-09-10T06:28:09.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286279+0000", 2024-09-10T06:28:09.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015285400000000001 2024-09-10T06:28:09.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286520+0000", 2024-09-10T06:28:09.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024062000000000001 2024-09-10T06:28:09.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:09.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286772+0000", 2024-09-10T06:28:09.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025170599999999998 2024-09-10T06:28:09.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.301846+0000", 2024-09-10T06:28:09.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015074363 2024-09-10T06:28:09.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302698+0000", 2024-09-10T06:28:09.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000852179 2024-09-10T06:28:09.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302864+0000", 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016568900000000001 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302990+0000", 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012568799999999999 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1397 3.3f e63/41 3:ff95a35c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_152:head v 63'5, mlcod=63'3)", 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.385363+0000", 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.371806810000001, 2024-09-10T06:28:09.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017789975999999999, 2024-09-10T06:28:09.817 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.817 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.817 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.817 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.385363+0000", 2024-09-10T06:28:09.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.385363+0000", 2024-09-10T06:28:09.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.385366+0000", 2024-09-10T06:28:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7329999999999999e-06 2024-09-10T06:28:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390582+0000", 2024-09-10T06:28:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052160740000000002 2024-09-10T06:28:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390618+0000", 2024-09-10T06:28:09.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5818000000000002e-05 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390637+0000", 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9096000000000001e-05 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390769+0000", 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013195700000000001 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390810+0000", 2024-09-10T06:28:09.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0734e-05 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403047+0000", 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012237534 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403153+0000", 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010603 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.821 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1398 3.2c 3:350a23e7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.821 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:09.821 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.362192733000001, 2024-09-10T06:28:09.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032248536000000001, 2024-09-10T06:28:09.821 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.821 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.821 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.821 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1398 2024-09-10T06:28:09.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.821 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394981+0000", 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7359999999999999e-06 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402145+0000", 2024-09-10T06:28:09.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071643540000000004 2024-09-10T06:28:09.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402182+0000", 2024-09-10T06:28:09.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6318e-05 2024-09-10T06:28:09.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402200+0000", 2024-09-10T06:28:09.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8439000000000001e-05 2024-09-10T06:28:09.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402391+0000", 2024-09-10T06:28:09.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190917 2024-09-10T06:28:09.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402649+0000", 2024-09-10T06:28:09.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025817599999999999 2024-09-10T06:28:09.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:09.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402908+0000", 2024-09-10T06:28:09.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025864300000000002 2024-09-10T06:28:09.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424973+0000", 2024-09-10T06:28:09.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022065004999999999 2024-09-10T06:28:09.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.426990+0000", 2024-09-10T06:28:09.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020169340000000002 2024-09-10T06:28:09.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427129+0000", 2024-09-10T06:28:09.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139436 2024-09-10T06:28:09.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427226+0000", 2024-09-10T06:28:09.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6577999999999996e-05 2024-09-10T06:28:09.826 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.826 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.826 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.826 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1413 3.1e e63/22 3:79ea7bee:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_158:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:09.826 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.445858+0000", 2024-09-10T06:28:09.827 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.311312149999999, 2024-09-10T06:28:09.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015385619, 2024-09-10T06:28:09.827 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.827 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.827 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.827 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.445858+0000", 2024-09-10T06:28:09.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.445858+0000", 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.445860+0000", 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.706e-06 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450317+0000", 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044569060000000001 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450355+0000", 2024-09-10T06:28:09.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7293999999999999e-05 2024-09-10T06:28:09.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450372+0000", 2024-09-10T06:28:09.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7492000000000001e-05 2024-09-10T06:28:09.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450488+0000", 2024-09-10T06:28:09.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011576199999999999 2024-09-10T06:28:09.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450533+0000", 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5046999999999997e-05 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.461119+0000", 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010585796 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.461243+0000", 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000124616 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1415 3.2c 3:34c14757:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.294345735, 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029598765999999999, 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1415 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462828+0000", 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1999999999999996e-06 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.466974+0000", 2024-09-10T06:28:09.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041452989999999999 2024-09-10T06:28:09.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467026+0000", 2024-09-10T06:28:09.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2416000000000001e-05 2024-09-10T06:28:09.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467055+0000", 2024-09-10T06:28:09.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9081000000000002e-05 2024-09-10T06:28:09.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467207+0000", 2024-09-10T06:28:09.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015225699999999999 2024-09-10T06:28:09.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467468+0000", 2024-09-10T06:28:09.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026093500000000001 2024-09-10T06:28:09.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:09.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467755+0000", 2024-09-10T06:28:09.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000287101 2024-09-10T06:28:09.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477312+0000", 2024-09-10T06:28:09.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095560300000000001 2024-09-10T06:28:09.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492136+0000", 2024-09-10T06:28:09.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014824936 2024-09-10T06:28:09.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492301+0000", 2024-09-10T06:28:09.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016411600000000001 2024-09-10T06:28:09.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492423+0000", 2024-09-10T06:28:09.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122395 2024-09-10T06:28:09.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.836 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.836 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1416 3.10 3:084717f7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:09.836 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:09.836 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.285311487, 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021526931999999999, 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1416 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471863+0000", 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477370+0000", 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055071549999999997 2024-09-10T06:28:09.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477402+0000", 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1498000000000002e-05 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477423+0000", 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1098e-05 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477559+0000", 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136627 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477936+0000", 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037718099999999998 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.478271+0000", 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033427799999999997 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.490997+0000", 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012725858 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493126+0000", 2024-09-10T06:28:09.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002129499 2024-09-10T06:28:09.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493263+0000", 2024-09-10T06:28:09.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013682500000000001 2024-09-10T06:28:09.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493385+0000", 2024-09-10T06:28:09.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122414 2024-09-10T06:28:09.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1466 3.a 3:52715822:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.004814+0000", 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.7523561569999995, 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01610396, 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1466 2024-09-10T06:28:09.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.004814+0000", 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.004814+0000", 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.004817+0000", 2024-09-10T06:28:09.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.993e-06 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.009941+0000", 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051237699999999997 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.009977+0000", 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6021e-05 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010002+0000", 2024-09-10T06:28:09.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5114999999999999e-05 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010104+0000", 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010259699999999999 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010243+0000", 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000138858 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010361+0000", 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117751 2024-09-10T06:28:09.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.019657+0000", 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092965689999999993 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.020775+0000", 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001117266 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.020853+0000", 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.020918+0000", 2024-09-10T06:28:09.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4243000000000001e-05 2024-09-10T06:28:09.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.847 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.847 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1482 3.35 3:ad9242de:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:09.847 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:09.847 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5970057529999995, 2024-09-10T06:28:09.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022710764000000001, 2024-09-10T06:28:09.847 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1482 2024-09-10T06:28:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160166+0000", 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1069999999999999e-06 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163977+0000", 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003810843 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163995+0000", 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7648000000000001e-05 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164010+0000", 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4754e-05 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164094+0000", 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4473000000000003e-05 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164281+0000", 2024-09-10T06:28:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018659699999999999 2024-09-10T06:28:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164458+0000", 2024-09-10T06:28:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017758300000000001 2024-09-10T06:28:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.179923+0000", 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015465269 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182736+0000", 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028130579999999998 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182816+0000", 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9976999999999997e-05 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182875+0000", 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8455000000000002e-05 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1664 3.a 3:52f62ee7:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.9329805140000005, 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020253482999999999, 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1664 2024-09-10T06:28:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824193+0000", 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6059999999999999e-06 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829549+0000", 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053562189999999997 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829584+0000", 2024-09-10T06:28:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4925000000000002e-05 2024-09-10T06:28:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829602+0000", 2024-09-10T06:28:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8034999999999999e-05 2024-09-10T06:28:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829716+0000", 2024-09-10T06:28:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113522 2024-09-10T06:28:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829903+0000", 2024-09-10T06:28:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187443 2024-09-10T06:28:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.830162+0000", 2024-09-10T06:28:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025917900000000001 2024-09-10T06:28:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.843459+0000", 2024-09-10T06:28:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01329675 2024-09-10T06:28:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844211+0000", 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075213700000000005 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844286+0000", 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4453e-05 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844443+0000", 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157214 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1666 3.35 3:ad92e5c9:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.844780+0000", 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.9123897999999997, 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016844930000000001, 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1666 2024-09-10T06:28:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844780+0000", 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844780+0000", 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844782+0000", 2024-09-10T06:28:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5740000000000001e-06 2024-09-10T06:28:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848542+0000", 2024-09-10T06:28:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037601620000000001 2024-09-10T06:28:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848564+0000", 2024-09-10T06:28:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2405999999999999e-05 2024-09-10T06:28:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848574+0000", 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6989999999999998e-06 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848714+0000", 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014004100000000001 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848964+0000", 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024983600000000003 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.849193+0000", 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000228693 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.861129+0000", 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01193658 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.861509+0000", 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037939899999999999 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.861574+0000", 2024-09-10T06:28:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5471999999999999e-05 2024-09-10T06:28:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.861625+0000", 2024-09-10T06:28:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1068e-05 2024-09-10T06:28:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:09.867 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:09.869 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:28:09.869 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:09.863+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:09.970 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:09.967+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:09.997 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:09.998 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:09.998 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:09.998 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:10.013 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:28:10.071 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:10.068+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:10.130 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:10.130 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:10.130 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:10.131 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:10.131 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:10.146 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:28:10.188 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:10.188+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:10.249 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:28:10.298 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:10.295+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:10.312 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:10.312 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:10.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:10.312 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:10.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.312 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:10.313 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:10.313 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 112.86290927899999, 2024-09-10T06:28:10.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70775834699999995, 2024-09-10T06:28:10.313 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.313 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.313 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:10.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:10.313 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1 2024-09-10T06:28:10.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.313 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:10.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:10.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446852+0000", 2024-09-10T06:28:10.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.117e-06 2024-09-10T06:28:10.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446870+0000", 2024-09-10T06:28:10.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7569999999999999e-05 2024-09-10T06:28:10.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446892+0000", 2024-09-10T06:28:10.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2036e-05 2024-09-10T06:28:10.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446908+0000", 2024-09-10T06:28:10.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6719999999999999e-05 2024-09-10T06:28:10.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447040+0000", 2024-09-10T06:28:10.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013118299999999999 2024-09-10T06:28:10.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:28:10.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447054+0000", 2024-09-10T06:28:10.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4343e-05 2024-09-10T06:28:10.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.151730+0000", 2024-09-10T06:28:10.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70467560600000001 2024-09-10T06:28:10.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152054+0000", 2024-09-10T06:28:10.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032444100000000002 2024-09-10T06:28:10.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:10.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152404+0000", 2024-09-10T06:28:10.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000349938 2024-09-10T06:28:10.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.153773+0000", 2024-09-10T06:28:10.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013693620000000001 2024-09-10T06:28:10.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154454+0000", 2024-09-10T06:28:10.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068035800000000005 2024-09-10T06:28:10.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154544+0000", 2024-09-10T06:28:10.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0623000000000003e-05 2024-09-10T06:28:10.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154607+0000", 2024-09-10T06:28:10.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3050000000000001e-05 2024-09-10T06:28:10.319 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.319 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.319 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.319 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:10.319 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:28:10.320 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 112.024803608, 2024-09-10T06:28:10.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019245090999999999, 2024-09-10T06:28:10.320 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.320 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.320 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.320 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.320 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:10.320 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:10.320 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 50 2024-09-10T06:28:10.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.320 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:28:10.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:28:10.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.284955+0000", 2024-09-10T06:28:10.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3e-07 2024-09-10T06:28:10.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285037+0000", 2024-09-10T06:28:10.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2008999999999994e-05 2024-09-10T06:28:10.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285049+0000", 2024-09-10T06:28:10.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1816e-05 2024-09-10T06:28:10.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285057+0000", 2024-09-10T06:28:10.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8639999999999996e-06 2024-09-10T06:28:10.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.298896+0000", 2024-09-10T06:28:10.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013838743000000001 2024-09-10T06:28:10.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.299025+0000", 2024-09-10T06:28:10.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129352 2024-09-10T06:28:10.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:10.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.299222+0000", 2024-09-10T06:28:10.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019682200000000001 2024-09-10T06:28:10.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302676+0000", 2024-09-10T06:28:10.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00345371 2024-09-10T06:28:10.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304050+0000", 2024-09-10T06:28:10.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001374779 2024-09-10T06:28:10.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304135+0000", 2024-09-10T06:28:10.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4640000000000003e-05 2024-09-10T06:28:10.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.304200+0000", 2024-09-10T06:28:10.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4626000000000001e-05 2024-09-10T06:28:10.325 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.325 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.325 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.325 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:10.325 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:10.325 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 112.024681359, 2024-09-10T06:28:10.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021819150999999998, 2024-09-10T06:28:10.326 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.326 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.326 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:10.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:10.326 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 51 2024-09-10T06:28:10.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.326 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:10.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285078+0000", 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000001e-07 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285083+0000", 2024-09-10T06:28:10.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6099999999999997e-06 2024-09-10T06:28:10.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285092+0000", 2024-09-10T06:28:10.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2399999999999996e-06 2024-09-10T06:28:10.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285100+0000", 2024-09-10T06:28:10.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8739999999999995e-06 2024-09-10T06:28:10.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300938+0000", 2024-09-10T06:28:10.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015837527000000001 2024-09-10T06:28:10.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301058+0000", 2024-09-10T06:28:10.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012032300000000001 2024-09-10T06:28:10.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:10.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301251+0000", 2024-09-10T06:28:10.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192828 2024-09-10T06:28:10.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302937+0000", 2024-09-10T06:28:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016857339999999999 2024-09-10T06:28:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306745+0000", 2024-09-10T06:28:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038078729999999998 2024-09-10T06:28:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306830+0000", 2024-09-10T06:28:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5432999999999993e-05 2024-09-10T06:28:10.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306896+0000", 2024-09-10T06:28:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5993000000000003e-05 2024-09-10T06:28:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 112.024641483, 2024-09-10T06:28:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021995553000000001, 2024-09-10T06:28:10.331 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 52 2024-09-10T06:28:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4000000000000001e-07 2024-09-10T06:28:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285123+0000", 2024-09-10T06:28:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6969999999999998e-06 2024-09-10T06:28:10.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285132+0000", 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1560000000000001e-06 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285139+0000", 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1539999999999996e-06 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301865+0000", 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016725173999999999 2024-09-10T06:28:10.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301995+0000", 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130739 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302195+0000", 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000199965 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.303135+0000", 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093978300000000002 2024-09-10T06:28:10.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306979+0000", 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038437459999999999 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307057+0000", 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7766e-05 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307112+0000", 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5733000000000003e-05 2024-09-10T06:28:10.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1374 3.2f e63/22 3:f735f5eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_129:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.151598238, 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022402502000000001, 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158162+0000", 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4569999999999999e-06 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161871+0000", 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037080799999999999 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161914+0000", 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3571e-05 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161940+0000", 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5876000000000001e-05 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.162081+0000", 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014147000000000001 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.162123+0000", 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1666999999999999e-05 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.180416+0000", 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018292881 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.180562+0000", 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014650000000000001 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1378 3.2d 3:b4d0ba6d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.118037578999999, 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029738187999999999, 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.342 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.342 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1378 2024-09-10T06:28:10.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.342 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:10.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:10.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191724+0000", 2024-09-10T06:28:10.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2650000000000001e-06 2024-09-10T06:28:10.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196514+0000", 2024-09-10T06:28:10.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047904039999999998 2024-09-10T06:28:10.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196552+0000", 2024-09-10T06:28:10.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8034999999999998e-05 2024-09-10T06:28:10.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196577+0000", 2024-09-10T06:28:10.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5120999999999999e-05 2024-09-10T06:28:10.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196716+0000", 2024-09-10T06:28:10.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013837699999999999 2024-09-10T06:28:10.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196970+0000", 2024-09-10T06:28:10.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025406300000000001 2024-09-10T06:28:10.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:10.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.197196+0000", 2024-09-10T06:28:10.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022647499999999999 2024-09-10T06:28:10.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211315+0000", 2024-09-10T06:28:10.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014118175 2024-09-10T06:28:10.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.220793+0000", 2024-09-10T06:28:10.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094785640000000001 2024-09-10T06:28:10.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221044+0000", 2024-09-10T06:28:10.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025106 2024-09-10T06:28:10.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221459+0000", 2024-09-10T06:28:10.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041464900000000001 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1379 3.11 3:8ad434e9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.108359160999999, 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021255388, 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.348 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1379 2024-09-10T06:28:10.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.348 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:10.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:10.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201402+0000", 2024-09-10T06:28:10.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2459999999999999e-06 2024-09-10T06:28:10.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205915+0000", 2024-09-10T06:28:10.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045131149999999998 2024-09-10T06:28:10.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205948+0000", 2024-09-10T06:28:10.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2259999999999999e-05 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205966+0000", 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8238999999999999e-05 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.206162+0000", 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000195782 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.206607+0000", 2024-09-10T06:28:10.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044565000000000002 2024-09-10T06:28:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.207031+0000", 2024-09-10T06:28:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000423714 2024-09-10T06:28:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221664+0000", 2024-09-10T06:28:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014632895 2024-09-10T06:28:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222398+0000", 2024-09-10T06:28:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073376099999999998 2024-09-10T06:28:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222569+0000", 2024-09-10T06:28:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017139400000000001 2024-09-10T06:28:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222654+0000", 2024-09-10T06:28:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5332000000000002e-05 2024-09-10T06:28:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.353 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1389 3.13 3:c83648d5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:10.353 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.302213+0000", 2024-09-10T06:28:10.353 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.007545454000001, 2024-09-10T06:28:10.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019439842999999998, 2024-09-10T06:28:10.353 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.353 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.354 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.354 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1389 2024-09-10T06:28:10.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.354 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302213+0000", 2024-09-10T06:28:10.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302213+0000", 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302217+0000", 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4959999999999998e-06 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.306238+0000", 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040202679999999996 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.306275+0000", 2024-09-10T06:28:10.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7577000000000003e-05 2024-09-10T06:28:10.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.306293+0000", 2024-09-10T06:28:10.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8376000000000002e-05 2024-09-10T06:28:10.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.306427+0000", 2024-09-10T06:28:10.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013334100000000001 2024-09-10T06:28:10.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.306676+0000", 2024-09-10T06:28:10.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024941600000000003 2024-09-10T06:28:10.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:10.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.306908+0000", 2024-09-10T06:28:10.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-09-10T06:28:10.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.320872+0000", 2024-09-10T06:28:10.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01396437 2024-09-10T06:28:10.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.321337+0000", 2024-09-10T06:28:10.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000464895 2024-09-10T06:28:10.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.321519+0000", 2024-09-10T06:28:10.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000181731 2024-09-10T06:28:10.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.321653+0000", 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133485 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1426 3.2d 3:b764a1d5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.743018568, 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027451646999999999, 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.359 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.360 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.360 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1426 2024-09-10T06:28:10.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.360 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:10.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:10.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566742+0000", 2024-09-10T06:28:10.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.317e-06 2024-09-10T06:28:10.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570553+0000", 2024-09-10T06:28:10.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038114680000000001 2024-09-10T06:28:10.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570585+0000", 2024-09-10T06:28:10.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1940999999999998e-05 2024-09-10T06:28:10.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570601+0000", 2024-09-10T06:28:10.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5218000000000001e-05 2024-09-10T06:28:10.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570723+0000", 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012265099999999999 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570966+0000", 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024268099999999999 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.571204+0000", 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000238213 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.584059+0000", 2024-09-10T06:28:10.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012854477 2024-09-10T06:28:10.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594094+0000", 2024-09-10T06:28:10.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010034992 2024-09-10T06:28:10.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594146+0000", 2024-09-10T06:28:10.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2497999999999998e-05 2024-09-10T06:28:10.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594191+0000", 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5191000000000002e-05 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1435 3.2d 3:b4574439:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.646272611000001, 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.035042897000000003, 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.366 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1435 2024-09-10T06:28:10.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.366 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:10.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:10.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663488+0000", 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.616e-06 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667246+0000", 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037580579999999999 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667277+0000", 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0688000000000002e-05 2024-09-10T06:28:10.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667291+0000", 2024-09-10T06:28:10.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4472e-05 2024-09-10T06:28:10.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667411+0000", 2024-09-10T06:28:10.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011913699999999999 2024-09-10T06:28:10.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:10.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667422+0000", 2024-09-10T06:28:10.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1073000000000001e-05 2024-09-10T06:28:10.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674124+0000", 2024-09-10T06:28:10.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067023619999999999 2024-09-10T06:28:10.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674520+0000", 2024-09-10T06:28:10.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039614700000000001 2024-09-10T06:28:10.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:10.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674879+0000", 2024-09-10T06:28:10.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035909899999999999 2024-09-10T06:28:10.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698261+0000", 2024-09-10T06:28:10.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023382209000000001 2024-09-10T06:28:10.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698338+0000", 2024-09-10T06:28:10.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6915000000000005e-05 2024-09-10T06:28:10.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698455+0000", 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117039 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698528+0000", 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3082000000000003e-05 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1436 3.2d 3:b7b59058:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:10.371 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.636709092, 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032516167999999998, 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1436 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:10.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:10.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673052+0000", 2024-09-10T06:28:10.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3629999999999998e-06 2024-09-10T06:28:10.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678383+0000", 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053304199999999998 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678423+0000", 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0089999999999997e-05 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678442+0000", 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9242e-05 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.685257+0000", 2024-09-10T06:28:10.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068147920000000001 2024-09-10T06:28:10.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.685641+0000", 2024-09-10T06:28:10.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038388700000000002 2024-09-10T06:28:10.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:10.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.686106+0000", 2024-09-10T06:28:10.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046506800000000001 2024-09-10T06:28:10.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698619+0000", 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012513102999999999 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705364+0000", 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067448170000000002 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705482+0000", 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118362 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705565+0000", 2024-09-10T06:28:10.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3023999999999997e-05 2024-09-10T06:28:10.377 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.377 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.377 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.377 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1442 3.13 3:c8bde401:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:10.377 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:10.377 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.57462849, 2024-09-10T06:28:10.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021096628999999999, 2024-09-10T06:28:10.377 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.377 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.377 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1442 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:10.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735133+0000", 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6899999999999998e-06 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739406+0000", 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042727950000000002 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739432+0000", 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6245999999999999e-05 2024-09-10T06:28:10.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739447+0000", 2024-09-10T06:28:10.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4071e-05 2024-09-10T06:28:10.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739575+0000", 2024-09-10T06:28:10.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000128641 2024-09-10T06:28:10.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739818+0000", 2024-09-10T06:28:10.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024242999999999999 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.740058+0000", 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023991 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.748440+0000", 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083824390000000002 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756108+0000", 2024-09-10T06:28:10.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076684350000000004 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756165+0000", 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6641000000000002e-05 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756226+0000", 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1330999999999999e-05 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.383 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1443 3.37 3:edd7279d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:10.383 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:10.383 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.564721727, 2024-09-10T06:28:10.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022124847, 2024-09-10T06:28:10.383 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.383 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.383 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.383 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.383 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.383 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.383 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1443 2024-09-10T06:28:10.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.383 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:10.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:10.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745040+0000", 2024-09-10T06:28:10.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6490000000000001e-06 2024-09-10T06:28:10.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753657+0000", 2024-09-10T06:28:10.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086173410000000006 2024-09-10T06:28:10.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753697+0000", 2024-09-10T06:28:10.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9669999999999998e-05 2024-09-10T06:28:10.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753722+0000", 2024-09-10T06:28:10.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4666000000000001e-05 2024-09-10T06:28:10.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753845+0000", 2024-09-10T06:28:10.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012319699999999999 2024-09-10T06:28:10.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753994+0000", 2024-09-10T06:28:10.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149157 2024-09-10T06:28:10.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.754120+0000", 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012597500000000001 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.766728+0000", 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012608359 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767022+0000", 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029342099999999998 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767098+0000", 2024-09-10T06:28:10.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6508999999999995e-05 2024-09-10T06:28:10.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767161+0000", 2024-09-10T06:28:10.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2903000000000004e-05 2024-09-10T06:28:10.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.388 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.388 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1469 3.d 3:b3f21559:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.27481483, 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024987420999999999, 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1469 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:10.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:10.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034946+0000", 2024-09-10T06:28:10.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0630000000000002e-06 2024-09-10T06:28:10.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.038986+0000", 2024-09-10T06:28:10.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040398580000000003 2024-09-10T06:28:10.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039019+0000", 2024-09-10T06:28:10.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3167000000000003e-05 2024-09-10T06:28:10.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039037+0000", 2024-09-10T06:28:10.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7785999999999999e-05 2024-09-10T06:28:10.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039135+0000", 2024-09-10T06:28:10.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8152999999999994e-05 2024-09-10T06:28:10.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039321+0000", 2024-09-10T06:28:10.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000185243 2024-09-10T06:28:10.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:10.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039506+0000", 2024-09-10T06:28:10.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018496100000000001 2024-09-10T06:28:10.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.047253+0000", 2024-09-10T06:28:10.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0077471889999999998 2024-09-10T06:28:10.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059836+0000", 2024-09-10T06:28:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012583145 2024-09-10T06:28:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059879+0000", 2024-09-10T06:28:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3090999999999998e-05 2024-09-10T06:28:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059931+0000", 2024-09-10T06:28:10.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1765000000000003e-05 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1669 3.2d 3:b72c6e58:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4347828199999997, 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021299012999999999, 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.395 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1669 2024-09-10T06:28:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874979+0000", 2024-09-10T06:28:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7670000000000001e-06 2024-09-10T06:28:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880441+0000", 2024-09-10T06:28:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054614859999999998 2024-09-10T06:28:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880475+0000", 2024-09-10T06:28:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4542000000000002e-05 2024-09-10T06:28:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880492+0000", 2024-09-10T06:28:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7048999999999999e-05 2024-09-10T06:28:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880599+0000", 2024-09-10T06:28:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106741 2024-09-10T06:28:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880788+0000", 2024-09-10T06:28:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189168 2024-09-10T06:28:10.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880951+0000", 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016303199999999999 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.890345+0000", 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093942379999999992 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896112+0000", 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057669289999999996 2024-09-10T06:28:10.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896204+0000", 2024-09-10T06:28:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2069000000000002e-05 2024-09-10T06:28:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896274+0000", 2024-09-10T06:28:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9992000000000003e-05 2024-09-10T06:28:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1671 3.37 3:ed354b67:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.4120605069999996, 2024-09-10T06:28:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022257213000000001, 2024-09-10T06:28:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1671 2024-09-10T06:28:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897701+0000", 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901677+0000", 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039758609999999998 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901717+0000", 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9889999999999999e-05 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901735+0000", 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8185999999999998e-05 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901926+0000", 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019083899999999999 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902165+0000", 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023968200000000001 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902392+0000", 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022711399999999999 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.915622+0000", 2024-09-10T06:28:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013229708999999999 2024-09-10T06:28:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919654+0000", 2024-09-10T06:28:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040314699999999997 2024-09-10T06:28:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919827+0000", 2024-09-10T06:28:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173647 2024-09-10T06:28:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919955+0000", 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012767900000000001 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1673 3.2d 3:b688b693:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.917332+0000", 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3924258639999998, 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01991099, 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.406 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1673 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.917332+0000", 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.917332+0000", 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.917336+0000", 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4240000000000002e-06 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.922265+0000", 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049295399999999996 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.922295+0000", 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9414999999999999e-05 2024-09-10T06:28:10.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.922310+0000", 2024-09-10T06:28:10.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5438999999999999e-05 2024-09-10T06:28:10.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.922457+0000", 2024-09-10T06:28:10.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014695800000000001 2024-09-10T06:28:10.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.922716+0000", 2024-09-10T06:28:10.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025858800000000003 2024-09-10T06:28:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.922944+0000", 2024-09-10T06:28:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000228464 2024-09-10T06:28:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936043+0000", 2024-09-10T06:28:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013099296999999999 2024-09-10T06:28:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.937118+0000", 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001074661 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.937186+0000", 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7455999999999999e-05 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.937243+0000", 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7747999999999997e-05 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1674 3.e 3:71dde5c5:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3768639809999996, 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024662893000000002, 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1674 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932897+0000", 2024-09-10T06:28:10.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3939999999999999e-06 2024-09-10T06:28:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935777+0000", 2024-09-10T06:28:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028807899999999998 2024-09-10T06:28:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935803+0000", 2024-09-10T06:28:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6067e-05 2024-09-10T06:28:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935818+0000", 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4696e-05 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935939+0000", 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120895 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936155+0000", 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021555000000000001 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:10.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936376+0000", 2024-09-10T06:28:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221127 2024-09-10T06:28:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.951276+0000", 2024-09-10T06:28:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014900149999999999 2024-09-10T06:28:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957421+0000", 2024-09-10T06:28:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061452440000000002 2024-09-10T06:28:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957502+0000", 2024-09-10T06:28:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1290000000000003e-05 2024-09-10T06:28:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957557+0000", 2024-09-10T06:28:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.469e-05 2024-09-10T06:28:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1675 3.13 3:cbcca46f:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3680079159999998, 2024-09-10T06:28:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02191593, 2024-09-10T06:28:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1675 2024-09-10T06:28:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.418 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941752+0000", 2024-09-10T06:28:10.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1550000000000001e-06 2024-09-10T06:28:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945904+0000", 2024-09-10T06:28:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041513019999999999 2024-09-10T06:28:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945928+0000", 2024-09-10T06:28:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4113000000000001e-05 2024-09-10T06:28:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945941+0000", 2024-09-10T06:28:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3052e-05 2024-09-10T06:28:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946089+0000", 2024-09-10T06:28:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014766599999999999 2024-09-10T06:28:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946459+0000", 2024-09-10T06:28:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037089600000000001 2024-09-10T06:28:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946838+0000", 2024-09-10T06:28:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037808900000000002 2024-09-10T06:28:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957331+0000", 2024-09-10T06:28:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010493195 2024-09-10T06:28:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963409+0000", 2024-09-10T06:28:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060786570000000003 2024-09-10T06:28:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963559+0000", 2024-09-10T06:28:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014962600000000001 2024-09-10T06:28:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963666+0000", 2024-09-10T06:28:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107179 2024-09-10T06:28:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.423 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1684 3.e 3:70ef0483:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T06:28:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.2111741460000003, 2024-09-10T06:28:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020215823000000001, 2024-09-10T06:28:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1684 2024-09-10T06:28:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:10.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:10.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:10.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:10.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:10.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:10.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098589+0000", 2024-09-10T06:28:10.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.673e-06 2024-09-10T06:28:10.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:10.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102294+0000", 2024-09-10T06:28:10.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037056160000000001 2024-09-10T06:28:10.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:10.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102319+0000", 2024-09-10T06:28:10.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4411000000000001e-05 2024-09-10T06:28:10.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:10.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102330+0000", 2024-09-10T06:28:10.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1212999999999999e-05 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102457+0000", 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012733300000000001 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102472+0000", 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4236000000000001e-05 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106594+0000", 2024-09-10T06:28:10.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004122906 2024-09-10T06:28:10.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:10.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106701+0000", 2024-09-10T06:28:10.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106745 2024-09-10T06:28:10.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:10.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106809+0000", 2024-09-10T06:28:10.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107686 2024-09-10T06:28:10.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:10.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.117591+0000", 2024-09-10T06:28:10.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01078202 2024-09-10T06:28:10.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:10.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118617+0000", 2024-09-10T06:28:10.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001026218 2024-09-10T06:28:10.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:10.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118715+0000", 2024-09-10T06:28:10.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8004000000000006e-05 2024-09-10T06:28:10.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:10.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:10.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:10.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118800+0000", 2024-09-10T06:28:10.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4761999999999999e-05 2024-09-10T06:28:10.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.430 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:10.430 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:10.430 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:10.431 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:28:10.432 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:28:10.432 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:28:10.432 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:28:10.433 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:10.427+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:10.433 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:28:10.439 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:28:10.439 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:28:10.459 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:28:10.459 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:28:10.479 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:28:10.479 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:28:10.500 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:28:10.500 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:28:10.520 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:28:10.521 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:28:10.532 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:10.532+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:10.542 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:28:10.542 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:28:10.553 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-10T06:28:10.561 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:10.561 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:10.584 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:28:10.674 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:10.671+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:10.734 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:10.732+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:10.745 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:10.745 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:10.760 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:28:10.846 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:10.843+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:10.926 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:10.926 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:10.936 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:10.931+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:10.940 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:28:11.037 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:11.031+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:11.111 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:11.111 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:11.125 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:28:11.170 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:11.167+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:11.238 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:11.235+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:11.294 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:11.294 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:11.308 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:28:11.339 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:11.340+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:11.440 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:11.435+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:11.464 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:11.464 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:11.478 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:28:11.570 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:11.567+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:11.642 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:11.640+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:11.644 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:11.644 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:11.659 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:28:11.746 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:11.743+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:11.820 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:11.820 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:11.834 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:28:11.878 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:11.875+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:11.945 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:11.944+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:12.002 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:12.002 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:12.016 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:28:12.062 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:12.059+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:12.134 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:12.134 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:12.147 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:12.144+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:12.149 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:28:12.248 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:12.248+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:12.325 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:12.325 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:12.338 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:28:12.348 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:12.348+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:12.398 INFO:tasks.workunit.client.0.smithi112.stderr:100+0 records in 2024-09-10T06:28:12.399 INFO:tasks.workunit.client.0.smithi112.stderr:100+0 records out 2024-09-10T06:28:12.399 INFO:tasks.workunit.client.0.smithi112.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 6.54942 s, 160 MB/s 2024-09-10T06:28:12.449 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:12.443+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:12.459 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:12.459 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:12.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:28:12.550 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:12.547+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:12.566 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:28:12.586 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T06:28:12.611 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:12.611 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:12.625 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:28:12.668 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:12.668+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:12.701 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:28:12.701 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:28:12.718 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:28:12.719 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:28:12.737 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:28:12.737 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:28:12.748 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:12.748 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:12.752 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:12.748+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:12.754 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:28:12.754 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:28:12.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:28:12.773 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:28:12.774 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:28:12.792 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:28:12.792 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:28:12.809 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:28:12.810 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:28:12.828 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:28:12.828 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:28:12.853 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:12.847+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:12.934 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1351 3.1d e63/41 3:b8f5f32e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_106:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.891127+0000", 2024-09-10T06:28:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.041797520999999, 2024-09-10T06:28:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016439619999999999, 2024-09-10T06:28:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:12.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.891127+0000", 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.891127+0000", 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.891129+0000", 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7089999999999998e-06 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895096+0000", 2024-09-10T06:28:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039671309999999996 2024-09-10T06:28:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895128+0000", 2024-09-10T06:28:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1664e-05 2024-09-10T06:28:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895158+0000", 2024-09-10T06:28:12.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0168e-05 2024-09-10T06:28:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895311+0000", 2024-09-10T06:28:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015315899999999999 2024-09-10T06:28:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.895380+0000", 2024-09-10T06:28:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8559000000000005e-05 2024-09-10T06:28:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:12.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.907398+0000", 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012017798 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.907566+0000", 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016843199999999999 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1352 3.1c e63/22 3:3adb07ef:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_107:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.904909+0000", 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.028015366, 2024-09-10T06:28:12.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016373502000000002, 2024-09-10T06:28:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.904909+0000", 2024-09-10T06:28:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:12.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.904909+0000", 2024-09-10T06:28:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.904911+0000", 2024-09-10T06:28:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.916e-06 2024-09-10T06:28:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908660+0000", 2024-09-10T06:28:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037489490000000001 2024-09-10T06:28:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908697+0000", 2024-09-10T06:28:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7761e-05 2024-09-10T06:28:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908724+0000", 2024-09-10T06:28:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6361000000000001e-05 2024-09-10T06:28:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908878+0000", 2024-09-10T06:28:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000153936 2024-09-10T06:28:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.908921+0000", 2024-09-10T06:28:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3000999999999997e-05 2024-09-10T06:28:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.921179+0000", 2024-09-10T06:28:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012257901999999999 2024-09-10T06:28:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.921282+0000", 2024-09-10T06:28:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103676 2024-09-10T06:28:12.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1359 3.34 3:2ece4e0b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.955694202, 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021482449000000001, 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:12.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1359 2024-09-10T06:28:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:12.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977234+0000", 2024-09-10T06:28:12.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7969999999999998e-06 2024-09-10T06:28:12.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:12.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981211+0000", 2024-09-10T06:28:12.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039768329999999999 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981247+0000", 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6457e-05 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981274+0000", 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6917999999999999e-05 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981446+0000", 2024-09-10T06:28:12.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171831 2024-09-10T06:28:12.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:12.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981719+0000", 2024-09-10T06:28:12.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027282800000000002 2024-09-10T06:28:12.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:12.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981975+0000", 2024-09-10T06:28:12.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000256782 2024-09-10T06:28:12.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.991319+0000", 2024-09-10T06:28:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093433820000000008 2024-09-10T06:28:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998330+0000", 2024-09-10T06:28:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070108549999999999 2024-09-10T06:28:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998549+0000", 2024-09-10T06:28:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021944400000000001 2024-09-10T06:28:12.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998712+0000", 2024-09-10T06:28:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016332200000000001 2024-09-10T06:28:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1367 3.34 3:2f444f7f:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:12.950 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.862612499000001, 2024-09-10T06:28:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020931903000000002, 2024-09-10T06:28:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1367 2024-09-10T06:28:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:12.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070316+0000", 2024-09-10T06:28:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9029999999999997e-06 2024-09-10T06:28:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074255+0000", 2024-09-10T06:28:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039391679999999998 2024-09-10T06:28:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074291+0000", 2024-09-10T06:28:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5970000000000003e-05 2024-09-10T06:28:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074309+0000", 2024-09-10T06:28:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8399000000000001e-05 2024-09-10T06:28:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074436+0000", 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012683099999999999 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074686+0000", 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024971699999999999 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074907+0000", 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022124800000000001 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.084332+0000", 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094253449999999999 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.090954+0000", 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066213649999999997 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.091123+0000", 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169216 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.091244+0000", 2024-09-10T06:28:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120741 2024-09-10T06:28:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1375 3.1 e63/22 3:82031a0e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_130:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.769556463000001, 2024-09-10T06:28:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018270307999999999, 2024-09-10T06:28:12.956 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:12.957 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:12.957 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:12.957 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:12.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:12.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:12.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163370+0000", 2024-09-10T06:28:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8289999999999999e-06 2024-09-10T06:28:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:12.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167665+0000", 2024-09-10T06:28:12.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042940499999999998 2024-09-10T06:28:12.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:12.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167698+0000", 2024-09-10T06:28:12.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3484e-05 2024-09-10T06:28:12.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:12.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167714+0000", 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167847+0000", 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013299300000000001 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167890+0000", 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2434000000000001e-05 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181507+0000", 2024-09-10T06:28:12.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013616872 2024-09-10T06:28:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181638+0000", 2024-09-10T06:28:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013123099999999999 2024-09-10T06:28:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1380 3.3 3:c3afb574:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:12.961 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.721502328, 2024-09-10T06:28:12.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027193374999999999, 2024-09-10T06:28:12.962 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:12.962 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:12.962 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:12.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:12.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:12.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:12.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1380 2024-09-10T06:28:12.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.962 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:12.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:12.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:12.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:12.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:12.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:12.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211426+0000", 2024-09-10T06:28:12.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3599999999999998e-06 2024-09-10T06:28:12.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215383+0000", 2024-09-10T06:28:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039567450000000002 2024-09-10T06:28:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215417+0000", 2024-09-10T06:28:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4051000000000003e-05 2024-09-10T06:28:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:12.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215435+0000", 2024-09-10T06:28:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8459000000000001e-05 2024-09-10T06:28:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215626+0000", 2024-09-10T06:28:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019018299999999999 2024-09-10T06:28:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215991+0000", 2024-09-10T06:28:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036566099999999998 2024-09-10T06:28:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.216360+0000", 2024-09-10T06:28:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000368995 2024-09-10T06:28:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.226152+0000", 2024-09-10T06:28:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097914319999999992 2024-09-10T06:28:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238448+0000", 2024-09-10T06:28:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012295834 2024-09-10T06:28:12.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238538+0000", 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0539999999999997e-05 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238615+0000", 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7114999999999996e-05 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1383 3.3 3:c2c34097:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:12.967 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.690160614, 2024-09-10T06:28:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020753975000000001, 2024-09-10T06:28:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1383 2024-09-10T06:28:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242767+0000", 2024-09-10T06:28:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6169999999999998e-06 2024-09-10T06:28:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:12.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246704+0000", 2024-09-10T06:28:12.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003936485 2024-09-10T06:28:12.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:12.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246733+0000", 2024-09-10T06:28:12.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9819999999999999e-05 2024-09-10T06:28:12.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:12.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246748+0000", 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4334e-05 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246902+0000", 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015468 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.247286+0000", 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038366799999999999 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:12.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.247687+0000", 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000401252 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.257963+0000", 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010275584000000001 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263287+0000", 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053238499999999998 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:12.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263412+0000", 2024-09-10T06:28:12.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012516200000000001 2024-09-10T06:28:12.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:12.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263517+0000", 2024-09-10T06:28:12.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105523 2024-09-10T06:28:12.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.973 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:12.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.973 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1391 3.1c e63/22 3:3a76b5ac:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_146:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:12.973 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:12.973 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.605854600000001, 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026554852, 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327072+0000", 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6970000000000002e-06 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330874+0000", 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038016590000000002 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330928+0000", 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3729e-05 2024-09-10T06:28:12.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330956+0000", 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8694999999999999e-05 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.331147+0000", 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190841 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.331216+0000", 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8948999999999993e-05 2024-09-10T06:28:12.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:12.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.353521+0000", 2024-09-10T06:28:12.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022304781999999999 2024-09-10T06:28:12.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:12.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.353624+0000", 2024-09-10T06:28:12.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010349999999999999 2024-09-10T06:28:12.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.977 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:12.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.978 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1392 3.14 3:2b02aaa8:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:12.978 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:12.978 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.600875811, 2024-09-10T06:28:12.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024102582000000001, 2024-09-10T06:28:12.978 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:12.978 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:12.978 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:12.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:12.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:12.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:12.978 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1392 2024-09-10T06:28:12.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.978 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:12.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332052+0000", 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8999999999999999e-06 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:12.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.335987+0000", 2024-09-10T06:28:12.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039349800000000002 2024-09-10T06:28:12.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:12.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336020+0000", 2024-09-10T06:28:12.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2968e-05 2024-09-10T06:28:12.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:12.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336040+0000", 2024-09-10T06:28:12.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9956e-05 2024-09-10T06:28:12.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336155+0000", 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115275 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336404+0000", 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024874599999999999 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336626+0000", 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022168200000000001 2024-09-10T06:28:12.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:12.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.355854+0000", 2024-09-10T06:28:12.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019228624999999999 2024-09-10T06:28:12.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:12.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.355890+0000", 2024-09-10T06:28:12.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5901000000000001e-05 2024-09-10T06:28:12.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:12.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.356040+0000", 2024-09-10T06:28:12.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014919600000000001 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.356151+0000", 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111353 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1398 3.2c e63/22 3:350a23e7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_153:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.529782825, 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021444181, 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:12.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:12.984 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:12.984 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:12.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:12.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:12.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403144+0000", 2024-09-10T06:28:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.734e-06 2024-09-10T06:28:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406432+0000", 2024-09-10T06:28:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032884500000000001 2024-09-10T06:28:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406473+0000", 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0834000000000002e-05 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406492+0000", 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8868999999999998e-05 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406632+0000", 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140183 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406698+0000", 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5913000000000004e-05 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424483+0000", 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017785108000000001 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424585+0000", 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010208999999999999 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.987 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1415 3.2c e63/22 3:34c14757:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_160:head v 63'5, mlcod=63'3)", 2024-09-10T06:28:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.464932366999999, 2024-09-10T06:28:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023773743999999999, 2024-09-10T06:28:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:12.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:12.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:12.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:12.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:12.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467994+0000", 2024-09-10T06:28:12.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471376+0000", 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033818099999999999 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471426+0000", 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9846999999999999e-05 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471452+0000", 2024-09-10T06:28:12.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6327999999999999e-05 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471621+0000", 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016928200000000001 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.472399+0000", 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000777171 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.491634+0000", 2024-09-10T06:28:12.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019235070999999999 2024-09-10T06:28:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.491766+0000", 2024-09-10T06:28:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013176799999999999 2024-09-10T06:28:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1417 3.14 3:29141a67:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.45199837, 2024-09-10T06:28:12.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026932543, 2024-09-10T06:28:12.993 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:12.993 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:12.993 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:12.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:12.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:12.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:12.993 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1417 2024-09-10T06:28:12.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.993 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:12.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:12.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:12.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:12.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:12.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:12.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:12.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480929+0000", 2024-09-10T06:28:12.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-10T06:28:12.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:12.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486391+0000", 2024-09-10T06:28:12.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054618599999999998 2024-09-10T06:28:12.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:12.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486425+0000", 2024-09-10T06:28:12.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4031e-05 2024-09-10T06:28:12.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:12.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486443+0000", 2024-09-10T06:28:12.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7878999999999999e-05 2024-09-10T06:28:12.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:12.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486581+0000", 2024-09-10T06:28:12.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013773400000000001 2024-09-10T06:28:12.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486836+0000", 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025529900000000001 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.487064+0000", 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000228438 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.505216+0000", 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018152130999999998 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:12.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507597+0000", 2024-09-10T06:28:12.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023807260000000001 2024-09-10T06:28:12.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:12.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507690+0000", 2024-09-10T06:28:12.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2305999999999993e-05 2024-09-10T06:28:12.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:12.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507858+0000", 2024-09-10T06:28:12.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016879199999999999 2024-09-10T06:28:12.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.998 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:12.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:12.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:12.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:12.999 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1418 3.24 e63/22 3:26ca0de9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_163:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:12.999 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.493351+0000", 2024-09-10T06:28:12.999 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.43957361, 2024-09-10T06:28:12.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01657111, 2024-09-10T06:28:12.999 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:12.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.000 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.000 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493351+0000", 2024-09-10T06:28:13.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493351+0000", 2024-09-10T06:28:13.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493353+0000", 2024-09-10T06:28:13.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5830000000000001e-06 2024-09-10T06:28:13.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499691+0000", 2024-09-10T06:28:13.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063376029999999998 2024-09-10T06:28:13.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499724+0000", 2024-09-10T06:28:13.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3124999999999999e-05 2024-09-10T06:28:13.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499741+0000", 2024-09-10T06:28:13.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6852000000000001e-05 2024-09-10T06:28:13.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499853+0000", 2024-09-10T06:28:13.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011278899999999999 2024-09-10T06:28:13.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.499897+0000", 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3789999999999999e-05 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.509788+0000", 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098906770000000005 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.509922+0000", 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013369099999999999 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.004 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.005 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.005 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1424 3.14 3:28df499c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:13.005 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:13.005 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.385426646999999, 2024-09-10T06:28:13.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017872099999999998, 2024-09-10T06:28:13.005 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.005 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.005 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.006 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1424 2024-09-10T06:28:13.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.006 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:13.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:13.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547500+0000", 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.999e-06 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551376+0000", 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038754010000000001 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551401+0000", 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5476000000000001e-05 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551413+0000", 2024-09-10T06:28:13.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2082999999999999e-05 2024-09-10T06:28:13.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551486+0000", 2024-09-10T06:28:13.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2793999999999995e-05 2024-09-10T06:28:13.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551610+0000", 2024-09-10T06:28:13.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123993 2024-09-10T06:28:13.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551718+0000", 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107357 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.559898+0000", 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081805860000000001 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565204+0000", 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053053589999999999 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565296+0000", 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2291000000000001e-05 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565370+0000", 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3761000000000001e-05 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1429 3.1a 3:5acc80b6:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:13.010 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:13.011 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.335561588999999, 2024-09-10T06:28:13.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020448872999999999, 2024-09-10T06:28:13.011 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.011 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.011 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.011 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1429 2024-09-10T06:28:13.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.011 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:13.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:13.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597365+0000", 2024-09-10T06:28:13.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2759999999999999e-06 2024-09-10T06:28:13.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601186+0000", 2024-09-10T06:28:13.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038214410000000001 2024-09-10T06:28:13.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601212+0000", 2024-09-10T06:28:13.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5522999999999999e-05 2024-09-10T06:28:13.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601222+0000", 2024-09-10T06:28:13.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0584999999999999e-05 2024-09-10T06:28:13.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601314+0000", 2024-09-10T06:28:13.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1484999999999996e-05 2024-09-10T06:28:13.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601494+0000", 2024-09-10T06:28:13.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018006899999999999 2024-09-10T06:28:13.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601655+0000", 2024-09-10T06:28:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016119999999999999 2024-09-10T06:28:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.607352+0000", 2024-09-10T06:28:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056970500000000004 2024-09-10T06:28:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617735+0000", 2024-09-10T06:28:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010382769 2024-09-10T06:28:13.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617780+0000", 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5145999999999998e-05 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617811+0000", 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1328999999999998e-05 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.016 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1433 3.1a 3:59ee0094:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.285947605, 2024-09-10T06:28:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024407437000000001, 2024-09-10T06:28:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1433 2024-09-10T06:28:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646979+0000", 2024-09-10T06:28:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.074e-06 2024-09-10T06:28:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.650998+0000", 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040192470000000001 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651031+0000", 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2821000000000003e-05 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651050+0000", 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9556e-05 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651150+0000", 2024-09-10T06:28:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9689e-05 2024-09-10T06:28:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651325+0000", 2024-09-10T06:28:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017529199999999999 2024-09-10T06:28:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651496+0000", 2024-09-10T06:28:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000170531 2024-09-10T06:28:13.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.659894+0000", 2024-09-10T06:28:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083978049999999995 2024-09-10T06:28:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671085+0000", 2024-09-10T06:28:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011190989 2024-09-10T06:28:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671261+0000", 2024-09-10T06:28:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017616800000000001 2024-09-10T06:28:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671384+0000", 2024-09-10T06:28:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012326500000000001 2024-09-10T06:28:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1470 3.34 3:2e4989bb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:13.022 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:13.023 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.888755678999999, 2024-09-10T06:28:13.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019466533000000001, 2024-09-10T06:28:13.023 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.023 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1470 2024-09-10T06:28:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:13.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044172+0000", 2024-09-10T06:28:13.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5939999999999998e-06 2024-09-10T06:28:13.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048101+0000", 2024-09-10T06:28:13.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003929325 2024-09-10T06:28:13.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048135+0000", 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3856000000000002e-05 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048150+0000", 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.523e-05 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048258+0000", 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108025 2024-09-10T06:28:13.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048437+0000", 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017811199999999999 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048550+0000", 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113181 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063173+0000", 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014623565 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063361+0000", 2024-09-10T06:28:13.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018807599999999999 2024-09-10T06:28:13.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063499+0000", 2024-09-10T06:28:13.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013745000000000001 2024-09-10T06:28:13.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063635+0000", 2024-09-10T06:28:13.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136119 2024-09-10T06:28:13.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.029 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.029 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.029 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1472 3.34 3:2e34818b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_217:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:13.029 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.062471+0000", 2024-09-10T06:28:13.029 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.870453449999999, 2024-09-10T06:28:13.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016070911, 2024-09-10T06:28:13.029 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.029 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.030 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1472 2024-09-10T06:28:13.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.030 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.062471+0000", 2024-09-10T06:28:13.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.062471+0000", 2024-09-10T06:28:13.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.062473+0000", 2024-09-10T06:28:13.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0190000000000001e-06 2024-09-10T06:28:13.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066284+0000", 2024-09-10T06:28:13.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038111659999999999 2024-09-10T06:28:13.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066302+0000", 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8216e-05 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066311+0000", 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7460000000000006e-06 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066370+0000", 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9292000000000001e-05 2024-09-10T06:28:13.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066526+0000", 2024-09-10T06:28:13.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155783 2024-09-10T06:28:13.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:13.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.066639+0000", 2024-09-10T06:28:13.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113212 2024-09-10T06:28:13.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078013+0000", 2024-09-10T06:28:13.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011373822 2024-09-10T06:28:13.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078408+0000", 2024-09-10T06:28:13.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000395086 2024-09-10T06:28:13.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078486+0000", 2024-09-10T06:28:13.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8176999999999994e-05 2024-09-10T06:28:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.078542+0000", 2024-09-10T06:28:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5392000000000001e-05 2024-09-10T06:28:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1674 3.e e66/22 3:71dde5c5:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_14:head v 66'6, mlcod=64'4)", 2024-09-10T06:28:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.936559+0000", 2024-09-10T06:28:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.9963654829999999, 2024-09-10T06:28:13.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020541475999999999, 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936559+0000", 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936559+0000", 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936562+0000", 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9000000000000002e-06 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939051+0000", 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024898899999999998 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939094+0000", 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2874999999999999e-05 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939115+0000", 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0213000000000001e-05 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939294+0000", 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017977299999999999 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939359+0000", 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4596000000000003e-05 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.956969+0000", 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017610223000000001 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957100+0000", 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131006 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1677 3.34 3:2e18bed5:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.968824+0000", 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.9640998620000003, 2024-09-10T06:28:13.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017983664999999999, 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1677 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.968824+0000", 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.968824+0000", 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.968827+0000", 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7489999999999999e-06 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974158+0000", 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005330942 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974178+0000", 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0143e-05 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974187+0000", 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0250000000000008e-06 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974240+0000", 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3341000000000003e-05 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974350+0000", 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109874 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974445+0000", 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4730999999999998e-05 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.980411+0000", 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059658100000000002 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.986640+0000", 2024-09-10T06:28:13.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062289110000000002 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.986733+0000", 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3646000000000004e-05 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.986808+0000", 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4493000000000007e-05 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.044 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.045 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:13.046 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:28:13.047 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:13.044+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:13.147 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:13.144+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:13.214 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:13.215 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:13.215 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:13.215 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:13.228 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:28:13.273 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:13.272+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:13.350 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:13.347+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:13.395 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:13.395 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:13.395 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:13.395 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:13.395 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:13.409 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:28:13.451 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:13.447+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:13.529 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:13.529 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:13.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:13.529 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:13.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.529 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1354 3.5 3:a2100466:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:13.529 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:13.529 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.608181235, 2024-09-10T06:28:13.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022320934000000001, 2024-09-10T06:28:13.529 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.529 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.530 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.530 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1354 2024-09-10T06:28:13.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.530 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:13.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919975+0000", 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4369999999999999e-06 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926675+0000", 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066993529999999999 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926705+0000", 2024-09-10T06:28:13.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0391000000000001e-05 2024-09-10T06:28:13.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926722+0000", 2024-09-10T06:28:13.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7159e-05 2024-09-10T06:28:13.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926840+0000", 2024-09-10T06:28:13.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117459 2024-09-10T06:28:13.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.927092+0000", 2024-09-10T06:28:13.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025180899999999997 2024-09-10T06:28:13.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:13.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.927353+0000", 2024-09-10T06:28:13.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026148499999999999 2024-09-10T06:28:13.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.940116+0000", 2024-09-10T06:28:13.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01276245 2024-09-10T06:28:13.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.941993+0000", 2024-09-10T06:28:13.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001877079 2024-09-10T06:28:13.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.942164+0000", 2024-09-10T06:28:13.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171378 2024-09-10T06:28:13.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.942293+0000", 2024-09-10T06:28:13.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012893400000000001 2024-09-10T06:28:13.535 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.535 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.535 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.535 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1355 3.16 3:6be207af:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:13.535 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:13.536 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.597431633999999, 2024-09-10T06:28:13.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023027044, 2024-09-10T06:28:13.536 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.536 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.536 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.536 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.536 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.536 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.536 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1355 2024-09-10T06:28:13.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.536 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930724+0000", 2024-09-10T06:28:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5100000000000001e-06 2024-09-10T06:28:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937234+0000", 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065097760000000001 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937259+0000", 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4915000000000001e-05 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937275+0000", 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6659000000000001e-05 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937437+0000", 2024-09-10T06:28:13.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161259 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937718+0000", 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028092699999999999 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937955+0000", 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023767300000000001 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.952527+0000", 2024-09-10T06:28:13.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014571850000000001 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953577+0000", 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001049601 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953671+0000", 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4580000000000006e-05 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953749+0000", 2024-09-10T06:28:13.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7293999999999996e-05 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1369 3.22 3:45ffca16:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.433378133, 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020833028999999999, 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.542 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1369 2024-09-10T06:28:13.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.542 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:13.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:13.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094779+0000", 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1099999999999996e-06 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100674+0000", 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058944740000000002 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100714+0000", 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0527e-05 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100732+0000", 2024-09-10T06:28:13.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8034999999999999e-05 2024-09-10T06:28:13.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100871+0000", 2024-09-10T06:28:13.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013849399999999999 2024-09-10T06:28:13.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.101123+0000", 2024-09-10T06:28:13.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025259000000000002 2024-09-10T06:28:13.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.101372+0000", 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024846599999999998 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.111593+0000", 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010221165000000001 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115305+0000", 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037123249999999998 2024-09-10T06:28:13.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115476+0000", 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017085200000000001 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115608+0000", 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131991 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1372 3.36 e63/22 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:13.546 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:13.547 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.389755627, 2024-09-10T06:28:13.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018914395000000001, 2024-09-10T06:28:13.547 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.547 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.547 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.547 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:13.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:13.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138401+0000", 2024-09-10T06:28:13.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3859999999999999e-06 2024-09-10T06:28:13.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142599+0000", 2024-09-10T06:28:13.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041982190000000004 2024-09-10T06:28:13.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142649+0000", 2024-09-10T06:28:13.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9477000000000001e-05 2024-09-10T06:28:13.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142674+0000", 2024-09-10T06:28:13.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5558000000000002e-05 2024-09-10T06:28:13.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142832+0000", 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158159 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142879+0000", 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6650000000000002e-05 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157209+0000", 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014330209999999999 2024-09-10T06:28:13.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157312+0000", 2024-09-10T06:28:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102736 2024-09-10T06:28:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1373 3.35 e63/22 3:ac8a3287:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_128:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.148374+0000", 2024-09-10T06:28:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.379778910000001, 2024-09-10T06:28:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017663458999999999, 2024-09-10T06:28:13.551 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.552 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.552 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.552 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148374+0000", 2024-09-10T06:28:13.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148374+0000", 2024-09-10T06:28:13.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148378+0000", 2024-09-10T06:28:13.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4869999999999998e-06 2024-09-10T06:28:13.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153210+0000", 2024-09-10T06:28:13.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048319130000000002 2024-09-10T06:28:13.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153243+0000", 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3794000000000002e-05 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153266+0000", 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2841999999999999e-05 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153394+0000", 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012804099999999999 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153432+0000", 2024-09-10T06:28:13.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7194000000000003e-05 2024-09-10T06:28:13.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.165933+0000", 2024-09-10T06:28:13.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012501583 2024-09-10T06:28:13.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166038+0000", 2024-09-10T06:28:13.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010460500000000001 2024-09-10T06:28:13.555 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.555 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.556 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.556 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1374 3.2f 3:f735f5eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:13.556 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:13.556 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.374731327999999, 2024-09-10T06:28:13.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028841426, 2024-09-10T06:28:13.556 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.556 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.556 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.556 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1374 2024-09-10T06:28:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153425+0000", 2024-09-10T06:28:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8030000000000001e-06 2024-09-10T06:28:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157050+0000", 2024-09-10T06:28:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036249070000000001 2024-09-10T06:28:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157081+0000", 2024-09-10T06:28:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1525000000000001e-05 2024-09-10T06:28:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157103+0000", 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1599000000000001e-05 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157253+0000", 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150266 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157545+0000", 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029204399999999998 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:13.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157898+0000", 2024-09-10T06:28:13.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035326200000000002 2024-09-10T06:28:13.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181021+0000", 2024-09-10T06:28:13.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023123008 2024-09-10T06:28:13.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181894+0000", 2024-09-10T06:28:13.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00087308700000000004 2024-09-10T06:28:13.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.182128+0000", 2024-09-10T06:28:13.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000233811 2024-09-10T06:28:13.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.182263+0000", 2024-09-10T06:28:13.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013511400000000001 2024-09-10T06:28:13.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.562 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.562 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.562 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1391 3.1c 3:3a76b5ac:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:13.562 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:13.562 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.205994322, 2024-09-10T06:28:13.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032016492000000001, 2024-09-10T06:28:13.562 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.562 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.562 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.562 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.563 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1391 2024-09-10T06:28:13.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.563 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:13.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:13.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322162+0000", 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.523e-06 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326140+0000", 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039776000000000004 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326177+0000", 2024-09-10T06:28:13.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6878000000000002e-05 2024-09-10T06:28:13.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326195+0000", 2024-09-10T06:28:13.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8576e-05 2024-09-10T06:28:13.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326334+0000", 2024-09-10T06:28:13.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013836600000000001 2024-09-10T06:28:13.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326608+0000", 2024-09-10T06:28:13.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000274586 2024-09-10T06:28:13.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:13.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326847+0000", 2024-09-10T06:28:13.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023812 2024-09-10T06:28:13.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.338793+0000", 2024-09-10T06:28:13.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011946141 2024-09-10T06:28:13.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354011+0000", 2024-09-10T06:28:13.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015217856 2024-09-10T06:28:13.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354100+0000", 2024-09-10T06:28:13.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9497e-05 2024-09-10T06:28:13.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354175+0000", 2024-09-10T06:28:13.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5349e-05 2024-09-10T06:28:13.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.568 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.568 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1399 3.38 e63/22 3:1dcd0b88:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_154:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:13.568 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:13.568 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.122423215, 2024-09-10T06:28:13.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019306528999999999, 2024-09-10T06:28:13.568 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.568 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.568 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405734+0000", 2024-09-10T06:28:13.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2529999999999998e-06 2024-09-10T06:28:13.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410725+0000", 2024-09-10T06:28:13.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049902849999999997 2024-09-10T06:28:13.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410776+0000", 2024-09-10T06:28:13.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1762999999999999e-05 2024-09-10T06:28:13.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410805+0000", 2024-09-10T06:28:13.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8274999999999999e-05 2024-09-10T06:28:13.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410984+0000", 2024-09-10T06:28:13.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017977800000000001 2024-09-10T06:28:13.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.411050+0000", 2024-09-10T06:28:13.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6115e-05 2024-09-10T06:28:13.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424826+0000", 2024-09-10T06:28:13.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013775267000000001 2024-09-10T06:28:13.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.425037+0000", 2024-09-10T06:28:13.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000210793 2024-09-10T06:28:13.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.572 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.572 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1421 3.16 3:69839037:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:13.572 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:13.573 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.009098829999999, 2024-09-10T06:28:13.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022412087000000001, 2024-09-10T06:28:13.573 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.573 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.573 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1421 2024-09-10T06:28:13.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.573 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:13.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:13.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519058+0000", 2024-09-10T06:28:13.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.354e-06 2024-09-10T06:28:13.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.522967+0000", 2024-09-10T06:28:13.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003909231 2024-09-10T06:28:13.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523003+0000", 2024-09-10T06:28:13.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5981e-05 2024-09-10T06:28:13.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523021+0000", 2024-09-10T06:28:13.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8362000000000001e-05 2024-09-10T06:28:13.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523166+0000", 2024-09-10T06:28:13.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014476699999999999 2024-09-10T06:28:13.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523435+0000", 2024-09-10T06:28:13.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026895800000000002 2024-09-10T06:28:13.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:13.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523671+0000", 2024-09-10T06:28:13.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023608099999999999 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538600+0000", 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014929318 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541356+0000", 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002755216 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541420+0000", 2024-09-10T06:28:13.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4775000000000002e-05 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541466+0000", 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6044000000000002e-05 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1423 3.5 3:a38f4fc9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_168:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.538548+0000", 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.989605190000001, 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017201465999999999, 2024-09-10T06:28:13.578 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.579 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.579 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.579 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1423 2024-09-10T06:28:13.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.579 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538548+0000", 2024-09-10T06:28:13.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538548+0000", 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538553+0000", 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7249999999999997e-06 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542507+0000", 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039544719999999997 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542538+0000", 2024-09-10T06:28:13.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1161000000000002e-05 2024-09-10T06:28:13.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542559+0000", 2024-09-10T06:28:13.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0953000000000001e-05 2024-09-10T06:28:13.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542674+0000", 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114788 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542804+0000", 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013024600000000001 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.542912+0000", 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107738 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.550500+0000", 2024-09-10T06:28:13.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075878769999999998 2024-09-10T06:28:13.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.555620+0000", 2024-09-10T06:28:13.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051202009999999996 2024-09-10T06:28:13.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.555693+0000", 2024-09-10T06:28:13.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2719000000000006e-05 2024-09-10T06:28:13.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.555749+0000", 2024-09-10T06:28:13.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6586000000000003e-05 2024-09-10T06:28:13.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.584 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.584 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.584 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1439 3.3c 3:3e1c16d9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:13.584 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:13.584 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.822227891000001, 2024-09-10T06:28:13.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020786124999999999, 2024-09-10T06:28:13.584 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.584 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.584 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.585 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1439 2024-09-10T06:28:13.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.585 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:13.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:13.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705929+0000", 2024-09-10T06:28:13.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1620000000000001e-06 2024-09-10T06:28:13.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.709954+0000", 2024-09-10T06:28:13.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004024344 2024-09-10T06:28:13.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.709991+0000", 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6868e-05 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710009+0000", 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8422000000000001e-05 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710091+0000", 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1440000000000006e-05 2024-09-10T06:28:13.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:13.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710105+0000", 2024-09-10T06:28:13.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4072e-05 2024-09-10T06:28:13.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.713970+0000", 2024-09-10T06:28:13.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038651699999999998 2024-09-10T06:28:13.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.714137+0000", 2024-09-10T06:28:13.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016704999999999999 2024-09-10T06:28:13.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:13.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.714352+0000", 2024-09-10T06:28:13.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021503099999999999 2024-09-10T06:28:13.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.721589+0000", 2024-09-10T06:28:13.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072370680000000001 2024-09-10T06:28:13.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726578+0000", 2024-09-10T06:28:13.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049887300000000002 2024-09-10T06:28:13.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726659+0000", 2024-09-10T06:28:13.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0972999999999999e-05 2024-09-10T06:28:13.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726711+0000", 2024-09-10T06:28:13.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2794999999999999e-05 2024-09-10T06:28:13.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.590 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1454 3.5 3:a08a9c17:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.657750200000001, 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018980882000000001, 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1454 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.591 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:13.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:13.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870407+0000", 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9090000000000002e-06 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874434+0000", 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040275700000000003 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874471+0000", 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6528e-05 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874496+0000", 2024-09-10T06:28:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4751000000000001e-05 2024-09-10T06:28:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874624+0000", 2024-09-10T06:28:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012825600000000001 2024-09-10T06:28:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874828+0000", 2024-09-10T06:28:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020377700000000001 2024-09-10T06:28:13.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.875010+0000", 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018253200000000001 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.883337+0000", 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083265860000000004 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889239+0000", 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059024409999999996 2024-09-10T06:28:13.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889322+0000", 2024-09-10T06:28:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2216e-05 2024-09-10T06:28:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889384+0000", 2024-09-10T06:28:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2316000000000004e-05 2024-09-10T06:28:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1463 3.c 3:32b18461:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.554778485, 2024-09-10T06:28:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019470828999999999, 2024-09-10T06:28:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1463 2024-09-10T06:28:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973377+0000", 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5749999999999999e-06 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977213+0000", 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038358789999999999 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977239+0000", 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5965999999999998e-05 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977252+0000", 2024-09-10T06:28:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2472e-05 2024-09-10T06:28:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977406+0000", 2024-09-10T06:28:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000154809 2024-09-10T06:28:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977687+0000", 2024-09-10T06:28:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028013400000000003 2024-09-10T06:28:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977963+0000", 2024-09-10T06:28:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027642500000000001 2024-09-10T06:28:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.987026+0000", 2024-09-10T06:28:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090629430000000004 2024-09-10T06:28:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992655+0000", 2024-09-10T06:28:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056288320000000003 2024-09-10T06:28:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992765+0000", 2024-09-10T06:28:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110276 2024-09-10T06:28:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992846+0000", 2024-09-10T06:28:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0518000000000004e-05 2024-09-10T06:28:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1469 3.d e64/22 3:b3f21559:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_214:head v 64'1, mlcod=0'0)", 2024-09-10T06:28:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.488473528, 2024-09-10T06:28:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01994638, 2024-09-10T06:28:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039683+0000", 2024-09-10T06:28:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0929999999999999e-06 2024-09-10T06:28:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044782+0000", 2024-09-10T06:28:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050988240000000001 2024-09-10T06:28:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044821+0000", 2024-09-10T06:28:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9764000000000001e-05 2024-09-10T06:28:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044839+0000", 2024-09-10T06:28:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7598999999999999e-05 2024-09-10T06:28:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044936+0000", 2024-09-10T06:28:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7388999999999999e-05 2024-09-10T06:28:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044962+0000", 2024-09-10T06:28:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5967999999999999e-05 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059554+0000", 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014592055 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059626+0000", 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1687999999999995e-05 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1482 3.35 e64/22 3:ad9242de:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_227:head v 64'5, mlcod=63'3)", 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.164584+0000", 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.363568851, 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017917325000000001, 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164584+0000", 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164584+0000", 2024-09-10T06:28:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164585+0000", 2024-09-10T06:28:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8700000000000002e-07 2024-09-10T06:28:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166303+0000", 2024-09-10T06:28:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001718853 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166326+0000", 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2432000000000001e-05 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166337+0000", 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0706999999999999e-05 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166414+0000", 2024-09-10T06:28:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7855999999999995e-05 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.166443+0000", 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8827999999999999e-05 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182419+0000", 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015975432000000001 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182502+0000", 2024-09-10T06:28:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2929999999999994e-05 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1503 3.1c 3:383b1d54:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_248:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.369146+0000", 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.15900686, 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016922006999999999, 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1503 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.369146+0000", 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.369146+0000", 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.369149+0000", 2024-09-10T06:28:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4339999999999999e-06 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.372988+0000", 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003839248 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373020+0000", 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2293999999999999e-05 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373036+0000", 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5875e-05 2024-09-10T06:28:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373142+0000", 2024-09-10T06:28:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105469 2024-09-10T06:28:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373265+0000", 2024-09-10T06:28:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012343799999999999 2024-09-10T06:28:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.373374+0000", 2024-09-10T06:28:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108656 2024-09-10T06:28:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.383143+0000", 2024-09-10T06:28:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097691649999999998 2024-09-10T06:28:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.385934+0000", 2024-09-10T06:28:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027914419999999999 2024-09-10T06:28:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.386009+0000", 2024-09-10T06:28:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4734000000000006e-05 2024-09-10T06:28:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.386068+0000", 2024-09-10T06:28:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252000000000001e-05 2024-09-10T06:28:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1671 3.37 e66/22 3:ed354b67:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_11:head v 66'6, mlcod=63'4)", 2024-09-10T06:28:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.902594+0000", 2024-09-10T06:28:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6255592760000006, 2024-09-10T06:28:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016672485000000001, 2024-09-10T06:28:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902594+0000", 2024-09-10T06:28:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902594+0000", 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902596+0000", 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.232e-06 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906073+0000", 2024-09-10T06:28:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034771849999999998 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906111+0000", 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7178000000000002e-05 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906134+0000", 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3697999999999999e-05 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906262+0000", 2024-09-10T06:28:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012822300000000001 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.906304+0000", 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1106999999999998e-05 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919150+0000", 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012846781999999999 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919266+0000", 2024-09-10T06:28:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011608 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1672 3.c 3:33a5f042:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.6208001490000008, 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019487879999999999, 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1672 2024-09-10T06:28:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907355+0000", 2024-09-10T06:28:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.43e-06 2024-09-10T06:28:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.911999+0000", 2024-09-10T06:28:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046435979999999996 2024-09-10T06:28:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912047+0000", 2024-09-10T06:28:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8204000000000001e-05 2024-09-10T06:28:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912078+0000", 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0998999999999999e-05 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912197+0000", 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119165 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912368+0000", 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000170111 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912532+0000", 2024-09-10T06:28:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016403000000000001 2024-09-10T06:28:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.920064+0000", 2024-09-10T06:28:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007531973 2024-09-10T06:28:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926719+0000", 2024-09-10T06:28:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066550840000000003 2024-09-10T06:28:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926786+0000", 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7267999999999994e-05 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926841+0000", 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5018000000000001e-05 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1676 3.3c 3:3fe08b90:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.956218+0000", 2024-09-10T06:28:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.5719348540000002, 2024-09-10T06:28:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017380520999999999, 2024-09-10T06:28:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1676 2024-09-10T06:28:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.956218+0000", 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.956218+0000", 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.956223+0000", 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6970000000000001e-06 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.960875+0000", 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046524269999999998 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.960911+0000", 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5689000000000003e-05 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.960930+0000", 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9110000000000002e-05 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.961057+0000", 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001272 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.961319+0000", 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000261041 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.961552+0000", 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000233129 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.970290+0000", 2024-09-10T06:28:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087384939999999994 2024-09-10T06:28:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.973498+0000", 2024-09-10T06:28:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032079489999999999 2024-09-10T06:28:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.973545+0000", 2024-09-10T06:28:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6971000000000001e-05 2024-09-10T06:28:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.973599+0000", 2024-09-10T06:28:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3813999999999997e-05 2024-09-10T06:28:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1679 3.22 3:44bf1ad9:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.991719+0000", 2024-09-10T06:28:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.5364339339999997, 2024-09-10T06:28:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017288846, 2024-09-10T06:28:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1679 2024-09-10T06:28:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.991719+0000", 2024-09-10T06:28:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.991719+0000", 2024-09-10T06:28:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.991721+0000", 2024-09-10T06:28:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1019999999999999e-06 2024-09-10T06:28:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.995487+0000", 2024-09-10T06:28:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003765975 2024-09-10T06:28:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.995506+0000", 2024-09-10T06:28:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8966000000000001e-05 2024-09-10T06:28:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.995516+0000", 2024-09-10T06:28:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6509999999999996e-06 2024-09-10T06:28:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.995574+0000", 2024-09-10T06:28:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8486999999999998e-05 2024-09-10T06:28:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.995698+0000", 2024-09-10T06:28:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012344799999999999 2024-09-10T06:28:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.995796+0000", 2024-09-10T06:28:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8422000000000001e-05 2024-09-10T06:28:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.001740+0000", 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059432629999999998 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.008886+0000", 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071467320000000003 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.008956+0000", 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9636999999999998e-05 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.009008+0000", 2024-09-10T06:28:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2163000000000002e-05 2024-09-10T06:28:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:13.639 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:13.641 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-10T06:28:13.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:28:13.641 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:13.640+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:13.741 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:13.740+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:13.812 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:13.812 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:13.813 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:13.813 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:13.827 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:28:13.868 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:13.868+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:13.944 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:13.944+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:13.990 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:13.990 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:14.007 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:28:14.048 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:14.048+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:14.146 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:14.143+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:14.172 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:14.173 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:14.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:14.173 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:14.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.173 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-10T06:28:14.173 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:28:14.173 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 95.890199709000001, 2024-09-10T06:28:14.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016848367, 2024-09-10T06:28:14.173 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.173 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.173 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.174 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 46 2024-09-10T06:28:14.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.174 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:28:14.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280017+0000", 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280021+0000", 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0069999999999999e-06 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280036+0000", 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.483e-05 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280070+0000", 2024-09-10T06:28:14.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4106000000000002e-05 2024-09-10T06:28:14.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280094+0000", 2024-09-10T06:28:14.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4037e-05 2024-09-10T06:28:14.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280246+0000", 2024-09-10T06:28:14.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000152199 2024-09-10T06:28:14.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.280271+0000", 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4581999999999999e-05 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.289388+0000", 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091175639999999999 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.290774+0000", 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013859860000000001 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:14.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.291069+0000", 2024-09-10T06:28:14.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000294534 2024-09-10T06:28:14.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.295828+0000", 2024-09-10T06:28:14.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047595729999999996 2024-09-10T06:28:14.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296614+0000", 2024-09-10T06:28:14.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00078534700000000004 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296759+0000", 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014571300000000001 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:38.296865+0000", 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105889 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.180 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1357 3.1e e63/22 3:7863b3e2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_112:head v 63'1, mlcod=0'0)", 2024-09-10T06:28:14.180 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.960485+0000", 2024-09-10T06:28:14.180 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.209732101, 2024-09-10T06:28:14.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017126476000000002, 2024-09-10T06:28:14.180 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.180 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.180 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.180 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.960485+0000", 2024-09-10T06:28:14.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.960485+0000", 2024-09-10T06:28:14.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.960487+0000", 2024-09-10T06:28:14.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6230000000000001e-06 2024-09-10T06:28:14.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966394+0000", 2024-09-10T06:28:14.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059067119999999997 2024-09-10T06:28:14.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966432+0000", 2024-09-10T06:28:14.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8133000000000002e-05 2024-09-10T06:28:14.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966453+0000", 2024-09-10T06:28:14.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0536000000000001e-05 2024-09-10T06:28:14.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966585+0000", 2024-09-10T06:28:14.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013260400000000001 2024-09-10T06:28:14.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.966628+0000", 2024-09-10T06:28:14.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3273999999999999e-05 2024-09-10T06:28:14.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977524+0000", 2024-09-10T06:28:14.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010895207000000001 2024-09-10T06:28:14.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977611+0000", 2024-09-10T06:28:14.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7386999999999995e-05 2024-09-10T06:28:14.184 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.184 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.184 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.184 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1359 3.34 e63/22 3:2ece4e0b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_114:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:14.184 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.982175+0000", 2024-09-10T06:28:14.184 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.188041869999999, 2024-09-10T06:28:14.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015763586999999999, 2024-09-10T06:28:14.185 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.185 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.185 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.185 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.982175+0000", 2024-09-10T06:28:14.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.982175+0000", 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.982177+0000", 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.616e-06 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984716+0000", 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00253885 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984752+0000", 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6060999999999999e-05 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984773+0000", 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0288e-05 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.984930+0000", 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157446 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.985015+0000", 2024-09-10T06:28:14.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4744e-05 2024-09-10T06:28:14.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.997786+0000", 2024-09-10T06:28:14.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012770826000000001 2024-09-10T06:28:14.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.997938+0000", 2024-09-10T06:28:14.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015275600000000001 2024-09-10T06:28:14.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.188 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.189 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1363 3.a 3:52044754:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:14.189 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:14.189 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.146988286999999, 2024-09-10T06:28:14.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021475438999999999, 2024-09-10T06:28:14.189 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.189 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.189 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1363 2024-09-10T06:28:14.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023232+0000", 2024-09-10T06:28:14.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6500000000000002e-06 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027903+0000", 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046709569999999999 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027944+0000", 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1e-05 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027963+0000", 2024-09-10T06:28:14.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9363000000000001e-05 2024-09-10T06:28:14.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028108+0000", 2024-09-10T06:28:14.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144306 2024-09-10T06:28:14.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028370+0000", 2024-09-10T06:28:14.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026210300000000002 2024-09-10T06:28:14.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:14.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028610+0000", 2024-09-10T06:28:14.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024058 2024-09-10T06:28:14.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.036472+0000", 2024-09-10T06:28:14.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078620170000000007 2024-09-10T06:28:14.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044306+0000", 2024-09-10T06:28:14.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078340070000000005 2024-09-10T06:28:14.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044496+0000", 2024-09-10T06:28:14.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189507 2024-09-10T06:28:14.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044704+0000", 2024-09-10T06:28:14.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207949 2024-09-10T06:28:14.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.194 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.194 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1364 3.36 3:6e968b0d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.134996749000001, 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022135317000000002, 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1364 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035266+0000", 2024-09-10T06:28:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6529999999999997e-05 2024-09-10T06:28:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039528+0000", 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042612580000000004 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039570+0000", 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2481000000000002e-05 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039594+0000", 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3564999999999999e-05 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039735+0000", 2024-09-10T06:28:14.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014147000000000001 2024-09-10T06:28:14.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039983+0000", 2024-09-10T06:28:14.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024765399999999998 2024-09-10T06:28:14.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:14.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.040216+0000", 2024-09-10T06:28:14.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023322999999999999 2024-09-10T06:28:14.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.049930+0000", 2024-09-10T06:28:14.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097135920000000001 2024-09-10T06:28:14.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057061+0000", 2024-09-10T06:28:14.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071309570000000003 2024-09-10T06:28:14.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057234+0000", 2024-09-10T06:28:14.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173308 2024-09-10T06:28:14.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057355+0000", 2024-09-10T06:28:14.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121272 2024-09-10T06:28:14.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.200 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.200 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1370 3.26 3:64e41eab:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:14.201 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:14.201 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.060261217000001, 2024-09-10T06:28:14.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022030800999999999, 2024-09-10T06:28:14.201 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.201 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.201 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.201 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1370 2024-09-10T06:28:14.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.201 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:14.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:14.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109960+0000", 2024-09-10T06:28:14.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3930000000000001e-06 2024-09-10T06:28:14.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114711+0000", 2024-09-10T06:28:14.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047511580000000001 2024-09-10T06:28:14.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114749+0000", 2024-09-10T06:28:14.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8417999999999997e-05 2024-09-10T06:28:14.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114768+0000", 2024-09-10T06:28:14.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8352e-05 2024-09-10T06:28:14.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114926+0000", 2024-09-10T06:28:14.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015819599999999999 2024-09-10T06:28:14.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115321+0000", 2024-09-10T06:28:14.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039507300000000002 2024-09-10T06:28:14.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:14.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115735+0000", 2024-09-10T06:28:14.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041369900000000001 2024-09-10T06:28:14.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.125212+0000", 2024-09-10T06:28:14.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094774109999999998 2024-09-10T06:28:14.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131666+0000", 2024-09-10T06:28:14.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064533730000000001 2024-09-10T06:28:14.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131847+0000", 2024-09-10T06:28:14.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018112400000000001 2024-09-10T06:28:14.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131986+0000", 2024-09-10T06:28:14.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013960399999999999 2024-09-10T06:28:14.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.206 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1371 3.2e e63/22 3:741ddced:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_126:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.045300752999999, 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440024000000001, 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:14.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124919+0000", 2024-09-10T06:28:14.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-10T06:28:14.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130095+0000", 2024-09-10T06:28:14.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00517645 2024-09-10T06:28:14.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130125+0000", 2024-09-10T06:28:14.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9944e-05 2024-09-10T06:28:14.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130142+0000", 2024-09-10T06:28:14.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6515999999999999e-05 2024-09-10T06:28:14.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130252+0000", 2024-09-10T06:28:14.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110473 2024-09-10T06:28:14.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130297+0000", 2024-09-10T06:28:14.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5012999999999997e-05 2024-09-10T06:28:14.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149096+0000", 2024-09-10T06:28:14.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018799429999999999 2024-09-10T06:28:14.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149356+0000", 2024-09-10T06:28:14.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000259499 2024-09-10T06:28:14.211 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.211 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.211 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.211 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1372 3.36 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:14.211 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:14.211 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.037744129, 2024-09-10T06:28:14.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026714723999999999, 2024-09-10T06:28:14.211 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.211 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.211 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.211 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.211 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.212 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.212 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1372 2024-09-10T06:28:14.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.212 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:14.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:14.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132475+0000", 2024-09-10T06:28:14.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.65e-06 2024-09-10T06:28:14.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137399+0000", 2024-09-10T06:28:14.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049236530000000001 2024-09-10T06:28:14.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137432+0000", 2024-09-10T06:28:14.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3050999999999999e-05 2024-09-10T06:28:14.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137449+0000", 2024-09-10T06:28:14.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6976000000000001e-05 2024-09-10T06:28:14.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137569+0000", 2024-09-10T06:28:14.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012016899999999999 2024-09-10T06:28:14.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137884+0000", 2024-09-10T06:28:14.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031455799999999999 2024-09-10T06:28:14.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:14.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138191+0000", 2024-09-10T06:28:14.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000307466 2024-09-10T06:28:14.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157760+0000", 2024-09-10T06:28:14.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019569128000000002 2024-09-10T06:28:14.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157954+0000", 2024-09-10T06:28:14.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019375300000000001 2024-09-10T06:28:14.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158118+0000", 2024-09-10T06:28:14.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016390900000000001 2024-09-10T06:28:14.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.159187+0000", 2024-09-10T06:28:14.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010694109999999999 2024-09-10T06:28:14.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.217 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.217 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1373 3.35 3:ac8a3287:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:14.217 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:14.217 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.027411138, 2024-09-10T06:28:14.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023907627000000001, 2024-09-10T06:28:14.217 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.217 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.217 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.217 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.218 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1373 2024-09-10T06:28:14.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.218 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:14.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:14.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142810+0000", 2024-09-10T06:28:14.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6129999999999997e-06 2024-09-10T06:28:14.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.146972+0000", 2024-09-10T06:28:14.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041615180000000003 2024-09-10T06:28:14.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147029+0000", 2024-09-10T06:28:14.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7476000000000003e-05 2024-09-10T06:28:14.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147056+0000", 2024-09-10T06:28:14.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7021000000000001e-05 2024-09-10T06:28:14.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147249+0000", 2024-09-10T06:28:14.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019260999999999999 2024-09-10T06:28:14.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147702+0000", 2024-09-10T06:28:14.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045347999999999997 2024-09-10T06:28:14.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:14.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148113+0000", 2024-09-10T06:28:14.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041051899999999998 2024-09-10T06:28:14.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161583+0000", 2024-09-10T06:28:14.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013470278 2024-09-10T06:28:14.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166410+0000", 2024-09-10T06:28:14.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048270199999999996 2024-09-10T06:28:14.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166579+0000", 2024-09-10T06:28:14.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016839099999999999 2024-09-10T06:28:14.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166713+0000", 2024-09-10T06:28:14.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013470100000000001 2024-09-10T06:28:14.223 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.223 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.223 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.223 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1384 3.33 e63/22 3:cfe948dc:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_139:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:14.223 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.254532+0000", 2024-09-10T06:28:14.223 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.915684828, 2024-09-10T06:28:14.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015554659, 2024-09-10T06:28:14.223 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.223 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.223 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.254532+0000", 2024-09-10T06:28:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.254532+0000", 2024-09-10T06:28:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.254535+0000", 2024-09-10T06:28:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9170000000000002e-06 2024-09-10T06:28:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260133+0000", 2024-09-10T06:28:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055976969999999996 2024-09-10T06:28:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260168+0000", 2024-09-10T06:28:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5917000000000002e-05 2024-09-10T06:28:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260186+0000", 2024-09-10T06:28:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7538999999999999e-05 2024-09-10T06:28:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260307+0000", 2024-09-10T06:28:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121382 2024-09-10T06:28:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.260354+0000", 2024-09-10T06:28:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6507e-05 2024-09-10T06:28:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.269997+0000", 2024-09-10T06:28:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096426900000000006 2024-09-10T06:28:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.270087+0000", 2024-09-10T06:28:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.001e-05 2024-09-10T06:28:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.227 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1387 3.35 3:adfbe02e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.888282851, 2024-09-10T06:28:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021055645000000001, 2024-09-10T06:28:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1387 2024-09-10T06:28:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.228 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281938+0000", 2024-09-10T06:28:14.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0659999999999997e-06 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286048+0000", 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041104560000000002 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286097+0000", 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8715999999999999e-05 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286126+0000", 2024-09-10T06:28:14.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9308000000000001e-05 2024-09-10T06:28:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286279+0000", 2024-09-10T06:28:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015285400000000001 2024-09-10T06:28:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286520+0000", 2024-09-10T06:28:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024062000000000001 2024-09-10T06:28:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286772+0000", 2024-09-10T06:28:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025170599999999998 2024-09-10T06:28:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.301846+0000", 2024-09-10T06:28:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015074363 2024-09-10T06:28:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302698+0000", 2024-09-10T06:28:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000852179 2024-09-10T06:28:14.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302864+0000", 2024-09-10T06:28:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016568900000000001 2024-09-10T06:28:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302990+0000", 2024-09-10T06:28:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012568799999999999 2024-09-10T06:28:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1397 3.3f e63/41 3:ff95a35c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_152:head v 63'5, mlcod=63'3)", 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.385363+0000", 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.784853609000001, 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017789975999999999, 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.385363+0000", 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.385363+0000", 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.385366+0000", 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7329999999999999e-06 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390582+0000", 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052160740000000002 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390618+0000", 2024-09-10T06:28:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5818000000000002e-05 2024-09-10T06:28:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390637+0000", 2024-09-10T06:28:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9096000000000001e-05 2024-09-10T06:28:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390769+0000", 2024-09-10T06:28:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013195700000000001 2024-09-10T06:28:14.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.390810+0000", 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0734e-05 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403047+0000", 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012237534 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403153+0000", 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010603 2024-09-10T06:28:14.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1398 3.2c 3:350a23e7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.775239532000001, 2024-09-10T06:28:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032248536000000001, 2024-09-10T06:28:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1398 2024-09-10T06:28:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394981+0000", 2024-09-10T06:28:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7359999999999999e-06 2024-09-10T06:28:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402145+0000", 2024-09-10T06:28:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071643540000000004 2024-09-10T06:28:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402182+0000", 2024-09-10T06:28:14.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6318e-05 2024-09-10T06:28:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402200+0000", 2024-09-10T06:28:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8439000000000001e-05 2024-09-10T06:28:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402391+0000", 2024-09-10T06:28:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190917 2024-09-10T06:28:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402649+0000", 2024-09-10T06:28:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025817599999999999 2024-09-10T06:28:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402908+0000", 2024-09-10T06:28:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025864300000000002 2024-09-10T06:28:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424973+0000", 2024-09-10T06:28:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022065004999999999 2024-09-10T06:28:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.426990+0000", 2024-09-10T06:28:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020169340000000002 2024-09-10T06:28:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427129+0000", 2024-09-10T06:28:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139436 2024-09-10T06:28:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427226+0000", 2024-09-10T06:28:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6577999999999996e-05 2024-09-10T06:28:14.243 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1413 3.1e e63/22 3:79ea7bee:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_158:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.445858+0000", 2024-09-10T06:28:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.724358948999999, 2024-09-10T06:28:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015385619, 2024-09-10T06:28:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.445858+0000", 2024-09-10T06:28:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.445858+0000", 2024-09-10T06:28:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.445860+0000", 2024-09-10T06:28:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.706e-06 2024-09-10T06:28:14.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450317+0000", 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044569060000000001 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450355+0000", 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7293999999999999e-05 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450372+0000", 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7492000000000001e-05 2024-09-10T06:28:14.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450488+0000", 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011576199999999999 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.450533+0000", 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5046999999999997e-05 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.461119+0000", 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010585796 2024-09-10T06:28:14.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.461243+0000", 2024-09-10T06:28:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000124616 2024-09-10T06:28:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1415 3.2c 3:34c14757:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.707392534, 2024-09-10T06:28:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029598765999999999, 2024-09-10T06:28:14.248 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1415 2024-09-10T06:28:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462828+0000", 2024-09-10T06:28:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1999999999999996e-06 2024-09-10T06:28:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.466974+0000", 2024-09-10T06:28:14.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041452989999999999 2024-09-10T06:28:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467026+0000", 2024-09-10T06:28:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2416000000000001e-05 2024-09-10T06:28:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467055+0000", 2024-09-10T06:28:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9081000000000002e-05 2024-09-10T06:28:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467207+0000", 2024-09-10T06:28:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015225699999999999 2024-09-10T06:28:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467468+0000", 2024-09-10T06:28:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026093500000000001 2024-09-10T06:28:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467755+0000", 2024-09-10T06:28:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000287101 2024-09-10T06:28:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477312+0000", 2024-09-10T06:28:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095560300000000001 2024-09-10T06:28:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492136+0000", 2024-09-10T06:28:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014824936 2024-09-10T06:28:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492301+0000", 2024-09-10T06:28:14.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016411600000000001 2024-09-10T06:28:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492423+0000", 2024-09-10T06:28:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122395 2024-09-10T06:28:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1416 3.10 3:084717f7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.698358285999999, 2024-09-10T06:28:14.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021526931999999999, 2024-09-10T06:28:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1416 2024-09-10T06:28:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:14.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471863+0000", 2024-09-10T06:28:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-10T06:28:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477370+0000", 2024-09-10T06:28:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055071549999999997 2024-09-10T06:28:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477402+0000", 2024-09-10T06:28:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1498000000000002e-05 2024-09-10T06:28:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477423+0000", 2024-09-10T06:28:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1098e-05 2024-09-10T06:28:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477559+0000", 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136627 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477936+0000", 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037718099999999998 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.478271+0000", 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033427799999999997 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.490997+0000", 2024-09-10T06:28:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012725858 2024-09-10T06:28:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493126+0000", 2024-09-10T06:28:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002129499 2024-09-10T06:28:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493263+0000", 2024-09-10T06:28:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013682500000000001 2024-09-10T06:28:14.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493385+0000", 2024-09-10T06:28:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122414 2024-09-10T06:28:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1466 3.a 3:52715822:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_211:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.004814+0000", 2024-09-10T06:28:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.165402955999999, 2024-09-10T06:28:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01610396, 2024-09-10T06:28:14.260 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1466 2024-09-10T06:28:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.004814+0000", 2024-09-10T06:28:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.004814+0000", 2024-09-10T06:28:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.004817+0000", 2024-09-10T06:28:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.993e-06 2024-09-10T06:28:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.009941+0000", 2024-09-10T06:28:14.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051237699999999997 2024-09-10T06:28:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.009977+0000", 2024-09-10T06:28:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6021e-05 2024-09-10T06:28:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010002+0000", 2024-09-10T06:28:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5114999999999999e-05 2024-09-10T06:28:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010104+0000", 2024-09-10T06:28:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010259699999999999 2024-09-10T06:28:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010243+0000", 2024-09-10T06:28:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000138858 2024-09-10T06:28:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.010361+0000", 2024-09-10T06:28:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117751 2024-09-10T06:28:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.019657+0000", 2024-09-10T06:28:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092965689999999993 2024-09-10T06:28:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.020775+0000", 2024-09-10T06:28:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001117266 2024-09-10T06:28:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.020853+0000", 2024-09-10T06:28:14.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8776999999999995e-05 2024-09-10T06:28:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.020918+0000", 2024-09-10T06:28:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4243000000000001e-05 2024-09-10T06:28:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1482 3.35 3:ad9242de:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.010052551999999, 2024-09-10T06:28:14.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022710764000000001, 2024-09-10T06:28:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1482 2024-09-10T06:28:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:14.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160166+0000", 2024-09-10T06:28:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1069999999999999e-06 2024-09-10T06:28:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163977+0000", 2024-09-10T06:28:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003810843 2024-09-10T06:28:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163995+0000", 2024-09-10T06:28:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7648000000000001e-05 2024-09-10T06:28:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164010+0000", 2024-09-10T06:28:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4754e-05 2024-09-10T06:28:14.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164094+0000", 2024-09-10T06:28:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4473000000000003e-05 2024-09-10T06:28:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164281+0000", 2024-09-10T06:28:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018659699999999999 2024-09-10T06:28:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:14.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164458+0000", 2024-09-10T06:28:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017758300000000001 2024-09-10T06:28:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.179923+0000", 2024-09-10T06:28:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015465269 2024-09-10T06:28:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182736+0000", 2024-09-10T06:28:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028130579999999998 2024-09-10T06:28:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182816+0000", 2024-09-10T06:28:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9976999999999997e-05 2024-09-10T06:28:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182875+0000", 2024-09-10T06:28:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8455000000000002e-05 2024-09-10T06:28:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1664 3.a 3:52f62ee7:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:14.272 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.3460273130000004, 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020253482999999999, 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1664 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:14.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824193+0000", 2024-09-10T06:28:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6059999999999999e-06 2024-09-10T06:28:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829549+0000", 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053562189999999997 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829584+0000", 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4925000000000002e-05 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829602+0000", 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8034999999999999e-05 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829716+0000", 2024-09-10T06:28:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113522 2024-09-10T06:28:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829903+0000", 2024-09-10T06:28:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187443 2024-09-10T06:28:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.830162+0000", 2024-09-10T06:28:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025917900000000001 2024-09-10T06:28:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.843459+0000", 2024-09-10T06:28:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01329675 2024-09-10T06:28:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844211+0000", 2024-09-10T06:28:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075213700000000005 2024-09-10T06:28:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844286+0000", 2024-09-10T06:28:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4453e-05 2024-09-10T06:28:14.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844443+0000", 2024-09-10T06:28:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157214 2024-09-10T06:28:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1666 3.35 3:ad92e5c9:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.844780+0000", 2024-09-10T06:28:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.3254365989999997, 2024-09-10T06:28:14.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016844930000000001, 2024-09-10T06:28:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1666 2024-09-10T06:28:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844780+0000", 2024-09-10T06:28:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844780+0000", 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844782+0000", 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5740000000000001e-06 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848542+0000", 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037601620000000001 2024-09-10T06:28:14.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848564+0000", 2024-09-10T06:28:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2405999999999999e-05 2024-09-10T06:28:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848574+0000", 2024-09-10T06:28:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6989999999999998e-06 2024-09-10T06:28:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848714+0000", 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014004100000000001 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.848964+0000", 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024983600000000003 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.849193+0000", 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000228693 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.861129+0000", 2024-09-10T06:28:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01193658 2024-09-10T06:28:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.861509+0000", 2024-09-10T06:28:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037939899999999999 2024-09-10T06:28:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.861574+0000", 2024-09-10T06:28:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5471999999999999e-05 2024-09-10T06:28:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.861625+0000", 2024-09-10T06:28:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1068e-05 2024-09-10T06:28:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.284 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.284 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:14.285 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:28:14.286 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:14.279+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:14.387 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:14.383+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:14.408 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:14.409 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:14.409 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:14.422 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:28:14.488 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:14.484+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:14.552 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:14.553 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:14.553 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:14.553 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:14.553 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:14.572 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:28:14.617 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:14.616+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:14.689 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:14.683+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:14.750 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 117.30005959499999, 2024-09-10T06:28:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70775834699999995, 2024-09-10T06:28:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1 2024-09-10T06:28:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446852+0000", 2024-09-10T06:28:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.117e-06 2024-09-10T06:28:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446870+0000", 2024-09-10T06:28:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7569999999999999e-05 2024-09-10T06:28:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446892+0000", 2024-09-10T06:28:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2036e-05 2024-09-10T06:28:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446908+0000", 2024-09-10T06:28:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6719999999999999e-05 2024-09-10T06:28:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447040+0000", 2024-09-10T06:28:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013118299999999999 2024-09-10T06:28:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:28:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447054+0000", 2024-09-10T06:28:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4343e-05 2024-09-10T06:28:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.151730+0000", 2024-09-10T06:28:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70467560600000001 2024-09-10T06:28:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152054+0000", 2024-09-10T06:28:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032444100000000002 2024-09-10T06:28:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152404+0000", 2024-09-10T06:28:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000349938 2024-09-10T06:28:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.153773+0000", 2024-09-10T06:28:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013693620000000001 2024-09-10T06:28:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154454+0000", 2024-09-10T06:28:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068035800000000005 2024-09-10T06:28:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154544+0000", 2024-09-10T06:28:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0623000000000003e-05 2024-09-10T06:28:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154607+0000", 2024-09-10T06:28:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3050000000000001e-05 2024-09-10T06:28:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 116.461831675, 2024-09-10T06:28:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021819150999999998, 2024-09-10T06:28:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 51 2024-09-10T06:28:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285078+0000", 2024-09-10T06:28:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000001e-07 2024-09-10T06:28:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285083+0000", 2024-09-10T06:28:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6099999999999997e-06 2024-09-10T06:28:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285092+0000", 2024-09-10T06:28:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2399999999999996e-06 2024-09-10T06:28:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285100+0000", 2024-09-10T06:28:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8739999999999995e-06 2024-09-10T06:28:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300938+0000", 2024-09-10T06:28:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015837527000000001 2024-09-10T06:28:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301058+0000", 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012032300000000001 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301251+0000", 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192828 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302937+0000", 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016857339999999999 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306745+0000", 2024-09-10T06:28:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038078729999999998 2024-09-10T06:28:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306830+0000", 2024-09-10T06:28:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5432999999999993e-05 2024-09-10T06:28:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306896+0000", 2024-09-10T06:28:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5993000000000003e-05 2024-09-10T06:28:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 116.461791799, 2024-09-10T06:28:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021995553000000001, 2024-09-10T06:28:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 52 2024-09-10T06:28:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4000000000000001e-07 2024-09-10T06:28:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285123+0000", 2024-09-10T06:28:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6969999999999998e-06 2024-09-10T06:28:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285132+0000", 2024-09-10T06:28:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1560000000000001e-06 2024-09-10T06:28:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285139+0000", 2024-09-10T06:28:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1539999999999996e-06 2024-09-10T06:28:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301865+0000", 2024-09-10T06:28:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016725173999999999 2024-09-10T06:28:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301995+0000", 2024-09-10T06:28:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130739 2024-09-10T06:28:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302195+0000", 2024-09-10T06:28:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000199965 2024-09-10T06:28:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.303135+0000", 2024-09-10T06:28:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093978300000000002 2024-09-10T06:28:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306979+0000", 2024-09-10T06:28:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038437459999999999 2024-09-10T06:28:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307057+0000", 2024-09-10T06:28:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7766e-05 2024-09-10T06:28:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307112+0000", 2024-09-10T06:28:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5733000000000003e-05 2024-09-10T06:28:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1374 3.2f e63/22 3:f735f5eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_129:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.588748554, 2024-09-10T06:28:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022402502000000001, 2024-09-10T06:28:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158162+0000", 2024-09-10T06:28:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4569999999999999e-06 2024-09-10T06:28:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161871+0000", 2024-09-10T06:28:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037080799999999999 2024-09-10T06:28:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161914+0000", 2024-09-10T06:28:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3571e-05 2024-09-10T06:28:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161940+0000", 2024-09-10T06:28:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5876000000000001e-05 2024-09-10T06:28:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.162081+0000", 2024-09-10T06:28:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014147000000000001 2024-09-10T06:28:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.162123+0000", 2024-09-10T06:28:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1666999999999999e-05 2024-09-10T06:28:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.180416+0000", 2024-09-10T06:28:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018292881 2024-09-10T06:28:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.180562+0000", 2024-09-10T06:28:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014650000000000001 2024-09-10T06:28:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1378 3.2d 3:b4d0ba6d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.555187895, 2024-09-10T06:28:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029738187999999999, 2024-09-10T06:28:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1378 2024-09-10T06:28:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191724+0000", 2024-09-10T06:28:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2650000000000001e-06 2024-09-10T06:28:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196514+0000", 2024-09-10T06:28:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047904039999999998 2024-09-10T06:28:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196552+0000", 2024-09-10T06:28:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8034999999999998e-05 2024-09-10T06:28:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196577+0000", 2024-09-10T06:28:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5120999999999999e-05 2024-09-10T06:28:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196716+0000", 2024-09-10T06:28:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013837699999999999 2024-09-10T06:28:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196970+0000", 2024-09-10T06:28:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025406300000000001 2024-09-10T06:28:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.197196+0000", 2024-09-10T06:28:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022647499999999999 2024-09-10T06:28:14.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211315+0000", 2024-09-10T06:28:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014118175 2024-09-10T06:28:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.220793+0000", 2024-09-10T06:28:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094785640000000001 2024-09-10T06:28:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221044+0000", 2024-09-10T06:28:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025106 2024-09-10T06:28:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221459+0000", 2024-09-10T06:28:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041464900000000001 2024-09-10T06:28:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1379 3.11 3:8ad434e9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:14.781 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.545509477, 2024-09-10T06:28:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021255388, 2024-09-10T06:28:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1379 2024-09-10T06:28:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:14.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201402+0000", 2024-09-10T06:28:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2459999999999999e-06 2024-09-10T06:28:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205915+0000", 2024-09-10T06:28:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045131149999999998 2024-09-10T06:28:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205948+0000", 2024-09-10T06:28:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2259999999999999e-05 2024-09-10T06:28:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205966+0000", 2024-09-10T06:28:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8238999999999999e-05 2024-09-10T06:28:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.206162+0000", 2024-09-10T06:28:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000195782 2024-09-10T06:28:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.206607+0000", 2024-09-10T06:28:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044565000000000002 2024-09-10T06:28:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.207031+0000", 2024-09-10T06:28:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000423714 2024-09-10T06:28:14.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221664+0000", 2024-09-10T06:28:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014632895 2024-09-10T06:28:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222398+0000", 2024-09-10T06:28:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073376099999999998 2024-09-10T06:28:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222569+0000", 2024-09-10T06:28:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017139400000000001 2024-09-10T06:28:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222654+0000", 2024-09-10T06:28:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5332000000000002e-05 2024-09-10T06:28:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.788 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1389 3.13 3:c83648d5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_144:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.302213+0000", 2024-09-10T06:28:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.444695769999999, 2024-09-10T06:28:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019439842999999998, 2024-09-10T06:28:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1389 2024-09-10T06:28:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302213+0000", 2024-09-10T06:28:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302213+0000", 2024-09-10T06:28:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302217+0000", 2024-09-10T06:28:14.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4959999999999998e-06 2024-09-10T06:28:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.306238+0000", 2024-09-10T06:28:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040202679999999996 2024-09-10T06:28:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.306275+0000", 2024-09-10T06:28:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7577000000000003e-05 2024-09-10T06:28:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.306293+0000", 2024-09-10T06:28:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8376000000000002e-05 2024-09-10T06:28:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.306427+0000", 2024-09-10T06:28:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013334100000000001 2024-09-10T06:28:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.306676+0000", 2024-09-10T06:28:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024941600000000003 2024-09-10T06:28:14.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.306908+0000", 2024-09-10T06:28:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-09-10T06:28:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.320872+0000", 2024-09-10T06:28:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01396437 2024-09-10T06:28:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.321337+0000", 2024-09-10T06:28:14.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000464895 2024-09-10T06:28:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.321519+0000", 2024-09-10T06:28:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000181731 2024-09-10T06:28:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.321653+0000", 2024-09-10T06:28:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133485 2024-09-10T06:28:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1426 3.2d 3:b764a1d5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.180168884, 2024-09-10T06:28:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027451646999999999, 2024-09-10T06:28:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1426 2024-09-10T06:28:14.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566742+0000", 2024-09-10T06:28:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.317e-06 2024-09-10T06:28:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570553+0000", 2024-09-10T06:28:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038114680000000001 2024-09-10T06:28:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570585+0000", 2024-09-10T06:28:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1940999999999998e-05 2024-09-10T06:28:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570601+0000", 2024-09-10T06:28:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5218000000000001e-05 2024-09-10T06:28:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570723+0000", 2024-09-10T06:28:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012265099999999999 2024-09-10T06:28:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570966+0000", 2024-09-10T06:28:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024268099999999999 2024-09-10T06:28:14.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.571204+0000", 2024-09-10T06:28:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000238213 2024-09-10T06:28:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.584059+0000", 2024-09-10T06:28:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012854477 2024-09-10T06:28:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594094+0000", 2024-09-10T06:28:14.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010034992 2024-09-10T06:28:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594146+0000", 2024-09-10T06:28:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2497999999999998e-05 2024-09-10T06:28:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594191+0000", 2024-09-10T06:28:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5191000000000002e-05 2024-09-10T06:28:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1435 3.2d 3:b4574439:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.083422927000001, 2024-09-10T06:28:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.035042897000000003, 2024-09-10T06:28:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1435 2024-09-10T06:28:14.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663488+0000", 2024-09-10T06:28:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.616e-06 2024-09-10T06:28:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667246+0000", 2024-09-10T06:28:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037580579999999999 2024-09-10T06:28:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667277+0000", 2024-09-10T06:28:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0688000000000002e-05 2024-09-10T06:28:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667291+0000", 2024-09-10T06:28:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4472e-05 2024-09-10T06:28:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667411+0000", 2024-09-10T06:28:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011913699999999999 2024-09-10T06:28:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667422+0000", 2024-09-10T06:28:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1073000000000001e-05 2024-09-10T06:28:14.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674124+0000", 2024-09-10T06:28:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067023619999999999 2024-09-10T06:28:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674520+0000", 2024-09-10T06:28:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039614700000000001 2024-09-10T06:28:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674879+0000", 2024-09-10T06:28:14.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035909899999999999 2024-09-10T06:28:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698261+0000", 2024-09-10T06:28:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023382209000000001 2024-09-10T06:28:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698338+0000", 2024-09-10T06:28:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6915000000000005e-05 2024-09-10T06:28:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698455+0000", 2024-09-10T06:28:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117039 2024-09-10T06:28:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698528+0000", 2024-09-10T06:28:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3082000000000003e-05 2024-09-10T06:28:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1436 3.2d 3:b7b59058:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:14.809 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.073859408000001, 2024-09-10T06:28:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032516167999999998, 2024-09-10T06:28:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1436 2024-09-10T06:28:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673052+0000", 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3629999999999998e-06 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678383+0000", 2024-09-10T06:28:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053304199999999998 2024-09-10T06:28:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678423+0000", 2024-09-10T06:28:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0089999999999997e-05 2024-09-10T06:28:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678442+0000", 2024-09-10T06:28:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9242e-05 2024-09-10T06:28:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.685257+0000", 2024-09-10T06:28:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068147920000000001 2024-09-10T06:28:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.685641+0000", 2024-09-10T06:28:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038388700000000002 2024-09-10T06:28:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.686106+0000", 2024-09-10T06:28:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046506800000000001 2024-09-10T06:28:14.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698619+0000", 2024-09-10T06:28:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012513102999999999 2024-09-10T06:28:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705364+0000", 2024-09-10T06:28:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067448170000000002 2024-09-10T06:28:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705482+0000", 2024-09-10T06:28:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118362 2024-09-10T06:28:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705565+0000", 2024-09-10T06:28:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3023999999999997e-05 2024-09-10T06:28:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1442 3.13 3:c8bde401:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:14.815 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.011778806000001, 2024-09-10T06:28:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021096628999999999, 2024-09-10T06:28:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1442 2024-09-10T06:28:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735133+0000", 2024-09-10T06:28:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6899999999999998e-06 2024-09-10T06:28:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739406+0000", 2024-09-10T06:28:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042727950000000002 2024-09-10T06:28:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739432+0000", 2024-09-10T06:28:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6245999999999999e-05 2024-09-10T06:28:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739447+0000", 2024-09-10T06:28:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4071e-05 2024-09-10T06:28:14.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739575+0000", 2024-09-10T06:28:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000128641 2024-09-10T06:28:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739818+0000", 2024-09-10T06:28:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024242999999999999 2024-09-10T06:28:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.740058+0000", 2024-09-10T06:28:14.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023991 2024-09-10T06:28:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.748440+0000", 2024-09-10T06:28:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083824390000000002 2024-09-10T06:28:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756108+0000", 2024-09-10T06:28:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076684350000000004 2024-09-10T06:28:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756165+0000", 2024-09-10T06:28:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6641000000000002e-05 2024-09-10T06:28:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756226+0000", 2024-09-10T06:28:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1330999999999999e-05 2024-09-10T06:28:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1443 3.37 3:edd7279d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:14.821 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.001872043000001, 2024-09-10T06:28:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022124847, 2024-09-10T06:28:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1443 2024-09-10T06:28:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:14.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745040+0000", 2024-09-10T06:28:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6490000000000001e-06 2024-09-10T06:28:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753657+0000", 2024-09-10T06:28:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086173410000000006 2024-09-10T06:28:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753697+0000", 2024-09-10T06:28:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9669999999999998e-05 2024-09-10T06:28:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753722+0000", 2024-09-10T06:28:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4666000000000001e-05 2024-09-10T06:28:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753845+0000", 2024-09-10T06:28:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012319699999999999 2024-09-10T06:28:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753994+0000", 2024-09-10T06:28:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149157 2024-09-10T06:28:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.754120+0000", 2024-09-10T06:28:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012597500000000001 2024-09-10T06:28:14.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.766728+0000", 2024-09-10T06:28:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012608359 2024-09-10T06:28:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767022+0000", 2024-09-10T06:28:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029342099999999998 2024-09-10T06:28:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767098+0000", 2024-09-10T06:28:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6508999999999995e-05 2024-09-10T06:28:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767161+0000", 2024-09-10T06:28:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2903000000000004e-05 2024-09-10T06:28:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1469 3.d 3:b3f21559:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:14.827 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.711965146000001, 2024-09-10T06:28:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024987420999999999, 2024-09-10T06:28:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1469 2024-09-10T06:28:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034946+0000", 2024-09-10T06:28:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0630000000000002e-06 2024-09-10T06:28:14.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.038986+0000", 2024-09-10T06:28:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040398580000000003 2024-09-10T06:28:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039019+0000", 2024-09-10T06:28:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3167000000000003e-05 2024-09-10T06:28:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039037+0000", 2024-09-10T06:28:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7785999999999999e-05 2024-09-10T06:28:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039135+0000", 2024-09-10T06:28:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8152999999999994e-05 2024-09-10T06:28:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039321+0000", 2024-09-10T06:28:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000185243 2024-09-10T06:28:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039506+0000", 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018496100000000001 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.047253+0000", 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0077471889999999998 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059836+0000", 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012583145 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059879+0000", 2024-09-10T06:28:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3090999999999998e-05 2024-09-10T06:28:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059931+0000", 2024-09-10T06:28:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1765000000000003e-05 2024-09-10T06:28:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1669 3.2d 3:b72c6e58:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.8719331359999991, 2024-09-10T06:28:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021299012999999999, 2024-09-10T06:28:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1669 2024-09-10T06:28:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874979+0000", 2024-09-10T06:28:14.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7670000000000001e-06 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880441+0000", 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054614859999999998 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880475+0000", 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4542000000000002e-05 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880492+0000", 2024-09-10T06:28:14.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7048999999999999e-05 2024-09-10T06:28:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880599+0000", 2024-09-10T06:28:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106741 2024-09-10T06:28:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880788+0000", 2024-09-10T06:28:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189168 2024-09-10T06:28:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880951+0000", 2024-09-10T06:28:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016303199999999999 2024-09-10T06:28:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.890345+0000", 2024-09-10T06:28:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093942379999999992 2024-09-10T06:28:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896112+0000", 2024-09-10T06:28:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057669289999999996 2024-09-10T06:28:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896204+0000", 2024-09-10T06:28:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2069000000000002e-05 2024-09-10T06:28:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896274+0000", 2024-09-10T06:28:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9992000000000003e-05 2024-09-10T06:28:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.839 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1671 3.37 3:ed354b67:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.8492108229999999, 2024-09-10T06:28:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022257213000000001, 2024-09-10T06:28:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1671 2024-09-10T06:28:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897701+0000", 2024-09-10T06:28:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-10T06:28:14.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901677+0000", 2024-09-10T06:28:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039758609999999998 2024-09-10T06:28:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901717+0000", 2024-09-10T06:28:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9889999999999999e-05 2024-09-10T06:28:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901735+0000", 2024-09-10T06:28:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8185999999999998e-05 2024-09-10T06:28:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901926+0000", 2024-09-10T06:28:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019083899999999999 2024-09-10T06:28:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902165+0000", 2024-09-10T06:28:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023968200000000001 2024-09-10T06:28:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902392+0000", 2024-09-10T06:28:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022711399999999999 2024-09-10T06:28:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.915622+0000", 2024-09-10T06:28:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013229708999999999 2024-09-10T06:28:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919654+0000", 2024-09-10T06:28:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040314699999999997 2024-09-10T06:28:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919827+0000", 2024-09-10T06:28:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173647 2024-09-10T06:28:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919955+0000", 2024-09-10T06:28:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012767900000000001 2024-09-10T06:28:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.845 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1673 3.2d 3:b688b693:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.917332+0000", 2024-09-10T06:28:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.8295761800000001, 2024-09-10T06:28:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01991099, 2024-09-10T06:28:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1673 2024-09-10T06:28:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.917332+0000", 2024-09-10T06:28:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.917332+0000", 2024-09-10T06:28:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.917336+0000", 2024-09-10T06:28:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4240000000000002e-06 2024-09-10T06:28:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.922265+0000", 2024-09-10T06:28:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049295399999999996 2024-09-10T06:28:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.922295+0000", 2024-09-10T06:28:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9414999999999999e-05 2024-09-10T06:28:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.922310+0000", 2024-09-10T06:28:14.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5438999999999999e-05 2024-09-10T06:28:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.922457+0000", 2024-09-10T06:28:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014695800000000001 2024-09-10T06:28:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.922716+0000", 2024-09-10T06:28:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025858800000000003 2024-09-10T06:28:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:14.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.922944+0000", 2024-09-10T06:28:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000228464 2024-09-10T06:28:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936043+0000", 2024-09-10T06:28:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013099296999999999 2024-09-10T06:28:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.937118+0000", 2024-09-10T06:28:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001074661 2024-09-10T06:28:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.937186+0000", 2024-09-10T06:28:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7455999999999999e-05 2024-09-10T06:28:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.937243+0000", 2024-09-10T06:28:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7747999999999997e-05 2024-09-10T06:28:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.851 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1674 3.e 3:71dde5c5:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.8140142969999999, 2024-09-10T06:28:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024662893000000002, 2024-09-10T06:28:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1674 2024-09-10T06:28:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:14.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:14.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932897+0000", 2024-09-10T06:28:14.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3939999999999999e-06 2024-09-10T06:28:14.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935777+0000", 2024-09-10T06:28:14.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028807899999999998 2024-09-10T06:28:14.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935803+0000", 2024-09-10T06:28:14.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6067e-05 2024-09-10T06:28:14.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935818+0000", 2024-09-10T06:28:14.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4696e-05 2024-09-10T06:28:14.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935939+0000", 2024-09-10T06:28:14.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120895 2024-09-10T06:28:14.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936155+0000", 2024-09-10T06:28:14.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021555000000000001 2024-09-10T06:28:14.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:14.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936376+0000", 2024-09-10T06:28:14.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221127 2024-09-10T06:28:14.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.951276+0000", 2024-09-10T06:28:14.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014900149999999999 2024-09-10T06:28:14.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957421+0000", 2024-09-10T06:28:14.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061452440000000002 2024-09-10T06:28:14.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957502+0000", 2024-09-10T06:28:14.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1290000000000003e-05 2024-09-10T06:28:14.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957557+0000", 2024-09-10T06:28:14.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.469e-05 2024-09-10T06:28:14.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.857 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.857 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1675 3.13 3:cbcca46f:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:14.857 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:14.858 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.8051582320000001, 2024-09-10T06:28:14.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02191593, 2024-09-10T06:28:14.858 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.858 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.858 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.858 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.858 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.858 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.858 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1675 2024-09-10T06:28:14.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.858 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:14.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:14.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941752+0000", 2024-09-10T06:28:14.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1550000000000001e-06 2024-09-10T06:28:14.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945904+0000", 2024-09-10T06:28:14.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041513019999999999 2024-09-10T06:28:14.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945928+0000", 2024-09-10T06:28:14.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4113000000000001e-05 2024-09-10T06:28:14.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945941+0000", 2024-09-10T06:28:14.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3052e-05 2024-09-10T06:28:14.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946089+0000", 2024-09-10T06:28:14.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014766599999999999 2024-09-10T06:28:14.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946459+0000", 2024-09-10T06:28:14.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037089600000000001 2024-09-10T06:28:14.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:14.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946838+0000", 2024-09-10T06:28:14.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037808900000000002 2024-09-10T06:28:14.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957331+0000", 2024-09-10T06:28:14.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010493195 2024-09-10T06:28:14.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963409+0000", 2024-09-10T06:28:14.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060786570000000003 2024-09-10T06:28:14.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963559+0000", 2024-09-10T06:28:14.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014962600000000001 2024-09-10T06:28:14.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963666+0000", 2024-09-10T06:28:14.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107179 2024-09-10T06:28:14.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.863 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.863 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1684 3.e 3:70ef0483:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T06:28:14.863 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:14.863 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6483244619999997, 2024-09-10T06:28:14.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020215823000000001, 2024-09-10T06:28:14.864 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.864 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.864 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.864 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1684 2024-09-10T06:28:14.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.864 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:14.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:14.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098589+0000", 2024-09-10T06:28:14.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.673e-06 2024-09-10T06:28:14.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102294+0000", 2024-09-10T06:28:14.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037056160000000001 2024-09-10T06:28:14.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102319+0000", 2024-09-10T06:28:14.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4411000000000001e-05 2024-09-10T06:28:14.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102330+0000", 2024-09-10T06:28:14.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1212999999999999e-05 2024-09-10T06:28:14.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102457+0000", 2024-09-10T06:28:14.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012733300000000001 2024-09-10T06:28:14.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:14.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102472+0000", 2024-09-10T06:28:14.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4236000000000001e-05 2024-09-10T06:28:14.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106594+0000", 2024-09-10T06:28:14.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004122906 2024-09-10T06:28:14.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106701+0000", 2024-09-10T06:28:14.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106745 2024-09-10T06:28:14.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:14.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106809+0000", 2024-09-10T06:28:14.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107686 2024-09-10T06:28:14.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.117591+0000", 2024-09-10T06:28:14.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01078202 2024-09-10T06:28:14.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118617+0000", 2024-09-10T06:28:14.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001026218 2024-09-10T06:28:14.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118715+0000", 2024-09-10T06:28:14.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8004000000000006e-05 2024-09-10T06:28:14.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118800+0000", 2024-09-10T06:28:14.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4761999999999999e-05 2024-09-10T06:28:14.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.870 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.870 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1755 3.39 3:9c54616e:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:14.870 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.502598+0000", 2024-09-10T06:28:14.870 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.24431032499999999, 2024-09-10T06:28:14.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019821722, 2024-09-10T06:28:14.871 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:14.871 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:14.871 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:14.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:14.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:14.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:14.871 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1755 2024-09-10T06:28:14.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.871 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:14.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:14.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.502598+0000", 2024-09-10T06:28:14.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:14.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.502598+0000", 2024-09-10T06:28:14.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:14.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:14.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.502602+0000", 2024-09-10T06:28:14.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3459999999999998e-06 2024-09-10T06:28:14.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:14.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.507407+0000", 2024-09-10T06:28:14.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004804984 2024-09-10T06:28:14.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:14.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.507433+0000", 2024-09-10T06:28:14.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6154000000000001e-05 2024-09-10T06:28:14.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:14.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.507447+0000", 2024-09-10T06:28:14.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.435e-05 2024-09-10T06:28:14.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:14.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.507514+0000", 2024-09-10T06:28:14.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7317000000000006e-05 2024-09-10T06:28:14.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:14.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.507630+0000", 2024-09-10T06:28:14.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011568 2024-09-10T06:28:14.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:14.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.507727+0000", 2024-09-10T06:28:14.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6669999999999994e-05 2024-09-10T06:28:14.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.515567+0000", 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078406759999999995 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.522350+0000", 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067823989999999997 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.522389+0000", 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9221000000000003e-05 2024-09-10T06:28:14.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:14.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:14.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:14.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.522420+0000", 2024-09-10T06:28:14.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0925e-05 2024-09-10T06:28:14.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.876 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:14.876 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:14.876 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:14.876 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:28:14.877 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:28:14.878 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:14.803+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:14.910 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:14.908+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:15.011 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:15.007+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:15.023 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:15.023 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:28:15.023 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:28:15.023 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:15.046 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:28:15.049 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:28:15.049 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:28:15.073 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:28:15.074 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:28:15.110 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:28:15.110 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:28:15.112 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:15.108+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:15.133 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:28:15.134 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:28:15.161 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:28:15.161 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:28:15.193 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:28:15.193 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:28:15.196 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:15.196 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:15.213 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:15.212+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:15.218 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:28:15.218 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:28:15.219 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:28:15.244 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:28:15.244 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:28:15.314 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:15.312+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:15.383 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:15.383 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:15.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:28:15.450 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:15.447+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:15.514 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:15.511+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:15.554 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:15.554 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:15.576 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:28:15.618 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:15.615+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:15.642 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T06:28:15.716 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:15.715+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:15.769 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:15.769 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:15.795 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:28:15.842 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:15.839+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:15.918 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:15.915+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:15.946 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:15.946 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:15.977 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:28:16.019 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:16.015+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:16.120 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:16.115+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:16.161 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:16.161 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:16.181 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:28:16.226 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:16.223+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:16.324 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:16.319+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:16.326 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:16.326 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:16.348 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:28:16.434 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:16.431+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:16.523 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:16.519+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:16.531 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:16.532 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:16.554 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:28:16.574 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-10T06:28:16.625 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:16.623+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:16.714 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:16.714 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:16.724 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:16.719+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:16.733 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:28:16.825 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:16.823+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:16.917 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:16.917 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:16.926 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:16.923+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:16.933 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:28:17.026 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:17.023+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:17.115 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:17.115 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:17.128 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:17.123+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:17.133 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:28:17.229 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:17.223+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:17.276 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:28:17.280 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:17.280 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:17.297 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:28:17.340 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:17.339+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:17.344 INFO:tasks.workunit.client.0.smithi112.stdout:quota enabled for the user 0.140792901019694 2024-09-10T06:28:17.344 INFO:tasks.workunit.client.0.smithi112.stdout:adding file to bucket buck_2024_08_10_06_28_05: 1Gb. 2024-09-10T06:28:17.344 INFO:tasks.workunit.client.0.smithi112.stdout:upload file successful 2024-09-10T06:28:17.412 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:28:17.413 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:28:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:17.425 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:17.429 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:28:17.429 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:28:17.430 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:17.427+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:17.441 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:28:17.448 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:28:17.448 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:28:17.466 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:28:17.467 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:28:17.489 INFO:tasks.workunit.client.0.smithi112.stdout:Bucket Created: buck_2024_08_10_06_28_17 2024-09-10T06:28:17.489 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:28:17.489 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:28:17.507 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:28:17.507 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:28:17.527 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:28:17.527 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:28:17.532 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:17.531+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:17.546 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:28:17.546 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:28:17.618 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1359 3.34 3:2ece4e0b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.639321500000001, 2024-09-10T06:28:17.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021482449000000001, 2024-09-10T06:28:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:17.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1359 2024-09-10T06:28:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:17.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977234+0000", 2024-09-10T06:28:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7969999999999998e-06 2024-09-10T06:28:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981211+0000", 2024-09-10T06:28:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039768329999999999 2024-09-10T06:28:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981247+0000", 2024-09-10T06:28:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6457e-05 2024-09-10T06:28:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981274+0000", 2024-09-10T06:28:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6917999999999999e-05 2024-09-10T06:28:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981446+0000", 2024-09-10T06:28:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171831 2024-09-10T06:28:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981719+0000", 2024-09-10T06:28:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027282800000000002 2024-09-10T06:28:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981975+0000", 2024-09-10T06:28:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000256782 2024-09-10T06:28:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.991319+0000", 2024-09-10T06:28:17.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093433820000000008 2024-09-10T06:28:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998330+0000", 2024-09-10T06:28:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070108549999999999 2024-09-10T06:28:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998549+0000", 2024-09-10T06:28:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021944400000000001 2024-09-10T06:28:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998712+0000", 2024-09-10T06:28:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016332200000000001 2024-09-10T06:28:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1367 3.34 3:2f444f7f:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.546239796999998, 2024-09-10T06:28:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020931903000000002, 2024-09-10T06:28:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.625 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1367 2024-09-10T06:28:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070316+0000", 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9029999999999997e-06 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074255+0000", 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039391679999999998 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074291+0000", 2024-09-10T06:28:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5970000000000003e-05 2024-09-10T06:28:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074309+0000", 2024-09-10T06:28:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8399000000000001e-05 2024-09-10T06:28:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074436+0000", 2024-09-10T06:28:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012683099999999999 2024-09-10T06:28:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074686+0000", 2024-09-10T06:28:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024971699999999999 2024-09-10T06:28:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074907+0000", 2024-09-10T06:28:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022124800000000001 2024-09-10T06:28:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:17.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.084332+0000", 2024-09-10T06:28:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094253449999999999 2024-09-10T06:28:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.090954+0000", 2024-09-10T06:28:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066213649999999997 2024-09-10T06:28:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.091123+0000", 2024-09-10T06:28:17.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169216 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.091244+0000", 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120741 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1375 3.1 e63/22 3:82031a0e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_130:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.453183760999998, 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018270307999999999, 2024-09-10T06:28:17.631 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163370+0000", 2024-09-10T06:28:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8289999999999999e-06 2024-09-10T06:28:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167665+0000", 2024-09-10T06:28:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042940499999999998 2024-09-10T06:28:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167698+0000", 2024-09-10T06:28:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3484e-05 2024-09-10T06:28:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167714+0000", 2024-09-10T06:28:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-09-10T06:28:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167847+0000", 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013299300000000001 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167890+0000", 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2434000000000001e-05 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181507+0000", 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013616872 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181638+0000", 2024-09-10T06:28:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013123099999999999 2024-09-10T06:28:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1380 3.3 3:c3afb574:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.405129626000001, 2024-09-10T06:28:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027193374999999999, 2024-09-10T06:28:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.636 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1380 2024-09-10T06:28:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211426+0000", 2024-09-10T06:28:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3599999999999998e-06 2024-09-10T06:28:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215383+0000", 2024-09-10T06:28:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039567450000000002 2024-09-10T06:28:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215417+0000", 2024-09-10T06:28:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4051000000000003e-05 2024-09-10T06:28:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215435+0000", 2024-09-10T06:28:17.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8459000000000001e-05 2024-09-10T06:28:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215626+0000", 2024-09-10T06:28:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019018299999999999 2024-09-10T06:28:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215991+0000", 2024-09-10T06:28:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036566099999999998 2024-09-10T06:28:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.216360+0000", 2024-09-10T06:28:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000368995 2024-09-10T06:28:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.226152+0000", 2024-09-10T06:28:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097914319999999992 2024-09-10T06:28:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238448+0000", 2024-09-10T06:28:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012295834 2024-09-10T06:28:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238538+0000", 2024-09-10T06:28:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0539999999999997e-05 2024-09-10T06:28:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238615+0000", 2024-09-10T06:28:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7114999999999996e-05 2024-09-10T06:28:17.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1383 3.3 3:c2c34097:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.373787912000001, 2024-09-10T06:28:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020753975000000001, 2024-09-10T06:28:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.643 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1383 2024-09-10T06:28:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242767+0000", 2024-09-10T06:28:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6169999999999998e-06 2024-09-10T06:28:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246704+0000", 2024-09-10T06:28:17.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003936485 2024-09-10T06:28:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246733+0000", 2024-09-10T06:28:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9819999999999999e-05 2024-09-10T06:28:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246748+0000", 2024-09-10T06:28:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4334e-05 2024-09-10T06:28:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246902+0000", 2024-09-10T06:28:17.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015468 2024-09-10T06:28:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.247286+0000", 2024-09-10T06:28:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038366799999999999 2024-09-10T06:28:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.247687+0000", 2024-09-10T06:28:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000401252 2024-09-10T06:28:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.257963+0000", 2024-09-10T06:28:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010275584000000001 2024-09-10T06:28:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263287+0000", 2024-09-10T06:28:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053238499999999998 2024-09-10T06:28:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263412+0000", 2024-09-10T06:28:17.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012516200000000001 2024-09-10T06:28:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263517+0000", 2024-09-10T06:28:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105523 2024-09-10T06:28:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1391 3.1c e63/22 3:3a76b5ac:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_146:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.289481897999998, 2024-09-10T06:28:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026554852, 2024-09-10T06:28:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.653 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327072+0000", 2024-09-10T06:28:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6970000000000002e-06 2024-09-10T06:28:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330874+0000", 2024-09-10T06:28:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038016590000000002 2024-09-10T06:28:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330928+0000", 2024-09-10T06:28:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3729e-05 2024-09-10T06:28:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330956+0000", 2024-09-10T06:28:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8694999999999999e-05 2024-09-10T06:28:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.331147+0000", 2024-09-10T06:28:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190841 2024-09-10T06:28:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.331216+0000", 2024-09-10T06:28:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8948999999999993e-05 2024-09-10T06:28:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.353521+0000", 2024-09-10T06:28:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022304781999999999 2024-09-10T06:28:17.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.353624+0000", 2024-09-10T06:28:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010349999999999999 2024-09-10T06:28:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1392 3.14 3:2b02aaa8:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.284503108999999, 2024-09-10T06:28:17.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024102582000000001, 2024-09-10T06:28:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1392 2024-09-10T06:28:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332052+0000", 2024-09-10T06:28:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8999999999999999e-06 2024-09-10T06:28:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.335987+0000", 2024-09-10T06:28:17.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039349800000000002 2024-09-10T06:28:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336020+0000", 2024-09-10T06:28:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2968e-05 2024-09-10T06:28:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336040+0000", 2024-09-10T06:28:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9956e-05 2024-09-10T06:28:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336155+0000", 2024-09-10T06:28:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115275 2024-09-10T06:28:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336404+0000", 2024-09-10T06:28:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024874599999999999 2024-09-10T06:28:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336626+0000", 2024-09-10T06:28:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022168200000000001 2024-09-10T06:28:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.355854+0000", 2024-09-10T06:28:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019228624999999999 2024-09-10T06:28:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.355890+0000", 2024-09-10T06:28:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5901000000000001e-05 2024-09-10T06:28:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.356040+0000", 2024-09-10T06:28:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014919600000000001 2024-09-10T06:28:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.356151+0000", 2024-09-10T06:28:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111353 2024-09-10T06:28:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1398 3.2c e63/22 3:350a23e7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_153:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.213410122999999, 2024-09-10T06:28:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021444181, 2024-09-10T06:28:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.664 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403144+0000", 2024-09-10T06:28:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.734e-06 2024-09-10T06:28:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406432+0000", 2024-09-10T06:28:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032884500000000001 2024-09-10T06:28:17.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406473+0000", 2024-09-10T06:28:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0834000000000002e-05 2024-09-10T06:28:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406492+0000", 2024-09-10T06:28:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8868999999999998e-05 2024-09-10T06:28:17.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406632+0000", 2024-09-10T06:28:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140183 2024-09-10T06:28:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406698+0000", 2024-09-10T06:28:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5913000000000004e-05 2024-09-10T06:28:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424483+0000", 2024-09-10T06:28:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017785108000000001 2024-09-10T06:28:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424585+0000", 2024-09-10T06:28:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010208999999999999 2024-09-10T06:28:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1415 3.2c e63/22 3:34c14757:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_160:head v 63'5, mlcod=63'3)", 2024-09-10T06:28:17.669 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.148559665000001, 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023773743999999999, 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:17.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467994+0000", 2024-09-10T06:28:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:28:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471376+0000", 2024-09-10T06:28:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033818099999999999 2024-09-10T06:28:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471426+0000", 2024-09-10T06:28:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9846999999999999e-05 2024-09-10T06:28:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471452+0000", 2024-09-10T06:28:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6327999999999999e-05 2024-09-10T06:28:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471621+0000", 2024-09-10T06:28:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016928200000000001 2024-09-10T06:28:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.472399+0000", 2024-09-10T06:28:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000777171 2024-09-10T06:28:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.491634+0000", 2024-09-10T06:28:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019235070999999999 2024-09-10T06:28:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.491766+0000", 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013176799999999999 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1417 3.14 3:29141a67:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.135625667999999, 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026932543, 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:17.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1417 2024-09-10T06:28:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480929+0000", 2024-09-10T06:28:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-10T06:28:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486391+0000", 2024-09-10T06:28:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054618599999999998 2024-09-10T06:28:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486425+0000", 2024-09-10T06:28:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4031e-05 2024-09-10T06:28:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486443+0000", 2024-09-10T06:28:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7878999999999999e-05 2024-09-10T06:28:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486581+0000", 2024-09-10T06:28:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013773400000000001 2024-09-10T06:28:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486836+0000", 2024-09-10T06:28:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025529900000000001 2024-09-10T06:28:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.487064+0000", 2024-09-10T06:28:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000228438 2024-09-10T06:28:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:17.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.505216+0000", 2024-09-10T06:28:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018152130999999998 2024-09-10T06:28:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507597+0000", 2024-09-10T06:28:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023807260000000001 2024-09-10T06:28:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507690+0000", 2024-09-10T06:28:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2305999999999993e-05 2024-09-10T06:28:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507858+0000", 2024-09-10T06:28:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016879199999999999 2024-09-10T06:28:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1424 3.14 3:28df499c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.069053945, 2024-09-10T06:28:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017872099999999998, 2024-09-10T06:28:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.680 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1424 2024-09-10T06:28:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:17.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547500+0000", 2024-09-10T06:28:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.999e-06 2024-09-10T06:28:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551376+0000", 2024-09-10T06:28:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038754010000000001 2024-09-10T06:28:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551401+0000", 2024-09-10T06:28:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5476000000000001e-05 2024-09-10T06:28:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551413+0000", 2024-09-10T06:28:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2082999999999999e-05 2024-09-10T06:28:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551486+0000", 2024-09-10T06:28:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2793999999999995e-05 2024-09-10T06:28:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551610+0000", 2024-09-10T06:28:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123993 2024-09-10T06:28:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551718+0000", 2024-09-10T06:28:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107357 2024-09-10T06:28:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.559898+0000", 2024-09-10T06:28:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081805860000000001 2024-09-10T06:28:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565204+0000", 2024-09-10T06:28:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053053589999999999 2024-09-10T06:28:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565296+0000", 2024-09-10T06:28:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2291000000000001e-05 2024-09-10T06:28:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565370+0000", 2024-09-10T06:28:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3761000000000001e-05 2024-09-10T06:28:17.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1429 3.1a 3:5acc80b6:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.019188886999999, 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020448872999999999, 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:17.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1429 2024-09-10T06:28:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597365+0000", 2024-09-10T06:28:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2759999999999999e-06 2024-09-10T06:28:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601186+0000", 2024-09-10T06:28:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038214410000000001 2024-09-10T06:28:17.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601212+0000", 2024-09-10T06:28:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5522999999999999e-05 2024-09-10T06:28:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601222+0000", 2024-09-10T06:28:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0584999999999999e-05 2024-09-10T06:28:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601314+0000", 2024-09-10T06:28:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1484999999999996e-05 2024-09-10T06:28:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601494+0000", 2024-09-10T06:28:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018006899999999999 2024-09-10T06:28:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601655+0000", 2024-09-10T06:28:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016119999999999999 2024-09-10T06:28:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.607352+0000", 2024-09-10T06:28:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056970500000000004 2024-09-10T06:28:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617735+0000", 2024-09-10T06:28:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010382769 2024-09-10T06:28:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617780+0000", 2024-09-10T06:28:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5145999999999998e-05 2024-09-10T06:28:17.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617811+0000", 2024-09-10T06:28:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1328999999999998e-05 2024-09-10T06:28:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1433 3.1a 3:59ee0094:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.969574903000002, 2024-09-10T06:28:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024407437000000001, 2024-09-10T06:28:17.693 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1433 2024-09-10T06:28:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646979+0000", 2024-09-10T06:28:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.074e-06 2024-09-10T06:28:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.650998+0000", 2024-09-10T06:28:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040192470000000001 2024-09-10T06:28:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651031+0000", 2024-09-10T06:28:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2821000000000003e-05 2024-09-10T06:28:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651050+0000", 2024-09-10T06:28:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9556e-05 2024-09-10T06:28:17.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651150+0000", 2024-09-10T06:28:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9689e-05 2024-09-10T06:28:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651325+0000", 2024-09-10T06:28:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017529199999999999 2024-09-10T06:28:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:17.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651496+0000", 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000170531 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.659894+0000", 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083978049999999995 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671085+0000", 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011190989 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671261+0000", 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017616800000000001 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671384+0000", 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012326500000000001 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1470 3.34 3:2e4989bb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.572382977, 2024-09-10T06:28:17.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019466533000000001, 2024-09-10T06:28:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1470 2024-09-10T06:28:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044172+0000", 2024-09-10T06:28:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5939999999999998e-06 2024-09-10T06:28:17.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048101+0000", 2024-09-10T06:28:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003929325 2024-09-10T06:28:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048135+0000", 2024-09-10T06:28:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3856000000000002e-05 2024-09-10T06:28:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048150+0000", 2024-09-10T06:28:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.523e-05 2024-09-10T06:28:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048258+0000", 2024-09-10T06:28:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108025 2024-09-10T06:28:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048437+0000", 2024-09-10T06:28:17.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017811199999999999 2024-09-10T06:28:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048550+0000", 2024-09-10T06:28:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113181 2024-09-10T06:28:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063173+0000", 2024-09-10T06:28:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014623565 2024-09-10T06:28:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:17.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063361+0000", 2024-09-10T06:28:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018807599999999999 2024-09-10T06:28:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063499+0000", 2024-09-10T06:28:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013745000000000001 2024-09-10T06:28:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063635+0000", 2024-09-10T06:28:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136119 2024-09-10T06:28:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1674 3.e e66/22 3:71dde5c5:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_14:head v 66'6, mlcod=64'4)", 2024-09-10T06:28:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.936559+0000", 2024-09-10T06:28:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.679992780999999, 2024-09-10T06:28:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020541475999999999, 2024-09-10T06:28:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.706 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936559+0000", 2024-09-10T06:28:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936559+0000", 2024-09-10T06:28:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936562+0000", 2024-09-10T06:28:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9000000000000002e-06 2024-09-10T06:28:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939051+0000", 2024-09-10T06:28:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024898899999999998 2024-09-10T06:28:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939094+0000", 2024-09-10T06:28:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2874999999999999e-05 2024-09-10T06:28:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939115+0000", 2024-09-10T06:28:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0213000000000001e-05 2024-09-10T06:28:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939294+0000", 2024-09-10T06:28:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017977299999999999 2024-09-10T06:28:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939359+0000", 2024-09-10T06:28:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4596000000000003e-05 2024-09-10T06:28:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.956969+0000", 2024-09-10T06:28:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017610223000000001 2024-09-10T06:28:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957100+0000", 2024-09-10T06:28:17.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131006 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1677 3.34 3:2e18bed5:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.968824+0000", 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.647727160000001, 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017983664999999999, 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:17.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1677 2024-09-10T06:28:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.968824+0000", 2024-09-10T06:28:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.968824+0000", 2024-09-10T06:28:17.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.968827+0000", 2024-09-10T06:28:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7489999999999999e-06 2024-09-10T06:28:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974158+0000", 2024-09-10T06:28:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005330942 2024-09-10T06:28:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974178+0000", 2024-09-10T06:28:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0143e-05 2024-09-10T06:28:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974187+0000", 2024-09-10T06:28:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0250000000000008e-06 2024-09-10T06:28:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974240+0000", 2024-09-10T06:28:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3341000000000003e-05 2024-09-10T06:28:17.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974350+0000", 2024-09-10T06:28:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109874 2024-09-10T06:28:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974445+0000", 2024-09-10T06:28:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4730999999999998e-05 2024-09-10T06:28:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.980411+0000", 2024-09-10T06:28:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059658100000000002 2024-09-10T06:28:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.986640+0000", 2024-09-10T06:28:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062289110000000002 2024-09-10T06:28:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.986733+0000", 2024-09-10T06:28:17.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3646000000000004e-05 2024-09-10T06:28:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.986808+0000", 2024-09-10T06:28:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4493000000000007e-05 2024-09-10T06:28:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1757 3.3 3:c11eb9b0:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.546676+0000", 2024-09-10T06:28:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0698755900000001, 2024-09-10T06:28:17.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024581693000000002, 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1757 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.546676+0000", 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.546676+0000", 2024-09-10T06:28:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.546678+0000", 2024-09-10T06:28:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3929999999999998e-06 2024-09-10T06:28:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.555482+0000", 2024-09-10T06:28:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088036099999999999 2024-09-10T06:28:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.555524+0000", 2024-09-10T06:28:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2382000000000002e-05 2024-09-10T06:28:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.555543+0000", 2024-09-10T06:28:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8379000000000001e-05 2024-09-10T06:28:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.555639+0000", 2024-09-10T06:28:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6859000000000002e-05 2024-09-10T06:28:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.555799+0000", 2024-09-10T06:28:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015953699999999999 2024-09-10T06:28:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.555949+0000", 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015047899999999999 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.565863+0000", 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099130799999999995 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.571137+0000", 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052747549999999999 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.571205+0000", 2024-09-10T06:28:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7863999999999999e-05 2024-09-10T06:28:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.571258+0000", 2024-09-10T06:28:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2355000000000003e-05 2024-09-10T06:28:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.723 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1760 3.3 3:c3b22309:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.593712+0000", 2024-09-10T06:28:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.022839013, 2024-09-10T06:28:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019158087000000001, 2024-09-10T06:28:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1760 2024-09-10T06:28:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.724 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.593712+0000", 2024-09-10T06:28:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.593712+0000", 2024-09-10T06:28:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.593714+0000", 2024-09-10T06:28:17.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-10T06:28:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.598085+0000", 2024-09-10T06:28:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043711080000000003 2024-09-10T06:28:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.598098+0000", 2024-09-10T06:28:17.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3028e-05 2024-09-10T06:28:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.598108+0000", 2024-09-10T06:28:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9070000000000002e-06 2024-09-10T06:28:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.598166+0000", 2024-09-10T06:28:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7951999999999997e-05 2024-09-10T06:28:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.598328+0000", 2024-09-10T06:28:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016156300000000001 2024-09-10T06:28:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.598443+0000", 2024-09-10T06:28:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115639 2024-09-10T06:28:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.606437+0000", 2024-09-10T06:28:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079941600000000002 2024-09-10T06:28:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.612807+0000", 2024-09-10T06:28:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063695669999999996 2024-09-10T06:28:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.612843+0000", 2024-09-10T06:28:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6624e-05 2024-09-10T06:28:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.612870+0000", 2024-09-10T06:28:17.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6996999999999999e-05 2024-09-10T06:28:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1786 3.14 3:2ba43105:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.060200+0000", 2024-09-10T06:28:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.55635104, 2024-09-10T06:28:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024374178, 2024-09-10T06:28:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:17.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1786 2024-09-10T06:28:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.060200+0000", 2024-09-10T06:28:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.060200+0000", 2024-09-10T06:28:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.060204+0000", 2024-09-10T06:28:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9870000000000001e-06 2024-09-10T06:28:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064504+0000", 2024-09-10T06:28:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042997649999999997 2024-09-10T06:28:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064532+0000", 2024-09-10T06:28:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8365999999999999e-05 2024-09-10T06:28:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064548+0000", 2024-09-10T06:28:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5818999999999999e-05 2024-09-10T06:28:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064707+0000", 2024-09-10T06:28:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015854000000000001 2024-09-10T06:28:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.065113+0000", 2024-09-10T06:28:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040584200000000001 2024-09-10T06:28:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.065542+0000", 2024-09-10T06:28:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042921799999999998 2024-09-10T06:28:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.076775+0000", 2024-09-10T06:28:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011233065 2024-09-10T06:28:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.084355+0000", 2024-09-10T06:28:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075799459999999997 2024-09-10T06:28:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.084462+0000", 2024-09-10T06:28:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107058 2024-09-10T06:28:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.084575+0000", 2024-09-10T06:28:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011257200000000001 2024-09-10T06:28:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.736 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1789 3.31 e72/22 3:8c17f478:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_36:head v 72'7, mlcod=65'5)", 2024-09-10T06:28:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.094890+0000", 2024-09-10T06:28:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.5216611699999998, 2024-09-10T06:28:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017541174, 2024-09-10T06:28:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.094890+0000", 2024-09-10T06:28:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.094890+0000", 2024-09-10T06:28:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.094892+0000", 2024-09-10T06:28:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.08e-06 2024-09-10T06:28:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:17.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.100289+0000", 2024-09-10T06:28:17.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053965410000000004 2024-09-10T06:28:17.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:17.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.100322+0000", 2024-09-10T06:28:17.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2864999999999998e-05 2024-09-10T06:28:17.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:17.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.100337+0000", 2024-09-10T06:28:17.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5166e-05 2024-09-10T06:28:17.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:17.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.100467+0000", 2024-09-10T06:28:17.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012983800000000001 2024-09-10T06:28:17.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:17.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.100512+0000", 2024-09-10T06:28:17.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5688e-05 2024-09-10T06:28:17.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:17.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.112302+0000", 2024-09-10T06:28:17.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011789475000000001 2024-09-10T06:28:17.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:17.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:17.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:17.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.112431+0000", 2024-09-10T06:28:17.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012952100000000001 2024-09-10T06:28:17.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.741 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.742 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.742 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:17.742 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:17.742 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:17.743 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:28:17.744 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:17.739+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:17.845 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:17.839+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:17.913 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:17.913 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:17.928 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:28:17.976 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:17.975+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:18.046 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:18.043+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:18.051 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:18.051 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:18.051 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:18.065 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:28:18.147 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:18.143+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:18.228 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:18.229 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:18.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:18.229 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:18.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.229 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1354 3.5 3:a2100466:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.229 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:18.229 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.306223869, 2024-09-10T06:28:18.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022320934000000001, 2024-09-10T06:28:18.229 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.229 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.229 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1354 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919975+0000", 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4369999999999999e-06 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926675+0000", 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066993529999999999 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926705+0000", 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0391000000000001e-05 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926722+0000", 2024-09-10T06:28:18.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7159e-05 2024-09-10T06:28:18.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926840+0000", 2024-09-10T06:28:18.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117459 2024-09-10T06:28:18.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.927092+0000", 2024-09-10T06:28:18.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025180899999999997 2024-09-10T06:28:18.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:18.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.927353+0000", 2024-09-10T06:28:18.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026148499999999999 2024-09-10T06:28:18.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.940116+0000", 2024-09-10T06:28:18.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01276245 2024-09-10T06:28:18.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.941993+0000", 2024-09-10T06:28:18.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001877079 2024-09-10T06:28:18.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.942164+0000", 2024-09-10T06:28:18.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171378 2024-09-10T06:28:18.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.942293+0000", 2024-09-10T06:28:18.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012893400000000001 2024-09-10T06:28:18.234 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.234 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.234 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.235 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1355 3.16 3:6be207af:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.235 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:18.235 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.295474268, 2024-09-10T06:28:18.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023027044, 2024-09-10T06:28:18.235 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.235 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.235 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.235 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1355 2024-09-10T06:28:18.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.236 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:18.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:18.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930724+0000", 2024-09-10T06:28:18.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5100000000000001e-06 2024-09-10T06:28:18.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937234+0000", 2024-09-10T06:28:18.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065097760000000001 2024-09-10T06:28:18.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937259+0000", 2024-09-10T06:28:18.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4915000000000001e-05 2024-09-10T06:28:18.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937275+0000", 2024-09-10T06:28:18.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6659000000000001e-05 2024-09-10T06:28:18.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937437+0000", 2024-09-10T06:28:18.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161259 2024-09-10T06:28:18.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937718+0000", 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028092699999999999 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937955+0000", 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023767300000000001 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.952527+0000", 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014571850000000001 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953577+0000", 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001049601 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953671+0000", 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4580000000000006e-05 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953749+0000", 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7293999999999996e-05 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.240 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.241 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1369 3.22 3:45ffca16:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.241 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:18.241 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.131420767000002, 2024-09-10T06:28:18.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020833028999999999, 2024-09-10T06:28:18.241 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.241 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.241 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.241 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.241 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.241 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.241 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1369 2024-09-10T06:28:18.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.242 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:18.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:18.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094779+0000", 2024-09-10T06:28:18.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1099999999999996e-06 2024-09-10T06:28:18.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100674+0000", 2024-09-10T06:28:18.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058944740000000002 2024-09-10T06:28:18.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100714+0000", 2024-09-10T06:28:18.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0527e-05 2024-09-10T06:28:18.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100732+0000", 2024-09-10T06:28:18.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8034999999999999e-05 2024-09-10T06:28:18.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100871+0000", 2024-09-10T06:28:18.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013849399999999999 2024-09-10T06:28:18.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.101123+0000", 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025259000000000002 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.101372+0000", 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024846599999999998 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.111593+0000", 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010221165000000001 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115305+0000", 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037123249999999998 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115476+0000", 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017085200000000001 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115608+0000", 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131991 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.247 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1372 3.36 e63/22 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:18.247 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:18.247 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.087798261, 2024-09-10T06:28:18.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018914395000000001, 2024-09-10T06:28:18.247 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.247 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.247 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.247 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:18.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:18.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138401+0000", 2024-09-10T06:28:18.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3859999999999999e-06 2024-09-10T06:28:18.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142599+0000", 2024-09-10T06:28:18.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041982190000000004 2024-09-10T06:28:18.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142649+0000", 2024-09-10T06:28:18.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9477000000000001e-05 2024-09-10T06:28:18.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142674+0000", 2024-09-10T06:28:18.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5558000000000002e-05 2024-09-10T06:28:18.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142832+0000", 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158159 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142879+0000", 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6650000000000002e-05 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157209+0000", 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014330209999999999 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157312+0000", 2024-09-10T06:28:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102736 2024-09-10T06:28:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1374 3.2f 3:f735f5eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.072773961999999, 2024-09-10T06:28:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028841426, 2024-09-10T06:28:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.251 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.252 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1374 2024-09-10T06:28:18.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.252 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:18.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:18.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153425+0000", 2024-09-10T06:28:18.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8030000000000001e-06 2024-09-10T06:28:18.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157050+0000", 2024-09-10T06:28:18.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036249070000000001 2024-09-10T06:28:18.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157081+0000", 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1525000000000001e-05 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157103+0000", 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1599000000000001e-05 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157253+0000", 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150266 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157545+0000", 2024-09-10T06:28:18.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029204399999999998 2024-09-10T06:28:18.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:18.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157898+0000", 2024-09-10T06:28:18.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035326200000000002 2024-09-10T06:28:18.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181021+0000", 2024-09-10T06:28:18.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023123008 2024-09-10T06:28:18.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181894+0000", 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00087308700000000004 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.182128+0000", 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000233811 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.182263+0000", 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013511400000000001 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.256 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.257 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1391 3.1c 3:3a76b5ac:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.257 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:18.257 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.904036955999999, 2024-09-10T06:28:18.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032016492000000001, 2024-09-10T06:28:18.257 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.257 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.257 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.258 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1391 2024-09-10T06:28:18.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.258 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:18.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:18.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322162+0000", 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.523e-06 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326140+0000", 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039776000000000004 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326177+0000", 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6878000000000002e-05 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326195+0000", 2024-09-10T06:28:18.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8576e-05 2024-09-10T06:28:18.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326334+0000", 2024-09-10T06:28:18.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013836600000000001 2024-09-10T06:28:18.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326608+0000", 2024-09-10T06:28:18.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000274586 2024-09-10T06:28:18.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326847+0000", 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023812 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.338793+0000", 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011946141 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354011+0000", 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015217856 2024-09-10T06:28:18.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354100+0000", 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9497e-05 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354175+0000", 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5349e-05 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.262 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1399 3.38 e63/22 3:1dcd0b88:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_154:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:18.263 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:18.263 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.820465849000001, 2024-09-10T06:28:18.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019306528999999999, 2024-09-10T06:28:18.263 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.263 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.263 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.263 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:18.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:18.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405734+0000", 2024-09-10T06:28:18.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2529999999999998e-06 2024-09-10T06:28:18.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410725+0000", 2024-09-10T06:28:18.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049902849999999997 2024-09-10T06:28:18.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410776+0000", 2024-09-10T06:28:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1762999999999999e-05 2024-09-10T06:28:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410805+0000", 2024-09-10T06:28:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8274999999999999e-05 2024-09-10T06:28:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410984+0000", 2024-09-10T06:28:18.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017977800000000001 2024-09-10T06:28:18.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.411050+0000", 2024-09-10T06:28:18.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6115e-05 2024-09-10T06:28:18.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424826+0000", 2024-09-10T06:28:18.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013775267000000001 2024-09-10T06:28:18.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.425037+0000", 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000210793 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1421 3.16 3:69839037:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.707141463999999, 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022412087000000001, 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.268 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1421 2024-09-10T06:28:18.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.268 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:18.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:18.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519058+0000", 2024-09-10T06:28:18.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.354e-06 2024-09-10T06:28:18.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.522967+0000", 2024-09-10T06:28:18.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003909231 2024-09-10T06:28:18.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523003+0000", 2024-09-10T06:28:18.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5981e-05 2024-09-10T06:28:18.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523021+0000", 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8362000000000001e-05 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523166+0000", 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014476699999999999 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523435+0000", 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026895800000000002 2024-09-10T06:28:18.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:18.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523671+0000", 2024-09-10T06:28:18.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023608099999999999 2024-09-10T06:28:18.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538600+0000", 2024-09-10T06:28:18.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014929318 2024-09-10T06:28:18.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541356+0000", 2024-09-10T06:28:18.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002755216 2024-09-10T06:28:18.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541420+0000", 2024-09-10T06:28:18.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4775000000000002e-05 2024-09-10T06:28:18.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541466+0000", 2024-09-10T06:28:18.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6044000000000002e-05 2024-09-10T06:28:18.272 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.272 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.272 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1439 3.3c 3:3e1c16d9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.520270525000001, 2024-09-10T06:28:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020786124999999999, 2024-09-10T06:28:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1439 2024-09-10T06:28:18.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.274 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:18.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:18.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705929+0000", 2024-09-10T06:28:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1620000000000001e-06 2024-09-10T06:28:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.709954+0000", 2024-09-10T06:28:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004024344 2024-09-10T06:28:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.709991+0000", 2024-09-10T06:28:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6868e-05 2024-09-10T06:28:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710009+0000", 2024-09-10T06:28:18.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8422000000000001e-05 2024-09-10T06:28:18.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710091+0000", 2024-09-10T06:28:18.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1440000000000006e-05 2024-09-10T06:28:18.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:18.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710105+0000", 2024-09-10T06:28:18.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4072e-05 2024-09-10T06:28:18.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.713970+0000", 2024-09-10T06:28:18.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038651699999999998 2024-09-10T06:28:18.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.714137+0000", 2024-09-10T06:28:18.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016704999999999999 2024-09-10T06:28:18.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:18.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.714352+0000", 2024-09-10T06:28:18.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021503099999999999 2024-09-10T06:28:18.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.721589+0000", 2024-09-10T06:28:18.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072370680000000001 2024-09-10T06:28:18.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726578+0000", 2024-09-10T06:28:18.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049887300000000002 2024-09-10T06:28:18.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726659+0000", 2024-09-10T06:28:18.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0972999999999999e-05 2024-09-10T06:28:18.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726711+0000", 2024-09-10T06:28:18.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2794999999999999e-05 2024-09-10T06:28:18.279 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.279 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.279 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.279 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1454 3.5 3:a08a9c17:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:18.279 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:18.279 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.355792833999999, 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018980882000000001, 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1454 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870407+0000", 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9090000000000002e-06 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874434+0000", 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040275700000000003 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874471+0000", 2024-09-10T06:28:18.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6528e-05 2024-09-10T06:28:18.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874496+0000", 2024-09-10T06:28:18.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4751000000000001e-05 2024-09-10T06:28:18.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874624+0000", 2024-09-10T06:28:18.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012825600000000001 2024-09-10T06:28:18.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874828+0000", 2024-09-10T06:28:18.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020377700000000001 2024-09-10T06:28:18.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:18.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.875010+0000", 2024-09-10T06:28:18.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018253200000000001 2024-09-10T06:28:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.883337+0000", 2024-09-10T06:28:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083265860000000004 2024-09-10T06:28:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889239+0000", 2024-09-10T06:28:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059024409999999996 2024-09-10T06:28:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889322+0000", 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2216e-05 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889384+0000", 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2316000000000004e-05 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1463 3.c 3:32b18461:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.252821119, 2024-09-10T06:28:18.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019470828999999999, 2024-09-10T06:28:18.286 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.286 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.286 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.286 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1463 2024-09-10T06:28:18.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.286 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:18.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973377+0000", 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5749999999999999e-06 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977213+0000", 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038358789999999999 2024-09-10T06:28:18.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977239+0000", 2024-09-10T06:28:18.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5965999999999998e-05 2024-09-10T06:28:18.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977252+0000", 2024-09-10T06:28:18.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2472e-05 2024-09-10T06:28:18.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977406+0000", 2024-09-10T06:28:18.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000154809 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977687+0000", 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028013400000000003 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977963+0000", 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027642500000000001 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.987026+0000", 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090629430000000004 2024-09-10T06:28:18.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992655+0000", 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056288320000000003 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992765+0000", 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110276 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992846+0000", 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0518000000000004e-05 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.290 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1469 3.d e64/22 3:b3f21559:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_214:head v 64'1, mlcod=0'0)", 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.186516162, 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01994638, 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:18.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039683+0000", 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0929999999999999e-06 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044782+0000", 2024-09-10T06:28:18.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050988240000000001 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044821+0000", 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9764000000000001e-05 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044839+0000", 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7598999999999999e-05 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044936+0000", 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7388999999999999e-05 2024-09-10T06:28:18.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044962+0000", 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5967999999999999e-05 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059554+0000", 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014592055 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059626+0000", 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1687999999999995e-05 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.294 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1672 3.c 3:33a5f042:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.318842783000001, 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019487879999999999, 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1672 2024-09-10T06:28:18.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907355+0000", 2024-09-10T06:28:18.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.43e-06 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.911999+0000", 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046435979999999996 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912047+0000", 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8204000000000001e-05 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912078+0000", 2024-09-10T06:28:18.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0998999999999999e-05 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912197+0000", 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119165 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912368+0000", 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000170111 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912532+0000", 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016403000000000001 2024-09-10T06:28:18.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.920064+0000", 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007531973 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926719+0000", 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066550840000000003 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926786+0000", 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7267999999999994e-05 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926841+0000", 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5018000000000001e-05 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1756 3.30 3:0c20eb42:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.524760+0000", 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.7014359049999999, 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024610467, 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.300 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.301 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1756 2024-09-10T06:28:18.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.301 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.524760+0000", 2024-09-10T06:28:18.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.524760+0000", 2024-09-10T06:28:18.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.524763+0000", 2024-09-10T06:28:18.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.734e-06 2024-09-10T06:28:18.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.532754+0000", 2024-09-10T06:28:18.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007991359 2024-09-10T06:28:18.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.532797+0000", 2024-09-10T06:28:18.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3282000000000003e-05 2024-09-10T06:28:18.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.532816+0000", 2024-09-10T06:28:18.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8389e-05 2024-09-10T06:28:18.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.532916+0000", 2024-09-10T06:28:18.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100784 2024-09-10T06:28:18.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.533095+0000", 2024-09-10T06:28:18.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000178674 2024-09-10T06:28:18.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:18.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.533260+0000", 2024-09-10T06:28:18.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016465800000000001 2024-09-10T06:28:18.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.541932+0000", 2024-09-10T06:28:18.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086723589999999993 2024-09-10T06:28:18.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.549254+0000", 2024-09-10T06:28:18.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0073213560000000002 2024-09-10T06:28:18.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.549318+0000", 2024-09-10T06:28:18.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4000999999999999e-05 2024-09-10T06:28:18.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.549370+0000", 2024-09-10T06:28:18.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2871000000000003e-05 2024-09-10T06:28:18.306 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.306 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.306 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.306 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1758 3.c 3:30c1ab1b:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.306 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.568417+0000", 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.657779026, 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.031919546, 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1758 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.568417+0000", 2024-09-10T06:28:18.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.568417+0000", 2024-09-10T06:28:18.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.568421+0000", 2024-09-10T06:28:18.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3830000000000002e-06 2024-09-10T06:28:18.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.572700+0000", 2024-09-10T06:28:18.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042786489999999998 2024-09-10T06:28:18.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.572737+0000", 2024-09-10T06:28:18.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7591e-05 2024-09-10T06:28:18.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.572754+0000", 2024-09-10T06:28:18.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6963e-05 2024-09-10T06:28:18.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.572880+0000", 2024-09-10T06:28:18.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012607100000000001 2024-09-10T06:28:18.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.573127+0000", 2024-09-10T06:28:18.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024628600000000002 2024-09-10T06:28:18.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:18.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.573352+0000", 2024-09-10T06:28:18.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022482599999999999 2024-09-10T06:28:18.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.582293+0000", 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089417360000000005 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.600217+0000", 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01792384 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.600285+0000", 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7353000000000004e-05 2024-09-10T06:28:18.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.600336+0000", 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1848000000000002e-05 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1773 3.36 3:6dd9d777:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.854355+0000", 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.371840787, 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020478250999999999, 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.312 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.313 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.313 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1773 2024-09-10T06:28:18.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.313 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.854355+0000", 2024-09-10T06:28:18.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.854355+0000", 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.854359+0000", 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.557e-06 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858551+0000", 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041923760000000003 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858588+0000", 2024-09-10T06:28:18.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6591000000000003e-05 2024-09-10T06:28:18.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858605+0000", 2024-09-10T06:28:18.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7223000000000001e-05 2024-09-10T06:28:18.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858730+0000", 2024-09-10T06:28:18.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000125511 2024-09-10T06:28:18.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858977+0000", 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024648600000000002 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.859205+0000", 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000228299 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.866046+0000", 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068413010000000002 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.874668+0000", 2024-09-10T06:28:18.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086216499999999998 2024-09-10T06:28:18.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.874760+0000", 2024-09-10T06:28:18.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1926e-05 2024-09-10T06:28:18.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.874833+0000", 2024-09-10T06:28:18.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3331000000000007e-05 2024-09-10T06:28:18.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1774 3.30 3:0db12388:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.877453+0000", 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.3487428100000001, 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022593780000000001, 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.318 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1774 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.877453+0000", 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.877453+0000", 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.877456+0000", 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6800000000000002e-06 2024-09-10T06:28:18.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881345+0000", 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038893529999999999 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881378+0000", 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3374000000000003e-05 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881394+0000", 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5327000000000001e-05 2024-09-10T06:28:18.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881555+0000", 2024-09-10T06:28:18.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161356 2024-09-10T06:28:18.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881815+0000", 2024-09-10T06:28:18.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026025499999999998 2024-09-10T06:28:18.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:18.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.882089+0000", 2024-09-10T06:28:18.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027335400000000001 2024-09-10T06:28:18.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.891046+0000", 2024-09-10T06:28:18.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089577000000000007 2024-09-10T06:28:18.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.899882+0000", 2024-09-10T06:28:18.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088357350000000008 2024-09-10T06:28:18.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.899976+0000", 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3338999999999995e-05 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.900047+0000", 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1307e-05 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1775 3.2f 3:f4c391ba:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.900332+0000", 2024-09-10T06:28:18.323 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.3258642959999998, 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02158852, 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1775 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.900332+0000", 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.900332+0000", 2024-09-10T06:28:18.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.900334+0000", 2024-09-10T06:28:18.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-10T06:28:18.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904266+0000", 2024-09-10T06:28:18.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039319439999999997 2024-09-10T06:28:18.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904302+0000", 2024-09-10T06:28:18.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6235000000000001e-05 2024-09-10T06:28:18.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904327+0000", 2024-09-10T06:28:18.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4545e-05 2024-09-10T06:28:18.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904515+0000", 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187932 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904773+0000", 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000258022 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.905009+0000", 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023653899999999999 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.913889+0000", 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088796799999999992 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.921726+0000", 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078370260000000004 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.921843+0000", 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011721400000000001 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.921920+0000", 2024-09-10T06:28:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6662999999999994e-05 2024-09-10T06:28:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1779 3.2f 3:f63ca6bf:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.959254+0000", 2024-09-10T06:28:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.266942035, 2024-09-10T06:28:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021331428999999999, 2024-09-10T06:28:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1779 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.959254+0000", 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.959254+0000", 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.959257+0000", 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2600000000000001e-06 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963270+0000", 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040126909999999997 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963309+0000", 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9558000000000003e-05 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963327+0000", 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7952999999999999e-05 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963468+0000", 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014084699999999999 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963717+0000", 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024887800000000001 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:18.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963944+0000", 2024-09-10T06:28:18.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022745 2024-09-10T06:28:18.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976421+0000", 2024-09-10T06:28:18.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012476529 2024-09-10T06:28:18.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.980418+0000", 2024-09-10T06:28:18.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039974770000000001 2024-09-10T06:28:18.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.980510+0000", 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1896000000000002e-05 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.980585+0000", 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4889999999999996e-05 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1780 3.5 3:a2a1f206:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.334 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.970512+0000", 2024-09-10T06:28:18.335 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.2556840139999998, 2024-09-10T06:28:18.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021558898, 2024-09-10T06:28:18.335 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.335 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.335 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.335 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1780 2024-09-10T06:28:18.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.335 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.970512+0000", 2024-09-10T06:28:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.970512+0000", 2024-09-10T06:28:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.970516+0000", 2024-09-10T06:28:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7859999999999998e-06 2024-09-10T06:28:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976034+0000", 2024-09-10T06:28:18.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055182190000000004 2024-09-10T06:28:18.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976067+0000", 2024-09-10T06:28:18.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3628999999999999e-05 2024-09-10T06:28:18.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976085+0000", 2024-09-10T06:28:18.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7921999999999999e-05 2024-09-10T06:28:18.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976224+0000", 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000138171 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976551+0000", 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032767199999999999 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976821+0000", 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026987400000000003 2024-09-10T06:28:18.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.986827+0000", 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010006088999999999 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.991915+0000", 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050881859999999998 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.992005+0000", 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9553000000000001e-05 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.992071+0000", 2024-09-10T06:28:18.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5796999999999994e-05 2024-09-10T06:28:18.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.340 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.340 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.340 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:18.341 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:28:18.342 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:18.335+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:18.443 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:18.439+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:18.469 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:18.469 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:18.469 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:18.483 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:28:18.544 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:18.539+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:18.605 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T06:28:18.646 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:18.646 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:18.650 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:18.647+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:18.660 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:28:18.745 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:18.743+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:18.779 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:18.779 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:18.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:18.779 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:18.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.779 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1363 3.a 3:52044754:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.779 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.755256785, 2024-09-10T06:28:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021475438999999999, 2024-09-10T06:28:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1363 2024-09-10T06:28:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023232+0000", 2024-09-10T06:28:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6500000000000002e-06 2024-09-10T06:28:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027903+0000", 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046709569999999999 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027944+0000", 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1e-05 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027963+0000", 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9363000000000001e-05 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028108+0000", 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144306 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028370+0000", 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026210300000000002 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028610+0000", 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024058 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.036472+0000", 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078620170000000007 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044306+0000", 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078340070000000005 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044496+0000", 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189507 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044704+0000", 2024-09-10T06:28:18.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207949 2024-09-10T06:28:18.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.785 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.785 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1364 3.36 3:6e968b0d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.785 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:18.785 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.743265247, 2024-09-10T06:28:18.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022135317000000002, 2024-09-10T06:28:18.785 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.785 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1364 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:18.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035266+0000", 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6529999999999997e-05 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039528+0000", 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042612580000000004 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039570+0000", 2024-09-10T06:28:18.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2481000000000002e-05 2024-09-10T06:28:18.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039594+0000", 2024-09-10T06:28:18.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3564999999999999e-05 2024-09-10T06:28:18.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039735+0000", 2024-09-10T06:28:18.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014147000000000001 2024-09-10T06:28:18.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039983+0000", 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024765399999999998 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.040216+0000", 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023322999999999999 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.049930+0000", 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097135920000000001 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057061+0000", 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071309570000000003 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057234+0000", 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173308 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057355+0000", 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121272 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.790 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1370 3.26 3:64e41eab:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.668529714999998, 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022030800999999999, 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1370 2024-09-10T06:28:18.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.792 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:18.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:18.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109960+0000", 2024-09-10T06:28:18.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3930000000000001e-06 2024-09-10T06:28:18.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114711+0000", 2024-09-10T06:28:18.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047511580000000001 2024-09-10T06:28:18.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114749+0000", 2024-09-10T06:28:18.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8417999999999997e-05 2024-09-10T06:28:18.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114768+0000", 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8352e-05 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114926+0000", 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015819599999999999 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115321+0000", 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039507300000000002 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115735+0000", 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041369900000000001 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.125212+0000", 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094774109999999998 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131666+0000", 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064533730000000001 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131847+0000", 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018112400000000001 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131986+0000", 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013960399999999999 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1371 3.2e e63/22 3:741ddced:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_126:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:18.796 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.653569251, 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440024000000001, 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:18.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124919+0000", 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130095+0000", 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00517645 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130125+0000", 2024-09-10T06:28:18.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9944e-05 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130142+0000", 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6515999999999999e-05 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130252+0000", 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110473 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130297+0000", 2024-09-10T06:28:18.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5012999999999997e-05 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149096+0000", 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018799429999999999 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149356+0000", 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000259499 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.801 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1372 3.36 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.801 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:18.801 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.646012627000001, 2024-09-10T06:28:18.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026714723999999999, 2024-09-10T06:28:18.801 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.801 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.801 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1372 2024-09-10T06:28:18.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.801 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:18.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:18.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132475+0000", 2024-09-10T06:28:18.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.65e-06 2024-09-10T06:28:18.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137399+0000", 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049236530000000001 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137432+0000", 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3050999999999999e-05 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137449+0000", 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6976000000000001e-05 2024-09-10T06:28:18.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137569+0000", 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012016899999999999 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137884+0000", 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031455799999999999 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138191+0000", 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000307466 2024-09-10T06:28:18.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157760+0000", 2024-09-10T06:28:18.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019569128000000002 2024-09-10T06:28:18.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157954+0000", 2024-09-10T06:28:18.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019375300000000001 2024-09-10T06:28:18.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158118+0000", 2024-09-10T06:28:18.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016390900000000001 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.159187+0000", 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010694109999999999 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1373 3.35 3:ac8a3287:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.635679635999999, 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023907627000000001, 2024-09-10T06:28:18.806 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.807 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.807 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.807 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1373 2024-09-10T06:28:18.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.807 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:18.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:18.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142810+0000", 2024-09-10T06:28:18.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6129999999999997e-06 2024-09-10T06:28:18.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.146972+0000", 2024-09-10T06:28:18.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041615180000000003 2024-09-10T06:28:18.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147029+0000", 2024-09-10T06:28:18.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7476000000000003e-05 2024-09-10T06:28:18.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147056+0000", 2024-09-10T06:28:18.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7021000000000001e-05 2024-09-10T06:28:18.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147249+0000", 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019260999999999999 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147702+0000", 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045347999999999997 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148113+0000", 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041051899999999998 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161583+0000", 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013470278 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166410+0000", 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048270199999999996 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166579+0000", 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016839099999999999 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166713+0000", 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013470100000000001 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1387 3.35 3:adfbe02e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.496551349000001, 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021055645000000001, 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.812 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1387 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281938+0000", 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0659999999999997e-06 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286048+0000", 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041104560000000002 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286097+0000", 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8715999999999999e-05 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286126+0000", 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9308000000000001e-05 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286279+0000", 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015285400000000001 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286520+0000", 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024062000000000001 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286772+0000", 2024-09-10T06:28:18.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025170599999999998 2024-09-10T06:28:18.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.301846+0000", 2024-09-10T06:28:18.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015074363 2024-09-10T06:28:18.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302698+0000", 2024-09-10T06:28:18.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000852179 2024-09-10T06:28:18.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302864+0000", 2024-09-10T06:28:18.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016568900000000001 2024-09-10T06:28:18.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302990+0000", 2024-09-10T06:28:18.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012568799999999999 2024-09-10T06:28:18.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.817 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.817 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1398 3.2c 3:350a23e7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.817 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:18.817 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.383508030000002, 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032248536000000001, 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1398 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394981+0000", 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7359999999999999e-06 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402145+0000", 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071643540000000004 2024-09-10T06:28:18.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402182+0000", 2024-09-10T06:28:18.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6318e-05 2024-09-10T06:28:18.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402200+0000", 2024-09-10T06:28:18.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8439000000000001e-05 2024-09-10T06:28:18.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402391+0000", 2024-09-10T06:28:18.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190917 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402649+0000", 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025817599999999999 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402908+0000", 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025864300000000002 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424973+0000", 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022065004999999999 2024-09-10T06:28:18.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.426990+0000", 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020169340000000002 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427129+0000", 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139436 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427226+0000", 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6577999999999996e-05 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.822 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.823 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.823 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1415 3.2c 3:34c14757:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.823 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:18.823 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.315661032000001, 2024-09-10T06:28:18.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029598765999999999, 2024-09-10T06:28:18.823 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.823 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.823 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.823 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1415 2024-09-10T06:28:18.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.824 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:18.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462828+0000", 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1999999999999996e-06 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.466974+0000", 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041452989999999999 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467026+0000", 2024-09-10T06:28:18.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2416000000000001e-05 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467055+0000", 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9081000000000002e-05 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467207+0000", 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015225699999999999 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467468+0000", 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026093500000000001 2024-09-10T06:28:18.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467755+0000", 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000287101 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477312+0000", 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095560300000000001 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492136+0000", 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014824936 2024-09-10T06:28:18.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492301+0000", 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016411600000000001 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492423+0000", 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122395 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.828 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1416 3.10 3:084717f7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:18.829 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:18.829 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.306626783999999, 2024-09-10T06:28:18.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021526931999999999, 2024-09-10T06:28:18.829 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.829 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.829 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.829 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1416 2024-09-10T06:28:18.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.829 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471863+0000", 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477370+0000", 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055071549999999997 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477402+0000", 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1498000000000002e-05 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477423+0000", 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1098e-05 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477559+0000", 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136627 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477936+0000", 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037718099999999998 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.478271+0000", 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033427799999999997 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.490997+0000", 2024-09-10T06:28:18.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012725858 2024-09-10T06:28:18.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493126+0000", 2024-09-10T06:28:18.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002129499 2024-09-10T06:28:18.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493263+0000", 2024-09-10T06:28:18.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013682500000000001 2024-09-10T06:28:18.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493385+0000", 2024-09-10T06:28:18.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122414 2024-09-10T06:28:18.834 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.834 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.834 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.834 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1482 3.35 3:ad9242de:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:18.834 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:18.834 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.618321049999999, 2024-09-10T06:28:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022710764000000001, 2024-09-10T06:28:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1482 2024-09-10T06:28:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:18.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:18.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160166+0000", 2024-09-10T06:28:18.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1069999999999999e-06 2024-09-10T06:28:18.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163977+0000", 2024-09-10T06:28:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003810843 2024-09-10T06:28:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163995+0000", 2024-09-10T06:28:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7648000000000001e-05 2024-09-10T06:28:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164010+0000", 2024-09-10T06:28:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4754e-05 2024-09-10T06:28:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164094+0000", 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4473000000000003e-05 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164281+0000", 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018659699999999999 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164458+0000", 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017758300000000001 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.179923+0000", 2024-09-10T06:28:18.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015465269 2024-09-10T06:28:18.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182736+0000", 2024-09-10T06:28:18.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028130579999999998 2024-09-10T06:28:18.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182816+0000", 2024-09-10T06:28:18.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9976999999999997e-05 2024-09-10T06:28:18.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182875+0000", 2024-09-10T06:28:18.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8455000000000002e-05 2024-09-10T06:28:18.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.840 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.840 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1664 3.a 3:52f62ee7:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:18.840 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:18.840 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.954295811, 2024-09-10T06:28:18.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020253482999999999, 2024-09-10T06:28:18.840 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.840 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1664 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824193+0000", 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6059999999999999e-06 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829549+0000", 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053562189999999997 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829584+0000", 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4925000000000002e-05 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829602+0000", 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8034999999999999e-05 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829716+0000", 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113522 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829903+0000", 2024-09-10T06:28:18.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187443 2024-09-10T06:28:18.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:18.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.830162+0000", 2024-09-10T06:28:18.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025917900000000001 2024-09-10T06:28:18.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.843459+0000", 2024-09-10T06:28:18.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01329675 2024-09-10T06:28:18.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844211+0000", 2024-09-10T06:28:18.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075213700000000005 2024-09-10T06:28:18.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844286+0000", 2024-09-10T06:28:18.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4453e-05 2024-09-10T06:28:18.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844443+0000", 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157214 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1754 3.3b 3:ded70450:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.481010+0000", 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2974754050000001, 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033092867999999998, 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.846 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1754 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.481010+0000", 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.481010+0000", 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.481012+0000", 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487559+0000", 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065467889999999999 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487603+0000", 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3254999999999998e-05 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487622+0000", 2024-09-10T06:28:18.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9142000000000001e-05 2024-09-10T06:28:18.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487793+0000", 2024-09-10T06:28:18.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017092299999999999 2024-09-10T06:28:18.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.488035+0000", 2024-09-10T06:28:18.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000242563 2024-09-10T06:28:18.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:18.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.488258+0000", 2024-09-10T06:28:18.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022282000000000001 2024-09-10T06:28:18.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.501495+0000", 2024-09-10T06:28:18.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013236988 2024-09-10T06:28:18.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.513877+0000", 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012382166 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.513986+0000", 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108405 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.514103+0000", 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117155 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1765 3.2c 3:36655c69:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.683969+0000", 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0945165240000003, 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018761877999999999, 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1765 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.683969+0000", 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.683969+0000", 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.683971+0000", 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7250000000000002e-06 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688364+0000", 2024-09-10T06:28:18.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043926399999999997 2024-09-10T06:28:18.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688389+0000", 2024-09-10T06:28:18.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199999999999999e-05 2024-09-10T06:28:18.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688401+0000", 2024-09-10T06:28:18.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1834999999999999e-05 2024-09-10T06:28:18.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688496+0000", 2024-09-10T06:28:18.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4661999999999996e-05 2024-09-10T06:28:18.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688685+0000", 2024-09-10T06:28:18.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018916899999999999 2024-09-10T06:28:18.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:18.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688800+0000", 2024-09-10T06:28:18.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115047 2024-09-10T06:28:18.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.696257+0000", 2024-09-10T06:28:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007457371 2024-09-10T06:28:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.702611+0000", 2024-09-10T06:28:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063533180000000002 2024-09-10T06:28:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.702693+0000", 2024-09-10T06:28:18.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2021000000000006e-05 2024-09-10T06:28:18.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.702731+0000", 2024-09-10T06:28:18.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7889999999999998e-05 2024-09-10T06:28:18.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.857 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.857 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1768 3.26 3:655dfe81:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.857 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.749704+0000", 2024-09-10T06:28:18.857 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0287809870000002, 2024-09-10T06:28:18.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018211538999999999, 2024-09-10T06:28:18.858 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.858 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.858 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.858 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.858 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.858 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.858 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1768 2024-09-10T06:28:18.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.858 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.749704+0000", 2024-09-10T06:28:18.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.749704+0000", 2024-09-10T06:28:18.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.749707+0000", 2024-09-10T06:28:18.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8490000000000002e-06 2024-09-10T06:28:18.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753470+0000", 2024-09-10T06:28:18.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003762601 2024-09-10T06:28:18.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753503+0000", 2024-09-10T06:28:18.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3556999999999997e-05 2024-09-10T06:28:18.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753517+0000", 2024-09-10T06:28:18.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3946e-05 2024-09-10T06:28:18.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753641+0000", 2024-09-10T06:28:18.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349099999999999 2024-09-10T06:28:18.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753919+0000", 2024-09-10T06:28:18.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027816400000000002 2024-09-10T06:28:18.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:18.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.754150+0000", 2024-09-10T06:28:18.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000230967 2024-09-10T06:28:18.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767713+0000", 2024-09-10T06:28:18.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013563225999999999 2024-09-10T06:28:18.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767757+0000", 2024-09-10T06:28:18.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4401999999999999e-05 2024-09-10T06:28:18.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767848+0000", 2024-09-10T06:28:18.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0209000000000003e-05 2024-09-10T06:28:18.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767916+0000", 2024-09-10T06:28:18.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8126999999999993e-05 2024-09-10T06:28:18.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.863 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.863 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1771 3.10 3:0b728edd:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.863 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.819227+0000", 2024-09-10T06:28:18.863 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.959258089, 2024-09-10T06:28:18.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020819891, 2024-09-10T06:28:18.864 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.864 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.864 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.864 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.864 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1771 2024-09-10T06:28:18.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.864 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.819227+0000", 2024-09-10T06:28:18.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.819227+0000", 2024-09-10T06:28:18.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.819231+0000", 2024-09-10T06:28:18.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.596e-06 2024-09-10T06:28:18.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823354+0000", 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041235350000000002 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823376+0000", 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1838999999999999e-05 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823394+0000", 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8116000000000001e-05 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823527+0000", 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013270799999999999 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823790+0000", 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026267199999999998 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.824038+0000", 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024825200000000002 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.832733+0000", 2024-09-10T06:28:18.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086948110000000002 2024-09-10T06:28:18.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.839945+0000", 2024-09-10T06:28:18.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072128119999999999 2024-09-10T06:28:18.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.840000+0000", 2024-09-10T06:28:18.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4987000000000001e-05 2024-09-10T06:28:18.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.840047+0000", 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6563000000000001e-05 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1776 3.10 3:08e15545:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.923066+0000", 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8554188759999999, 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027201434, 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.869 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.870 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1776 2024-09-10T06:28:18.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.870 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.923066+0000", 2024-09-10T06:28:18.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.923066+0000", 2024-09-10T06:28:18.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.923070+0000", 2024-09-10T06:28:18.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9859999999999996e-06 2024-09-10T06:28:18.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927726+0000", 2024-09-10T06:28:18.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046555549999999996 2024-09-10T06:28:18.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927764+0000", 2024-09-10T06:28:18.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7709000000000001e-05 2024-09-10T06:28:18.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927782+0000", 2024-09-10T06:28:18.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8592000000000001e-05 2024-09-10T06:28:18.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927974+0000", 2024-09-10T06:28:18.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019189500000000001 2024-09-10T06:28:18.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.928245+0000", 2024-09-10T06:28:18.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000270454 2024-09-10T06:28:18.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:18.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.928474+0000", 2024-09-10T06:28:18.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022925699999999999 2024-09-10T06:28:18.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.935435+0000", 2024-09-10T06:28:18.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069609049999999999 2024-09-10T06:28:18.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.950096+0000", 2024-09-10T06:28:18.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014661097999999999 2024-09-10T06:28:18.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.950190+0000", 2024-09-10T06:28:18.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4631999999999998e-05 2024-09-10T06:28:18.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.950268+0000", 2024-09-10T06:28:18.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7350999999999999e-05 2024-09-10T06:28:18.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.875 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.875 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1784 3.20 3:054632f9:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.875 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.038819+0000", 2024-09-10T06:28:18.875 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.7396664550000001, 2024-09-10T06:28:18.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02561799, 2024-09-10T06:28:18.875 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.875 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.875 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.876 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1784 2024-09-10T06:28:18.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.876 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.038819+0000", 2024-09-10T06:28:18.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.038819+0000", 2024-09-10T06:28:18.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.038822+0000", 2024-09-10T06:28:18.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6059999999999999e-06 2024-09-10T06:28:18.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043474+0000", 2024-09-10T06:28:18.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004651947 2024-09-10T06:28:18.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043515+0000", 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0901e-05 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043533+0000", 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7989999999999999e-05 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043684+0000", 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150786 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043937+0000", 2024-09-10T06:28:18.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025274899999999997 2024-09-10T06:28:18.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:18.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.044177+0000", 2024-09-10T06:28:18.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024046000000000001 2024-09-10T06:28:18.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.050984+0000", 2024-09-10T06:28:18.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006806739 2024-09-10T06:28:18.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064079+0000", 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013094924000000001 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064258+0000", 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017905500000000001 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064437+0000", 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017883299999999999 2024-09-10T06:28:18.880 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.881 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.881 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1792 3.26 3:674d8f8e:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.881 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.126132+0000", 2024-09-10T06:28:18.881 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.6523534689999999, 2024-09-10T06:28:18.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022657136000000001, 2024-09-10T06:28:18.881 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.881 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.881 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.881 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1792 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.126132+0000", 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.126132+0000", 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.126136+0000", 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8700000000000002e-06 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130132+0000", 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039961140000000003 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130172+0000", 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0052000000000002e-05 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130191+0000", 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9176000000000001e-05 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130393+0000", 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020170400000000001 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130656+0000", 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000262952 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:18.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130893+0000", 2024-09-10T06:28:18.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023785599999999999 2024-09-10T06:28:18.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.138071+0000", 2024-09-10T06:28:18.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071771969999999997 2024-09-10T06:28:18.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.148497+0000", 2024-09-10T06:28:18.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010426444 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.148669+0000", 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000172096 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.148789+0000", 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119675 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1793 3.20 3:044d7174:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.136820+0000", 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.641665047, 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024061645, 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1793 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:18.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.136820+0000", 2024-09-10T06:28:18.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:18.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.136820+0000", 2024-09-10T06:28:18.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:18.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:18.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.136825+0000", 2024-09-10T06:28:18.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4700000000000004e-06 2024-09-10T06:28:18.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.142937+0000", 2024-09-10T06:28:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061127400000000002 2024-09-10T06:28:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.142976+0000", 2024-09-10T06:28:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8927999999999997e-05 2024-09-10T06:28:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143003+0000", 2024-09-10T06:28:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6914999999999999e-05 2024-09-10T06:28:18.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143141+0000", 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013770399999999999 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143399+0000", 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025788299999999998 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143650+0000", 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025162200000000001 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.151461+0000", 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078103410000000002 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.160675+0000", 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092145309999999998 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.160773+0000", 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7316000000000001e-05 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:18.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:18.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:18.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.160882+0000", 2024-09-10T06:28:18.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109195 2024-09-10T06:28:18.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.892 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:18.892 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:18.892 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:18.893 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:28:18.894 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:18.891+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:18.994 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:18.991+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:19.061 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:19.062 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:19.075 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:28:19.120 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:19.119+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:19.197 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:19.191+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:19.197 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:19.198 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:19.198 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:19.198 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:19.198 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:19.212 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:28:19.298 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:19.295+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:19.378 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:19.378 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:19.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:19.379 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:19.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.379 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:19.379 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:19.379 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 121.931105449, 2024-09-10T06:28:19.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70775834699999995, 2024-09-10T06:28:19.379 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.379 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.379 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.379 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.379 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:19.379 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:19.379 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1 2024-09-10T06:28:19.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.380 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:19.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:19.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446852+0000", 2024-09-10T06:28:19.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.117e-06 2024-09-10T06:28:19.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446870+0000", 2024-09-10T06:28:19.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7569999999999999e-05 2024-09-10T06:28:19.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446892+0000", 2024-09-10T06:28:19.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2036e-05 2024-09-10T06:28:19.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446908+0000", 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6719999999999999e-05 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447040+0000", 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013118299999999999 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447054+0000", 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4343e-05 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.151730+0000", 2024-09-10T06:28:19.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70467560600000001 2024-09-10T06:28:19.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152054+0000", 2024-09-10T06:28:19.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032444100000000002 2024-09-10T06:28:19.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:19.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152404+0000", 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000349938 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.153773+0000", 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013693620000000001 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154454+0000", 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068035800000000005 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154544+0000", 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0623000000000003e-05 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154607+0000", 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3050000000000001e-05 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 121.09287752900001, 2024-09-10T06:28:19.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021819150999999998, 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 51 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285078+0000", 2024-09-10T06:28:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000001e-07 2024-09-10T06:28:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285083+0000", 2024-09-10T06:28:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6099999999999997e-06 2024-09-10T06:28:19.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285092+0000", 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2399999999999996e-06 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285100+0000", 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8739999999999995e-06 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300938+0000", 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015837527000000001 2024-09-10T06:28:19.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301058+0000", 2024-09-10T06:28:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012032300000000001 2024-09-10T06:28:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301251+0000", 2024-09-10T06:28:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192828 2024-09-10T06:28:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302937+0000", 2024-09-10T06:28:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016857339999999999 2024-09-10T06:28:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306745+0000", 2024-09-10T06:28:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038078729999999998 2024-09-10T06:28:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306830+0000", 2024-09-10T06:28:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5432999999999993e-05 2024-09-10T06:28:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306896+0000", 2024-09-10T06:28:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5993000000000003e-05 2024-09-10T06:28:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 121.092837653, 2024-09-10T06:28:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021995553000000001, 2024-09-10T06:28:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.391 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 52 2024-09-10T06:28:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4000000000000001e-07 2024-09-10T06:28:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285123+0000", 2024-09-10T06:28:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6969999999999998e-06 2024-09-10T06:28:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285132+0000", 2024-09-10T06:28:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1560000000000001e-06 2024-09-10T06:28:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285139+0000", 2024-09-10T06:28:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1539999999999996e-06 2024-09-10T06:28:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301865+0000", 2024-09-10T06:28:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016725173999999999 2024-09-10T06:28:19.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301995+0000", 2024-09-10T06:28:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130739 2024-09-10T06:28:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302195+0000", 2024-09-10T06:28:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000199965 2024-09-10T06:28:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.303135+0000", 2024-09-10T06:28:19.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093978300000000002 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306979+0000", 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038437459999999999 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307057+0000", 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7766e-05 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307112+0000", 2024-09-10T06:28:19.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5733000000000003e-05 2024-09-10T06:28:19.397 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.397 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.397 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.397 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1374 3.2f e63/22 3:f735f5eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_129:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:19.397 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:19.397 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.219794407999998, 2024-09-10T06:28:19.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022402502000000001, 2024-09-10T06:28:19.397 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.397 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.397 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.397 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158162+0000", 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4569999999999999e-06 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161871+0000", 2024-09-10T06:28:19.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037080799999999999 2024-09-10T06:28:19.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161914+0000", 2024-09-10T06:28:19.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3571e-05 2024-09-10T06:28:19.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161940+0000", 2024-09-10T06:28:19.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5876000000000001e-05 2024-09-10T06:28:19.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.162081+0000", 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014147000000000001 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.162123+0000", 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1666999999999999e-05 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.180416+0000", 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018292881 2024-09-10T06:28:19.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.180562+0000", 2024-09-10T06:28:19.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014650000000000001 2024-09-10T06:28:19.401 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.401 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.401 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.401 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1378 3.2d 3:b4d0ba6d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:19.401 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:19.401 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.186233748999999, 2024-09-10T06:28:19.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029738187999999999, 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1378 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:19.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191724+0000", 2024-09-10T06:28:19.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2650000000000001e-06 2024-09-10T06:28:19.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196514+0000", 2024-09-10T06:28:19.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047904039999999998 2024-09-10T06:28:19.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196552+0000", 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8034999999999998e-05 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196577+0000", 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5120999999999999e-05 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196716+0000", 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013837699999999999 2024-09-10T06:28:19.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196970+0000", 2024-09-10T06:28:19.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025406300000000001 2024-09-10T06:28:19.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:19.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.197196+0000", 2024-09-10T06:28:19.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022647499999999999 2024-09-10T06:28:19.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211315+0000", 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014118175 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.220793+0000", 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094785640000000001 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221044+0000", 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025106 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221459+0000", 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041464900000000001 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1379 3.11 3:8ad434e9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.176555330999999, 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021255388, 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.407 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1379 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201402+0000", 2024-09-10T06:28:19.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2459999999999999e-06 2024-09-10T06:28:19.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205915+0000", 2024-09-10T06:28:19.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045131149999999998 2024-09-10T06:28:19.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205948+0000", 2024-09-10T06:28:19.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2259999999999999e-05 2024-09-10T06:28:19.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205966+0000", 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8238999999999999e-05 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.206162+0000", 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000195782 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.206607+0000", 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044565000000000002 2024-09-10T06:28:19.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.207031+0000", 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000423714 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221664+0000", 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014632895 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222398+0000", 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073376099999999998 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222569+0000", 2024-09-10T06:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017139400000000001 2024-09-10T06:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222654+0000", 2024-09-10T06:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5332000000000002e-05 2024-09-10T06:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.412 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1426 3.2d 3:b764a1d5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.811214738, 2024-09-10T06:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027451646999999999, 2024-09-10T06:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1426 2024-09-10T06:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.413 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:19.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:19.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566742+0000", 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.317e-06 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570553+0000", 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038114680000000001 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570585+0000", 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1940999999999998e-05 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570601+0000", 2024-09-10T06:28:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5218000000000001e-05 2024-09-10T06:28:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570723+0000", 2024-09-10T06:28:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012265099999999999 2024-09-10T06:28:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570966+0000", 2024-09-10T06:28:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024268099999999999 2024-09-10T06:28:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.571204+0000", 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000238213 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.584059+0000", 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012854477 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594094+0000", 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010034992 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594146+0000", 2024-09-10T06:28:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2497999999999998e-05 2024-09-10T06:28:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594191+0000", 2024-09-10T06:28:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5191000000000002e-05 2024-09-10T06:28:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.418 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1435 3.2d 3:b4574439:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.714468781000001, 2024-09-10T06:28:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.035042897000000003, 2024-09-10T06:28:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1435 2024-09-10T06:28:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663488+0000", 2024-09-10T06:28:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.616e-06 2024-09-10T06:28:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667246+0000", 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037580579999999999 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667277+0000", 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0688000000000002e-05 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667291+0000", 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4472e-05 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667411+0000", 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011913699999999999 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667422+0000", 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1073000000000001e-05 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674124+0000", 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067023619999999999 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674520+0000", 2024-09-10T06:28:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039614700000000001 2024-09-10T06:28:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674879+0000", 2024-09-10T06:28:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035909899999999999 2024-09-10T06:28:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698261+0000", 2024-09-10T06:28:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023382209000000001 2024-09-10T06:28:19.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698338+0000", 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6915000000000005e-05 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698455+0000", 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117039 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698528+0000", 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3082000000000003e-05 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.424 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1436 3.2d 3:b7b59058:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.704905262, 2024-09-10T06:28:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032516167999999998, 2024-09-10T06:28:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.425 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1436 2024-09-10T06:28:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673052+0000", 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3629999999999998e-06 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678383+0000", 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053304199999999998 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678423+0000", 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0089999999999997e-05 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678442+0000", 2024-09-10T06:28:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9242e-05 2024-09-10T06:28:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.685257+0000", 2024-09-10T06:28:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068147920000000001 2024-09-10T06:28:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.685641+0000", 2024-09-10T06:28:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038388700000000002 2024-09-10T06:28:19.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.686106+0000", 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046506800000000001 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698619+0000", 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012513102999999999 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705364+0000", 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067448170000000002 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705482+0000", 2024-09-10T06:28:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118362 2024-09-10T06:28:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705565+0000", 2024-09-10T06:28:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3023999999999997e-05 2024-09-10T06:28:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.430 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1442 3.13 3:c8bde401:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.642824659999999, 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021096628999999999, 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1442 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735133+0000", 2024-09-10T06:28:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6899999999999998e-06 2024-09-10T06:28:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739406+0000", 2024-09-10T06:28:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042727950000000002 2024-09-10T06:28:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739432+0000", 2024-09-10T06:28:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6245999999999999e-05 2024-09-10T06:28:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739447+0000", 2024-09-10T06:28:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4071e-05 2024-09-10T06:28:19.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739575+0000", 2024-09-10T06:28:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000128641 2024-09-10T06:28:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739818+0000", 2024-09-10T06:28:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024242999999999999 2024-09-10T06:28:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.740058+0000", 2024-09-10T06:28:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023991 2024-09-10T06:28:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.748440+0000", 2024-09-10T06:28:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083824390000000002 2024-09-10T06:28:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756108+0000", 2024-09-10T06:28:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076684350000000004 2024-09-10T06:28:19.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756165+0000", 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6641000000000002e-05 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756226+0000", 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1330999999999999e-05 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.436 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1443 3.37 3:edd7279d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.632917896999999, 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022124847, 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1443 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745040+0000", 2024-09-10T06:28:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6490000000000001e-06 2024-09-10T06:28:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753657+0000", 2024-09-10T06:28:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086173410000000006 2024-09-10T06:28:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753697+0000", 2024-09-10T06:28:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9669999999999998e-05 2024-09-10T06:28:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753722+0000", 2024-09-10T06:28:19.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4666000000000001e-05 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753845+0000", 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012319699999999999 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753994+0000", 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149157 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.754120+0000", 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012597500000000001 2024-09-10T06:28:19.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.766728+0000", 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012608359 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767022+0000", 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029342099999999998 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767098+0000", 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6508999999999995e-05 2024-09-10T06:28:19.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767161+0000", 2024-09-10T06:28:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2903000000000004e-05 2024-09-10T06:28:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1469 3.d 3:b3f21559:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 19.343011000000001, 2024-09-10T06:28:19.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024987420999999999, 2024-09-10T06:28:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1469 2024-09-10T06:28:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:19.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034946+0000", 2024-09-10T06:28:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0630000000000002e-06 2024-09-10T06:28:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.038986+0000", 2024-09-10T06:28:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040398580000000003 2024-09-10T06:28:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039019+0000", 2024-09-10T06:28:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3167000000000003e-05 2024-09-10T06:28:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039037+0000", 2024-09-10T06:28:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7785999999999999e-05 2024-09-10T06:28:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039135+0000", 2024-09-10T06:28:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8152999999999994e-05 2024-09-10T06:28:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039321+0000", 2024-09-10T06:28:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000185243 2024-09-10T06:28:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039506+0000", 2024-09-10T06:28:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018496100000000001 2024-09-10T06:28:19.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.047253+0000", 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0077471889999999998 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059836+0000", 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012583145 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059879+0000", 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3090999999999998e-05 2024-09-10T06:28:19.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059931+0000", 2024-09-10T06:28:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1765000000000003e-05 2024-09-10T06:28:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1669 3.2d 3:b72c6e58:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.502978990000001, 2024-09-10T06:28:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021299012999999999, 2024-09-10T06:28:19.448 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1669 2024-09-10T06:28:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874979+0000", 2024-09-10T06:28:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7670000000000001e-06 2024-09-10T06:28:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880441+0000", 2024-09-10T06:28:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054614859999999998 2024-09-10T06:28:19.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880475+0000", 2024-09-10T06:28:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4542000000000002e-05 2024-09-10T06:28:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880492+0000", 2024-09-10T06:28:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7048999999999999e-05 2024-09-10T06:28:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880599+0000", 2024-09-10T06:28:19.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106741 2024-09-10T06:28:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880788+0000", 2024-09-10T06:28:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189168 2024-09-10T06:28:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880951+0000", 2024-09-10T06:28:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016303199999999999 2024-09-10T06:28:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.890345+0000", 2024-09-10T06:28:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093942379999999992 2024-09-10T06:28:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896112+0000", 2024-09-10T06:28:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057669289999999996 2024-09-10T06:28:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896204+0000", 2024-09-10T06:28:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2069000000000002e-05 2024-09-10T06:28:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896274+0000", 2024-09-10T06:28:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9992000000000003e-05 2024-09-10T06:28:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1671 3.37 3:ed354b67:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.480256677, 2024-09-10T06:28:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022257213000000001, 2024-09-10T06:28:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.454 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1671 2024-09-10T06:28:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897701+0000", 2024-09-10T06:28:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-10T06:28:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901677+0000", 2024-09-10T06:28:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039758609999999998 2024-09-10T06:28:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901717+0000", 2024-09-10T06:28:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9889999999999999e-05 2024-09-10T06:28:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901735+0000", 2024-09-10T06:28:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8185999999999998e-05 2024-09-10T06:28:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901926+0000", 2024-09-10T06:28:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019083899999999999 2024-09-10T06:28:19.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902165+0000", 2024-09-10T06:28:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023968200000000001 2024-09-10T06:28:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902392+0000", 2024-09-10T06:28:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022711399999999999 2024-09-10T06:28:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.915622+0000", 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013229708999999999 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919654+0000", 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040314699999999997 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919827+0000", 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173647 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919955+0000", 2024-09-10T06:28:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012767900000000001 2024-09-10T06:28:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1674 3.e 3:71dde5c5:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.445060151, 2024-09-10T06:28:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024662893000000002, 2024-09-10T06:28:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1674 2024-09-10T06:28:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932897+0000", 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3939999999999999e-06 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935777+0000", 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028807899999999998 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935803+0000", 2024-09-10T06:28:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6067e-05 2024-09-10T06:28:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935818+0000", 2024-09-10T06:28:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4696e-05 2024-09-10T06:28:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935939+0000", 2024-09-10T06:28:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120895 2024-09-10T06:28:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936155+0000", 2024-09-10T06:28:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021555000000000001 2024-09-10T06:28:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936376+0000", 2024-09-10T06:28:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221127 2024-09-10T06:28:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.951276+0000", 2024-09-10T06:28:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014900149999999999 2024-09-10T06:28:19.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957421+0000", 2024-09-10T06:28:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061452440000000002 2024-09-10T06:28:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957502+0000", 2024-09-10T06:28:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1290000000000003e-05 2024-09-10T06:28:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957557+0000", 2024-09-10T06:28:19.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.469e-05 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1675 3.13 3:cbcca46f:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.436204086, 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02191593, 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1675 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941752+0000", 2024-09-10T06:28:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1550000000000001e-06 2024-09-10T06:28:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945904+0000", 2024-09-10T06:28:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041513019999999999 2024-09-10T06:28:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945928+0000", 2024-09-10T06:28:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4113000000000001e-05 2024-09-10T06:28:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945941+0000", 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3052e-05 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946089+0000", 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014766599999999999 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946459+0000", 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037089600000000001 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946838+0000", 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037808900000000002 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957331+0000", 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010493195 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963409+0000", 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060786570000000003 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963559+0000", 2024-09-10T06:28:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014962600000000001 2024-09-10T06:28:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963666+0000", 2024-09-10T06:28:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107179 2024-09-10T06:28:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.471 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1684 3.e 3:70ef0483:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T06:28:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.279370316, 2024-09-10T06:28:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020215823000000001, 2024-09-10T06:28:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1684 2024-09-10T06:28:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098589+0000", 2024-09-10T06:28:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.673e-06 2024-09-10T06:28:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102294+0000", 2024-09-10T06:28:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037056160000000001 2024-09-10T06:28:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102319+0000", 2024-09-10T06:28:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4411000000000001e-05 2024-09-10T06:28:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102330+0000", 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1212999999999999e-05 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102457+0000", 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012733300000000001 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102472+0000", 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4236000000000001e-05 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106594+0000", 2024-09-10T06:28:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004122906 2024-09-10T06:28:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106701+0000", 2024-09-10T06:28:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106745 2024-09-10T06:28:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106809+0000", 2024-09-10T06:28:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107686 2024-09-10T06:28:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.117591+0000", 2024-09-10T06:28:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01078202 2024-09-10T06:28:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118617+0000", 2024-09-10T06:28:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001026218 2024-09-10T06:28:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118715+0000", 2024-09-10T06:28:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8004000000000006e-05 2024-09-10T06:28:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118800+0000", 2024-09-10T06:28:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4761999999999999e-05 2024-09-10T06:28:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1795 3.15 3:a8bb4476:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.157992+0000", 2024-09-10T06:28:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2199628650000003, 2024-09-10T06:28:19.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033173499000000002, 2024-09-10T06:28:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1795 2024-09-10T06:28:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.157992+0000", 2024-09-10T06:28:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.157992+0000", 2024-09-10T06:28:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.157996+0000", 2024-09-10T06:28:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3370000000000001e-06 2024-09-10T06:28:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164634+0000", 2024-09-10T06:28:19.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066382089999999999 2024-09-10T06:28:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164667+0000", 2024-09-10T06:28:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2741999999999999e-05 2024-09-10T06:28:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164684+0000", 2024-09-10T06:28:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6872999999999999e-05 2024-09-10T06:28:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164819+0000", 2024-09-10T06:28:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013543999999999999 2024-09-10T06:28:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.165087+0000", 2024-09-10T06:28:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026768899999999999 2024-09-10T06:28:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.165323+0000", 2024-09-10T06:28:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023572299999999999 2024-09-10T06:28:19.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.177948+0000", 2024-09-10T06:28:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012625658 2024-09-10T06:28:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.190846+0000", 2024-09-10T06:28:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012897782 2024-09-10T06:28:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.191029+0000", 2024-09-10T06:28:19.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000183086 2024-09-10T06:28:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.191165+0000", 2024-09-10T06:28:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013595999999999999 2024-09-10T06:28:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1797 3.f 3:f0b01c0d:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.176445+0000", 2024-09-10T06:28:19.484 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2015094550000001, 2024-09-10T06:28:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025704059000000001, 2024-09-10T06:28:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1797 2024-09-10T06:28:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.176445+0000", 2024-09-10T06:28:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.176445+0000", 2024-09-10T06:28:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.176448+0000", 2024-09-10T06:28:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1030000000000002e-06 2024-09-10T06:28:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181072+0000", 2024-09-10T06:28:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046238379999999999 2024-09-10T06:28:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181125+0000", 2024-09-10T06:28:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3124000000000002e-05 2024-09-10T06:28:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181150+0000", 2024-09-10T06:28:19.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5439000000000002e-05 2024-09-10T06:28:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181314+0000", 2024-09-10T06:28:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163566 2024-09-10T06:28:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181555+0000", 2024-09-10T06:28:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024091999999999999 2024-09-10T06:28:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181769+0000", 2024-09-10T06:28:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021398700000000001 2024-09-10T06:28:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.197700+0000", 2024-09-10T06:28:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015930990999999999 2024-09-10T06:28:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201865+0000", 2024-09-10T06:28:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041652800000000004 2024-09-10T06:28:19.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.202025+0000", 2024-09-10T06:28:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015980000000000001 2024-09-10T06:28:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.202149+0000", 2024-09-10T06:28:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012401099999999999 2024-09-10T06:28:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1799 3.11 3:8b44ea92:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.201684+0000", 2024-09-10T06:28:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.1762704719999997, 2024-09-10T06:28:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025177875999999998, 2024-09-10T06:28:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1799 2024-09-10T06:28:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.491 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201684+0000", 2024-09-10T06:28:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201684+0000", 2024-09-10T06:28:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:19.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201687+0000", 2024-09-10T06:28:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:28:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206479+0000", 2024-09-10T06:28:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047921869999999998 2024-09-10T06:28:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206515+0000", 2024-09-10T06:28:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5954999999999997e-05 2024-09-10T06:28:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206532+0000", 2024-09-10T06:28:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6736e-05 2024-09-10T06:28:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206723+0000", 2024-09-10T06:28:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000191022 2024-09-10T06:28:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206978+0000", 2024-09-10T06:28:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025566199999999998 2024-09-10T06:28:19.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.207206+0000", 2024-09-10T06:28:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000227717 2024-09-10T06:28:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.217181+0000", 2024-09-10T06:28:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099752969999999993 2024-09-10T06:28:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:19.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.226557+0000", 2024-09-10T06:28:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093756800000000008 2024-09-10T06:28:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.226732+0000", 2024-09-10T06:28:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017504900000000001 2024-09-10T06:28:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.226862+0000", 2024-09-10T06:28:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129701 2024-09-10T06:28:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.497 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:19.497 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:19.497 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:19.498 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:28:19.499 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:19.495+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:19.565 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:28:19.592 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-10T06:28:19.601 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:19.595+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:19.635 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:28:19.635 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:28:19.635 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:19.650 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:28:19.699 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:19.695+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:19.715 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:28:19.716 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:28:19.733 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:28:19.733 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:28:19.751 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:28:19.751 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:28:19.767 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:28:19.768 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:28:19.787 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:28:19.788 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:28:19.799 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:19.795+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:19.807 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:28:19.808 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:28:19.810 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:19.810 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:19.823 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:28:19.828 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:28:19.828 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:28:19.849 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:28:19.849 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:28:19.900 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:19.895+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:19.941 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:19.941 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:19.957 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:28:20.002 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:19.999+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:20.076 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:20.077 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:20.091 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:28:20.101 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:20.099+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:20.202 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:20.199+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:20.261 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:20.261 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:20.276 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:28:20.322 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:20.319+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:20.400 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:20.400 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:20.404 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:20.399+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:20.414 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:28:20.505 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:20.499+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:20.582 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:20.582 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:20.598 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:28:20.605 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:20.603+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:20.706 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:20.703+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:20.772 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:20.772 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:20.786 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:28:20.806 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:20.803+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:20.907 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:20.903+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:20.958 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:20.958 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:20.973 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:28:21.014 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:21.011+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:21.109 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:21.107+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:21.141 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:21.141 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:21.157 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:28:21.210 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:21.207+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:21.282 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:21.282 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:21.297 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:28:21.310 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:21.307+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:21.411 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:21.407+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:21.422 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:21.422 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:21.437 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:28:21.512 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:21.507+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:21.570 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:21.570 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:21.584 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:28:21.621 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T06:28:21.628 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:21.627+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:21.714 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:21.711+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:21.744 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:21.745 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:21.759 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:28:21.815 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:21.811+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:21.866 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:28:21.874 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:21.874 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:21.889 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:28:21.937 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:21.935+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:22.006 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:28:22.006 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:28:22.008 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:22.008 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:22.016 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:22.015+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:22.022 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:28:22.022 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:28:22.024 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:28:22.038 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:28:22.038 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:28:22.055 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:28:22.056 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:28:22.075 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:28:22.076 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:28:22.096 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:28:22.096 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:28:22.113 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:28:22.113 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:28:22.117 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:22.111+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:22.133 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:28:22.133 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:28:22.188 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:22.189 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:22.189 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:22.203 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:28:22.252 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:22.251+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:22.320 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:22.315+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:22.330 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:22.330 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:22.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:22.330 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:22.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.330 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1354 3.5 3:a2100466:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:22.330 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:22.330 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.407693947999999, 2024-09-10T06:28:22.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022320934000000001, 2024-09-10T06:28:22.330 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.330 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.330 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1354 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:22.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919975+0000", 2024-09-10T06:28:22.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4369999999999999e-06 2024-09-10T06:28:22.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926675+0000", 2024-09-10T06:28:22.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066993529999999999 2024-09-10T06:28:22.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926705+0000", 2024-09-10T06:28:22.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0391000000000001e-05 2024-09-10T06:28:22.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926722+0000", 2024-09-10T06:28:22.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7159e-05 2024-09-10T06:28:22.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926840+0000", 2024-09-10T06:28:22.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117459 2024-09-10T06:28:22.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.927092+0000", 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025180899999999997 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.927353+0000", 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026148499999999999 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.940116+0000", 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01276245 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.941993+0000", 2024-09-10T06:28:22.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001877079 2024-09-10T06:28:22.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.942164+0000", 2024-09-10T06:28:22.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171378 2024-09-10T06:28:22.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.942293+0000", 2024-09-10T06:28:22.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012893400000000001 2024-09-10T06:28:22.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.336 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.336 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1355 3.16 3:6be207af:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:22.336 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:22.336 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.396944347000002, 2024-09-10T06:28:22.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023027044, 2024-09-10T06:28:22.336 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.336 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.336 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.337 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1355 2024-09-10T06:28:22.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.337 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:22.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:22.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930724+0000", 2024-09-10T06:28:22.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5100000000000001e-06 2024-09-10T06:28:22.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937234+0000", 2024-09-10T06:28:22.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065097760000000001 2024-09-10T06:28:22.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937259+0000", 2024-09-10T06:28:22.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4915000000000001e-05 2024-09-10T06:28:22.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937275+0000", 2024-09-10T06:28:22.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6659000000000001e-05 2024-09-10T06:28:22.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937437+0000", 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161259 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937718+0000", 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028092699999999999 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937955+0000", 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023767300000000001 2024-09-10T06:28:22.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.952527+0000", 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014571850000000001 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953577+0000", 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001049601 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953671+0000", 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4580000000000006e-05 2024-09-10T06:28:22.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953749+0000", 2024-09-10T06:28:22.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7293999999999996e-05 2024-09-10T06:28:22.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.342 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.342 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1369 3.22 3:45ffca16:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:22.342 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:22.342 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.232890846, 2024-09-10T06:28:22.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020833028999999999, 2024-09-10T06:28:22.342 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.343 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.343 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.343 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1369 2024-09-10T06:28:22.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.343 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:22.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094779+0000", 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1099999999999996e-06 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100674+0000", 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058944740000000002 2024-09-10T06:28:22.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100714+0000", 2024-09-10T06:28:22.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0527e-05 2024-09-10T06:28:22.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100732+0000", 2024-09-10T06:28:22.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8034999999999999e-05 2024-09-10T06:28:22.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100871+0000", 2024-09-10T06:28:22.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013849399999999999 2024-09-10T06:28:22.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.101123+0000", 2024-09-10T06:28:22.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025259000000000002 2024-09-10T06:28:22.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:22.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.101372+0000", 2024-09-10T06:28:22.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024846599999999998 2024-09-10T06:28:22.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.111593+0000", 2024-09-10T06:28:22.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010221165000000001 2024-09-10T06:28:22.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115305+0000", 2024-09-10T06:28:22.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037123249999999998 2024-09-10T06:28:22.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115476+0000", 2024-09-10T06:28:22.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017085200000000001 2024-09-10T06:28:22.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115608+0000", 2024-09-10T06:28:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131991 2024-09-10T06:28:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1372 3.36 e63/22 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.189268340000002, 2024-09-10T06:28:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018914395000000001, 2024-09-10T06:28:22.348 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138401+0000", 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3859999999999999e-06 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142599+0000", 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041982190000000004 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142649+0000", 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9477000000000001e-05 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142674+0000", 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5558000000000002e-05 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142832+0000", 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158159 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142879+0000", 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6650000000000002e-05 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157209+0000", 2024-09-10T06:28:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014330209999999999 2024-09-10T06:28:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157312+0000", 2024-09-10T06:28:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102736 2024-09-10T06:28:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1374 3.2f 3:f735f5eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:22.352 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.174244041000001, 2024-09-10T06:28:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028841426, 2024-09-10T06:28:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1374 2024-09-10T06:28:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153425+0000", 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8030000000000001e-06 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157050+0000", 2024-09-10T06:28:22.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036249070000000001 2024-09-10T06:28:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157081+0000", 2024-09-10T06:28:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1525000000000001e-05 2024-09-10T06:28:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157103+0000", 2024-09-10T06:28:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1599000000000001e-05 2024-09-10T06:28:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157253+0000", 2024-09-10T06:28:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150266 2024-09-10T06:28:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157545+0000", 2024-09-10T06:28:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029204399999999998 2024-09-10T06:28:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157898+0000", 2024-09-10T06:28:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035326200000000002 2024-09-10T06:28:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181021+0000", 2024-09-10T06:28:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023123008 2024-09-10T06:28:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181894+0000", 2024-09-10T06:28:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00087308700000000004 2024-09-10T06:28:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.182128+0000", 2024-09-10T06:28:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000233811 2024-09-10T06:28:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.182263+0000", 2024-09-10T06:28:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013511400000000001 2024-09-10T06:28:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1391 3.1c 3:3a76b5ac:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:22.358 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.005507035000001, 2024-09-10T06:28:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032016492000000001, 2024-09-10T06:28:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1391 2024-09-10T06:28:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:22.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322162+0000", 2024-09-10T06:28:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.523e-06 2024-09-10T06:28:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326140+0000", 2024-09-10T06:28:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039776000000000004 2024-09-10T06:28:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326177+0000", 2024-09-10T06:28:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6878000000000002e-05 2024-09-10T06:28:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326195+0000", 2024-09-10T06:28:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8576e-05 2024-09-10T06:28:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326334+0000", 2024-09-10T06:28:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013836600000000001 2024-09-10T06:28:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326608+0000", 2024-09-10T06:28:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000274586 2024-09-10T06:28:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326847+0000", 2024-09-10T06:28:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023812 2024-09-10T06:28:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.338793+0000", 2024-09-10T06:28:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011946141 2024-09-10T06:28:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354011+0000", 2024-09-10T06:28:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015217856 2024-09-10T06:28:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354100+0000", 2024-09-10T06:28:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9497e-05 2024-09-10T06:28:22.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354175+0000", 2024-09-10T06:28:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5349e-05 2024-09-10T06:28:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1399 3.38 e63/22 3:1dcd0b88:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_154:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.921935928, 2024-09-10T06:28:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019306528999999999, 2024-09-10T06:28:22.364 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:22.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405734+0000", 2024-09-10T06:28:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2529999999999998e-06 2024-09-10T06:28:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410725+0000", 2024-09-10T06:28:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049902849999999997 2024-09-10T06:28:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410776+0000", 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1762999999999999e-05 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410805+0000", 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8274999999999999e-05 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410984+0000", 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017977800000000001 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.411050+0000", 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6115e-05 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424826+0000", 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013775267000000001 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.425037+0000", 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000210793 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1421 3.16 3:69839037:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.808611543000001, 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022412087000000001, 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1421 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.369 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519058+0000", 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.354e-06 2024-09-10T06:28:22.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.522967+0000", 2024-09-10T06:28:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003909231 2024-09-10T06:28:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523003+0000", 2024-09-10T06:28:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5981e-05 2024-09-10T06:28:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523021+0000", 2024-09-10T06:28:22.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8362000000000001e-05 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523166+0000", 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014476699999999999 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523435+0000", 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026895800000000002 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523671+0000", 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023608099999999999 2024-09-10T06:28:22.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538600+0000", 2024-09-10T06:28:22.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014929318 2024-09-10T06:28:22.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541356+0000", 2024-09-10T06:28:22.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002755216 2024-09-10T06:28:22.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541420+0000", 2024-09-10T06:28:22.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4775000000000002e-05 2024-09-10T06:28:22.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541466+0000", 2024-09-10T06:28:22.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6044000000000002e-05 2024-09-10T06:28:22.374 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.374 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.374 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.374 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1439 3.3c 3:3e1c16d9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:22.374 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.621740603999999, 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020786124999999999, 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1439 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:22.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705929+0000", 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1620000000000001e-06 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.709954+0000", 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004024344 2024-09-10T06:28:22.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.709991+0000", 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6868e-05 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710009+0000", 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8422000000000001e-05 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710091+0000", 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1440000000000006e-05 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710105+0000", 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4072e-05 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.713970+0000", 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038651699999999998 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.714137+0000", 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016704999999999999 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.714352+0000", 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021503099999999999 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.721589+0000", 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072370680000000001 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726578+0000", 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049887300000000002 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726659+0000", 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0972999999999999e-05 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726711+0000", 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2794999999999999e-05 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1454 3.5 3:a08a9c17:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:22.380 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.457262913000001, 2024-09-10T06:28:22.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018980882000000001, 2024-09-10T06:28:22.381 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.381 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.381 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.381 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1454 2024-09-10T06:28:22.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.381 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:22.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:22.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870407+0000", 2024-09-10T06:28:22.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9090000000000002e-06 2024-09-10T06:28:22.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874434+0000", 2024-09-10T06:28:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040275700000000003 2024-09-10T06:28:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874471+0000", 2024-09-10T06:28:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6528e-05 2024-09-10T06:28:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874496+0000", 2024-09-10T06:28:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4751000000000001e-05 2024-09-10T06:28:22.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874624+0000", 2024-09-10T06:28:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012825600000000001 2024-09-10T06:28:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874828+0000", 2024-09-10T06:28:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020377700000000001 2024-09-10T06:28:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.875010+0000", 2024-09-10T06:28:22.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018253200000000001 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.883337+0000", 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083265860000000004 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889239+0000", 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059024409999999996 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889322+0000", 2024-09-10T06:28:22.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2216e-05 2024-09-10T06:28:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889384+0000", 2024-09-10T06:28:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2316000000000004e-05 2024-09-10T06:28:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1463 3.c 3:32b18461:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:22.386 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.354291197999999, 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019470828999999999, 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1463 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973377+0000", 2024-09-10T06:28:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5749999999999999e-06 2024-09-10T06:28:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977213+0000", 2024-09-10T06:28:22.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038358789999999999 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977239+0000", 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5965999999999998e-05 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977252+0000", 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2472e-05 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977406+0000", 2024-09-10T06:28:22.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000154809 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977687+0000", 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028013400000000003 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977963+0000", 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027642500000000001 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.987026+0000", 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090629430000000004 2024-09-10T06:28:22.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992655+0000", 2024-09-10T06:28:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056288320000000003 2024-09-10T06:28:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992765+0000", 2024-09-10T06:28:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110276 2024-09-10T06:28:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992846+0000", 2024-09-10T06:28:22.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0518000000000004e-05 2024-09-10T06:28:22.392 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.392 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.392 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.392 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1469 3.d e64/22 3:b3f21559:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_214:head v 64'1, mlcod=0'0)", 2024-09-10T06:28:22.392 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:22.392 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.287986240999999, 2024-09-10T06:28:22.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01994638, 2024-09-10T06:28:22.392 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.392 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.392 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.392 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:22.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:22.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039683+0000", 2024-09-10T06:28:22.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0929999999999999e-06 2024-09-10T06:28:22.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044782+0000", 2024-09-10T06:28:22.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050988240000000001 2024-09-10T06:28:22.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044821+0000", 2024-09-10T06:28:22.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9764000000000001e-05 2024-09-10T06:28:22.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044839+0000", 2024-09-10T06:28:22.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7598999999999999e-05 2024-09-10T06:28:22.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044936+0000", 2024-09-10T06:28:22.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7388999999999999e-05 2024-09-10T06:28:22.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044962+0000", 2024-09-10T06:28:22.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5967999999999999e-05 2024-09-10T06:28:22.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059554+0000", 2024-09-10T06:28:22.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014592055 2024-09-10T06:28:22.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059626+0000", 2024-09-10T06:28:22.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1687999999999995e-05 2024-09-10T06:28:22.396 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.396 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.396 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.397 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1672 3.c 3:33a5f042:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:22.397 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:22.397 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.420312861999999, 2024-09-10T06:28:22.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019487879999999999, 2024-09-10T06:28:22.397 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.397 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.397 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.397 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1672 2024-09-10T06:28:22.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.397 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:22.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:22.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907355+0000", 2024-09-10T06:28:22.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.43e-06 2024-09-10T06:28:22.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.911999+0000", 2024-09-10T06:28:22.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046435979999999996 2024-09-10T06:28:22.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912047+0000", 2024-09-10T06:28:22.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8204000000000001e-05 2024-09-10T06:28:22.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912078+0000", 2024-09-10T06:28:22.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0998999999999999e-05 2024-09-10T06:28:22.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912197+0000", 2024-09-10T06:28:22.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119165 2024-09-10T06:28:22.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912368+0000", 2024-09-10T06:28:22.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000170111 2024-09-10T06:28:22.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912532+0000", 2024-09-10T06:28:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016403000000000001 2024-09-10T06:28:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.920064+0000", 2024-09-10T06:28:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007531973 2024-09-10T06:28:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926719+0000", 2024-09-10T06:28:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066550840000000003 2024-09-10T06:28:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926786+0000", 2024-09-10T06:28:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7267999999999994e-05 2024-09-10T06:28:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926841+0000", 2024-09-10T06:28:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5018000000000001e-05 2024-09-10T06:28:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.402 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1756 3.30 3:0c20eb42:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.524760+0000", 2024-09-10T06:28:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.8029059839999997, 2024-09-10T06:28:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024610467, 2024-09-10T06:28:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.403 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1756 2024-09-10T06:28:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.524760+0000", 2024-09-10T06:28:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.524760+0000", 2024-09-10T06:28:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.524763+0000", 2024-09-10T06:28:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.734e-06 2024-09-10T06:28:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.532754+0000", 2024-09-10T06:28:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007991359 2024-09-10T06:28:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.532797+0000", 2024-09-10T06:28:22.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3282000000000003e-05 2024-09-10T06:28:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.532816+0000", 2024-09-10T06:28:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8389e-05 2024-09-10T06:28:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.532916+0000", 2024-09-10T06:28:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100784 2024-09-10T06:28:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.533095+0000", 2024-09-10T06:28:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000178674 2024-09-10T06:28:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.533260+0000", 2024-09-10T06:28:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016465800000000001 2024-09-10T06:28:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.541932+0000", 2024-09-10T06:28:22.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086723589999999993 2024-09-10T06:28:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.549254+0000", 2024-09-10T06:28:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0073213560000000002 2024-09-10T06:28:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.549318+0000", 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4000999999999999e-05 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.549370+0000", 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2871000000000003e-05 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1758 3.c 3:30c1ab1b:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.568417+0000", 2024-09-10T06:28:22.409 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.7592491050000003, 2024-09-10T06:28:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.031919546, 2024-09-10T06:28:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1758 2024-09-10T06:28:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.568417+0000", 2024-09-10T06:28:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.568417+0000", 2024-09-10T06:28:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.568421+0000", 2024-09-10T06:28:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3830000000000002e-06 2024-09-10T06:28:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.572700+0000", 2024-09-10T06:28:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042786489999999998 2024-09-10T06:28:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.572737+0000", 2024-09-10T06:28:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7591e-05 2024-09-10T06:28:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.572754+0000", 2024-09-10T06:28:22.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6963e-05 2024-09-10T06:28:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.572880+0000", 2024-09-10T06:28:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012607100000000001 2024-09-10T06:28:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.573127+0000", 2024-09-10T06:28:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024628600000000002 2024-09-10T06:28:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:22.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.573352+0000", 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022482599999999999 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.582293+0000", 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089417360000000005 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.600217+0000", 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01792384 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.600285+0000", 2024-09-10T06:28:22.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7353000000000004e-05 2024-09-10T06:28:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.600336+0000", 2024-09-10T06:28:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1848000000000002e-05 2024-09-10T06:28:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1773 3.36 3:6dd9d777:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.854355+0000", 2024-09-10T06:28:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.4733108660000003, 2024-09-10T06:28:22.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020478250999999999, 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1773 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.854355+0000", 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.854355+0000", 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.854359+0000", 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.557e-06 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858551+0000", 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041923760000000003 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858588+0000", 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6591000000000003e-05 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858605+0000", 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7223000000000001e-05 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858730+0000", 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000125511 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858977+0000", 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024648600000000002 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.859205+0000", 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000228299 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.866046+0000", 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068413010000000002 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.874668+0000", 2024-09-10T06:28:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086216499999999998 2024-09-10T06:28:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.874760+0000", 2024-09-10T06:28:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1926e-05 2024-09-10T06:28:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.874833+0000", 2024-09-10T06:28:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3331000000000007e-05 2024-09-10T06:28:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.420 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1774 3.30 3:0db12388:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.877453+0000", 2024-09-10T06:28:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.4502128890000003, 2024-09-10T06:28:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022593780000000001, 2024-09-10T06:28:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1774 2024-09-10T06:28:22.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.877453+0000", 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.877453+0000", 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.877456+0000", 2024-09-10T06:28:22.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6800000000000002e-06 2024-09-10T06:28:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881345+0000", 2024-09-10T06:28:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038893529999999999 2024-09-10T06:28:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881378+0000", 2024-09-10T06:28:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3374000000000003e-05 2024-09-10T06:28:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881394+0000", 2024-09-10T06:28:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5327000000000001e-05 2024-09-10T06:28:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881555+0000", 2024-09-10T06:28:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161356 2024-09-10T06:28:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881815+0000", 2024-09-10T06:28:22.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026025499999999998 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.882089+0000", 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027335400000000001 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.891046+0000", 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089577000000000007 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.899882+0000", 2024-09-10T06:28:22.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088357350000000008 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.899976+0000", 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3338999999999995e-05 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.900047+0000", 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1307e-05 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1775 3.2f 3:f4c391ba:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.900332+0000", 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.427334375, 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02158852, 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1775 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.900332+0000", 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.900332+0000", 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.900334+0000", 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904266+0000", 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039319439999999997 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904302+0000", 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6235000000000001e-05 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904327+0000", 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4545e-05 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904515+0000", 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187932 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904773+0000", 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000258022 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.905009+0000", 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023653899999999999 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.913889+0000", 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088796799999999992 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.921726+0000", 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078370260000000004 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.921843+0000", 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011721400000000001 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.921920+0000", 2024-09-10T06:28:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6662999999999994e-05 2024-09-10T06:28:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1779 3.2f 3:f63ca6bf:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.959254+0000", 2024-09-10T06:28:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3684121139999998, 2024-09-10T06:28:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021331428999999999, 2024-09-10T06:28:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1779 2024-09-10T06:28:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.959254+0000", 2024-09-10T06:28:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.959254+0000", 2024-09-10T06:28:22.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.959257+0000", 2024-09-10T06:28:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2600000000000001e-06 2024-09-10T06:28:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963270+0000", 2024-09-10T06:28:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040126909999999997 2024-09-10T06:28:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963309+0000", 2024-09-10T06:28:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9558000000000003e-05 2024-09-10T06:28:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963327+0000", 2024-09-10T06:28:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7952999999999999e-05 2024-09-10T06:28:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963468+0000", 2024-09-10T06:28:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014084699999999999 2024-09-10T06:28:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963717+0000", 2024-09-10T06:28:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024887800000000001 2024-09-10T06:28:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963944+0000", 2024-09-10T06:28:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022745 2024-09-10T06:28:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976421+0000", 2024-09-10T06:28:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012476529 2024-09-10T06:28:22.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.980418+0000", 2024-09-10T06:28:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039974770000000001 2024-09-10T06:28:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.980510+0000", 2024-09-10T06:28:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1896000000000002e-05 2024-09-10T06:28:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.980585+0000", 2024-09-10T06:28:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4889999999999996e-05 2024-09-10T06:28:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.438 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1780 3.5 3:a2a1f206:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.970512+0000", 2024-09-10T06:28:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.3571540930000001, 2024-09-10T06:28:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021558898, 2024-09-10T06:28:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1780 2024-09-10T06:28:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.970512+0000", 2024-09-10T06:28:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.970512+0000", 2024-09-10T06:28:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.970516+0000", 2024-09-10T06:28:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7859999999999998e-06 2024-09-10T06:28:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976034+0000", 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055182190000000004 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976067+0000", 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3628999999999999e-05 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976085+0000", 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7921999999999999e-05 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976224+0000", 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000138171 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976551+0000", 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032767199999999999 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976821+0000", 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026987400000000003 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.986827+0000", 2024-09-10T06:28:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010006088999999999 2024-09-10T06:28:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.991915+0000", 2024-09-10T06:28:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050881859999999998 2024-09-10T06:28:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.992005+0000", 2024-09-10T06:28:22.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9553000000000001e-05 2024-09-10T06:28:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.992071+0000", 2024-09-10T06:28:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5796999999999994e-05 2024-09-10T06:28:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.444 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.444 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:22.446 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:28:22.446 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:22.443+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:22.546 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:22.543+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:22.617 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:22.618 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:22.632 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:28:22.647 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:22.643+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:22.659 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-10T06:28:22.748 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:22.743+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:22.797 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:22.797 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:22.797 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:22.797 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:22.797 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:22.811 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:28:22.848 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:22.843+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:22.950 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:22.947+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:22.981 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1363 3.a 3:52044754:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.955771517999999, 2024-09-10T06:28:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021475438999999999, 2024-09-10T06:28:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1363 2024-09-10T06:28:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023232+0000", 2024-09-10T06:28:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6500000000000002e-06 2024-09-10T06:28:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027903+0000", 2024-09-10T06:28:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046709569999999999 2024-09-10T06:28:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027944+0000", 2024-09-10T06:28:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1e-05 2024-09-10T06:28:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027963+0000", 2024-09-10T06:28:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9363000000000001e-05 2024-09-10T06:28:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028108+0000", 2024-09-10T06:28:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144306 2024-09-10T06:28:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028370+0000", 2024-09-10T06:28:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026210300000000002 2024-09-10T06:28:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028610+0000", 2024-09-10T06:28:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024058 2024-09-10T06:28:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.036472+0000", 2024-09-10T06:28:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078620170000000007 2024-09-10T06:28:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044306+0000", 2024-09-10T06:28:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078340070000000005 2024-09-10T06:28:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044496+0000", 2024-09-10T06:28:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189507 2024-09-10T06:28:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044704+0000", 2024-09-10T06:28:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207949 2024-09-10T06:28:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1364 3.36 3:6e968b0d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.943779979999999, 2024-09-10T06:28:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022135317000000002, 2024-09-10T06:28:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1364 2024-09-10T06:28:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035266+0000", 2024-09-10T06:28:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6529999999999997e-05 2024-09-10T06:28:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039528+0000", 2024-09-10T06:28:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042612580000000004 2024-09-10T06:28:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039570+0000", 2024-09-10T06:28:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2481000000000002e-05 2024-09-10T06:28:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039594+0000", 2024-09-10T06:28:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3564999999999999e-05 2024-09-10T06:28:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039735+0000", 2024-09-10T06:28:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014147000000000001 2024-09-10T06:28:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039983+0000", 2024-09-10T06:28:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024765399999999998 2024-09-10T06:28:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.040216+0000", 2024-09-10T06:28:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023322999999999999 2024-09-10T06:28:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.049930+0000", 2024-09-10T06:28:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097135920000000001 2024-09-10T06:28:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057061+0000", 2024-09-10T06:28:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071309570000000003 2024-09-10T06:28:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057234+0000", 2024-09-10T06:28:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173308 2024-09-10T06:28:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057355+0000", 2024-09-10T06:28:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121272 2024-09-10T06:28:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1370 3.26 3:64e41eab:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.869044448, 2024-09-10T06:28:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022030800999999999, 2024-09-10T06:28:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1370 2024-09-10T06:28:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109960+0000", 2024-09-10T06:28:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3930000000000001e-06 2024-09-10T06:28:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114711+0000", 2024-09-10T06:28:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047511580000000001 2024-09-10T06:28:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114749+0000", 2024-09-10T06:28:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8417999999999997e-05 2024-09-10T06:28:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114768+0000", 2024-09-10T06:28:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8352e-05 2024-09-10T06:28:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114926+0000", 2024-09-10T06:28:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015819599999999999 2024-09-10T06:28:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115321+0000", 2024-09-10T06:28:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039507300000000002 2024-09-10T06:28:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115735+0000", 2024-09-10T06:28:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041369900000000001 2024-09-10T06:28:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.125212+0000", 2024-09-10T06:28:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094774109999999998 2024-09-10T06:28:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131666+0000", 2024-09-10T06:28:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064533730000000001 2024-09-10T06:28:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131847+0000", 2024-09-10T06:28:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018112400000000001 2024-09-10T06:28:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131986+0000", 2024-09-10T06:28:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013960399999999999 2024-09-10T06:28:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1371 3.2e e63/22 3:741ddced:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_126:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.854083983999999, 2024-09-10T06:28:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440024000000001, 2024-09-10T06:28:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124919+0000", 2024-09-10T06:28:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-10T06:28:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130095+0000", 2024-09-10T06:28:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00517645 2024-09-10T06:28:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130125+0000", 2024-09-10T06:28:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9944e-05 2024-09-10T06:28:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130142+0000", 2024-09-10T06:28:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6515999999999999e-05 2024-09-10T06:28:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130252+0000", 2024-09-10T06:28:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110473 2024-09-10T06:28:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130297+0000", 2024-09-10T06:28:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5012999999999997e-05 2024-09-10T06:28:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149096+0000", 2024-09-10T06:28:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018799429999999999 2024-09-10T06:28:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149356+0000", 2024-09-10T06:28:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000259499 2024-09-10T06:28:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1372 3.36 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.84652736, 2024-09-10T06:28:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026714723999999999, 2024-09-10T06:28:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1372 2024-09-10T06:28:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132475+0000", 2024-09-10T06:28:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.65e-06 2024-09-10T06:28:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137399+0000", 2024-09-10T06:28:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049236530000000001 2024-09-10T06:28:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137432+0000", 2024-09-10T06:28:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3050999999999999e-05 2024-09-10T06:28:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137449+0000", 2024-09-10T06:28:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6976000000000001e-05 2024-09-10T06:28:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137569+0000", 2024-09-10T06:28:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012016899999999999 2024-09-10T06:28:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137884+0000", 2024-09-10T06:28:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031455799999999999 2024-09-10T06:28:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138191+0000", 2024-09-10T06:28:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000307466 2024-09-10T06:28:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157760+0000", 2024-09-10T06:28:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019569128000000002 2024-09-10T06:28:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157954+0000", 2024-09-10T06:28:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019375300000000001 2024-09-10T06:28:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158118+0000", 2024-09-10T06:28:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016390900000000001 2024-09-10T06:28:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.159187+0000", 2024-09-10T06:28:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010694109999999999 2024-09-10T06:28:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1373 3.35 3:ac8a3287:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.836194369000001, 2024-09-10T06:28:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023907627000000001, 2024-09-10T06:28:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1373 2024-09-10T06:28:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142810+0000", 2024-09-10T06:28:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6129999999999997e-06 2024-09-10T06:28:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.146972+0000", 2024-09-10T06:28:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041615180000000003 2024-09-10T06:28:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147029+0000", 2024-09-10T06:28:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7476000000000003e-05 2024-09-10T06:28:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147056+0000", 2024-09-10T06:28:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7021000000000001e-05 2024-09-10T06:28:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147249+0000", 2024-09-10T06:28:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019260999999999999 2024-09-10T06:28:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147702+0000", 2024-09-10T06:28:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045347999999999997 2024-09-10T06:28:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148113+0000", 2024-09-10T06:28:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041051899999999998 2024-09-10T06:28:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161583+0000", 2024-09-10T06:28:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013470278 2024-09-10T06:28:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166410+0000", 2024-09-10T06:28:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048270199999999996 2024-09-10T06:28:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166579+0000", 2024-09-10T06:28:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016839099999999999 2024-09-10T06:28:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166713+0000", 2024-09-10T06:28:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013470100000000001 2024-09-10T06:28:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1387 3.35 3:adfbe02e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.697066081999999, 2024-09-10T06:28:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021055645000000001, 2024-09-10T06:28:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1387 2024-09-10T06:28:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281938+0000", 2024-09-10T06:28:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0659999999999997e-06 2024-09-10T06:28:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286048+0000", 2024-09-10T06:28:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041104560000000002 2024-09-10T06:28:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286097+0000", 2024-09-10T06:28:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8715999999999999e-05 2024-09-10T06:28:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286126+0000", 2024-09-10T06:28:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9308000000000001e-05 2024-09-10T06:28:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286279+0000", 2024-09-10T06:28:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015285400000000001 2024-09-10T06:28:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286520+0000", 2024-09-10T06:28:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024062000000000001 2024-09-10T06:28:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286772+0000", 2024-09-10T06:28:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025170599999999998 2024-09-10T06:28:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.301846+0000", 2024-09-10T06:28:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015074363 2024-09-10T06:28:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302698+0000", 2024-09-10T06:28:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000852179 2024-09-10T06:28:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302864+0000", 2024-09-10T06:28:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016568900000000001 2024-09-10T06:28:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302990+0000", 2024-09-10T06:28:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012568799999999999 2024-09-10T06:28:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1398 3.2c 3:350a23e7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.584022763, 2024-09-10T06:28:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032248536000000001, 2024-09-10T06:28:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1398 2024-09-10T06:28:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394981+0000", 2024-09-10T06:28:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7359999999999999e-06 2024-09-10T06:28:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402145+0000", 2024-09-10T06:28:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071643540000000004 2024-09-10T06:28:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402182+0000", 2024-09-10T06:28:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6318e-05 2024-09-10T06:28:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402200+0000", 2024-09-10T06:28:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8439000000000001e-05 2024-09-10T06:28:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402391+0000", 2024-09-10T06:28:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190917 2024-09-10T06:28:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402649+0000", 2024-09-10T06:28:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025817599999999999 2024-09-10T06:28:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402908+0000", 2024-09-10T06:28:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025864300000000002 2024-09-10T06:28:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424973+0000", 2024-09-10T06:28:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022065004999999999 2024-09-10T06:28:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.426990+0000", 2024-09-10T06:28:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020169340000000002 2024-09-10T06:28:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427129+0000", 2024-09-10T06:28:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139436 2024-09-10T06:28:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427226+0000", 2024-09-10T06:28:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6577999999999996e-05 2024-09-10T06:28:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1415 3.2c 3:34c14757:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.516175765, 2024-09-10T06:28:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029598765999999999, 2024-09-10T06:28:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1415 2024-09-10T06:28:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462828+0000", 2024-09-10T06:28:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1999999999999996e-06 2024-09-10T06:28:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.466974+0000", 2024-09-10T06:28:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041452989999999999 2024-09-10T06:28:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467026+0000", 2024-09-10T06:28:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2416000000000001e-05 2024-09-10T06:28:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467055+0000", 2024-09-10T06:28:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9081000000000002e-05 2024-09-10T06:28:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467207+0000", 2024-09-10T06:28:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015225699999999999 2024-09-10T06:28:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467468+0000", 2024-09-10T06:28:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026093500000000001 2024-09-10T06:28:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467755+0000", 2024-09-10T06:28:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000287101 2024-09-10T06:28:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477312+0000", 2024-09-10T06:28:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095560300000000001 2024-09-10T06:28:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492136+0000", 2024-09-10T06:28:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014824936 2024-09-10T06:28:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492301+0000", 2024-09-10T06:28:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016411600000000001 2024-09-10T06:28:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492423+0000", 2024-09-10T06:28:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122395 2024-09-10T06:28:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1416 3.10 3:084717f7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.507141517000001, 2024-09-10T06:28:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021526931999999999, 2024-09-10T06:28:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1416 2024-09-10T06:28:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471863+0000", 2024-09-10T06:28:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-10T06:28:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477370+0000", 2024-09-10T06:28:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055071549999999997 2024-09-10T06:28:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477402+0000", 2024-09-10T06:28:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1498000000000002e-05 2024-09-10T06:28:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477423+0000", 2024-09-10T06:28:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1098e-05 2024-09-10T06:28:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477559+0000", 2024-09-10T06:28:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136627 2024-09-10T06:28:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477936+0000", 2024-09-10T06:28:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037718099999999998 2024-09-10T06:28:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.478271+0000", 2024-09-10T06:28:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033427799999999997 2024-09-10T06:28:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.490997+0000", 2024-09-10T06:28:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012725858 2024-09-10T06:28:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493126+0000", 2024-09-10T06:28:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002129499 2024-09-10T06:28:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493263+0000", 2024-09-10T06:28:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013682500000000001 2024-09-10T06:28:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493385+0000", 2024-09-10T06:28:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122414 2024-09-10T06:28:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1482 3.35 3:ad9242de:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.818835783000001, 2024-09-10T06:28:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022710764000000001, 2024-09-10T06:28:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1482 2024-09-10T06:28:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160166+0000", 2024-09-10T06:28:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1069999999999999e-06 2024-09-10T06:28:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163977+0000", 2024-09-10T06:28:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003810843 2024-09-10T06:28:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163995+0000", 2024-09-10T06:28:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7648000000000001e-05 2024-09-10T06:28:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164010+0000", 2024-09-10T06:28:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4754e-05 2024-09-10T06:28:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164094+0000", 2024-09-10T06:28:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4473000000000003e-05 2024-09-10T06:28:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164281+0000", 2024-09-10T06:28:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018659699999999999 2024-09-10T06:28:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164458+0000", 2024-09-10T06:28:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017758300000000001 2024-09-10T06:28:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.179923+0000", 2024-09-10T06:28:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015465269 2024-09-10T06:28:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182736+0000", 2024-09-10T06:28:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028130579999999998 2024-09-10T06:28:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182816+0000", 2024-09-10T06:28:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9976999999999997e-05 2024-09-10T06:28:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182875+0000", 2024-09-10T06:28:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8455000000000002e-05 2024-09-10T06:28:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1664 3.a 3:52f62ee7:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.154810544, 2024-09-10T06:28:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020253482999999999, 2024-09-10T06:28:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1664 2024-09-10T06:28:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824193+0000", 2024-09-10T06:28:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6059999999999999e-06 2024-09-10T06:28:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829549+0000", 2024-09-10T06:28:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053562189999999997 2024-09-10T06:28:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829584+0000", 2024-09-10T06:28:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4925000000000002e-05 2024-09-10T06:28:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829602+0000", 2024-09-10T06:28:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8034999999999999e-05 2024-09-10T06:28:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829716+0000", 2024-09-10T06:28:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113522 2024-09-10T06:28:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829903+0000", 2024-09-10T06:28:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187443 2024-09-10T06:28:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.830162+0000", 2024-09-10T06:28:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025917900000000001 2024-09-10T06:28:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.843459+0000", 2024-09-10T06:28:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01329675 2024-09-10T06:28:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844211+0000", 2024-09-10T06:28:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075213700000000005 2024-09-10T06:28:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844286+0000", 2024-09-10T06:28:23.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4453e-05 2024-09-10T06:28:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844443+0000", 2024-09-10T06:28:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157214 2024-09-10T06:28:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1754 3.3b 3:ded70450:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.481010+0000", 2024-09-10T06:28:23.054 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4979901380000005, 2024-09-10T06:28:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033092867999999998, 2024-09-10T06:28:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1754 2024-09-10T06:28:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.481010+0000", 2024-09-10T06:28:23.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.481010+0000", 2024-09-10T06:28:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.481012+0000", 2024-09-10T06:28:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-10T06:28:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487559+0000", 2024-09-10T06:28:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065467889999999999 2024-09-10T06:28:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487603+0000", 2024-09-10T06:28:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3254999999999998e-05 2024-09-10T06:28:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487622+0000", 2024-09-10T06:28:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9142000000000001e-05 2024-09-10T06:28:23.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487793+0000", 2024-09-10T06:28:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017092299999999999 2024-09-10T06:28:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.488035+0000", 2024-09-10T06:28:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000242563 2024-09-10T06:28:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.488258+0000", 2024-09-10T06:28:23.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022282000000000001 2024-09-10T06:28:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.501495+0000", 2024-09-10T06:28:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013236988 2024-09-10T06:28:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.513877+0000", 2024-09-10T06:28:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012382166 2024-09-10T06:28:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.513986+0000", 2024-09-10T06:28:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108405 2024-09-10T06:28:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.514103+0000", 2024-09-10T06:28:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117155 2024-09-10T06:28:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1765 3.2c 3:36655c69:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.683969+0000", 2024-09-10T06:28:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.2950312569999998, 2024-09-10T06:28:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018761877999999999, 2024-09-10T06:28:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1765 2024-09-10T06:28:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.061 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.683969+0000", 2024-09-10T06:28:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.683969+0000", 2024-09-10T06:28:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.683971+0000", 2024-09-10T06:28:23.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7250000000000002e-06 2024-09-10T06:28:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688364+0000", 2024-09-10T06:28:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043926399999999997 2024-09-10T06:28:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688389+0000", 2024-09-10T06:28:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199999999999999e-05 2024-09-10T06:28:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688401+0000", 2024-09-10T06:28:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1834999999999999e-05 2024-09-10T06:28:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688496+0000", 2024-09-10T06:28:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4661999999999996e-05 2024-09-10T06:28:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688685+0000", 2024-09-10T06:28:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018916899999999999 2024-09-10T06:28:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688800+0000", 2024-09-10T06:28:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115047 2024-09-10T06:28:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.696257+0000", 2024-09-10T06:28:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007457371 2024-09-10T06:28:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.702611+0000", 2024-09-10T06:28:23.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063533180000000002 2024-09-10T06:28:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.702693+0000", 2024-09-10T06:28:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2021000000000006e-05 2024-09-10T06:28:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.702731+0000", 2024-09-10T06:28:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7889999999999998e-05 2024-09-10T06:28:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1768 3.26 3:655dfe81:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.749704+0000", 2024-09-10T06:28:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.2292957199999996, 2024-09-10T06:28:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018211538999999999, 2024-09-10T06:28:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.067 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1768 2024-09-10T06:28:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.749704+0000", 2024-09-10T06:28:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.749704+0000", 2024-09-10T06:28:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.749707+0000", 2024-09-10T06:28:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8490000000000002e-06 2024-09-10T06:28:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753470+0000", 2024-09-10T06:28:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003762601 2024-09-10T06:28:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753503+0000", 2024-09-10T06:28:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3556999999999997e-05 2024-09-10T06:28:23.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753517+0000", 2024-09-10T06:28:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3946e-05 2024-09-10T06:28:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753641+0000", 2024-09-10T06:28:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349099999999999 2024-09-10T06:28:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753919+0000", 2024-09-10T06:28:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027816400000000002 2024-09-10T06:28:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.754150+0000", 2024-09-10T06:28:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000230967 2024-09-10T06:28:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767713+0000", 2024-09-10T06:28:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013563225999999999 2024-09-10T06:28:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767757+0000", 2024-09-10T06:28:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4401999999999999e-05 2024-09-10T06:28:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767848+0000", 2024-09-10T06:28:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0209000000000003e-05 2024-09-10T06:28:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767916+0000", 2024-09-10T06:28:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8126999999999993e-05 2024-09-10T06:28:23.072 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1771 3.10 3:0b728edd:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.819227+0000", 2024-09-10T06:28:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1597728220000008, 2024-09-10T06:28:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020819891, 2024-09-10T06:28:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1771 2024-09-10T06:28:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.819227+0000", 2024-09-10T06:28:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.819227+0000", 2024-09-10T06:28:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.819231+0000", 2024-09-10T06:28:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.596e-06 2024-09-10T06:28:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823354+0000", 2024-09-10T06:28:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041235350000000002 2024-09-10T06:28:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823376+0000", 2024-09-10T06:28:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1838999999999999e-05 2024-09-10T06:28:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823394+0000", 2024-09-10T06:28:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8116000000000001e-05 2024-09-10T06:28:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823527+0000", 2024-09-10T06:28:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013270799999999999 2024-09-10T06:28:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823790+0000", 2024-09-10T06:28:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026267199999999998 2024-09-10T06:28:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.824038+0000", 2024-09-10T06:28:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024825200000000002 2024-09-10T06:28:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.832733+0000", 2024-09-10T06:28:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086948110000000002 2024-09-10T06:28:23.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.839945+0000", 2024-09-10T06:28:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072128119999999999 2024-09-10T06:28:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.840000+0000", 2024-09-10T06:28:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4987000000000001e-05 2024-09-10T06:28:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.840047+0000", 2024-09-10T06:28:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6563000000000001e-05 2024-09-10T06:28:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1776 3.10 3:08e15545:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.923066+0000", 2024-09-10T06:28:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0559336090000002, 2024-09-10T06:28:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027201434, 2024-09-10T06:28:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1776 2024-09-10T06:28:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.923066+0000", 2024-09-10T06:28:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.923066+0000", 2024-09-10T06:28:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.923070+0000", 2024-09-10T06:28:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9859999999999996e-06 2024-09-10T06:28:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927726+0000", 2024-09-10T06:28:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046555549999999996 2024-09-10T06:28:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927764+0000", 2024-09-10T06:28:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7709000000000001e-05 2024-09-10T06:28:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927782+0000", 2024-09-10T06:28:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8592000000000001e-05 2024-09-10T06:28:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927974+0000", 2024-09-10T06:28:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019189500000000001 2024-09-10T06:28:23.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.928245+0000", 2024-09-10T06:28:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000270454 2024-09-10T06:28:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.928474+0000", 2024-09-10T06:28:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022925699999999999 2024-09-10T06:28:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.935435+0000", 2024-09-10T06:28:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069609049999999999 2024-09-10T06:28:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.950096+0000", 2024-09-10T06:28:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014661097999999999 2024-09-10T06:28:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.950190+0000", 2024-09-10T06:28:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4631999999999998e-05 2024-09-10T06:28:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.950268+0000", 2024-09-10T06:28:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7350999999999999e-05 2024-09-10T06:28:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1784 3.20 3:054632f9:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.038819+0000", 2024-09-10T06:28:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.9401811880000004, 2024-09-10T06:28:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02561799, 2024-09-10T06:28:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.085 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1784 2024-09-10T06:28:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.038819+0000", 2024-09-10T06:28:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.038819+0000", 2024-09-10T06:28:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.038822+0000", 2024-09-10T06:28:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6059999999999999e-06 2024-09-10T06:28:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043474+0000", 2024-09-10T06:28:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004651947 2024-09-10T06:28:23.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043515+0000", 2024-09-10T06:28:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0901e-05 2024-09-10T06:28:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043533+0000", 2024-09-10T06:28:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7989999999999999e-05 2024-09-10T06:28:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043684+0000", 2024-09-10T06:28:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150786 2024-09-10T06:28:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043937+0000", 2024-09-10T06:28:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025274899999999997 2024-09-10T06:28:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.044177+0000", 2024-09-10T06:28:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024046000000000001 2024-09-10T06:28:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.050984+0000", 2024-09-10T06:28:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006806739 2024-09-10T06:28:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064079+0000", 2024-09-10T06:28:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013094924000000001 2024-09-10T06:28:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064258+0000", 2024-09-10T06:28:23.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017905500000000001 2024-09-10T06:28:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064437+0000", 2024-09-10T06:28:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017883299999999999 2024-09-10T06:28:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1792 3.26 3:674d8f8e:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.126132+0000", 2024-09-10T06:28:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.8528682019999998, 2024-09-10T06:28:23.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022657136000000001, 2024-09-10T06:28:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1792 2024-09-10T06:28:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.126132+0000", 2024-09-10T06:28:23.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.126132+0000", 2024-09-10T06:28:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.126136+0000", 2024-09-10T06:28:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8700000000000002e-06 2024-09-10T06:28:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130132+0000", 2024-09-10T06:28:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039961140000000003 2024-09-10T06:28:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130172+0000", 2024-09-10T06:28:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0052000000000002e-05 2024-09-10T06:28:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130191+0000", 2024-09-10T06:28:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9176000000000001e-05 2024-09-10T06:28:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130393+0000", 2024-09-10T06:28:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020170400000000001 2024-09-10T06:28:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130656+0000", 2024-09-10T06:28:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000262952 2024-09-10T06:28:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130893+0000", 2024-09-10T06:28:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023785599999999999 2024-09-10T06:28:23.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.138071+0000", 2024-09-10T06:28:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071771969999999997 2024-09-10T06:28:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.148497+0000", 2024-09-10T06:28:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010426444 2024-09-10T06:28:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.148669+0000", 2024-09-10T06:28:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000172096 2024-09-10T06:28:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.148789+0000", 2024-09-10T06:28:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119675 2024-09-10T06:28:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1793 3.20 3:044d7174:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:23.097 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.136820+0000", 2024-09-10T06:28:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.8421797800000004, 2024-09-10T06:28:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024061645, 2024-09-10T06:28:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1793 2024-09-10T06:28:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.136820+0000", 2024-09-10T06:28:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.136820+0000", 2024-09-10T06:28:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.136825+0000", 2024-09-10T06:28:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4700000000000004e-06 2024-09-10T06:28:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.142937+0000", 2024-09-10T06:28:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061127400000000002 2024-09-10T06:28:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.142976+0000", 2024-09-10T06:28:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8927999999999997e-05 2024-09-10T06:28:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143003+0000", 2024-09-10T06:28:23.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6914999999999999e-05 2024-09-10T06:28:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143141+0000", 2024-09-10T06:28:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013770399999999999 2024-09-10T06:28:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143399+0000", 2024-09-10T06:28:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025788299999999998 2024-09-10T06:28:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:23.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143650+0000", 2024-09-10T06:28:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025162200000000001 2024-09-10T06:28:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.151461+0000", 2024-09-10T06:28:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078103410000000002 2024-09-10T06:28:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.160675+0000", 2024-09-10T06:28:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092145309999999998 2024-09-10T06:28:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.160773+0000", 2024-09-10T06:28:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7316000000000001e-05 2024-09-10T06:28:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.160882+0000", 2024-09-10T06:28:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109195 2024-09-10T06:28:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.103 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.103 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:23.105 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:28:23.105 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:23.099+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:23.205 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:23.199+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:23.275 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:23.275 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:23.275 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:23.275 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:23.289 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:28:23.332 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:23.331+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:23.407 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:23.407 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:23.407 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:23.407 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:23.407 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:23.408 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:23.403+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:23.421 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:28:23.509 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:23.503+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:23.597 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:23.597 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:23.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:23.597 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:23.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.597 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:23.597 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:23.597 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 126.14712737000001, 2024-09-10T06:28:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70775834699999995, 2024-09-10T06:28:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1 2024-09-10T06:28:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446852+0000", 2024-09-10T06:28:23.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.117e-06 2024-09-10T06:28:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446870+0000", 2024-09-10T06:28:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7569999999999999e-05 2024-09-10T06:28:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446892+0000", 2024-09-10T06:28:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2036e-05 2024-09-10T06:28:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446908+0000", 2024-09-10T06:28:23.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6719999999999999e-05 2024-09-10T06:28:23.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447040+0000", 2024-09-10T06:28:23.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013118299999999999 2024-09-10T06:28:23.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:28:23.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447054+0000", 2024-09-10T06:28:23.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4343e-05 2024-09-10T06:28:23.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.151730+0000", 2024-09-10T06:28:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70467560600000001 2024-09-10T06:28:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152054+0000", 2024-09-10T06:28:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032444100000000002 2024-09-10T06:28:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152404+0000", 2024-09-10T06:28:23.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000349938 2024-09-10T06:28:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.153773+0000", 2024-09-10T06:28:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013693620000000001 2024-09-10T06:28:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154454+0000", 2024-09-10T06:28:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068035800000000005 2024-09-10T06:28:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154544+0000", 2024-09-10T06:28:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0623000000000003e-05 2024-09-10T06:28:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154607+0000", 2024-09-10T06:28:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3050000000000001e-05 2024-09-10T06:28:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:23.605 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:23.605 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 125.30889945, 2024-09-10T06:28:23.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021819150999999998, 2024-09-10T06:28:23.605 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.605 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:23.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:23.605 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 51 2024-09-10T06:28:23.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285078+0000", 2024-09-10T06:28:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000001e-07 2024-09-10T06:28:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285083+0000", 2024-09-10T06:28:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6099999999999997e-06 2024-09-10T06:28:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285092+0000", 2024-09-10T06:28:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2399999999999996e-06 2024-09-10T06:28:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285100+0000", 2024-09-10T06:28:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8739999999999995e-06 2024-09-10T06:28:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300938+0000", 2024-09-10T06:28:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015837527000000001 2024-09-10T06:28:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301058+0000", 2024-09-10T06:28:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012032300000000001 2024-09-10T06:28:23.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301251+0000", 2024-09-10T06:28:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192828 2024-09-10T06:28:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302937+0000", 2024-09-10T06:28:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016857339999999999 2024-09-10T06:28:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306745+0000", 2024-09-10T06:28:23.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038078729999999998 2024-09-10T06:28:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306830+0000", 2024-09-10T06:28:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5432999999999993e-05 2024-09-10T06:28:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306896+0000", 2024-09-10T06:28:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5993000000000003e-05 2024-09-10T06:28:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.610 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.611 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:23.611 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:23.611 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 125.308859574, 2024-09-10T06:28:23.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021995553000000001, 2024-09-10T06:28:23.611 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.611 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.611 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:23.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:23.611 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 52 2024-09-10T06:28:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4000000000000001e-07 2024-09-10T06:28:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285123+0000", 2024-09-10T06:28:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6969999999999998e-06 2024-09-10T06:28:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285132+0000", 2024-09-10T06:28:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1560000000000001e-06 2024-09-10T06:28:23.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285139+0000", 2024-09-10T06:28:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1539999999999996e-06 2024-09-10T06:28:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301865+0000", 2024-09-10T06:28:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016725173999999999 2024-09-10T06:28:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301995+0000", 2024-09-10T06:28:23.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130739 2024-09-10T06:28:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302195+0000", 2024-09-10T06:28:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000199965 2024-09-10T06:28:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.303135+0000", 2024-09-10T06:28:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093978300000000002 2024-09-10T06:28:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306979+0000", 2024-09-10T06:28:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038437459999999999 2024-09-10T06:28:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307057+0000", 2024-09-10T06:28:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7766e-05 2024-09-10T06:28:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307112+0000", 2024-09-10T06:28:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5733000000000003e-05 2024-09-10T06:28:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1374 3.2f e63/22 3:f735f5eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_129:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.435816329000001, 2024-09-10T06:28:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022402502000000001, 2024-09-10T06:28:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158162+0000", 2024-09-10T06:28:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4569999999999999e-06 2024-09-10T06:28:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161871+0000", 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037080799999999999 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161914+0000", 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3571e-05 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161940+0000", 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5876000000000001e-05 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.162081+0000", 2024-09-10T06:28:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014147000000000001 2024-09-10T06:28:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.162123+0000", 2024-09-10T06:28:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1666999999999999e-05 2024-09-10T06:28:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.180416+0000", 2024-09-10T06:28:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018292881 2024-09-10T06:28:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.180562+0000", 2024-09-10T06:28:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014650000000000001 2024-09-10T06:28:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1378 3.2d 3:b4d0ba6d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.402255669999999, 2024-09-10T06:28:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029738187999999999, 2024-09-10T06:28:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.621 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1378 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191724+0000", 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2650000000000001e-06 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196514+0000", 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047904039999999998 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196552+0000", 2024-09-10T06:28:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8034999999999998e-05 2024-09-10T06:28:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196577+0000", 2024-09-10T06:28:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5120999999999999e-05 2024-09-10T06:28:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196716+0000", 2024-09-10T06:28:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013837699999999999 2024-09-10T06:28:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196970+0000", 2024-09-10T06:28:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025406300000000001 2024-09-10T06:28:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.197196+0000", 2024-09-10T06:28:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022647499999999999 2024-09-10T06:28:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211315+0000", 2024-09-10T06:28:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014118175 2024-09-10T06:28:23.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.220793+0000", 2024-09-10T06:28:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094785640000000001 2024-09-10T06:28:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221044+0000", 2024-09-10T06:28:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025106 2024-09-10T06:28:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221459+0000", 2024-09-10T06:28:23.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041464900000000001 2024-09-10T06:28:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1379 3.11 3:8ad434e9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.392577251999999, 2024-09-10T06:28:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021255388, 2024-09-10T06:28:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.627 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1379 2024-09-10T06:28:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201402+0000", 2024-09-10T06:28:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2459999999999999e-06 2024-09-10T06:28:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205915+0000", 2024-09-10T06:28:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045131149999999998 2024-09-10T06:28:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205948+0000", 2024-09-10T06:28:23.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2259999999999999e-05 2024-09-10T06:28:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205966+0000", 2024-09-10T06:28:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8238999999999999e-05 2024-09-10T06:28:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.206162+0000", 2024-09-10T06:28:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000195782 2024-09-10T06:28:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.206607+0000", 2024-09-10T06:28:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044565000000000002 2024-09-10T06:28:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.207031+0000", 2024-09-10T06:28:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000423714 2024-09-10T06:28:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221664+0000", 2024-09-10T06:28:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014632895 2024-09-10T06:28:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222398+0000", 2024-09-10T06:28:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073376099999999998 2024-09-10T06:28:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222569+0000", 2024-09-10T06:28:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017139400000000001 2024-09-10T06:28:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222654+0000", 2024-09-10T06:28:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5332000000000002e-05 2024-09-10T06:28:23.632 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1426 3.2d 3:b764a1d5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.027236659, 2024-09-10T06:28:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027451646999999999, 2024-09-10T06:28:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1426 2024-09-10T06:28:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566742+0000", 2024-09-10T06:28:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.317e-06 2024-09-10T06:28:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570553+0000", 2024-09-10T06:28:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038114680000000001 2024-09-10T06:28:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570585+0000", 2024-09-10T06:28:23.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1940999999999998e-05 2024-09-10T06:28:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570601+0000", 2024-09-10T06:28:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5218000000000001e-05 2024-09-10T06:28:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570723+0000", 2024-09-10T06:28:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012265099999999999 2024-09-10T06:28:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570966+0000", 2024-09-10T06:28:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024268099999999999 2024-09-10T06:28:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.571204+0000", 2024-09-10T06:28:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000238213 2024-09-10T06:28:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.584059+0000", 2024-09-10T06:28:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012854477 2024-09-10T06:28:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594094+0000", 2024-09-10T06:28:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010034992 2024-09-10T06:28:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594146+0000", 2024-09-10T06:28:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2497999999999998e-05 2024-09-10T06:28:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594191+0000", 2024-09-10T06:28:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5191000000000002e-05 2024-09-10T06:28:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.638 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1435 3.2d 3:b4574439:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.930490702, 2024-09-10T06:28:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.035042897000000003, 2024-09-10T06:28:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1435 2024-09-10T06:28:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663488+0000", 2024-09-10T06:28:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.616e-06 2024-09-10T06:28:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667246+0000", 2024-09-10T06:28:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037580579999999999 2024-09-10T06:28:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667277+0000", 2024-09-10T06:28:23.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0688000000000002e-05 2024-09-10T06:28:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667291+0000", 2024-09-10T06:28:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4472e-05 2024-09-10T06:28:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667411+0000", 2024-09-10T06:28:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011913699999999999 2024-09-10T06:28:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:23.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667422+0000", 2024-09-10T06:28:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1073000000000001e-05 2024-09-10T06:28:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674124+0000", 2024-09-10T06:28:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067023619999999999 2024-09-10T06:28:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674520+0000", 2024-09-10T06:28:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039614700000000001 2024-09-10T06:28:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674879+0000", 2024-09-10T06:28:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035909899999999999 2024-09-10T06:28:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698261+0000", 2024-09-10T06:28:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023382209000000001 2024-09-10T06:28:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698338+0000", 2024-09-10T06:28:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6915000000000005e-05 2024-09-10T06:28:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698455+0000", 2024-09-10T06:28:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117039 2024-09-10T06:28:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698528+0000", 2024-09-10T06:28:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3082000000000003e-05 2024-09-10T06:28:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1436 3.2d 3:b7b59058:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.920927183, 2024-09-10T06:28:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032516167999999998, 2024-09-10T06:28:23.646 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1436 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673052+0000", 2024-09-10T06:28:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3629999999999998e-06 2024-09-10T06:28:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678383+0000", 2024-09-10T06:28:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053304199999999998 2024-09-10T06:28:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678423+0000", 2024-09-10T06:28:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0089999999999997e-05 2024-09-10T06:28:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678442+0000", 2024-09-10T06:28:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9242e-05 2024-09-10T06:28:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.685257+0000", 2024-09-10T06:28:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068147920000000001 2024-09-10T06:28:23.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.685641+0000", 2024-09-10T06:28:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038388700000000002 2024-09-10T06:28:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.686106+0000", 2024-09-10T06:28:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046506800000000001 2024-09-10T06:28:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698619+0000", 2024-09-10T06:28:23.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012513102999999999 2024-09-10T06:28:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705364+0000", 2024-09-10T06:28:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067448170000000002 2024-09-10T06:28:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705482+0000", 2024-09-10T06:28:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118362 2024-09-10T06:28:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705565+0000", 2024-09-10T06:28:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3023999999999997e-05 2024-09-10T06:28:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1442 3.13 3:c8bde401:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.858846581000002, 2024-09-10T06:28:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021096628999999999, 2024-09-10T06:28:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.652 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1442 2024-09-10T06:28:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735133+0000", 2024-09-10T06:28:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6899999999999998e-06 2024-09-10T06:28:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739406+0000", 2024-09-10T06:28:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042727950000000002 2024-09-10T06:28:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739432+0000", 2024-09-10T06:28:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6245999999999999e-05 2024-09-10T06:28:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739447+0000", 2024-09-10T06:28:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4071e-05 2024-09-10T06:28:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739575+0000", 2024-09-10T06:28:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000128641 2024-09-10T06:28:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739818+0000", 2024-09-10T06:28:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024242999999999999 2024-09-10T06:28:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.740058+0000", 2024-09-10T06:28:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023991 2024-09-10T06:28:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.748440+0000", 2024-09-10T06:28:23.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083824390000000002 2024-09-10T06:28:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756108+0000", 2024-09-10T06:28:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076684350000000004 2024-09-10T06:28:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756165+0000", 2024-09-10T06:28:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6641000000000002e-05 2024-09-10T06:28:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756226+0000", 2024-09-10T06:28:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1330999999999999e-05 2024-09-10T06:28:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1443 3.37 3:edd7279d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.848939818000002, 2024-09-10T06:28:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022124847, 2024-09-10T06:28:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.658 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1443 2024-09-10T06:28:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:23.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745040+0000", 2024-09-10T06:28:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6490000000000001e-06 2024-09-10T06:28:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753657+0000", 2024-09-10T06:28:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086173410000000006 2024-09-10T06:28:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753697+0000", 2024-09-10T06:28:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9669999999999998e-05 2024-09-10T06:28:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753722+0000", 2024-09-10T06:28:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4666000000000001e-05 2024-09-10T06:28:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753845+0000", 2024-09-10T06:28:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012319699999999999 2024-09-10T06:28:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753994+0000", 2024-09-10T06:28:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149157 2024-09-10T06:28:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.754120+0000", 2024-09-10T06:28:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012597500000000001 2024-09-10T06:28:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.766728+0000", 2024-09-10T06:28:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012608359 2024-09-10T06:28:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767022+0000", 2024-09-10T06:28:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029342099999999998 2024-09-10T06:28:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767098+0000", 2024-09-10T06:28:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6508999999999995e-05 2024-09-10T06:28:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767161+0000", 2024-09-10T06:28:23.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2903000000000004e-05 2024-09-10T06:28:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1469 3.d 3:b3f21559:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.559032921, 2024-09-10T06:28:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024987420999999999, 2024-09-10T06:28:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1469 2024-09-10T06:28:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034946+0000", 2024-09-10T06:28:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0630000000000002e-06 2024-09-10T06:28:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.038986+0000", 2024-09-10T06:28:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040398580000000003 2024-09-10T06:28:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039019+0000", 2024-09-10T06:28:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3167000000000003e-05 2024-09-10T06:28:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039037+0000", 2024-09-10T06:28:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7785999999999999e-05 2024-09-10T06:28:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039135+0000", 2024-09-10T06:28:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8152999999999994e-05 2024-09-10T06:28:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039321+0000", 2024-09-10T06:28:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000185243 2024-09-10T06:28:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039506+0000", 2024-09-10T06:28:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018496100000000001 2024-09-10T06:28:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.047253+0000", 2024-09-10T06:28:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0077471889999999998 2024-09-10T06:28:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059836+0000", 2024-09-10T06:28:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012583145 2024-09-10T06:28:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059879+0000", 2024-09-10T06:28:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3090999999999998e-05 2024-09-10T06:28:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059931+0000", 2024-09-10T06:28:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1765000000000003e-05 2024-09-10T06:28:23.669 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1669 3.2d 3:b72c6e58:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.719000910999998, 2024-09-10T06:28:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021299012999999999, 2024-09-10T06:28:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1669 2024-09-10T06:28:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874979+0000", 2024-09-10T06:28:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7670000000000001e-06 2024-09-10T06:28:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880441+0000", 2024-09-10T06:28:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054614859999999998 2024-09-10T06:28:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880475+0000", 2024-09-10T06:28:23.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4542000000000002e-05 2024-09-10T06:28:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880492+0000", 2024-09-10T06:28:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7048999999999999e-05 2024-09-10T06:28:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880599+0000", 2024-09-10T06:28:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106741 2024-09-10T06:28:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880788+0000", 2024-09-10T06:28:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189168 2024-09-10T06:28:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880951+0000", 2024-09-10T06:28:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016303199999999999 2024-09-10T06:28:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.890345+0000", 2024-09-10T06:28:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093942379999999992 2024-09-10T06:28:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896112+0000", 2024-09-10T06:28:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057669289999999996 2024-09-10T06:28:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896204+0000", 2024-09-10T06:28:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2069000000000002e-05 2024-09-10T06:28:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896274+0000", 2024-09-10T06:28:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9992000000000003e-05 2024-09-10T06:28:23.675 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1671 3.37 3:ed354b67:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.696278597999999, 2024-09-10T06:28:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022257213000000001, 2024-09-10T06:28:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1671 2024-09-10T06:28:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897701+0000", 2024-09-10T06:28:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-10T06:28:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901677+0000", 2024-09-10T06:28:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039758609999999998 2024-09-10T06:28:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901717+0000", 2024-09-10T06:28:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9889999999999999e-05 2024-09-10T06:28:23.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901735+0000", 2024-09-10T06:28:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8185999999999998e-05 2024-09-10T06:28:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901926+0000", 2024-09-10T06:28:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019083899999999999 2024-09-10T06:28:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902165+0000", 2024-09-10T06:28:23.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023968200000000001 2024-09-10T06:28:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902392+0000", 2024-09-10T06:28:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022711399999999999 2024-09-10T06:28:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.915622+0000", 2024-09-10T06:28:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013229708999999999 2024-09-10T06:28:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919654+0000", 2024-09-10T06:28:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040314699999999997 2024-09-10T06:28:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919827+0000", 2024-09-10T06:28:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173647 2024-09-10T06:28:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919955+0000", 2024-09-10T06:28:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012767900000000001 2024-09-10T06:28:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.681 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1674 3.e 3:71dde5c5:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.661082071999999, 2024-09-10T06:28:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024662893000000002, 2024-09-10T06:28:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.682 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1674 2024-09-10T06:28:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932897+0000", 2024-09-10T06:28:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3939999999999999e-06 2024-09-10T06:28:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935777+0000", 2024-09-10T06:28:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028807899999999998 2024-09-10T06:28:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935803+0000", 2024-09-10T06:28:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6067e-05 2024-09-10T06:28:23.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935818+0000", 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4696e-05 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935939+0000", 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120895 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936155+0000", 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021555000000000001 2024-09-10T06:28:23.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936376+0000", 2024-09-10T06:28:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221127 2024-09-10T06:28:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.951276+0000", 2024-09-10T06:28:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014900149999999999 2024-09-10T06:28:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957421+0000", 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061452440000000002 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957502+0000", 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1290000000000003e-05 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957557+0000", 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.469e-05 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1675 3.13 3:cbcca46f:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.652226006999999, 2024-09-10T06:28:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02191593, 2024-09-10T06:28:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1675 2024-09-10T06:28:23.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941752+0000", 2024-09-10T06:28:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1550000000000001e-06 2024-09-10T06:28:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945904+0000", 2024-09-10T06:28:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041513019999999999 2024-09-10T06:28:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945928+0000", 2024-09-10T06:28:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4113000000000001e-05 2024-09-10T06:28:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945941+0000", 2024-09-10T06:28:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3052e-05 2024-09-10T06:28:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946089+0000", 2024-09-10T06:28:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014766599999999999 2024-09-10T06:28:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946459+0000", 2024-09-10T06:28:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037089600000000001 2024-09-10T06:28:23.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946838+0000", 2024-09-10T06:28:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037808900000000002 2024-09-10T06:28:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957331+0000", 2024-09-10T06:28:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010493195 2024-09-10T06:28:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963409+0000", 2024-09-10T06:28:23.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060786570000000003 2024-09-10T06:28:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963559+0000", 2024-09-10T06:28:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014962600000000001 2024-09-10T06:28:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963666+0000", 2024-09-10T06:28:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107179 2024-09-10T06:28:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1684 3.e 3:70ef0483:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T06:28:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.495392237000001, 2024-09-10T06:28:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020215823000000001, 2024-09-10T06:28:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1684 2024-09-10T06:28:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.694 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098589+0000", 2024-09-10T06:28:23.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.673e-06 2024-09-10T06:28:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102294+0000", 2024-09-10T06:28:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037056160000000001 2024-09-10T06:28:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102319+0000", 2024-09-10T06:28:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4411000000000001e-05 2024-09-10T06:28:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102330+0000", 2024-09-10T06:28:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1212999999999999e-05 2024-09-10T06:28:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102457+0000", 2024-09-10T06:28:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012733300000000001 2024-09-10T06:28:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102472+0000", 2024-09-10T06:28:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4236000000000001e-05 2024-09-10T06:28:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106594+0000", 2024-09-10T06:28:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004122906 2024-09-10T06:28:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106701+0000", 2024-09-10T06:28:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106745 2024-09-10T06:28:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106809+0000", 2024-09-10T06:28:23.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107686 2024-09-10T06:28:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.117591+0000", 2024-09-10T06:28:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01078202 2024-09-10T06:28:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118617+0000", 2024-09-10T06:28:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001026218 2024-09-10T06:28:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118715+0000", 2024-09-10T06:28:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8004000000000006e-05 2024-09-10T06:28:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118800+0000", 2024-09-10T06:28:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4761999999999999e-05 2024-09-10T06:28:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.700 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1795 3.15 3:a8bb4476:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.157992+0000", 2024-09-10T06:28:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4359847860000006, 2024-09-10T06:28:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033173499000000002, 2024-09-10T06:28:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1795 2024-09-10T06:28:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.157992+0000", 2024-09-10T06:28:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.157992+0000", 2024-09-10T06:28:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.157996+0000", 2024-09-10T06:28:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3370000000000001e-06 2024-09-10T06:28:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164634+0000", 2024-09-10T06:28:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066382089999999999 2024-09-10T06:28:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164667+0000", 2024-09-10T06:28:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2741999999999999e-05 2024-09-10T06:28:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164684+0000", 2024-09-10T06:28:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6872999999999999e-05 2024-09-10T06:28:23.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164819+0000", 2024-09-10T06:28:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013543999999999999 2024-09-10T06:28:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.165087+0000", 2024-09-10T06:28:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026768899999999999 2024-09-10T06:28:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:23.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.165323+0000", 2024-09-10T06:28:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023572299999999999 2024-09-10T06:28:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.177948+0000", 2024-09-10T06:28:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012625658 2024-09-10T06:28:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.190846+0000", 2024-09-10T06:28:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012897782 2024-09-10T06:28:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.191029+0000", 2024-09-10T06:28:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000183086 2024-09-10T06:28:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.191165+0000", 2024-09-10T06:28:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013595999999999999 2024-09-10T06:28:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.706 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1797 3.f 3:f0b01c0d:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.176445+0000", 2024-09-10T06:28:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4175313759999995, 2024-09-10T06:28:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025704059000000001, 2024-09-10T06:28:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1797 2024-09-10T06:28:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.176445+0000", 2024-09-10T06:28:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.176445+0000", 2024-09-10T06:28:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.176448+0000", 2024-09-10T06:28:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1030000000000002e-06 2024-09-10T06:28:23.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181072+0000", 2024-09-10T06:28:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046238379999999999 2024-09-10T06:28:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181125+0000", 2024-09-10T06:28:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3124000000000002e-05 2024-09-10T06:28:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181150+0000", 2024-09-10T06:28:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5439000000000002e-05 2024-09-10T06:28:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181314+0000", 2024-09-10T06:28:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163566 2024-09-10T06:28:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181555+0000", 2024-09-10T06:28:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024091999999999999 2024-09-10T06:28:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181769+0000", 2024-09-10T06:28:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021398700000000001 2024-09-10T06:28:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.197700+0000", 2024-09-10T06:28:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015930990999999999 2024-09-10T06:28:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201865+0000", 2024-09-10T06:28:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041652800000000004 2024-09-10T06:28:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.202025+0000", 2024-09-10T06:28:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015980000000000001 2024-09-10T06:28:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.202149+0000", 2024-09-10T06:28:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012401099999999999 2024-09-10T06:28:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.712 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1799 3.11 3:8b44ea92:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.201684+0000", 2024-09-10T06:28:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.392292393, 2024-09-10T06:28:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025177875999999998, 2024-09-10T06:28:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1799 2024-09-10T06:28:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201684+0000", 2024-09-10T06:28:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201684+0000", 2024-09-10T06:28:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201687+0000", 2024-09-10T06:28:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:28:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206479+0000", 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047921869999999998 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206515+0000", 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5954999999999997e-05 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206532+0000", 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6736e-05 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206723+0000", 2024-09-10T06:28:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000191022 2024-09-10T06:28:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206978+0000", 2024-09-10T06:28:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025566199999999998 2024-09-10T06:28:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.207206+0000", 2024-09-10T06:28:23.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000227717 2024-09-10T06:28:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.217181+0000", 2024-09-10T06:28:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099752969999999993 2024-09-10T06:28:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.226557+0000", 2024-09-10T06:28:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093756800000000008 2024-09-10T06:28:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:23.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.226732+0000", 2024-09-10T06:28:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017504900000000001 2024-09-10T06:28:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.226862+0000", 2024-09-10T06:28:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129701 2024-09-10T06:28:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:23.718 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:23.720 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:23.715+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:23.720 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:28:23.821 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:23.819+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:23.847 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:23.848 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:28:23.848 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:28:23.848 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:23.862 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:28:23.922 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:23.919+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:23.983 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:28:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:28:23.983 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:28:23.983 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:23.997 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:28:24.023 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:24.023+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:24.124 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:24.124 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:28:24.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:28:24.124 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:28:24.124 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.124 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1346 3.17 3:ebf43782:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:24.124 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.831822+0000", 2024-09-10T06:28:24.124 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.288424157000001, 2024-09-10T06:28:24.124 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017975873999999999, 2024-09-10T06:28:24.124 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.124 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.125 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.125 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.125 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.125 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.125 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1346 2024-09-10T06:28:24.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.125 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.125 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.831822+0000", 2024-09-10T06:28:24.125 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.125 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.125 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.125 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.831822+0000", 2024-09-10T06:28:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.831825+0000", 2024-09-10T06:28:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8990000000000001e-06 2024-09-10T06:28:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.833538+0000", 2024-09-10T06:28:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001713216 2024-09-10T06:28:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.126 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.833562+0000", 2024-09-10T06:28:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3501000000000001e-05 2024-09-10T06:28:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.833576+0000", 2024-09-10T06:28:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3703000000000001e-05 2024-09-10T06:28:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.833684+0000", 2024-09-10T06:28:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108146 2024-09-10T06:28:24.127 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.833853+0000", 2024-09-10T06:28:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000169061 2024-09-10T06:28:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.834009+0000", 2024-09-10T06:28:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000156637 2024-09-10T06:28:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.128 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.844404+0000", 2024-09-10T06:28:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010394578 2024-09-10T06:28:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.849677+0000", 2024-09-10T06:28:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0052733149999999998 2024-09-10T06:28:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.849748+0000", 2024-09-10T06:28:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0514999999999998e-05 2024-09-10T06:28:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.129 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.849798+0000", 2024-09-10T06:28:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0303000000000003e-05 2024-09-10T06:28:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1358 3.39 e63/22 3:9e64b0c1:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_113:head v 63'7, mlcod=63'5)", 2024-09-10T06:28:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.970089+0000", 2024-09-10T06:28:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.150157135000001, 2024-09-10T06:28:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017522941, 2024-09-10T06:28:24.130 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.970089+0000", 2024-09-10T06:28:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.970089+0000", 2024-09-10T06:28:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.131 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.970091+0000", 2024-09-10T06:28:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8449999999999999e-06 2024-09-10T06:28:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.973992+0000", 2024-09-10T06:28:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039005799999999998 2024-09-10T06:28:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.132 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.974023+0000", 2024-09-10T06:28:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1696999999999998e-05 2024-09-10T06:28:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.974037+0000", 2024-09-10T06:28:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3198e-05 2024-09-10T06:28:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.133 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.974121+0000", 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4211999999999999e-05 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.974152+0000", 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0942000000000003e-05 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.987549+0000", 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013396979 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.134 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.987612+0000", 2024-09-10T06:28:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3487999999999999e-05 2024-09-10T06:28:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1366 3.2b 3:d6d8400c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_121:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.057722+0000", 2024-09-10T06:28:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 25.062524441000001, 2024-09-10T06:28:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01945465, 2024-09-10T06:28:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.135 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1366 2024-09-10T06:28:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.057722+0000", 2024-09-10T06:28:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.057722+0000", 2024-09-10T06:28:24.136 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.057725+0000", 2024-09-10T06:28:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5420000000000001e-06 2024-09-10T06:28:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.059551+0000", 2024-09-10T06:28:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018257849999999999 2024-09-10T06:28:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.137 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.059583+0000", 2024-09-10T06:28:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1387999999999998e-05 2024-09-10T06:28:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.059597+0000", 2024-09-10T06:28:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4185999999999999e-05 2024-09-10T06:28:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.059686+0000", 2024-09-10T06:28:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9288000000000003e-05 2024-09-10T06:28:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.138 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.059852+0000", 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000166341 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.060014+0000", 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000161325 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.068503+0000", 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0084894979999999998 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.139 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.077061+0000", 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.008557851 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.077127+0000", 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6227000000000001e-05 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.077177+0000", 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9218999999999998e-05 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.140 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1375 3.1 3:82031a0e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.159907+0000", 2024-09-10T06:28:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.960339763, 2024-09-10T06:28:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021300930999999999, 2024-09-10T06:28:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.141 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1375 2024-09-10T06:28:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.159907+0000", 2024-09-10T06:28:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.159907+0000", 2024-09-10T06:28:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.142 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.159910+0000", 2024-09-10T06:28:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1489999999999998e-06 2024-09-10T06:28:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.161877+0000", 2024-09-10T06:28:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019669990000000001 2024-09-10T06:28:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.161910+0000", 2024-09-10T06:28:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3102000000000003e-05 2024-09-10T06:28:24.143 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.161927+0000", 2024-09-10T06:28:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7566000000000001e-05 2024-09-10T06:28:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.162013+0000", 2024-09-10T06:28:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5201e-05 2024-09-10T06:28:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.144 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.162166+0000", 2024-09-10T06:28:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153323 2024-09-10T06:28:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.162261+0000", 2024-09-10T06:28:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4791999999999996e-05 2024-09-10T06:28:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.171107+0000", 2024-09-10T06:28:24.145 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0088467210000000001 2024-09-10T06:28:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.181069+0000", 2024-09-10T06:28:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0099611460000000006 2024-09-10T06:28:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.181147+0000", 2024-09-10T06:28:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8261000000000002e-05 2024-09-10T06:28:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.146 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.181208+0000", 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0671000000000002e-05 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1380 3.3 e63/22 3:c3afb574:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_135:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.215704+0000", 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.904542162999999, 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021271970000000001, 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.147 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.215704+0000", 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.215704+0000", 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.215706+0000", 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2220000000000001e-06 2024-09-10T06:28:24.148 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.220496+0000", 2024-09-10T06:28:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047897449999999998 2024-09-10T06:28:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.220530+0000", 2024-09-10T06:28:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4205999999999997e-05 2024-09-10T06:28:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.149 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.220546+0000", 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5998000000000002e-05 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.220631+0000", 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4547000000000002e-05 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.220662+0000", 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1071000000000001e-05 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.150 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.236915+0000", 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016253086 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.236976+0000", 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1094999999999997e-05 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1381 3.18 e63/22 3:1b2e08f5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_136:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.223349+0000", 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.896896897000001, 2024-09-10T06:28:24.151 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019080877, 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.223349+0000", 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.223349+0000", 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.152 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.223352+0000", 2024-09-10T06:28:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3029999999999998e-06 2024-09-10T06:28:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.224908+0000", 2024-09-10T06:28:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015566460000000001 2024-09-10T06:28:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.224930+0000", 2024-09-10T06:28:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1240999999999999e-05 2024-09-10T06:28:24.153 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.224943+0000", 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3216e-05 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.225026+0000", 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2856999999999996e-05 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.225054+0000", 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7772000000000001e-05 2024-09-10T06:28:24.154 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.242361+0000", 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017307031 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.242430+0000", 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9811e-05 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.155 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1385 3.1 3:8059af1d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.260983+0000", 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.859263645999999, 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018700082999999999, 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1385 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.156 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.260983+0000", 2024-09-10T06:28:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.260983+0000", 2024-09-10T06:28:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.260986+0000", 2024-09-10T06:28:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9919999999999999e-06 2024-09-10T06:28:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.157 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262376+0000", 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013901709999999999 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262393+0000", 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7011999999999999e-05 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262404+0000", 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0713000000000001e-05 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.158 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262479+0000", 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5643999999999996e-05 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262636+0000", 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015708700000000001 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262747+0000", 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110485 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.159 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.269606+0000", 2024-09-10T06:28:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0068592879999999998 2024-09-10T06:28:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.279561+0000", 2024-09-10T06:28:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0099551899999999992 2024-09-10T06:28:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.279629+0000", 2024-09-10T06:28:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8034000000000006e-05 2024-09-10T06:28:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.160 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.279683+0000", 2024-09-10T06:28:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3467000000000002e-05 2024-09-10T06:28:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1394 3.12 3:4b2d7d46:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.350980+0000", 2024-09-10T06:28:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.769266602999998, 2024-09-10T06:28:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017882708000000001, 2024-09-10T06:28:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.161 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1394 2024-09-10T06:28:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.350980+0000", 2024-09-10T06:28:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.162 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.350980+0000", 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.350983+0000", 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4750000000000002e-06 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.352912+0000", 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019285369999999999 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.163 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.352941+0000", 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9479999999999999e-05 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.352955+0000", 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3976e-05 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.353042+0000", 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6557000000000005e-05 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.164 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.353184+0000", 2024-09-10T06:28:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014217200000000001 2024-09-10T06:28:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.353289+0000", 2024-09-10T06:28:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104548 2024-09-10T06:28:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.359755+0000", 2024-09-10T06:28:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0064666109999999997 2024-09-10T06:28:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.165 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.368735+0000", 2024-09-10T06:28:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0089798020000000003 2024-09-10T06:28:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.368807+0000", 2024-09-10T06:28:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2124000000000003e-05 2024-09-10T06:28:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.368862+0000", 2024-09-10T06:28:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5426000000000001e-05 2024-09-10T06:28:24.166 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1401 3.1f 3:f8a0f298:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.423590+0000", 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.696656042000001, 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017827781000000001, 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.167 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1401 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.423590+0000", 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.423590+0000", 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.168 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.423594+0000", 2024-09-10T06:28:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4929999999999998e-06 2024-09-10T06:28:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.425311+0000", 2024-09-10T06:28:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017173449999999999 2024-09-10T06:28:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.425339+0000", 2024-09-10T06:28:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8038000000000002e-05 2024-09-10T06:28:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.169 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.425353+0000", 2024-09-10T06:28:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4255e-05 2024-09-10T06:28:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.425430+0000", 2024-09-10T06:28:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7022999999999998e-05 2024-09-10T06:28:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.425559+0000", 2024-09-10T06:28:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-10T06:28:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.170 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.425688+0000", 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012926999999999999 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.432754+0000", 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070662920000000001 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.441317+0000", 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085629380000000008 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.171 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.441366+0000", 2024-09-10T06:28:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8965999999999998e-05 2024-09-10T06:28:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.441418+0000", 2024-09-10T06:28:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2042000000000001e-05 2024-09-10T06:28:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.172 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1419 3.1 3:8151f0ae:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.499659+0000", 2024-09-10T06:28:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.620587399000001, 2024-09-10T06:28:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017413623, 2024-09-10T06:28:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1419 2024-09-10T06:28:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.173 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.499659+0000", 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.499659+0000", 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.499662+0000", 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5689999999999999e-06 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.174 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.501538+0000", 2024-09-10T06:28:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001876827 2024-09-10T06:28:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.501567+0000", 2024-09-10T06:28:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8311e-05 2024-09-10T06:28:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.501579+0000", 2024-09-10T06:28:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2689e-05 2024-09-10T06:28:24.175 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.501658+0000", 2024-09-10T06:28:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9097000000000005e-05 2024-09-10T06:28:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.501776+0000", 2024-09-10T06:28:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117946 2024-09-10T06:28:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.501870+0000", 2024-09-10T06:28:24.176 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3950999999999995e-05 2024-09-10T06:28:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.508403+0000", 2024-09-10T06:28:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0065325579999999999 2024-09-10T06:28:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.516997+0000", 2024-09-10T06:28:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085940549999999997 2024-09-10T06:28:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.177 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.517040+0000", 2024-09-10T06:28:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2731999999999997e-05 2024-09-10T06:28:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.517073+0000", 2024-09-10T06:28:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2888000000000001e-05 2024-09-10T06:28:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1430 3.1 3:837f4898:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:24.178 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.608952+0000", 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.511293974000001, 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020599517000000001, 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1430 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.608952+0000", 2024-09-10T06:28:24.179 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.608952+0000", 2024-09-10T06:28:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.608955+0000", 2024-09-10T06:28:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.988e-06 2024-09-10T06:28:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.180 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.610147+0000", 2024-09-10T06:28:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00119126 2024-09-10T06:28:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.610175+0000", 2024-09-10T06:28:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8228000000000001e-05 2024-09-10T06:28:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.610188+0000", 2024-09-10T06:28:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3602e-05 2024-09-10T06:28:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.181 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.610295+0000", 2024-09-10T06:28:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010634299999999999 2024-09-10T06:28:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:28:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.610302+0000", 2024-09-10T06:28:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5379999999999997e-06 2024-09-10T06:28:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.616184+0000", 2024-09-10T06:28:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058815050000000004 2024-09-10T06:28:24.182 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.616334+0000", 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015010499999999999 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.616476+0000", 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141698 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.624402+0000", 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0079261290000000005 2024-09-10T06:28:24.183 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.629436+0000", 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0050340180000000003 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.629501+0000", 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5666000000000005e-05 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.629552+0000", 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0436999999999998e-05 2024-09-10T06:28:24.184 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1437 3.12 3:4968153c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.682294+0000", 2024-09-10T06:28:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.437952219, 2024-09-10T06:28:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021809942999999998, 2024-09-10T06:28:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.185 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1437 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.682294+0000", 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.682294+0000", 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.186 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.682297+0000", 2024-09-10T06:28:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1200000000000002e-06 2024-09-10T06:28:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.683732+0000", 2024-09-10T06:28:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014347660000000001 2024-09-10T06:28:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.683759+0000", 2024-09-10T06:28:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6684999999999999e-05 2024-09-10T06:28:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.187 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.683772+0000", 2024-09-10T06:28:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3573e-05 2024-09-10T06:28:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.683863+0000", 2024-09-10T06:28:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0265000000000004e-05 2024-09-10T06:28:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.684010+0000", 2024-09-10T06:28:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000147448 2024-09-10T06:28:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.188 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.684112+0000", 2024-09-10T06:28:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010174 2024-09-10T06:28:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.691015+0000", 2024-09-10T06:28:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069028270000000003 2024-09-10T06:28:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.703987+0000", 2024-09-10T06:28:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012972869 2024-09-10T06:28:24.189 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.704053+0000", 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5864999999999994e-05 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.704104+0000", 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0785000000000003e-05 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.190 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1464 3.32 3:4ca2cc0f:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.984338+0000", 2024-09-10T06:28:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.135908223000001, 2024-09-10T06:28:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022262539000000001, 2024-09-10T06:28:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1464 2024-09-10T06:28:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.191 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.984338+0000", 2024-09-10T06:28:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.984338+0000", 2024-09-10T06:28:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.984340+0000", 2024-09-10T06:28:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.34e-06 2024-09-10T06:28:24.192 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.986783+0000", 2024-09-10T06:28:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002442081 2024-09-10T06:28:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.986810+0000", 2024-09-10T06:28:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7464999999999999e-05 2024-09-10T06:28:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.986822+0000", 2024-09-10T06:28:24.193 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2451e-05 2024-09-10T06:28:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.986904+0000", 2024-09-10T06:28:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1153e-05 2024-09-10T06:28:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.987074+0000", 2024-09-10T06:28:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017030699999999999 2024-09-10T06:28:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:24.194 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.987225+0000", 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000151471 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.993726+0000", 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0065008380000000001 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.006467+0000", 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012740336999999999 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.195 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.006545+0000", 2024-09-10T06:28:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8615000000000005e-05 2024-09-10T06:28:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.006601+0000", 2024-09-10T06:28:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5481e-05 2024-09-10T06:28:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1661 3.3d 3:bc9aff3a:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:24.196 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:04.793163+0000", 2024-09-10T06:28:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.327083772000002, 2024-09-10T06:28:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019162267, 2024-09-10T06:28:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1661 2024-09-10T06:28:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.197 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.793163+0000", 2024-09-10T06:28:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.793163+0000", 2024-09-10T06:28:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.793166+0000", 2024-09-10T06:28:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8349999999999997e-06 2024-09-10T06:28:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.198 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795231+0000", 2024-09-10T06:28:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0020642899999999999 2024-09-10T06:28:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795258+0000", 2024-09-10T06:28:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7080000000000002e-05 2024-09-10T06:28:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795268+0000", 2024-09-10T06:28:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0328e-05 2024-09-10T06:28:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.199 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795346+0000", 2024-09-10T06:28:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7485999999999996e-05 2024-09-10T06:28:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795533+0000", 2024-09-10T06:28:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0001875 2024-09-10T06:28:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795698+0000", 2024-09-10T06:28:24.200 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000165358 2024-09-10T06:28:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.810278+0000", 2024-09-10T06:28:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014579062 2024-09-10T06:28:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.812195+0000", 2024-09-10T06:28:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001917836 2024-09-10T06:28:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.201 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.812265+0000", 2024-09-10T06:28:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9987999999999995e-05 2024-09-10T06:28:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.812325+0000", 2024-09-10T06:28:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9503999999999998e-05 2024-09-10T06:28:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1662 3.17 3:e9b19d45:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:04.803037+0000", 2024-09-10T06:28:24.202 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.317209606999999, 2024-09-10T06:28:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017298568, 2024-09-10T06:28:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1662 2024-09-10T06:28:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.803037+0000", 2024-09-10T06:28:24.203 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.803037+0000", 2024-09-10T06:28:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.803039+0000", 2024-09-10T06:28:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3750000000000001e-06 2024-09-10T06:28:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.204 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.805236+0000", 2024-09-10T06:28:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002196974 2024-09-10T06:28:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.805258+0000", 2024-09-10T06:28:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2385e-05 2024-09-10T06:28:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.805276+0000", 2024-09-10T06:28:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7439e-05 2024-09-10T06:28:24.205 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.805367+0000", 2024-09-10T06:28:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1323000000000006e-05 2024-09-10T06:28:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.805531+0000", 2024-09-10T06:28:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000164148 2024-09-10T06:28:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.805692+0000", 2024-09-10T06:28:24.206 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000160502 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.814886+0000", 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0091940649999999995 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.820212+0000", 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0053255830000000001 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.820281+0000", 2024-09-10T06:28:24.207 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9669e-05 2024-09-10T06:28:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.820335+0000", 2024-09-10T06:28:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4104999999999998e-05 2024-09-10T06:28:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1667 3.17 3:e8214844:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:04.852886+0000", 2024-09-10T06:28:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 19.267360195999998, 2024-09-10T06:28:24.208 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020952383000000002, 2024-09-10T06:28:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1667 2024-09-10T06:28:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.852886+0000", 2024-09-10T06:28:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.209 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.852886+0000", 2024-09-10T06:28:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.852890+0000", 2024-09-10T06:28:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3500000000000001e-06 2024-09-10T06:28:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.854189+0000", 2024-09-10T06:28:24.210 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012995579999999999 2024-09-10T06:28:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.854222+0000", 2024-09-10T06:28:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2821999999999998e-05 2024-09-10T06:28:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.854237+0000", 2024-09-10T06:28:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4684999999999999e-05 2024-09-10T06:28:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.211 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.854318+0000", 2024-09-10T06:28:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1639999999999998e-05 2024-09-10T06:28:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.854443+0000", 2024-09-10T06:28:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012452399999999999 2024-09-10T06:28:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.854545+0000", 2024-09-10T06:28:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102565 2024-09-10T06:28:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.212 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.860508+0000", 2024-09-10T06:28:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059627819999999998 2024-09-10T06:28:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.873674+0000", 2024-09-10T06:28:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013166394 2024-09-10T06:28:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.873761+0000", 2024-09-10T06:28:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6236999999999994e-05 2024-09-10T06:28:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.213 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.873839+0000", 2024-09-10T06:28:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7825999999999997e-05 2024-09-10T06:28:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1759 3.17 3:ea0cd25c:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.581724+0000", 2024-09-10T06:28:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.538522575, 2024-09-10T06:28:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021920720000000001, 2024-09-10T06:28:24.214 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1759 2024-09-10T06:28:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.581724+0000", 2024-09-10T06:28:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.215 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.581724+0000", 2024-09-10T06:28:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.581728+0000", 2024-09-10T06:28:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8160000000000004e-06 2024-09-10T06:28:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.586321+0000", 2024-09-10T06:28:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00459327 2024-09-10T06:28:24.216 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.586353+0000", 2024-09-10T06:28:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.205e-05 2024-09-10T06:28:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.586368+0000", 2024-09-10T06:28:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5519000000000002e-05 2024-09-10T06:28:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.217 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.586493+0000", 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124611 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.586794+0000", 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030131800000000002 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.587105+0000", 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031030100000000002 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.598668+0000", 2024-09-10T06:28:24.218 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011563357 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.603562+0000", 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048937190000000004 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.603609+0000", 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7673000000000002e-05 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.603645+0000", 2024-09-10T06:28:24.219 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5086000000000003e-05 2024-09-10T06:28:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1774 3.30 e72/22 3:0db12388:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_21:head v 72'8, mlcod=66'6)", 2024-09-10T06:28:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.881549+0000", 2024-09-10T06:28:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.2386972029999992, 2024-09-10T06:28:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017013248000000002, 2024-09-10T06:28:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.220 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.881549+0000", 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.881549+0000", 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.881553+0000", 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8859999999999997e-06 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.221 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.889205+0000", 2024-09-10T06:28:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076515309999999996 2024-09-10T06:28:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.889257+0000", 2024-09-10T06:28:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2547999999999999e-05 2024-09-10T06:28:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.889281+0000", 2024-09-10T06:28:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4053000000000002e-05 2024-09-10T06:28:24.222 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.889403+0000", 2024-09-10T06:28:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122163 2024-09-10T06:28:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.889439+0000", 2024-09-10T06:28:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5420000000000003e-05 2024-09-10T06:28:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.898494+0000", 2024-09-10T06:28:24.223 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0090547570000000001 2024-09-10T06:28:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.898562+0000", 2024-09-10T06:28:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8889999999999999e-05 2024-09-10T06:28:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1776 3.10 e72/22 3:08e15545:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_23:head v 72'5, mlcod=63'3)", 2024-09-10T06:28:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.927936+0000", 2024-09-10T06:28:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.1923103709999996, 2024-09-10T06:28:24.224 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020917899, 2024-09-10T06:28:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.927936+0000", 2024-09-10T06:28:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.927936+0000", 2024-09-10T06:28:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.225 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.927939+0000", 2024-09-10T06:28:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0450000000000001e-06 2024-09-10T06:28:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.932107+0000", 2024-09-10T06:28:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041679519999999999 2024-09-10T06:28:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.932140+0000", 2024-09-10T06:28:24.226 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3195999999999999e-05 2024-09-10T06:28:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.932156+0000", 2024-09-10T06:28:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5988999999999999e-05 2024-09-10T06:28:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.932341+0000", 2024-09-10T06:28:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018458400000000001 2024-09-10T06:28:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.227 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.932407+0000", 2024-09-10T06:28:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6481000000000003e-05 2024-09-10T06:28:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.948743+0000", 2024-09-10T06:28:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016336234000000002 2024-09-10T06:28:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.948854+0000", 2024-09-10T06:28:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110418 2024-09-10T06:28:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.228 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1781 3.23 3:c455f7fe:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.991725+0000", 2024-09-10T06:28:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 9.1285211040000007, 2024-09-10T06:28:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016870662000000002, 2024-09-10T06:28:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:24.229 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1781 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.991725+0000", 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.991725+0000", 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:24.230 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.991730+0000", 2024-09-10T06:28:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9269999999999996e-06 2024-09-10T06:28:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.996954+0000", 2024-09-10T06:28:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0052241129999999998 2024-09-10T06:28:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.997010+0000", 2024-09-10T06:28:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5544000000000002e-05 2024-09-10T06:28:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.231 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.997036+0000", 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6265999999999999e-05 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.997162+0000", 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012590600000000001 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.997362+0000", 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020023999999999999 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.232 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.997549+0000", 2024-09-10T06:28:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018662 2024-09-10T06:28:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.003086+0000", 2024-09-10T06:28:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055372729999999997 2024-09-10T06:28:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.008479+0000", 2024-09-10T06:28:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0053925400000000004 2024-09-10T06:28:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.233 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.008543+0000", 2024-09-10T06:28:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3928000000000002e-05 2024-09-10T06:28:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.008596+0000", 2024-09-10T06:28:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3304999999999999e-05 2024-09-10T06:28:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:24.234 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:24.234 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:24.235 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:24.119+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:24.236 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:28:24.236 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T06:28:24.278 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:24.275+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:24.338 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:24.335+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:24.414 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:28:24.414 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:28:24.414 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:24.429 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:28:24.429 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:28:24.430 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:28:24.439 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:24.439+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:24.447 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:28:24.447 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:28:24.464 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:28:24.464 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:28:24.480 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:28:24.480 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:28:24.500 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:28:24.501 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:28:24.521 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:28:24.521 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:28:24.539 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:24.535+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:24.542 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:28:24.542 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:28:24.546 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:24.546 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:24.560 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:28:24.563 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:28:24.563 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:28:24.641 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:24.635+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:24.678 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:24.678 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:24.684 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T06:28:24.692 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:28:24.778 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:24.775+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:24.843 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:24.839+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:24.865 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:24.865 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:24.879 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:28:24.966 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:24.963+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:25.038 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:25.038 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:25.045 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:25.039+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:25.052 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:28:25.146 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:25.143+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:25.211 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:25.212 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:25.225 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:28:25.247 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:25.243+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:25.348 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:25.343+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:25.396 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:25.396 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:25.410 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:28:25.449 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:25.447+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:25.550 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:25.547+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:25.580 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:25.580 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:25.594 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:28:25.625 INFO:tasks.workunit.client.0.smithi112.stderr:100+0 records in 2024-09-10T06:28:25.625 INFO:tasks.workunit.client.0.smithi112.stderr:100+0 records out 2024-09-10T06:28:25.625 INFO:tasks.workunit.client.0.smithi112.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 7.88562 s, 133 MB/s 2024-09-10T06:28:25.651 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:25.647+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:25.709 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is set 2024-09-10T06:28:25.743 INFO:teuthology.orchestra.run.smithi112.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:25.743 INFO:teuthology.orchestra.run.smithi112.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:25.751 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:25.747+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:25.758 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:28:25.852 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:25.851+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:25.891 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:25.891 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:25.905 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:28:25.953 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:25.947+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:26.054 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:26.051+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:26.069 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:26.069 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:26.083 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:28:26.154 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:26.151+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:26.199 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:26.199 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:26.213 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:28:26.255 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:26.251+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:26.356 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:26.355+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:26.382 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:26.383 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:26.397 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:28:26.457 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:26.451+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:26.558 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:26.555+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:26.562 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:26.563 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:26.577 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:28:26.583 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T06:28:26.659 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:26.655+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:26.696 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:26.696 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:26.712 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:28:26.733 INFO:teuthology.orchestra.run.smithi112.stdout:osd.0: {} 2024-09-10T06:28:26.733 INFO:teuthology.orchestra.run.smithi112.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T06:28:26.750 INFO:teuthology.orchestra.run.smithi112.stdout:osd.1: {} 2024-09-10T06:28:26.750 INFO:teuthology.orchestra.run.smithi112.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T06:28:26.760 INFO:tasks.ceph.osd.7.smithi120.stderr:2024-09-10T06:28:26.755+0000 7f939ac8e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26522) UID: 0 2024-09-10T06:28:26.766 INFO:teuthology.orchestra.run.smithi112.stdout:osd.2: {} 2024-09-10T06:28:26.767 INFO:teuthology.orchestra.run.smithi112.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T06:28:26.783 INFO:teuthology.orchestra.run.smithi112.stdout:osd.3: {} 2024-09-10T06:28:26.783 INFO:teuthology.orchestra.run.smithi112.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T06:28:26.803 INFO:teuthology.orchestra.run.smithi112.stdout:osd.4: {} 2024-09-10T06:28:26.803 INFO:teuthology.orchestra.run.smithi112.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T06:28:26.821 INFO:teuthology.orchestra.run.smithi112.stdout:osd.5: {} 2024-09-10T06:28:26.821 INFO:teuthology.orchestra.run.smithi112.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T06:28:26.829 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-09-10T06:28:26.829 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T06:28:26.840 INFO:teuthology.orchestra.run.smithi112.stdout:osd.6: {} 2024-09-10T06:28:26.840 INFO:teuthology.orchestra.run.smithi112.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T06:28:26.843 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:28:26.861 INFO:teuthology.orchestra.run.smithi112.stdout:osd.7: {} 2024-09-10T06:28:26.861 INFO:teuthology.orchestra.run.smithi112.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T06:28:26.861 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:26.855+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:26.963 INFO:tasks.ceph.osd.0.smithi112.stderr:2024-09-10T06:28:26.959+0000 7f4e2271f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26428) UID: 0 2024-09-10T06:28:27.006 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:27.006 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:27.006 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:27.020 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:28:27.063 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:27.059+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:27.147 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1363 3.a 3:52044754:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.121602413000002, 2024-09-10T06:28:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021475438999999999, 2024-09-10T06:28:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.148 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1363 2024-09-10T06:28:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:27.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023232+0000", 2024-09-10T06:28:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6500000000000002e-06 2024-09-10T06:28:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027903+0000", 2024-09-10T06:28:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046709569999999999 2024-09-10T06:28:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027944+0000", 2024-09-10T06:28:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1e-05 2024-09-10T06:28:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027963+0000", 2024-09-10T06:28:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9363000000000001e-05 2024-09-10T06:28:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028108+0000", 2024-09-10T06:28:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144306 2024-09-10T06:28:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028370+0000", 2024-09-10T06:28:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026210300000000002 2024-09-10T06:28:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028610+0000", 2024-09-10T06:28:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024058 2024-09-10T06:28:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.036472+0000", 2024-09-10T06:28:27.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078620170000000007 2024-09-10T06:28:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044306+0000", 2024-09-10T06:28:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078340070000000005 2024-09-10T06:28:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044496+0000", 2024-09-10T06:28:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189507 2024-09-10T06:28:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044704+0000", 2024-09-10T06:28:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207949 2024-09-10T06:28:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1364 3.36 3:6e968b0d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.109610875000001, 2024-09-10T06:28:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022135317000000002, 2024-09-10T06:28:27.154 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.155 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.155 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.155 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1364 2024-09-10T06:28:27.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.155 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:27.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:27.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035266+0000", 2024-09-10T06:28:27.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6529999999999997e-05 2024-09-10T06:28:27.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039528+0000", 2024-09-10T06:28:27.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042612580000000004 2024-09-10T06:28:27.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039570+0000", 2024-09-10T06:28:27.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2481000000000002e-05 2024-09-10T06:28:27.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039594+0000", 2024-09-10T06:28:27.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3564999999999999e-05 2024-09-10T06:28:27.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039735+0000", 2024-09-10T06:28:27.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014147000000000001 2024-09-10T06:28:27.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039983+0000", 2024-09-10T06:28:27.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024765399999999998 2024-09-10T06:28:27.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:27.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.040216+0000", 2024-09-10T06:28:27.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023322999999999999 2024-09-10T06:28:27.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.049930+0000", 2024-09-10T06:28:27.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097135920000000001 2024-09-10T06:28:27.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057061+0000", 2024-09-10T06:28:27.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071309570000000003 2024-09-10T06:28:27.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057234+0000", 2024-09-10T06:28:27.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173308 2024-09-10T06:28:27.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057355+0000", 2024-09-10T06:28:27.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121272 2024-09-10T06:28:27.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.160 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.160 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1370 3.26 3:64e41eab:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:27.161 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:27.161 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.034875343, 2024-09-10T06:28:27.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022030800999999999, 2024-09-10T06:28:27.161 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.161 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.161 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1370 2024-09-10T06:28:27.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.161 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:27.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:27.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109960+0000", 2024-09-10T06:28:27.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3930000000000001e-06 2024-09-10T06:28:27.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114711+0000", 2024-09-10T06:28:27.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047511580000000001 2024-09-10T06:28:27.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114749+0000", 2024-09-10T06:28:27.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8417999999999997e-05 2024-09-10T06:28:27.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114768+0000", 2024-09-10T06:28:27.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8352e-05 2024-09-10T06:28:27.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114926+0000", 2024-09-10T06:28:27.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015819599999999999 2024-09-10T06:28:27.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115321+0000", 2024-09-10T06:28:27.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039507300000000002 2024-09-10T06:28:27.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115735+0000", 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041369900000000001 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.125212+0000", 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094774109999999998 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131666+0000", 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064533730000000001 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131847+0000", 2024-09-10T06:28:27.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018112400000000001 2024-09-10T06:28:27.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131986+0000", 2024-09-10T06:28:27.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013960399999999999 2024-09-10T06:28:27.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.166 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.166 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1371 3.2e e63/22 3:741ddced:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_126:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:27.167 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:27.167 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.019914879000002, 2024-09-10T06:28:27.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440024000000001, 2024-09-10T06:28:27.167 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.167 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.167 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.167 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:27.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:27.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124919+0000", 2024-09-10T06:28:27.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-10T06:28:27.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130095+0000", 2024-09-10T06:28:27.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00517645 2024-09-10T06:28:27.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130125+0000", 2024-09-10T06:28:27.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9944e-05 2024-09-10T06:28:27.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130142+0000", 2024-09-10T06:28:27.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6515999999999999e-05 2024-09-10T06:28:27.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130252+0000", 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110473 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130297+0000", 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5012999999999997e-05 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149096+0000", 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018799429999999999 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149356+0000", 2024-09-10T06:28:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000259499 2024-09-10T06:28:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1372 3.36 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.012358254999999, 2024-09-10T06:28:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026714723999999999, 2024-09-10T06:28:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1372 2024-09-10T06:28:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132475+0000", 2024-09-10T06:28:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.65e-06 2024-09-10T06:28:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137399+0000", 2024-09-10T06:28:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049236530000000001 2024-09-10T06:28:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137432+0000", 2024-09-10T06:28:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3050999999999999e-05 2024-09-10T06:28:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137449+0000", 2024-09-10T06:28:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6976000000000001e-05 2024-09-10T06:28:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137569+0000", 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012016899999999999 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137884+0000", 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031455799999999999 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138191+0000", 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000307466 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157760+0000", 2024-09-10T06:28:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019569128000000002 2024-09-10T06:28:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157954+0000", 2024-09-10T06:28:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019375300000000001 2024-09-10T06:28:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158118+0000", 2024-09-10T06:28:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016390900000000001 2024-09-10T06:28:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.159187+0000", 2024-09-10T06:28:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010694109999999999 2024-09-10T06:28:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1373 3.35 3:ac8a3287:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:27.177 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.002025264, 2024-09-10T06:28:27.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023907627000000001, 2024-09-10T06:28:27.178 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.178 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.178 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1373 2024-09-10T06:28:27.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.178 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:27.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:27.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142810+0000", 2024-09-10T06:28:27.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6129999999999997e-06 2024-09-10T06:28:27.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.146972+0000", 2024-09-10T06:28:27.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041615180000000003 2024-09-10T06:28:27.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147029+0000", 2024-09-10T06:28:27.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7476000000000003e-05 2024-09-10T06:28:27.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147056+0000", 2024-09-10T06:28:27.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7021000000000001e-05 2024-09-10T06:28:27.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147249+0000", 2024-09-10T06:28:27.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019260999999999999 2024-09-10T06:28:27.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147702+0000", 2024-09-10T06:28:27.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045347999999999997 2024-09-10T06:28:27.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:27.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148113+0000", 2024-09-10T06:28:27.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041051899999999998 2024-09-10T06:28:27.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161583+0000", 2024-09-10T06:28:27.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013470278 2024-09-10T06:28:27.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166410+0000", 2024-09-10T06:28:27.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048270199999999996 2024-09-10T06:28:27.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166579+0000", 2024-09-10T06:28:27.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016839099999999999 2024-09-10T06:28:27.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166713+0000", 2024-09-10T06:28:27.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013470100000000001 2024-09-10T06:28:27.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.183 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.183 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1387 3.35 3:adfbe02e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:27.183 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:27.183 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.862896976999998, 2024-09-10T06:28:27.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021055645000000001, 2024-09-10T06:28:27.184 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.184 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.184 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.184 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1387 2024-09-10T06:28:27.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.184 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281938+0000", 2024-09-10T06:28:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0659999999999997e-06 2024-09-10T06:28:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286048+0000", 2024-09-10T06:28:27.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041104560000000002 2024-09-10T06:28:27.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286097+0000", 2024-09-10T06:28:27.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8715999999999999e-05 2024-09-10T06:28:27.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286126+0000", 2024-09-10T06:28:27.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9308000000000001e-05 2024-09-10T06:28:27.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286279+0000", 2024-09-10T06:28:27.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015285400000000001 2024-09-10T06:28:27.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286520+0000", 2024-09-10T06:28:27.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024062000000000001 2024-09-10T06:28:27.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:27.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286772+0000", 2024-09-10T06:28:27.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025170599999999998 2024-09-10T06:28:27.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.301846+0000", 2024-09-10T06:28:27.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015074363 2024-09-10T06:28:27.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302698+0000", 2024-09-10T06:28:27.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000852179 2024-09-10T06:28:27.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302864+0000", 2024-09-10T06:28:27.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016568900000000001 2024-09-10T06:28:27.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302990+0000", 2024-09-10T06:28:27.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012568799999999999 2024-09-10T06:28:27.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.189 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.189 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1398 3.2c 3:350a23e7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:27.189 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:27.189 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.749853657999999, 2024-09-10T06:28:27.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032248536000000001, 2024-09-10T06:28:27.190 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.190 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.190 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.190 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.190 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.190 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.190 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1398 2024-09-10T06:28:27.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.190 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:27.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:27.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394981+0000", 2024-09-10T06:28:27.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7359999999999999e-06 2024-09-10T06:28:27.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402145+0000", 2024-09-10T06:28:27.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071643540000000004 2024-09-10T06:28:27.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402182+0000", 2024-09-10T06:28:27.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6318e-05 2024-09-10T06:28:27.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402200+0000", 2024-09-10T06:28:27.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8439000000000001e-05 2024-09-10T06:28:27.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402391+0000", 2024-09-10T06:28:27.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190917 2024-09-10T06:28:27.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402649+0000", 2024-09-10T06:28:27.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025817599999999999 2024-09-10T06:28:27.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:27.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402908+0000", 2024-09-10T06:28:27.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025864300000000002 2024-09-10T06:28:27.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424973+0000", 2024-09-10T06:28:27.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022065004999999999 2024-09-10T06:28:27.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.426990+0000", 2024-09-10T06:28:27.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020169340000000002 2024-09-10T06:28:27.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427129+0000", 2024-09-10T06:28:27.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139436 2024-09-10T06:28:27.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427226+0000", 2024-09-10T06:28:27.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6577999999999996e-05 2024-09-10T06:28:27.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.195 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.195 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1415 3.2c 3:34c14757:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:27.195 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:27.195 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.682006659999999, 2024-09-10T06:28:27.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029598765999999999, 2024-09-10T06:28:27.196 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.196 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.196 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.196 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1415 2024-09-10T06:28:27.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.196 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:27.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:27.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462828+0000", 2024-09-10T06:28:27.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1999999999999996e-06 2024-09-10T06:28:27.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.466974+0000", 2024-09-10T06:28:27.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041452989999999999 2024-09-10T06:28:27.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467026+0000", 2024-09-10T06:28:27.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2416000000000001e-05 2024-09-10T06:28:27.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467055+0000", 2024-09-10T06:28:27.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9081000000000002e-05 2024-09-10T06:28:27.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467207+0000", 2024-09-10T06:28:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015225699999999999 2024-09-10T06:28:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467468+0000", 2024-09-10T06:28:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026093500000000001 2024-09-10T06:28:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467755+0000", 2024-09-10T06:28:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000287101 2024-09-10T06:28:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477312+0000", 2024-09-10T06:28:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095560300000000001 2024-09-10T06:28:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492136+0000", 2024-09-10T06:28:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014824936 2024-09-10T06:28:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492301+0000", 2024-09-10T06:28:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016411600000000001 2024-09-10T06:28:27.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492423+0000", 2024-09-10T06:28:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122395 2024-09-10T06:28:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1416 3.10 3:084717f7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.672972412, 2024-09-10T06:28:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021526931999999999, 2024-09-10T06:28:27.201 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1416 2024-09-10T06:28:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471863+0000", 2024-09-10T06:28:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-10T06:28:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477370+0000", 2024-09-10T06:28:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055071549999999997 2024-09-10T06:28:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477402+0000", 2024-09-10T06:28:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1498000000000002e-05 2024-09-10T06:28:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477423+0000", 2024-09-10T06:28:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1098e-05 2024-09-10T06:28:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477559+0000", 2024-09-10T06:28:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136627 2024-09-10T06:28:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477936+0000", 2024-09-10T06:28:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037718099999999998 2024-09-10T06:28:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.478271+0000", 2024-09-10T06:28:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033427799999999997 2024-09-10T06:28:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.490997+0000", 2024-09-10T06:28:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012725858 2024-09-10T06:28:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493126+0000", 2024-09-10T06:28:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002129499 2024-09-10T06:28:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493263+0000", 2024-09-10T06:28:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013682500000000001 2024-09-10T06:28:27.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493385+0000", 2024-09-10T06:28:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122414 2024-09-10T06:28:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1482 3.35 3:ad9242de:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.984666678, 2024-09-10T06:28:27.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022710764000000001, 2024-09-10T06:28:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1482 2024-09-10T06:28:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:27.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160166+0000", 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1069999999999999e-06 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163977+0000", 2024-09-10T06:28:27.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003810843 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163995+0000", 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7648000000000001e-05 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164010+0000", 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4754e-05 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164094+0000", 2024-09-10T06:28:27.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4473000000000003e-05 2024-09-10T06:28:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164281+0000", 2024-09-10T06:28:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018659699999999999 2024-09-10T06:28:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164458+0000", 2024-09-10T06:28:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017758300000000001 2024-09-10T06:28:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.179923+0000", 2024-09-10T06:28:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015465269 2024-09-10T06:28:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182736+0000", 2024-09-10T06:28:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028130579999999998 2024-09-10T06:28:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182816+0000", 2024-09-10T06:28:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9976999999999997e-05 2024-09-10T06:28:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182875+0000", 2024-09-10T06:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8455000000000002e-05 2024-09-10T06:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1664 3.a 3:52f62ee7:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.320641438999999, 2024-09-10T06:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020253482999999999, 2024-09-10T06:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.213 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1664 2024-09-10T06:28:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824193+0000", 2024-09-10T06:28:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6059999999999999e-06 2024-09-10T06:28:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829549+0000", 2024-09-10T06:28:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053562189999999997 2024-09-10T06:28:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829584+0000", 2024-09-10T06:28:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4925000000000002e-05 2024-09-10T06:28:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829602+0000", 2024-09-10T06:28:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8034999999999999e-05 2024-09-10T06:28:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829716+0000", 2024-09-10T06:28:27.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113522 2024-09-10T06:28:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829903+0000", 2024-09-10T06:28:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187443 2024-09-10T06:28:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.830162+0000", 2024-09-10T06:28:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025917900000000001 2024-09-10T06:28:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.843459+0000", 2024-09-10T06:28:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01329675 2024-09-10T06:28:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844211+0000", 2024-09-10T06:28:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075213700000000005 2024-09-10T06:28:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844286+0000", 2024-09-10T06:28:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4453e-05 2024-09-10T06:28:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844443+0000", 2024-09-10T06:28:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157214 2024-09-10T06:28:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1754 3.3b 3:ded70450:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.481010+0000", 2024-09-10T06:28:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.663821033, 2024-09-10T06:28:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033092867999999998, 2024-09-10T06:28:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.219 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1754 2024-09-10T06:28:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.481010+0000", 2024-09-10T06:28:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.481010+0000", 2024-09-10T06:28:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.481012+0000", 2024-09-10T06:28:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-10T06:28:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487559+0000", 2024-09-10T06:28:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065467889999999999 2024-09-10T06:28:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487603+0000", 2024-09-10T06:28:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3254999999999998e-05 2024-09-10T06:28:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487622+0000", 2024-09-10T06:28:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9142000000000001e-05 2024-09-10T06:28:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487793+0000", 2024-09-10T06:28:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017092299999999999 2024-09-10T06:28:27.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.488035+0000", 2024-09-10T06:28:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000242563 2024-09-10T06:28:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.488258+0000", 2024-09-10T06:28:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022282000000000001 2024-09-10T06:28:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.501495+0000", 2024-09-10T06:28:27.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013236988 2024-09-10T06:28:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.513877+0000", 2024-09-10T06:28:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012382166 2024-09-10T06:28:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.513986+0000", 2024-09-10T06:28:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108405 2024-09-10T06:28:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.514103+0000", 2024-09-10T06:28:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117155 2024-09-10T06:28:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1765 3.2c 3:36655c69:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.683969+0000", 2024-09-10T06:28:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.460862152000001, 2024-09-10T06:28:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018761877999999999, 2024-09-10T06:28:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.225 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1765 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.683969+0000", 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.683969+0000", 2024-09-10T06:28:27.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.683971+0000", 2024-09-10T06:28:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7250000000000002e-06 2024-09-10T06:28:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688364+0000", 2024-09-10T06:28:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043926399999999997 2024-09-10T06:28:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688389+0000", 2024-09-10T06:28:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199999999999999e-05 2024-09-10T06:28:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688401+0000", 2024-09-10T06:28:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1834999999999999e-05 2024-09-10T06:28:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688496+0000", 2024-09-10T06:28:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4661999999999996e-05 2024-09-10T06:28:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688685+0000", 2024-09-10T06:28:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018916899999999999 2024-09-10T06:28:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688800+0000", 2024-09-10T06:28:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115047 2024-09-10T06:28:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.696257+0000", 2024-09-10T06:28:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007457371 2024-09-10T06:28:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.702611+0000", 2024-09-10T06:28:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063533180000000002 2024-09-10T06:28:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.702693+0000", 2024-09-10T06:28:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2021000000000006e-05 2024-09-10T06:28:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.702731+0000", 2024-09-10T06:28:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7889999999999998e-05 2024-09-10T06:28:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1768 3.26 3:655dfe81:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.749704+0000", 2024-09-10T06:28:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.395126615000001, 2024-09-10T06:28:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018211538999999999, 2024-09-10T06:28:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.231 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1768 2024-09-10T06:28:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.749704+0000", 2024-09-10T06:28:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.749704+0000", 2024-09-10T06:28:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.749707+0000", 2024-09-10T06:28:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8490000000000002e-06 2024-09-10T06:28:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753470+0000", 2024-09-10T06:28:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003762601 2024-09-10T06:28:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753503+0000", 2024-09-10T06:28:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3556999999999997e-05 2024-09-10T06:28:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753517+0000", 2024-09-10T06:28:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3946e-05 2024-09-10T06:28:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753641+0000", 2024-09-10T06:28:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349099999999999 2024-09-10T06:28:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753919+0000", 2024-09-10T06:28:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027816400000000002 2024-09-10T06:28:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.754150+0000", 2024-09-10T06:28:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000230967 2024-09-10T06:28:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767713+0000", 2024-09-10T06:28:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013563225999999999 2024-09-10T06:28:27.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767757+0000", 2024-09-10T06:28:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4401999999999999e-05 2024-09-10T06:28:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767848+0000", 2024-09-10T06:28:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0209000000000003e-05 2024-09-10T06:28:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767916+0000", 2024-09-10T06:28:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8126999999999993e-05 2024-09-10T06:28:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1771 3.10 3:0b728edd:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.819227+0000", 2024-09-10T06:28:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.325603717, 2024-09-10T06:28:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020819891, 2024-09-10T06:28:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.237 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1771 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.819227+0000", 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.819227+0000", 2024-09-10T06:28:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.819231+0000", 2024-09-10T06:28:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.596e-06 2024-09-10T06:28:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823354+0000", 2024-09-10T06:28:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041235350000000002 2024-09-10T06:28:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823376+0000", 2024-09-10T06:28:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1838999999999999e-05 2024-09-10T06:28:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823394+0000", 2024-09-10T06:28:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8116000000000001e-05 2024-09-10T06:28:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823527+0000", 2024-09-10T06:28:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013270799999999999 2024-09-10T06:28:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823790+0000", 2024-09-10T06:28:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026267199999999998 2024-09-10T06:28:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.824038+0000", 2024-09-10T06:28:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024825200000000002 2024-09-10T06:28:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.832733+0000", 2024-09-10T06:28:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086948110000000002 2024-09-10T06:28:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.839945+0000", 2024-09-10T06:28:27.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072128119999999999 2024-09-10T06:28:27.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.840000+0000", 2024-09-10T06:28:27.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4987000000000001e-05 2024-09-10T06:28:27.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.840047+0000", 2024-09-10T06:28:27.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6563000000000001e-05 2024-09-10T06:28:27.242 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1776 3.10 3:08e15545:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.923066+0000", 2024-09-10T06:28:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.221764503999999, 2024-09-10T06:28:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027201434, 2024-09-10T06:28:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1776 2024-09-10T06:28:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.923066+0000", 2024-09-10T06:28:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.923066+0000", 2024-09-10T06:28:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.923070+0000", 2024-09-10T06:28:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9859999999999996e-06 2024-09-10T06:28:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927726+0000", 2024-09-10T06:28:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046555549999999996 2024-09-10T06:28:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927764+0000", 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7709000000000001e-05 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927782+0000", 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8592000000000001e-05 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927974+0000", 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019189500000000001 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.928245+0000", 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000270454 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.928474+0000", 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022925699999999999 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.935435+0000", 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069609049999999999 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.950096+0000", 2024-09-10T06:28:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014661097999999999 2024-09-10T06:28:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.950190+0000", 2024-09-10T06:28:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4631999999999998e-05 2024-09-10T06:28:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.950268+0000", 2024-09-10T06:28:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7350999999999999e-05 2024-09-10T06:28:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1784 3.20 3:054632f9:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.038819+0000", 2024-09-10T06:28:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.106012083, 2024-09-10T06:28:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02561799, 2024-09-10T06:28:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.249 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1784 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.038819+0000", 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.038819+0000", 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.038822+0000", 2024-09-10T06:28:27.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6059999999999999e-06 2024-09-10T06:28:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043474+0000", 2024-09-10T06:28:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004651947 2024-09-10T06:28:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043515+0000", 2024-09-10T06:28:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0901e-05 2024-09-10T06:28:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043533+0000", 2024-09-10T06:28:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7989999999999999e-05 2024-09-10T06:28:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043684+0000", 2024-09-10T06:28:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150786 2024-09-10T06:28:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043937+0000", 2024-09-10T06:28:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025274899999999997 2024-09-10T06:28:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.044177+0000", 2024-09-10T06:28:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024046000000000001 2024-09-10T06:28:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.050984+0000", 2024-09-10T06:28:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006806739 2024-09-10T06:28:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064079+0000", 2024-09-10T06:28:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013094924000000001 2024-09-10T06:28:27.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064258+0000", 2024-09-10T06:28:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017905500000000001 2024-09-10T06:28:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064437+0000", 2024-09-10T06:28:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017883299999999999 2024-09-10T06:28:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1792 3.26 3:674d8f8e:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.126132+0000", 2024-09-10T06:28:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.018699097000001, 2024-09-10T06:28:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022657136000000001, 2024-09-10T06:28:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1792 2024-09-10T06:28:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.126132+0000", 2024-09-10T06:28:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.126132+0000", 2024-09-10T06:28:27.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.126136+0000", 2024-09-10T06:28:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8700000000000002e-06 2024-09-10T06:28:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130132+0000", 2024-09-10T06:28:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039961140000000003 2024-09-10T06:28:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130172+0000", 2024-09-10T06:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0052000000000002e-05 2024-09-10T06:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130191+0000", 2024-09-10T06:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9176000000000001e-05 2024-09-10T06:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130393+0000", 2024-09-10T06:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020170400000000001 2024-09-10T06:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130656+0000", 2024-09-10T06:28:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000262952 2024-09-10T06:28:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130893+0000", 2024-09-10T06:28:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023785599999999999 2024-09-10T06:28:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.138071+0000", 2024-09-10T06:28:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071771969999999997 2024-09-10T06:28:27.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.148497+0000", 2024-09-10T06:28:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010426444 2024-09-10T06:28:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.148669+0000", 2024-09-10T06:28:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000172096 2024-09-10T06:28:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.148789+0000", 2024-09-10T06:28:27.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119675 2024-09-10T06:28:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1793 3.20 3:044d7174:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.136820+0000", 2024-09-10T06:28:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.008010675, 2024-09-10T06:28:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024061645, 2024-09-10T06:28:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1793 2024-09-10T06:28:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.136820+0000", 2024-09-10T06:28:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.136820+0000", 2024-09-10T06:28:27.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.136825+0000", 2024-09-10T06:28:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4700000000000004e-06 2024-09-10T06:28:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.142937+0000", 2024-09-10T06:28:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061127400000000002 2024-09-10T06:28:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.142976+0000", 2024-09-10T06:28:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8927999999999997e-05 2024-09-10T06:28:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143003+0000", 2024-09-10T06:28:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6914999999999999e-05 2024-09-10T06:28:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143141+0000", 2024-09-10T06:28:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013770399999999999 2024-09-10T06:28:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143399+0000", 2024-09-10T06:28:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025788299999999998 2024-09-10T06:28:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143650+0000", 2024-09-10T06:28:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025162200000000001 2024-09-10T06:28:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.151461+0000", 2024-09-10T06:28:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078103410000000002 2024-09-10T06:28:27.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.160675+0000", 2024-09-10T06:28:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092145309999999998 2024-09-10T06:28:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.160773+0000", 2024-09-10T06:28:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7316000000000001e-05 2024-09-10T06:28:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.160882+0000", 2024-09-10T06:28:27.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109195 2024-09-10T06:28:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.267 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.267 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:27.269 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:28:27.269 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:27.267+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:27.370 INFO:tasks.ceph.osd.4.smithi120.stderr:2024-09-10T06:28:27.367+0000 7fba16ea7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26516) UID: 0 2024-09-10T06:28:27.440 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:27.440 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:27.440 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:27.440 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:27.454 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:28:27.472 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:27.467+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:27.571 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:27.567+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:27.618 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:27.619 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:27.619 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:27.619 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:27.619 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:27.633 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:28:27.672 INFO:tasks.ceph.osd.2.smithi112.stderr:2024-09-10T06:28:27.667+0000 7f9836f2b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26432) UID: 0 2024-09-10T06:28:27.737 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T06:28:27.753 INFO:tasks.workunit.client.0.smithi112.stdout:quota enabled for the user 0.140792901019694 2024-09-10T06:28:27.753 INFO:tasks.workunit.client.0.smithi112.stdout:adding file to bucket buck_2024_08_10_06_28_17: 1Gb. 2024-09-10T06:28:27.753 INFO:tasks.workunit.client.0.smithi112.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T06:28:27.753 INFO:tasks.workunit.client.0.smithi112.stdout:Test case: PASSED - user quota max size for 0.140792901019694 passed on 2 buckets 2024-09-10T06:28:27.753 INFO:tasks.workunit.client.0.smithi112.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T06:28:27.773 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:27.771+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:27.799 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:27.800 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:27.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:27.800 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:27.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.800 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:27.800 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:27.800 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 130.35158233300001, 2024-09-10T06:28:27.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70775834699999995, 2024-09-10T06:28:27.800 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.800 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.800 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:27.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:27.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1 2024-09-10T06:28:27.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.801 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:27.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:27.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446852+0000", 2024-09-10T06:28:27.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.117e-06 2024-09-10T06:28:27.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446870+0000", 2024-09-10T06:28:27.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7569999999999999e-05 2024-09-10T06:28:27.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446892+0000", 2024-09-10T06:28:27.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2036e-05 2024-09-10T06:28:27.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446908+0000", 2024-09-10T06:28:27.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6719999999999999e-05 2024-09-10T06:28:27.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447040+0000", 2024-09-10T06:28:27.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013118299999999999 2024-09-10T06:28:27.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:28:27.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447054+0000", 2024-09-10T06:28:27.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4343e-05 2024-09-10T06:28:27.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.151730+0000", 2024-09-10T06:28:27.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70467560600000001 2024-09-10T06:28:27.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152054+0000", 2024-09-10T06:28:27.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032444100000000002 2024-09-10T06:28:27.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:27.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152404+0000", 2024-09-10T06:28:27.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000349938 2024-09-10T06:28:27.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.153773+0000", 2024-09-10T06:28:27.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013693620000000001 2024-09-10T06:28:27.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154454+0000", 2024-09-10T06:28:27.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068035800000000005 2024-09-10T06:28:27.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154544+0000", 2024-09-10T06:28:27.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0623000000000003e-05 2024-09-10T06:28:27.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154607+0000", 2024-09-10T06:28:27.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3050000000000001e-05 2024-09-10T06:28:27.808 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.808 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.808 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.808 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:27.808 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:27.809 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 129.513354413, 2024-09-10T06:28:27.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021819150999999998, 2024-09-10T06:28:27.809 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.809 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.809 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:27.809 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:27.809 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 51 2024-09-10T06:28:27.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.809 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285078+0000", 2024-09-10T06:28:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000001e-07 2024-09-10T06:28:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285083+0000", 2024-09-10T06:28:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6099999999999997e-06 2024-09-10T06:28:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285092+0000", 2024-09-10T06:28:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2399999999999996e-06 2024-09-10T06:28:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285100+0000", 2024-09-10T06:28:27.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8739999999999995e-06 2024-09-10T06:28:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300938+0000", 2024-09-10T06:28:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015837527000000001 2024-09-10T06:28:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301058+0000", 2024-09-10T06:28:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012032300000000001 2024-09-10T06:28:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:27.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301251+0000", 2024-09-10T06:28:27.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192828 2024-09-10T06:28:27.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302937+0000", 2024-09-10T06:28:27.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016857339999999999 2024-09-10T06:28:27.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306745+0000", 2024-09-10T06:28:27.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038078729999999998 2024-09-10T06:28:27.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306830+0000", 2024-09-10T06:28:27.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5432999999999993e-05 2024-09-10T06:28:27.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306896+0000", 2024-09-10T06:28:27.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5993000000000003e-05 2024-09-10T06:28:27.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.814 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.815 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:27.815 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:27.815 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 129.51331453700001, 2024-09-10T06:28:27.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021995553000000001, 2024-09-10T06:28:27.815 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.815 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.815 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:27.815 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:27.815 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 52 2024-09-10T06:28:27.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.816 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:27.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:27.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:27.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4000000000000001e-07 2024-09-10T06:28:27.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285123+0000", 2024-09-10T06:28:27.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6969999999999998e-06 2024-09-10T06:28:27.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285132+0000", 2024-09-10T06:28:27.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1560000000000001e-06 2024-09-10T06:28:27.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285139+0000", 2024-09-10T06:28:27.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1539999999999996e-06 2024-09-10T06:28:27.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301865+0000", 2024-09-10T06:28:27.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016725173999999999 2024-09-10T06:28:27.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301995+0000", 2024-09-10T06:28:27.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130739 2024-09-10T06:28:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302195+0000", 2024-09-10T06:28:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000199965 2024-09-10T06:28:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.303135+0000", 2024-09-10T06:28:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093978300000000002 2024-09-10T06:28:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306979+0000", 2024-09-10T06:28:27.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038437459999999999 2024-09-10T06:28:27.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307057+0000", 2024-09-10T06:28:27.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7766e-05 2024-09-10T06:28:27.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307112+0000", 2024-09-10T06:28:27.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5733000000000003e-05 2024-09-10T06:28:27.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.820 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1374 3.2f e63/22 3:f735f5eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_129:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.640271292000001, 2024-09-10T06:28:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022402502000000001, 2024-09-10T06:28:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:27.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:27.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158162+0000", 2024-09-10T06:28:27.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4569999999999999e-06 2024-09-10T06:28:27.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161871+0000", 2024-09-10T06:28:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037080799999999999 2024-09-10T06:28:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161914+0000", 2024-09-10T06:28:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3571e-05 2024-09-10T06:28:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161940+0000", 2024-09-10T06:28:27.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5876000000000001e-05 2024-09-10T06:28:27.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.162081+0000", 2024-09-10T06:28:27.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014147000000000001 2024-09-10T06:28:27.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.162123+0000", 2024-09-10T06:28:27.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1666999999999999e-05 2024-09-10T06:28:27.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.180416+0000", 2024-09-10T06:28:27.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018292881 2024-09-10T06:28:27.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.180562+0000", 2024-09-10T06:28:27.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014650000000000001 2024-09-10T06:28:27.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.825 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.825 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1378 3.2d 3:b4d0ba6d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:27.826 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:27.826 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.606710632999999, 2024-09-10T06:28:27.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029738187999999999, 2024-09-10T06:28:27.826 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.826 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.826 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.826 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1378 2024-09-10T06:28:27.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.826 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:27.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:27.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191724+0000", 2024-09-10T06:28:27.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2650000000000001e-06 2024-09-10T06:28:27.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196514+0000", 2024-09-10T06:28:27.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047904039999999998 2024-09-10T06:28:27.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196552+0000", 2024-09-10T06:28:27.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8034999999999998e-05 2024-09-10T06:28:27.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196577+0000", 2024-09-10T06:28:27.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5120999999999999e-05 2024-09-10T06:28:27.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196716+0000", 2024-09-10T06:28:27.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013837699999999999 2024-09-10T06:28:27.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196970+0000", 2024-09-10T06:28:27.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025406300000000001 2024-09-10T06:28:27.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.197196+0000", 2024-09-10T06:28:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022647499999999999 2024-09-10T06:28:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211315+0000", 2024-09-10T06:28:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014118175 2024-09-10T06:28:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.220793+0000", 2024-09-10T06:28:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094785640000000001 2024-09-10T06:28:27.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221044+0000", 2024-09-10T06:28:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025106 2024-09-10T06:28:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221459+0000", 2024-09-10T06:28:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041464900000000001 2024-09-10T06:28:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.832 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1379 3.11 3:8ad434e9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:27.832 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:27.832 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.597032214999999, 2024-09-10T06:28:27.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021255388, 2024-09-10T06:28:27.832 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.832 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.832 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.832 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1379 2024-09-10T06:28:27.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.833 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:27.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:27.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201402+0000", 2024-09-10T06:28:27.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2459999999999999e-06 2024-09-10T06:28:27.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205915+0000", 2024-09-10T06:28:27.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045131149999999998 2024-09-10T06:28:27.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205948+0000", 2024-09-10T06:28:27.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2259999999999999e-05 2024-09-10T06:28:27.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205966+0000", 2024-09-10T06:28:27.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8238999999999999e-05 2024-09-10T06:28:27.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.206162+0000", 2024-09-10T06:28:27.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000195782 2024-09-10T06:28:27.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.206607+0000", 2024-09-10T06:28:27.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044565000000000002 2024-09-10T06:28:27.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:27.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.207031+0000", 2024-09-10T06:28:27.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000423714 2024-09-10T06:28:27.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221664+0000", 2024-09-10T06:28:27.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014632895 2024-09-10T06:28:27.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222398+0000", 2024-09-10T06:28:27.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073376099999999998 2024-09-10T06:28:27.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222569+0000", 2024-09-10T06:28:27.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017139400000000001 2024-09-10T06:28:27.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222654+0000", 2024-09-10T06:28:27.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5332000000000002e-05 2024-09-10T06:28:27.838 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.838 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.838 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.838 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1426 3.2d 3:b764a1d5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:27.838 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:27.838 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.231691622, 2024-09-10T06:28:27.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027451646999999999, 2024-09-10T06:28:27.838 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.838 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.838 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.839 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1426 2024-09-10T06:28:27.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.839 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:27.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:27.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566742+0000", 2024-09-10T06:28:27.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.317e-06 2024-09-10T06:28:27.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570553+0000", 2024-09-10T06:28:27.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038114680000000001 2024-09-10T06:28:27.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570585+0000", 2024-09-10T06:28:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1940999999999998e-05 2024-09-10T06:28:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570601+0000", 2024-09-10T06:28:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5218000000000001e-05 2024-09-10T06:28:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570723+0000", 2024-09-10T06:28:27.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012265099999999999 2024-09-10T06:28:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570966+0000", 2024-09-10T06:28:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024268099999999999 2024-09-10T06:28:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.571204+0000", 2024-09-10T06:28:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000238213 2024-09-10T06:28:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.584059+0000", 2024-09-10T06:28:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012854477 2024-09-10T06:28:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594094+0000", 2024-09-10T06:28:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010034992 2024-09-10T06:28:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594146+0000", 2024-09-10T06:28:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2497999999999998e-05 2024-09-10T06:28:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594191+0000", 2024-09-10T06:28:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5191000000000002e-05 2024-09-10T06:28:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1435 3.2d 3:b4574439:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.134945665, 2024-09-10T06:28:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.035042897000000003, 2024-09-10T06:28:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.844 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1435 2024-09-10T06:28:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663488+0000", 2024-09-10T06:28:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.616e-06 2024-09-10T06:28:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667246+0000", 2024-09-10T06:28:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037580579999999999 2024-09-10T06:28:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667277+0000", 2024-09-10T06:28:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0688000000000002e-05 2024-09-10T06:28:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667291+0000", 2024-09-10T06:28:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4472e-05 2024-09-10T06:28:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667411+0000", 2024-09-10T06:28:27.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011913699999999999 2024-09-10T06:28:27.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:27.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667422+0000", 2024-09-10T06:28:27.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1073000000000001e-05 2024-09-10T06:28:27.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674124+0000", 2024-09-10T06:28:27.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067023619999999999 2024-09-10T06:28:27.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674520+0000", 2024-09-10T06:28:27.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039614700000000001 2024-09-10T06:28:27.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:27.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674879+0000", 2024-09-10T06:28:27.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035909899999999999 2024-09-10T06:28:27.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698261+0000", 2024-09-10T06:28:27.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023382209000000001 2024-09-10T06:28:27.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698338+0000", 2024-09-10T06:28:27.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6915000000000005e-05 2024-09-10T06:28:27.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698455+0000", 2024-09-10T06:28:27.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117039 2024-09-10T06:28:27.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698528+0000", 2024-09-10T06:28:27.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3082000000000003e-05 2024-09-10T06:28:27.851 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.851 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.851 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.852 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1436 3.2d 3:b7b59058:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:27.852 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:27.852 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.125382146, 2024-09-10T06:28:27.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032516167999999998, 2024-09-10T06:28:27.852 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.852 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.852 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.853 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1436 2024-09-10T06:28:27.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.853 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:27.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:27.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673052+0000", 2024-09-10T06:28:27.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3629999999999998e-06 2024-09-10T06:28:27.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678383+0000", 2024-09-10T06:28:27.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053304199999999998 2024-09-10T06:28:27.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678423+0000", 2024-09-10T06:28:27.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0089999999999997e-05 2024-09-10T06:28:27.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678442+0000", 2024-09-10T06:28:27.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9242e-05 2024-09-10T06:28:27.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.685257+0000", 2024-09-10T06:28:27.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068147920000000001 2024-09-10T06:28:27.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.685641+0000", 2024-09-10T06:28:27.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038388700000000002 2024-09-10T06:28:27.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:27.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.686106+0000", 2024-09-10T06:28:27.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046506800000000001 2024-09-10T06:28:27.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698619+0000", 2024-09-10T06:28:27.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012513102999999999 2024-09-10T06:28:27.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705364+0000", 2024-09-10T06:28:27.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067448170000000002 2024-09-10T06:28:27.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705482+0000", 2024-09-10T06:28:27.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118362 2024-09-10T06:28:27.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705565+0000", 2024-09-10T06:28:27.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3023999999999997e-05 2024-09-10T06:28:27.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.858 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.858 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1442 3.13 3:c8bde401:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:27.859 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:27.859 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.063301544000002, 2024-09-10T06:28:27.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021096628999999999, 2024-09-10T06:28:27.859 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.859 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.859 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1442 2024-09-10T06:28:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:27.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735133+0000", 2024-09-10T06:28:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6899999999999998e-06 2024-09-10T06:28:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739406+0000", 2024-09-10T06:28:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042727950000000002 2024-09-10T06:28:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739432+0000", 2024-09-10T06:28:27.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6245999999999999e-05 2024-09-10T06:28:27.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739447+0000", 2024-09-10T06:28:27.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4071e-05 2024-09-10T06:28:27.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739575+0000", 2024-09-10T06:28:27.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000128641 2024-09-10T06:28:27.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739818+0000", 2024-09-10T06:28:27.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024242999999999999 2024-09-10T06:28:27.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:27.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.740058+0000", 2024-09-10T06:28:27.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023991 2024-09-10T06:28:27.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.748440+0000", 2024-09-10T06:28:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083824390000000002 2024-09-10T06:28:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756108+0000", 2024-09-10T06:28:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076684350000000004 2024-09-10T06:28:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756165+0000", 2024-09-10T06:28:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6641000000000002e-05 2024-09-10T06:28:27.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756226+0000", 2024-09-10T06:28:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1330999999999999e-05 2024-09-10T06:28:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1443 3.37 3:edd7279d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 28.053394781000002, 2024-09-10T06:28:27.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022124847, 2024-09-10T06:28:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1443 2024-09-10T06:28:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:27.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745040+0000", 2024-09-10T06:28:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6490000000000001e-06 2024-09-10T06:28:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753657+0000", 2024-09-10T06:28:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086173410000000006 2024-09-10T06:28:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753697+0000", 2024-09-10T06:28:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9669999999999998e-05 2024-09-10T06:28:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753722+0000", 2024-09-10T06:28:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4666000000000001e-05 2024-09-10T06:28:27.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753845+0000", 2024-09-10T06:28:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012319699999999999 2024-09-10T06:28:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753994+0000", 2024-09-10T06:28:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149157 2024-09-10T06:28:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:27.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.754120+0000", 2024-09-10T06:28:27.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012597500000000001 2024-09-10T06:28:27.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.766728+0000", 2024-09-10T06:28:27.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012608359 2024-09-10T06:28:27.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767022+0000", 2024-09-10T06:28:27.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029342099999999998 2024-09-10T06:28:27.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767098+0000", 2024-09-10T06:28:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6508999999999995e-05 2024-09-10T06:28:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767161+0000", 2024-09-10T06:28:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2903000000000004e-05 2024-09-10T06:28:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1469 3.d 3:b3f21559:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:27.871 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.763487884, 2024-09-10T06:28:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024987420999999999, 2024-09-10T06:28:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1469 2024-09-10T06:28:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034946+0000", 2024-09-10T06:28:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0630000000000002e-06 2024-09-10T06:28:27.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.038986+0000", 2024-09-10T06:28:27.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040398580000000003 2024-09-10T06:28:27.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039019+0000", 2024-09-10T06:28:27.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3167000000000003e-05 2024-09-10T06:28:27.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039037+0000", 2024-09-10T06:28:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7785999999999999e-05 2024-09-10T06:28:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039135+0000", 2024-09-10T06:28:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8152999999999994e-05 2024-09-10T06:28:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039321+0000", 2024-09-10T06:28:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000185243 2024-09-10T06:28:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039506+0000", 2024-09-10T06:28:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018496100000000001 2024-09-10T06:28:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.047253+0000", 2024-09-10T06:28:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0077471889999999998 2024-09-10T06:28:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059836+0000", 2024-09-10T06:28:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012583145 2024-09-10T06:28:27.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059879+0000", 2024-09-10T06:28:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3090999999999998e-05 2024-09-10T06:28:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059931+0000", 2024-09-10T06:28:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1765000000000003e-05 2024-09-10T06:28:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.878 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1669 3.2d 3:b72c6e58:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:27.878 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:27.878 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.923455873999998, 2024-09-10T06:28:27.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021299012999999999, 2024-09-10T06:28:27.878 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.878 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.879 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1669 2024-09-10T06:28:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874979+0000", 2024-09-10T06:28:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7670000000000001e-06 2024-09-10T06:28:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880441+0000", 2024-09-10T06:28:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054614859999999998 2024-09-10T06:28:27.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880475+0000", 2024-09-10T06:28:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4542000000000002e-05 2024-09-10T06:28:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880492+0000", 2024-09-10T06:28:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7048999999999999e-05 2024-09-10T06:28:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880599+0000", 2024-09-10T06:28:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106741 2024-09-10T06:28:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880788+0000", 2024-09-10T06:28:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189168 2024-09-10T06:28:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880951+0000", 2024-09-10T06:28:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016303199999999999 2024-09-10T06:28:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.890345+0000", 2024-09-10T06:28:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093942379999999992 2024-09-10T06:28:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896112+0000", 2024-09-10T06:28:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057669289999999996 2024-09-10T06:28:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896204+0000", 2024-09-10T06:28:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2069000000000002e-05 2024-09-10T06:28:27.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896274+0000", 2024-09-10T06:28:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9992000000000003e-05 2024-09-10T06:28:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1671 3.37 3:ed354b67:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.900733560999999, 2024-09-10T06:28:27.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022257213000000001, 2024-09-10T06:28:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1671 2024-09-10T06:28:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:27.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897701+0000", 2024-09-10T06:28:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-10T06:28:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901677+0000", 2024-09-10T06:28:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039758609999999998 2024-09-10T06:28:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901717+0000", 2024-09-10T06:28:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9889999999999999e-05 2024-09-10T06:28:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901735+0000", 2024-09-10T06:28:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8185999999999998e-05 2024-09-10T06:28:27.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901926+0000", 2024-09-10T06:28:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019083899999999999 2024-09-10T06:28:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902165+0000", 2024-09-10T06:28:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023968200000000001 2024-09-10T06:28:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902392+0000", 2024-09-10T06:28:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022711399999999999 2024-09-10T06:28:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.915622+0000", 2024-09-10T06:28:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013229708999999999 2024-09-10T06:28:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919654+0000", 2024-09-10T06:28:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040314699999999997 2024-09-10T06:28:27.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919827+0000", 2024-09-10T06:28:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173647 2024-09-10T06:28:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919955+0000", 2024-09-10T06:28:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012767900000000001 2024-09-10T06:28:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1674 3.e 3:71dde5c5:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.865537034999999, 2024-09-10T06:28:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024662893000000002, 2024-09-10T06:28:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1674 2024-09-10T06:28:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.892 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932897+0000", 2024-09-10T06:28:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3939999999999999e-06 2024-09-10T06:28:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935777+0000", 2024-09-10T06:28:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028807899999999998 2024-09-10T06:28:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935803+0000", 2024-09-10T06:28:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6067e-05 2024-09-10T06:28:27.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935818+0000", 2024-09-10T06:28:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4696e-05 2024-09-10T06:28:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935939+0000", 2024-09-10T06:28:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120895 2024-09-10T06:28:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936155+0000", 2024-09-10T06:28:27.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021555000000000001 2024-09-10T06:28:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936376+0000", 2024-09-10T06:28:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221127 2024-09-10T06:28:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.951276+0000", 2024-09-10T06:28:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014900149999999999 2024-09-10T06:28:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957421+0000", 2024-09-10T06:28:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061452440000000002 2024-09-10T06:28:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957502+0000", 2024-09-10T06:28:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1290000000000003e-05 2024-09-10T06:28:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957557+0000", 2024-09-10T06:28:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.469e-05 2024-09-10T06:28:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.897 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1675 3.13 3:cbcca46f:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.856680969999999, 2024-09-10T06:28:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02191593, 2024-09-10T06:28:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1675 2024-09-10T06:28:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941752+0000", 2024-09-10T06:28:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1550000000000001e-06 2024-09-10T06:28:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945904+0000", 2024-09-10T06:28:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041513019999999999 2024-09-10T06:28:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945928+0000", 2024-09-10T06:28:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4113000000000001e-05 2024-09-10T06:28:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945941+0000", 2024-09-10T06:28:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3052e-05 2024-09-10T06:28:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946089+0000", 2024-09-10T06:28:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014766599999999999 2024-09-10T06:28:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946459+0000", 2024-09-10T06:28:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037089600000000001 2024-09-10T06:28:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946838+0000", 2024-09-10T06:28:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037808900000000002 2024-09-10T06:28:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957331+0000", 2024-09-10T06:28:27.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010493195 2024-09-10T06:28:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963409+0000", 2024-09-10T06:28:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060786570000000003 2024-09-10T06:28:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963559+0000", 2024-09-10T06:28:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014962600000000001 2024-09-10T06:28:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963666+0000", 2024-09-10T06:28:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107179 2024-09-10T06:28:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1684 3.e 3:70ef0483:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T06:28:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.699847200000001, 2024-09-10T06:28:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020215823000000001, 2024-09-10T06:28:27.904 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1684 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098589+0000", 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.673e-06 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102294+0000", 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037056160000000001 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102319+0000", 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4411000000000001e-05 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102330+0000", 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1212999999999999e-05 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102457+0000", 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012733300000000001 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102472+0000", 2024-09-10T06:28:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4236000000000001e-05 2024-09-10T06:28:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106594+0000", 2024-09-10T06:28:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004122906 2024-09-10T06:28:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106701+0000", 2024-09-10T06:28:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106745 2024-09-10T06:28:27.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106809+0000", 2024-09-10T06:28:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107686 2024-09-10T06:28:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.117591+0000", 2024-09-10T06:28:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01078202 2024-09-10T06:28:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118617+0000", 2024-09-10T06:28:27.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001026218 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118715+0000", 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8004000000000006e-05 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118800+0000", 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4761999999999999e-05 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1795 3.15 3:a8bb4476:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.157992+0000", 2024-09-10T06:28:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.640439749, 2024-09-10T06:28:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033173499000000002, 2024-09-10T06:28:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1795 2024-09-10T06:28:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.157992+0000", 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.157992+0000", 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.157996+0000", 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3370000000000001e-06 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164634+0000", 2024-09-10T06:28:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066382089999999999 2024-09-10T06:28:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164667+0000", 2024-09-10T06:28:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2741999999999999e-05 2024-09-10T06:28:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164684+0000", 2024-09-10T06:28:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6872999999999999e-05 2024-09-10T06:28:27.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164819+0000", 2024-09-10T06:28:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013543999999999999 2024-09-10T06:28:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.165087+0000", 2024-09-10T06:28:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026768899999999999 2024-09-10T06:28:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.165323+0000", 2024-09-10T06:28:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023572299999999999 2024-09-10T06:28:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.177948+0000", 2024-09-10T06:28:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012625658 2024-09-10T06:28:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.190846+0000", 2024-09-10T06:28:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012897782 2024-09-10T06:28:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.191029+0000", 2024-09-10T06:28:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000183086 2024-09-10T06:28:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.191165+0000", 2024-09-10T06:28:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013595999999999999 2024-09-10T06:28:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1797 3.f 3:f0b01c0d:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.176445+0000", 2024-09-10T06:28:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.621986338999999, 2024-09-10T06:28:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025704059000000001, 2024-09-10T06:28:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1797 2024-09-10T06:28:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.917 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.176445+0000", 2024-09-10T06:28:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.176445+0000", 2024-09-10T06:28:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.176448+0000", 2024-09-10T06:28:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1030000000000002e-06 2024-09-10T06:28:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181072+0000", 2024-09-10T06:28:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046238379999999999 2024-09-10T06:28:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181125+0000", 2024-09-10T06:28:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3124000000000002e-05 2024-09-10T06:28:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181150+0000", 2024-09-10T06:28:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5439000000000002e-05 2024-09-10T06:28:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181314+0000", 2024-09-10T06:28:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163566 2024-09-10T06:28:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181555+0000", 2024-09-10T06:28:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024091999999999999 2024-09-10T06:28:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181769+0000", 2024-09-10T06:28:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021398700000000001 2024-09-10T06:28:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.197700+0000", 2024-09-10T06:28:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015930990999999999 2024-09-10T06:28:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201865+0000", 2024-09-10T06:28:27.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041652800000000004 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.202025+0000", 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015980000000000001 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.202149+0000", 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012401099999999999 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1799 3.11 3:8b44ea92:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.201684+0000", 2024-09-10T06:28:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.596747356, 2024-09-10T06:28:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025177875999999998, 2024-09-10T06:28:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1799 2024-09-10T06:28:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:27.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201684+0000", 2024-09-10T06:28:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201684+0000", 2024-09-10T06:28:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201687+0000", 2024-09-10T06:28:27.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:28:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206479+0000", 2024-09-10T06:28:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047921869999999998 2024-09-10T06:28:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206515+0000", 2024-09-10T06:28:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5954999999999997e-05 2024-09-10T06:28:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206532+0000", 2024-09-10T06:28:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6736e-05 2024-09-10T06:28:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206723+0000", 2024-09-10T06:28:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000191022 2024-09-10T06:28:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206978+0000", 2024-09-10T06:28:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025566199999999998 2024-09-10T06:28:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.207206+0000", 2024-09-10T06:28:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000227717 2024-09-10T06:28:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.217181+0000", 2024-09-10T06:28:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099752969999999993 2024-09-10T06:28:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.226557+0000", 2024-09-10T06:28:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093756800000000008 2024-09-10T06:28:27.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.226732+0000", 2024-09-10T06:28:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017504900000000001 2024-09-10T06:28:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.226862+0000", 2024-09-10T06:28:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129701 2024-09-10T06:28:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:27.929 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:27.929 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:27.930 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T06:28:27.931 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:27.927+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:28.032 INFO:tasks.workunit.client.0.smithi112.stdout:user 0.140792901019694 deleted 2024-09-10T06:28:28.032 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:28.027+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:28.036 INFO:tasks.workunit.client.0.smithi112.stdout:OK 2024-09-10T06:28:28.037 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T06:28:28.037 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T06:28:28.049 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:28.050 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:28:28.050 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:28:28.050 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:28.059 INFO:tasks.workunit:Stopping ['rgw/s3_user_quota.pl'] on client.0... 2024-09-10T06:28:28.060 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T06:28:28.063 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T06:28:28.133 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:28.131+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:28.211 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:28.211 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:28:28.211 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:28:28.211 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:28:28.211 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:28.224 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T06:28:28.270 INFO:tasks.ceph.osd.3.smithi112.stderr:2024-09-10T06:28:28.267+0000 7fab0fa33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26434) UID: 0 2024-09-10T06:28:28.336 INFO:tasks.ceph.osd.6.smithi120.stderr:2024-09-10T06:28:28.331+0000 7fee6fccb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26520) UID: 0 2024-09-10T06:28:28.339 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:28:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:28:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:28:28.339 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1346 3.17 3:ebf43782:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.831822+0000", 2024-09-10T06:28:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.505952771, 2024-09-10T06:28:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017975873999999999, 2024-09-10T06:28:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1346 2024-09-10T06:28:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.340 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.831822+0000", 2024-09-10T06:28:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.831822+0000", 2024-09-10T06:28:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.831825+0000", 2024-09-10T06:28:28.341 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8990000000000001e-06 2024-09-10T06:28:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.833538+0000", 2024-09-10T06:28:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001713216 2024-09-10T06:28:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.833562+0000", 2024-09-10T06:28:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3501000000000001e-05 2024-09-10T06:28:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.342 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.833576+0000", 2024-09-10T06:28:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3703000000000001e-05 2024-09-10T06:28:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.833684+0000", 2024-09-10T06:28:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108146 2024-09-10T06:28:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.833853+0000", 2024-09-10T06:28:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000169061 2024-09-10T06:28:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.343 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.834009+0000", 2024-09-10T06:28:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000156637 2024-09-10T06:28:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.844404+0000", 2024-09-10T06:28:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010394578 2024-09-10T06:28:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.849677+0000", 2024-09-10T06:28:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0052733149999999998 2024-09-10T06:28:28.344 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.849748+0000", 2024-09-10T06:28:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0514999999999998e-05 2024-09-10T06:28:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.849798+0000", 2024-09-10T06:28:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0303000000000003e-05 2024-09-10T06:28:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.345 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1358 3.39 e63/22 3:9e64b0c1:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_113:head v 63'7, mlcod=63'5)", 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.970089+0000", 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.367685749, 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017522941, 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.970089+0000", 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.346 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.970089+0000", 2024-09-10T06:28:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.970091+0000", 2024-09-10T06:28:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8449999999999999e-06 2024-09-10T06:28:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.973992+0000", 2024-09-10T06:28:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039005799999999998 2024-09-10T06:28:28.347 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.974023+0000", 2024-09-10T06:28:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1696999999999998e-05 2024-09-10T06:28:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.974037+0000", 2024-09-10T06:28:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3198e-05 2024-09-10T06:28:28.348 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.974121+0000", 2024-09-10T06:28:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4211999999999999e-05 2024-09-10T06:28:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.974152+0000", 2024-09-10T06:28:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0942000000000003e-05 2024-09-10T06:28:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.987549+0000", 2024-09-10T06:28:28.349 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013396979 2024-09-10T06:28:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.987612+0000", 2024-09-10T06:28:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3487999999999999e-05 2024-09-10T06:28:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1366 3.2b 3:d6d8400c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_121:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.057722+0000", 2024-09-10T06:28:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.280053055, 2024-09-10T06:28:28.350 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01945465, 2024-09-10T06:28:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1366 2024-09-10T06:28:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.057722+0000", 2024-09-10T06:28:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.351 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.057722+0000", 2024-09-10T06:28:28.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.057725+0000", 2024-09-10T06:28:28.352 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5420000000000001e-06 2024-09-10T06:28:28.352 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.352 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.352 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.352 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.059551+0000", 2024-09-10T06:28:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018257849999999999 2024-09-10T06:28:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.059583+0000", 2024-09-10T06:28:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1387999999999998e-05 2024-09-10T06:28:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.059597+0000", 2024-09-10T06:28:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4185999999999999e-05 2024-09-10T06:28:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.353 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.059686+0000", 2024-09-10T06:28:28.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9288000000000003e-05 2024-09-10T06:28:28.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.059852+0000", 2024-09-10T06:28:28.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000166341 2024-09-10T06:28:28.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.354 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:28.354 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.060014+0000", 2024-09-10T06:28:28.354 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000161325 2024-09-10T06:28:28.354 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.354 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.068503+0000", 2024-09-10T06:28:28.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0084894979999999998 2024-09-10T06:28:28.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.077061+0000", 2024-09-10T06:28:28.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.008557851 2024-09-10T06:28:28.355 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.355 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.355 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.355 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.077127+0000", 2024-09-10T06:28:28.355 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6227000000000001e-05 2024-09-10T06:28:28.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.356 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.356 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.077177+0000", 2024-09-10T06:28:28.356 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9218999999999998e-05 2024-09-10T06:28:28.356 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.356 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.356 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.356 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.356 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.356 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1375 3.1 3:82031a0e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_130:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:28.356 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.159907+0000", 2024-09-10T06:28:28.356 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.177868376999999, 2024-09-10T06:28:28.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021300930999999999, 2024-09-10T06:28:28.357 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.357 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.357 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.357 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.357 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.357 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.357 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1375 2024-09-10T06:28:28.357 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.357 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.357 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.357 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.357 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.159907+0000", 2024-09-10T06:28:28.357 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.159907+0000", 2024-09-10T06:28:28.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.358 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.159910+0000", 2024-09-10T06:28:28.358 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1489999999999998e-06 2024-09-10T06:28:28.358 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.358 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.358 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.161877+0000", 2024-09-10T06:28:28.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019669990000000001 2024-09-10T06:28:28.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.161910+0000", 2024-09-10T06:28:28.359 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3102000000000003e-05 2024-09-10T06:28:28.359 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.359 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.359 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.359 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.161927+0000", 2024-09-10T06:28:28.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7566000000000001e-05 2024-09-10T06:28:28.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.162013+0000", 2024-09-10T06:28:28.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5201e-05 2024-09-10T06:28:28.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.360 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.360 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.162166+0000", 2024-09-10T06:28:28.360 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000153323 2024-09-10T06:28:28.360 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.360 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:28.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.162261+0000", 2024-09-10T06:28:28.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4791999999999996e-05 2024-09-10T06:28:28.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.171107+0000", 2024-09-10T06:28:28.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0088467210000000001 2024-09-10T06:28:28.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.361 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.361 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.361 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.181069+0000", 2024-09-10T06:28:28.361 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0099611460000000006 2024-09-10T06:28:28.361 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.181147+0000", 2024-09-10T06:28:28.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8261000000000002e-05 2024-09-10T06:28:28.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.362 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.362 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.181208+0000", 2024-09-10T06:28:28.362 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0671000000000002e-05 2024-09-10T06:28:28.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.362 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.362 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.362 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.362 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.363 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1380 3.3 e63/22 3:c3afb574:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_135:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:28.363 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.215704+0000", 2024-09-10T06:28:28.363 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.122070777000001, 2024-09-10T06:28:28.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021271970000000001, 2024-09-10T06:28:28.363 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.363 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.363 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.363 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.363 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.363 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.215704+0000", 2024-09-10T06:28:28.363 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.363 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.363 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.215704+0000", 2024-09-10T06:28:28.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.215706+0000", 2024-09-10T06:28:28.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2220000000000001e-06 2024-09-10T06:28:28.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.364 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.364 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.364 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.220496+0000", 2024-09-10T06:28:28.364 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0047897449999999998 2024-09-10T06:28:28.364 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.220530+0000", 2024-09-10T06:28:28.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4205999999999997e-05 2024-09-10T06:28:28.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.220546+0000", 2024-09-10T06:28:28.365 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5998000000000002e-05 2024-09-10T06:28:28.365 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.365 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.365 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.365 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.220631+0000", 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.4547000000000002e-05 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.220662+0000", 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1071000000000001e-05 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.236915+0000", 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016253086 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.366 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.236976+0000", 2024-09-10T06:28:28.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1094999999999997e-05 2024-09-10T06:28:28.367 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.367 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.367 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.367 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.367 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.367 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1381 3.18 e63/22 3:1b2e08f5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_136:head v 63'2, mlcod=0'0)", 2024-09-10T06:28:28.367 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.223349+0000", 2024-09-10T06:28:28.367 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.114425511, 2024-09-10T06:28:28.367 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019080877, 2024-09-10T06:28:28.367 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.367 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.367 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.368 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.223349+0000", 2024-09-10T06:28:28.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.368 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.368 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.368 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.223349+0000", 2024-09-10T06:28:28.368 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.368 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.223352+0000", 2024-09-10T06:28:28.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3029999999999998e-06 2024-09-10T06:28:28.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.224908+0000", 2024-09-10T06:28:28.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015566460000000001 2024-09-10T06:28:28.369 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.369 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.369 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.369 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.224930+0000", 2024-09-10T06:28:28.369 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1240999999999999e-05 2024-09-10T06:28:28.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.224943+0000", 2024-09-10T06:28:28.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3216e-05 2024-09-10T06:28:28.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.225026+0000", 2024-09-10T06:28:28.370 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2856999999999996e-05 2024-09-10T06:28:28.370 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.370 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.370 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.370 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.225054+0000", 2024-09-10T06:28:28.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7772000000000001e-05 2024-09-10T06:28:28.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.242361+0000", 2024-09-10T06:28:28.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017307031 2024-09-10T06:28:28.371 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.371 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.371 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.371 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.242430+0000", 2024-09-10T06:28:28.371 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9811e-05 2024-09-10T06:28:28.371 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.371 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.372 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.372 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.372 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.372 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1385 3.1 3:8059af1d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:28.372 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.260983+0000", 2024-09-10T06:28:28.372 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.076792260000001, 2024-09-10T06:28:28.372 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018700082999999999, 2024-09-10T06:28:28.372 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.372 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.372 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.372 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.372 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1385 2024-09-10T06:28:28.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.373 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.260983+0000", 2024-09-10T06:28:28.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.373 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.373 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.260983+0000", 2024-09-10T06:28:28.373 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.373 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.373 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.260986+0000", 2024-09-10T06:28:28.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9919999999999999e-06 2024-09-10T06:28:28.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262376+0000", 2024-09-10T06:28:28.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013901709999999999 2024-09-10T06:28:28.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.374 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.374 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.374 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262393+0000", 2024-09-10T06:28:28.374 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7011999999999999e-05 2024-09-10T06:28:28.374 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262404+0000", 2024-09-10T06:28:28.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0713000000000001e-05 2024-09-10T06:28:28.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262479+0000", 2024-09-10T06:28:28.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5643999999999996e-05 2024-09-10T06:28:28.375 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.375 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.375 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.375 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262636+0000", 2024-09-10T06:28:28.375 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015708700000000001 2024-09-10T06:28:28.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:28.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262747+0000", 2024-09-10T06:28:28.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110485 2024-09-10T06:28:28.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.376 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.376 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.269606+0000", 2024-09-10T06:28:28.376 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0068592879999999998 2024-09-10T06:28:28.376 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.376 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.279561+0000", 2024-09-10T06:28:28.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0099551899999999992 2024-09-10T06:28:28.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.279629+0000", 2024-09-10T06:28:28.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8034000000000006e-05 2024-09-10T06:28:28.377 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.377 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.377 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.377 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.279683+0000", 2024-09-10T06:28:28.377 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3467000000000002e-05 2024-09-10T06:28:28.377 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.378 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.378 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.378 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.378 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.378 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1394 3.12 3:4b2d7d46:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_149:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:28.378 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.350980+0000", 2024-09-10T06:28:28.378 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.986795217000001, 2024-09-10T06:28:28.378 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017882708000000001, 2024-09-10T06:28:28.378 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.378 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.378 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.378 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.378 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1394 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.350980+0000", 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.350980+0000", 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.379 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.350983+0000", 2024-09-10T06:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4750000000000002e-06 2024-09-10T06:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.352912+0000", 2024-09-10T06:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019285369999999999 2024-09-10T06:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.352941+0000", 2024-09-10T06:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9479999999999999e-05 2024-09-10T06:28:28.380 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.352955+0000", 2024-09-10T06:28:28.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3976e-05 2024-09-10T06:28:28.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.353042+0000", 2024-09-10T06:28:28.381 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6557000000000005e-05 2024-09-10T06:28:28.381 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.381 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.381 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.381 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.353184+0000", 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014217200000000001 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.353289+0000", 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000104548 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.359755+0000", 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0064666109999999997 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.382 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.368735+0000", 2024-09-10T06:28:28.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0089798020000000003 2024-09-10T06:28:28.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.368807+0000", 2024-09-10T06:28:28.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2124000000000003e-05 2024-09-10T06:28:28.383 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.383 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.383 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.383 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.368862+0000", 2024-09-10T06:28:28.383 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5426000000000001e-05 2024-09-10T06:28:28.383 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.383 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.384 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.384 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.384 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.384 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1401 3.1f 3:f8a0f298:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_156:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:28.384 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.423590+0000", 2024-09-10T06:28:28.384 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.914184656, 2024-09-10T06:28:28.384 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017827781000000001, 2024-09-10T06:28:28.384 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.384 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.384 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.384 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.384 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.384 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.384 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1401 2024-09-10T06:28:28.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.385 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.423590+0000", 2024-09-10T06:28:28.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.385 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.385 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.423590+0000", 2024-09-10T06:28:28.385 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.385 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.385 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.423594+0000", 2024-09-10T06:28:28.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4929999999999998e-06 2024-09-10T06:28:28.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.425311+0000", 2024-09-10T06:28:28.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017173449999999999 2024-09-10T06:28:28.386 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.386 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.386 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.386 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.425339+0000", 2024-09-10T06:28:28.386 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8038000000000002e-05 2024-09-10T06:28:28.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.425353+0000", 2024-09-10T06:28:28.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4255e-05 2024-09-10T06:28:28.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.425430+0000", 2024-09-10T06:28:28.387 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7022999999999998e-05 2024-09-10T06:28:28.387 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.387 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.387 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.387 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.425559+0000", 2024-09-10T06:28:28.388 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000128119 2024-09-10T06:28:28.388 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.388 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.388 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:28.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.425688+0000", 2024-09-10T06:28:28.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012926999999999999 2024-09-10T06:28:28.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.432754+0000", 2024-09-10T06:28:28.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070662920000000001 2024-09-10T06:28:28.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.389 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.389 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.389 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.441317+0000", 2024-09-10T06:28:28.389 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085629380000000008 2024-09-10T06:28:28.389 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.441366+0000", 2024-09-10T06:28:28.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8965999999999998e-05 2024-09-10T06:28:28.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.390 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.390 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.441418+0000", 2024-09-10T06:28:28.390 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2042000000000001e-05 2024-09-10T06:28:28.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.390 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.390 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.390 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.390 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1419 3.1 3:8151f0ae:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_164:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.499659+0000", 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.838116013, 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017413623, 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1419 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.391 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.499659+0000", 2024-09-10T06:28:28.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.392 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.392 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.499659+0000", 2024-09-10T06:28:28.392 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.392 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.392 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.499662+0000", 2024-09-10T06:28:28.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5689999999999999e-06 2024-09-10T06:28:28.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.501538+0000", 2024-09-10T06:28:28.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001876827 2024-09-10T06:28:28.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.393 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.393 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.393 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.501567+0000", 2024-09-10T06:28:28.393 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8311e-05 2024-09-10T06:28:28.393 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.501579+0000", 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2689e-05 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.501658+0000", 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9097000000000005e-05 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.501776+0000", 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000117946 2024-09-10T06:28:28.394 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:28.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.501870+0000", 2024-09-10T06:28:28.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3950999999999995e-05 2024-09-10T06:28:28.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.508403+0000", 2024-09-10T06:28:28.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0065325579999999999 2024-09-10T06:28:28.395 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.395 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.395 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.395 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.516997+0000", 2024-09-10T06:28:28.395 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085940549999999997 2024-09-10T06:28:28.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.517040+0000", 2024-09-10T06:28:28.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2731999999999997e-05 2024-09-10T06:28:28.396 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.396 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.396 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.396 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.517073+0000", 2024-09-10T06:28:28.396 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2888000000000001e-05 2024-09-10T06:28:28.396 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.396 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.396 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1430 3.1 3:837f4898:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_175:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.608952+0000", 2024-09-10T06:28:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.728822588, 2024-09-10T06:28:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020599517000000001, 2024-09-10T06:28:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1430 2024-09-10T06:28:28.397 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.608952+0000", 2024-09-10T06:28:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.608952+0000", 2024-09-10T06:28:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.398 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.608955+0000", 2024-09-10T06:28:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.988e-06 2024-09-10T06:28:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.610147+0000", 2024-09-10T06:28:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00119126 2024-09-10T06:28:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.610175+0000", 2024-09-10T06:28:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8228000000000001e-05 2024-09-10T06:28:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.399 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.610188+0000", 2024-09-10T06:28:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3602e-05 2024-09-10T06:28:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.610295+0000", 2024-09-10T06:28:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010634299999999999 2024-09-10T06:28:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op must wait for map", 2024-09-10T06:28:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.610302+0000", 2024-09-10T06:28:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5379999999999997e-06 2024-09-10T06:28:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.400 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.616184+0000", 2024-09-10T06:28:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0058815050000000004 2024-09-10T06:28:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.616334+0000", 2024-09-10T06:28:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015010499999999999 2024-09-10T06:28:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.616476+0000", 2024-09-10T06:28:28.401 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141698 2024-09-10T06:28:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.624402+0000", 2024-09-10T06:28:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0079261290000000005 2024-09-10T06:28:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.629436+0000", 2024-09-10T06:28:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0050340180000000003 2024-09-10T06:28:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.402 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.629501+0000", 2024-09-10T06:28:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5666000000000005e-05 2024-09-10T06:28:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.629552+0000", 2024-09-10T06:28:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0436999999999998e-05 2024-09-10T06:28:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1437 3.12 3:4968153c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:28.403 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.682294+0000", 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.655480832999999, 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021809942999999998, 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1437 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.682294+0000", 2024-09-10T06:28:28.404 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.682294+0000", 2024-09-10T06:28:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.682297+0000", 2024-09-10T06:28:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1200000000000002e-06 2024-09-10T06:28:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.405 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.683732+0000", 2024-09-10T06:28:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014347660000000001 2024-09-10T06:28:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.683759+0000", 2024-09-10T06:28:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6684999999999999e-05 2024-09-10T06:28:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.683772+0000", 2024-09-10T06:28:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3573e-05 2024-09-10T06:28:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.406 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.683863+0000", 2024-09-10T06:28:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0265000000000004e-05 2024-09-10T06:28:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.684010+0000", 2024-09-10T06:28:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000147448 2024-09-10T06:28:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.684112+0000", 2024-09-10T06:28:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010174 2024-09-10T06:28:28.407 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.691015+0000", 2024-09-10T06:28:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0069028270000000003 2024-09-10T06:28:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.703987+0000", 2024-09-10T06:28:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012972869 2024-09-10T06:28:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.408 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.704053+0000", 2024-09-10T06:28:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5864999999999994e-05 2024-09-10T06:28:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.704104+0000", 2024-09-10T06:28:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0785000000000003e-05 2024-09-10T06:28:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1464 3.32 3:4ca2cc0f:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_209:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.984338+0000", 2024-09-10T06:28:28.409 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.353436837, 2024-09-10T06:28:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022262539000000001, 2024-09-10T06:28:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1464 2024-09-10T06:28:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.410 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.984338+0000", 2024-09-10T06:28:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.984338+0000", 2024-09-10T06:28:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.984340+0000", 2024-09-10T06:28:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.34e-06 2024-09-10T06:28:28.411 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.986783+0000", 2024-09-10T06:28:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002442081 2024-09-10T06:28:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.986810+0000", 2024-09-10T06:28:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7464999999999999e-05 2024-09-10T06:28:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.412 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.986822+0000", 2024-09-10T06:28:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2451e-05 2024-09-10T06:28:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.986904+0000", 2024-09-10T06:28:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1153e-05 2024-09-10T06:28:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.987074+0000", 2024-09-10T06:28:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017030699999999999 2024-09-10T06:28:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.413 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.987225+0000", 2024-09-10T06:28:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000151471 2024-09-10T06:28:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.993726+0000", 2024-09-10T06:28:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0065008380000000001 2024-09-10T06:28:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.006467+0000", 2024-09-10T06:28:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012740336999999999 2024-09-10T06:28:28.414 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.006545+0000", 2024-09-10T06:28:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8615000000000005e-05 2024-09-10T06:28:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.006601+0000", 2024-09-10T06:28:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5481e-05 2024-09-10T06:28:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.415 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1661 3.3d 3:bc9aff3a:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:04.793163+0000", 2024-09-10T06:28:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.544612386000001, 2024-09-10T06:28:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019162267, 2024-09-10T06:28:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1661 2024-09-10T06:28:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.416 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.793163+0000", 2024-09-10T06:28:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.793163+0000", 2024-09-10T06:28:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.793166+0000", 2024-09-10T06:28:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8349999999999997e-06 2024-09-10T06:28:28.417 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795231+0000", 2024-09-10T06:28:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0020642899999999999 2024-09-10T06:28:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795258+0000", 2024-09-10T06:28:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7080000000000002e-05 2024-09-10T06:28:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795268+0000", 2024-09-10T06:28:28.418 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0328e-05 2024-09-10T06:28:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795346+0000", 2024-09-10T06:28:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7485999999999996e-05 2024-09-10T06:28:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795533+0000", 2024-09-10T06:28:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0001875 2024-09-10T06:28:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:28.419 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795698+0000", 2024-09-10T06:28:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000165358 2024-09-10T06:28:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.810278+0000", 2024-09-10T06:28:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014579062 2024-09-10T06:28:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.812195+0000", 2024-09-10T06:28:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001917836 2024-09-10T06:28:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.420 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.812265+0000", 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9987999999999995e-05 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.812325+0000", 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9503999999999998e-05 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1662 3.17 3:e9b19d45:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:28.421 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:04.803037+0000", 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.534738221000001, 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017298568, 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1662 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.803037+0000", 2024-09-10T06:28:28.422 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.803037+0000", 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.803039+0000", 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3750000000000001e-06 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.805236+0000", 2024-09-10T06:28:28.423 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002196974 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.805258+0000", 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2385e-05 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.805276+0000", 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7439e-05 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.805367+0000", 2024-09-10T06:28:28.424 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1323000000000006e-05 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.805531+0000", 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000164148 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.805692+0000", 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000160502 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.814886+0000", 2024-09-10T06:28:28.425 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0091940649999999995 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.820212+0000", 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0053255830000000001 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.820281+0000", 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9669e-05 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.820335+0000", 2024-09-10T06:28:28.426 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4104999999999998e-05 2024-09-10T06:28:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1667 3.17 3:e8214844:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:04.852886+0000", 2024-09-10T06:28:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.484888810000001, 2024-09-10T06:28:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020952383000000002, 2024-09-10T06:28:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.427 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1667 2024-09-10T06:28:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.852886+0000", 2024-09-10T06:28:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.428 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.852886+0000", 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.852890+0000", 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3500000000000001e-06 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.854189+0000", 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012995579999999999 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.429 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.854222+0000", 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2821999999999998e-05 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.854237+0000", 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4684999999999999e-05 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.854318+0000", 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1639999999999998e-05 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.430 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.854443+0000", 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012452399999999999 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.854545+0000", 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000102565 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.860508+0000", 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059627819999999998 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.431 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.873674+0000", 2024-09-10T06:28:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013166394 2024-09-10T06:28:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.873761+0000", 2024-09-10T06:28:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.6236999999999994e-05 2024-09-10T06:28:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.873839+0000", 2024-09-10T06:28:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7825999999999997e-05 2024-09-10T06:28:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.432 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1759 3.17 3:ea0cd25c:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.581724+0000", 2024-09-10T06:28:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.756051189000001, 2024-09-10T06:28:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.021920720000000001, 2024-09-10T06:28:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.433 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1759 2024-09-10T06:28:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.581724+0000", 2024-09-10T06:28:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.581724+0000", 2024-09-10T06:28:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.581728+0000", 2024-09-10T06:28:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8160000000000004e-06 2024-09-10T06:28:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.586321+0000", 2024-09-10T06:28:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00459327 2024-09-10T06:28:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.586353+0000", 2024-09-10T06:28:28.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.205e-05 2024-09-10T06:28:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.586368+0000", 2024-09-10T06:28:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5519000000000002e-05 2024-09-10T06:28:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.586493+0000", 2024-09-10T06:28:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000124611 2024-09-10T06:28:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.586794+0000", 2024-09-10T06:28:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030131800000000002 2024-09-10T06:28:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.587105+0000", 2024-09-10T06:28:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031030100000000002 2024-09-10T06:28:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.598668+0000", 2024-09-10T06:28:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011563357 2024-09-10T06:28:28.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.603562+0000", 2024-09-10T06:28:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0048937190000000004 2024-09-10T06:28:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.603609+0000", 2024-09-10T06:28:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7673000000000002e-05 2024-09-10T06:28:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.603645+0000", 2024-09-10T06:28:28.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5086000000000003e-05 2024-09-10T06:28:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1774 3.30 e72/22 3:0db12388:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_21:head v 72'8, mlcod=66'6)", 2024-09-10T06:28:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.881549+0000", 2024-09-10T06:28:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.456225817, 2024-09-10T06:28:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017013248000000002, 2024-09-10T06:28:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.439 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.881549+0000", 2024-09-10T06:28:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.881549+0000", 2024-09-10T06:28:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.881553+0000", 2024-09-10T06:28:28.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8859999999999997e-06 2024-09-10T06:28:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.889205+0000", 2024-09-10T06:28:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0076515309999999996 2024-09-10T06:28:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.889257+0000", 2024-09-10T06:28:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2547999999999999e-05 2024-09-10T06:28:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.889281+0000", 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4053000000000002e-05 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.889403+0000", 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000122163 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.889439+0000", 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5420000000000003e-05 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.898494+0000", 2024-09-10T06:28:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0090547570000000001 2024-09-10T06:28:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.898562+0000", 2024-09-10T06:28:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8889999999999999e-05 2024-09-10T06:28:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1776 3.10 e72/22 3:08e15545:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_23:head v 72'5, mlcod=63'3)", 2024-09-10T06:28:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.927936+0000", 2024-09-10T06:28:28.443 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.409838985, 2024-09-10T06:28:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020917899, 2024-09-10T06:28:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.927936+0000", 2024-09-10T06:28:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.927936+0000", 2024-09-10T06:28:28.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.927939+0000", 2024-09-10T06:28:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0450000000000001e-06 2024-09-10T06:28:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.932107+0000", 2024-09-10T06:28:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041679519999999999 2024-09-10T06:28:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.445 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.932140+0000", 2024-09-10T06:28:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3195999999999999e-05 2024-09-10T06:28:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.932156+0000", 2024-09-10T06:28:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5988999999999999e-05 2024-09-10T06:28:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.932341+0000", 2024-09-10T06:28:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018458400000000001 2024-09-10T06:28:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.932407+0000", 2024-09-10T06:28:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6481000000000003e-05 2024-09-10T06:28:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.948743+0000", 2024-09-10T06:28:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016336234000000002 2024-09-10T06:28:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.948854+0000", 2024-09-10T06:28:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000110418 2024-09-10T06:28:28.447 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1781 3.23 3:c455f7fe:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.991725+0000", 2024-09-10T06:28:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.346049718, 2024-09-10T06:28:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016870662000000002, 2024-09-10T06:28:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.448 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1781 2024-09-10T06:28:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.991725+0000", 2024-09-10T06:28:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.991725+0000", 2024-09-10T06:28:28.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.991730+0000", 2024-09-10T06:28:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9269999999999996e-06 2024-09-10T06:28:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.996954+0000", 2024-09-10T06:28:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0052241129999999998 2024-09-10T06:28:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.997010+0000", 2024-09-10T06:28:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5544000000000002e-05 2024-09-10T06:28:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.997036+0000", 2024-09-10T06:28:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6265999999999999e-05 2024-09-10T06:28:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.997162+0000", 2024-09-10T06:28:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012590600000000001 2024-09-10T06:28:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.997362+0000", 2024-09-10T06:28:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00020023999999999999 2024-09-10T06:28:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.997549+0000", 2024-09-10T06:28:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00018662 2024-09-10T06:28:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.003086+0000", 2024-09-10T06:28:28.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055372729999999997 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.008479+0000", 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0053925400000000004 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.008543+0000", 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3928000000000002e-05 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.008596+0000", 2024-09-10T06:28:28.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3304999999999999e-05 2024-09-10T06:28:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.454 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.454 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:28.455 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T06:28:28.456 DEBUG:teuthology.parallel:result is None 2024-09-10T06:28:28.457 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T06:28:28.457 INFO:tasks.ceph.osd.5.smithi120.stderr:2024-09-10T06:28:28.451+0000 7fa7ac230640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26518) UID: 0 2024-09-10T06:28:28.509 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T06:28:28.509 DEBUG:teuthology.orchestra.run.smithi112:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-10T06:28:28.566 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T06:28:28.567 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-10T06:28:28.579 INFO:tasks.thrashosds:joining thrashosds 2024-09-10T06:28:28.579 INFO:tasks.ceph.osd.1.smithi112.stderr:2024-09-10T06:28:28.563+0000 7fae2de29640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26430) UID: 0 2024-09-10T06:28:28.614 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:28.614 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:28:28.614 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:28:28.614 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:28.627 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T06:28:28.730 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is set 2024-09-10T06:28:28.743 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:28:28.743 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:28:28.744 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:28:28.744 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:28.758 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T06:28:28.920 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:28.920 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:28:28.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:28:28.920 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:28:28.920 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.920 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1348 3.3f 3:ffdc06e0:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_103:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:28.920 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.852661+0000", 2024-09-10T06:28:28.920 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.065497381, 2024-09-10T06:28:28.920 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.023404767, 2024-09-10T06:28:28.921 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.921 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.921 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.921 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.921 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.921 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.921 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1348 2024-09-10T06:28:28.921 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.921 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.921 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.921 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.921 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.852661+0000", 2024-09-10T06:28:28.921 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.852661+0000", 2024-09-10T06:28:28.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.922 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.852665+0000", 2024-09-10T06:28:28.922 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3529999999999999e-06 2024-09-10T06:28:28.922 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.922 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.922 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.854710+0000", 2024-09-10T06:28:28.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0020450500000000001 2024-09-10T06:28:28.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.854741+0000", 2024-09-10T06:28:28.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1056000000000002e-05 2024-09-10T06:28:28.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.923 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.923 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.854755+0000", 2024-09-10T06:28:28.923 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4551e-05 2024-09-10T06:28:28.923 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.923 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.854839+0000", 2024-09-10T06:28:28.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3397000000000001e-05 2024-09-10T06:28:28.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.855001+0000", 2024-09-10T06:28:28.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016251699999999999 2024-09-10T06:28:28.924 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.924 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.924 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:28.924 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.855166+0000", 2024-09-10T06:28:28.924 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016436399999999999 2024-09-10T06:28:28.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.861724+0000", 2024-09-10T06:28:28.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0065586459999999996 2024-09-10T06:28:28.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.875946+0000", 2024-09-10T06:28:28.925 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014221612 2024-09-10T06:28:28.925 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.925 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.925 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.925 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.876016+0000", 2024-09-10T06:28:28.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0265999999999994e-05 2024-09-10T06:28:28.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.926 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.926 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.876066+0000", 2024-09-10T06:28:28.926 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9954999999999999e-05 2024-09-10T06:28:28.926 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.926 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.926 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.926 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.926 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.926 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1396 3.0 3:03331966:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_151:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:28.926 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.371516+0000", 2024-09-10T06:28:28.927 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.546642575, 2024-09-10T06:28:28.927 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014403317000000001, 2024-09-10T06:28:28.927 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.927 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.927 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.927 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.927 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.927 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.927 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1396 2024-09-10T06:28:28.927 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.927 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.927 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.927 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.927 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.371516+0000", 2024-09-10T06:28:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.371516+0000", 2024-09-10T06:28:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.371519+0000", 2024-09-10T06:28:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1429999999999998e-06 2024-09-10T06:28:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.928 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.373044+0000", 2024-09-10T06:28:28.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015249490000000001 2024-09-10T06:28:28.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.373076+0000", 2024-09-10T06:28:28.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1265e-05 2024-09-10T06:28:28.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.929 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.929 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.373090+0000", 2024-09-10T06:28:28.929 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4881e-05 2024-09-10T06:28:28.929 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.929 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.373167+0000", 2024-09-10T06:28:28.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6478999999999997e-05 2024-09-10T06:28:28.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.373313+0000", 2024-09-10T06:28:28.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000146401 2024-09-10T06:28:28.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.930 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.930 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:28.930 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.373422+0000", 2024-09-10T06:28:28.930 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108585 2024-09-10T06:28:28.930 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.380446+0000", 2024-09-10T06:28:28.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0070244909999999999 2024-09-10T06:28:28.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.385805+0000", 2024-09-10T06:28:28.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0053582109999999999 2024-09-10T06:28:28.931 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.931 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.931 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.931 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.385867+0000", 2024-09-10T06:28:28.931 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2506000000000001e-05 2024-09-10T06:28:28.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.932 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.932 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.385920+0000", 2024-09-10T06:28:28.932 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2405999999999999e-05 2024-09-10T06:28:28.932 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.932 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.932 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.932 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.932 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.932 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1397 3.3f 3:ff95a35c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_152:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:28.932 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.381725+0000", 2024-09-10T06:28:28.932 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.536433439, 2024-09-10T06:28:28.933 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.02359089, 2024-09-10T06:28:28.933 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.933 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.933 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.933 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.933 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.933 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.933 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1397 2024-09-10T06:28:28.933 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.933 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.933 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.933 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.381725+0000", 2024-09-10T06:28:28.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.381725+0000", 2024-09-10T06:28:28.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.934 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.934 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.934 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.381728+0000", 2024-09-10T06:28:28.934 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4660000000000002e-06 2024-09-10T06:28:28.934 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.383812+0000", 2024-09-10T06:28:28.935 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0020840960000000001 2024-09-10T06:28:28.935 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.935 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.935 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.935 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.383841+0000", 2024-09-10T06:28:28.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9281999999999998e-05 2024-09-10T06:28:28.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.936 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.383855+0000", 2024-09-10T06:28:28.936 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3925e-05 2024-09-10T06:28:28.936 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.936 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.936 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.383941+0000", 2024-09-10T06:28:28.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5952999999999995e-05 2024-09-10T06:28:28.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.384117+0000", 2024-09-10T06:28:28.937 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017543499999999999 2024-09-10T06:28:28.937 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.937 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.937 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:28.937 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.384285+0000", 2024-09-10T06:28:28.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016873600000000001 2024-09-10T06:28:28.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.390985+0000", 2024-09-10T06:28:28.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.006699534 2024-09-10T06:28:28.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.938 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.938 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.405204+0000", 2024-09-10T06:28:28.938 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014219041 2024-09-10T06:28:28.938 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.938 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.405255+0000", 2024-09-10T06:28:28.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1616000000000002e-05 2024-09-10T06:28:28.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.939 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.939 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.405316+0000", 2024-09-10T06:28:28.939 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0806e-05 2024-09-10T06:28:28.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.939 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.939 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.939 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.939 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.939 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1427 3.19 3:99212806:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_172:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:28.940 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.575499+0000", 2024-09-10T06:28:28.940 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.342659711, 2024-09-10T06:28:28.940 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017846364, 2024-09-10T06:28:28.940 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.940 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.940 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.940 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.940 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.940 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.940 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1427 2024-09-10T06:28:28.940 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.941 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.575499+0000", 2024-09-10T06:28:28.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.941 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.575499+0000", 2024-09-10T06:28:28.941 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.941 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.941 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.941 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.575502+0000", 2024-09-10T06:28:28.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9660000000000001e-06 2024-09-10T06:28:28.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.577408+0000", 2024-09-10T06:28:28.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019058129999999999 2024-09-10T06:28:28.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.942 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.942 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.577431+0000", 2024-09-10T06:28:28.942 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2756e-05 2024-09-10T06:28:28.942 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.942 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.577442+0000", 2024-09-10T06:28:28.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1802e-05 2024-09-10T06:28:28.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.577534+0000", 2024-09-10T06:28:28.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.1407000000000001e-05 2024-09-10T06:28:28.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.943 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.943 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.943 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.577654+0000", 2024-09-10T06:28:28.943 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012002099999999999 2024-09-10T06:28:28.943 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:28.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.577748+0000", 2024-09-10T06:28:28.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3701000000000003e-05 2024-09-10T06:28:28.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.590653+0000", 2024-09-10T06:28:28.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012905511999999999 2024-09-10T06:28:28.944 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.944 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.944 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.944 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.593235+0000", 2024-09-10T06:28:28.944 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002581575 2024-09-10T06:28:28.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.945 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.945 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.593296+0000", 2024-09-10T06:28:28.945 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1583999999999999e-05 2024-09-10T06:28:28.945 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.945 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.946 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.946 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.593345+0000", 2024-09-10T06:28:28.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9227000000000001e-05 2024-09-10T06:28:28.946 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.946 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.946 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.946 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.946 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.946 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1428 3.0 3:003d3a04:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_173:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:28.946 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.585825+0000", 2024-09-10T06:28:28.946 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.332334237000001, 2024-09-10T06:28:28.946 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015098583, 2024-09-10T06:28:28.947 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.947 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.947 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.947 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.947 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.947 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.947 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1428 2024-09-10T06:28:28.947 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.947 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.947 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.947 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.585825+0000", 2024-09-10T06:28:28.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.585825+0000", 2024-09-10T06:28:28.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.948 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.948 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.585827+0000", 2024-09-10T06:28:28.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7219999999999999e-06 2024-09-10T06:28:28.948 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.587493+0000", 2024-09-10T06:28:28.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001665244 2024-09-10T06:28:28.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.587515+0000", 2024-09-10T06:28:28.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2663999999999998e-05 2024-09-10T06:28:28.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.949 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.949 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.587525+0000", 2024-09-10T06:28:28.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.012e-05 2024-09-10T06:28:28.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.587602+0000", 2024-09-10T06:28:28.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7002999999999994e-05 2024-09-10T06:28:28.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.587739+0000", 2024-09-10T06:28:28.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013684600000000001 2024-09-10T06:28:28.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:28.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.587841+0000", 2024-09-10T06:28:28.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000101952 2024-09-10T06:28:28.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.598454+0000", 2024-09-10T06:28:28.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010612673 2024-09-10T06:28:28.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.600808+0000", 2024-09-10T06:28:28.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023537559999999998 2024-09-10T06:28:28.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.600872+0000", 2024-09-10T06:28:28.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4783000000000006e-05 2024-09-10T06:28:28.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.600923+0000", 2024-09-10T06:28:28.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0819999999999998e-05 2024-09-10T06:28:28.952 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.952 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.952 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.953 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1429 3.1a e63/22 3:5acc80b6:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_174:head v 63'1, mlcod=0'0)", 2024-09-10T06:28:28.953 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.600917+0000", 2024-09-10T06:28:28.953 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.317242029999999, 2024-09-10T06:28:28.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0148802, 2024-09-10T06:28:28.953 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.953 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.953 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.953 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.600917+0000", 2024-09-10T06:28:28.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.600917+0000", 2024-09-10T06:28:28.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.600918+0000", 2024-09-10T06:28:28.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7900000000000007e-07 2024-09-10T06:28:28.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.606704+0000", 2024-09-10T06:28:28.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057863380000000002 2024-09-10T06:28:28.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.606718+0000", 2024-09-10T06:28:28.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3506000000000001e-05 2024-09-10T06:28:28.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.606727+0000", 2024-09-10T06:28:28.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5170000000000005e-06 2024-09-10T06:28:28.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.608220+0000", 2024-09-10T06:28:28.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014932509999999999 2024-09-10T06:28:28.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.608241+0000", 2024-09-10T06:28:28.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0469e-05 2024-09-10T06:28:28.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.615740+0000", 2024-09-10T06:28:28.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0074989820000000004 2024-09-10T06:28:28.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.615797+0000", 2024-09-10T06:28:28.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7157999999999997e-05 2024-09-10T06:28:28.957 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.957 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.957 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.957 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1433 3.1a e64/22 3:59ee0094:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_178:head v 64'2, mlcod=0'0)", 2024-09-10T06:28:28.957 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.650778+0000", 2024-09-10T06:28:28.957 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.267380435, 2024-09-10T06:28:28.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019005857000000001, 2024-09-10T06:28:28.957 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.958 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.958 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.958 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.650778+0000", 2024-09-10T06:28:28.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.650778+0000", 2024-09-10T06:28:28.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.650780+0000", 2024-09-10T06:28:28.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0609999999999998e-06 2024-09-10T06:28:28.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.654780+0000", 2024-09-10T06:28:28.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039990670000000002 2024-09-10T06:28:28.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.654811+0000", 2024-09-10T06:28:28.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1498000000000002e-05 2024-09-10T06:28:28.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.654826+0000", 2024-09-10T06:28:28.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5288999999999999e-05 2024-09-10T06:28:28.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.654934+0000", 2024-09-10T06:28:28.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010728199999999999 2024-09-10T06:28:28.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.654964+0000", 2024-09-10T06:28:28.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0898000000000001e-05 2024-09-10T06:28:28.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.961 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.961 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.669723+0000", 2024-09-10T06:28:28.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014758929 2024-09-10T06:28:28.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.669784+0000", 2024-09-10T06:28:28.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0832999999999998e-05 2024-09-10T06:28:28.962 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.962 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.962 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.963 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1434 3.25 3:a4872046:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_179:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:28.963 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.653744+0000", 2024-09-10T06:28:28.963 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.264414815999999, 2024-09-10T06:28:28.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017405322000000001, 2024-09-10T06:28:28.963 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.963 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.963 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.963 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.963 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.963 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.963 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1434 2024-09-10T06:28:28.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.963 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.653744+0000", 2024-09-10T06:28:28.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.653744+0000", 2024-09-10T06:28:28.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.653748+0000", 2024-09-10T06:28:28.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5329999999999999e-06 2024-09-10T06:28:28.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.655539+0000", 2024-09-10T06:28:28.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001791076 2024-09-10T06:28:28.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.655551+0000", 2024-09-10T06:28:28.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2842e-05 2024-09-10T06:28:28.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.655559+0000", 2024-09-10T06:28:28.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0999999999999998e-06 2024-09-10T06:28:28.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.655616+0000", 2024-09-10T06:28:28.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7392999999999998e-05 2024-09-10T06:28:28.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.655730+0000", 2024-09-10T06:28:28.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000114015 2024-09-10T06:28:28.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:28.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.655823+0000", 2024-09-10T06:28:28.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3443999999999995e-05 2024-09-10T06:28:28.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.670385+0000", 2024-09-10T06:28:28.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014561419000000001 2024-09-10T06:28:28.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.671030+0000", 2024-09-10T06:28:28.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00064488299999999996 2024-09-10T06:28:28.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.671099+0000", 2024-09-10T06:28:28.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9084999999999993e-05 2024-09-10T06:28:28.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.968 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.671149+0000", 2024-09-10T06:28:28.968 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.0531999999999997e-05 2024-09-10T06:28:28.968 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.968 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.968 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.969 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1444 3.3f 3:fd0dadb8:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_189:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:28.969 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.754230+0000", 2024-09-10T06:28:28.969 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.163928931000001, 2024-09-10T06:28:28.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015964303999999999, 2024-09-10T06:28:28.969 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.969 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.969 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.969 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.969 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.969 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.969 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1444 2024-09-10T06:28:28.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.970 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.754230+0000", 2024-09-10T06:28:28.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.754230+0000", 2024-09-10T06:28:28.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.754233+0000", 2024-09-10T06:28:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.689e-06 2024-09-10T06:28:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.755744+0000", 2024-09-10T06:28:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015112929999999999 2024-09-10T06:28:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.755769+0000", 2024-09-10T06:28:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5273e-05 2024-09-10T06:28:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.755782+0000", 2024-09-10T06:28:28.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3101999999999999e-05 2024-09-10T06:28:28.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.755856+0000", 2024-09-10T06:28:28.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.4097000000000006e-05 2024-09-10T06:28:28.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.755968+0000", 2024-09-10T06:28:28.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011212 2024-09-10T06:28:28.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:28.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.756075+0000", 2024-09-10T06:28:28.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000106634 2024-09-10T06:28:28.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.762136+0000", 2024-09-10T06:28:28.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060612569999999996 2024-09-10T06:28:28.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.770123+0000", 2024-09-10T06:28:28.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0079868660000000005 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.770162+0000", 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8599000000000001e-05 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.770194+0000", 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2373999999999999e-05 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.975 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1460 3.31 3:8dd8a2fc:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_205:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:28.975 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.943343+0000", 2024-09-10T06:28:28.975 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.974815648, 2024-09-10T06:28:28.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017984032, 2024-09-10T06:28:28.975 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.975 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.975 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.975 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.975 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.975 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.975 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1460 2024-09-10T06:28:28.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.975 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.943343+0000", 2024-09-10T06:28:28.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.943343+0000", 2024-09-10T06:28:28.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.943346+0000", 2024-09-10T06:28:28.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5110000000000002e-06 2024-09-10T06:28:28.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.944607+0000", 2024-09-10T06:28:28.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0012608540000000001 2024-09-10T06:28:28.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.944638+0000", 2024-09-10T06:28:28.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1225e-05 2024-09-10T06:28:28.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.944654+0000", 2024-09-10T06:28:28.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5843999999999999e-05 2024-09-10T06:28:28.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.944752+0000", 2024-09-10T06:28:28.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8585999999999994e-05 2024-09-10T06:28:28.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.944925+0000", 2024-09-10T06:28:28.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000172955 2024-09-10T06:28:28.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:28.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.945086+0000", 2024-09-10T06:28:28.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016108100000000001 2024-09-10T06:28:28.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.951526+0000", 2024-09-10T06:28:28.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0064402019999999999 2024-09-10T06:28:28.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.961240+0000", 2024-09-10T06:28:28.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0097132850000000003 2024-09-10T06:28:28.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.961279+0000", 2024-09-10T06:28:28.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.909e-05 2024-09-10T06:28:28.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.980 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.980 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.961327+0000", 2024-09-10T06:28:28.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8399000000000002e-05 2024-09-10T06:28:28.980 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.980 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.980 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.981 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1464 3.32 e64/22 3:4ca2cc0f:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_209:head v 64'3, mlcod=63'1)", 2024-09-10T06:28:28.981 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.987339+0000", 2024-09-10T06:28:28.981 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.930820104999999, 2024-09-10T06:28:28.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018908297000000001, 2024-09-10T06:28:28.981 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.981 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.981 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.981 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.987339+0000", 2024-09-10T06:28:28.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.987339+0000", 2024-09-10T06:28:28.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.987341+0000", 2024-09-10T06:28:28.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2539999999999999e-06 2024-09-10T06:28:28.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.989736+0000", 2024-09-10T06:28:28.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002394855 2024-09-10T06:28:28.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.989760+0000", 2024-09-10T06:28:28.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4451999999999999e-05 2024-09-10T06:28:28.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.989772+0000", 2024-09-10T06:28:28.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2135e-05 2024-09-10T06:28:28.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.989885+0000", 2024-09-10T06:28:28.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011244299999999999 2024-09-10T06:28:28.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.989923+0000", 2024-09-10T06:28:28.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7704999999999999e-05 2024-09-10T06:28:28.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.006162+0000", 2024-09-10T06:28:28.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016239234000000002 2024-09-10T06:28:28.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.006247+0000", 2024-09-10T06:28:28.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5218999999999998e-05 2024-09-10T06:28:28.985 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.985 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.985 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.985 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1494 3.4 3:23f20a86:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:28.985 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:00.277430+0000", 2024-09-10T06:28:28.985 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 28.640729232999998, 2024-09-10T06:28:28.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01365971, 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1494 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.277430+0000", 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.277430+0000", 2024-09-10T06:28:28.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.277431+0000", 2024-09-10T06:28:28.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.624e-06 2024-09-10T06:28:28.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.279222+0000", 2024-09-10T06:28:28.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017903750000000001 2024-09-10T06:28:28.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.279238+0000", 2024-09-10T06:28:28.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6257999999999999e-05 2024-09-10T06:28:28.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.279251+0000", 2024-09-10T06:28:28.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3412e-05 2024-09-10T06:28:28.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.279314+0000", 2024-09-10T06:28:28.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2829000000000004e-05 2024-09-10T06:28:28.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.279490+0000", 2024-09-10T06:28:28.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017629899999999999 2024-09-10T06:28:28.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:28.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.279663+0000", 2024-09-10T06:28:28.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017234600000000001 2024-09-10T06:28:28.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.284740+0000", 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0050775270000000001 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.290960+0000", 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0062194579999999998 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.291032+0000", 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2784e-05 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.291089+0000", 2024-09-10T06:28:28.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6798000000000001e-05 2024-09-10T06:28:28.991 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.991 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.991 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.991 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1663 3.3f 3:fe7ceaa6:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:28.991 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:04.812639+0000", 2024-09-10T06:28:28.991 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.105520089999999, 2024-09-10T06:28:28.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016895633, 2024-09-10T06:28:28.991 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.991 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.992 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.992 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.992 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.992 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.992 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1663 2024-09-10T06:28:28.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.992 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.992 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.992 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.812639+0000", 2024-09-10T06:28:28.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.812639+0000", 2024-09-10T06:28:28.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.812641+0000", 2024-09-10T06:28:28.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0040000000000002e-06 2024-09-10T06:28:28.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.814776+0000", 2024-09-10T06:28:28.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021352340000000002 2024-09-10T06:28:28.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.814799+0000", 2024-09-10T06:28:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3249999999999999e-05 2024-09-10T06:28:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.814812+0000", 2024-09-10T06:28:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2649999999999999e-05 2024-09-10T06:28:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.814889+0000", 2024-09-10T06:28:28.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6884000000000005e-05 2024-09-10T06:28:28.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:28.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.815030+0000", 2024-09-10T06:28:28.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000141099 2024-09-10T06:28:28.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:28.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.815124+0000", 2024-09-10T06:28:28.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4415999999999999e-05 2024-09-10T06:28:28.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:28.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.821412+0000", 2024-09-10T06:28:28.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0062882199999999997 2024-09-10T06:28:28.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:28.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.829442+0000", 2024-09-10T06:28:28.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0080293259999999998 2024-09-10T06:28:28.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:28.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.829483+0000", 2024-09-10T06:28:28.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1482e-05 2024-09-10T06:28:28.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:28.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.829534+0000", 2024-09-10T06:28:28.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1068e-05 2024-09-10T06:28:28.997 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.997 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:28.997 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:28.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.997 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1670 3.31 3:8dfda815:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:28.997 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:04.886184+0000", 2024-09-10T06:28:28.997 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.031974543, 2024-09-10T06:28:28.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016799363000000001, 2024-09-10T06:28:28.997 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:28.997 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:28.998 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:28.998 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:28.998 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:28.998 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:28.998 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1670 2024-09-10T06:28:28.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.998 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:28.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:28.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.886184+0000", 2024-09-10T06:28:28.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:28.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.886184+0000", 2024-09-10T06:28:28.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:28.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:28.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.886189+0000", 2024-09-10T06:28:28.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.5920000000000002e-06 2024-09-10T06:28:28.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:28.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:28.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.888121+0000", 2024-09-10T06:28:28.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001931648 2024-09-10T06:28:28.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:28.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.888152+0000", 2024-09-10T06:28:29.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1544999999999997e-05 2024-09-10T06:28:29.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.888167+0000", 2024-09-10T06:28:29.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5146e-05 2024-09-10T06:28:29.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.888245+0000", 2024-09-10T06:28:29.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7620000000000006e-05 2024-09-10T06:28:29.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.888370+0000", 2024-09-10T06:28:29.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012497100000000001 2024-09-10T06:28:29.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:29.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.888479+0000", 2024-09-10T06:28:29.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108745 2024-09-10T06:28:29.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.897316+0000", 2024-09-10T06:28:29.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0088378880000000003 2024-09-10T06:28:29.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.902861+0000", 2024-09-10T06:28:29.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0055442679999999998 2024-09-10T06:28:29.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.902928+0000", 2024-09-10T06:28:29.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6952999999999994e-05 2024-09-10T06:28:29.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.003 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.902984+0000", 2024-09-10T06:28:29.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5986999999999998e-05 2024-09-10T06:28:29.003 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.003 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.003 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.003 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1680 3.8 e66/41 3:123b12e9:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_20:head v 66'7, mlcod=63'5)", 2024-09-10T06:28:29.003 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:05.004346+0000", 2024-09-10T06:28:29.003 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 23.913813158, 2024-09-10T06:28:29.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013545488, 2024-09-10T06:28:29.003 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.003 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.004 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.004 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.004346+0000", 2024-09-10T06:28:29.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.004346+0000", 2024-09-10T06:28:29.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.004348+0000", 2024-09-10T06:28:29.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7410000000000001e-06 2024-09-10T06:28:29.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.007664+0000", 2024-09-10T06:28:29.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0033154090000000001 2024-09-10T06:28:29.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.007686+0000", 2024-09-10T06:28:29.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2429000000000002e-05 2024-09-10T06:28:29.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.007699+0000", 2024-09-10T06:28:29.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2852e-05 2024-09-10T06:28:29.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.007781+0000", 2024-09-10T06:28:29.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1777e-05 2024-09-10T06:28:29.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.007809+0000", 2024-09-10T06:28:29.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8248000000000001e-05 2024-09-10T06:28:29.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.017827+0000", 2024-09-10T06:28:29.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010018338 2024-09-10T06:28:29.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.017891+0000", 2024-09-10T06:28:29.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3694000000000004e-05 2024-09-10T06:28:29.007 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.007 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.008 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.008 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1763 3.4 3:21f724d0:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:29.008 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.659347+0000", 2024-09-10T06:28:29.008 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.258811492, 2024-09-10T06:28:29.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.025962448999999999, 2024-09-10T06:28:29.008 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.008 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.008 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.008 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.008 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.008 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.008 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1763 2024-09-10T06:28:29.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.009 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.659347+0000", 2024-09-10T06:28:29.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.659347+0000", 2024-09-10T06:28:29.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.659350+0000", 2024-09-10T06:28:29.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1109999999999999e-06 2024-09-10T06:28:29.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.663741+0000", 2024-09-10T06:28:29.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0043902409999999996 2024-09-10T06:28:29.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.663788+0000", 2024-09-10T06:28:29.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7632000000000001e-05 2024-09-10T06:28:29.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.663812+0000", 2024-09-10T06:28:29.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3989999999999999e-05 2024-09-10T06:28:29.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.663975+0000", 2024-09-10T06:28:29.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016267500000000001 2024-09-10T06:28:29.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.664367+0000", 2024-09-10T06:28:29.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000391956 2024-09-10T06:28:29.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:29.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.664753+0000", 2024-09-10T06:28:29.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00038600199999999998 2024-09-10T06:28:29.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.683862+0000", 2024-09-10T06:28:29.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019109365999999999 2024-09-10T06:28:29.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.685176+0000", 2024-09-10T06:28:29.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013136879999999999 2024-09-10T06:28:29.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.685252+0000", 2024-09-10T06:28:29.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5795000000000002e-05 2024-09-10T06:28:29.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.685310+0000", 2024-09-10T06:28:29.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7992999999999999e-05 2024-09-10T06:28:29.013 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.014 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.014 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.014 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1766 3.19 3:98156cb2:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:29.014 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.704900+0000", 2024-09-10T06:28:29.014 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.213258639999999, 2024-09-10T06:28:29.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019321485999999999, 2024-09-10T06:28:29.014 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.014 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.014 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.014 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.014 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.015 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.015 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1766 2024-09-10T06:28:29.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.015 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.015 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.704900+0000", 2024-09-10T06:28:29.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.704900+0000", 2024-09-10T06:28:29.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.704905+0000", 2024-09-10T06:28:29.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8770000000000001e-06 2024-09-10T06:28:29.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.707557+0000", 2024-09-10T06:28:29.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026520710000000002 2024-09-10T06:28:29.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.707604+0000", 2024-09-10T06:28:29.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.7210999999999999e-05 2024-09-10T06:28:29.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.707623+0000", 2024-09-10T06:28:29.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.8822999999999999e-05 2024-09-10T06:28:29.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.707757+0000", 2024-09-10T06:28:29.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000133394 2024-09-10T06:28:29.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.708020+0000", 2024-09-10T06:28:29.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026306799999999998 2024-09-10T06:28:29.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:29.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.708263+0000", 2024-09-10T06:28:29.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00024347299999999999 2024-09-10T06:28:29.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.718064+0000", 2024-09-10T06:28:29.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0098008809999999991 2024-09-10T06:28:29.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.724085+0000", 2024-09-10T06:28:29.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0060214559999999997 2024-09-10T06:28:29.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.724162+0000", 2024-09-10T06:28:29.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6332e-05 2024-09-10T06:28:29.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.724222+0000", 2024-09-10T06:28:29.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9899999999999999e-05 2024-09-10T06:28:29.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.020 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.021 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1767 3.19 3:9ab57b9a:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:29.021 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.727082+0000", 2024-09-10T06:28:29.021 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.191076599000001, 2024-09-10T06:28:29.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017494734000000001, 2024-09-10T06:28:29.021 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.021 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.021 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.021 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1767 2024-09-10T06:28:29.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.022 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.727082+0000", 2024-09-10T06:28:29.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.727082+0000", 2024-09-10T06:28:29.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.727086+0000", 2024-09-10T06:28:29.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5829999999999998e-06 2024-09-10T06:28:29.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.729759+0000", 2024-09-10T06:28:29.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0026729810000000001 2024-09-10T06:28:29.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.729801+0000", 2024-09-10T06:28:29.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2104000000000002e-05 2024-09-10T06:28:29.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.729827+0000", 2024-09-10T06:28:29.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6239000000000001e-05 2024-09-10T06:28:29.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.729994+0000", 2024-09-10T06:28:29.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000166763 2024-09-10T06:28:29.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.730348+0000", 2024-09-10T06:28:29.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00035460400000000001 2024-09-10T06:28:29.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:29.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.730618+0000", 2024-09-10T06:28:29.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000269125 2024-09-10T06:28:29.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.743712+0000", 2024-09-10T06:28:29.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013094854 2024-09-10T06:28:29.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.744449+0000", 2024-09-10T06:28:29.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00073658800000000004 2024-09-10T06:28:29.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.744519+0000", 2024-09-10T06:28:29.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9941e-05 2024-09-10T06:28:29.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.744577+0000", 2024-09-10T06:28:29.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7951999999999997e-05 2024-09-10T06:28:29.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.027 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.027 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.027 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1773 3.36 e72/65 3:6dd9d777:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_20:head v 72'5, mlcod=63'3)", 2024-09-10T06:28:29.027 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.858595+0000", 2024-09-10T06:28:29.027 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.0595637, 2024-09-10T06:28:29.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014792962999999999, 2024-09-10T06:28:29.027 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.027 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.027 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.027 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.858595+0000", 2024-09-10T06:28:29.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.858595+0000", 2024-09-10T06:28:29.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.858598+0000", 2024-09-10T06:28:29.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3859999999999999e-06 2024-09-10T06:28:29.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.863613+0000", 2024-09-10T06:28:29.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0050140059999999997 2024-09-10T06:28:29.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.863654+0000", 2024-09-10T06:28:29.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1115000000000002e-05 2024-09-10T06:28:29.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.863672+0000", 2024-09-10T06:28:29.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7972999999999999e-05 2024-09-10T06:28:29.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.863815+0000", 2024-09-10T06:28:29.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014308999999999999 2024-09-10T06:28:29.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.863854+0000", 2024-09-10T06:28:29.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9235e-05 2024-09-10T06:28:29.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.873331+0000", 2024-09-10T06:28:29.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0094775429999999997 2024-09-10T06:28:29.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.873388+0000", 2024-09-10T06:28:29.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6614999999999999e-05 2024-09-10T06:28:29.031 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.031 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.031 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.031 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1782 3.19 3:9ac8ef78:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:29.031 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:15.014673+0000", 2024-09-10T06:28:29.031 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 13.903486024999999, 2024-09-10T06:28:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.023115772999999999, 2024-09-10T06:28:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1782 2024-09-10T06:28:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.014673+0000", 2024-09-10T06:28:29.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.014673+0000", 2024-09-10T06:28:29.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.014676+0000", 2024-09-10T06:28:29.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0319999999999999e-06 2024-09-10T06:28:29.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.017508+0000", 2024-09-10T06:28:29.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002831863 2024-09-10T06:28:29.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.017536+0000", 2024-09-10T06:28:29.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8337999999999999e-05 2024-09-10T06:28:29.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.017546+0000", 2024-09-10T06:28:29.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0312999999999999e-05 2024-09-10T06:28:29.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.017630+0000", 2024-09-10T06:28:29.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3750000000000003e-05 2024-09-10T06:28:29.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.017818+0000", 2024-09-10T06:28:29.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000187985 2024-09-10T06:28:29.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:29.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.017983+0000", 2024-09-10T06:28:29.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016540200000000001 2024-09-10T06:28:29.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.030986+0000", 2024-09-10T06:28:29.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013002843 2024-09-10T06:28:29.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.037666+0000", 2024-09-10T06:28:29.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066799709999999998 2024-09-10T06:28:29.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.037735+0000", 2024-09-10T06:28:29.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8563000000000001e-05 2024-09-10T06:28:29.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.037 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.037789+0000", 2024-09-10T06:28:29.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3712999999999999e-05 2024-09-10T06:28:29.037 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.037 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.037 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.037 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.037 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.037 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:29.039 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T06:28:29.166 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:29.166 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:28:29.166 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:28:29.166 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:29.180 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T06:28:29.298 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:29.298 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:28:29.298 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:28:29.298 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:28:29.298 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:29.312 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T06:28:29.432 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:29.433 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:28:29.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:28:29.433 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:28:29.433 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.433 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1347 3.2e 3:75a3a1ca:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_102:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.433 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.843860+0000", 2024-09-10T06:28:29.433 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.585380241999999, 2024-09-10T06:28:29.433 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024698649, 2024-09-10T06:28:29.433 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.433 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.433 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1347 2024-09-10T06:28:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.843860+0000", 2024-09-10T06:28:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.434 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.843860+0000", 2024-09-10T06:28:29.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.843862+0000", 2024-09-10T06:28:29.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.835e-06 2024-09-10T06:28:29.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.435 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.845513+0000", 2024-09-10T06:28:29.435 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001650639 2024-09-10T06:28:29.435 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.435 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.435 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.845549+0000", 2024-09-10T06:28:29.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6007000000000003e-05 2024-09-10T06:28:29.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.845565+0000", 2024-09-10T06:28:29.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6138e-05 2024-09-10T06:28:29.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.436 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.436 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.845661+0000", 2024-09-10T06:28:29.436 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5377999999999994e-05 2024-09-10T06:28:29.436 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.436 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.845833+0000", 2024-09-10T06:28:29.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017233 2024-09-10T06:28:29.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:29.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.846000+0000", 2024-09-10T06:28:29.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000167508 2024-09-10T06:28:29.437 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.437 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.437 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.437 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.854574+0000", 2024-09-10T06:28:29.437 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0085735240000000008 2024-09-10T06:28:29.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.868413+0000", 2024-09-10T06:28:29.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013838891000000001 2024-09-10T06:28:29.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.438 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.868489+0000", 2024-09-10T06:28:29.438 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.5841999999999997e-05 2024-09-10T06:28:29.438 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.438 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.438 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.439 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.868558+0000", 2024-09-10T06:28:29.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9556999999999998e-05 2024-09-10T06:28:29.439 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.439 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.439 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.439 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.439 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.439 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1351 3.1d 3:b8f5f32e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_106:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.439 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.888252+0000", 2024-09-10T06:28:29.439 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.540988289000001, 2024-09-10T06:28:29.439 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018796976999999999, 2024-09-10T06:28:29.439 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.439 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.439 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.440 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.440 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.440 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.440 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1351 2024-09-10T06:28:29.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.440 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.888252+0000", 2024-09-10T06:28:29.440 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.440 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.440 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.440 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.440 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.888252+0000", 2024-09-10T06:28:29.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.888255+0000", 2024-09-10T06:28:29.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.7419999999999999e-06 2024-09-10T06:28:29.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.441 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.889650+0000", 2024-09-10T06:28:29.441 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013942220000000001 2024-09-10T06:28:29.441 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.441 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.441 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.889680+0000", 2024-09-10T06:28:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0389999999999999e-05 2024-09-10T06:28:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.889694+0000", 2024-09-10T06:28:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4293e-05 2024-09-10T06:28:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.889780+0000", 2024-09-10T06:28:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5427999999999996e-05 2024-09-10T06:28:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.442 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.889896+0000", 2024-09-10T06:28:29.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011675099999999999 2024-09-10T06:28:29.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:29.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.890009+0000", 2024-09-10T06:28:29.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011252300000000001 2024-09-10T06:28:29.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.443 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.443 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.443 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.897320+0000", 2024-09-10T06:28:29.443 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073107010000000002 2024-09-10T06:28:29.443 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.906918+0000", 2024-09-10T06:28:29.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0095979770000000006 2024-09-10T06:28:29.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.906991+0000", 2024-09-10T06:28:29.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3728999999999998e-05 2024-09-10T06:28:29.444 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.444 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.444 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.444 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.907049+0000", 2024-09-10T06:28:29.444 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7221e-05 2024-09-10T06:28:29.445 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.445 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.445 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.445 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.445 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.445 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1365 3.2a 3:56a303a3:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_120:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.445 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.045578+0000", 2024-09-10T06:28:29.445 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.383661758999999, 2024-09-10T06:28:29.445 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016400039000000002, 2024-09-10T06:28:29.445 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.445 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.445 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.445 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1365 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.045578+0000", 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.045578+0000", 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.446 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.045582+0000", 2024-09-10T06:28:29.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6830000000000001e-06 2024-09-10T06:28:29.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.047565+0000", 2024-09-10T06:28:29.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0019831089999999998 2024-09-10T06:28:29.447 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.447 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.447 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.447 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.047597+0000", 2024-09-10T06:28:29.447 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1783999999999999e-05 2024-09-10T06:28:29.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.047612+0000", 2024-09-10T06:28:29.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5815e-05 2024-09-10T06:28:29.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.448 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.047706+0000", 2024-09-10T06:28:29.448 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3888999999999995e-05 2024-09-10T06:28:29.448 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.448 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.448 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.047818+0000", 2024-09-10T06:28:29.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011157 2024-09-10T06:28:29.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:29.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.047916+0000", 2024-09-10T06:28:29.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8418999999999994e-05 2024-09-10T06:28:29.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.449 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.449 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.053862+0000", 2024-09-10T06:28:29.449 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0059458740000000003 2024-09-10T06:28:29.449 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.449 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.061855+0000", 2024-09-10T06:28:29.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0079930149999999991 2024-09-10T06:28:29.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.061920+0000", 2024-09-10T06:28:29.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5145000000000001e-05 2024-09-10T06:28:29.450 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.450 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.450 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.450 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.061978+0000", 2024-09-10T06:28:29.450 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7735999999999997e-05 2024-09-10T06:28:29.450 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.451 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.451 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.451 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.451 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.451 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1371 3.2e 3:741ddced:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_126:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.451 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.121782+0000", 2024-09-10T06:28:29.451 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.307457487000001, 2024-09-10T06:28:29.451 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026983055999999998, 2024-09-10T06:28:29.451 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.451 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.451 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.451 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.451 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1371 2024-09-10T06:28:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.121782+0000", 2024-09-10T06:28:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.121782+0000", 2024-09-10T06:28:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.452 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.121786+0000", 2024-09-10T06:28:29.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5370000000000002e-06 2024-09-10T06:28:29.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.123359+0000", 2024-09-10T06:28:29.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015730869999999999 2024-09-10T06:28:29.453 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.453 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.453 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.453 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.123387+0000", 2024-09-10T06:28:29.453 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8274999999999999e-05 2024-09-10T06:28:29.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.123401+0000", 2024-09-10T06:28:29.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.417e-05 2024-09-10T06:28:29.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.123483+0000", 2024-09-10T06:28:29.454 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1265000000000002e-05 2024-09-10T06:28:29.454 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.454 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.454 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.454 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.123661+0000", 2024-09-10T06:28:29.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000178359 2024-09-10T06:28:29.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:29.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.123823+0000", 2024-09-10T06:28:29.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016233600000000001 2024-09-10T06:28:29.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.455 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.129517+0000", 2024-09-10T06:28:29.455 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0056934300000000002 2024-09-10T06:28:29.455 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.455 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.455 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.148687+0000", 2024-09-10T06:28:29.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019170445000000001 2024-09-10T06:28:29.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.148729+0000", 2024-09-10T06:28:29.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1652e-05 2024-09-10T06:28:29.456 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.456 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.456 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.456 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.148765+0000", 2024-09-10T06:28:29.456 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.65e-05 2024-09-10T06:28:29.456 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.457 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.457 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.457 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.457 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.457 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1382 3.8 3:120ffce8:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.457 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.231236+0000", 2024-09-10T06:28:29.457 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.19800356, 2024-09-10T06:28:29.457 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01386484, 2024-09-10T06:28:29.457 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.457 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.457 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.457 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.457 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.457 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1382 2024-09-10T06:28:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.231236+0000", 2024-09-10T06:28:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.231236+0000", 2024-09-10T06:28:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.458 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.231239+0000", 2024-09-10T06:28:29.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9249999999999999e-06 2024-09-10T06:28:29.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.232956+0000", 2024-09-10T06:28:29.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017163879999999999 2024-09-10T06:28:29.459 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.459 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.459 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.459 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.232979+0000", 2024-09-10T06:28:29.459 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2968000000000001e-05 2024-09-10T06:28:29.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.232992+0000", 2024-09-10T06:28:29.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.342e-05 2024-09-10T06:28:29.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.460 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.233080+0000", 2024-09-10T06:28:29.460 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.8486000000000006e-05 2024-09-10T06:28:29.460 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.460 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.460 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.233267+0000", 2024-09-10T06:28:29.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000186393 2024-09-10T06:28:29.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:29.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.233447+0000", 2024-09-10T06:28:29.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000180423 2024-09-10T06:28:29.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.461 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.461 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.244690+0000", 2024-09-10T06:28:29.461 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011243087000000001 2024-09-10T06:28:29.461 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.461 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.244992+0000", 2024-09-10T06:28:29.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000301417 2024-09-10T06:28:29.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.245054+0000", 2024-09-10T06:28:29.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2359000000000004e-05 2024-09-10T06:28:29.462 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.462 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.462 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.462 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.245101+0000", 2024-09-10T06:28:29.462 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.6974000000000001e-05 2024-09-10T06:28:29.463 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.463 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.463 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.463 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.463 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.463 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1388 3.21 3:8602187c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.463 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.290789+0000", 2024-09-10T06:28:29.463 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.138451003, 2024-09-10T06:28:29.464 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018219921, 2024-09-10T06:28:29.464 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.464 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.464 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.464 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.464 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.464 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.464 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1388 2024-09-10T06:28:29.464 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.464 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.464 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.464 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.290789+0000", 2024-09-10T06:28:29.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.290789+0000", 2024-09-10T06:28:29.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.465 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.465 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.290792+0000", 2024-09-10T06:28:29.465 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5700000000000001e-06 2024-09-10T06:28:29.465 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.465 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.292388+0000", 2024-09-10T06:28:29.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0015951419999999999 2024-09-10T06:28:29.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.292411+0000", 2024-09-10T06:28:29.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3810000000000001e-05 2024-09-10T06:28:29.466 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.466 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.466 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.466 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.292422+0000", 2024-09-10T06:28:29.466 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0326000000000001e-05 2024-09-10T06:28:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.292504+0000", 2024-09-10T06:28:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.2133999999999997e-05 2024-09-10T06:28:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.292701+0000", 2024-09-10T06:28:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019686000000000001 2024-09-10T06:28:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:29.467 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.292877+0000", 2024-09-10T06:28:29.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017616299999999999 2024-09-10T06:28:29.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.300035+0000", 2024-09-10T06:28:29.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071579069999999998 2024-09-10T06:28:29.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.468 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.308912+0000", 2024-09-10T06:28:29.468 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0088774530000000004 2024-09-10T06:28:29.468 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.468 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.468 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.308955+0000", 2024-09-10T06:28:29.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2661999999999999e-05 2024-09-10T06:28:29.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.469 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.469 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.309009+0000", 2024-09-10T06:28:29.469 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.3894000000000003e-05 2024-09-10T06:28:29.469 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.469 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.469 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.469 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.469 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.469 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1393 3.8 3:133d3b46:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_148:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.469 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.340298+0000", 2024-09-10T06:28:29.470 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.088942116999998, 2024-09-10T06:28:29.470 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014057366999999999, 2024-09-10T06:28:29.470 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.470 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.470 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.470 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.470 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.470 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.470 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1393 2024-09-10T06:28:29.470 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.470 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.470 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.470 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.470 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.340298+0000", 2024-09-10T06:28:29.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.340298+0000", 2024-09-10T06:28:29.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.471 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.340301+0000", 2024-09-10T06:28:29.471 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3179999999999998e-06 2024-09-10T06:28:29.471 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.471 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.471 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.342680+0000", 2024-09-10T06:28:29.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023788450000000001 2024-09-10T06:28:29.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.342709+0000", 2024-09-10T06:28:29.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9091e-05 2024-09-10T06:28:29.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.472 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.472 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.472 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.342723+0000", 2024-09-10T06:28:29.472 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3926e-05 2024-09-10T06:28:29.472 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.342812+0000", 2024-09-10T06:28:29.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9559000000000001e-05 2024-09-10T06:28:29.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.342994+0000", 2024-09-10T06:28:29.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000181227 2024-09-10T06:28:29.473 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.473 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.473 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:29.473 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.343158+0000", 2024-09-10T06:28:29.473 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000164535 2024-09-10T06:28:29.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.353829+0000", 2024-09-10T06:28:29.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010670951999999999 2024-09-10T06:28:29.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.354223+0000", 2024-09-10T06:28:29.474 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000394204 2024-09-10T06:28:29.474 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.474 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.474 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.474 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.354290+0000", 2024-09-10T06:28:29.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6301000000000001e-05 2024-09-10T06:28:29.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.475 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.475 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.354355+0000", 2024-09-10T06:28:29.475 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5408999999999997e-05 2024-09-10T06:28:29.475 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.475 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.475 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.475 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.475 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.475 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1426 3.2d e63/22 3:b764a1d5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_171:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:29.475 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.570490+0000", 2024-09-10T06:28:29.475 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.858750128000001, 2024-09-10T06:28:29.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022457779000000001, 2024-09-10T06:28:29.476 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.476 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.476 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.476 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.570490+0000", 2024-09-10T06:28:29.476 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.476 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.476 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.476 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.476 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.570490+0000", 2024-09-10T06:28:29.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.570491+0000", 2024-09-10T06:28:29.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6789999999999999e-06 2024-09-10T06:28:29.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.477 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.574937+0000", 2024-09-10T06:28:29.477 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0044455650000000003 2024-09-10T06:28:29.477 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.477 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.477 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.574966+0000", 2024-09-10T06:28:29.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8571000000000001e-05 2024-09-10T06:28:29.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.574978+0000", 2024-09-10T06:28:29.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2893e-05 2024-09-10T06:28:29.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.478 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.478 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.575064+0000", 2024-09-10T06:28:29.478 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.5977999999999996e-05 2024-09-10T06:28:29.478 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.478 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.575093+0000", 2024-09-10T06:28:29.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8529000000000001e-05 2024-09-10T06:28:29.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.592886+0000", 2024-09-10T06:28:29.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017793320000000001 2024-09-10T06:28:29.479 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.479 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.479 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.479 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.592948+0000", 2024-09-10T06:28:29.479 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1243999999999998e-05 2024-09-10T06:28:29.479 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.480 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.480 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.480 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.480 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1435 3.2d e64/22 3:b4574439:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_180:head v 64'4, mlcod=63'2)", 2024-09-10T06:28:29.480 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.674206+0000", 2024-09-10T06:28:29.480 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.755034112000001, 2024-09-10T06:28:29.480 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013130650000000001, 2024-09-10T06:28:29.480 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.480 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.480 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.480 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.480 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.674206+0000", 2024-09-10T06:28:29.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.674206+0000", 2024-09-10T06:28:29.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.481 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.481 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.481 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.674206+0000", 2024-09-10T06:28:29.481 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0100000000000001e-07 2024-09-10T06:28:29.481 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.679960+0000", 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00575407 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.679977+0000", 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6988999999999999e-05 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.679986+0000", 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9050000000000003e-06 2024-09-10T06:28:29.482 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.680048+0000", 2024-09-10T06:28:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2131000000000005e-05 2024-09-10T06:28:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.680067+0000", 2024-09-10T06:28:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9143999999999998e-05 2024-09-10T06:28:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.687263+0000", 2024-09-10T06:28:29.483 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071955589999999998 2024-09-10T06:28:29.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.484 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.484 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.687336+0000", 2024-09-10T06:28:29.484 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3551000000000001e-05 2024-09-10T06:28:29.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.484 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.484 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.484 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.484 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.484 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1485 3.2e 3:753fe2a7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:29.484 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:00.187398+0000", 2024-09-10T06:28:29.484 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.241842038000001, 2024-09-10T06:28:29.485 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015948928000000001, 2024-09-10T06:28:29.485 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.485 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.485 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.485 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.485 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.485 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.485 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1485 2024-09-10T06:28:29.485 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.485 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.485 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.485 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.485 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.187398+0000", 2024-09-10T06:28:29.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.187398+0000", 2024-09-10T06:28:29.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.486 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.187401+0000", 2024-09-10T06:28:29.486 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9009999999999998e-06 2024-09-10T06:28:29.486 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.486 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.486 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.189074+0000", 2024-09-10T06:28:29.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016731789999999999 2024-09-10T06:28:29.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.189107+0000", 2024-09-10T06:28:29.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2892999999999998e-05 2024-09-10T06:28:29.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.487 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.487 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.189122+0000", 2024-09-10T06:28:29.487 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4858000000000001e-05 2024-09-10T06:28:29.487 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.487 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.189212+0000", 2024-09-10T06:28:29.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.0753000000000003e-05 2024-09-10T06:28:29.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.189353+0000", 2024-09-10T06:28:29.488 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000140963 2024-09-10T06:28:29.488 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.488 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.488 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:29.488 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.189454+0000", 2024-09-10T06:28:29.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100554 2024-09-10T06:28:29.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.196597+0000", 2024-09-10T06:28:29.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0071428230000000004 2024-09-10T06:28:29.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.489 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.489 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.489 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.203231+0000", 2024-09-10T06:28:29.489 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066339509999999999 2024-09-10T06:28:29.489 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.203294+0000", 2024-09-10T06:28:29.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3534000000000005e-05 2024-09-10T06:28:29.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.490 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.490 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.203347+0000", 2024-09-10T06:28:29.490 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2519000000000003e-05 2024-09-10T06:28:29.490 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.490 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.490 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.490 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.490 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.491 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1491 3.2e 3:777f7d52:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_236:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:29.491 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:00.246366+0000", 2024-09-10T06:28:29.491 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.182873916999998, 2024-09-10T06:28:29.491 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015042414, 2024-09-10T06:28:29.491 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.491 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.491 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.491 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.491 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.491 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.491 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1491 2024-09-10T06:28:29.491 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.491 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.491 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.246366+0000", 2024-09-10T06:28:29.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.246366+0000", 2024-09-10T06:28:29.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.492 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.492 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.492 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.246369+0000", 2024-09-10T06:28:29.492 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3680000000000002e-06 2024-09-10T06:28:29.492 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.247845+0000", 2024-09-10T06:28:29.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014757240000000001 2024-09-10T06:28:29.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.247867+0000", 2024-09-10T06:28:29.493 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2172e-05 2024-09-10T06:28:29.493 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.493 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.493 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.493 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.247880+0000", 2024-09-10T06:28:29.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.2697999999999999e-05 2024-09-10T06:28:29.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.247952+0000", 2024-09-10T06:28:29.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2321000000000001e-05 2024-09-10T06:28:29.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.494 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.248096+0000", 2024-09-10T06:28:29.494 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000144129 2024-09-10T06:28:29.494 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.494 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.494 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:29.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.248204+0000", 2024-09-10T06:28:29.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010783800000000001 2024-09-10T06:28:29.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.256043+0000", 2024-09-10T06:28:29.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0078390430000000004 2024-09-10T06:28:29.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.495 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.495 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.261282+0000", 2024-09-10T06:28:29.495 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0052392410000000004 2024-09-10T06:28:29.495 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.495 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.261356+0000", 2024-09-10T06:28:29.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3528000000000005e-05 2024-09-10T06:28:29.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.496 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.496 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.261408+0000", 2024-09-10T06:28:29.496 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2352000000000003e-05 2024-09-10T06:28:29.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.496 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.496 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.496 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.496 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.497 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1497 3.2a 3:5768add4:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_242:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:29.497 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:00.307829+0000", 2024-09-10T06:28:29.497 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 29.121410692000001, 2024-09-10T06:28:29.497 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015727718000000002, 2024-09-10T06:28:29.497 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.497 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.497 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.497 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.497 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1497 2024-09-10T06:28:29.497 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.497 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.497 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.307829+0000", 2024-09-10T06:28:29.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.307829+0000", 2024-09-10T06:28:29.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.498 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.498 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.498 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.498 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.307832+0000", 2024-09-10T06:28:29.498 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8030000000000001e-06 2024-09-10T06:28:29.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.310011+0000", 2024-09-10T06:28:29.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021787460000000001 2024-09-10T06:28:29.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.499 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.310040+0000", 2024-09-10T06:28:29.499 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9315999999999998e-05 2024-09-10T06:28:29.499 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.499 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.499 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.310056+0000", 2024-09-10T06:28:29.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6079999999999999e-05 2024-09-10T06:28:29.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.310145+0000", 2024-09-10T06:28:29.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.9035000000000004e-05 2024-09-10T06:28:29.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.500 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.500 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.310295+0000", 2024-09-10T06:28:29.500 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014964899999999999 2024-09-10T06:28:29.500 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.500 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:29.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.310419+0000", 2024-09-10T06:28:29.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000123843 2024-09-10T06:28:29.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.317688+0000", 2024-09-10T06:28:29.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072695650000000004 2024-09-10T06:28:29.501 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.501 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.501 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.501 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.323417+0000", 2024-09-10T06:28:29.501 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0057285180000000002 2024-09-10T06:28:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.323494+0000", 2024-09-10T06:28:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.7409000000000004e-05 2024-09-10T06:28:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:00.323557+0000", 2024-09-10T06:28:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2754000000000003e-05 2024-09-10T06:28:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.502 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.503 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1661 3.3d e66/22 3:bc9aff3a:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_1:head v 66'8, mlcod=64'6)", 2024-09-10T06:28:29.503 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:04.795814+0000", 2024-09-10T06:28:29.503 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.6334263, 2024-09-10T06:28:29.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016227867999999999, 2024-09-10T06:28:29.503 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.503 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.503 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.503 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.503 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.503 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.503 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795814+0000", 2024-09-10T06:28:29.503 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795814+0000", 2024-09-10T06:28:29.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.795817+0000", 2024-09-10T06:28:29.504 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9859999999999999e-06 2024-09-10T06:28:29.504 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.504 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.504 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.504 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.798060+0000", 2024-09-10T06:28:29.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022438480000000001 2024-09-10T06:28:29.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.505 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.505 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.798090+0000", 2024-09-10T06:28:29.505 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9600000000000001e-05 2024-09-10T06:28:29.505 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.505 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.798104+0000", 2024-09-10T06:28:29.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.429e-05 2024-09-10T06:28:29.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.798181+0000", 2024-09-10T06:28:29.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.6255999999999996e-05 2024-09-10T06:28:29.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.506 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.506 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.506 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.798208+0000", 2024-09-10T06:28:29.506 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7236000000000001e-05 2024-09-10T06:28:29.506 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.811986+0000", 2024-09-10T06:28:29.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013777912 2024-09-10T06:28:29.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.507 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.507 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.507 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.812041+0000", 2024-09-10T06:28:29.507 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.5739999999999998e-05 2024-09-10T06:28:29.507 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.507 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.507 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.507 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.508 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1669 3.2d e66/22 3:b72c6e58:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_9:head v 66'6, mlcod=64'4)", 2024-09-10T06:28:29.508 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:04.880233+0000", 2024-09-10T06:28:29.508 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.549007039999999, 2024-09-10T06:28:29.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014676704, 2024-09-10T06:28:29.508 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.508 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.508 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.508 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.508 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.508 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.508 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.880233+0000", 2024-09-10T06:28:29.508 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.508 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.880233+0000", 2024-09-10T06:28:29.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.880235+0000", 2024-09-10T06:28:29.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.894e-06 2024-09-10T06:28:29.509 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.509 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.509 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.509 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.885630+0000", 2024-09-10T06:28:29.509 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.005395642 2024-09-10T06:28:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.885653+0000", 2024-09-10T06:28:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2427999999999999e-05 2024-09-10T06:28:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.885663+0000", 2024-09-10T06:28:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.9170000000000001e-06 2024-09-10T06:28:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.510 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.885756+0000", 2024-09-10T06:28:29.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.3030999999999997e-05 2024-09-10T06:28:29.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.885787+0000", 2024-09-10T06:28:29.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1254000000000003e-05 2024-09-10T06:28:29.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.511 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.894839+0000", 2024-09-10T06:28:29.511 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0090523770000000003 2024-09-10T06:28:29.511 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.511 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.511 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:04.894910+0000", 2024-09-10T06:28:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0160999999999995e-05 2024-09-10T06:28:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1680 3.8 3:123b12e9:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:05.001598+0000", 2024-09-10T06:28:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.427642335000002, 2024-09-10T06:28:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016920372999999999, 2024-09-10T06:28:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.512 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.513 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.513 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1680 2024-09-10T06:28:29.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.513 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.513 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.513 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.001598+0000", 2024-09-10T06:28:29.513 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.513 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.513 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.001598+0000", 2024-09-10T06:28:29.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.001601+0000", 2024-09-10T06:28:29.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3799999999999998e-06 2024-09-10T06:28:29.514 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.514 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.514 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.514 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.003758+0000", 2024-09-10T06:28:29.514 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0021566469999999998 2024-09-10T06:28:29.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.003783+0000", 2024-09-10T06:28:29.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5712e-05 2024-09-10T06:28:29.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.515 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.003799+0000", 2024-09-10T06:28:29.515 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6113999999999999e-05 2024-09-10T06:28:29.515 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.515 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.515 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.003916+0000", 2024-09-10T06:28:29.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011691799999999999 2024-09-10T06:28:29.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.004089+0000", 2024-09-10T06:28:29.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000172506 2024-09-10T06:28:29.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.516 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.516 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:29.516 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.004232+0000", 2024-09-10T06:28:29.516 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000142769 2024-09-10T06:28:29.516 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.014114+0000", 2024-09-10T06:28:29.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0098827470000000008 2024-09-10T06:28:29.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.018249+0000", 2024-09-10T06:28:29.517 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0041348440000000004 2024-09-10T06:28:29.517 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.517 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.517 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.517 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.018390+0000", 2024-09-10T06:28:29.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014072299999999999 2024-09-10T06:28:29.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.518 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.518 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.018518+0000", 2024-09-10T06:28:29.518 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012801300000000001 2024-09-10T06:28:29.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.518 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.518 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.518 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.518 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.518 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1754 3.3b e72/69 3:ded70450:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_1:head v 72'5, mlcod=0'0)", 2024-09-10T06:28:29.518 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.487729+0000", 2024-09-10T06:28:29.518 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.941511359, 2024-09-10T06:28:29.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.024952223999999999, 2024-09-10T06:28:29.519 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.519 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.519 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.519 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.487729+0000", 2024-09-10T06:28:29.519 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.519 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.519 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.519 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.519 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.487729+0000", 2024-09-10T06:28:29.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.487729+0000", 2024-09-10T06:28:29.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.33e-07 2024-09-10T06:28:29.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.520 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.520 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.498788+0000", 2024-09-10T06:28:29.520 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011058632000000001 2024-09-10T06:28:29.520 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.520 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.498831+0000", 2024-09-10T06:28:29.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2678e-05 2024-09-10T06:28:29.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.498858+0000", 2024-09-10T06:28:29.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7229e-05 2024-09-10T06:28:29.521 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.521 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.521 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.521 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.499030+0000", 2024-09-10T06:28:29.521 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017227200000000001 2024-09-10T06:28:29.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.499093+0000", 2024-09-10T06:28:29.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2990000000000005e-05 2024-09-10T06:28:29.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.522 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.512553+0000", 2024-09-10T06:28:29.522 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013459572 2024-09-10T06:28:29.522 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.522 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.522 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.523 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.512681+0000", 2024-09-10T06:28:29.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000127918 2024-09-10T06:28:29.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.523 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.523 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.523 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.523 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.523 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1762 3.2e 3:74a5876a:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:29.523 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.637520+0000", 2024-09-10T06:28:29.523 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.791720175, 2024-09-10T06:28:29.523 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017068719999999999, 2024-09-10T06:28:29.523 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.523 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.523 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.524 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.524 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1762 2024-09-10T06:28:29.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.524 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.524 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.637520+0000", 2024-09-10T06:28:29.524 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.524 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.524 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.524 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.637520+0000", 2024-09-10T06:28:29.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.637523+0000", 2024-09-10T06:28:29.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4029999999999999e-06 2024-09-10T06:28:29.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.525 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.525 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.640400+0000", 2024-09-10T06:28:29.525 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0028766120000000002 2024-09-10T06:28:29.525 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.525 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.640440+0000", 2024-09-10T06:28:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.0142000000000003e-05 2024-09-10T06:28:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.640462+0000", 2024-09-10T06:28:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1679e-05 2024-09-10T06:28:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.640593+0000", 2024-09-10T06:28:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131507 2024-09-10T06:28:29.526 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.640843+0000", 2024-09-10T06:28:29.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00025006200000000001 2024-09-10T06:28:29.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:29.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.641065+0000", 2024-09-10T06:28:29.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00022184700000000001 2024-09-10T06:28:29.527 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.527 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.527 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.527 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.652438+0000", 2024-09-10T06:28:29.527 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011372634 2024-09-10T06:28:29.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.654150+0000", 2024-09-10T06:28:29.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017127080000000001 2024-09-10T06:28:29.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.528 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.654322+0000", 2024-09-10T06:28:29.528 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017212799999999999 2024-09-10T06:28:29.528 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.528 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.528 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.529 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.654588+0000", 2024-09-10T06:28:29.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00026599799999999998 2024-09-10T06:28:29.529 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.529 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.529 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.529 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.529 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.529 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1763 3.4 e72/22 3:21f724d0:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_10:head v 72'6, mlcod=64'4)", 2024-09-10T06:28:29.529 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.664945+0000", 2024-09-10T06:28:29.529 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.764294703999999, 2024-09-10T06:28:29.529 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019922149, 2024-09-10T06:28:29.529 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.529 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.530 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.530 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.664945+0000", 2024-09-10T06:28:29.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.530 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.530 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.664945+0000", 2024-09-10T06:28:29.530 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.530 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.530 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.664948+0000", 2024-09-10T06:28:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7930000000000002e-06 2024-09-10T06:28:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.667597+0000", 2024-09-10T06:28:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.002649191 2024-09-10T06:28:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.667632+0000", 2024-09-10T06:28:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5210999999999999e-05 2024-09-10T06:28:29.531 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.667649+0000", 2024-09-10T06:28:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6966e-05 2024-09-10T06:28:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.667800+0000", 2024-09-10T06:28:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015055099999999999 2024-09-10T06:28:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.667851+0000", 2024-09-10T06:28:29.532 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1087000000000001e-05 2024-09-10T06:28:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.684722+0000", 2024-09-10T06:28:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.016870679 2024-09-10T06:28:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.684867+0000", 2024-09-10T06:28:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014567099999999999 2024-09-10T06:28:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.533 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1770 3.22 3:470f2217:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.794285+0000", 2024-09-10T06:28:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.634954792, 2024-09-10T06:28:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017895583, 2024-09-10T06:28:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1770 2024-09-10T06:28:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.534 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.794285+0000", 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.794285+0000", 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.794288+0000", 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.3890000000000001e-06 2024-09-10T06:28:29.535 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.796785+0000", 2024-09-10T06:28:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0024965759999999999 2024-09-10T06:28:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.796829+0000", 2024-09-10T06:28:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.4155e-05 2024-09-10T06:28:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.536 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.796850+0000", 2024-09-10T06:28:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.0594999999999998e-05 2024-09-10T06:28:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.796988+0000", 2024-09-10T06:28:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000138317 2024-09-10T06:28:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.797264+0000", 2024-09-10T06:28:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027561799999999999 2024-09-10T06:28:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.537 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.797580+0000", 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031587899999999998 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.811170+0000", 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013590876 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.811869+0000", 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00069860500000000004 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.538 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.812048+0000", 2024-09-10T06:28:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017905899999999999 2024-09-10T06:28:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.812181+0000", 2024-09-10T06:28:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000132514 2024-09-10T06:28:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1778 3.22 3:477c89af:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:29.539 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.945928+0000", 2024-09-10T06:28:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.483311643, 2024-09-10T06:28:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017342939000000002, 2024-09-10T06:28:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1778 2024-09-10T06:28:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.540 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.945928+0000", 2024-09-10T06:28:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.945928+0000", 2024-09-10T06:28:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.945933+0000", 2024-09-10T06:28:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.3030000000000001e-06 2024-09-10T06:28:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.541 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.948169+0000", 2024-09-10T06:28:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022362100000000002 2024-09-10T06:28:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.948223+0000", 2024-09-10T06:28:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4441000000000003e-05 2024-09-10T06:28:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.948251+0000", 2024-09-10T06:28:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8238999999999998e-05 2024-09-10T06:28:29.542 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.948445+0000", 2024-09-10T06:28:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00019384099999999999 2024-09-10T06:28:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.948761+0000", 2024-09-10T06:28:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000316049 2024-09-10T06:28:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.949105+0000", 2024-09-10T06:28:29.543 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00034362100000000001 2024-09-10T06:28:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.960748+0000", 2024-09-10T06:28:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.011642736000000001 2024-09-10T06:28:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.963107+0000", 2024-09-10T06:28:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0023598360000000001 2024-09-10T06:28:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.544 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.963205+0000", 2024-09-10T06:28:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7526000000000001e-05 2024-09-10T06:28:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.963271+0000", 2024-09-10T06:28:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6136999999999994e-05 2024-09-10T06:28:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.545 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.545 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:29.547 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T06:28:29.671 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:29.671 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:28:29.671 INFO:teuthology.orchestra.run.smithi112.stdout: "num_ops": 0 2024-09-10T06:28:29.672 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:29.686 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T06:28:29.811 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:29.811 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [], 2024-09-10T06:28:29.812 INFO:teuthology.orchestra.run.smithi112.stdout: "complaint_time": 30, 2024-09-10T06:28:29.812 INFO:teuthology.orchestra.run.smithi112.stdout: "num_blocked_ops": 0 2024-09-10T06:28:29.812 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:29.826 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T06:28:29.948 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:28:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "size": 20, 2024-09-10T06:28:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 600, 2024-09-10T06:28:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: "ops": [ 2024-09-10T06:28:29.948 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1357 3.1e 3:7863b3e2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_112:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.957495+0000", 2024-09-10T06:28:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.987050015000001, 2024-09-10T06:28:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019676366000000001, 2024-09-10T06:28:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1357 2024-09-10T06:28:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.949 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.957495+0000", 2024-09-10T06:28:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.957495+0000", 2024-09-10T06:28:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.957499+0000", 2024-09-10T06:28:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6789999999999998e-06 2024-09-10T06:28:29.950 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.958828+0000", 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0013292829999999999 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.958867+0000", 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.8810000000000003e-05 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.958883+0000", 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5362999999999998e-05 2024-09-10T06:28:29.951 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.958975+0000", 2024-09-10T06:28:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.2200999999999994e-05 2024-09-10T06:28:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.959138+0000", 2024-09-10T06:28:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000163542 2024-09-10T06:28:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:29.952 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.959288+0000", 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015009499999999999 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.967661+0000", 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0083720940000000001 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.977039+0000", 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0093786000000000008 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.953 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.977112+0000", 2024-09-10T06:28:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3040000000000005e-05 2024-09-10T06:28:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.977172+0000", 2024-09-10T06:28:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.9658999999999999e-05 2024-09-10T06:28:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1361 3.38 3:1ede1c11:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:58.998802+0000", 2024-09-10T06:28:29.954 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.945743104000002, 2024-09-10T06:28:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017059365999999999, 2024-09-10T06:28:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1361 2024-09-10T06:28:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.998802+0000", 2024-09-10T06:28:29.955 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.998802+0000", 2024-09-10T06:28:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:58.998806+0000", 2024-09-10T06:28:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1889999999999999e-06 2024-09-10T06:28:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.956 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000620+0000", 2024-09-10T06:28:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001814485 2024-09-10T06:28:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000651+0000", 2024-09-10T06:28:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0719999999999997e-05 2024-09-10T06:28:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.957 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000665+0000", 2024-09-10T06:28:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4695000000000001e-05 2024-09-10T06:28:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000738+0000", 2024-09-10T06:28:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2229000000000003e-05 2024-09-10T06:28:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000869+0000", 2024-09-10T06:28:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000131688 2024-09-10T06:28:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.958 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.000993+0000", 2024-09-10T06:28:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012376999999999999 2024-09-10T06:28:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.010762+0000", 2024-09-10T06:28:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0097692260000000006 2024-09-10T06:28:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.015691+0000", 2024-09-10T06:28:29.959 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049281660000000003 2024-09-10T06:28:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.015764+0000", 2024-09-10T06:28:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3182999999999994e-05 2024-09-10T06:28:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.015862+0000", 2024-09-10T06:28:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8015000000000003e-05 2024-09-10T06:28:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.960 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1377 3.7 3:e1b31464:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_132:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.180368+0000", 2024-09-10T06:28:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.764177813, 2024-09-10T06:28:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017958923000000002, 2024-09-10T06:28:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1377 2024-09-10T06:28:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.961 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.180368+0000", 2024-09-10T06:28:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.180368+0000", 2024-09-10T06:28:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.180370+0000", 2024-09-10T06:28:29.962 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6900000000000001e-06 2024-09-10T06:28:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182458+0000", 2024-09-10T06:28:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0020876179999999999 2024-09-10T06:28:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182485+0000", 2024-09-10T06:28:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.694e-05 2024-09-10T06:28:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.963 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182499+0000", 2024-09-10T06:28:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4100000000000001e-05 2024-09-10T06:28:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182597+0000", 2024-09-10T06:28:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.8309999999999999e-05 2024-09-10T06:28:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182700+0000", 2024-09-10T06:28:29.964 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010313400000000001 2024-09-10T06:28:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.182801+0000", 2024-09-10T06:28:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100065 2024-09-10T06:28:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.965 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.191493+0000", 2024-09-10T06:28:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0086923150000000008 2024-09-10T06:28:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.198196+0000", 2024-09-10T06:28:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.006703166 2024-09-10T06:28:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.198263+0000", 2024-09-10T06:28:29.966 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6685000000000003e-05 2024-09-10T06:28:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.198327+0000", 2024-09-10T06:28:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3899999999999995e-05 2024-09-10T06:28:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1381 3.18 3:1b2e08f5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.221807+0000", 2024-09-10T06:28:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.722738939999999, 2024-09-10T06:28:29.967 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.020986388000000002, 2024-09-10T06:28:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1381 2024-09-10T06:28:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.968 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.221807+0000", 2024-09-10T06:28:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.221807+0000", 2024-09-10T06:28:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.221809+0000", 2024-09-10T06:28:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.571e-06 2024-09-10T06:28:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.969 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.222886+0000", 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001076547 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.222909+0000", 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3028e-05 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.222919+0000", 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0509000000000001e-05 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.970 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.222981+0000", 2024-09-10T06:28:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1754999999999994e-05 2024-09-10T06:28:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.223119+0000", 2024-09-10T06:28:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013831299999999999 2024-09-10T06:28:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.223228+0000", 2024-09-10T06:28:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000108424 2024-09-10T06:28:29.971 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.237361+0000", 2024-09-10T06:28:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.014132824 2024-09-10T06:28:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.242666+0000", 2024-09-10T06:28:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0053053340000000001 2024-09-10T06:28:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.972 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.242739+0000", 2024-09-10T06:28:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2801999999999999e-05 2024-09-10T06:28:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.242793+0000", 2024-09-10T06:28:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4280999999999997e-05 2024-09-10T06:28:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1384 3.33 3:cfe948dc:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.973 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.251038+0000", 2024-09-10T06:28:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.693507853, 2024-09-10T06:28:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.018535228000000001, 2024-09-10T06:28:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1384 2024-09-10T06:28:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.974 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.251038+0000", 2024-09-10T06:28:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.251038+0000", 2024-09-10T06:28:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.975 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.251040+0000", 2024-09-10T06:28:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4590000000000001e-06 2024-09-10T06:28:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.252948+0000", 2024-09-10T06:28:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001907658 2024-09-10T06:28:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.976 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.252976+0000", 2024-09-10T06:28:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8673000000000001e-05 2024-09-10T06:28:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.252992+0000", 2024-09-10T06:28:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5761999999999999e-05 2024-09-10T06:28:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.253086+0000", 2024-09-10T06:28:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4279999999999999e-05 2024-09-10T06:28:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.977 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.253243+0000", 2024-09-10T06:28:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015613700000000001 2024-09-10T06:28:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.253381+0000", 2024-09-10T06:28:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00013826800000000001 2024-09-10T06:28:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.262637+0000", 2024-09-10T06:28:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0092563639999999996 2024-09-10T06:28:29.978 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.269454+0000", 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0068171120000000002 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.269522+0000", 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7287999999999997e-05 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.269573+0000", 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1227000000000003e-05 2024-09-10T06:28:29.979 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1395 3.24 3:24edd8eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.360953+0000", 2024-09-10T06:28:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.583592096, 2024-09-10T06:28:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017333182999999999, 2024-09-10T06:28:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.980 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1395 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.360953+0000", 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.360953+0000", 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.981 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.360956+0000", 2024-09-10T06:28:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5840000000000002e-06 2024-09-10T06:28:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.362555+0000", 2024-09-10T06:28:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001599329 2024-09-10T06:28:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.362584+0000", 2024-09-10T06:28:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.8986e-05 2024-09-10T06:28:29.982 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.362617+0000", 2024-09-10T06:28:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2327999999999999e-05 2024-09-10T06:28:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.362695+0000", 2024-09-10T06:28:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.8392000000000004e-05 2024-09-10T06:28:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.983 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.362872+0000", 2024-09-10T06:28:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017744200000000001 2024-09-10T06:28:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.362978+0000", 2024-09-10T06:28:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010545800000000001 2024-09-10T06:28:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.369228+0000", 2024-09-10T06:28:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0062498789999999999 2024-09-10T06:28:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.984 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.378141+0000", 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0089135240000000008 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.378224+0000", 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.3066999999999996e-05 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.378287+0000", 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2193999999999994e-05 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.985 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1399 3.38 3:1dcd0b88:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.402210+0000", 2024-09-10T06:28:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.542335656999999, 2024-09-10T06:28:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022347520999999999, 2024-09-10T06:28:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.986 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1399 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.402210+0000", 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.402210+0000", 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.987 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.402212+0000", 2024-09-10T06:28:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.1229999999999998e-06 2024-09-10T06:28:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.404083+0000", 2024-09-10T06:28:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0018714440000000001 2024-09-10T06:28:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.404116+0000", 2024-09-10T06:28:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2347e-05 2024-09-10T06:28:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.988 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.404130+0000", 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4729000000000001e-05 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.404218+0000", 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.7576000000000003e-05 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.404399+0000", 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000181196 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.989 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.404571+0000", 2024-09-10T06:28:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000171578 2024-09-10T06:28:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.411199+0000", 2024-09-10T06:28:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0066279800000000003 2024-09-10T06:28:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.424426+0000", 2024-09-10T06:28:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.013226897 2024-09-10T06:28:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.990 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.424494+0000", 2024-09-10T06:28:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.8280000000000004e-05 2024-09-10T06:28:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.424557+0000", 2024-09-10T06:28:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3371e-05 2024-09-10T06:28:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.991 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1400 3.7 3:e1237548:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_155:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.413228+0000", 2024-09-10T06:28:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.531317114, 2024-09-10T06:28:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017167168, 2024-09-10T06:28:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1400 2024-09-10T06:28:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.992 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.413228+0000", 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.413228+0000", 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.413231+0000", 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7039999999999999e-06 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.993 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.414994+0000", 2024-09-10T06:28:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017624279999999999 2024-09-10T06:28:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.415029+0000", 2024-09-10T06:28:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5420000000000003e-05 2024-09-10T06:28:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.415045+0000", 2024-09-10T06:28:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.6166000000000001e-05 2024-09-10T06:28:29.994 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.415125+0000", 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.9783999999999994e-05 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.415250+0000", 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000125485 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.415363+0000", 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000112185 2024-09-10T06:28:29.995 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.421713+0000", 2024-09-10T06:28:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0063500969999999999 2024-09-10T06:28:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.430316+0000", 2024-09-10T06:28:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0086033299999999993 2024-09-10T06:28:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:29.996 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.430353+0000", 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6718999999999999e-05 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.430396+0000", 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.2849999999999998e-05 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1412 3.38 3:1da1fffe:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.433157+0000", 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.511388903, 2024-09-10T06:28:29.997 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017894383, 2024-09-10T06:28:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1412 2024-09-10T06:28:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.433157+0000", 2024-09-10T06:28:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.998 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.433157+0000", 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.433159+0000", 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9539999999999998e-06 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.434562+0000", 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0014031810000000001 2024-09-10T06:28:29.999 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.434586+0000", 2024-09-10T06:28:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.4244e-05 2024-09-10T06:28:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.434600+0000", 2024-09-10T06:28:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.4173e-05 2024-09-10T06:28:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.434662+0000", 2024-09-10T06:28:30.000 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.1890999999999994e-05 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.434777+0000", 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011537200000000001 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.434881+0000", 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000103984 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.442157+0000", 2024-09-10T06:28:30.001 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0072760400000000001 2024-09-10T06:28:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.450923+0000", 2024-09-10T06:28:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0087658289999999993 2024-09-10T06:28:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.450992+0000", 2024-09-10T06:28:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.9176000000000003e-05 2024-09-10T06:28:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:30.002 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.451051+0000", 2024-09-10T06:28:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8539000000000003e-05 2024-09-10T06:28:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1413 3.1e 3:79ea7bee:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_158:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.442985+0000", 2024-09-10T06:28:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.501560295000001, 2024-09-10T06:28:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017707302000000001, 2024-09-10T06:28:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:30.003 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1413 2024-09-10T06:28:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.442985+0000", 2024-09-10T06:28:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:30.004 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.442985+0000", 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.442987+0000", 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.77e-06 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.444274+0000", 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001287009 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:30.005 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.444306+0000", 2024-09-10T06:28:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.2369000000000001e-05 2024-09-10T06:28:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.444319+0000", 2024-09-10T06:28:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.3057000000000001e-05 2024-09-10T06:28:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.444385+0000", 2024-09-10T06:28:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.5629999999999993e-05 2024-09-10T06:28:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.006 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.444539+0000", 2024-09-10T06:28:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015395200000000001 2024-09-10T06:28:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.444699+0000", 2024-09-10T06:28:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000160204 2024-09-10T06:28:30.007 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.450971+0000", 2024-09-10T06:28:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0062716430000000004 2024-09-10T06:28:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.460580+0000", 2024-09-10T06:28:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0096087829999999992 2024-09-10T06:28:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:30.008 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.460644+0000", 2024-09-10T06:28:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.4664000000000003e-05 2024-09-10T06:28:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.460693+0000", 2024-09-10T06:28:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8220999999999998e-05 2024-09-10T06:28:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1418 3.24 3:26ca0de9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_163:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.490364+0000", 2024-09-10T06:28:30.009 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.454181683000002, 2024-09-10T06:28:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019039736000000002, 2024-09-10T06:28:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1418 2024-09-10T06:28:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.490364+0000", 2024-09-10T06:28:30.010 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.490364+0000", 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.490367+0000", 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5039999999999998e-06 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.491928+0000", 2024-09-10T06:28:30.011 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001560875 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.491948+0000", 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9706000000000001e-05 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.491960+0000", 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1855000000000001e-05 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.492032+0000", 2024-09-10T06:28:30.012 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.1796000000000002e-05 2024-09-10T06:28:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.492141+0000", 2024-09-10T06:28:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00010906199999999999 2024-09-10T06:28:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.492238+0000", 2024-09-10T06:28:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.7513e-05 2024-09-10T06:28:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:30.013 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.497020+0000", 2024-09-10T06:28:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.004781731 2024-09-10T06:28:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.509272+0000", 2024-09-10T06:28:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012251811 2024-09-10T06:28:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.509345+0000", 2024-09-10T06:28:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.2977000000000003e-05 2024-09-10T06:28:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.014 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.509404+0000", 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.8906000000000001e-05 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1446 3.29 3:97120176:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_191:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.777351+0000", 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.167194715000001, 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017481667999999999, 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.015 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1446 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.777351+0000", 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.777351+0000", 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.016 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.777354+0000", 2024-09-10T06:28:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1889999999999999e-06 2024-09-10T06:28:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.778750+0000", 2024-09-10T06:28:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001396088 2024-09-10T06:28:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.778760+0000", 2024-09-10T06:28:30.017 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.5049999999999996e-06 2024-09-10T06:28:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.778765+0000", 2024-09-10T06:28:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.9679999999999997e-06 2024-09-10T06:28:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.778821+0000", 2024-09-10T06:28:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.6728999999999998e-05 2024-09-10T06:28:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:30.018 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.778968+0000", 2024-09-10T06:28:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014646 2024-09-10T06:28:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.779069+0000", 2024-09-10T06:28:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000100905 2024-09-10T06:28:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.787361+0000", 2024-09-10T06:28:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0082922780000000001 2024-09-10T06:28:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.019 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.794713+0000", 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0073517870000000003 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.794780+0000", 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.7415000000000004e-05 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.794832+0000", 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.2343999999999999e-05 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:30.020 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1450 3.27 3:e710f600:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:27:59.823335+0000", 2024-09-10T06:28:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 30.121210599000001, 2024-09-10T06:28:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017310316999999999, 2024-09-10T06:28:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1450 2024-09-10T06:28:30.021 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.823335+0000", 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.823335+0000", 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.823338+0000", 2024-09-10T06:28:30.022 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1709999999999998e-06 2024-09-10T06:28:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.824588+0000", 2024-09-10T06:28:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.001249642 2024-09-10T06:28:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.824615+0000", 2024-09-10T06:28:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7593000000000002e-05 2024-09-10T06:28:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.023 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.824626+0000", 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0540000000000001e-05 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.824704+0000", 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.805e-05 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.824869+0000", 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016499700000000001 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:30.024 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.825028+0000", 2024-09-10T06:28:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000158839 2024-09-10T06:28:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.833009+0000", 2024-09-10T06:28:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0079817329999999995 2024-09-10T06:28:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.840527+0000", 2024-09-10T06:28:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0075173180000000003 2024-09-10T06:28:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.025 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.840593+0000", 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.6536000000000001e-05 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:27:59.840645+0000", 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.1897999999999997e-05 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1683 3.7 3:e078a1a0:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:30.026 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:05.034363+0000", 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 24.910182517999999, 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017799134000000001, 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1683 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.034363+0000", 2024-09-10T06:28:30.027 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.034363+0000", 2024-09-10T06:28:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.034366+0000", 2024-09-10T06:28:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6060000000000001e-06 2024-09-10T06:28:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.028 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.035986+0000", 2024-09-10T06:28:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0016203560000000001 2024-09-10T06:28:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.036010+0000", 2024-09-10T06:28:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.3601e-05 2024-09-10T06:28:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.036020+0000", 2024-09-10T06:28:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.0644e-05 2024-09-10T06:28:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.029 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.036094+0000", 2024-09-10T06:28:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.3774000000000002e-05 2024-09-10T06:28:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.036216+0000", 2024-09-10T06:28:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012216399999999999 2024-09-10T06:28:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.036310+0000", 2024-09-10T06:28:30.030 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 9.4160999999999995e-05 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.043891+0000", 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0075808350000000002 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.052094+0000", 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0082024569999999998 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.052130+0000", 2024-09-10T06:28:30.031 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.6535999999999997e-05 2024-09-10T06:28:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:05.052162+0000", 2024-09-10T06:28:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1999999999999999e-05 2024-09-10T06:28:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1758 3.c e72/22 3:30c1ab1b:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_5:head v 72'4, mlcod=64'2)", 2024-09-10T06:28:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.572756+0000", 2024-09-10T06:28:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 15.371789239, 2024-09-10T06:28:30.032 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.026362844999999999, 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.572756+0000", 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.572756+0000", 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.033 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.572759+0000", 2024-09-10T06:28:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.6630000000000002e-06 2024-09-10T06:28:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.583512+0000", 2024-09-10T06:28:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.01075307 2024-09-10T06:28:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.583538+0000", 2024-09-10T06:28:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.5765000000000001e-05 2024-09-10T06:28:30.034 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.583557+0000", 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9606000000000002e-05 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.583674+0000", 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011623799999999999 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.583736+0000", 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.2204000000000003e-05 2024-09-10T06:28:30.035 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.599006+0000", 2024-09-10T06:28:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.015270423999999999 2024-09-10T06:28:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.599119+0000", 2024-09-10T06:28:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011287500000000001 2024-09-10T06:28:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.036 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1761 3.29 3:9698b2c3:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.615231+0000", 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 15.329314667, 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019047363000000001, 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1761 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.037 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.615231+0000", 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.615231+0000", 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.615233+0000", 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.2120000000000002e-06 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.038 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.617806+0000", 2024-09-10T06:28:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0025733349999999999 2024-09-10T06:28:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.617841+0000", 2024-09-10T06:28:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.4585000000000002e-05 2024-09-10T06:28:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.617858+0000", 2024-09-10T06:28:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.7149000000000001e-05 2024-09-10T06:28:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.039 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.617998+0000", 2024-09-10T06:28:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000140087 2024-09-10T06:28:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.618315+0000", 2024-09-10T06:28:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031701899999999998 2024-09-10T06:28:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.618620+0000", 2024-09-10T06:28:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00030459999999999998 2024-09-10T06:28:30.040 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.628775+0000", 2024-09-10T06:28:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010155462000000001 2024-09-10T06:28:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.633983+0000", 2024-09-10T06:28:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0052074570000000004 2024-09-10T06:28:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.634154+0000", 2024-09-10T06:28:30.041 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00017105000000000001 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.634278+0000", 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00012440699999999999 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1769 3.b 3:d18dee18:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.770911+0000", 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 15.173634286, 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019328515000000001, 2024-09-10T06:28:30.042 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1769 2024-09-10T06:28:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.770911+0000", 2024-09-10T06:28:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.043 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.770911+0000", 2024-09-10T06:28:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.770914+0000", 2024-09-10T06:28:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0010000000000002e-06 2024-09-10T06:28:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.774097+0000", 2024-09-10T06:28:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0031827919999999998 2024-09-10T06:28:30.044 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.774139+0000", 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.1591000000000002e-05 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.774158+0000", 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.9352999999999999e-05 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.774302+0000", 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014413699999999999 2024-09-10T06:28:30.045 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.774622+0000", 2024-09-10T06:28:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00031961899999999999 2024-09-10T06:28:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.774892+0000", 2024-09-10T06:28:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00027027799999999999 2024-09-10T06:28:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.787849+0000", 2024-09-10T06:28:30.046 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012957043 2024-09-10T06:28:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.790131+0000", 2024-09-10T06:28:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0022822979999999999 2024-09-10T06:28:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.790180+0000", 2024-09-10T06:28:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 4.8257000000000002e-05 2024-09-10T06:28:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:30.047 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.790240+0000", 2024-09-10T06:28:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.0146000000000003e-05 2024-09-10T06:28:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1777 3.18 3:1a2d0160:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:14.932911+0000", 2024-09-10T06:28:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 15.011634431999999, 2024-09-10T06:28:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022700274999999999, 2024-09-10T06:28:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.048 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1777 2024-09-10T06:28:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.932911+0000", 2024-09-10T06:28:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.932911+0000", 2024-09-10T06:28:30.049 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.932915+0000", 2024-09-10T06:28:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.9430000000000002e-06 2024-09-10T06:28:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.937859+0000", 2024-09-10T06:28:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0049439289999999997 2024-09-10T06:28:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.050 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.937913+0000", 2024-09-10T06:28:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.4345000000000002e-05 2024-09-10T06:28:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.937944+0000", 2024-09-10T06:28:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.0701999999999998e-05 2024-09-10T06:28:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:30.052 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.938065+0000", 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000121475 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.938232+0000", 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000166909 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.938383+0000", 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00015024600000000001 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:30.053 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.951356+0000", 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.012973477000000001 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.955328+0000", 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0039716250000000003 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.955492+0000", 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00016410900000000001 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:30.054 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:14.955611+0000", 2024-09-10T06:28:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000119515 2024-09-10T06:28:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_repop(client.4358.0:1782 3.19 e72/22 3:9ac8ef78:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_29:head v 72'8, mlcod=72'6)", 2024-09-10T06:28:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:15.018092+0000", 2024-09-10T06:28:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.926453474000001, 2024-09-10T06:28:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.019341255000000002, 2024-09-10T06:28:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.055 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.018092+0000", 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.018092+0000", 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.018095+0000", 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7860000000000001e-06 2024-09-10T06:28:30.056 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.019841+0000", 2024-09-10T06:28:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0017464799999999999 2024-09-10T06:28:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.019873+0000", 2024-09-10T06:28:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.1526000000000003e-05 2024-09-10T06:28:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.057 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.019888+0000", 2024-09-10T06:28:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.5526e-05 2024-09-10T06:28:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.020001+0000", 2024-09-10T06:28:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00011228 2024-09-10T06:28:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.020030+0000", 2024-09-10T06:28:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.9654000000000001e-05 2024-09-10T06:28:30.058 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.037352+0000", 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.017321656000000001 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.037433+0000", 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 8.1347000000000006e-05 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.059 INFO:teuthology.orchestra.run.smithi112.stdout: "description": "osd_op(client.4358.0:1785 3.7 3:e0613ecb:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: "initiated_at": "2024-09-10T06:28:15.048033+0000", 2024-09-10T06:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: "age": 14.896512113, 2024-09-10T06:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.022119473000000001, 2024-09-10T06:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: "continuous": false, 2024-09-10T06:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: "type_data": { 2024-09-10T06:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client_info": { 2024-09-10T06:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client": "client.4358", 2024-09-10T06:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: "tid": 1785 2024-09-10T06:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: "events": [ 2024-09-10T06:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.060 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "initiated", 2024-09-10T06:28:30.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.048033+0000", 2024-09-10T06:28:30.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "header_read", 2024-09-10T06:28:30.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.048033+0000", 2024-09-10T06:28:30.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0 2024-09-10T06:28:30.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.061 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "throttled", 2024-09-10T06:28:30.061 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.048037+0000", 2024-09-10T06:28:30.061 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 3.5389999999999999e-06 2024-09-10T06:28:30.061 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.061 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "all_read", 2024-09-10T06:28:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.049638+0000", 2024-09-10T06:28:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00160108 2024-09-10T06:28:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "dispatched", 2024-09-10T06:28:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.049665+0000", 2024-09-10T06:28:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 2.7248000000000001e-05 2024-09-10T06:28:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.049676+0000", 2024-09-10T06:28:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 1.1212999999999999e-05 2024-09-10T06:28:30.062 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "reached_pg", 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.049740+0000", 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 6.3697999999999999e-05 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "started", 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.049857+0000", 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.000116674 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.050003+0000", 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.00014609200000000001 2024-09-10T06:28:30.063 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "op_commit", 2024-09-10T06:28:30.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.059537+0000", 2024-09-10T06:28:30.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.0095339329999999996 2024-09-10T06:28:30.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.064 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.070025+0000", 2024-09-10T06:28:30.064 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 0.010488383 2024-09-10T06:28:30.064 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.064 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.064 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "commit_sent", 2024-09-10T06:28:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.070095+0000", 2024-09-10T06:28:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 7.0234000000000006e-05 2024-09-10T06:28:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: }, 2024-09-10T06:28:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: { 2024-09-10T06:28:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: "event": "done", 2024-09-10T06:28:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: "time": "2024-09-10T06:28:15.070153+0000", 2024-09-10T06:28:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: "duration": 5.7379000000000001e-05 2024-09-10T06:28:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: } 2024-09-10T06:28:30.065 INFO:teuthology.orchestra.run.smithi112.stdout: ] 2024-09-10T06:28:30.066 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:28:30.067 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T06:28:30.199 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:30.199 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:30.199 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:30.199 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:30.214 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T06:28:30.339 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:30.339 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:30.339 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:30.353 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T06:28:30.475 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1359 3.34 3:2ece4e0b:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_114:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.495031170000001, 2024-09-10T06:28:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021482449000000001, 2024-09-10T06:28:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.475 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1359 2024-09-10T06:28:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977230+0000", 2024-09-10T06:28:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.977234+0000", 2024-09-10T06:28:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7969999999999998e-06 2024-09-10T06:28:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981211+0000", 2024-09-10T06:28:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039768329999999999 2024-09-10T06:28:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981247+0000", 2024-09-10T06:28:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6457e-05 2024-09-10T06:28:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981274+0000", 2024-09-10T06:28:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6917999999999999e-05 2024-09-10T06:28:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981446+0000", 2024-09-10T06:28:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171831 2024-09-10T06:28:30.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981719+0000", 2024-09-10T06:28:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027282800000000002 2024-09-10T06:28:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.981975+0000", 2024-09-10T06:28:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000256782 2024-09-10T06:28:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.991319+0000", 2024-09-10T06:28:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093433820000000008 2024-09-10T06:28:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998330+0000", 2024-09-10T06:28:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070108549999999999 2024-09-10T06:28:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998549+0000", 2024-09-10T06:28:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021944400000000001 2024-09-10T06:28:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.998712+0000", 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016332200000000001 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1367 3.34 3:2f444f7f:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.401949467000001, 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020931903000000002, 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1367 2024-09-10T06:28:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070312+0000", 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.070316+0000", 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9029999999999997e-06 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074255+0000", 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039391679999999998 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074291+0000", 2024-09-10T06:28:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5970000000000003e-05 2024-09-10T06:28:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074309+0000", 2024-09-10T06:28:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8399000000000001e-05 2024-09-10T06:28:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074436+0000", 2024-09-10T06:28:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012683099999999999 2024-09-10T06:28:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074686+0000", 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024971699999999999 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.074907+0000", 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022124800000000001 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.084332+0000", 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094253449999999999 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.090954+0000", 2024-09-10T06:28:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066213649999999997 2024-09-10T06:28:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.091123+0000", 2024-09-10T06:28:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169216 2024-09-10T06:28:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.091244+0000", 2024-09-10T06:28:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120741 2024-09-10T06:28:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.486 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1375 3.1 e63/22 3:82031a0e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_130:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.308893431000001, 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018270307999999999, 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:30.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163368+0000", 2024-09-10T06:28:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.163370+0000", 2024-09-10T06:28:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8289999999999999e-06 2024-09-10T06:28:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167665+0000", 2024-09-10T06:28:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042940499999999998 2024-09-10T06:28:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167698+0000", 2024-09-10T06:28:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3484e-05 2024-09-10T06:28:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167714+0000", 2024-09-10T06:28:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-09-10T06:28:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167847+0000", 2024-09-10T06:28:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013299300000000001 2024-09-10T06:28:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.167890+0000", 2024-09-10T06:28:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2434000000000001e-05 2024-09-10T06:28:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181507+0000", 2024-09-10T06:28:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013616872 2024-09-10T06:28:30.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181638+0000", 2024-09-10T06:28:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013123099999999999 2024-09-10T06:28:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1380 3.3 3:c3afb574:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.260839296, 2024-09-10T06:28:30.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027193374999999999, 2024-09-10T06:28:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1380 2024-09-10T06:28:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:30.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211422+0000", 2024-09-10T06:28:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211426+0000", 2024-09-10T06:28:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3599999999999998e-06 2024-09-10T06:28:30.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215383+0000", 2024-09-10T06:28:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039567450000000002 2024-09-10T06:28:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215417+0000", 2024-09-10T06:28:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4051000000000003e-05 2024-09-10T06:28:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215435+0000", 2024-09-10T06:28:30.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8459000000000001e-05 2024-09-10T06:28:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215626+0000", 2024-09-10T06:28:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019018299999999999 2024-09-10T06:28:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.215991+0000", 2024-09-10T06:28:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036566099999999998 2024-09-10T06:28:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:30.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.216360+0000", 2024-09-10T06:28:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000368995 2024-09-10T06:28:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.226152+0000", 2024-09-10T06:28:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097914319999999992 2024-09-10T06:28:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238448+0000", 2024-09-10T06:28:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012295834 2024-09-10T06:28:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238538+0000", 2024-09-10T06:28:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0539999999999997e-05 2024-09-10T06:28:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.238615+0000", 2024-09-10T06:28:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7114999999999996e-05 2024-09-10T06:28:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.497 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1383 3.3 3:c2c34097:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_138:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.229497582, 2024-09-10T06:28:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020753975000000001, 2024-09-10T06:28:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1383 2024-09-10T06:28:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242764+0000", 2024-09-10T06:28:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.242767+0000", 2024-09-10T06:28:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6169999999999998e-06 2024-09-10T06:28:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246704+0000", 2024-09-10T06:28:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003936485 2024-09-10T06:28:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246733+0000", 2024-09-10T06:28:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9819999999999999e-05 2024-09-10T06:28:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246748+0000", 2024-09-10T06:28:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4334e-05 2024-09-10T06:28:30.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.246902+0000", 2024-09-10T06:28:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015468 2024-09-10T06:28:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.247286+0000", 2024-09-10T06:28:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038366799999999999 2024-09-10T06:28:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.247687+0000", 2024-09-10T06:28:30.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000401252 2024-09-10T06:28:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.257963+0000", 2024-09-10T06:28:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010275584000000001 2024-09-10T06:28:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263287+0000", 2024-09-10T06:28:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053238499999999998 2024-09-10T06:28:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263412+0000", 2024-09-10T06:28:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012516200000000001 2024-09-10T06:28:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.263517+0000", 2024-09-10T06:28:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105523 2024-09-10T06:28:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1391 3.1c e63/22 3:3a76b5ac:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_146:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:30.503 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.145191568000001, 2024-09-10T06:28:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026554852, 2024-09-10T06:28:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327070+0000", 2024-09-10T06:28:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.327072+0000", 2024-09-10T06:28:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6970000000000002e-06 2024-09-10T06:28:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330874+0000", 2024-09-10T06:28:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038016590000000002 2024-09-10T06:28:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330928+0000", 2024-09-10T06:28:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3729e-05 2024-09-10T06:28:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.330956+0000", 2024-09-10T06:28:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8694999999999999e-05 2024-09-10T06:28:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.331147+0000", 2024-09-10T06:28:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190841 2024-09-10T06:28:30.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.331216+0000", 2024-09-10T06:28:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8948999999999993e-05 2024-09-10T06:28:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.353521+0000", 2024-09-10T06:28:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022304781999999999 2024-09-10T06:28:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.353624+0000", 2024-09-10T06:28:30.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010349999999999999 2024-09-10T06:28:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1392 3.14 3:2b02aaa8:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_147:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.140212778999999, 2024-09-10T06:28:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024102582000000001, 2024-09-10T06:28:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1392 2024-09-10T06:28:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332048+0000", 2024-09-10T06:28:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.332052+0000", 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8999999999999999e-06 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.335987+0000", 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039349800000000002 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336020+0000", 2024-09-10T06:28:30.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2968e-05 2024-09-10T06:28:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336040+0000", 2024-09-10T06:28:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9956e-05 2024-09-10T06:28:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336155+0000", 2024-09-10T06:28:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115275 2024-09-10T06:28:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336404+0000", 2024-09-10T06:28:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024874599999999999 2024-09-10T06:28:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.336626+0000", 2024-09-10T06:28:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022168200000000001 2024-09-10T06:28:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.355854+0000", 2024-09-10T06:28:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019228624999999999 2024-09-10T06:28:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.355890+0000", 2024-09-10T06:28:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5901000000000001e-05 2024-09-10T06:28:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.356040+0000", 2024-09-10T06:28:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014919600000000001 2024-09-10T06:28:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.356151+0000", 2024-09-10T06:28:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111353 2024-09-10T06:28:30.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1398 3.2c e63/22 3:350a23e7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_153:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.069119792999999, 2024-09-10T06:28:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021444181, 2024-09-10T06:28:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403141+0000", 2024-09-10T06:28:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.403144+0000", 2024-09-10T06:28:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.734e-06 2024-09-10T06:28:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406432+0000", 2024-09-10T06:28:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032884500000000001 2024-09-10T06:28:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406473+0000", 2024-09-10T06:28:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0834000000000002e-05 2024-09-10T06:28:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406492+0000", 2024-09-10T06:28:30.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8868999999999998e-05 2024-09-10T06:28:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406632+0000", 2024-09-10T06:28:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140183 2024-09-10T06:28:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.406698+0000", 2024-09-10T06:28:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5913000000000004e-05 2024-09-10T06:28:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424483+0000", 2024-09-10T06:28:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017785108000000001 2024-09-10T06:28:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424585+0000", 2024-09-10T06:28:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010208999999999999 2024-09-10T06:28:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1415 3.2c e63/22 3:34c14757:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_160:head v 63'5, mlcod=63'3)", 2024-09-10T06:28:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:30.518 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.004269335, 2024-09-10T06:28:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023773743999999999, 2024-09-10T06:28:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467992+0000", 2024-09-10T06:28:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467994+0000", 2024-09-10T06:28:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4669999999999998e-06 2024-09-10T06:28:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471376+0000", 2024-09-10T06:28:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033818099999999999 2024-09-10T06:28:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471426+0000", 2024-09-10T06:28:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9846999999999999e-05 2024-09-10T06:28:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471452+0000", 2024-09-10T06:28:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6327999999999999e-05 2024-09-10T06:28:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471621+0000", 2024-09-10T06:28:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016928200000000001 2024-09-10T06:28:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.472399+0000", 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000777171 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.491634+0000", 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019235070999999999 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.491766+0000", 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013176799999999999 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.522 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1417 3.14 3:29141a67:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_162:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.991335337999999, 2024-09-10T06:28:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026932543, 2024-09-10T06:28:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.523 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1417 2024-09-10T06:28:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480926+0000", 2024-09-10T06:28:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.480929+0000", 2024-09-10T06:28:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-09-10T06:28:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486391+0000", 2024-09-10T06:28:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054618599999999998 2024-09-10T06:28:30.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486425+0000", 2024-09-10T06:28:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4031e-05 2024-09-10T06:28:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486443+0000", 2024-09-10T06:28:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7878999999999999e-05 2024-09-10T06:28:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486581+0000", 2024-09-10T06:28:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013773400000000001 2024-09-10T06:28:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.486836+0000", 2024-09-10T06:28:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025529900000000001 2024-09-10T06:28:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.487064+0000", 2024-09-10T06:28:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000228438 2024-09-10T06:28:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.505216+0000", 2024-09-10T06:28:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018152130999999998 2024-09-10T06:28:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507597+0000", 2024-09-10T06:28:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023807260000000001 2024-09-10T06:28:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507690+0000", 2024-09-10T06:28:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2305999999999993e-05 2024-09-10T06:28:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.507858+0000", 2024-09-10T06:28:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016879199999999999 2024-09-10T06:28:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1424 3.14 3:28df499c:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_169:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.924763615, 2024-09-10T06:28:30.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017872099999999998, 2024-09-10T06:28:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1424 2024-09-10T06:28:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547497+0000", 2024-09-10T06:28:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.547500+0000", 2024-09-10T06:28:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.999e-06 2024-09-10T06:28:30.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551376+0000", 2024-09-10T06:28:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038754010000000001 2024-09-10T06:28:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551401+0000", 2024-09-10T06:28:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5476000000000001e-05 2024-09-10T06:28:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551413+0000", 2024-09-10T06:28:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2082999999999999e-05 2024-09-10T06:28:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551486+0000", 2024-09-10T06:28:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2793999999999995e-05 2024-09-10T06:28:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551610+0000", 2024-09-10T06:28:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123993 2024-09-10T06:28:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.551718+0000", 2024-09-10T06:28:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107357 2024-09-10T06:28:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.559898+0000", 2024-09-10T06:28:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081805860000000001 2024-09-10T06:28:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565204+0000", 2024-09-10T06:28:30.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053053589999999999 2024-09-10T06:28:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565296+0000", 2024-09-10T06:28:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2291000000000001e-05 2024-09-10T06:28:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.565370+0000", 2024-09-10T06:28:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3761000000000001e-05 2024-09-10T06:28:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1429 3.1a 3:5acc80b6:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_174:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.874898557000002, 2024-09-10T06:28:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020448872999999999, 2024-09-10T06:28:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.536 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1429 2024-09-10T06:28:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597363+0000", 2024-09-10T06:28:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.597365+0000", 2024-09-10T06:28:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2759999999999999e-06 2024-09-10T06:28:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601186+0000", 2024-09-10T06:28:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038214410000000001 2024-09-10T06:28:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601212+0000", 2024-09-10T06:28:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5522999999999999e-05 2024-09-10T06:28:30.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601222+0000", 2024-09-10T06:28:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0584999999999999e-05 2024-09-10T06:28:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601314+0000", 2024-09-10T06:28:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1484999999999996e-05 2024-09-10T06:28:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601494+0000", 2024-09-10T06:28:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018006899999999999 2024-09-10T06:28:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.601655+0000", 2024-09-10T06:28:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016119999999999999 2024-09-10T06:28:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.607352+0000", 2024-09-10T06:28:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056970500000000004 2024-09-10T06:28:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617735+0000", 2024-09-10T06:28:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010382769 2024-09-10T06:28:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617780+0000", 2024-09-10T06:28:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5145999999999998e-05 2024-09-10T06:28:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.617811+0000", 2024-09-10T06:28:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1328999999999998e-05 2024-09-10T06:28:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.541 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1433 3.1a 3:59ee0094:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.825284573000001, 2024-09-10T06:28:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024407437000000001, 2024-09-10T06:28:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.542 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1433 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646977+0000", 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.646979+0000", 2024-09-10T06:28:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.074e-06 2024-09-10T06:28:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.650998+0000", 2024-09-10T06:28:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040192470000000001 2024-09-10T06:28:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651031+0000", 2024-09-10T06:28:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2821000000000003e-05 2024-09-10T06:28:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651050+0000", 2024-09-10T06:28:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9556e-05 2024-09-10T06:28:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651150+0000", 2024-09-10T06:28:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9689e-05 2024-09-10T06:28:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651325+0000", 2024-09-10T06:28:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017529199999999999 2024-09-10T06:28:30.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.651496+0000", 2024-09-10T06:28:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000170531 2024-09-10T06:28:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.659894+0000", 2024-09-10T06:28:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083978049999999995 2024-09-10T06:28:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671085+0000", 2024-09-10T06:28:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011190989 2024-09-10T06:28:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671261+0000", 2024-09-10T06:28:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017616800000000001 2024-09-10T06:28:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.671384+0000", 2024-09-10T06:28:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012326500000000001 2024-09-10T06:28:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1470 3.34 3:2e4989bb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_215:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.428092647, 2024-09-10T06:28:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019466533000000001, 2024-09-10T06:28:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.548 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1470 2024-09-10T06:28:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044168+0000", 2024-09-10T06:28:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044172+0000", 2024-09-10T06:28:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5939999999999998e-06 2024-09-10T06:28:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048101+0000", 2024-09-10T06:28:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003929325 2024-09-10T06:28:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048135+0000", 2024-09-10T06:28:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3856000000000002e-05 2024-09-10T06:28:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048150+0000", 2024-09-10T06:28:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.523e-05 2024-09-10T06:28:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048258+0000", 2024-09-10T06:28:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108025 2024-09-10T06:28:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048437+0000", 2024-09-10T06:28:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017811199999999999 2024-09-10T06:28:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.048550+0000", 2024-09-10T06:28:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113181 2024-09-10T06:28:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063173+0000", 2024-09-10T06:28:30.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014623565 2024-09-10T06:28:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063361+0000", 2024-09-10T06:28:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018807599999999999 2024-09-10T06:28:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063499+0000", 2024-09-10T06:28:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013745000000000001 2024-09-10T06:28:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.063635+0000", 2024-09-10T06:28:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136119 2024-09-10T06:28:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1674 3.e e66/22 3:71dde5c5:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_14:head v 66'6, mlcod=64'4)", 2024-09-10T06:28:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.936559+0000", 2024-09-10T06:28:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 25.535702450999999, 2024-09-10T06:28:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020541475999999999, 2024-09-10T06:28:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.554 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936559+0000", 2024-09-10T06:28:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936559+0000", 2024-09-10T06:28:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936562+0000", 2024-09-10T06:28:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9000000000000002e-06 2024-09-10T06:28:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939051+0000", 2024-09-10T06:28:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024898899999999998 2024-09-10T06:28:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939094+0000", 2024-09-10T06:28:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2874999999999999e-05 2024-09-10T06:28:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939115+0000", 2024-09-10T06:28:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0213000000000001e-05 2024-09-10T06:28:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939294+0000", 2024-09-10T06:28:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017977299999999999 2024-09-10T06:28:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.939359+0000", 2024-09-10T06:28:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4596000000000003e-05 2024-09-10T06:28:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.956969+0000", 2024-09-10T06:28:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017610223000000001 2024-09-10T06:28:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957100+0000", 2024-09-10T06:28:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131006 2024-09-10T06:28:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1677 3.34 3:2e18bed5:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.968824+0000", 2024-09-10T06:28:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 25.503436829999998, 2024-09-10T06:28:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017983664999999999, 2024-09-10T06:28:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1677 2024-09-10T06:28:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.559 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.968824+0000", 2024-09-10T06:28:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.968824+0000", 2024-09-10T06:28:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.968827+0000", 2024-09-10T06:28:30.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7489999999999999e-06 2024-09-10T06:28:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974158+0000", 2024-09-10T06:28:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005330942 2024-09-10T06:28:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974178+0000", 2024-09-10T06:28:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0143e-05 2024-09-10T06:28:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974187+0000", 2024-09-10T06:28:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0250000000000008e-06 2024-09-10T06:28:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974240+0000", 2024-09-10T06:28:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3341000000000003e-05 2024-09-10T06:28:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974350+0000", 2024-09-10T06:28:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109874 2024-09-10T06:28:30.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 6", 2024-09-10T06:28:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.974445+0000", 2024-09-10T06:28:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4730999999999998e-05 2024-09-10T06:28:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.980411+0000", 2024-09-10T06:28:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059658100000000002 2024-09-10T06:28:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.986640+0000", 2024-09-10T06:28:30.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062289110000000002 2024-09-10T06:28:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.986733+0000", 2024-09-10T06:28:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3646000000000004e-05 2024-09-10T06:28:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.986808+0000", 2024-09-10T06:28:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4493000000000007e-05 2024-09-10T06:28:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.564 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1757 3.3 3:c11eb9b0:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.546676+0000", 2024-09-10T06:28:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.92558526, 2024-09-10T06:28:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024581693000000002, 2024-09-10T06:28:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.565 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1757 2024-09-10T06:28:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.546676+0000", 2024-09-10T06:28:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.546676+0000", 2024-09-10T06:28:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.546678+0000", 2024-09-10T06:28:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3929999999999998e-06 2024-09-10T06:28:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.555482+0000", 2024-09-10T06:28:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088036099999999999 2024-09-10T06:28:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.555524+0000", 2024-09-10T06:28:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2382000000000002e-05 2024-09-10T06:28:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.555543+0000", 2024-09-10T06:28:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8379000000000001e-05 2024-09-10T06:28:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.555639+0000", 2024-09-10T06:28:30.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6859000000000002e-05 2024-09-10T06:28:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.555799+0000", 2024-09-10T06:28:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015953699999999999 2024-09-10T06:28:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.555949+0000", 2024-09-10T06:28:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015047899999999999 2024-09-10T06:28:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.565863+0000", 2024-09-10T06:28:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099130799999999995 2024-09-10T06:28:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.571137+0000", 2024-09-10T06:28:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052747549999999999 2024-09-10T06:28:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.571205+0000", 2024-09-10T06:28:30.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7863999999999999e-05 2024-09-10T06:28:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.571258+0000", 2024-09-10T06:28:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2355000000000003e-05 2024-09-10T06:28:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1760 3.3 3:c3b22309:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.593712+0000", 2024-09-10T06:28:30.571 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.878548683, 2024-09-10T06:28:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019158087000000001, 2024-09-10T06:28:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1760 2024-09-10T06:28:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.593712+0000", 2024-09-10T06:28:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.593712+0000", 2024-09-10T06:28:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.593714+0000", 2024-09-10T06:28:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.542e-06 2024-09-10T06:28:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.598085+0000", 2024-09-10T06:28:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043711080000000003 2024-09-10T06:28:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.598098+0000", 2024-09-10T06:28:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3028e-05 2024-09-10T06:28:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.598108+0000", 2024-09-10T06:28:30.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9070000000000002e-06 2024-09-10T06:28:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.598166+0000", 2024-09-10T06:28:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7951999999999997e-05 2024-09-10T06:28:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.598328+0000", 2024-09-10T06:28:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016156300000000001 2024-09-10T06:28:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.598443+0000", 2024-09-10T06:28:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115639 2024-09-10T06:28:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.606437+0000", 2024-09-10T06:28:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079941600000000002 2024-09-10T06:28:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.612807+0000", 2024-09-10T06:28:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063695669999999996 2024-09-10T06:28:30.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.612843+0000", 2024-09-10T06:28:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6624e-05 2024-09-10T06:28:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.612870+0000", 2024-09-10T06:28:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6996999999999999e-05 2024-09-10T06:28:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1786 3.14 3:2ba43105:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.060200+0000", 2024-09-10T06:28:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.41206071, 2024-09-10T06:28:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024374178, 2024-09-10T06:28:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1786 2024-09-10T06:28:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.578 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.060200+0000", 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.060200+0000", 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.060204+0000", 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9870000000000001e-06 2024-09-10T06:28:30.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064504+0000", 2024-09-10T06:28:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042997649999999997 2024-09-10T06:28:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064532+0000", 2024-09-10T06:28:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8365999999999999e-05 2024-09-10T06:28:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064548+0000", 2024-09-10T06:28:30.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5818999999999999e-05 2024-09-10T06:28:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064707+0000", 2024-09-10T06:28:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015854000000000001 2024-09-10T06:28:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.065113+0000", 2024-09-10T06:28:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040584200000000001 2024-09-10T06:28:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.065542+0000", 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042921799999999998 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.076775+0000", 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011233065 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.084355+0000", 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075799459999999997 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.084462+0000", 2024-09-10T06:28:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107058 2024-09-10T06:28:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.084575+0000", 2024-09-10T06:28:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011257200000000001 2024-09-10T06:28:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.583 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1789 3.31 e72/22 3:8c17f478:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_36:head v 72'7, mlcod=65'5)", 2024-09-10T06:28:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.094890+0000", 2024-09-10T06:28:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.377370839999999, 2024-09-10T06:28:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017541174, 2024-09-10T06:28:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.094890+0000", 2024-09-10T06:28:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.094890+0000", 2024-09-10T06:28:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.094892+0000", 2024-09-10T06:28:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.08e-06 2024-09-10T06:28:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.100289+0000", 2024-09-10T06:28:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053965410000000004 2024-09-10T06:28:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.100322+0000", 2024-09-10T06:28:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2864999999999998e-05 2024-09-10T06:28:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.100337+0000", 2024-09-10T06:28:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5166e-05 2024-09-10T06:28:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.100467+0000", 2024-09-10T06:28:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012983800000000001 2024-09-10T06:28:30.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.100512+0000", 2024-09-10T06:28:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5688e-05 2024-09-10T06:28:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.112302+0000", 2024-09-10T06:28:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011789475000000001 2024-09-10T06:28:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:30.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.112431+0000", 2024-09-10T06:28:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012952100000000001 2024-09-10T06:28:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:30.588 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:30.588 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:30.589 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T06:28:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:30.717 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:30.717 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:30.731 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T06:28:30.748 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T06:28:30.852 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:30.852 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:30.852 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:30.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T06:28:30.994 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1354 3.5 3:a2100466:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_109:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.071533103999997, 2024-09-10T06:28:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022320934000000001, 2024-09-10T06:28:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1354 2024-09-10T06:28:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919972+0000", 2024-09-10T06:28:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.919975+0000", 2024-09-10T06:28:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4369999999999999e-06 2024-09-10T06:28:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926675+0000", 2024-09-10T06:28:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066993529999999999 2024-09-10T06:28:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926705+0000", 2024-09-10T06:28:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0391000000000001e-05 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926722+0000", 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7159e-05 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.926840+0000", 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117459 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.927092+0000", 2024-09-10T06:28:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025180899999999997 2024-09-10T06:28:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.927353+0000", 2024-09-10T06:28:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026148499999999999 2024-09-10T06:28:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.940116+0000", 2024-09-10T06:28:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01276245 2024-09-10T06:28:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.941993+0000", 2024-09-10T06:28:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001877079 2024-09-10T06:28:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.942164+0000", 2024-09-10T06:28:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171378 2024-09-10T06:28:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.942293+0000", 2024-09-10T06:28:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012893400000000001 2024-09-10T06:28:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1355 3.16 3:6be207af:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_110:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.060783503000003, 2024-09-10T06:28:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023027044, 2024-09-10T06:28:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1355 2024-09-10T06:28:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930722+0000", 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.930724+0000", 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5100000000000001e-06 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937234+0000", 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065097760000000001 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937259+0000", 2024-09-10T06:28:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4915000000000001e-05 2024-09-10T06:28:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937275+0000", 2024-09-10T06:28:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6659000000000001e-05 2024-09-10T06:28:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937437+0000", 2024-09-10T06:28:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161259 2024-09-10T06:28:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937718+0000", 2024-09-10T06:28:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028092699999999999 2024-09-10T06:28:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.937955+0000", 2024-09-10T06:28:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023767300000000001 2024-09-10T06:28:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.952527+0000", 2024-09-10T06:28:31.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014571850000000001 2024-09-10T06:28:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953577+0000", 2024-09-10T06:28:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001049601 2024-09-10T06:28:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953671+0000", 2024-09-10T06:28:31.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4580000000000006e-05 2024-09-10T06:28:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:58.953749+0000", 2024-09-10T06:28:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7293999999999996e-05 2024-09-10T06:28:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1369 3.22 3:45ffca16:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.896730001999998, 2024-09-10T06:28:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020833028999999999, 2024-09-10T06:28:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.008 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1369 2024-09-10T06:28:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094775+0000", 2024-09-10T06:28:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.094779+0000", 2024-09-10T06:28:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1099999999999996e-06 2024-09-10T06:28:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100674+0000", 2024-09-10T06:28:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058944740000000002 2024-09-10T06:28:31.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100714+0000", 2024-09-10T06:28:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0527e-05 2024-09-10T06:28:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100732+0000", 2024-09-10T06:28:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8034999999999999e-05 2024-09-10T06:28:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.100871+0000", 2024-09-10T06:28:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013849399999999999 2024-09-10T06:28:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.101123+0000", 2024-09-10T06:28:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025259000000000002 2024-09-10T06:28:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.101372+0000", 2024-09-10T06:28:31.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024846599999999998 2024-09-10T06:28:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.111593+0000", 2024-09-10T06:28:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010221165000000001 2024-09-10T06:28:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115305+0000", 2024-09-10T06:28:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037123249999999998 2024-09-10T06:28:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115476+0000", 2024-09-10T06:28:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017085200000000001 2024-09-10T06:28:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115608+0000", 2024-09-10T06:28:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131991 2024-09-10T06:28:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1372 3.36 e63/22 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:31.014 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.853107496, 2024-09-10T06:28:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018914395000000001, 2024-09-10T06:28:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138398+0000", 2024-09-10T06:28:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138401+0000", 2024-09-10T06:28:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3859999999999999e-06 2024-09-10T06:28:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142599+0000", 2024-09-10T06:28:31.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041982190000000004 2024-09-10T06:28:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142649+0000", 2024-09-10T06:28:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9477000000000001e-05 2024-09-10T06:28:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142674+0000", 2024-09-10T06:28:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5558000000000002e-05 2024-09-10T06:28:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142832+0000", 2024-09-10T06:28:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158159 2024-09-10T06:28:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142879+0000", 2024-09-10T06:28:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6650000000000002e-05 2024-09-10T06:28:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157209+0000", 2024-09-10T06:28:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014330209999999999 2024-09-10T06:28:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157312+0000", 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102736 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1374 3.2f 3:f735f5eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_129:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.838083197, 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.028841426, 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.019 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1374 2024-09-10T06:28:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153422+0000", 2024-09-10T06:28:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.153425+0000", 2024-09-10T06:28:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8030000000000001e-06 2024-09-10T06:28:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157050+0000", 2024-09-10T06:28:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036249070000000001 2024-09-10T06:28:31.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157081+0000", 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1525000000000001e-05 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157103+0000", 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1599000000000001e-05 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157253+0000", 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150266 2024-09-10T06:28:31.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157545+0000", 2024-09-10T06:28:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029204399999999998 2024-09-10T06:28:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157898+0000", 2024-09-10T06:28:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035326200000000002 2024-09-10T06:28:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181021+0000", 2024-09-10T06:28:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023123008 2024-09-10T06:28:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.181894+0000", 2024-09-10T06:28:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00087308700000000004 2024-09-10T06:28:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.182128+0000", 2024-09-10T06:28:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000233811 2024-09-10T06:28:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.182263+0000", 2024-09-10T06:28:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013511400000000001 2024-09-10T06:28:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.025 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1391 3.1c 3:3a76b5ac:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.669346190999999, 2024-09-10T06:28:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032016492000000001, 2024-09-10T06:28:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1391 2024-09-10T06:28:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322159+0000", 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.322162+0000", 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.523e-06 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326140+0000", 2024-09-10T06:28:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039776000000000004 2024-09-10T06:28:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326177+0000", 2024-09-10T06:28:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6878000000000002e-05 2024-09-10T06:28:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326195+0000", 2024-09-10T06:28:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8576e-05 2024-09-10T06:28:31.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326334+0000", 2024-09-10T06:28:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013836600000000001 2024-09-10T06:28:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326608+0000", 2024-09-10T06:28:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000274586 2024-09-10T06:28:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.326847+0000", 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023812 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.338793+0000", 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011946141 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354011+0000", 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015217856 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354100+0000", 2024-09-10T06:28:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9497e-05 2024-09-10T06:28:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.354175+0000", 2024-09-10T06:28:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5349e-05 2024-09-10T06:28:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1399 3.38 e63/22 3:1dcd0b88:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_154:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:31.031 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.585775084000002, 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019306528999999999, 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405730+0000", 2024-09-10T06:28:31.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.405734+0000", 2024-09-10T06:28:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2529999999999998e-06 2024-09-10T06:28:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410725+0000", 2024-09-10T06:28:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049902849999999997 2024-09-10T06:28:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410776+0000", 2024-09-10T06:28:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1762999999999999e-05 2024-09-10T06:28:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410805+0000", 2024-09-10T06:28:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8274999999999999e-05 2024-09-10T06:28:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.410984+0000", 2024-09-10T06:28:31.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017977800000000001 2024-09-10T06:28:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.411050+0000", 2024-09-10T06:28:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6115e-05 2024-09-10T06:28:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424826+0000", 2024-09-10T06:28:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013775267000000001 2024-09-10T06:28:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.425037+0000", 2024-09-10T06:28:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000210793 2024-09-10T06:28:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1421 3.16 3:69839037:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_166:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.472450698999999, 2024-09-10T06:28:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022412087000000001, 2024-09-10T06:28:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.036 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1421 2024-09-10T06:28:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519054+0000", 2024-09-10T06:28:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.519058+0000", 2024-09-10T06:28:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.354e-06 2024-09-10T06:28:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.522967+0000", 2024-09-10T06:28:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003909231 2024-09-10T06:28:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523003+0000", 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5981e-05 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523021+0000", 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8362000000000001e-05 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523166+0000", 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014476699999999999 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523435+0000", 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026895800000000002 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.523671+0000", 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023608099999999999 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.538600+0000", 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014929318 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541356+0000", 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002755216 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541420+0000", 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4775000000000002e-05 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.541466+0000", 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6044000000000002e-05 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.041 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1439 3.3c 3:3e1c16d9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_184:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.285579760000001, 2024-09-10T06:28:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020786124999999999, 2024-09-10T06:28:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1439 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705925+0000", 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705929+0000", 2024-09-10T06:28:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1620000000000001e-06 2024-09-10T06:28:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.709954+0000", 2024-09-10T06:28:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004024344 2024-09-10T06:28:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.709991+0000", 2024-09-10T06:28:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6868e-05 2024-09-10T06:28:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710009+0000", 2024-09-10T06:28:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8422000000000001e-05 2024-09-10T06:28:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710091+0000", 2024-09-10T06:28:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1440000000000006e-05 2024-09-10T06:28:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.710105+0000", 2024-09-10T06:28:31.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4072e-05 2024-09-10T06:28:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.713970+0000", 2024-09-10T06:28:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038651699999999998 2024-09-10T06:28:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.714137+0000", 2024-09-10T06:28:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016704999999999999 2024-09-10T06:28:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:31.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.714352+0000", 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021503099999999999 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.721589+0000", 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072370680000000001 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726578+0000", 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049887300000000002 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726659+0000", 2024-09-10T06:28:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0972999999999999e-05 2024-09-10T06:28:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.726711+0000", 2024-09-10T06:28:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2794999999999999e-05 2024-09-10T06:28:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1454 3.5 3:a08a9c17:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_199:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:31.048 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.121102068999999, 2024-09-10T06:28:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018980882000000001, 2024-09-10T06:28:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1454 2024-09-10T06:28:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:31.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870403+0000", 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.870407+0000", 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9090000000000002e-06 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874434+0000", 2024-09-10T06:28:31.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040275700000000003 2024-09-10T06:28:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874471+0000", 2024-09-10T06:28:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6528e-05 2024-09-10T06:28:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874496+0000", 2024-09-10T06:28:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4751000000000001e-05 2024-09-10T06:28:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874624+0000", 2024-09-10T06:28:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012825600000000001 2024-09-10T06:28:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.874828+0000", 2024-09-10T06:28:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020377700000000001 2024-09-10T06:28:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.875010+0000", 2024-09-10T06:28:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018253200000000001 2024-09-10T06:28:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.883337+0000", 2024-09-10T06:28:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083265860000000004 2024-09-10T06:28:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889239+0000", 2024-09-10T06:28:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059024409999999996 2024-09-10T06:28:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889322+0000", 2024-09-10T06:28:31.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2216e-05 2024-09-10T06:28:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.889384+0000", 2024-09-10T06:28:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2316000000000004e-05 2024-09-10T06:28:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1463 3.c 3:32b18461:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_208:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:31.054 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.018130354, 2024-09-10T06:28:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019470828999999999, 2024-09-10T06:28:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1463 2024-09-10T06:28:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973375+0000", 2024-09-10T06:28:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.973377+0000", 2024-09-10T06:28:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5749999999999999e-06 2024-09-10T06:28:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977213+0000", 2024-09-10T06:28:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038358789999999999 2024-09-10T06:28:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977239+0000", 2024-09-10T06:28:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5965999999999998e-05 2024-09-10T06:28:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977252+0000", 2024-09-10T06:28:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2472e-05 2024-09-10T06:28:31.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977406+0000", 2024-09-10T06:28:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000154809 2024-09-10T06:28:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977687+0000", 2024-09-10T06:28:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028013400000000003 2024-09-10T06:28:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:31.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.977963+0000", 2024-09-10T06:28:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027642500000000001 2024-09-10T06:28:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.987026+0000", 2024-09-10T06:28:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090629430000000004 2024-09-10T06:28:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992655+0000", 2024-09-10T06:28:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056288320000000003 2024-09-10T06:28:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992765+0000", 2024-09-10T06:28:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110276 2024-09-10T06:28:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.992846+0000", 2024-09-10T06:28:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0518000000000004e-05 2024-09-10T06:28:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1469 3.d e64/22 3:b3f21559:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_214:head v 64'1, mlcod=0'0)", 2024-09-10T06:28:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.951825397, 2024-09-10T06:28:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01994638, 2024-09-10T06:28:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039680+0000", 2024-09-10T06:28:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039683+0000", 2024-09-10T06:28:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0929999999999999e-06 2024-09-10T06:28:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044782+0000", 2024-09-10T06:28:31.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050988240000000001 2024-09-10T06:28:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044821+0000", 2024-09-10T06:28:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9764000000000001e-05 2024-09-10T06:28:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044839+0000", 2024-09-10T06:28:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7598999999999999e-05 2024-09-10T06:28:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044936+0000", 2024-09-10T06:28:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7388999999999999e-05 2024-09-10T06:28:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.044962+0000", 2024-09-10T06:28:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5967999999999999e-05 2024-09-10T06:28:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059554+0000", 2024-09-10T06:28:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014592055 2024-09-10T06:28:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059626+0000", 2024-09-10T06:28:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1687999999999995e-05 2024-09-10T06:28:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1672 3.c 3:33a5f042:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.084152018000001, 2024-09-10T06:28:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019487879999999999, 2024-09-10T06:28:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.065 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1672 2024-09-10T06:28:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907353+0000", 2024-09-10T06:28:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.907355+0000", 2024-09-10T06:28:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.43e-06 2024-09-10T06:28:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.911999+0000", 2024-09-10T06:28:31.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046435979999999996 2024-09-10T06:28:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912047+0000", 2024-09-10T06:28:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8204000000000001e-05 2024-09-10T06:28:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912078+0000", 2024-09-10T06:28:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0998999999999999e-05 2024-09-10T06:28:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912197+0000", 2024-09-10T06:28:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119165 2024-09-10T06:28:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912368+0000", 2024-09-10T06:28:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000170111 2024-09-10T06:28:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.912532+0000", 2024-09-10T06:28:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016403000000000001 2024-09-10T06:28:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.920064+0000", 2024-09-10T06:28:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007531973 2024-09-10T06:28:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926719+0000", 2024-09-10T06:28:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066550840000000003 2024-09-10T06:28:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926786+0000", 2024-09-10T06:28:31.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7267999999999994e-05 2024-09-10T06:28:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.926841+0000", 2024-09-10T06:28:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5018000000000001e-05 2024-09-10T06:28:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1756 3.30 3:0c20eb42:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.524760+0000", 2024-09-10T06:28:31.071 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.46674514, 2024-09-10T06:28:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024610467, 2024-09-10T06:28:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1756 2024-09-10T06:28:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.524760+0000", 2024-09-10T06:28:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.524760+0000", 2024-09-10T06:28:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.524763+0000", 2024-09-10T06:28:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.734e-06 2024-09-10T06:28:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.532754+0000", 2024-09-10T06:28:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007991359 2024-09-10T06:28:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.532797+0000", 2024-09-10T06:28:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3282000000000003e-05 2024-09-10T06:28:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.532816+0000", 2024-09-10T06:28:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8389e-05 2024-09-10T06:28:31.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.532916+0000", 2024-09-10T06:28:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100784 2024-09-10T06:28:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.533095+0000", 2024-09-10T06:28:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000178674 2024-09-10T06:28:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:31.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.533260+0000", 2024-09-10T06:28:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016465800000000001 2024-09-10T06:28:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.541932+0000", 2024-09-10T06:28:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086723589999999993 2024-09-10T06:28:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.549254+0000", 2024-09-10T06:28:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0073213560000000002 2024-09-10T06:28:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.549318+0000", 2024-09-10T06:28:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4000999999999999e-05 2024-09-10T06:28:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.549370+0000", 2024-09-10T06:28:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2871000000000003e-05 2024-09-10T06:28:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.077 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1758 3.c 3:30c1ab1b:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.568417+0000", 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.423088261, 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.031919546, 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1758 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.568417+0000", 2024-09-10T06:28:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.568417+0000", 2024-09-10T06:28:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.568421+0000", 2024-09-10T06:28:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3830000000000002e-06 2024-09-10T06:28:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.572700+0000", 2024-09-10T06:28:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042786489999999998 2024-09-10T06:28:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.572737+0000", 2024-09-10T06:28:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7591e-05 2024-09-10T06:28:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.572754+0000", 2024-09-10T06:28:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6963e-05 2024-09-10T06:28:31.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.572880+0000", 2024-09-10T06:28:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012607100000000001 2024-09-10T06:28:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.573127+0000", 2024-09-10T06:28:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024628600000000002 2024-09-10T06:28:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:31.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.573352+0000", 2024-09-10T06:28:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022482599999999999 2024-09-10T06:28:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.582293+0000", 2024-09-10T06:28:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089417360000000005 2024-09-10T06:28:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.600217+0000", 2024-09-10T06:28:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01792384 2024-09-10T06:28:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.600285+0000", 2024-09-10T06:28:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7353000000000004e-05 2024-09-10T06:28:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.600336+0000", 2024-09-10T06:28:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1848000000000002e-05 2024-09-10T06:28:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1773 3.36 3:6dd9d777:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.854355+0000", 2024-09-10T06:28:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.137150022, 2024-09-10T06:28:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020478250999999999, 2024-09-10T06:28:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1773 2024-09-10T06:28:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.084 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.854355+0000", 2024-09-10T06:28:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.854355+0000", 2024-09-10T06:28:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.854359+0000", 2024-09-10T06:28:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.557e-06 2024-09-10T06:28:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858551+0000", 2024-09-10T06:28:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041923760000000003 2024-09-10T06:28:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858588+0000", 2024-09-10T06:28:31.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6591000000000003e-05 2024-09-10T06:28:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858605+0000", 2024-09-10T06:28:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7223000000000001e-05 2024-09-10T06:28:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858730+0000", 2024-09-10T06:28:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000125511 2024-09-10T06:28:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.858977+0000", 2024-09-10T06:28:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024648600000000002 2024-09-10T06:28:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-09-10T06:28:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.859205+0000", 2024-09-10T06:28:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000228299 2024-09-10T06:28:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.866046+0000", 2024-09-10T06:28:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068413010000000002 2024-09-10T06:28:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.874668+0000", 2024-09-10T06:28:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086216499999999998 2024-09-10T06:28:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.874760+0000", 2024-09-10T06:28:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1926e-05 2024-09-10T06:28:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.874833+0000", 2024-09-10T06:28:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3331000000000007e-05 2024-09-10T06:28:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1774 3.30 3:0db12388:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.877453+0000", 2024-09-10T06:28:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.114052045000001, 2024-09-10T06:28:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022593780000000001, 2024-09-10T06:28:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.090 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1774 2024-09-10T06:28:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.877453+0000", 2024-09-10T06:28:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.877453+0000", 2024-09-10T06:28:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.877456+0000", 2024-09-10T06:28:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6800000000000002e-06 2024-09-10T06:28:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881345+0000", 2024-09-10T06:28:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038893529999999999 2024-09-10T06:28:31.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881378+0000", 2024-09-10T06:28:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3374000000000003e-05 2024-09-10T06:28:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881394+0000", 2024-09-10T06:28:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5327000000000001e-05 2024-09-10T06:28:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881555+0000", 2024-09-10T06:28:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161356 2024-09-10T06:28:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.881815+0000", 2024-09-10T06:28:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026025499999999998 2024-09-10T06:28:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.882089+0000", 2024-09-10T06:28:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027335400000000001 2024-09-10T06:28:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.891046+0000", 2024-09-10T06:28:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0089577000000000007 2024-09-10T06:28:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.899882+0000", 2024-09-10T06:28:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088357350000000008 2024-09-10T06:28:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.899976+0000", 2024-09-10T06:28:31.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3338999999999995e-05 2024-09-10T06:28:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.900047+0000", 2024-09-10T06:28:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1307e-05 2024-09-10T06:28:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1775 3.2f 3:f4c391ba:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.096 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.900332+0000", 2024-09-10T06:28:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.091173530999999, 2024-09-10T06:28:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02158852, 2024-09-10T06:28:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1775 2024-09-10T06:28:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.900332+0000", 2024-09-10T06:28:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.900332+0000", 2024-09-10T06:28:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.900334+0000", 2024-09-10T06:28:31.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7199999999999998e-06 2024-09-10T06:28:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904266+0000", 2024-09-10T06:28:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039319439999999997 2024-09-10T06:28:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904302+0000", 2024-09-10T06:28:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6235000000000001e-05 2024-09-10T06:28:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904327+0000", 2024-09-10T06:28:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4545e-05 2024-09-10T06:28:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904515+0000", 2024-09-10T06:28:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187932 2024-09-10T06:28:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.904773+0000", 2024-09-10T06:28:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000258022 2024-09-10T06:28:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.905009+0000", 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023653899999999999 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.913889+0000", 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088796799999999992 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.921726+0000", 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078370260000000004 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.921843+0000", 2024-09-10T06:28:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011721400000000001 2024-09-10T06:28:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.921920+0000", 2024-09-10T06:28:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6662999999999994e-05 2024-09-10T06:28:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.102 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1779 3.2f 3:f63ca6bf:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.959254+0000", 2024-09-10T06:28:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.03225127, 2024-09-10T06:28:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021331428999999999, 2024-09-10T06:28:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1779 2024-09-10T06:28:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.959254+0000", 2024-09-10T06:28:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.959254+0000", 2024-09-10T06:28:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.959257+0000", 2024-09-10T06:28:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2600000000000001e-06 2024-09-10T06:28:31.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963270+0000", 2024-09-10T06:28:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040126909999999997 2024-09-10T06:28:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963309+0000", 2024-09-10T06:28:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9558000000000003e-05 2024-09-10T06:28:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963327+0000", 2024-09-10T06:28:31.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7952999999999999e-05 2024-09-10T06:28:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963468+0000", 2024-09-10T06:28:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014084699999999999 2024-09-10T06:28:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963717+0000", 2024-09-10T06:28:31.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024887800000000001 2024-09-10T06:28:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.963944+0000", 2024-09-10T06:28:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022745 2024-09-10T06:28:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976421+0000", 2024-09-10T06:28:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012476529 2024-09-10T06:28:31.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.980418+0000", 2024-09-10T06:28:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039974770000000001 2024-09-10T06:28:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.980510+0000", 2024-09-10T06:28:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1896000000000002e-05 2024-09-10T06:28:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.980585+0000", 2024-09-10T06:28:31.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4889999999999996e-05 2024-09-10T06:28:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1780 3.5 3:a2a1f206:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.970512+0000", 2024-09-10T06:28:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.020993249, 2024-09-10T06:28:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021558898, 2024-09-10T06:28:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.109 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1780 2024-09-10T06:28:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.970512+0000", 2024-09-10T06:28:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.970512+0000", 2024-09-10T06:28:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.970516+0000", 2024-09-10T06:28:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7859999999999998e-06 2024-09-10T06:28:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976034+0000", 2024-09-10T06:28:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055182190000000004 2024-09-10T06:28:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976067+0000", 2024-09-10T06:28:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3628999999999999e-05 2024-09-10T06:28:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976085+0000", 2024-09-10T06:28:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7921999999999999e-05 2024-09-10T06:28:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976224+0000", 2024-09-10T06:28:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000138171 2024-09-10T06:28:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976551+0000", 2024-09-10T06:28:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032767199999999999 2024-09-10T06:28:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.976821+0000", 2024-09-10T06:28:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026987400000000003 2024-09-10T06:28:31.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.986827+0000", 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010006088999999999 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.991915+0000", 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050881859999999998 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.992005+0000", 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9553000000000001e-05 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.992071+0000", 2024-09-10T06:28:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5796999999999994e-05 2024-09-10T06:28:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.115 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.115 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:31.116 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T06:28:31.124 INFO:teuthology.orchestra.run.smithi112.stderr:noscrub is unset 2024-09-10T06:28:31.149 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T06:28:31.243 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:31.243 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:31.244 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:31.258 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T06:28:31.380 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:31.380 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:31.381 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:31.381 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:31.395 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T06:28:31.518 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:31.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1363 3.a 3:52044754:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.494177116000003, 2024-09-10T06:28:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021475438999999999, 2024-09-10T06:28:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.519 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1363 2024-09-10T06:28:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023228+0000", 2024-09-10T06:28:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.023232+0000", 2024-09-10T06:28:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6500000000000002e-06 2024-09-10T06:28:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027903+0000", 2024-09-10T06:28:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046709569999999999 2024-09-10T06:28:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027944+0000", 2024-09-10T06:28:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1e-05 2024-09-10T06:28:31.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.027963+0000", 2024-09-10T06:28:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9363000000000001e-05 2024-09-10T06:28:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028108+0000", 2024-09-10T06:28:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144306 2024-09-10T06:28:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028370+0000", 2024-09-10T06:28:31.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026210300000000002 2024-09-10T06:28:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.028610+0000", 2024-09-10T06:28:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024058 2024-09-10T06:28:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.036472+0000", 2024-09-10T06:28:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078620170000000007 2024-09-10T06:28:31.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044306+0000", 2024-09-10T06:28:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078340070000000005 2024-09-10T06:28:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044496+0000", 2024-09-10T06:28:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189507 2024-09-10T06:28:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.044704+0000", 2024-09-10T06:28:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207949 2024-09-10T06:28:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1364 3.36 3:6e968b0d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_119:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.482185577999999, 2024-09-10T06:28:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022135317000000002, 2024-09-10T06:28:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.525 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1364 2024-09-10T06:28:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035220+0000", 2024-09-10T06:28:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.035266+0000", 2024-09-10T06:28:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6529999999999997e-05 2024-09-10T06:28:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039528+0000", 2024-09-10T06:28:31.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042612580000000004 2024-09-10T06:28:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039570+0000", 2024-09-10T06:28:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2481000000000002e-05 2024-09-10T06:28:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039594+0000", 2024-09-10T06:28:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3564999999999999e-05 2024-09-10T06:28:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039735+0000", 2024-09-10T06:28:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014147000000000001 2024-09-10T06:28:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.039983+0000", 2024-09-10T06:28:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024765399999999998 2024-09-10T06:28:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:31.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.040216+0000", 2024-09-10T06:28:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023322999999999999 2024-09-10T06:28:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.049930+0000", 2024-09-10T06:28:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097135920000000001 2024-09-10T06:28:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057061+0000", 2024-09-10T06:28:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071309570000000003 2024-09-10T06:28:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057234+0000", 2024-09-10T06:28:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173308 2024-09-10T06:28:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.057355+0000", 2024-09-10T06:28:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121272 2024-09-10T06:28:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.531 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1370 3.26 3:64e41eab:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_125:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.407450046000001, 2024-09-10T06:28:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022030800999999999, 2024-09-10T06:28:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1370 2024-09-10T06:28:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109956+0000", 2024-09-10T06:28:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.109960+0000", 2024-09-10T06:28:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3930000000000001e-06 2024-09-10T06:28:31.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114711+0000", 2024-09-10T06:28:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047511580000000001 2024-09-10T06:28:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114749+0000", 2024-09-10T06:28:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8417999999999997e-05 2024-09-10T06:28:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114768+0000", 2024-09-10T06:28:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8352e-05 2024-09-10T06:28:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.114926+0000", 2024-09-10T06:28:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015819599999999999 2024-09-10T06:28:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115321+0000", 2024-09-10T06:28:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039507300000000002 2024-09-10T06:28:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.115735+0000", 2024-09-10T06:28:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041369900000000001 2024-09-10T06:28:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.125212+0000", 2024-09-10T06:28:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094774109999999998 2024-09-10T06:28:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131666+0000", 2024-09-10T06:28:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064533730000000001 2024-09-10T06:28:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131847+0000", 2024-09-10T06:28:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018112400000000001 2024-09-10T06:28:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.131986+0000", 2024-09-10T06:28:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013960399999999999 2024-09-10T06:28:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.537 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1371 3.2e e63/22 3:741ddced:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_126:head v 63'3, mlcod=63'1)", 2024-09-10T06:28:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.392489582000003, 2024-09-10T06:28:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024440024000000001, 2024-09-10T06:28:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124916+0000", 2024-09-10T06:28:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.124919+0000", 2024-09-10T06:28:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-09-10T06:28:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130095+0000", 2024-09-10T06:28:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00517645 2024-09-10T06:28:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130125+0000", 2024-09-10T06:28:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9944e-05 2024-09-10T06:28:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130142+0000", 2024-09-10T06:28:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6515999999999999e-05 2024-09-10T06:28:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130252+0000", 2024-09-10T06:28:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110473 2024-09-10T06:28:31.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.130297+0000", 2024-09-10T06:28:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5012999999999997e-05 2024-09-10T06:28:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149096+0000", 2024-09-10T06:28:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018799429999999999 2024-09-10T06:28:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.149356+0000", 2024-09-10T06:28:31.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000259499 2024-09-10T06:28:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1372 3.36 3:6fe4c4f2:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.384932958, 2024-09-10T06:28:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.026714723999999999, 2024-09-10T06:28:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.542 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1372 2024-09-10T06:28:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132473+0000", 2024-09-10T06:28:31.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.132475+0000", 2024-09-10T06:28:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.65e-06 2024-09-10T06:28:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137399+0000", 2024-09-10T06:28:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049236530000000001 2024-09-10T06:28:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137432+0000", 2024-09-10T06:28:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3050999999999999e-05 2024-09-10T06:28:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137449+0000", 2024-09-10T06:28:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6976000000000001e-05 2024-09-10T06:28:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137569+0000", 2024-09-10T06:28:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012016899999999999 2024-09-10T06:28:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.137884+0000", 2024-09-10T06:28:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031455799999999999 2024-09-10T06:28:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.138191+0000", 2024-09-10T06:28:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000307466 2024-09-10T06:28:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157760+0000", 2024-09-10T06:28:31.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019569128000000002 2024-09-10T06:28:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.157954+0000", 2024-09-10T06:28:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019375300000000001 2024-09-10T06:28:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158118+0000", 2024-09-10T06:28:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016390900000000001 2024-09-10T06:28:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.159187+0000", 2024-09-10T06:28:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010694109999999999 2024-09-10T06:28:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1373 3.35 3:ac8a3287:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_128:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.374599967000002, 2024-09-10T06:28:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023907627000000001, 2024-09-10T06:28:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.548 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1373 2024-09-10T06:28:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142806+0000", 2024-09-10T06:28:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.142810+0000", 2024-09-10T06:28:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6129999999999997e-06 2024-09-10T06:28:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.146972+0000", 2024-09-10T06:28:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041615180000000003 2024-09-10T06:28:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147029+0000", 2024-09-10T06:28:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7476000000000003e-05 2024-09-10T06:28:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147056+0000", 2024-09-10T06:28:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7021000000000001e-05 2024-09-10T06:28:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147249+0000", 2024-09-10T06:28:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019260999999999999 2024-09-10T06:28:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.147702+0000", 2024-09-10T06:28:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00045347999999999997 2024-09-10T06:28:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.148113+0000", 2024-09-10T06:28:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041051899999999998 2024-09-10T06:28:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161583+0000", 2024-09-10T06:28:31.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013470278 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166410+0000", 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048270199999999996 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166579+0000", 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016839099999999999 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.166713+0000", 2024-09-10T06:28:31.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013470100000000001 2024-09-10T06:28:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1387 3.35 3:adfbe02e:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_142:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.235471680000003, 2024-09-10T06:28:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021055645000000001, 2024-09-10T06:28:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1387 2024-09-10T06:28:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281934+0000", 2024-09-10T06:28:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.281938+0000", 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0659999999999997e-06 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286048+0000", 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041104560000000002 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286097+0000", 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8715999999999999e-05 2024-09-10T06:28:31.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286126+0000", 2024-09-10T06:28:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9308000000000001e-05 2024-09-10T06:28:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286279+0000", 2024-09-10T06:28:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015285400000000001 2024-09-10T06:28:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286520+0000", 2024-09-10T06:28:31.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024062000000000001 2024-09-10T06:28:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.286772+0000", 2024-09-10T06:28:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025170599999999998 2024-09-10T06:28:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.301846+0000", 2024-09-10T06:28:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015074363 2024-09-10T06:28:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302698+0000", 2024-09-10T06:28:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000852179 2024-09-10T06:28:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302864+0000", 2024-09-10T06:28:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016568900000000001 2024-09-10T06:28:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.302990+0000", 2024-09-10T06:28:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012568799999999999 2024-09-10T06:28:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1398 3.2c 3:350a23e7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_153:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.122428360999997, 2024-09-10T06:28:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032248536000000001, 2024-09-10T06:28:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.560 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1398 2024-09-10T06:28:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394977+0000", 2024-09-10T06:28:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.394981+0000", 2024-09-10T06:28:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7359999999999999e-06 2024-09-10T06:28:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402145+0000", 2024-09-10T06:28:31.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071643540000000004 2024-09-10T06:28:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402182+0000", 2024-09-10T06:28:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6318e-05 2024-09-10T06:28:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402200+0000", 2024-09-10T06:28:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8439000000000001e-05 2024-09-10T06:28:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402391+0000", 2024-09-10T06:28:31.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190917 2024-09-10T06:28:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402649+0000", 2024-09-10T06:28:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025817599999999999 2024-09-10T06:28:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.402908+0000", 2024-09-10T06:28:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025864300000000002 2024-09-10T06:28:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.424973+0000", 2024-09-10T06:28:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022065004999999999 2024-09-10T06:28:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.426990+0000", 2024-09-10T06:28:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020169340000000002 2024-09-10T06:28:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427129+0000", 2024-09-10T06:28:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139436 2024-09-10T06:28:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.427226+0000", 2024-09-10T06:28:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6577999999999996e-05 2024-09-10T06:28:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1415 3.2c 3:34c14757:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_160:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.054581362999997, 2024-09-10T06:28:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029598765999999999, 2024-09-10T06:28:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.567 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1415 2024-09-10T06:28:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462824+0000", 2024-09-10T06:28:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.462828+0000", 2024-09-10T06:28:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1999999999999996e-06 2024-09-10T06:28:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.466974+0000", 2024-09-10T06:28:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041452989999999999 2024-09-10T06:28:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467026+0000", 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2416000000000001e-05 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467055+0000", 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9081000000000002e-05 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467207+0000", 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015225699999999999 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467468+0000", 2024-09-10T06:28:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026093500000000001 2024-09-10T06:28:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.467755+0000", 2024-09-10T06:28:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000287101 2024-09-10T06:28:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477312+0000", 2024-09-10T06:28:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095560300000000001 2024-09-10T06:28:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492136+0000", 2024-09-10T06:28:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014824936 2024-09-10T06:28:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492301+0000", 2024-09-10T06:28:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016411600000000001 2024-09-10T06:28:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.492423+0000", 2024-09-10T06:28:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122395 2024-09-10T06:28:31.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1416 3.10 3:084717f7:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_161:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.045547114999998, 2024-09-10T06:28:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021526931999999999, 2024-09-10T06:28:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1416 2024-09-10T06:28:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471858+0000", 2024-09-10T06:28:31.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.471863+0000", 2024-09-10T06:28:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-09-10T06:28:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477370+0000", 2024-09-10T06:28:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055071549999999997 2024-09-10T06:28:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477402+0000", 2024-09-10T06:28:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1498000000000002e-05 2024-09-10T06:28:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477423+0000", 2024-09-10T06:28:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1098e-05 2024-09-10T06:28:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477559+0000", 2024-09-10T06:28:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136627 2024-09-10T06:28:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.477936+0000", 2024-09-10T06:28:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037718099999999998 2024-09-10T06:28:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.478271+0000", 2024-09-10T06:28:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00033427799999999997 2024-09-10T06:28:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.490997+0000", 2024-09-10T06:28:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012725858 2024-09-10T06:28:31.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493126+0000", 2024-09-10T06:28:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002129499 2024-09-10T06:28:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493263+0000", 2024-09-10T06:28:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013682500000000001 2024-09-10T06:28:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.493385+0000", 2024-09-10T06:28:31.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122414 2024-09-10T06:28:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1482 3.35 3:ad9242de:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_227:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.357241381000001, 2024-09-10T06:28:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022710764000000001, 2024-09-10T06:28:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1482 2024-09-10T06:28:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160164+0000", 2024-09-10T06:28:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.160166+0000", 2024-09-10T06:28:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1069999999999999e-06 2024-09-10T06:28:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163977+0000", 2024-09-10T06:28:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003810843 2024-09-10T06:28:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.163995+0000", 2024-09-10T06:28:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7648000000000001e-05 2024-09-10T06:28:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164010+0000", 2024-09-10T06:28:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4754e-05 2024-09-10T06:28:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164094+0000", 2024-09-10T06:28:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4473000000000003e-05 2024-09-10T06:28:31.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164281+0000", 2024-09-10T06:28:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018659699999999999 2024-09-10T06:28:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.164458+0000", 2024-09-10T06:28:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017758300000000001 2024-09-10T06:28:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.179923+0000", 2024-09-10T06:28:31.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015465269 2024-09-10T06:28:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182736+0000", 2024-09-10T06:28:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028130579999999998 2024-09-10T06:28:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182816+0000", 2024-09-10T06:28:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9976999999999997e-05 2024-09-10T06:28:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.182875+0000", 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8455000000000002e-05 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1664 3.a 3:52f62ee7:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.693216142000001, 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020253482999999999, 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1664 2024-09-10T06:28:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824189+0000", 2024-09-10T06:28:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.824193+0000", 2024-09-10T06:28:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6059999999999999e-06 2024-09-10T06:28:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829549+0000", 2024-09-10T06:28:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053562189999999997 2024-09-10T06:28:31.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829584+0000", 2024-09-10T06:28:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4925000000000002e-05 2024-09-10T06:28:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829602+0000", 2024-09-10T06:28:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8034999999999999e-05 2024-09-10T06:28:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829716+0000", 2024-09-10T06:28:31.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113522 2024-09-10T06:28:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.829903+0000", 2024-09-10T06:28:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187443 2024-09-10T06:28:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.830162+0000", 2024-09-10T06:28:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025917900000000001 2024-09-10T06:28:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.843459+0000", 2024-09-10T06:28:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01329675 2024-09-10T06:28:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844211+0000", 2024-09-10T06:28:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075213700000000005 2024-09-10T06:28:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844286+0000", 2024-09-10T06:28:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4453e-05 2024-09-10T06:28:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.844443+0000", 2024-09-10T06:28:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157214 2024-09-10T06:28:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1754 3.3b 3:ded70450:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.481010+0000", 2024-09-10T06:28:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.036395735999999, 2024-09-10T06:28:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033092867999999998, 2024-09-10T06:28:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.591 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1754 2024-09-10T06:28:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.481010+0000", 2024-09-10T06:28:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.481010+0000", 2024-09-10T06:28:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.481012+0000", 2024-09-10T06:28:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-09-10T06:28:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487559+0000", 2024-09-10T06:28:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065467889999999999 2024-09-10T06:28:31.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487603+0000", 2024-09-10T06:28:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3254999999999998e-05 2024-09-10T06:28:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487622+0000", 2024-09-10T06:28:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9142000000000001e-05 2024-09-10T06:28:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.487793+0000", 2024-09-10T06:28:31.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017092299999999999 2024-09-10T06:28:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.488035+0000", 2024-09-10T06:28:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000242563 2024-09-10T06:28:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.488258+0000", 2024-09-10T06:28:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022282000000000001 2024-09-10T06:28:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.501495+0000", 2024-09-10T06:28:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013236988 2024-09-10T06:28:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.513877+0000", 2024-09-10T06:28:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012382166 2024-09-10T06:28:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.513986+0000", 2024-09-10T06:28:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108405 2024-09-10T06:28:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.514103+0000", 2024-09-10T06:28:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117155 2024-09-10T06:28:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1765 3.2c 3:36655c69:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.683969+0000", 2024-09-10T06:28:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.833436854999999, 2024-09-10T06:28:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018761877999999999, 2024-09-10T06:28:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1765 2024-09-10T06:28:31.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.683969+0000", 2024-09-10T06:28:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.683969+0000", 2024-09-10T06:28:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.683971+0000", 2024-09-10T06:28:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7250000000000002e-06 2024-09-10T06:28:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688364+0000", 2024-09-10T06:28:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043926399999999997 2024-09-10T06:28:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688389+0000", 2024-09-10T06:28:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5199999999999999e-05 2024-09-10T06:28:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688401+0000", 2024-09-10T06:28:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1834999999999999e-05 2024-09-10T06:28:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688496+0000", 2024-09-10T06:28:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4661999999999996e-05 2024-09-10T06:28:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688685+0000", 2024-09-10T06:28:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018916899999999999 2024-09-10T06:28:31.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.688800+0000", 2024-09-10T06:28:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115047 2024-09-10T06:28:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.696257+0000", 2024-09-10T06:28:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007457371 2024-09-10T06:28:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.702611+0000", 2024-09-10T06:28:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063533180000000002 2024-09-10T06:28:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.702693+0000", 2024-09-10T06:28:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2021000000000006e-05 2024-09-10T06:28:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.702731+0000", 2024-09-10T06:28:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7889999999999998e-05 2024-09-10T06:28:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1768 3.26 3:655dfe81:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.749704+0000", 2024-09-10T06:28:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.767701318, 2024-09-10T06:28:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018211538999999999, 2024-09-10T06:28:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.604 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1768 2024-09-10T06:28:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.749704+0000", 2024-09-10T06:28:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.749704+0000", 2024-09-10T06:28:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.749707+0000", 2024-09-10T06:28:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8490000000000002e-06 2024-09-10T06:28:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753470+0000", 2024-09-10T06:28:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003762601 2024-09-10T06:28:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753503+0000", 2024-09-10T06:28:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3556999999999997e-05 2024-09-10T06:28:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753517+0000", 2024-09-10T06:28:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3946e-05 2024-09-10T06:28:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753641+0000", 2024-09-10T06:28:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012349099999999999 2024-09-10T06:28:31.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.753919+0000", 2024-09-10T06:28:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027816400000000002 2024-09-10T06:28:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.754150+0000", 2024-09-10T06:28:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000230967 2024-09-10T06:28:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767713+0000", 2024-09-10T06:28:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013563225999999999 2024-09-10T06:28:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767757+0000", 2024-09-10T06:28:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4401999999999999e-05 2024-09-10T06:28:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767848+0000", 2024-09-10T06:28:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0209000000000003e-05 2024-09-10T06:28:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.767916+0000", 2024-09-10T06:28:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8126999999999993e-05 2024-09-10T06:28:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1771 3.10 3:0b728edd:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.819227+0000", 2024-09-10T06:28:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.698178420000001, 2024-09-10T06:28:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020819891, 2024-09-10T06:28:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.610 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1771 2024-09-10T06:28:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.819227+0000", 2024-09-10T06:28:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.819227+0000", 2024-09-10T06:28:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.819231+0000", 2024-09-10T06:28:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.596e-06 2024-09-10T06:28:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823354+0000", 2024-09-10T06:28:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041235350000000002 2024-09-10T06:28:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823376+0000", 2024-09-10T06:28:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1838999999999999e-05 2024-09-10T06:28:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823394+0000", 2024-09-10T06:28:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8116000000000001e-05 2024-09-10T06:28:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823527+0000", 2024-09-10T06:28:31.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013270799999999999 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.823790+0000", 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026267199999999998 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.824038+0000", 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024825200000000002 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.832733+0000", 2024-09-10T06:28:31.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086948110000000002 2024-09-10T06:28:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.839945+0000", 2024-09-10T06:28:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072128119999999999 2024-09-10T06:28:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.840000+0000", 2024-09-10T06:28:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4987000000000001e-05 2024-09-10T06:28:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.840047+0000", 2024-09-10T06:28:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6563000000000001e-05 2024-09-10T06:28:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1776 3.10 3:08e15545:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:14.923066+0000", 2024-09-10T06:28:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.594339207000001, 2024-09-10T06:28:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027201434, 2024-09-10T06:28:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.616 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1776 2024-09-10T06:28:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.923066+0000", 2024-09-10T06:28:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.923066+0000", 2024-09-10T06:28:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.923070+0000", 2024-09-10T06:28:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9859999999999996e-06 2024-09-10T06:28:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927726+0000", 2024-09-10T06:28:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046555549999999996 2024-09-10T06:28:31.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927764+0000", 2024-09-10T06:28:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7709000000000001e-05 2024-09-10T06:28:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927782+0000", 2024-09-10T06:28:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8592000000000001e-05 2024-09-10T06:28:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.927974+0000", 2024-09-10T06:28:31.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019189500000000001 2024-09-10T06:28:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.928245+0000", 2024-09-10T06:28:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000270454 2024-09-10T06:28:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.928474+0000", 2024-09-10T06:28:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022925699999999999 2024-09-10T06:28:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.935435+0000", 2024-09-10T06:28:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069609049999999999 2024-09-10T06:28:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.950096+0000", 2024-09-10T06:28:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014661097999999999 2024-09-10T06:28:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.950190+0000", 2024-09-10T06:28:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4631999999999998e-05 2024-09-10T06:28:31.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:14.950268+0000", 2024-09-10T06:28:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7350999999999999e-05 2024-09-10T06:28:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1784 3.20 3:054632f9:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.038819+0000", 2024-09-10T06:28:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.478586786000001, 2024-09-10T06:28:31.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02561799, 2024-09-10T06:28:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1784 2024-09-10T06:28:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.038819+0000", 2024-09-10T06:28:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.038819+0000", 2024-09-10T06:28:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.038822+0000", 2024-09-10T06:28:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6059999999999999e-06 2024-09-10T06:28:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043474+0000", 2024-09-10T06:28:31.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004651947 2024-09-10T06:28:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043515+0000", 2024-09-10T06:28:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0901e-05 2024-09-10T06:28:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043533+0000", 2024-09-10T06:28:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7989999999999999e-05 2024-09-10T06:28:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043684+0000", 2024-09-10T06:28:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150786 2024-09-10T06:28:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.043937+0000", 2024-09-10T06:28:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025274899999999997 2024-09-10T06:28:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.044177+0000", 2024-09-10T06:28:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024046000000000001 2024-09-10T06:28:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.050984+0000", 2024-09-10T06:28:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006806739 2024-09-10T06:28:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064079+0000", 2024-09-10T06:28:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013094924000000001 2024-09-10T06:28:31.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064258+0000", 2024-09-10T06:28:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017905500000000001 2024-09-10T06:28:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.064437+0000", 2024-09-10T06:28:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017883299999999999 2024-09-10T06:28:31.628 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1792 3.26 3:674d8f8e:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.126132+0000", 2024-09-10T06:28:31.629 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.3912738, 2024-09-10T06:28:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022657136000000001, 2024-09-10T06:28:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1792 2024-09-10T06:28:31.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.126132+0000", 2024-09-10T06:28:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.126132+0000", 2024-09-10T06:28:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.126136+0000", 2024-09-10T06:28:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8700000000000002e-06 2024-09-10T06:28:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130132+0000", 2024-09-10T06:28:31.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039961140000000003 2024-09-10T06:28:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130172+0000", 2024-09-10T06:28:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0052000000000002e-05 2024-09-10T06:28:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130191+0000", 2024-09-10T06:28:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9176000000000001e-05 2024-09-10T06:28:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130393+0000", 2024-09-10T06:28:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020170400000000001 2024-09-10T06:28:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130656+0000", 2024-09-10T06:28:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000262952 2024-09-10T06:28:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 7", 2024-09-10T06:28:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.130893+0000", 2024-09-10T06:28:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023785599999999999 2024-09-10T06:28:31.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.138071+0000", 2024-09-10T06:28:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071771969999999997 2024-09-10T06:28:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.148497+0000", 2024-09-10T06:28:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010426444 2024-09-10T06:28:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.148669+0000", 2024-09-10T06:28:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000172096 2024-09-10T06:28:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.148789+0000", 2024-09-10T06:28:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119675 2024-09-10T06:28:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.636 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1793 3.20 3:044d7174:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.136820+0000", 2024-09-10T06:28:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.380585377999999, 2024-09-10T06:28:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024061645, 2024-09-10T06:28:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:31.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1793 2024-09-10T06:28:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.136820+0000", 2024-09-10T06:28:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.136820+0000", 2024-09-10T06:28:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.136825+0000", 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4700000000000004e-06 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.142937+0000", 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061127400000000002 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.142976+0000", 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8927999999999997e-05 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143003+0000", 2024-09-10T06:28:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6914999999999999e-05 2024-09-10T06:28:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143141+0000", 2024-09-10T06:28:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013770399999999999 2024-09-10T06:28:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143399+0000", 2024-09-10T06:28:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025788299999999998 2024-09-10T06:28:31.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.143650+0000", 2024-09-10T06:28:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025162200000000001 2024-09-10T06:28:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.151461+0000", 2024-09-10T06:28:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078103410000000002 2024-09-10T06:28:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.160675+0000", 2024-09-10T06:28:31.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092145309999999998 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.160773+0000", 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7316000000000001e-05 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.160882+0000", 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109195 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:31.642 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:31.643 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:31.644 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T06:28:31.773 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-09-10T06:28:31.774 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:31.788 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T06:28:31.909 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-09-10T06:28:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-09-10T06:28:31.909 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-09-10T06:28:31.909 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:31.923 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T06:28:32.047 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-09-10T06:28:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-09-10T06:28:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-09-10T06:28:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-09-10T06:28:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:32.047 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 134.59891520100001, 2024-09-10T06:28:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70775834699999995, 2024-09-10T06:28:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1 2024-09-10T06:28:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446849+0000", 2024-09-10T06:28:32.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446852+0000", 2024-09-10T06:28:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.117e-06 2024-09-10T06:28:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446870+0000", 2024-09-10T06:28:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7569999999999999e-05 2024-09-10T06:28:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446892+0000", 2024-09-10T06:28:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2036e-05 2024-09-10T06:28:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.446908+0000", 2024-09-10T06:28:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6719999999999999e-05 2024-09-10T06:28:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447040+0000", 2024-09-10T06:28:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013118299999999999 2024-09-10T06:28:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-09-10T06:28:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:17.447054+0000", 2024-09-10T06:28:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4343e-05 2024-09-10T06:28:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.151730+0000", 2024-09-10T06:28:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.70467560600000001 2024-09-10T06:28:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152054+0000", 2024-09-10T06:28:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032444100000000002 2024-09-10T06:28:32.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.152404+0000", 2024-09-10T06:28:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000349938 2024-09-10T06:28:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.153773+0000", 2024-09-10T06:28:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013693620000000001 2024-09-10T06:28:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154454+0000", 2024-09-10T06:28:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00068035800000000005 2024-09-10T06:28:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154544+0000", 2024-09-10T06:28:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0623000000000003e-05 2024-09-10T06:28:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.154607+0000", 2024-09-10T06:28:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3050000000000001e-05 2024-09-10T06:28:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.054 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 133.760687281, 2024-09-10T06:28:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021819150999999998, 2024-09-10T06:28:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:32.055 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 51 2024-09-10T06:28:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285077+0000", 2024-09-10T06:28:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285078+0000", 2024-09-10T06:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000001e-07 2024-09-10T06:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285083+0000", 2024-09-10T06:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6099999999999997e-06 2024-09-10T06:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285092+0000", 2024-09-10T06:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2399999999999996e-06 2024-09-10T06:28:32.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285100+0000", 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8739999999999995e-06 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.300938+0000", 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015837527000000001 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301058+0000", 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012032300000000001 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301251+0000", 2024-09-10T06:28:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192828 2024-09-10T06:28:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302937+0000", 2024-09-10T06:28:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016857339999999999 2024-09-10T06:28:32.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306745+0000", 2024-09-10T06:28:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038078729999999998 2024-09-10T06:28:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306830+0000", 2024-09-10T06:28:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5432999999999993e-05 2024-09-10T06:28:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306896+0000", 2024-09-10T06:28:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5993000000000003e-05 2024-09-10T06:28:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4167.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T06:28:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:32.061 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 133.76064740499999, 2024-09-10T06:28:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021995553000000001, 2024-09-10T06:28:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4167", 2024-09-10T06:28:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/4234701950", 2024-09-10T06:28:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 52 2024-09-10T06:28:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:32.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285117+0000", 2024-09-10T06:28:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4000000000000001e-07 2024-09-10T06:28:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285123+0000", 2024-09-10T06:28:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6969999999999998e-06 2024-09-10T06:28:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285132+0000", 2024-09-10T06:28:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1560000000000001e-06 2024-09-10T06:28:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.285139+0000", 2024-09-10T06:28:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1539999999999996e-06 2024-09-10T06:28:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301865+0000", 2024-09-10T06:28:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016725173999999999 2024-09-10T06:28:32.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.301995+0000", 2024-09-10T06:28:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130739 2024-09-10T06:28:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 0", 2024-09-10T06:28:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.302195+0000", 2024-09-10T06:28:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000199965 2024-09-10T06:28:32.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.303135+0000", 2024-09-10T06:28:32.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093978300000000002 2024-09-10T06:28:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.306979+0000", 2024-09-10T06:28:32.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038437459999999999 2024-09-10T06:28:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307057+0000", 2024-09-10T06:28:32.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7766e-05 2024-09-10T06:28:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:26:18.307112+0000", 2024-09-10T06:28:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5733000000000003e-05 2024-09-10T06:28:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.072 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.073 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4358.0:1374 3.2f e63/22 3:f735f5eb:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_129:head v 63'4, mlcod=63'2)", 2024-09-10T06:28:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.887604160000002, 2024-09-10T06:28:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022402502000000001, 2024-09-10T06:28:32.074 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158160+0000", 2024-09-10T06:28:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.158162+0000", 2024-09-10T06:28:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4569999999999999e-06 2024-09-10T06:28:32.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161871+0000", 2024-09-10T06:28:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037080799999999999 2024-09-10T06:28:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161914+0000", 2024-09-10T06:28:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3571e-05 2024-09-10T06:28:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.161940+0000", 2024-09-10T06:28:32.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5876000000000001e-05 2024-09-10T06:28:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.162081+0000", 2024-09-10T06:28:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014147000000000001 2024-09-10T06:28:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.162123+0000", 2024-09-10T06:28:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1666999999999999e-05 2024-09-10T06:28:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.180416+0000", 2024-09-10T06:28:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018292881 2024-09-10T06:28:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.180562+0000", 2024-09-10T06:28:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014650000000000001 2024-09-10T06:28:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1378 3.2d 3:b4d0ba6d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_133:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.854043501, 2024-09-10T06:28:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.029738187999999999, 2024-09-10T06:28:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1378 2024-09-10T06:28:32.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191721+0000", 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.191724+0000", 2024-09-10T06:28:32.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2650000000000001e-06 2024-09-10T06:28:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196514+0000", 2024-09-10T06:28:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047904039999999998 2024-09-10T06:28:32.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196552+0000", 2024-09-10T06:28:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8034999999999998e-05 2024-09-10T06:28:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196577+0000", 2024-09-10T06:28:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5120999999999999e-05 2024-09-10T06:28:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196716+0000", 2024-09-10T06:28:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013837699999999999 2024-09-10T06:28:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.196970+0000", 2024-09-10T06:28:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025406300000000001 2024-09-10T06:28:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.197196+0000", 2024-09-10T06:28:32.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022647499999999999 2024-09-10T06:28:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.211315+0000", 2024-09-10T06:28:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014118175 2024-09-10T06:28:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.220793+0000", 2024-09-10T06:28:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094785640000000001 2024-09-10T06:28:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221044+0000", 2024-09-10T06:28:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025106 2024-09-10T06:28:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221459+0000", 2024-09-10T06:28:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00041464900000000001 2024-09-10T06:28:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1379 3.11 3:8ad434e9:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_134:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:32.088 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.844365083, 2024-09-10T06:28:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021255388, 2024-09-10T06:28:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1379 2024-09-10T06:28:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201399+0000", 2024-09-10T06:28:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.201402+0000", 2024-09-10T06:28:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2459999999999999e-06 2024-09-10T06:28:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205915+0000", 2024-09-10T06:28:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045131149999999998 2024-09-10T06:28:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205948+0000", 2024-09-10T06:28:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2259999999999999e-05 2024-09-10T06:28:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.205966+0000", 2024-09-10T06:28:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8238999999999999e-05 2024-09-10T06:28:32.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.206162+0000", 2024-09-10T06:28:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000195782 2024-09-10T06:28:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.206607+0000", 2024-09-10T06:28:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044565000000000002 2024-09-10T06:28:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:32.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.207031+0000", 2024-09-10T06:28:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000423714 2024-09-10T06:28:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.221664+0000", 2024-09-10T06:28:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014632895 2024-09-10T06:28:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222398+0000", 2024-09-10T06:28:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073376099999999998 2024-09-10T06:28:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222569+0000", 2024-09-10T06:28:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017139400000000001 2024-09-10T06:28:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.222654+0000", 2024-09-10T06:28:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5332000000000002e-05 2024-09-10T06:28:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1426 3.2d 3:b764a1d5:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_171:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T06:28:32.094 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.47902449, 2024-09-10T06:28:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.027451646999999999, 2024-09-10T06:28:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1426 2024-09-10T06:28:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566740+0000", 2024-09-10T06:28:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.566742+0000", 2024-09-10T06:28:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.317e-06 2024-09-10T06:28:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570553+0000", 2024-09-10T06:28:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038114680000000001 2024-09-10T06:28:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570585+0000", 2024-09-10T06:28:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1940999999999998e-05 2024-09-10T06:28:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570601+0000", 2024-09-10T06:28:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5218000000000001e-05 2024-09-10T06:28:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570723+0000", 2024-09-10T06:28:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012265099999999999 2024-09-10T06:28:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.570966+0000", 2024-09-10T06:28:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024268099999999999 2024-09-10T06:28:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.571204+0000", 2024-09-10T06:28:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000238213 2024-09-10T06:28:32.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.584059+0000", 2024-09-10T06:28:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012854477 2024-09-10T06:28:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594094+0000", 2024-09-10T06:28:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010034992 2024-09-10T06:28:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594146+0000", 2024-09-10T06:28:32.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2497999999999998e-05 2024-09-10T06:28:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.594191+0000", 2024-09-10T06:28:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5191000000000002e-05 2024-09-10T06:28:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1435 3.2d 3:b4574439:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_180:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.382278532999997, 2024-09-10T06:28:32.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.035042897000000003, 2024-09-10T06:28:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1435 2024-09-10T06:28:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663486+0000", 2024-09-10T06:28:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.663488+0000", 2024-09-10T06:28:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.616e-06 2024-09-10T06:28:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667246+0000", 2024-09-10T06:28:32.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037580579999999999 2024-09-10T06:28:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667277+0000", 2024-09-10T06:28:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0688000000000002e-05 2024-09-10T06:28:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667291+0000", 2024-09-10T06:28:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4472e-05 2024-09-10T06:28:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667411+0000", 2024-09-10T06:28:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011913699999999999 2024-09-10T06:28:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.667422+0000", 2024-09-10T06:28:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1073000000000001e-05 2024-09-10T06:28:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674124+0000", 2024-09-10T06:28:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067023619999999999 2024-09-10T06:28:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674520+0000", 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039614700000000001 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.674879+0000", 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035909899999999999 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698261+0000", 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023382209000000001 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698338+0000", 2024-09-10T06:28:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6915000000000005e-05 2024-09-10T06:28:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698455+0000", 2024-09-10T06:28:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117039 2024-09-10T06:28:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698528+0000", 2024-09-10T06:28:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3082000000000003e-05 2024-09-10T06:28:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1436 3.2d 3:b7b59058:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_181:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.372715014000001, 2024-09-10T06:28:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.032516167999999998, 2024-09-10T06:28:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1436 2024-09-10T06:28:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673049+0000", 2024-09-10T06:28:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.673052+0000", 2024-09-10T06:28:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3629999999999998e-06 2024-09-10T06:28:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678383+0000", 2024-09-10T06:28:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053304199999999998 2024-09-10T06:28:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678423+0000", 2024-09-10T06:28:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0089999999999997e-05 2024-09-10T06:28:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.678442+0000", 2024-09-10T06:28:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9242e-05 2024-09-10T06:28:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.685257+0000", 2024-09-10T06:28:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068147920000000001 2024-09-10T06:28:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.685641+0000", 2024-09-10T06:28:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038388700000000002 2024-09-10T06:28:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.686106+0000", 2024-09-10T06:28:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046506800000000001 2024-09-10T06:28:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.698619+0000", 2024-09-10T06:28:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012513102999999999 2024-09-10T06:28:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705364+0000", 2024-09-10T06:28:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067448170000000002 2024-09-10T06:28:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705482+0000", 2024-09-10T06:28:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118362 2024-09-10T06:28:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.705565+0000", 2024-09-10T06:28:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3023999999999997e-05 2024-09-10T06:28:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1442 3.13 3:c8bde401:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_187:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.310634411999999, 2024-09-10T06:28:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021096628999999999, 2024-09-10T06:28:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1442 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735130+0000", 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.735133+0000", 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6899999999999998e-06 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739406+0000", 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042727950000000002 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739432+0000", 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6245999999999999e-05 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739447+0000", 2024-09-10T06:28:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4071e-05 2024-09-10T06:28:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739575+0000", 2024-09-10T06:28:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000128641 2024-09-10T06:28:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.739818+0000", 2024-09-10T06:28:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024242999999999999 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.740058+0000", 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023991 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.748440+0000", 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083824390000000002 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756108+0000", 2024-09-10T06:28:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076684350000000004 2024-09-10T06:28:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756165+0000", 2024-09-10T06:28:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6641000000000002e-05 2024-09-10T06:28:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.756226+0000", 2024-09-10T06:28:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1330999999999999e-05 2024-09-10T06:28:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1443 3.37 3:edd7279d:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_188:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.300727649000002, 2024-09-10T06:28:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022124847, 2024-09-10T06:28:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1443 2024-09-10T06:28:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745036+0000", 2024-09-10T06:28:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.745040+0000", 2024-09-10T06:28:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6490000000000001e-06 2024-09-10T06:28:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753657+0000", 2024-09-10T06:28:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0086173410000000006 2024-09-10T06:28:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753697+0000", 2024-09-10T06:28:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9669999999999998e-05 2024-09-10T06:28:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753722+0000", 2024-09-10T06:28:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4666000000000001e-05 2024-09-10T06:28:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753845+0000", 2024-09-10T06:28:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012319699999999999 2024-09-10T06:28:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.753994+0000", 2024-09-10T06:28:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000149157 2024-09-10T06:28:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.754120+0000", 2024-09-10T06:28:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012597500000000001 2024-09-10T06:28:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.766728+0000", 2024-09-10T06:28:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012608359 2024-09-10T06:28:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767022+0000", 2024-09-10T06:28:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029342099999999998 2024-09-10T06:28:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767098+0000", 2024-09-10T06:28:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6508999999999995e-05 2024-09-10T06:28:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:27:59.767161+0000", 2024-09-10T06:28:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2903000000000004e-05 2024-09-10T06:28:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1469 3.d 3:b3f21559:::dfef714d-986b-43cb-b095-512e386c9309.4358.4__shadow_.gBK3yLg34YE01W2kj_RKvq4SdIFJQxN_214:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T06:28:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.010820752000001, 2024-09-10T06:28:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024987420999999999, 2024-09-10T06:28:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1469 2024-09-10T06:28:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034943+0000", 2024-09-10T06:28:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.034946+0000", 2024-09-10T06:28:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0630000000000002e-06 2024-09-10T06:28:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.038986+0000", 2024-09-10T06:28:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040398580000000003 2024-09-10T06:28:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039019+0000", 2024-09-10T06:28:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3167000000000003e-05 2024-09-10T06:28:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039037+0000", 2024-09-10T06:28:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7785999999999999e-05 2024-09-10T06:28:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039135+0000", 2024-09-10T06:28:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8152999999999994e-05 2024-09-10T06:28:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039321+0000", 2024-09-10T06:28:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000185243 2024-09-10T06:28:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.039506+0000", 2024-09-10T06:28:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018496100000000001 2024-09-10T06:28:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.047253+0000", 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0077471889999999998 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059836+0000", 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012583145 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059879+0000", 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3090999999999998e-05 2024-09-10T06:28:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:00.059931+0000", 2024-09-10T06:28:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1765000000000003e-05 2024-09-10T06:28:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1669 3.2d 3:b72c6e58:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.170788741999999, 2024-09-10T06:28:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021299012999999999, 2024-09-10T06:28:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1669 2024-09-10T06:28:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874975+0000", 2024-09-10T06:28:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.874979+0000", 2024-09-10T06:28:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7670000000000001e-06 2024-09-10T06:28:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880441+0000", 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054614859999999998 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880475+0000", 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4542000000000002e-05 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880492+0000", 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7048999999999999e-05 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880599+0000", 2024-09-10T06:28:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106741 2024-09-10T06:28:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880788+0000", 2024-09-10T06:28:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189168 2024-09-10T06:28:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-09-10T06:28:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.880951+0000", 2024-09-10T06:28:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016303199999999999 2024-09-10T06:28:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.890345+0000", 2024-09-10T06:28:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093942379999999992 2024-09-10T06:28:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896112+0000", 2024-09-10T06:28:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057669289999999996 2024-09-10T06:28:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896204+0000", 2024-09-10T06:28:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2069000000000002e-05 2024-09-10T06:28:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.896274+0000", 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9992000000000003e-05 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1671 3.37 3:ed354b67:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.148066429, 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.022257213000000001, 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1671 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897698+0000", 2024-09-10T06:28:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.897701+0000", 2024-09-10T06:28:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1360000000000001e-06 2024-09-10T06:28:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901677+0000", 2024-09-10T06:28:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039758609999999998 2024-09-10T06:28:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901717+0000", 2024-09-10T06:28:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9889999999999999e-05 2024-09-10T06:28:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901735+0000", 2024-09-10T06:28:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8185999999999998e-05 2024-09-10T06:28:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.901926+0000", 2024-09-10T06:28:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019083899999999999 2024-09-10T06:28:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902165+0000", 2024-09-10T06:28:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023968200000000001 2024-09-10T06:28:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 5", 2024-09-10T06:28:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.902392+0000", 2024-09-10T06:28:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022711399999999999 2024-09-10T06:28:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.915622+0000", 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013229708999999999 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919654+0000", 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040314699999999997 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919827+0000", 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000173647 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.919955+0000", 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012767900000000001 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1674 3.e 3:71dde5c5:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.112869903, 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024662893000000002, 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1674 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932894+0000", 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.932897+0000", 2024-09-10T06:28:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3939999999999999e-06 2024-09-10T06:28:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935777+0000", 2024-09-10T06:28:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028807899999999998 2024-09-10T06:28:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935803+0000", 2024-09-10T06:28:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6067e-05 2024-09-10T06:28:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935818+0000", 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4696e-05 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.935939+0000", 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120895 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936155+0000", 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021555000000000001 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.936376+0000", 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000221127 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.951276+0000", 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014900149999999999 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957421+0000", 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061452440000000002 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957502+0000", 2024-09-10T06:28:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1290000000000003e-05 2024-09-10T06:28:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957557+0000", 2024-09-10T06:28:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.469e-05 2024-09-10T06:28:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1675 3.13 3:cbcca46f:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-10T06:28:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.104013838, 2024-09-10T06:28:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02191593, 2024-09-10T06:28:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1675 2024-09-10T06:28:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941750+0000", 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.941752+0000", 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1550000000000001e-06 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945904+0000", 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041513019999999999 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945928+0000", 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4113000000000001e-05 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.945941+0000", 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3052e-05 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946089+0000", 2024-09-10T06:28:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014766599999999999 2024-09-10T06:28:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946459+0000", 2024-09-10T06:28:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037089600000000001 2024-09-10T06:28:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.946838+0000", 2024-09-10T06:28:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037808900000000002 2024-09-10T06:28:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.957331+0000", 2024-09-10T06:28:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010493195 2024-09-10T06:28:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963409+0000", 2024-09-10T06:28:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060786570000000003 2024-09-10T06:28:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963559+0000", 2024-09-10T06:28:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014962600000000001 2024-09-10T06:28:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:04.963666+0000", 2024-09-10T06:28:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107179 2024-09-10T06:28:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1684 3.e 3:70ef0483:::dfef714d-986b-43cb-b095-512e386c9309.4358.7__shadow_.eS8pNnieSLhfv-yx1n-Wq0yVlIk9NwZ_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T06:28:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.947180068000002, 2024-09-10T06:28:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020215823000000001, 2024-09-10T06:28:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1684 2024-09-10T06:28:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098584+0000", 2024-09-10T06:28:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.098589+0000", 2024-09-10T06:28:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.673e-06 2024-09-10T06:28:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102294+0000", 2024-09-10T06:28:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037056160000000001 2024-09-10T06:28:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102319+0000", 2024-09-10T06:28:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4411000000000001e-05 2024-09-10T06:28:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102330+0000", 2024-09-10T06:28:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1212999999999999e-05 2024-09-10T06:28:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102457+0000", 2024-09-10T06:28:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012733300000000001 2024-09-10T06:28:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op must wait for map", 2024-09-10T06:28:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.102472+0000", 2024-09-10T06:28:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4236000000000001e-05 2024-09-10T06:28:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106594+0000", 2024-09-10T06:28:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004122906 2024-09-10T06:28:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106701+0000", 2024-09-10T06:28:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106745 2024-09-10T06:28:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.106809+0000", 2024-09-10T06:28:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107686 2024-09-10T06:28:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.117591+0000", 2024-09-10T06:28:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01078202 2024-09-10T06:28:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118617+0000", 2024-09-10T06:28:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001026218 2024-09-10T06:28:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118715+0000", 2024-09-10T06:28:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8004000000000006e-05 2024-09-10T06:28:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:05.118800+0000", 2024-09-10T06:28:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4761999999999999e-05 2024-09-10T06:28:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1795 3.15 3:a8bb4476:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.157992+0000", 2024-09-10T06:28:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.887772617, 2024-09-10T06:28:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.033173499000000002, 2024-09-10T06:28:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1795 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.157992+0000", 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.157992+0000", 2024-09-10T06:28:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.157996+0000", 2024-09-10T06:28:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3370000000000001e-06 2024-09-10T06:28:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164634+0000", 2024-09-10T06:28:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066382089999999999 2024-09-10T06:28:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164667+0000", 2024-09-10T06:28:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2741999999999999e-05 2024-09-10T06:28:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164684+0000", 2024-09-10T06:28:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6872999999999999e-05 2024-09-10T06:28:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.164819+0000", 2024-09-10T06:28:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013543999999999999 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.165087+0000", 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026768899999999999 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 3", 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.165323+0000", 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023572299999999999 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.177948+0000", 2024-09-10T06:28:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012625658 2024-09-10T06:28:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.190846+0000", 2024-09-10T06:28:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012897782 2024-09-10T06:28:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.191029+0000", 2024-09-10T06:28:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000183086 2024-09-10T06:28:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.191165+0000", 2024-09-10T06:28:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013595999999999999 2024-09-10T06:28:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1797 3.f 3:f0b01c0d:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.176445+0000", 2024-09-10T06:28:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.869319207, 2024-09-10T06:28:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025704059000000001, 2024-09-10T06:28:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1797 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.176445+0000", 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.176445+0000", 2024-09-10T06:28:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.176448+0000", 2024-09-10T06:28:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1030000000000002e-06 2024-09-10T06:28:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181072+0000", 2024-09-10T06:28:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046238379999999999 2024-09-10T06:28:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181125+0000", 2024-09-10T06:28:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3124000000000002e-05 2024-09-10T06:28:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181150+0000", 2024-09-10T06:28:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5439000000000002e-05 2024-09-10T06:28:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181314+0000", 2024-09-10T06:28:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163566 2024-09-10T06:28:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181555+0000", 2024-09-10T06:28:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024091999999999999 2024-09-10T06:28:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.181769+0000", 2024-09-10T06:28:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021398700000000001 2024-09-10T06:28:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.197700+0000", 2024-09-10T06:28:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015930990999999999 2024-09-10T06:28:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201865+0000", 2024-09-10T06:28:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041652800000000004 2024-09-10T06:28:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.202025+0000", 2024-09-10T06:28:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015980000000000001 2024-09-10T06:28:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.202149+0000", 2024-09-10T06:28:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012401099999999999 2024-09-10T06:28:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4358.0:1799 3.11 3:8b44ea92:::dfef714d-986b-43cb-b095-512e386c9309.4358.8__shadow_.xv0WA6bqpJtyCKhOh0DkFIcfdjlgPAD_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-10T06:28:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-09-10T06:28:15.201684+0000", 2024-09-10T06:28:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.844080223999999, 2024-09-10T06:28:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025177875999999998, 2024-09-10T06:28:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "continuous": false, 2024-09-10T06:28:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-09-10T06:28:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T06:28:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-09-10T06:28:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4358", 2024-09-10T06:28:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.112:0/1407310564", 2024-09-10T06:28:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 1799 2024-09-10T06:28:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201684+0000", 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201684+0000", 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.201687+0000", 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8700000000000001e-06 2024-09-10T06:28:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-09-10T06:28:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206479+0000", 2024-09-10T06:28:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047921869999999998 2024-09-10T06:28:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-09-10T06:28:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206515+0000", 2024-09-10T06:28:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5954999999999997e-05 2024-09-10T06:28:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-09-10T06:28:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206532+0000", 2024-09-10T06:28:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6736e-05 2024-09-10T06:28:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-09-10T06:28:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206723+0000", 2024-09-10T06:28:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000191022 2024-09-10T06:28:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-09-10T06:28:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.206978+0000", 2024-09-10T06:28:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025566199999999998 2024-09-10T06:28:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 4", 2024-09-10T06:28:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.207206+0000", 2024-09-10T06:28:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000227717 2024-09-10T06:28:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-09-10T06:28:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.217181+0000", 2024-09-10T06:28:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0099752969999999993 2024-09-10T06:28:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-09-10T06:28:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.226557+0000", 2024-09-10T06:28:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0093756800000000008 2024-09-10T06:28:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-09-10T06:28:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.226732+0000", 2024-09-10T06:28:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017504900000000001 2024-09-10T06:28:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-09-10T06:28:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-09-10T06:28:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-09-10T06:28:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-09-10T06:28:15.226862+0000", 2024-09-10T06:28:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129701 2024-09-10T06:28:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-09-10T06:28:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-09-10T06:28:32.179 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-09-10T06:28:32.180 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-10T06:28:32.182 INFO:teuthology.orchestra.run.smithi112.stderr:nodeep-scrub is unset 2024-09-10T06:28:32.365 INFO:teuthology.orchestra.run.smithi112.stdout:mon.a: {} 2024-09-10T06:28:32.365 INFO:teuthology.orchestra.run.smithi112.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T06:28:32.378 INFO:teuthology.orchestra.run.smithi112.stdout:mon.b: {} 2024-09-10T06:28:32.380 INFO:teuthology.orchestra.run.smithi112.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T06:28:32.387 INFO:teuthology.orchestra.run.smithi112.stdout:mon.c: {} 2024-09-10T06:28:32.387 INFO:teuthology.orchestra.run.smithi112.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T06:28:32.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-10T06:28:33.168 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.0 to 1 (10000) 2024-09-10T06:28:33.190 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-10T06:28:34.155 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-10T06:28:34.183 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-10T06:28:35.179 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.1 to 1 (10000) 2024-09-10T06:28:35.209 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-10T06:28:36.200 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-10T06:28:36.224 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-10T06:28:37.202 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.2 to 1 (10000) 2024-09-10T06:28:37.233 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-10T06:28:38.218 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-10T06:28:38.248 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-10T06:28:39.240 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.3 to 1 (10000) 2024-09-10T06:28:39.268 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-10T06:28:40.256 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-10T06:28:40.283 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-10T06:28:41.252 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.4 to 1 (10000) 2024-09-10T06:28:41.281 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-10T06:28:42.278 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-10T06:28:42.302 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-10T06:28:43.281 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.5 to 1 (10000) 2024-09-10T06:28:43.308 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-10T06:28:44.304 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-10T06:28:44.334 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-10T06:28:45.323 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.6 to 1 (10000) 2024-09-10T06:28:45.353 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-10T06:28:46.312 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-10T06:28:46.345 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-10T06:28:47.356 INFO:teuthology.orchestra.run.smithi112.stderr:reweighted osd.7 to 1 (10000) 2024-09-10T06:28:47.382 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-10T06:28:48.369 INFO:teuthology.orchestra.run.smithi112.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-10T06:28:48.402 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-10T06:28:48.402 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-10T06:28:48.402 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-10T06:28:48.402 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-10T06:28:48.403 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T06:28:48.403 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T06:28:48.710 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:28:48.710 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":95,"fsid":"be773357-a22c-4a27-af42-3fbac58c722b","created":"2024-09-10T06:26:02.514361+0000","modified":"2024-09-10T06:28:48.361520+0000","last_up_change":"2024-09-10T06:26:15.419770+0000","last_in_change":"2024-09-10T06:26:05.513752+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T06:26:15.461819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T06:26:21.721813+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-10T06:26:29.046847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-10T06:26:30.892297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-10T06:26:32.542139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-10T06:26:34.398475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-10T06:26:36.315894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-10T06:26:38.424525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27b822ad-8298-4dd0-be44-f898fd6b155b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6817","nonce":1694936705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6819","nonce":1694936705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6823","nonce":1694936705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6821","nonce":1694936705}]},"public_addr":"172.21.15.112:6817/1694936705","cluster_addr":"172.21.15.112:6819/1694936705","heartbeat_back_addr":"172.21.15.112:6823/1694936705","heartbeat_front_addr":"172.21.15.112:6821/1694936705","state":["exists","up"]},{"osd":1,"uuid":"68108054-a914-4f7c-a6dd-1e8a2775cff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6825","nonce":3700063340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6827","nonce":3700063340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6831","nonce":3700063340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6829","nonce":3700063340}]},"public_addr":"172.21.15.112:6825/3700063340","cluster_addr":"172.21.15.112:6827/3700063340","heartbeat_back_addr":"172.21.15.112:6831/3700063340","heartbeat_front_addr":"172.21.15.112:6829/3700063340","state":["exists","up"]},{"osd":2,"uuid":"0b12ab6c-743b-446a-92de-3d7722320117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6809","nonce":3923792425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6811","nonce":3923792425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6815","nonce":3923792425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6813","nonce":3923792425}]},"public_addr":"172.21.15.112:6809/3923792425","cluster_addr":"172.21.15.112:6811/3923792425","heartbeat_back_addr":"172.21.15.112:6815/3923792425","heartbeat_front_addr":"172.21.15.112:6813/3923792425","state":["exists","up"]},{"osd":3,"uuid":"a468aa3a-22fb-414c-9e7c-fbe79ae3eafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6801","nonce":3428884615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6803","nonce":3428884615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6807","nonce":3428884615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6805","nonce":3428884615}]},"public_addr":"172.21.15.112:6801/3428884615","cluster_addr":"172.21.15.112:6803/3428884615","heartbeat_back_addr":"172.21.15.112:6807/3428884615","heartbeat_front_addr":"172.21.15.112:6805/3428884615","state":["exists","up"]},{"osd":4,"uuid":"e64b5d77-9d7c-4d5f-8ad6-91d3e77d5479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6809","nonce":4200633864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6811","nonce":4200633864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6815","nonce":4200633864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6813","nonce":4200633864}]},"public_addr":"172.21.15.120:6809/4200633864","cluster_addr":"172.21.15.120:6811/4200633864","heartbeat_back_addr":"172.21.15.120:6815/4200633864","heartbeat_front_addr":"172.21.15.120:6813/4200633864","state":["exists","up"]},{"osd":5,"uuid":"bdcce7db-9a36-423b-9a96-368a4a6b6270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6801","nonce":1878513652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6803","nonce":1878513652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6807","nonce":1878513652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6805","nonce":1878513652}]},"public_addr":"172.21.15.120:6801/1878513652","cluster_addr":"172.21.15.120:6803/1878513652","heartbeat_back_addr":"172.21.15.120:6807/1878513652","heartbeat_front_addr":"172.21.15.120:6805/1878513652","state":["exists","up"]},{"osd":6,"uuid":"8eedb98d-014b-4f07-a704-a4b01e8002cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6817","nonce":663776414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6819","nonce":663776414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6823","nonce":663776414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6821","nonce":663776414}]},"public_addr":"172.21.15.120:6817/663776414","cluster_addr":"172.21.15.120:6819/663776414","heartbeat_back_addr":"172.21.15.120:6823/663776414","heartbeat_front_addr":"172.21.15.120:6821/663776414","state":["exists","up"]},{"osd":7,"uuid":"72eece21-94cd-4ed1-9f02-4d2d1edaf136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6825","nonce":4213847863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6827","nonce":4213847863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6831","nonce":4213847863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6829","nonce":4213847863}]},"public_addr":"172.21.15.120:6825/4213847863","cluster_addr":"172.21.15.120:6827/4213847863","heartbeat_back_addr":"172.21.15.120:6831/4213847863","heartbeat_front_addr":"172.21.15.120:6829/4213847863","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.186913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.656858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.014588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.353407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.086903+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:11.731547+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.034165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.207613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:28:48.731 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T06:28:48.731 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T06:28:49.030 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:28:49.030 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":95,"fsid":"be773357-a22c-4a27-af42-3fbac58c722b","created":"2024-09-10T06:26:02.514361+0000","modified":"2024-09-10T06:28:48.361520+0000","last_up_change":"2024-09-10T06:26:15.419770+0000","last_in_change":"2024-09-10T06:26:05.513752+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T06:26:15.461819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T06:26:21.721813+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-10T06:26:29.046847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-10T06:26:30.892297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-10T06:26:32.542139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-10T06:26:34.398475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-10T06:26:36.315894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-10T06:26:38.424525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27b822ad-8298-4dd0-be44-f898fd6b155b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6817","nonce":1694936705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6819","nonce":1694936705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6823","nonce":1694936705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6821","nonce":1694936705}]},"public_addr":"172.21.15.112:6817/1694936705","cluster_addr":"172.21.15.112:6819/1694936705","heartbeat_back_addr":"172.21.15.112:6823/1694936705","heartbeat_front_addr":"172.21.15.112:6821/1694936705","state":["exists","up"]},{"osd":1,"uuid":"68108054-a914-4f7c-a6dd-1e8a2775cff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6825","nonce":3700063340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6827","nonce":3700063340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6831","nonce":3700063340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6829","nonce":3700063340}]},"public_addr":"172.21.15.112:6825/3700063340","cluster_addr":"172.21.15.112:6827/3700063340","heartbeat_back_addr":"172.21.15.112:6831/3700063340","heartbeat_front_addr":"172.21.15.112:6829/3700063340","state":["exists","up"]},{"osd":2,"uuid":"0b12ab6c-743b-446a-92de-3d7722320117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6809","nonce":3923792425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6811","nonce":3923792425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6815","nonce":3923792425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6813","nonce":3923792425}]},"public_addr":"172.21.15.112:6809/3923792425","cluster_addr":"172.21.15.112:6811/3923792425","heartbeat_back_addr":"172.21.15.112:6815/3923792425","heartbeat_front_addr":"172.21.15.112:6813/3923792425","state":["exists","up"]},{"osd":3,"uuid":"a468aa3a-22fb-414c-9e7c-fbe79ae3eafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6801","nonce":3428884615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6803","nonce":3428884615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6807","nonce":3428884615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6805","nonce":3428884615}]},"public_addr":"172.21.15.112:6801/3428884615","cluster_addr":"172.21.15.112:6803/3428884615","heartbeat_back_addr":"172.21.15.112:6807/3428884615","heartbeat_front_addr":"172.21.15.112:6805/3428884615","state":["exists","up"]},{"osd":4,"uuid":"e64b5d77-9d7c-4d5f-8ad6-91d3e77d5479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6809","nonce":4200633864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6811","nonce":4200633864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6815","nonce":4200633864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6813","nonce":4200633864}]},"public_addr":"172.21.15.120:6809/4200633864","cluster_addr":"172.21.15.120:6811/4200633864","heartbeat_back_addr":"172.21.15.120:6815/4200633864","heartbeat_front_addr":"172.21.15.120:6813/4200633864","state":["exists","up"]},{"osd":5,"uuid":"bdcce7db-9a36-423b-9a96-368a4a6b6270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6801","nonce":1878513652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6803","nonce":1878513652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6807","nonce":1878513652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6805","nonce":1878513652}]},"public_addr":"172.21.15.120:6801/1878513652","cluster_addr":"172.21.15.120:6803/1878513652","heartbeat_back_addr":"172.21.15.120:6807/1878513652","heartbeat_front_addr":"172.21.15.120:6805/1878513652","state":["exists","up"]},{"osd":6,"uuid":"8eedb98d-014b-4f07-a704-a4b01e8002cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6817","nonce":663776414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6819","nonce":663776414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6823","nonce":663776414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6821","nonce":663776414}]},"public_addr":"172.21.15.120:6817/663776414","cluster_addr":"172.21.15.120:6819/663776414","heartbeat_back_addr":"172.21.15.120:6823/663776414","heartbeat_front_addr":"172.21.15.120:6821/663776414","state":["exists","up"]},{"osd":7,"uuid":"72eece21-94cd-4ed1-9f02-4d2d1edaf136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6825","nonce":4213847863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6827","nonce":4213847863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6831","nonce":4213847863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6829","nonce":4213847863}]},"public_addr":"172.21.15.120:6825/4213847863","cluster_addr":"172.21.15.120:6827/4213847863","heartbeat_back_addr":"172.21.15.120:6831/4213847863","heartbeat_front_addr":"172.21.15.120:6829/4213847863","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.186913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.656858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.014588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.353407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.086903+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:11.731547+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.034165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.207613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:28:49.048 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T06:28:49.049 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T06:28:49.049 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T06:28:49.049 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T06:28:49.050 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T06:28:49.050 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T06:28:49.051 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T06:28:49.051 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T06:28:49.298 INFO:teuthology.orchestra.run.smithi112.stdout:60129542179 2024-09-10T06:28:49.298 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T06:28:49.311 INFO:teuthology.orchestra.run.smithi112.stdout:60129542179 2024-09-10T06:28:49.311 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T06:28:49.313 INFO:teuthology.orchestra.run.smithi112.stdout:60129542178 2024-09-10T06:28:49.314 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T06:28:49.317 INFO:teuthology.orchestra.run.smithi112.stdout:60129542179 2024-09-10T06:28:49.317 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T06:28:49.323 INFO:teuthology.orchestra.run.smithi112.stdout:60129542178 2024-09-10T06:28:49.324 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T06:28:49.325 INFO:teuthology.orchestra.run.smithi112.stdout:60129542178 2024-09-10T06:28:49.326 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T06:28:49.332 INFO:teuthology.orchestra.run.smithi112.stdout:60129542178 2024-09-10T06:28:49.332 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T06:28:49.341 INFO:teuthology.orchestra.run.smithi112.stdout:60129542179 2024-09-10T06:28:49.341 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T06:28:49.819 INFO:teuthology.orchestra.run.smithi112.stdout:60129542178 2024-09-10T06:28:49.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.2 2024-09-10T06:28:49.848 INFO:teuthology.orchestra.run.smithi112.stdout:60129542177 2024-09-10T06:28:49.855 INFO:teuthology.orchestra.run.smithi112.stdout:60129542178 2024-09-10T06:28:49.861 INFO:teuthology.orchestra.run.smithi112.stdout:60129542178 2024-09-10T06:28:49.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.1 2024-09-10T06:28:49.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542177 for osd.0 2024-09-10T06:28:49.879 INFO:teuthology.orchestra.run.smithi112.stdout:60129542177 2024-09-10T06:28:49.885 INFO:teuthology.orchestra.run.smithi112.stdout:60129542177 2024-09-10T06:28:49.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.3 2024-09-10T06:28:49.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542177 for osd.6 2024-09-10T06:28:49.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542177 for osd.4 2024-09-10T06:28:49.913 INFO:teuthology.orchestra.run.smithi112.stdout:60129542177 2024-09-10T06:28:49.917 INFO:teuthology.orchestra.run.smithi112.stdout:60129542178 2024-09-10T06:28:49.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542177 for osd.7 2024-09-10T06:28:49.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.5 2024-09-10T06:28:50.843 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T06:28:50.879 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T06:28:50.880 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T06:28:50.894 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T06:28:50.900 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T06:28:50.913 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T06:28:50.933 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T06:28:50.938 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T06:28:51.369 INFO:teuthology.orchestra.run.smithi112.stdout:60129542179 2024-09-10T06:28:51.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542179 for osd.2 2024-09-10T06:28:51.394 DEBUG:teuthology.parallel:result is None 2024-09-10T06:28:51.399 INFO:teuthology.orchestra.run.smithi112.stdout:60129542179 2024-09-10T06:28:51.399 INFO:teuthology.orchestra.run.smithi112.stdout:60129542178 2024-09-10T06:28:51.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542179 for osd.1 2024-09-10T06:28:51.429 DEBUG:teuthology.parallel:result is None 2024-09-10T06:28:51.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542178 for osd.0 2024-09-10T06:28:51.430 DEBUG:teuthology.parallel:result is None 2024-09-10T06:28:51.452 INFO:teuthology.orchestra.run.smithi112.stdout:60129542178 2024-09-10T06:28:51.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542178 for osd.7 2024-09-10T06:28:51.470 DEBUG:teuthology.parallel:result is None 2024-09-10T06:28:51.478 INFO:teuthology.orchestra.run.smithi112.stdout:60129542178 2024-09-10T06:28:51.485 INFO:teuthology.orchestra.run.smithi112.stdout:60129542179 2024-09-10T06:28:51.489 INFO:teuthology.orchestra.run.smithi112.stdout:60129542178 2024-09-10T06:28:51.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542178 for osd.4 2024-09-10T06:28:51.498 DEBUG:teuthology.parallel:result is None 2024-09-10T06:28:51.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542178 for osd.6 2024-09-10T06:28:51.510 DEBUG:teuthology.parallel:result is None 2024-09-10T06:28:51.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542179 for osd.3 2024-09-10T06:28:51.515 DEBUG:teuthology.parallel:result is None 2024-09-10T06:28:51.518 INFO:teuthology.orchestra.run.smithi112.stdout:60129542179 2024-09-10T06:28:51.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542179 for osd.5 2024-09-10T06:28:51.535 DEBUG:teuthology.parallel:result is None 2024-09-10T06:28:51.535 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-10T06:28:51.536 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:28:51.872 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:28:51.879 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:28:51.886 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-09-10T06:28:51.461292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397797023,"num_objects":772,"num_object_clones":0,"num_object_copies":1544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":772,"num_whiteouts":0,"num_read":2073,"num_read_kb":1782,"num_write":1669,"num_write_kb":2367363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":209715508,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2473,"ondisk_log_size":2473,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4941812,"kb_used_data":4692280,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":750032908,"statfs":{"total":773094113280,"available":768033697792,"internally_reserved":0,"allocated":4804894720,"data_stored":4800707198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":117440666,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001998"},"pg_stats":[{"pgid":"3.3f","version":"73'12","reported_seq":126,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453692+0000","last_change":"2024-09-10T06:27:08.597414+0000","last_active":"2024-09-10T06:28:48.453692+0000","last_peered":"2024-09-10T06:28:48.453692+0000","last_clean":"2024-09-10T06:28:48.453692+0000","last_became_active":"2024-09-10T06:27:08.597026+0000","last_became_peered":"2024-09-10T06:27:08.597026+0000","last_unstale":"2024-09-10T06:28:48.453692+0000","last_undegraded":"2024-09-10T06:28:48.453692+0000","last_fullsized":"2024-09-10T06:28:48.453692+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:07.484952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"67'4","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456465+0000","last_change":"2024-09-10T06:26:32.279882+0000","last_active":"2024-09-10T06:28:48.456465+0000","last_peered":"2024-09-10T06:28:48.456465+0000","last_clean":"2024-09-10T06:28:48.456465+0000","last_became_active":"2024-09-10T06:26:32.279098+0000","last_became_peered":"2024-09-10T06:26:32.279098+0000","last_unstale":"2024-09-10T06:28:48.456465+0000","last_undegraded":"2024-09-10T06:28:48.456465+0000","last_fullsized":"2024-09-10T06:28:48.456465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"72'5","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454007+0000","last_change":"2024-09-10T06:26:30.573148+0000","last_active":"2024-09-10T06:28:48.454007+0000","last_peered":"2024-09-10T06:28:48.454007+0000","last_clean":"2024-09-10T06:28:48.454007+0000","last_became_active":"2024-09-10T06:26:30.572798+0000","last_became_peered":"2024-09-10T06:26:30.572798+0000","last_unstale":"2024-09-10T06:28:48.454007+0000","last_undegraded":"2024-09-10T06:28:48.454007+0000","last_fullsized":"2024-09-10T06:28:48.454007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:38.833715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"62'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457051+0000","last_change":"2024-09-10T06:26:32.276811+0000","last_active":"2024-09-10T06:28:48.457051+0000","last_peered":"2024-09-10T06:28:48.457051+0000","last_clean":"2024-09-10T06:28:48.457051+0000","last_became_active":"2024-09-10T06:26:32.275990+0000","last_became_peered":"2024-09-10T06:26:32.275990+0000","last_unstale":"2024-09-10T06:28:48.457051+0000","last_undegraded":"2024-09-10T06:28:48.457051+0000","last_fullsized":"2024-09-10T06:28:48.457051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"72'10","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377820+0000","last_change":"2024-09-10T06:26:30.578068+0000","last_active":"2024-09-10T06:28:48.377820+0000","last_peered":"2024-09-10T06:28:48.377820+0000","last_clean":"2024-09-10T06:28:48.377820+0000","last_became_active":"2024-09-10T06:26:30.577688+0000","last_became_peered":"2024-09-10T06:26:30.577688+0000","last_unstale":"2024-09-10T06:28:48.377820+0000","last_undegraded":"2024-09-10T06:28:48.377820+0000","last_fullsized":"2024-09-10T06:28:48.377820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:34.137079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377601+0000","last_change":"2024-09-10T06:26:32.256939+0000","last_active":"2024-09-10T06:28:48.377601+0000","last_peered":"2024-09-10T06:28:48.377601+0000","last_clean":"2024-09-10T06:28:48.377601+0000","last_became_active":"2024-09-10T06:26:32.256117+0000","last_became_peered":"2024-09-10T06:26:32.256117+0000","last_unstale":"2024-09-10T06:28:48.377601+0000","last_undegraded":"2024-09-10T06:28:48.377601+0000","last_fullsized":"2024-09-10T06:28:48.377601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:51.879604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"73'11","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461567+0000","last_change":"2024-09-10T06:26:30.593697+0000","last_active":"2024-09-10T06:28:48.461567+0000","last_peered":"2024-09-10T06:28:48.461567+0000","last_clean":"2024-09-10T06:28:48.461567+0000","last_became_active":"2024-09-10T06:26:30.591807+0000","last_became_peered":"2024-09-10T06:26:30.591807+0000","last_unstale":"2024-09-10T06:28:48.461567+0000","last_undegraded":"2024-09-10T06:28:48.461567+0000","last_fullsized":"2024-09-10T06:28:48.461567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376194+0000","last_change":"2024-09-10T06:26:32.264685+0000","last_active":"2024-09-10T06:28:48.376194+0000","last_peered":"2024-09-10T06:28:48.376194+0000","last_clean":"2024-09-10T06:28:48.376194+0000","last_became_active":"2024-09-10T06:26:32.264199+0000","last_became_peered":"2024-09-10T06:26:32.264199+0000","last_unstale":"2024-09-10T06:28:48.376194+0000","last_undegraded":"2024-09-10T06:28:48.376194+0000","last_fullsized":"2024-09-10T06:28:48.376194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:20.713066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"72'7","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457396+0000","last_change":"2024-09-10T06:28:09.653122+0000","last_active":"2024-09-10T06:28:48.457396+0000","last_peered":"2024-09-10T06:28:48.457396+0000","last_clean":"2024-09-10T06:28:48.457396+0000","last_became_active":"2024-09-10T06:28:09.546624+0000","last_became_peered":"2024-09-10T06:28:09.546624+0000","last_unstale":"2024-09-10T06:28:48.457396+0000","last_undegraded":"2024-09-10T06:28:48.457396+0000","last_fullsized":"2024-09-10T06:28:48.457396+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:57.805994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"67'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458405+0000","last_change":"2024-09-10T06:26:32.290741+0000","last_active":"2024-09-10T06:28:48.458405+0000","last_peered":"2024-09-10T06:28:48.458405+0000","last_clean":"2024-09-10T06:28:48.458405+0000","last_became_active":"2024-09-10T06:26:32.289840+0000","last_became_peered":"2024-09-10T06:26:32.289840+0000","last_unstale":"2024-09-10T06:28:48.458405+0000","last_undegraded":"2024-09-10T06:28:48.458405+0000","last_fullsized":"2024-09-10T06:28:48.458405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"73'6","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458751+0000","last_change":"2024-09-10T06:26:30.609817+0000","last_active":"2024-09-10T06:28:48.458751+0000","last_peered":"2024-09-10T06:28:48.458751+0000","last_clean":"2024-09-10T06:28:48.458751+0000","last_became_active":"2024-09-10T06:26:30.603330+0000","last_became_peered":"2024-09-10T06:26:30.603330+0000","last_unstale":"2024-09-10T06:28:48.458751+0000","last_undegraded":"2024-09-10T06:28:48.458751+0000","last_fullsized":"2024-09-10T06:28:48.458751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:09.523045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"67'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380006+0000","last_change":"2024-09-10T06:26:32.257050+0000","last_active":"2024-09-10T06:28:48.380006+0000","last_peered":"2024-09-10T06:28:48.380006+0000","last_clean":"2024-09-10T06:28:48.380006+0000","last_became_active":"2024-09-10T06:26:32.254437+0000","last_became_peered":"2024-09-10T06:26:32.254437+0000","last_unstale":"2024-09-10T06:28:48.380006+0000","last_undegraded":"2024-09-10T06:28:48.380006+0000","last_fullsized":"2024-09-10T06:28:48.380006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"72'14","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457521+0000","last_change":"2024-09-10T06:26:30.579756+0000","last_active":"2024-09-10T06:28:48.457521+0000","last_peered":"2024-09-10T06:28:48.457521+0000","last_clean":"2024-09-10T06:28:48.457521+0000","last_became_active":"2024-09-10T06:26:30.578033+0000","last_became_peered":"2024-09-10T06:26:30.578033+0000","last_unstale":"2024-09-10T06:28:48.457521+0000","last_undegraded":"2024-09-10T06:28:48.457521+0000","last_fullsized":"2024-09-10T06:28:48.457521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":22,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460066+0000","last_change":"2024-09-10T06:26:32.281248+0000","last_active":"2024-09-10T06:28:48.460066+0000","last_peered":"2024-09-10T06:28:48.460066+0000","last_clean":"2024-09-10T06:28:48.460066+0000","last_became_active":"2024-09-10T06:26:32.280480+0000","last_became_peered":"2024-09-10T06:26:32.280480+0000","last_unstale":"2024-09-10T06:28:48.460066+0000","last_undegraded":"2024-09-10T06:28:48.460066+0000","last_fullsized":"2024-09-10T06:28:48.460066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"73'8","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375906+0000","last_change":"2024-09-10T06:26:30.593213+0000","last_active":"2024-09-10T06:28:48.375906+0000","last_peered":"2024-09-10T06:28:48.375906+0000","last_clean":"2024-09-10T06:28:48.375906+0000","last_became_active":"2024-09-10T06:26:30.592770+0000","last_became_peered":"2024-09-10T06:26:30.592770+0000","last_unstale":"2024-09-10T06:28:48.375906+0000","last_undegraded":"2024-09-10T06:28:48.375906+0000","last_fullsized":"2024-09-10T06:28:48.375906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'10","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456049+0000","last_change":"2024-09-10T06:26:32.267430+0000","last_active":"2024-09-10T06:28:48.456049+0000","last_peered":"2024-09-10T06:28:48.456049+0000","last_clean":"2024-09-10T06:28:48.456049+0000","last_became_active":"2024-09-10T06:26:32.265788+0000","last_became_peered":"2024-09-10T06:26:32.265788+0000","last_unstale":"2024-09-10T06:28:48.456049+0000","last_undegraded":"2024-09-10T06:28:48.456049+0000","last_fullsized":"2024-09-10T06:28:48.456049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:19.180142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'10","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376998+0000","last_change":"2024-09-10T06:26:32.255038+0000","last_active":"2024-09-10T06:28:48.376998+0000","last_peered":"2024-09-10T06:28:48.376998+0000","last_clean":"2024-09-10T06:28:48.376998+0000","last_became_active":"2024-09-10T06:26:32.254281+0000","last_became_peered":"2024-09-10T06:26:32.254281+0000","last_unstale":"2024-09-10T06:28:48.376998+0000","last_undegraded":"2024-09-10T06:28:48.376998+0000","last_fullsized":"2024-09-10T06:28:48.376998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:46.363171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"73'9","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464563+0000","last_change":"2024-09-10T06:26:30.607280+0000","last_active":"2024-09-10T06:28:48.464563+0000","last_peered":"2024-09-10T06:28:48.464563+0000","last_clean":"2024-09-10T06:28:48.464563+0000","last_became_active":"2024-09-10T06:26:30.605602+0000","last_became_peered":"2024-09-10T06:26:30.605602+0000","last_unstale":"2024-09-10T06:28:48.464563+0000","last_undegraded":"2024-09-10T06:28:48.464563+0000","last_fullsized":"2024-09-10T06:28:48.464563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:49.865234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457282+0000","last_change":"2024-09-10T06:26:32.275913+0000","last_active":"2024-09-10T06:28:48.457282+0000","last_peered":"2024-09-10T06:28:48.457282+0000","last_clean":"2024-09-10T06:28:48.457282+0000","last_became_active":"2024-09-10T06:26:32.274264+0000","last_became_peered":"2024-09-10T06:26:32.274264+0000","last_unstale":"2024-09-10T06:28:48.457282+0000","last_undegraded":"2024-09-10T06:28:48.457282+0000","last_fullsized":"2024-09-10T06:28:48.457282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"72'5","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459316+0000","last_change":"2024-09-10T06:28:46.509018+0000","last_active":"2024-09-10T06:28:48.459316+0000","last_peered":"2024-09-10T06:28:48.459316+0000","last_clean":"2024-09-10T06:28:48.459316+0000","last_became_active":"2024-09-10T06:28:46.332355+0000","last_became_peered":"2024-09-10T06:28:46.332355+0000","last_unstale":"2024-09-10T06:28:48.459316+0000","last_undegraded":"2024-09-10T06:28:48.459316+0000","last_fullsized":"2024-09-10T06:28:48.459316+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:54.077676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459039+0000","last_change":"2024-09-10T06:26:32.279079+0000","last_active":"2024-09-10T06:28:48.459039+0000","last_peered":"2024-09-10T06:28:48.459039+0000","last_clean":"2024-09-10T06:28:48.459039+0000","last_became_active":"2024-09-10T06:26:32.278407+0000","last_became_peered":"2024-09-10T06:26:32.278407+0000","last_unstale":"2024-09-10T06:28:48.459039+0000","last_undegraded":"2024-09-10T06:28:48.459039+0000","last_fullsized":"2024-09-10T06:28:48.459039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"73'10","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460652+0000","last_change":"2024-09-10T06:26:30.607368+0000","last_active":"2024-09-10T06:28:48.460652+0000","last_peered":"2024-09-10T06:28:48.460652+0000","last_clean":"2024-09-10T06:28:48.460652+0000","last_became_active":"2024-09-10T06:26:30.606807+0000","last_became_peered":"2024-09-10T06:26:30.606807+0000","last_unstale":"2024-09-10T06:28:48.460652+0000","last_undegraded":"2024-09-10T06:28:48.460652+0000","last_fullsized":"2024-09-10T06:28:48.460652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"76'8","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454789+0000","last_change":"2024-09-10T06:27:08.801987+0000","last_active":"2024-09-10T06:28:48.454789+0000","last_peered":"2024-09-10T06:28:48.454789+0000","last_clean":"2024-09-10T06:28:48.454789+0000","last_became_active":"2024-09-10T06:27:08.801461+0000","last_became_peered":"2024-09-10T06:27:08.801461+0000","last_unstale":"2024-09-10T06:28:48.454789+0000","last_undegraded":"2024-09-10T06:28:48.454789+0000","last_fullsized":"2024-09-10T06:28:48.454789+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"72'11","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379457+0000","last_change":"2024-09-10T06:26:30.598381+0000","last_active":"2024-09-10T06:28:48.379457+0000","last_peered":"2024-09-10T06:28:48.379457+0000","last_clean":"2024-09-10T06:28:48.379457+0000","last_became_active":"2024-09-10T06:26:30.597271+0000","last_became_peered":"2024-09-10T06:26:30.597271+0000","last_unstale":"2024-09-10T06:28:48.379457+0000","last_undegraded":"2024-09-10T06:28:48.379457+0000","last_fullsized":"2024-09-10T06:28:48.379457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:59.908548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455070+0000","last_change":"2024-09-10T06:26:32.247492+0000","last_active":"2024-09-10T06:28:48.455070+0000","last_peered":"2024-09-10T06:28:48.455070+0000","last_clean":"2024-09-10T06:28:48.455070+0000","last_became_active":"2024-09-10T06:26:32.246938+0000","last_became_peered":"2024-09-10T06:26:32.246938+0000","last_unstale":"2024-09-10T06:28:48.455070+0000","last_undegraded":"2024-09-10T06:28:48.455070+0000","last_fullsized":"2024-09-10T06:28:48.455070+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:01.766868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"73'11","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375472+0000","last_change":"2024-09-10T06:28:46.662120+0000","last_active":"2024-09-10T06:28:48.375472+0000","last_peered":"2024-09-10T06:28:48.375472+0000","last_clean":"2024-09-10T06:28:48.375472+0000","last_became_active":"2024-09-10T06:28:46.326710+0000","last_became_peered":"2024-09-10T06:28:46.326710+0000","last_unstale":"2024-09-10T06:28:48.375472+0000","last_undegraded":"2024-09-10T06:28:48.375472+0000","last_fullsized":"2024-09-10T06:28:48.375472+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:47.625969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380297+0000","last_change":"2024-09-10T06:26:32.278347+0000","last_active":"2024-09-10T06:28:48.380297+0000","last_peered":"2024-09-10T06:28:48.380297+0000","last_clean":"2024-09-10T06:28:48.380297+0000","last_became_active":"2024-09-10T06:26:32.275206+0000","last_became_peered":"2024-09-10T06:26:32.275206+0000","last_unstale":"2024-09-10T06:28:48.380297+0000","last_undegraded":"2024-09-10T06:28:48.380297+0000","last_fullsized":"2024-09-10T06:28:48.380297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"73'13","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375576+0000","last_change":"2024-09-10T06:26:30.572734+0000","last_active":"2024-09-10T06:28:48.375576+0000","last_peered":"2024-09-10T06:28:48.375576+0000","last_clean":"2024-09-10T06:28:48.375576+0000","last_became_active":"2024-09-10T06:26:30.572043+0000","last_became_peered":"2024-09-10T06:26:30.572043+0000","last_unstale":"2024-09-10T06:28:48.375576+0000","last_undegraded":"2024-09-10T06:28:48.375576+0000","last_fullsized":"2024-09-10T06:28:48.375576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"76'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376181+0000","last_change":"2024-09-10T06:26:40.323476+0000","last_active":"2024-09-10T06:28:48.376181+0000","last_peered":"2024-09-10T06:28:48.376181+0000","last_clean":"2024-09-10T06:28:48.376181+0000","last_became_active":"2024-09-10T06:26:40.322711+0000","last_became_peered":"2024-09-10T06:26:40.322711+0000","last_unstale":"2024-09-10T06:28:48.376181+0000","last_undegraded":"2024-09-10T06:28:48.376181+0000","last_fullsized":"2024-09-10T06:28:48.376181+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377930+0000","last_change":"2024-09-10T06:26:32.276274+0000","last_active":"2024-09-10T06:28:48.377930+0000","last_peered":"2024-09-10T06:28:48.377930+0000","last_clean":"2024-09-10T06:28:48.377930+0000","last_became_active":"2024-09-10T06:26:32.275889+0000","last_became_peered":"2024-09-10T06:26:32.275889+0000","last_unstale":"2024-09-10T06:28:48.377930+0000","last_undegraded":"2024-09-10T06:28:48.377930+0000","last_fullsized":"2024-09-10T06:28:48.377930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"72'14","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463117+0000","last_change":"2024-09-10T06:26:30.595738+0000","last_active":"2024-09-10T06:28:48.463117+0000","last_peered":"2024-09-10T06:28:48.463117+0000","last_clean":"2024-09-10T06:28:48.463117+0000","last_became_active":"2024-09-10T06:26:30.595128+0000","last_became_peered":"2024-09-10T06:26:30.595128+0000","last_unstale":"2024-09-10T06:28:48.463117+0000","last_undegraded":"2024-09-10T06:28:48.463117+0000","last_fullsized":"2024-09-10T06:28:48.463117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459157+0000","last_change":"2024-09-10T06:26:34.279824+0000","last_active":"2024-09-10T06:28:48.459157+0000","last_peered":"2024-09-10T06:28:48.459157+0000","last_clean":"2024-09-10T06:28:48.459157+0000","last_became_active":"2024-09-10T06:26:34.279074+0000","last_became_peered":"2024-09-10T06:26:34.279074+0000","last_unstale":"2024-09-10T06:28:48.459157+0000","last_undegraded":"2024-09-10T06:28:48.459157+0000","last_fullsized":"2024-09-10T06:28:48.459157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:40.507467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"76'15","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378326+0000","last_change":"2024-09-10T06:26:36.296703+0000","last_active":"2024-09-10T06:28:48.378326+0000","last_peered":"2024-09-10T06:28:48.378326+0000","last_clean":"2024-09-10T06:28:48.378326+0000","last_became_active":"2024-09-10T06:26:36.295786+0000","last_became_peered":"2024-09-10T06:26:36.295786+0000","last_unstale":"2024-09-10T06:28:48.378326+0000","last_undegraded":"2024-09-10T06:28:48.378326+0000","last_fullsized":"2024-09-10T06:28:48.378326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:31.699855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464287+0000","last_change":"2024-09-10T06:26:38.305468+0000","last_active":"2024-09-10T06:28:48.464287+0000","last_peered":"2024-09-10T06:28:48.464287+0000","last_clean":"2024-09-10T06:28:48.464287+0000","last_became_active":"2024-09-10T06:26:38.304847+0000","last_became_peered":"2024-09-10T06:26:38.304847+0000","last_unstale":"2024-09-10T06:28:48.464287+0000","last_undegraded":"2024-09-10T06:28:48.464287+0000","last_fullsized":"2024-09-10T06:28:48.464287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:36.499856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":131,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456145+0000","last_change":"2024-09-10T06:26:40.331389+0000","last_active":"2024-09-10T06:28:48.456145+0000","last_peered":"2024-09-10T06:28:48.456145+0000","last_clean":"2024-09-10T06:28:48.456145+0000","last_became_active":"2024-09-10T06:26:40.330777+0000","last_became_peered":"2024-09-10T06:26:40.330777+0000","last_unstale":"2024-09-10T06:28:48.456145+0000","last_undegraded":"2024-09-10T06:28:48.456145+0000","last_fullsized":"2024-09-10T06:28:48.456145+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:22.792159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'4","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459576+0000","last_change":"2024-09-10T06:26:32.283112+0000","last_active":"2024-09-10T06:28:48.459576+0000","last_peered":"2024-09-10T06:28:48.459576+0000","last_clean":"2024-09-10T06:28:48.459576+0000","last_became_active":"2024-09-10T06:26:32.282263+0000","last_became_peered":"2024-09-10T06:26:32.282263+0000","last_unstale":"2024-09-10T06:28:48.459576+0000","last_undegraded":"2024-09-10T06:28:48.459576+0000","last_fullsized":"2024-09-10T06:28:48.459576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:02.124800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375652+0000","last_change":"2024-09-10T06:26:30.576489+0000","last_active":"2024-09-10T06:28:48.375652+0000","last_peered":"2024-09-10T06:28:48.375652+0000","last_clean":"2024-09-10T06:28:48.375652+0000","last_became_active":"2024-09-10T06:26:30.576039+0000","last_became_peered":"2024-09-10T06:26:30.576039+0000","last_unstale":"2024-09-10T06:28:48.375652+0000","last_undegraded":"2024-09-10T06:28:48.375652+0000","last_fullsized":"2024-09-10T06:28:48.375652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377578+0000","last_change":"2024-09-10T06:26:34.268758+0000","last_active":"2024-09-10T06:28:48.377578+0000","last_peered":"2024-09-10T06:28:48.377578+0000","last_clean":"2024-09-10T06:28:48.377578+0000","last_became_active":"2024-09-10T06:26:34.268279+0000","last_became_peered":"2024-09-10T06:26:34.268279+0000","last_unstale":"2024-09-10T06:28:48.377578+0000","last_undegraded":"2024-09-10T06:28:48.377578+0000","last_fullsized":"2024-09-10T06:28:48.377578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:42.052702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380314+0000","last_change":"2024-09-10T06:26:36.273991+0000","last_active":"2024-09-10T06:28:48.380314+0000","last_peered":"2024-09-10T06:28:48.380314+0000","last_clean":"2024-09-10T06:28:48.380314+0000","last_became_active":"2024-09-10T06:26:36.273138+0000","last_became_peered":"2024-09-10T06:26:36.273138+0000","last_unstale":"2024-09-10T06:28:48.380314+0000","last_undegraded":"2024-09-10T06:28:48.380314+0000","last_fullsized":"2024-09-10T06:28:48.380314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379703+0000","last_change":"2024-09-10T06:26:38.294543+0000","last_active":"2024-09-10T06:28:48.379703+0000","last_peered":"2024-09-10T06:28:48.379703+0000","last_clean":"2024-09-10T06:28:48.379703+0000","last_became_active":"2024-09-10T06:26:38.293754+0000","last_became_peered":"2024-09-10T06:26:38.293754+0000","last_unstale":"2024-09-10T06:28:48.379703+0000","last_undegraded":"2024-09-10T06:28:48.379703+0000","last_fullsized":"2024-09-10T06:28:48.379703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"62'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375255+0000","last_change":"2024-09-10T06:26:40.326998+0000","last_active":"2024-09-10T06:28:48.375255+0000","last_peered":"2024-09-10T06:28:48.375255+0000","last_clean":"2024-09-10T06:28:48.375255+0000","last_became_active":"2024-09-10T06:26:40.322648+0000","last_became_peered":"2024-09-10T06:26:40.322648+0000","last_unstale":"2024-09-10T06:28:48.375255+0000","last_undegraded":"2024-09-10T06:28:48.375255+0000","last_fullsized":"2024-09-10T06:28:48.375255+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:19.837495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379395+0000","last_change":"2024-09-10T06:26:32.256959+0000","last_active":"2024-09-10T06:28:48.379395+0000","last_peered":"2024-09-10T06:28:48.379395+0000","last_clean":"2024-09-10T06:28:48.379395+0000","last_became_active":"2024-09-10T06:26:32.256701+0000","last_became_peered":"2024-09-10T06:26:32.256701+0000","last_unstale":"2024-09-10T06:28:48.379395+0000","last_undegraded":"2024-09-10T06:28:48.379395+0000","last_fullsized":"2024-09-10T06:28:48.379395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"73'13","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457900+0000","last_change":"2024-09-10T06:26:30.598409+0000","last_active":"2024-09-10T06:28:48.457900+0000","last_peered":"2024-09-10T06:28:48.457900+0000","last_clean":"2024-09-10T06:28:48.457900+0000","last_became_active":"2024-09-10T06:26:30.597703+0000","last_became_peered":"2024-09-10T06:26:30.597703+0000","last_unstale":"2024-09-10T06:28:48.457900+0000","last_undegraded":"2024-09-10T06:28:48.457900+0000","last_fullsized":"2024-09-10T06:28:48.457900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379989+0000","last_change":"2024-09-10T06:26:34.268741+0000","last_active":"2024-09-10T06:28:48.379989+0000","last_peered":"2024-09-10T06:28:48.379989+0000","last_clean":"2024-09-10T06:28:48.379989+0000","last_became_active":"2024-09-10T06:26:34.268192+0000","last_became_peered":"2024-09-10T06:26:34.268192+0000","last_unstale":"2024-09-10T06:28:48.379989+0000","last_undegraded":"2024-09-10T06:28:48.379989+0000","last_fullsized":"2024-09-10T06:28:48.379989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:42:10.110645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454914+0000","last_change":"2024-09-10T06:26:36.275955+0000","last_active":"2024-09-10T06:28:48.454914+0000","last_peered":"2024-09-10T06:28:48.454914+0000","last_clean":"2024-09-10T06:28:48.454914+0000","last_became_active":"2024-09-10T06:26:36.275306+0000","last_became_peered":"2024-09-10T06:26:36.275306+0000","last_unstale":"2024-09-10T06:28:48.454914+0000","last_undegraded":"2024-09-10T06:28:48.454914+0000","last_fullsized":"2024-09-10T06:28:48.454914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:03.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"76'101","reported_seq":400,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463206+0000","last_change":"2024-09-10T06:26:38.302764+0000","last_active":"2024-09-10T06:28:48.463206+0000","last_peered":"2024-09-10T06:28:48.463206+0000","last_clean":"2024-09-10T06:28:48.463206+0000","last_became_active":"2024-09-10T06:26:38.300326+0000","last_became_peered":"2024-09-10T06:26:38.300326+0000","last_unstale":"2024-09-10T06:28:48.463206+0000","last_undegraded":"2024-09-10T06:28:48.463206+0000","last_fullsized":"2024-09-10T06:28:48.463206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:29.851085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376468+0000","last_change":"2024-09-10T06:26:40.297893+0000","last_active":"2024-09-10T06:28:48.376468+0000","last_peered":"2024-09-10T06:28:48.376468+0000","last_clean":"2024-09-10T06:28:48.376468+0000","last_became_active":"2024-09-10T06:26:40.297296+0000","last_became_peered":"2024-09-10T06:26:40.297296+0000","last_unstale":"2024-09-10T06:28:48.376468+0000","last_undegraded":"2024-09-10T06:28:48.376468+0000","last_fullsized":"2024-09-10T06:28:48.376468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379578+0000","last_change":"2024-09-10T06:26:32.265005+0000","last_active":"2024-09-10T06:28:48.379578+0000","last_peered":"2024-09-10T06:28:48.379578+0000","last_clean":"2024-09-10T06:28:48.379578+0000","last_became_active":"2024-09-10T06:26:32.264334+0000","last_became_peered":"2024-09-10T06:26:32.264334+0000","last_unstale":"2024-09-10T06:28:48.379578+0000","last_undegraded":"2024-09-10T06:28:48.379578+0000","last_fullsized":"2024-09-10T06:28:48.379578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"73'13","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457010+0000","last_change":"2024-09-10T06:26:30.576242+0000","last_active":"2024-09-10T06:28:48.457010+0000","last_peered":"2024-09-10T06:28:48.457010+0000","last_clean":"2024-09-10T06:28:48.457010+0000","last_became_active":"2024-09-10T06:26:30.575433+0000","last_became_peered":"2024-09-10T06:26:30.575433+0000","last_unstale":"2024-09-10T06:28:48.457010+0000","last_undegraded":"2024-09-10T06:28:48.457010+0000","last_fullsized":"2024-09-10T06:28:48.457010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459940+0000","last_change":"2024-09-10T06:26:34.283701+0000","last_active":"2024-09-10T06:28:48.459940+0000","last_peered":"2024-09-10T06:28:48.459940+0000","last_clean":"2024-09-10T06:28:48.459940+0000","last_became_active":"2024-09-10T06:26:34.282941+0000","last_became_peered":"2024-09-10T06:26:34.282941+0000","last_unstale":"2024-09-10T06:28:48.459940+0000","last_undegraded":"2024-09-10T06:28:48.459940+0000","last_fullsized":"2024-09-10T06:28:48.459940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:29.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"76'16","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463333+0000","last_change":"2024-09-10T06:26:36.298510+0000","last_active":"2024-09-10T06:28:48.463333+0000","last_peered":"2024-09-10T06:28:48.463333+0000","last_clean":"2024-09-10T06:28:48.463333+0000","last_became_active":"2024-09-10T06:26:36.297309+0000","last_became_peered":"2024-09-10T06:26:36.297309+0000","last_unstale":"2024-09-10T06:28:48.463333+0000","last_undegraded":"2024-09-10T06:28:48.463333+0000","last_fullsized":"2024-09-10T06:28:48.463333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"76'101","reported_seq":267,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376948+0000","last_change":"2024-09-10T06:26:38.300228+0000","last_active":"2024-09-10T06:28:48.376948+0000","last_peered":"2024-09-10T06:28:48.376948+0000","last_clean":"2024-09-10T06:28:48.376948+0000","last_became_active":"2024-09-10T06:26:38.299355+0000","last_became_peered":"2024-09-10T06:26:38.299355+0000","last_unstale":"2024-09-10T06:28:48.376948+0000","last_undegraded":"2024-09-10T06:28:48.376948+0000","last_fullsized":"2024-09-10T06:28:48.376948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:20.050096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456891+0000","last_change":"2024-09-10T06:26:32.271283+0000","last_active":"2024-09-10T06:28:48.456891+0000","last_peered":"2024-09-10T06:28:48.456891+0000","last_clean":"2024-09-10T06:28:48.456891+0000","last_became_active":"2024-09-10T06:26:32.270496+0000","last_became_peered":"2024-09-10T06:26:32.270496+0000","last_unstale":"2024-09-10T06:28:48.456891+0000","last_undegraded":"2024-09-10T06:28:48.456891+0000","last_fullsized":"2024-09-10T06:28:48.456891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464629+0000","last_change":"2024-09-10T06:26:30.607373+0000","last_active":"2024-09-10T06:28:48.464629+0000","last_peered":"2024-09-10T06:28:48.464629+0000","last_clean":"2024-09-10T06:28:48.464629+0000","last_became_active":"2024-09-10T06:26:30.606685+0000","last_became_peered":"2024-09-10T06:26:30.606685+0000","last_unstale":"2024-09-10T06:28:48.464629+0000","last_undegraded":"2024-09-10T06:28:48.464629+0000","last_fullsized":"2024-09-10T06:28:48.464629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:35.705564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456456+0000","last_change":"2024-09-10T06:26:34.286925+0000","last_active":"2024-09-10T06:28:48.456456+0000","last_peered":"2024-09-10T06:28:48.456456+0000","last_clean":"2024-09-10T06:28:48.456456+0000","last_became_active":"2024-09-10T06:26:34.285787+0000","last_became_peered":"2024-09-10T06:26:34.285787+0000","last_unstale":"2024-09-10T06:28:48.456456+0000","last_undegraded":"2024-09-10T06:28:48.456456+0000","last_fullsized":"2024-09-10T06:28:48.456456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"76'25","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456092+0000","last_change":"2024-09-10T06:26:36.293988+0000","last_active":"2024-09-10T06:28:48.456092+0000","last_peered":"2024-09-10T06:28:48.456092+0000","last_clean":"2024-09-10T06:28:48.456092+0000","last_became_active":"2024-09-10T06:26:36.293226+0000","last_became_peered":"2024-09-10T06:26:36.293226+0000","last_unstale":"2024-09-10T06:28:48.456092+0000","last_undegraded":"2024-09-10T06:28:48.456092+0000","last_fullsized":"2024-09-10T06:28:48.456092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453801+0000","last_change":"2024-09-10T06:26:38.305826+0000","last_active":"2024-09-10T06:28:48.453801+0000","last_peered":"2024-09-10T06:28:48.453801+0000","last_clean":"2024-09-10T06:28:48.453801+0000","last_became_active":"2024-09-10T06:26:38.304601+0000","last_became_peered":"2024-09-10T06:26:38.304601+0000","last_unstale":"2024-09-10T06:28:48.453801+0000","last_undegraded":"2024-09-10T06:28:48.453801+0000","last_fullsized":"2024-09-10T06:28:48.453801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:12.545261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"62'8","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460978+0000","last_change":"2024-09-10T06:26:40.332286+0000","last_active":"2024-09-10T06:28:48.460978+0000","last_peered":"2024-09-10T06:28:48.460978+0000","last_clean":"2024-09-10T06:28:48.460978+0000","last_became_active":"2024-09-10T06:26:40.331262+0000","last_became_peered":"2024-09-10T06:26:40.331262+0000","last_unstale":"2024-09-10T06:28:48.460978+0000","last_undegraded":"2024-09-10T06:28:48.460978+0000","last_fullsized":"2024-09-10T06:28:48.460978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377579+0000","last_change":"2024-09-10T06:26:32.262320+0000","last_active":"2024-09-10T06:28:48.377579+0000","last_peered":"2024-09-10T06:28:48.377579+0000","last_clean":"2024-09-10T06:28:48.377579+0000","last_became_active":"2024-09-10T06:26:32.261423+0000","last_became_peered":"2024-09-10T06:26:32.261423+0000","last_unstale":"2024-09-10T06:28:48.377579+0000","last_undegraded":"2024-09-10T06:28:48.377579+0000","last_fullsized":"2024-09-10T06:28:48.377579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"76'13","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464559+0000","last_change":"2024-09-10T06:26:30.595879+0000","last_active":"2024-09-10T06:28:48.464559+0000","last_peered":"2024-09-10T06:28:48.464559+0000","last_clean":"2024-09-10T06:28:48.464559+0000","last_became_active":"2024-09-10T06:26:30.595269+0000","last_became_peered":"2024-09-10T06:26:30.595269+0000","last_unstale":"2024-09-10T06:28:48.464559+0000","last_undegraded":"2024-09-10T06:28:48.464559+0000","last_fullsized":"2024-09-10T06:28:48.464559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453028+0000","last_change":"2024-09-10T06:26:34.266906+0000","last_active":"2024-09-10T06:28:48.453028+0000","last_peered":"2024-09-10T06:28:48.453028+0000","last_clean":"2024-09-10T06:28:48.453028+0000","last_became_active":"2024-09-10T06:26:34.266017+0000","last_became_peered":"2024-09-10T06:26:34.266017+0000","last_unstale":"2024-09-10T06:28:48.453028+0000","last_undegraded":"2024-09-10T06:28:48.453028+0000","last_fullsized":"2024-09-10T06:28:48.453028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:24.366166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"76'16","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378015+0000","last_change":"2024-09-10T06:26:36.297020+0000","last_active":"2024-09-10T06:28:48.378015+0000","last_peered":"2024-09-10T06:28:48.378015+0000","last_clean":"2024-09-10T06:28:48.378015+0000","last_became_active":"2024-09-10T06:26:36.295796+0000","last_became_peered":"2024-09-10T06:26:36.295796+0000","last_unstale":"2024-09-10T06:28:48.378015+0000","last_undegraded":"2024-09-10T06:28:48.378015+0000","last_fullsized":"2024-09-10T06:28:48.378015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375244+0000","last_change":"2024-09-10T06:26:38.297273+0000","last_active":"2024-09-10T06:28:48.375244+0000","last_peered":"2024-09-10T06:28:48.375244+0000","last_clean":"2024-09-10T06:28:48.375244+0000","last_became_active":"2024-09-10T06:26:38.296455+0000","last_became_peered":"2024-09-10T06:26:38.296455+0000","last_unstale":"2024-09-10T06:28:48.375244+0000","last_undegraded":"2024-09-10T06:28:48.375244+0000","last_fullsized":"2024-09-10T06:28:48.375244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:26.766702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458102+0000","last_change":"2024-09-10T06:26:40.328294+0000","last_active":"2024-09-10T06:28:48.458102+0000","last_peered":"2024-09-10T06:28:48.458102+0000","last_clean":"2024-09-10T06:28:48.458102+0000","last_became_active":"2024-09-10T06:26:40.327585+0000","last_became_peered":"2024-09-10T06:26:40.327585+0000","last_unstale":"2024-09-10T06:28:48.458102+0000","last_undegraded":"2024-09-10T06:28:48.458102+0000","last_fullsized":"2024-09-10T06:28:48.458102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.537210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458888+0000","last_change":"2024-09-10T06:27:08.600683+0000","last_active":"2024-09-10T06:28:48.458888+0000","last_peered":"2024-09-10T06:28:48.458888+0000","last_clean":"2024-09-10T06:28:48.458888+0000","last_became_active":"2024-09-10T06:27:08.599875+0000","last_became_peered":"2024-09-10T06:27:08.599875+0000","last_unstale":"2024-09-10T06:28:48.458888+0000","last_undegraded":"2024-09-10T06:28:48.458888+0000","last_fullsized":"2024-09-10T06:28:48.458888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:59.605814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464013+0000","last_change":"2024-09-10T06:26:30.611704+0000","last_active":"2024-09-10T06:28:48.464013+0000","last_peered":"2024-09-10T06:28:48.464013+0000","last_clean":"2024-09-10T06:28:48.464013+0000","last_became_active":"2024-09-10T06:26:30.611039+0000","last_became_peered":"2024-09-10T06:26:30.611039+0000","last_unstale":"2024-09-10T06:28:48.464013+0000","last_undegraded":"2024-09-10T06:28:48.464013+0000","last_fullsized":"2024-09-10T06:28:48.464013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455026+0000","last_change":"2024-09-10T06:26:34.263514+0000","last_active":"2024-09-10T06:28:48.455026+0000","last_peered":"2024-09-10T06:28:48.455026+0000","last_clean":"2024-09-10T06:28:48.455026+0000","last_became_active":"2024-09-10T06:26:34.262793+0000","last_became_peered":"2024-09-10T06:26:34.262793+0000","last_unstale":"2024-09-10T06:28:48.455026+0000","last_undegraded":"2024-09-10T06:28:48.455026+0000","last_fullsized":"2024-09-10T06:28:48.455026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:31.501738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"76'22","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455616+0000","last_change":"2024-09-10T06:26:36.299923+0000","last_active":"2024-09-10T06:28:48.455616+0000","last_peered":"2024-09-10T06:28:48.455616+0000","last_clean":"2024-09-10T06:28:48.455616+0000","last_became_active":"2024-09-10T06:26:36.299140+0000","last_became_peered":"2024-09-10T06:26:36.299140+0000","last_unstale":"2024-09-10T06:28:48.455616+0000","last_undegraded":"2024-09-10T06:28:48.455616+0000","last_fullsized":"2024-09-10T06:28:48.455616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:12.246303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"76'101","reported_seq":266,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.463347+0000","last_change":"2024-09-10T06:26:38.292019+0000","last_active":"2024-09-10T06:28:49.463347+0000","last_peered":"2024-09-10T06:28:49.463347+0000","last_clean":"2024-09-10T06:28:49.463347+0000","last_became_active":"2024-09-10T06:26:38.291322+0000","last_became_peered":"2024-09-10T06:26:38.291322+0000","last_unstale":"2024-09-10T06:28:49.463347+0000","last_undegraded":"2024-09-10T06:28:49.463347+0000","last_fullsized":"2024-09-10T06:28:49.463347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"64'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378724+0000","last_change":"2024-09-10T06:26:40.328427+0000","last_active":"2024-09-10T06:28:48.378724+0000","last_peered":"2024-09-10T06:28:48.378724+0000","last_clean":"2024-09-10T06:28:48.378724+0000","last_became_active":"2024-09-10T06:26:40.323249+0000","last_became_peered":"2024-09-10T06:26:40.323249+0000","last_unstale":"2024-09-10T06:28:48.378724+0000","last_undegraded":"2024-09-10T06:28:48.378724+0000","last_fullsized":"2024-09-10T06:28:48.378724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:50.823195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377190+0000","last_change":"2024-09-10T06:26:32.274824+0000","last_active":"2024-09-10T06:28:48.377190+0000","last_peered":"2024-09-10T06:28:48.377190+0000","last_clean":"2024-09-10T06:28:48.377190+0000","last_became_active":"2024-09-10T06:26:32.274496+0000","last_became_peered":"2024-09-10T06:26:32.274496+0000","last_unstale":"2024-09-10T06:28:48.377190+0000","last_undegraded":"2024-09-10T06:28:48.377190+0000","last_fullsized":"2024-09-10T06:28:48.377190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:39.513476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"73'7","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462108+0000","last_change":"2024-09-10T06:26:30.604684+0000","last_active":"2024-09-10T06:28:48.462108+0000","last_peered":"2024-09-10T06:28:48.462108+0000","last_clean":"2024-09-10T06:28:48.462108+0000","last_became_active":"2024-09-10T06:26:30.593432+0000","last_became_peered":"2024-09-10T06:26:30.593432+0000","last_unstale":"2024-09-10T06:28:48.462108+0000","last_undegraded":"2024-09-10T06:28:48.462108+0000","last_fullsized":"2024-09-10T06:28:48.462108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454621+0000","last_change":"2024-09-10T06:26:34.256662+0000","last_active":"2024-09-10T06:28:48.454621+0000","last_peered":"2024-09-10T06:28:48.454621+0000","last_clean":"2024-09-10T06:28:48.454621+0000","last_became_active":"2024-09-10T06:26:34.256256+0000","last_became_peered":"2024-09-10T06:26:34.256256+0000","last_unstale":"2024-09-10T06:28:48.454621+0000","last_undegraded":"2024-09-10T06:28:48.454621+0000","last_fullsized":"2024-09-10T06:28:48.454621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:35.549063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'26","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375816+0000","last_change":"2024-09-10T06:26:36.296631+0000","last_active":"2024-09-10T06:28:48.375816+0000","last_peered":"2024-09-10T06:28:48.375816+0000","last_clean":"2024-09-10T06:28:48.375816+0000","last_became_active":"2024-09-10T06:26:36.295838+0000","last_became_peered":"2024-09-10T06:26:36.295838+0000","last_unstale":"2024-09-10T06:28:48.375816+0000","last_undegraded":"2024-09-10T06:28:48.375816+0000","last_fullsized":"2024-09-10T06:28:48.375816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:04.271824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9809,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452870+0000","last_change":"2024-09-10T06:26:38.308698+0000","last_active":"2024-09-10T06:28:48.452870+0000","last_peered":"2024-09-10T06:28:48.452870+0000","last_clean":"2024-09-10T06:28:48.452870+0000","last_became_active":"2024-09-10T06:26:38.307965+0000","last_became_peered":"2024-09-10T06:26:38.307965+0000","last_unstale":"2024-09-10T06:28:48.452870+0000","last_undegraded":"2024-09-10T06:28:48.452870+0000","last_fullsized":"2024-09-10T06:28:48.452870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:04.566221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"62'4","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454102+0000","last_change":"2024-09-10T06:26:40.326474+0000","last_active":"2024-09-10T06:28:48.454102+0000","last_peered":"2024-09-10T06:28:48.454102+0000","last_clean":"2024-09-10T06:28:48.454102+0000","last_became_active":"2024-09-10T06:26:40.325731+0000","last_became_peered":"2024-09-10T06:26:40.325731+0000","last_unstale":"2024-09-10T06:28:48.454102+0000","last_undegraded":"2024-09-10T06:28:48.454102+0000","last_fullsized":"2024-09-10T06:28:48.454102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:19.400355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"64'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380025+0000","last_change":"2024-09-10T06:26:32.254177+0000","last_active":"2024-09-10T06:28:48.380025+0000","last_peered":"2024-09-10T06:28:48.380025+0000","last_clean":"2024-09-10T06:28:48.380025+0000","last_became_active":"2024-09-10T06:26:32.253154+0000","last_became_peered":"2024-09-10T06:26:32.253154+0000","last_unstale":"2024-09-10T06:28:48.380025+0000","last_undegraded":"2024-09-10T06:28:48.380025+0000","last_fullsized":"2024-09-10T06:28:48.380025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"72'5","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375194+0000","last_change":"2024-09-10T06:26:30.572406+0000","last_active":"2024-09-10T06:28:48.375194+0000","last_peered":"2024-09-10T06:28:48.375194+0000","last_clean":"2024-09-10T06:28:48.375194+0000","last_became_active":"2024-09-10T06:26:30.571829+0000","last_became_peered":"2024-09-10T06:26:30.571829+0000","last_unstale":"2024-09-10T06:28:48.375194+0000","last_undegraded":"2024-09-10T06:28:48.375194+0000","last_fullsized":"2024-09-10T06:28:48.375194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455283+0000","last_change":"2024-09-10T06:26:34.285406+0000","last_active":"2024-09-10T06:28:48.455283+0000","last_peered":"2024-09-10T06:28:48.455283+0000","last_clean":"2024-09-10T06:28:48.455283+0000","last_became_active":"2024-09-10T06:26:34.285004+0000","last_became_peered":"2024-09-10T06:26:34.285004+0000","last_unstale":"2024-09-10T06:28:48.455283+0000","last_undegraded":"2024-09-10T06:28:48.455283+0000","last_fullsized":"2024-09-10T06:28:48.455283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:03.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"87'21","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379938+0000","last_change":"2024-09-10T06:26:36.293191+0000","last_active":"2024-09-10T06:28:48.379938+0000","last_peered":"2024-09-10T06:28:48.379938+0000","last_clean":"2024-09-10T06:28:48.379938+0000","last_became_active":"2024-09-10T06:26:36.292423+0000","last_became_peered":"2024-09-10T06:26:36.292423+0000","last_unstale":"2024-09-10T06:28:48.379938+0000","last_undegraded":"2024-09-10T06:28:48.379938+0000","last_fullsized":"2024-09-10T06:28:48.379938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":28,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378086+0000","last_change":"2024-09-10T06:26:38.293667+0000","last_active":"2024-09-10T06:28:48.378086+0000","last_peered":"2024-09-10T06:28:48.378086+0000","last_clean":"2024-09-10T06:28:48.378086+0000","last_became_active":"2024-09-10T06:26:38.292918+0000","last_became_peered":"2024-09-10T06:26:38.292918+0000","last_unstale":"2024-09-10T06:28:48.378086+0000","last_undegraded":"2024-09-10T06:28:48.378086+0000","last_fullsized":"2024-09-10T06:28:48.378086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:57.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376446+0000","last_change":"2024-09-10T06:26:40.327061+0000","last_active":"2024-09-10T06:28:48.376446+0000","last_peered":"2024-09-10T06:28:48.376446+0000","last_clean":"2024-09-10T06:28:48.376446+0000","last_became_active":"2024-09-10T06:26:40.326431+0000","last_became_peered":"2024-09-10T06:26:40.326431+0000","last_unstale":"2024-09-10T06:28:48.376446+0000","last_undegraded":"2024-09-10T06:28:48.376446+0000","last_fullsized":"2024-09-10T06:28:48.376446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:27.631214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"64'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380722+0000","last_change":"2024-09-10T06:26:32.255139+0000","last_active":"2024-09-10T06:28:48.380722+0000","last_peered":"2024-09-10T06:28:48.380722+0000","last_clean":"2024-09-10T06:28:48.380722+0000","last_became_active":"2024-09-10T06:26:32.253524+0000","last_became_peered":"2024-09-10T06:26:32.253524+0000","last_unstale":"2024-09-10T06:28:48.380722+0000","last_undegraded":"2024-09-10T06:28:48.380722+0000","last_fullsized":"2024-09-10T06:28:48.380722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"73'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459281+0000","last_change":"2024-09-10T06:26:30.591838+0000","last_active":"2024-09-10T06:28:48.459281+0000","last_peered":"2024-09-10T06:28:48.459281+0000","last_clean":"2024-09-10T06:28:48.459281+0000","last_became_active":"2024-09-10T06:26:30.591125+0000","last_became_peered":"2024-09-10T06:26:30.591125+0000","last_unstale":"2024-09-10T06:28:48.459281+0000","last_undegraded":"2024-09-10T06:28:48.459281+0000","last_fullsized":"2024-09-10T06:28:48.459281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453621+0000","last_change":"2024-09-10T06:26:34.280391+0000","last_active":"2024-09-10T06:28:48.453621+0000","last_peered":"2024-09-10T06:28:48.453621+0000","last_clean":"2024-09-10T06:28:48.453621+0000","last_became_active":"2024-09-10T06:26:34.280058+0000","last_became_peered":"2024-09-10T06:26:34.280058+0000","last_unstale":"2024-09-10T06:28:48.453621+0000","last_undegraded":"2024-09-10T06:28:48.453621+0000","last_fullsized":"2024-09-10T06:28:48.453621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.461857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"76'23","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456011+0000","last_change":"2024-09-10T06:26:36.277547+0000","last_active":"2024-09-10T06:28:48.456011+0000","last_peered":"2024-09-10T06:28:48.456011+0000","last_clean":"2024-09-10T06:28:48.456011+0000","last_became_active":"2024-09-10T06:26:36.276965+0000","last_became_peered":"2024-09-10T06:26:36.276965+0000","last_unstale":"2024-09-10T06:28:48.456011+0000","last_undegraded":"2024-09-10T06:28:48.456011+0000","last_fullsized":"2024-09-10T06:28:48.456011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:43.212945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"76'101","reported_seq":296,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455231+0000","last_change":"2024-09-10T06:26:38.306134+0000","last_active":"2024-09-10T06:28:48.455231+0000","last_peered":"2024-09-10T06:28:48.455231+0000","last_clean":"2024-09-10T06:28:48.455231+0000","last_became_active":"2024-09-10T06:26:38.299012+0000","last_became_peered":"2024-09-10T06:26:38.299012+0000","last_unstale":"2024-09-10T06:28:48.455231+0000","last_undegraded":"2024-09-10T06:28:48.455231+0000","last_fullsized":"2024-09-10T06:28:48.455231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:37.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"61'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454114+0000","last_change":"2024-09-10T06:26:40.336036+0000","last_active":"2024-09-10T06:28:48.454114+0000","last_peered":"2024-09-10T06:28:48.454114+0000","last_clean":"2024-09-10T06:28:48.454114+0000","last_became_active":"2024-09-10T06:26:40.335302+0000","last_became_peered":"2024-09-10T06:26:40.335302+0000","last_unstale":"2024-09-10T06:28:48.454114+0000","last_undegraded":"2024-09-10T06:28:48.454114+0000","last_fullsized":"2024-09-10T06:28:48.454114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:24.024562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380676+0000","last_change":"2024-09-10T06:26:32.287897+0000","last_active":"2024-09-10T06:28:48.380676+0000","last_peered":"2024-09-10T06:28:48.380676+0000","last_clean":"2024-09-10T06:28:48.380676+0000","last_became_active":"2024-09-10T06:26:32.287315+0000","last_became_peered":"2024-09-10T06:26:32.287315+0000","last_unstale":"2024-09-10T06:28:48.380676+0000","last_undegraded":"2024-09-10T06:28:48.380676+0000","last_fullsized":"2024-09-10T06:28:48.380676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"73'7","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378593+0000","last_change":"2024-09-10T06:26:30.569192+0000","last_active":"2024-09-10T06:28:48.378593+0000","last_peered":"2024-09-10T06:28:48.378593+0000","last_clean":"2024-09-10T06:28:48.378593+0000","last_became_active":"2024-09-10T06:26:30.568464+0000","last_became_peered":"2024-09-10T06:26:30.568464+0000","last_unstale":"2024-09-10T06:28:48.378593+0000","last_undegraded":"2024-09-10T06:28:48.378593+0000","last_fullsized":"2024-09-10T06:28:48.378593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:58.987914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":280,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459913+0000","last_change":"2024-09-10T06:26:34.279935+0000","last_active":"2024-09-10T06:28:48.459913+0000","last_peered":"2024-09-10T06:28:48.459913+0000","last_clean":"2024-09-10T06:28:48.459913+0000","last_became_active":"2024-09-10T06:26:34.279192+0000","last_became_peered":"2024-09-10T06:26:34.279192+0000","last_unstale":"2024-09-10T06:28:48.459913+0000","last_undegraded":"2024-09-10T06:28:48.459913+0000","last_fullsized":"2024-09-10T06:28:48.459913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:18.753175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377130+0000","last_change":"2024-09-10T06:26:36.290330+0000","last_active":"2024-09-10T06:28:48.377130+0000","last_peered":"2024-09-10T06:28:48.377130+0000","last_clean":"2024-09-10T06:28:48.377130+0000","last_became_active":"2024-09-10T06:26:36.289527+0000","last_became_peered":"2024-09-10T06:26:36.289527+0000","last_unstale":"2024-09-10T06:28:48.377130+0000","last_undegraded":"2024-09-10T06:28:48.377130+0000","last_fullsized":"2024-09-10T06:28:48.377130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"76'101","reported_seq":308,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460319+0000","last_change":"2024-09-10T06:26:38.288663+0000","last_active":"2024-09-10T06:28:48.460319+0000","last_peered":"2024-09-10T06:28:48.460319+0000","last_clean":"2024-09-10T06:28:48.460319+0000","last_became_active":"2024-09-10T06:26:38.287740+0000","last_became_peered":"2024-09-10T06:26:38.287740+0000","last_unstale":"2024-09-10T06:28:48.460319+0000","last_undegraded":"2024-09-10T06:28:48.460319+0000","last_fullsized":"2024-09-10T06:28:48.460319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:22.078943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'8","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377335+0000","last_change":"2024-09-10T06:26:40.329737+0000","last_active":"2024-09-10T06:28:48.377335+0000","last_peered":"2024-09-10T06:28:48.377335+0000","last_clean":"2024-09-10T06:28:48.377335+0000","last_became_active":"2024-09-10T06:26:40.328952+0000","last_became_peered":"2024-09-10T06:26:40.328952+0000","last_unstale":"2024-09-10T06:28:48.377335+0000","last_undegraded":"2024-09-10T06:28:48.377335+0000","last_fullsized":"2024-09-10T06:28:48.377335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454598+0000","last_change":"2024-09-10T06:26:32.270997+0000","last_active":"2024-09-10T06:28:48.454598+0000","last_peered":"2024-09-10T06:28:48.454598+0000","last_clean":"2024-09-10T06:28:48.454598+0000","last_became_active":"2024-09-10T06:26:32.270265+0000","last_became_peered":"2024-09-10T06:26:32.270265+0000","last_unstale":"2024-09-10T06:28:48.454598+0000","last_undegraded":"2024-09-10T06:28:48.454598+0000","last_fullsized":"2024-09-10T06:28:48.454598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:33.067523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"73'11","reported_seq":127,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452795+0000","last_change":"2024-09-10T06:27:08.593158+0000","last_active":"2024-09-10T06:28:48.452795+0000","last_peered":"2024-09-10T06:28:48.452795+0000","last_clean":"2024-09-10T06:28:48.452795+0000","last_became_active":"2024-09-10T06:27:08.592864+0000","last_became_peered":"2024-09-10T06:27:08.592864+0000","last_unstale":"2024-09-10T06:28:48.452795+0000","last_undegraded":"2024-09-10T06:28:48.452795+0000","last_fullsized":"2024-09-10T06:28:48.452795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:35.185591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380176+0000","last_change":"2024-09-10T06:26:34.286497+0000","last_active":"2024-09-10T06:28:48.380176+0000","last_peered":"2024-09-10T06:28:48.380176+0000","last_clean":"2024-09-10T06:28:48.380176+0000","last_became_active":"2024-09-10T06:26:34.285334+0000","last_became_peered":"2024-09-10T06:26:34.285334+0000","last_unstale":"2024-09-10T06:28:48.380176+0000","last_undegraded":"2024-09-10T06:28:48.380176+0000","last_fullsized":"2024-09-10T06:28:48.380176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:54.506182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"76'23","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459007+0000","last_change":"2024-09-10T06:26:36.288213+0000","last_active":"2024-09-10T06:28:48.459007+0000","last_peered":"2024-09-10T06:28:48.459007+0000","last_clean":"2024-09-10T06:28:48.459007+0000","last_became_active":"2024-09-10T06:26:36.287468+0000","last_became_peered":"2024-09-10T06:26:36.287468+0000","last_unstale":"2024-09-10T06:28:48.459007+0000","last_undegraded":"2024-09-10T06:28:48.459007+0000","last_fullsized":"2024-09-10T06:28:48.459007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457629+0000","last_change":"2024-09-10T06:26:38.291943+0000","last_active":"2024-09-10T06:28:48.457629+0000","last_peered":"2024-09-10T06:28:48.457629+0000","last_clean":"2024-09-10T06:28:48.457629+0000","last_became_active":"2024-09-10T06:26:38.291214+0000","last_became_peered":"2024-09-10T06:26:38.291214+0000","last_unstale":"2024-09-10T06:28:48.457629+0000","last_undegraded":"2024-09-10T06:28:48.457629+0000","last_fullsized":"2024-09-10T06:28:48.457629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:56.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"67'4","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453374+0000","last_change":"2024-09-10T06:26:40.331977+0000","last_active":"2024-09-10T06:28:48.453374+0000","last_peered":"2024-09-10T06:28:48.453374+0000","last_clean":"2024-09-10T06:28:48.453374+0000","last_became_active":"2024-09-10T06:26:40.331502+0000","last_became_peered":"2024-09-10T06:26:40.331502+0000","last_unstale":"2024-09-10T06:28:48.453374+0000","last_undegraded":"2024-09-10T06:28:48.453374+0000","last_fullsized":"2024-09-10T06:28:48.453374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:43.572813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460459+0000","last_change":"2024-09-10T06:26:32.274623+0000","last_active":"2024-09-10T06:28:48.460459+0000","last_peered":"2024-09-10T06:28:48.460459+0000","last_clean":"2024-09-10T06:28:48.460459+0000","last_became_active":"2024-09-10T06:26:32.273727+0000","last_became_peered":"2024-09-10T06:26:32.273727+0000","last_unstale":"2024-09-10T06:28:48.460459+0000","last_undegraded":"2024-09-10T06:28:48.460459+0000","last_fullsized":"2024-09-10T06:28:48.460459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:15.364938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":258,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455693+0000","last_change":"2024-09-10T06:26:18.153206+0000","last_active":"2024-09-10T06:28:48.455693+0000","last_peered":"2024-09-10T06:28:48.455693+0000","last_clean":"2024-09-10T06:28:48.455693+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:28:48.455693+0000","last_undegraded":"2024-09-10T06:28:48.455693+0000","last_fullsized":"2024-09-10T06:28:48.455693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_clean_scrub_stamp":"2024-09-10T06:26:16.422775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:42.510577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460195+0000","last_change":"2024-09-10T06:26:25.532465+0000","last_active":"2024-09-10T06:28:48.460195+0000","last_peered":"2024-09-10T06:28:48.460195+0000","last_clean":"2024-09-10T06:28:48.460195+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:28:48.460195+0000","last_undegraded":"2024-09-10T06:28:48.460195+0000","last_fullsized":"2024-09-10T06:28:48.460195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:10.318844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"73'9","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375960+0000","last_change":"2024-09-10T06:26:30.606630+0000","last_active":"2024-09-10T06:28:48.375960+0000","last_peered":"2024-09-10T06:28:48.375960+0000","last_clean":"2024-09-10T06:28:48.375960+0000","last_became_active":"2024-09-10T06:26:30.606348+0000","last_became_peered":"2024-09-10T06:26:30.606348+0000","last_unstale":"2024-09-10T06:28:48.375960+0000","last_undegraded":"2024-09-10T06:28:48.375960+0000","last_fullsized":"2024-09-10T06:28:48.375960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462936+0000","last_change":"2024-09-10T06:26:34.287201+0000","last_active":"2024-09-10T06:28:48.462936+0000","last_peered":"2024-09-10T06:28:48.462936+0000","last_clean":"2024-09-10T06:28:48.462936+0000","last_became_active":"2024-09-10T06:26:34.285248+0000","last_became_peered":"2024-09-10T06:26:34.285248+0000","last_unstale":"2024-09-10T06:28:48.462936+0000","last_undegraded":"2024-09-10T06:28:48.462936+0000","last_fullsized":"2024-09-10T06:28:48.462936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:43.907684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"76'32","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460159+0000","last_change":"2024-09-10T06:26:36.296684+0000","last_active":"2024-09-10T06:28:48.460159+0000","last_peered":"2024-09-10T06:28:48.460159+0000","last_clean":"2024-09-10T06:28:48.460159+0000","last_became_active":"2024-09-10T06:26:36.295901+0000","last_became_peered":"2024-09-10T06:26:36.295901+0000","last_unstale":"2024-09-10T06:28:48.460159+0000","last_undegraded":"2024-09-10T06:28:48.460159+0000","last_fullsized":"2024-09-10T06:28:48.460159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61969,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378965+0000","last_change":"2024-09-10T06:26:38.306412+0000","last_active":"2024-09-10T06:28:48.378965+0000","last_peered":"2024-09-10T06:28:48.378965+0000","last_clean":"2024-09-10T06:28:48.378965+0000","last_became_active":"2024-09-10T06:26:38.305496+0000","last_became_peered":"2024-09-10T06:26:38.305496+0000","last_unstale":"2024-09-10T06:28:48.378965+0000","last_undegraded":"2024-09-10T06:28:48.378965+0000","last_fullsized":"2024-09-10T06:28:48.378965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.370035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"64'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456581+0000","last_change":"2024-09-10T06:26:40.331981+0000","last_active":"2024-09-10T06:28:48.456581+0000","last_peered":"2024-09-10T06:28:48.456581+0000","last_clean":"2024-09-10T06:28:48.456581+0000","last_became_active":"2024-09-10T06:26:40.331294+0000","last_became_peered":"2024-09-10T06:26:40.331294+0000","last_unstale":"2024-09-10T06:28:48.456581+0000","last_undegraded":"2024-09-10T06:28:48.456581+0000","last_fullsized":"2024-09-10T06:28:48.456581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:00.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379255+0000","last_change":"2024-09-10T06:26:32.278733+0000","last_active":"2024-09-10T06:28:48.379255+0000","last_peered":"2024-09-10T06:28:48.379255+0000","last_clean":"2024-09-10T06:28:48.379255+0000","last_became_active":"2024-09-10T06:26:32.278118+0000","last_became_peered":"2024-09-10T06:26:32.278118+0000","last_unstale":"2024-09-10T06:28:48.379255+0000","last_undegraded":"2024-09-10T06:28:48.379255+0000","last_fullsized":"2024-09-10T06:28:48.379255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:58.860666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455540+0000","last_change":"2024-09-10T06:26:26.180664+0000","last_active":"2024-09-10T06:28:48.455540+0000","last_peered":"2024-09-10T06:28:48.455540+0000","last_clean":"2024-09-10T06:28:48.455540+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:28:48.455540+0000","last_undegraded":"2024-09-10T06:28:48.455540+0000","last_fullsized":"2024-09-10T06:28:48.455540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:28.793045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"73'11","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375865+0000","last_change":"2024-09-10T06:26:30.594315+0000","last_active":"2024-09-10T06:28:48.375865+0000","last_peered":"2024-09-10T06:28:48.375865+0000","last_clean":"2024-09-10T06:28:48.375865+0000","last_became_active":"2024-09-10T06:26:30.593978+0000","last_became_peered":"2024-09-10T06:26:30.593978+0000","last_unstale":"2024-09-10T06:28:48.375865+0000","last_undegraded":"2024-09-10T06:28:48.375865+0000","last_fullsized":"2024-09-10T06:28:48.375865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:41.851632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460472+0000","last_change":"2024-09-10T06:26:34.279889+0000","last_active":"2024-09-10T06:28:48.460472+0000","last_peered":"2024-09-10T06:28:48.460472+0000","last_clean":"2024-09-10T06:28:48.460472+0000","last_became_active":"2024-09-10T06:26:34.279147+0000","last_became_peered":"2024-09-10T06:26:34.279147+0000","last_unstale":"2024-09-10T06:28:48.460472+0000","last_undegraded":"2024-09-10T06:28:48.460472+0000","last_fullsized":"2024-09-10T06:28:48.460472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:02.260309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"76'107","reported_seq":326,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453554+0000","last_change":"2024-09-10T06:26:36.290005+0000","last_active":"2024-09-10T06:28:48.453554+0000","last_peered":"2024-09-10T06:28:48.453554+0000","last_clean":"2024-09-10T06:28:48.453554+0000","last_became_active":"2024-09-10T06:26:36.289232+0000","last_became_peered":"2024-09-10T06:26:36.289232+0000","last_unstale":"2024-09-10T06:28:48.453554+0000","last_undegraded":"2024-09-10T06:28:48.453554+0000","last_fullsized":"2024-09-10T06:28:48.453554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:51.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":141,"num_read_kb":126,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463283+0000","last_change":"2024-09-10T06:26:38.302505+0000","last_active":"2024-09-10T06:28:48.463283+0000","last_peered":"2024-09-10T06:28:48.463283+0000","last_clean":"2024-09-10T06:28:48.463283+0000","last_became_active":"2024-09-10T06:26:38.301104+0000","last_became_peered":"2024-09-10T06:26:38.301104+0000","last_unstale":"2024-09-10T06:28:48.463283+0000","last_undegraded":"2024-09-10T06:28:48.463283+0000","last_fullsized":"2024-09-10T06:28:48.463283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.863622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"76'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453152+0000","last_change":"2024-09-10T06:26:40.320079+0000","last_active":"2024-09-10T06:28:48.453152+0000","last_peered":"2024-09-10T06:28:48.453152+0000","last_clean":"2024-09-10T06:28:48.453152+0000","last_became_active":"2024-09-10T06:26:40.319266+0000","last_became_peered":"2024-09-10T06:26:40.319266+0000","last_unstale":"2024-09-10T06:28:48.453152+0000","last_undegraded":"2024-09-10T06:28:48.453152+0000","last_fullsized":"2024-09-10T06:28:48.453152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:57.937745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"76'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454407+0000","last_change":"2024-09-10T06:26:32.282679+0000","last_active":"2024-09-10T06:28:48.454407+0000","last_peered":"2024-09-10T06:28:48.454407+0000","last_clean":"2024-09-10T06:28:48.454407+0000","last_became_active":"2024-09-10T06:26:32.282235+0000","last_became_peered":"2024-09-10T06:26:32.282235+0000","last_unstale":"2024-09-10T06:28:48.454407+0000","last_undegraded":"2024-09-10T06:28:48.454407+0000","last_fullsized":"2024-09-10T06:28:48.454407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:27.994318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454483+0000","last_change":"2024-09-10T06:26:25.979784+0000","last_active":"2024-09-10T06:28:48.454483+0000","last_peered":"2024-09-10T06:28:48.454483+0000","last_clean":"2024-09-10T06:28:48.454483+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:28:48.454483+0000","last_undegraded":"2024-09-10T06:28:48.454483+0000","last_fullsized":"2024-09-10T06:28:48.454483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:42.490682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"65'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453191+0000","last_change":"2024-09-10T06:26:30.570558+0000","last_active":"2024-09-10T06:28:48.453191+0000","last_peered":"2024-09-10T06:28:48.453191+0000","last_clean":"2024-09-10T06:28:48.453191+0000","last_became_active":"2024-09-10T06:26:30.570037+0000","last_became_peered":"2024-09-10T06:26:30.570037+0000","last_unstale":"2024-09-10T06:28:48.453191+0000","last_undegraded":"2024-09-10T06:28:48.453191+0000","last_fullsized":"2024-09-10T06:28:48.453191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:46.692143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455347+0000","last_change":"2024-09-10T06:26:34.284394+0000","last_active":"2024-09-10T06:28:48.455347+0000","last_peered":"2024-09-10T06:28:48.455347+0000","last_clean":"2024-09-10T06:28:48.455347+0000","last_became_active":"2024-09-10T06:26:34.283980+0000","last_became_peered":"2024-09-10T06:26:34.283980+0000","last_unstale":"2024-09-10T06:28:48.455347+0000","last_undegraded":"2024-09-10T06:28:48.455347+0000","last_fullsized":"2024-09-10T06:28:48.455347+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:38.061123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'18","reported_seq":240,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463679+0000","last_change":"2024-09-10T06:28:47.073398+0000","last_active":"2024-09-10T06:28:48.463679+0000","last_peered":"2024-09-10T06:28:48.463679+0000","last_clean":"2024-09-10T06:28:48.463679+0000","last_became_active":"2024-09-10T06:28:46.327631+0000","last_became_peered":"2024-09-10T06:28:46.327631+0000","last_unstale":"2024-09-10T06:28:48.463679+0000","last_undegraded":"2024-09-10T06:28:48.463679+0000","last_fullsized":"2024-09-10T06:28:48.463679+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:25.802510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375982+0000","last_change":"2024-09-10T06:26:38.292411+0000","last_active":"2024-09-10T06:28:48.375982+0000","last_peered":"2024-09-10T06:28:48.375982+0000","last_clean":"2024-09-10T06:28:48.375982+0000","last_became_active":"2024-09-10T06:26:38.291623+0000","last_became_peered":"2024-09-10T06:26:38.291623+0000","last_unstale":"2024-09-10T06:28:48.375982+0000","last_undegraded":"2024-09-10T06:28:48.375982+0000","last_fullsized":"2024-09-10T06:28:48.375982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377280+0000","last_change":"2024-09-10T06:26:40.303598+0000","last_active":"2024-09-10T06:28:48.377280+0000","last_peered":"2024-09-10T06:28:48.377280+0000","last_clean":"2024-09-10T06:28:48.377280+0000","last_became_active":"2024-09-10T06:26:40.302898+0000","last_became_peered":"2024-09-10T06:26:40.302898+0000","last_unstale":"2024-09-10T06:28:48.377280+0000","last_undegraded":"2024-09-10T06:28:48.377280+0000","last_fullsized":"2024-09-10T06:28:48.377280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:49.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"76'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453765+0000","last_change":"2024-09-10T06:26:32.273484+0000","last_active":"2024-09-10T06:28:48.453765+0000","last_peered":"2024-09-10T06:28:48.453765+0000","last_clean":"2024-09-10T06:28:48.453765+0000","last_became_active":"2024-09-10T06:26:32.273183+0000","last_became_peered":"2024-09-10T06:26:32.273183+0000","last_unstale":"2024-09-10T06:28:48.453765+0000","last_undegraded":"2024-09-10T06:28:48.453765+0000","last_fullsized":"2024-09-10T06:28:48.453765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:32.410538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459095+0000","last_change":"2024-09-10T06:26:25.534289+0000","last_active":"2024-09-10T06:28:48.459095+0000","last_peered":"2024-09-10T06:28:48.459095+0000","last_clean":"2024-09-10T06:28:48.459095+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:28:48.459095+0000","last_undegraded":"2024-09-10T06:28:48.459095+0000","last_fullsized":"2024-09-10T06:28:48.459095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:11.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379406+0000","last_change":"2024-09-10T06:26:30.579693+0000","last_active":"2024-09-10T06:28:48.379406+0000","last_peered":"2024-09-10T06:28:48.379406+0000","last_clean":"2024-09-10T06:28:48.379406+0000","last_became_active":"2024-09-10T06:26:30.577934+0000","last_became_peered":"2024-09-10T06:26:30.577934+0000","last_unstale":"2024-09-10T06:28:48.379406+0000","last_undegraded":"2024-09-10T06:28:48.379406+0000","last_fullsized":"2024-09-10T06:28:48.379406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:35.852655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377724+0000","last_change":"2024-09-10T06:26:34.275458+0000","last_active":"2024-09-10T06:28:48.377724+0000","last_peered":"2024-09-10T06:28:48.377724+0000","last_clean":"2024-09-10T06:28:48.377724+0000","last_became_active":"2024-09-10T06:26:34.274705+0000","last_became_peered":"2024-09-10T06:26:34.274705+0000","last_unstale":"2024-09-10T06:28:48.377724+0000","last_undegraded":"2024-09-10T06:28:48.377724+0000","last_fullsized":"2024-09-10T06:28:48.377724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:20.624872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379364+0000","last_change":"2024-09-10T06:26:36.266077+0000","last_active":"2024-09-10T06:28:48.379364+0000","last_peered":"2024-09-10T06:28:48.379364+0000","last_clean":"2024-09-10T06:28:48.379364+0000","last_became_active":"2024-09-10T06:26:36.265322+0000","last_became_peered":"2024-09-10T06:26:36.265322+0000","last_unstale":"2024-09-10T06:28:48.379364+0000","last_undegraded":"2024-09-10T06:28:48.379364+0000","last_fullsized":"2024-09-10T06:28:48.379364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459162+0000","last_change":"2024-09-10T06:28:46.345843+0000","last_active":"2024-09-10T06:28:48.459162+0000","last_peered":"2024-09-10T06:28:48.459162+0000","last_clean":"2024-09-10T06:28:48.459162+0000","last_became_active":"2024-09-10T06:28:46.344951+0000","last_became_peered":"2024-09-10T06:28:46.344951+0000","last_unstale":"2024-09-10T06:28:48.459162+0000","last_undegraded":"2024-09-10T06:28:48.459162+0000","last_fullsized":"2024-09-10T06:28:48.459162+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:17.825354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"76'8","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456074+0000","last_change":"2024-09-10T06:26:40.326887+0000","last_active":"2024-09-10T06:28:48.456074+0000","last_peered":"2024-09-10T06:28:48.456074+0000","last_clean":"2024-09-10T06:28:48.456074+0000","last_became_active":"2024-09-10T06:26:40.326130+0000","last_became_peered":"2024-09-10T06:26:40.326130+0000","last_unstale":"2024-09-10T06:28:48.456074+0000","last_undegraded":"2024-09-10T06:28:48.456074+0000","last_fullsized":"2024-09-10T06:28:48.456074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:28.237428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'8","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453524+0000","last_change":"2024-09-10T06:26:32.282586+0000","last_active":"2024-09-10T06:28:48.453524+0000","last_peered":"2024-09-10T06:28:48.453524+0000","last_clean":"2024-09-10T06:28:48.453524+0000","last_became_active":"2024-09-10T06:26:32.282086+0000","last_became_peered":"2024-09-10T06:26:32.282086+0000","last_unstale":"2024-09-10T06:28:48.453524+0000","last_undegraded":"2024-09-10T06:28:48.453524+0000","last_fullsized":"2024-09-10T06:28:48.453524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:44.269917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"73'16","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459611+0000","last_change":"2024-09-10T06:26:30.591913+0000","last_active":"2024-09-10T06:28:48.459611+0000","last_peered":"2024-09-10T06:28:48.459611+0000","last_clean":"2024-09-10T06:28:48.459611+0000","last_became_active":"2024-09-10T06:26:30.591140+0000","last_became_peered":"2024-09-10T06:26:30.591140+0000","last_unstale":"2024-09-10T06:28:48.459611+0000","last_undegraded":"2024-09-10T06:28:48.459611+0000","last_fullsized":"2024-09-10T06:28:48.459611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454261+0000","last_change":"2024-09-10T06:26:25.537497+0000","last_active":"2024-09-10T06:28:48.454261+0000","last_peered":"2024-09-10T06:28:48.454261+0000","last_clean":"2024-09-10T06:28:48.454261+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:28:48.454261+0000","last_undegraded":"2024-09-10T06:28:48.454261+0000","last_fullsized":"2024-09-10T06:28:48.454261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:44.787852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376269+0000","last_change":"2024-09-10T06:26:34.276099+0000","last_active":"2024-09-10T06:28:48.376269+0000","last_peered":"2024-09-10T06:28:48.376269+0000","last_clean":"2024-09-10T06:28:48.376269+0000","last_became_active":"2024-09-10T06:26:34.273984+0000","last_became_peered":"2024-09-10T06:26:34.273984+0000","last_unstale":"2024-09-10T06:28:48.376269+0000","last_undegraded":"2024-09-10T06:28:48.376269+0000","last_fullsized":"2024-09-10T06:28:48.376269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'31","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375444+0000","last_change":"2024-09-10T06:26:36.272589+0000","last_active":"2024-09-10T06:28:48.375444+0000","last_peered":"2024-09-10T06:28:48.375444+0000","last_clean":"2024-09-10T06:28:48.375444+0000","last_became_active":"2024-09-10T06:26:36.270914+0000","last_became_peered":"2024-09-10T06:26:36.270914+0000","last_unstale":"2024-09-10T06:28:48.375444+0000","last_undegraded":"2024-09-10T06:28:48.375444+0000","last_fullsized":"2024-09-10T06:28:48.375444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:20.764690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61858,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376397+0000","last_change":"2024-09-10T06:26:38.278069+0000","last_active":"2024-09-10T06:28:48.376397+0000","last_peered":"2024-09-10T06:28:48.376397+0000","last_clean":"2024-09-10T06:28:48.376397+0000","last_became_active":"2024-09-10T06:26:38.277261+0000","last_became_peered":"2024-09-10T06:26:38.277261+0000","last_unstale":"2024-09-10T06:28:48.376397+0000","last_undegraded":"2024-09-10T06:28:48.376397+0000","last_fullsized":"2024-09-10T06:28:48.376397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"67'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377903+0000","last_change":"2024-09-10T06:26:40.333741+0000","last_active":"2024-09-10T06:28:48.377903+0000","last_peered":"2024-09-10T06:28:48.377903+0000","last_clean":"2024-09-10T06:28:48.377903+0000","last_became_active":"2024-09-10T06:26:40.329701+0000","last_became_peered":"2024-09-10T06:26:40.329701+0000","last_unstale":"2024-09-10T06:28:48.377903+0000","last_undegraded":"2024-09-10T06:28:48.377903+0000","last_fullsized":"2024-09-10T06:28:48.377903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:53.704790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"67'4","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376410+0000","last_change":"2024-09-10T06:26:32.275551+0000","last_active":"2024-09-10T06:28:48.376410+0000","last_peered":"2024-09-10T06:28:48.376410+0000","last_clean":"2024-09-10T06:28:48.376410+0000","last_became_active":"2024-09-10T06:26:32.274946+0000","last_became_peered":"2024-09-10T06:26:32.274946+0000","last_unstale":"2024-09-10T06:28:48.376410+0000","last_undegraded":"2024-09-10T06:28:48.376410+0000","last_fullsized":"2024-09-10T06:28:48.376410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"73'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454016+0000","last_change":"2024-09-10T06:26:30.565595+0000","last_active":"2024-09-10T06:28:48.454016+0000","last_peered":"2024-09-10T06:28:48.454016+0000","last_clean":"2024-09-10T06:28:48.454016+0000","last_became_active":"2024-09-10T06:26:30.565220+0000","last_became_peered":"2024-09-10T06:26:30.565220+0000","last_unstale":"2024-09-10T06:28:48.454016+0000","last_undegraded":"2024-09-10T06:28:48.454016+0000","last_fullsized":"2024-09-10T06:28:48.454016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:14.600216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464321+0000","last_change":"2024-09-10T06:26:26.180820+0000","last_active":"2024-09-10T06:28:48.464321+0000","last_peered":"2024-09-10T06:28:48.464321+0000","last_clean":"2024-09-10T06:28:48.464321+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:28:48.464321+0000","last_undegraded":"2024-09-10T06:28:48.464321+0000","last_fullsized":"2024-09-10T06:28:48.464321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:51.928304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458371+0000","last_change":"2024-09-10T06:26:34.272915+0000","last_active":"2024-09-10T06:28:48.458371+0000","last_peered":"2024-09-10T06:28:48.458371+0000","last_clean":"2024-09-10T06:28:48.458371+0000","last_became_active":"2024-09-10T06:26:34.272192+0000","last_became_peered":"2024-09-10T06:26:34.272192+0000","last_unstale":"2024-09-10T06:28:48.458371+0000","last_undegraded":"2024-09-10T06:28:48.458371+0000","last_fullsized":"2024-09-10T06:28:48.458371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:07.874348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453060+0000","last_change":"2024-09-10T06:26:36.291431+0000","last_active":"2024-09-10T06:28:48.453060+0000","last_peered":"2024-09-10T06:28:48.453060+0000","last_clean":"2024-09-10T06:28:48.453060+0000","last_became_active":"2024-09-10T06:26:36.290570+0000","last_became_peered":"2024-09-10T06:26:36.290570+0000","last_unstale":"2024-09-10T06:28:48.453060+0000","last_undegraded":"2024-09-10T06:28:48.453060+0000","last_fullsized":"2024-09-10T06:28:48.453060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:10.565531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"76'101","reported_seq":282,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456736+0000","last_change":"2024-09-10T06:26:38.312069+0000","last_active":"2024-09-10T06:28:48.456736+0000","last_peered":"2024-09-10T06:28:48.456736+0000","last_clean":"2024-09-10T06:28:48.456736+0000","last_became_active":"2024-09-10T06:26:38.310450+0000","last_became_peered":"2024-09-10T06:26:38.310450+0000","last_unstale":"2024-09-10T06:28:48.456736+0000","last_undegraded":"2024-09-10T06:28:48.456736+0000","last_fullsized":"2024-09-10T06:28:48.456736+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379742+0000","last_change":"2024-09-10T06:26:40.312990+0000","last_active":"2024-09-10T06:28:48.379742+0000","last_peered":"2024-09-10T06:28:48.379742+0000","last_clean":"2024-09-10T06:28:48.379742+0000","last_became_active":"2024-09-10T06:26:40.312266+0000","last_became_peered":"2024-09-10T06:26:40.312266+0000","last_unstale":"2024-09-10T06:28:48.379742+0000","last_undegraded":"2024-09-10T06:28:48.379742+0000","last_fullsized":"2024-09-10T06:28:48.379742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:15.777105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"76'4","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375253+0000","last_change":"2024-09-10T06:26:32.258874+0000","last_active":"2024-09-10T06:28:48.375253+0000","last_peered":"2024-09-10T06:28:48.375253+0000","last_clean":"2024-09-10T06:28:48.375253+0000","last_became_active":"2024-09-10T06:26:32.258337+0000","last_became_peered":"2024-09-10T06:26:32.258337+0000","last_unstale":"2024-09-10T06:28:48.375253+0000","last_undegraded":"2024-09-10T06:28:48.375253+0000","last_fullsized":"2024-09-10T06:28:48.375253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"73'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379418+0000","last_change":"2024-09-10T06:26:30.581501+0000","last_active":"2024-09-10T06:28:48.379418+0000","last_peered":"2024-09-10T06:28:48.379418+0000","last_clean":"2024-09-10T06:28:48.379418+0000","last_became_active":"2024-09-10T06:26:30.581115+0000","last_became_peered":"2024-09-10T06:26:30.581115+0000","last_unstale":"2024-09-10T06:28:48.379418+0000","last_undegraded":"2024-09-10T06:28:48.379418+0000","last_fullsized":"2024-09-10T06:28:48.379418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454045+0000","last_change":"2024-09-10T06:26:25.537295+0000","last_active":"2024-09-10T06:28:48.454045+0000","last_peered":"2024-09-10T06:28:48.454045+0000","last_clean":"2024-09-10T06:28:48.454045+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:28:48.454045+0000","last_undegraded":"2024-09-10T06:28:48.454045+0000","last_fullsized":"2024-09-10T06:28:48.454045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:32.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377381+0000","last_change":"2024-09-10T06:26:34.258956+0000","last_active":"2024-09-10T06:28:48.377381+0000","last_peered":"2024-09-10T06:28:48.377381+0000","last_clean":"2024-09-10T06:28:48.377381+0000","last_became_active":"2024-09-10T06:26:34.257739+0000","last_became_peered":"2024-09-10T06:26:34.257739+0000","last_unstale":"2024-09-10T06:28:48.377381+0000","last_undegraded":"2024-09-10T06:28:48.377381+0000","last_fullsized":"2024-09-10T06:28:48.377381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:18.547827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'10","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377884+0000","last_change":"2024-09-10T06:26:36.271096+0000","last_active":"2024-09-10T06:28:48.377884+0000","last_peered":"2024-09-10T06:28:48.377884+0000","last_clean":"2024-09-10T06:28:48.377884+0000","last_became_active":"2024-09-10T06:26:36.270325+0000","last_became_peered":"2024-09-10T06:26:36.270325+0000","last_unstale":"2024-09-10T06:28:48.377884+0000","last_undegraded":"2024-09-10T06:28:48.377884+0000","last_fullsized":"2024-09-10T06:28:48.377884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"76'101","reported_seq":268,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378782+0000","last_change":"2024-09-10T06:26:38.300795+0000","last_active":"2024-09-10T06:28:48.378782+0000","last_peered":"2024-09-10T06:28:48.378782+0000","last_clean":"2024-09-10T06:28:48.378782+0000","last_became_active":"2024-09-10T06:26:38.299466+0000","last_became_peered":"2024-09-10T06:26:38.299466+0000","last_unstale":"2024-09-10T06:28:48.378782+0000","last_undegraded":"2024-09-10T06:28:48.378782+0000","last_fullsized":"2024-09-10T06:28:48.378782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:38.641500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"67'4","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377170+0000","last_change":"2024-09-10T06:26:40.329688+0000","last_active":"2024-09-10T06:28:48.377170+0000","last_peered":"2024-09-10T06:28:48.377170+0000","last_clean":"2024-09-10T06:28:48.377170+0000","last_became_active":"2024-09-10T06:26:40.329009+0000","last_became_peered":"2024-09-10T06:26:40.329009+0000","last_unstale":"2024-09-10T06:28:48.377170+0000","last_undegraded":"2024-09-10T06:28:48.377170+0000","last_fullsized":"2024-09-10T06:28:48.377170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'8","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377758+0000","last_change":"2024-09-10T06:26:32.283524+0000","last_active":"2024-09-10T06:28:48.377758+0000","last_peered":"2024-09-10T06:28:48.377758+0000","last_clean":"2024-09-10T06:28:48.377758+0000","last_became_active":"2024-09-10T06:26:32.282794+0000","last_became_peered":"2024-09-10T06:26:32.282794+0000","last_unstale":"2024-09-10T06:28:48.377758+0000","last_undegraded":"2024-09-10T06:28:48.377758+0000","last_fullsized":"2024-09-10T06:28:48.377758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:11.537416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"73'6","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379512+0000","last_change":"2024-09-10T06:26:30.578273+0000","last_active":"2024-09-10T06:28:48.379512+0000","last_peered":"2024-09-10T06:28:48.379512+0000","last_clean":"2024-09-10T06:28:48.379512+0000","last_became_active":"2024-09-10T06:26:30.577985+0000","last_became_peered":"2024-09-10T06:26:30.577985+0000","last_unstale":"2024-09-10T06:28:48.379512+0000","last_undegraded":"2024-09-10T06:28:48.379512+0000","last_fullsized":"2024-09-10T06:28:48.379512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460109+0000","last_change":"2024-09-10T06:26:26.037773+0000","last_active":"2024-09-10T06:28:48.460109+0000","last_peered":"2024-09-10T06:28:48.460109+0000","last_clean":"2024-09-10T06:28:48.460109+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:28:48.460109+0000","last_undegraded":"2024-09-10T06:28:48.460109+0000","last_fullsized":"2024-09-10T06:28:48.460109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:21.949708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374863+0000","last_change":"2024-09-10T06:26:34.268710+0000","last_active":"2024-09-10T06:28:48.374863+0000","last_peered":"2024-09-10T06:28:48.374863+0000","last_clean":"2024-09-10T06:28:48.374863+0000","last_became_active":"2024-09-10T06:26:34.268359+0000","last_became_peered":"2024-09-10T06:26:34.268359+0000","last_unstale":"2024-09-10T06:28:48.374863+0000","last_undegraded":"2024-09-10T06:28:48.374863+0000","last_fullsized":"2024-09-10T06:28:48.374863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:27.191787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"76'37","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462144+0000","last_change":"2024-09-10T06:26:36.299700+0000","last_active":"2024-09-10T06:28:48.462144+0000","last_peered":"2024-09-10T06:28:48.462144+0000","last_clean":"2024-09-10T06:28:48.462144+0000","last_became_active":"2024-09-10T06:26:36.297606+0000","last_became_peered":"2024-09-10T06:26:36.297606+0000","last_unstale":"2024-09-10T06:28:48.462144+0000","last_undegraded":"2024-09-10T06:28:48.462144+0000","last_fullsized":"2024-09-10T06:28:48.462144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375382+0000","last_change":"2024-09-10T06:26:38.290601+0000","last_active":"2024-09-10T06:28:48.375382+0000","last_peered":"2024-09-10T06:28:48.375382+0000","last_clean":"2024-09-10T06:28:48.375382+0000","last_became_active":"2024-09-10T06:26:38.289589+0000","last_became_peered":"2024-09-10T06:26:38.289589+0000","last_unstale":"2024-09-10T06:28:48.375382+0000","last_undegraded":"2024-09-10T06:28:48.375382+0000","last_fullsized":"2024-09-10T06:28:48.375382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:22.625936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":131,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458535+0000","last_change":"2024-09-10T06:26:40.332819+0000","last_active":"2024-09-10T06:28:48.458535+0000","last_peered":"2024-09-10T06:28:48.458535+0000","last_clean":"2024-09-10T06:28:48.458535+0000","last_became_active":"2024-09-10T06:26:40.332160+0000","last_became_peered":"2024-09-10T06:26:40.332160+0000","last_unstale":"2024-09-10T06:28:48.458535+0000","last_undegraded":"2024-09-10T06:28:48.458535+0000","last_fullsized":"2024-09-10T06:28:48.458535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.784870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378032+0000","last_change":"2024-09-10T06:26:40.334393+0000","last_active":"2024-09-10T06:28:48.378032+0000","last_peered":"2024-09-10T06:28:48.378032+0000","last_clean":"2024-09-10T06:28:48.378032+0000","last_became_active":"2024-09-10T06:26:40.333474+0000","last_became_peered":"2024-09-10T06:26:40.333474+0000","last_unstale":"2024-09-10T06:28:48.378032+0000","last_undegraded":"2024-09-10T06:28:48.378032+0000","last_fullsized":"2024-09-10T06:28:48.378032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:35.031954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'6","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379068+0000","last_change":"2024-09-10T06:26:32.272914+0000","last_active":"2024-09-10T06:28:48.379068+0000","last_peered":"2024-09-10T06:28:48.379068+0000","last_clean":"2024-09-10T06:28:48.379068+0000","last_became_active":"2024-09-10T06:26:32.272178+0000","last_became_peered":"2024-09-10T06:26:32.272178+0000","last_unstale":"2024-09-10T06:28:48.379068+0000","last_undegraded":"2024-09-10T06:28:48.379068+0000","last_fullsized":"2024-09-10T06:28:48.379068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"72'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379651+0000","last_change":"2024-09-10T06:26:30.593531+0000","last_active":"2024-09-10T06:28:48.379651+0000","last_peered":"2024-09-10T06:28:48.379651+0000","last_clean":"2024-09-10T06:28:48.379651+0000","last_became_active":"2024-09-10T06:26:30.592753+0000","last_became_peered":"2024-09-10T06:26:30.592753+0000","last_unstale":"2024-09-10T06:28:48.379651+0000","last_undegraded":"2024-09-10T06:28:48.379651+0000","last_fullsized":"2024-09-10T06:28:48.379651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:14.506864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453648+0000","last_change":"2024-09-10T06:26:34.282877+0000","last_active":"2024-09-10T06:28:48.453648+0000","last_peered":"2024-09-10T06:28:48.453648+0000","last_clean":"2024-09-10T06:28:48.453648+0000","last_became_active":"2024-09-10T06:26:34.282281+0000","last_became_peered":"2024-09-10T06:26:34.282281+0000","last_unstale":"2024-09-10T06:28:48.453648+0000","last_undegraded":"2024-09-10T06:28:48.453648+0000","last_fullsized":"2024-09-10T06:28:48.453648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:41.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"76'17","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374470+0000","last_change":"2024-09-10T06:26:36.273166+0000","last_active":"2024-09-10T06:28:48.374470+0000","last_peered":"2024-09-10T06:28:48.374470+0000","last_clean":"2024-09-10T06:28:48.374470+0000","last_became_active":"2024-09-10T06:26:36.272386+0000","last_became_peered":"2024-09-10T06:26:36.272386+0000","last_unstale":"2024-09-10T06:28:48.374470+0000","last_undegraded":"2024-09-10T06:28:48.374470+0000","last_fullsized":"2024-09-10T06:28:48.374470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374423+0000","last_change":"2024-09-10T06:26:38.297347+0000","last_active":"2024-09-10T06:28:48.374423+0000","last_peered":"2024-09-10T06:28:48.374423+0000","last_clean":"2024-09-10T06:28:48.374423+0000","last_became_active":"2024-09-10T06:26:38.296600+0000","last_became_peered":"2024-09-10T06:26:38.296600+0000","last_unstale":"2024-09-10T06:28:48.374423+0000","last_undegraded":"2024-09-10T06:28:48.374423+0000","last_fullsized":"2024-09-10T06:28:48.374423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:08.758126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"67'20","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379025+0000","last_change":"2024-09-10T06:26:40.321844+0000","last_active":"2024-09-10T06:28:48.379025+0000","last_peered":"2024-09-10T06:28:48.379025+0000","last_clean":"2024-09-10T06:28:48.379025+0000","last_became_active":"2024-09-10T06:26:40.321097+0000","last_became_peered":"2024-09-10T06:26:40.321097+0000","last_unstale":"2024-09-10T06:28:48.379025+0000","last_undegraded":"2024-09-10T06:28:48.379025+0000","last_fullsized":"2024-09-10T06:28:48.379025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:10.004849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"67'6","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453385+0000","last_change":"2024-09-10T06:26:32.286989+0000","last_active":"2024-09-10T06:28:48.453385+0000","last_peered":"2024-09-10T06:28:48.453385+0000","last_clean":"2024-09-10T06:28:48.453385+0000","last_became_active":"2024-09-10T06:26:32.286519+0000","last_became_peered":"2024-09-10T06:26:32.286519+0000","last_unstale":"2024-09-10T06:28:48.453385+0000","last_undegraded":"2024-09-10T06:28:48.453385+0000","last_fullsized":"2024-09-10T06:28:48.453385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:31.592472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'6","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463876+0000","last_change":"2024-09-10T06:26:30.587315+0000","last_active":"2024-09-10T06:28:48.463876+0000","last_peered":"2024-09-10T06:28:48.463876+0000","last_clean":"2024-09-10T06:28:48.463876+0000","last_became_active":"2024-09-10T06:26:30.586611+0000","last_became_peered":"2024-09-10T06:26:30.586611+0000","last_unstale":"2024-09-10T06:28:48.463876+0000","last_undegraded":"2024-09-10T06:28:48.463876+0000","last_fullsized":"2024-09-10T06:28:48.463876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"27'1","reported_seq":215,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377034+0000","last_change":"2024-09-10T06:26:34.271770+0000","last_active":"2024-09-10T06:28:48.377034+0000","last_peered":"2024-09-10T06:28:48.377034+0000","last_clean":"2024-09-10T06:28:48.377034+0000","last_became_active":"2024-09-10T06:26:34.269875+0000","last_became_peered":"2024-09-10T06:26:34.269875+0000","last_unstale":"2024-09-10T06:28:48.377034+0000","last_undegraded":"2024-09-10T06:28:48.377034+0000","last_fullsized":"2024-09-10T06:28:48.377034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:09.570079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"67'6","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375158+0000","last_change":"2024-09-10T06:26:36.289140+0000","last_active":"2024-09-10T06:28:48.375158+0000","last_peered":"2024-09-10T06:28:48.375158+0000","last_clean":"2024-09-10T06:28:48.375158+0000","last_became_active":"2024-09-10T06:26:36.288355+0000","last_became_peered":"2024-09-10T06:26:36.288355+0000","last_unstale":"2024-09-10T06:28:48.375158+0000","last_undegraded":"2024-09-10T06:28:48.375158+0000","last_fullsized":"2024-09-10T06:28:48.375158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:42.518982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456834+0000","last_change":"2024-09-10T06:26:38.302040+0000","last_active":"2024-09-10T06:28:48.456834+0000","last_peered":"2024-09-10T06:28:48.456834+0000","last_clean":"2024-09-10T06:28:48.456834+0000","last_became_active":"2024-09-10T06:26:38.301064+0000","last_became_peered":"2024-09-10T06:26:38.301064+0000","last_unstale":"2024-09-10T06:28:48.456834+0000","last_undegraded":"2024-09-10T06:28:48.456834+0000","last_fullsized":"2024-09-10T06:28:48.456834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:41.513255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"64'4","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377465+0000","last_change":"2024-09-10T06:26:40.322368+0000","last_active":"2024-09-10T06:28:48.377465+0000","last_peered":"2024-09-10T06:28:48.377465+0000","last_clean":"2024-09-10T06:28:48.377465+0000","last_became_active":"2024-09-10T06:26:40.321592+0000","last_became_peered":"2024-09-10T06:26:40.321592+0000","last_unstale":"2024-09-10T06:28:48.377465+0000","last_undegraded":"2024-09-10T06:28:48.377465+0000","last_fullsized":"2024-09-10T06:28:48.377465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:03.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"61'4","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375474+0000","last_change":"2024-09-10T06:26:32.259666+0000","last_active":"2024-09-10T06:28:48.375474+0000","last_peered":"2024-09-10T06:28:48.375474+0000","last_clean":"2024-09-10T06:28:48.375474+0000","last_became_active":"2024-09-10T06:26:32.258775+0000","last_became_peered":"2024-09-10T06:26:32.258775+0000","last_unstale":"2024-09-10T06:28:48.375474+0000","last_undegraded":"2024-09-10T06:28:48.375474+0000","last_fullsized":"2024-09-10T06:28:48.375474+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"72'13","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460480+0000","last_change":"2024-09-10T06:26:30.592773+0000","last_active":"2024-09-10T06:28:48.460480+0000","last_peered":"2024-09-10T06:28:48.460480+0000","last_clean":"2024-09-10T06:28:48.460480+0000","last_became_active":"2024-09-10T06:26:30.590566+0000","last_became_peered":"2024-09-10T06:26:30.590566+0000","last_unstale":"2024-09-10T06:28:48.460480+0000","last_undegraded":"2024-09-10T06:28:48.460480+0000","last_fullsized":"2024-09-10T06:28:48.460480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:35.688897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455019+0000","last_change":"2024-09-10T06:26:34.281690+0000","last_active":"2024-09-10T06:28:48.455019+0000","last_peered":"2024-09-10T06:28:48.455019+0000","last_clean":"2024-09-10T06:28:48.455019+0000","last_became_active":"2024-09-10T06:26:34.281008+0000","last_became_peered":"2024-09-10T06:26:34.281008+0000","last_unstale":"2024-09-10T06:28:48.455019+0000","last_undegraded":"2024-09-10T06:28:48.455019+0000","last_fullsized":"2024-09-10T06:28:48.455019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"76'17","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375366+0000","last_change":"2024-09-10T06:26:36.277028+0000","last_active":"2024-09-10T06:28:48.375366+0000","last_peered":"2024-09-10T06:28:48.375366+0000","last_clean":"2024-09-10T06:28:48.375366+0000","last_became_active":"2024-09-10T06:26:36.276248+0000","last_became_peered":"2024-09-10T06:26:36.276248+0000","last_unstale":"2024-09-10T06:28:48.375366+0000","last_undegraded":"2024-09-10T06:28:48.375366+0000","last_fullsized":"2024-09-10T06:28:48.375366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:53.521681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457566+0000","last_change":"2024-09-10T06:28:46.344566+0000","last_active":"2024-09-10T06:28:48.457566+0000","last_peered":"2024-09-10T06:28:48.457566+0000","last_clean":"2024-09-10T06:28:48.457566+0000","last_became_active":"2024-09-10T06:28:46.343657+0000","last_became_peered":"2024-09-10T06:28:46.343657+0000","last_unstale":"2024-09-10T06:28:48.457566+0000","last_undegraded":"2024-09-10T06:28:48.457566+0000","last_fullsized":"2024-09-10T06:28:48.457566+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:25.681176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":131,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460750+0000","last_change":"2024-09-10T06:26:40.331445+0000","last_active":"2024-09-10T06:28:48.460750+0000","last_peered":"2024-09-10T06:28:48.460750+0000","last_clean":"2024-09-10T06:28:48.460750+0000","last_became_active":"2024-09-10T06:26:40.330707+0000","last_became_peered":"2024-09-10T06:26:40.330707+0000","last_unstale":"2024-09-10T06:28:48.460750+0000","last_undegraded":"2024-09-10T06:28:48.460750+0000","last_fullsized":"2024-09-10T06:28:48.460750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.822687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375689+0000","last_change":"2024-09-10T06:26:32.266221+0000","last_active":"2024-09-10T06:28:48.375689+0000","last_peered":"2024-09-10T06:28:48.375689+0000","last_clean":"2024-09-10T06:28:48.375689+0000","last_became_active":"2024-09-10T06:26:32.265705+0000","last_became_peered":"2024-09-10T06:26:32.265705+0000","last_unstale":"2024-09-10T06:28:48.375689+0000","last_undegraded":"2024-09-10T06:28:48.375689+0000","last_fullsized":"2024-09-10T06:28:48.375689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"73'9","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378292+0000","last_change":"2024-09-10T06:26:30.594335+0000","last_active":"2024-09-10T06:28:48.378292+0000","last_peered":"2024-09-10T06:28:48.378292+0000","last_clean":"2024-09-10T06:28:48.378292+0000","last_became_active":"2024-09-10T06:26:30.593326+0000","last_became_peered":"2024-09-10T06:26:30.593326+0000","last_unstale":"2024-09-10T06:28:48.378292+0000","last_undegraded":"2024-09-10T06:28:48.378292+0000","last_fullsized":"2024-09-10T06:28:48.378292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:37.297722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457321+0000","last_change":"2024-09-10T06:26:34.281915+0000","last_active":"2024-09-10T06:28:48.457321+0000","last_peered":"2024-09-10T06:28:48.457321+0000","last_clean":"2024-09-10T06:28:48.457321+0000","last_became_active":"2024-09-10T06:26:34.281147+0000","last_became_peered":"2024-09-10T06:26:34.281147+0000","last_unstale":"2024-09-10T06:28:48.457321+0000","last_undegraded":"2024-09-10T06:28:48.457321+0000","last_fullsized":"2024-09-10T06:28:48.457321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:41.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"76'15","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458102+0000","last_change":"2024-09-10T06:26:36.298537+0000","last_active":"2024-09-10T06:28:48.458102+0000","last_peered":"2024-09-10T06:28:48.458102+0000","last_clean":"2024-09-10T06:28:48.458102+0000","last_became_active":"2024-09-10T06:26:36.297372+0000","last_became_peered":"2024-09-10T06:26:36.297372+0000","last_unstale":"2024-09-10T06:28:48.458102+0000","last_undegraded":"2024-09-10T06:28:48.458102+0000","last_fullsized":"2024-09-10T06:28:48.458102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376039+0000","last_change":"2024-09-10T06:26:38.301461+0000","last_active":"2024-09-10T06:28:48.376039+0000","last_peered":"2024-09-10T06:28:48.376039+0000","last_clean":"2024-09-10T06:28:48.376039+0000","last_became_active":"2024-09-10T06:26:38.300580+0000","last_became_peered":"2024-09-10T06:26:38.300580+0000","last_unstale":"2024-09-10T06:28:48.376039+0000","last_undegraded":"2024-09-10T06:28:48.376039+0000","last_fullsized":"2024-09-10T06:28:48.376039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"67'10","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459745+0000","last_change":"2024-09-10T06:26:32.285276+0000","last_active":"2024-09-10T06:28:48.459745+0000","last_peered":"2024-09-10T06:28:48.459745+0000","last_clean":"2024-09-10T06:28:48.459745+0000","last_became_active":"2024-09-10T06:26:32.284457+0000","last_became_peered":"2024-09-10T06:26:32.284457+0000","last_unstale":"2024-09-10T06:28:48.459745+0000","last_undegraded":"2024-09-10T06:28:48.459745+0000","last_fullsized":"2024-09-10T06:28:48.459745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:37.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"72'7","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376160+0000","last_change":"2024-09-10T06:26:30.573339+0000","last_active":"2024-09-10T06:28:48.376160+0000","last_peered":"2024-09-10T06:28:48.376160+0000","last_clean":"2024-09-10T06:28:48.376160+0000","last_became_active":"2024-09-10T06:26:30.571377+0000","last_became_peered":"2024-09-10T06:26:30.571377+0000","last_unstale":"2024-09-10T06:28:48.376160+0000","last_undegraded":"2024-09-10T06:28:48.376160+0000","last_fullsized":"2024-09-10T06:28:48.376160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:59.752497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378936+0000","last_change":"2024-09-10T06:26:34.269013+0000","last_active":"2024-09-10T06:28:48.378936+0000","last_peered":"2024-09-10T06:28:48.378936+0000","last_clean":"2024-09-10T06:28:48.378936+0000","last_became_active":"2024-09-10T06:26:34.268677+0000","last_became_peered":"2024-09-10T06:26:34.268677+0000","last_unstale":"2024-09-10T06:28:48.378936+0000","last_undegraded":"2024-09-10T06:28:48.378936+0000","last_fullsized":"2024-09-10T06:28:48.378936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"76'24","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453725+0000","last_change":"2024-09-10T06:26:36.300362+0000","last_active":"2024-09-10T06:28:48.453725+0000","last_peered":"2024-09-10T06:28:48.453725+0000","last_clean":"2024-09-10T06:28:48.453725+0000","last_became_active":"2024-09-10T06:26:36.299645+0000","last_became_peered":"2024-09-10T06:26:36.299645+0000","last_unstale":"2024-09-10T06:28:48.453725+0000","last_undegraded":"2024-09-10T06:28:48.453725+0000","last_fullsized":"2024-09-10T06:28:48.453725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:17.424354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461216+0000","last_change":"2024-09-10T06:26:38.299751+0000","last_active":"2024-09-10T06:28:48.461216+0000","last_peered":"2024-09-10T06:28:48.461216+0000","last_clean":"2024-09-10T06:28:48.461216+0000","last_became_active":"2024-09-10T06:26:38.298414+0000","last_became_peered":"2024-09-10T06:26:38.298414+0000","last_unstale":"2024-09-10T06:28:48.461216+0000","last_undegraded":"2024-09-10T06:28:48.461216+0000","last_fullsized":"2024-09-10T06:28:48.461216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375074+0000","last_change":"2024-09-10T06:26:40.312752+0000","last_active":"2024-09-10T06:28:48.375074+0000","last_peered":"2024-09-10T06:28:48.375074+0000","last_clean":"2024-09-10T06:28:48.375074+0000","last_became_active":"2024-09-10T06:26:40.312026+0000","last_became_peered":"2024-09-10T06:26:40.312026+0000","last_unstale":"2024-09-10T06:28:48.375074+0000","last_undegraded":"2024-09-10T06:28:48.375074+0000","last_fullsized":"2024-09-10T06:28:48.375074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:50.071224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379114+0000","last_change":"2024-09-10T06:26:32.266934+0000","last_active":"2024-09-10T06:28:48.379114+0000","last_peered":"2024-09-10T06:28:48.379114+0000","last_clean":"2024-09-10T06:28:48.379114+0000","last_became_active":"2024-09-10T06:26:32.266682+0000","last_became_peered":"2024-09-10T06:26:32.266682+0000","last_unstale":"2024-09-10T06:28:48.379114+0000","last_undegraded":"2024-09-10T06:28:48.379114+0000","last_fullsized":"2024-09-10T06:28:48.379114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"73'15","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453902+0000","last_change":"2024-09-10T06:26:30.579097+0000","last_active":"2024-09-10T06:28:48.453902+0000","last_peered":"2024-09-10T06:28:48.453902+0000","last_clean":"2024-09-10T06:28:48.453902+0000","last_became_active":"2024-09-10T06:26:30.578692+0000","last_became_peered":"2024-09-10T06:26:30.578692+0000","last_unstale":"2024-09-10T06:28:48.453902+0000","last_undegraded":"2024-09-10T06:28:48.453902+0000","last_fullsized":"2024-09-10T06:28:48.453902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:15.878123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":23,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"27'1","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459372+0000","last_change":"2024-09-10T06:26:34.282356+0000","last_active":"2024-09-10T06:28:48.459372+0000","last_peered":"2024-09-10T06:28:48.459372+0000","last_clean":"2024-09-10T06:28:48.459372+0000","last_became_active":"2024-09-10T06:26:34.281167+0000","last_became_peered":"2024-09-10T06:26:34.281167+0000","last_unstale":"2024-09-10T06:28:48.459372+0000","last_undegraded":"2024-09-10T06:28:48.459372+0000","last_fullsized":"2024-09-10T06:28:48.459372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:59.042394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"76'22","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462615+0000","last_change":"2024-09-10T06:26:36.301277+0000","last_active":"2024-09-10T06:28:48.462615+0000","last_peered":"2024-09-10T06:28:48.462615+0000","last_clean":"2024-09-10T06:28:48.462615+0000","last_became_active":"2024-09-10T06:26:36.300501+0000","last_became_peered":"2024-09-10T06:26:36.300501+0000","last_unstale":"2024-09-10T06:28:48.462615+0000","last_undegraded":"2024-09-10T06:28:48.462615+0000","last_fullsized":"2024-09-10T06:28:48.462615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:38.477946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454290+0000","last_change":"2024-09-10T06:26:38.305737+0000","last_active":"2024-09-10T06:28:48.454290+0000","last_peered":"2024-09-10T06:28:48.454290+0000","last_clean":"2024-09-10T06:28:48.454290+0000","last_became_active":"2024-09-10T06:26:38.303318+0000","last_became_peered":"2024-09-10T06:26:38.303318+0000","last_unstale":"2024-09-10T06:28:48.454290+0000","last_undegraded":"2024-09-10T06:28:48.454290+0000","last_fullsized":"2024-09-10T06:28:48.454290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:52.587622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"67'10","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457986+0000","last_change":"2024-09-10T06:26:40.318587+0000","last_active":"2024-09-10T06:28:48.457986+0000","last_peered":"2024-09-10T06:28:48.457986+0000","last_clean":"2024-09-10T06:28:48.457986+0000","last_became_active":"2024-09-10T06:26:40.317695+0000","last_became_peered":"2024-09-10T06:26:40.317695+0000","last_unstale":"2024-09-10T06:28:48.457986+0000","last_undegraded":"2024-09-10T06:28:48.457986+0000","last_fullsized":"2024-09-10T06:28:48.457986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:48.298686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378998+0000","last_change":"2024-09-10T06:26:32.276218+0000","last_active":"2024-09-10T06:28:48.378998+0000","last_peered":"2024-09-10T06:28:48.378998+0000","last_clean":"2024-09-10T06:28:48.378998+0000","last_became_active":"2024-09-10T06:26:32.275805+0000","last_became_peered":"2024-09-10T06:26:32.275805+0000","last_unstale":"2024-09-10T06:28:48.378998+0000","last_undegraded":"2024-09-10T06:28:48.378998+0000","last_fullsized":"2024-09-10T06:28:48.378998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"73'7","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378792+0000","last_change":"2024-09-10T06:26:30.568731+0000","last_active":"2024-09-10T06:28:48.378792+0000","last_peered":"2024-09-10T06:28:48.378792+0000","last_clean":"2024-09-10T06:28:48.378792+0000","last_became_active":"2024-09-10T06:26:30.567937+0000","last_became_peered":"2024-09-10T06:26:30.567937+0000","last_unstale":"2024-09-10T06:28:48.378792+0000","last_undegraded":"2024-09-10T06:28:48.378792+0000","last_fullsized":"2024-09-10T06:28:48.378792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:18.974865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380790+0000","last_change":"2024-09-10T06:26:34.266227+0000","last_active":"2024-09-10T06:28:48.380790+0000","last_peered":"2024-09-10T06:28:48.380790+0000","last_clean":"2024-09-10T06:28:48.380790+0000","last_became_active":"2024-09-10T06:26:34.262443+0000","last_became_peered":"2024-09-10T06:26:34.262443+0000","last_unstale":"2024-09-10T06:28:48.380790+0000","last_undegraded":"2024-09-10T06:28:48.380790+0000","last_fullsized":"2024-09-10T06:28:48.380790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.918813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"76'18","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379862+0000","last_change":"2024-09-10T06:26:36.292958+0000","last_active":"2024-09-10T06:28:48.379862+0000","last_peered":"2024-09-10T06:28:48.379862+0000","last_clean":"2024-09-10T06:28:48.379862+0000","last_became_active":"2024-09-10T06:26:36.292149+0000","last_became_peered":"2024-09-10T06:26:36.292149+0000","last_unstale":"2024-09-10T06:28:48.379862+0000","last_undegraded":"2024-09-10T06:28:48.379862+0000","last_fullsized":"2024-09-10T06:28:48.379862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453832+0000","last_change":"2024-09-10T06:26:38.302991+0000","last_active":"2024-09-10T06:28:48.453832+0000","last_peered":"2024-09-10T06:28:48.453832+0000","last_clean":"2024-09-10T06:28:48.453832+0000","last_became_active":"2024-09-10T06:26:38.289306+0000","last_became_peered":"2024-09-10T06:26:38.289306+0000","last_unstale":"2024-09-10T06:28:48.453832+0000","last_undegraded":"2024-09-10T06:28:48.453832+0000","last_fullsized":"2024-09-10T06:28:48.453832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:57.625329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":131,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456388+0000","last_change":"2024-09-10T06:26:40.327627+0000","last_active":"2024-09-10T06:28:48.456388+0000","last_peered":"2024-09-10T06:28:48.456388+0000","last_clean":"2024-09-10T06:28:48.456388+0000","last_became_active":"2024-09-10T06:26:40.326888+0000","last_became_peered":"2024-09-10T06:26:40.326888+0000","last_unstale":"2024-09-10T06:28:48.456388+0000","last_undegraded":"2024-09-10T06:28:48.456388+0000","last_fullsized":"2024-09-10T06:28:48.456388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:41.122562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455150+0000","last_change":"2024-09-10T06:26:32.275071+0000","last_active":"2024-09-10T06:28:48.455150+0000","last_peered":"2024-09-10T06:28:48.455150+0000","last_clean":"2024-09-10T06:28:48.455150+0000","last_became_active":"2024-09-10T06:26:32.274395+0000","last_became_peered":"2024-09-10T06:26:32.274395+0000","last_unstale":"2024-09-10T06:28:48.455150+0000","last_undegraded":"2024-09-10T06:28:48.455150+0000","last_fullsized":"2024-09-10T06:28:48.455150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:51.369493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"73'7","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376168+0000","last_change":"2024-09-10T06:26:30.594599+0000","last_active":"2024-09-10T06:28:48.376168+0000","last_peered":"2024-09-10T06:28:48.376168+0000","last_clean":"2024-09-10T06:28:48.376168+0000","last_became_active":"2024-09-10T06:26:30.594058+0000","last_became_peered":"2024-09-10T06:26:30.594058+0000","last_unstale":"2024-09-10T06:28:48.376168+0000","last_undegraded":"2024-09-10T06:28:48.376168+0000","last_fullsized":"2024-09-10T06:28:48.376168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:18.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454398+0000","last_change":"2024-09-10T06:26:34.279538+0000","last_active":"2024-09-10T06:28:48.454398+0000","last_peered":"2024-09-10T06:28:48.454398+0000","last_clean":"2024-09-10T06:28:48.454398+0000","last_became_active":"2024-09-10T06:26:34.278871+0000","last_became_peered":"2024-09-10T06:26:34.278871+0000","last_unstale":"2024-09-10T06:28:48.454398+0000","last_undegraded":"2024-09-10T06:28:48.454398+0000","last_fullsized":"2024-09-10T06:28:48.454398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:13.203357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"71'12","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379969+0000","last_change":"2024-09-10T06:26:36.290976+0000","last_active":"2024-09-10T06:28:48.379969+0000","last_peered":"2024-09-10T06:28:48.379969+0000","last_clean":"2024-09-10T06:28:48.379969+0000","last_became_active":"2024-09-10T06:26:36.290265+0000","last_became_peered":"2024-09-10T06:26:36.290265+0000","last_unstale":"2024-09-10T06:28:48.379969+0000","last_undegraded":"2024-09-10T06:28:48.379969+0000","last_fullsized":"2024-09-10T06:28:48.379969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"76'101","reported_seq":270,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458883+0000","last_change":"2024-09-10T06:26:38.292031+0000","last_active":"2024-09-10T06:28:48.458883+0000","last_peered":"2024-09-10T06:28:48.458883+0000","last_clean":"2024-09-10T06:28:48.458883+0000","last_became_active":"2024-09-10T06:26:38.288791+0000","last_became_peered":"2024-09-10T06:26:38.288791+0000","last_unstale":"2024-09-10T06:28:48.458883+0000","last_undegraded":"2024-09-10T06:28:48.458883+0000","last_fullsized":"2024-09-10T06:28:48.458883+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:07.830355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"76'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454947+0000","last_change":"2024-09-10T06:26:40.336448+0000","last_active":"2024-09-10T06:28:48.454947+0000","last_peered":"2024-09-10T06:28:48.454947+0000","last_clean":"2024-09-10T06:28:48.454947+0000","last_became_active":"2024-09-10T06:26:40.335771+0000","last_became_peered":"2024-09-10T06:26:40.335771+0000","last_unstale":"2024-09-10T06:28:48.454947+0000","last_undegraded":"2024-09-10T06:28:48.454947+0000","last_fullsized":"2024-09-10T06:28:48.454947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378840+0000","last_change":"2024-09-10T06:26:32.262176+0000","last_active":"2024-09-10T06:28:48.378840+0000","last_peered":"2024-09-10T06:28:48.378840+0000","last_clean":"2024-09-10T06:28:48.378840+0000","last_became_active":"2024-09-10T06:26:32.261250+0000","last_became_peered":"2024-09-10T06:26:32.261250+0000","last_unstale":"2024-09-10T06:28:48.378840+0000","last_undegraded":"2024-09-10T06:28:48.378840+0000","last_fullsized":"2024-09-10T06:28:48.378840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"73'8","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461812+0000","last_change":"2024-09-10T06:26:30.604587+0000","last_active":"2024-09-10T06:28:48.461812+0000","last_peered":"2024-09-10T06:28:48.461812+0000","last_clean":"2024-09-10T06:28:48.461812+0000","last_became_active":"2024-09-10T06:26:30.603175+0000","last_became_peered":"2024-09-10T06:26:30.603175+0000","last_unstale":"2024-09-10T06:28:48.461812+0000","last_undegraded":"2024-09-10T06:28:48.461812+0000","last_fullsized":"2024-09-10T06:28:48.461812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458176+0000","last_change":"2024-09-10T06:26:34.286028+0000","last_active":"2024-09-10T06:28:48.458176+0000","last_peered":"2024-09-10T06:28:48.458176+0000","last_clean":"2024-09-10T06:28:48.458176+0000","last_became_active":"2024-09-10T06:26:34.285169+0000","last_became_peered":"2024-09-10T06:26:34.285169+0000","last_unstale":"2024-09-10T06:28:48.458176+0000","last_undegraded":"2024-09-10T06:28:48.458176+0000","last_fullsized":"2024-09-10T06:28:48.458176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:24.146088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"76'21","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456781+0000","last_change":"2024-09-10T06:26:36.292679+0000","last_active":"2024-09-10T06:28:48.456781+0000","last_peered":"2024-09-10T06:28:48.456781+0000","last_clean":"2024-09-10T06:28:48.456781+0000","last_became_active":"2024-09-10T06:26:36.288780+0000","last_became_peered":"2024-09-10T06:26:36.288780+0000","last_unstale":"2024-09-10T06:28:48.456781+0000","last_undegraded":"2024-09-10T06:28:48.456781+0000","last_fullsized":"2024-09-10T06:28:48.456781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374526+0000","last_change":"2024-09-10T06:26:38.293015+0000","last_active":"2024-09-10T06:28:48.374526+0000","last_peered":"2024-09-10T06:28:48.374526+0000","last_clean":"2024-09-10T06:28:48.374526+0000","last_became_active":"2024-09-10T06:26:38.292185+0000","last_became_peered":"2024-09-10T06:26:38.292185+0000","last_unstale":"2024-09-10T06:28:48.374526+0000","last_undegraded":"2024-09-10T06:28:48.374526+0000","last_fullsized":"2024-09-10T06:28:48.374526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:32.694777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"64'10","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464809+0000","last_change":"2024-09-10T06:26:40.336074+0000","last_active":"2024-09-10T06:28:48.464809+0000","last_peered":"2024-09-10T06:28:48.464809+0000","last_clean":"2024-09-10T06:28:48.464809+0000","last_became_active":"2024-09-10T06:26:40.335339+0000","last_became_peered":"2024-09-10T06:26:40.335339+0000","last_unstale":"2024-09-10T06:28:48.464809+0000","last_undegraded":"2024-09-10T06:28:48.464809+0000","last_fullsized":"2024-09-10T06:28:48.464809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378132+0000","last_change":"2024-09-10T06:26:32.262823+0000","last_active":"2024-09-10T06:28:48.378132+0000","last_peered":"2024-09-10T06:28:48.378132+0000","last_clean":"2024-09-10T06:28:48.378132+0000","last_became_active":"2024-09-10T06:26:32.262041+0000","last_became_peered":"2024-09-10T06:26:32.262041+0000","last_unstale":"2024-09-10T06:28:48.378132+0000","last_undegraded":"2024-09-10T06:28:48.378132+0000","last_fullsized":"2024-09-10T06:28:48.378132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:48.768083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"73'7","reported_seq":123,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455114+0000","last_change":"2024-09-10T06:27:08.868703+0000","last_active":"2024-09-10T06:28:48.455114+0000","last_peered":"2024-09-10T06:28:48.455114+0000","last_clean":"2024-09-10T06:28:48.455114+0000","last_became_active":"2024-09-10T06:27:08.868399+0000","last_became_peered":"2024-09-10T06:27:08.868399+0000","last_unstale":"2024-09-10T06:28:48.455114+0000","last_undegraded":"2024-09-10T06:28:48.455114+0000","last_fullsized":"2024-09-10T06:28:48.455114+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:20.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459766+0000","last_change":"2024-09-10T06:26:34.282651+0000","last_active":"2024-09-10T06:28:48.459766+0000","last_peered":"2024-09-10T06:28:48.459766+0000","last_clean":"2024-09-10T06:28:48.459766+0000","last_became_active":"2024-09-10T06:26:34.281777+0000","last_became_peered":"2024-09-10T06:26:34.281777+0000","last_unstale":"2024-09-10T06:28:48.459766+0000","last_undegraded":"2024-09-10T06:28:48.459766+0000","last_fullsized":"2024-09-10T06:28:48.459766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:42.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"76'15","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374806+0000","last_change":"2024-09-10T06:26:36.285192+0000","last_active":"2024-09-10T06:28:48.374806+0000","last_peered":"2024-09-10T06:28:48.374806+0000","last_clean":"2024-09-10T06:28:48.374806+0000","last_became_active":"2024-09-10T06:26:36.284470+0000","last_became_peered":"2024-09-10T06:26:36.284470+0000","last_unstale":"2024-09-10T06:28:48.374806+0000","last_undegraded":"2024-09-10T06:28:48.374806+0000","last_fullsized":"2024-09-10T06:28:48.374806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:44.280458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456833+0000","last_change":"2024-09-10T06:26:38.303425+0000","last_active":"2024-09-10T06:28:48.456833+0000","last_peered":"2024-09-10T06:28:48.456833+0000","last_clean":"2024-09-10T06:28:48.456833+0000","last_became_active":"2024-09-10T06:26:38.302606+0000","last_became_peered":"2024-09-10T06:26:38.302606+0000","last_unstale":"2024-09-10T06:28:48.456833+0000","last_undegraded":"2024-09-10T06:28:48.456833+0000","last_fullsized":"2024-09-10T06:28:48.456833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:14.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"76'13","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379222+0000","last_change":"2024-09-10T06:26:40.311253+0000","last_active":"2024-09-10T06:28:48.379222+0000","last_peered":"2024-09-10T06:28:48.379222+0000","last_clean":"2024-09-10T06:28:48.379222+0000","last_became_active":"2024-09-10T06:26:40.310414+0000","last_became_peered":"2024-09-10T06:26:40.310414+0000","last_unstale":"2024-09-10T06:28:48.379222+0000","last_undegraded":"2024-09-10T06:28:48.379222+0000","last_fullsized":"2024-09-10T06:28:48.379222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:20.868195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375885+0000","last_change":"2024-09-10T06:26:32.262972+0000","last_active":"2024-09-10T06:28:48.375885+0000","last_peered":"2024-09-10T06:28:48.375885+0000","last_clean":"2024-09-10T06:28:48.375885+0000","last_became_active":"2024-09-10T06:26:32.262469+0000","last_became_peered":"2024-09-10T06:26:32.262469+0000","last_unstale":"2024-09-10T06:28:48.375885+0000","last_undegraded":"2024-09-10T06:28:48.375885+0000","last_fullsized":"2024-09-10T06:28:48.375885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"72'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379565+0000","last_change":"2024-09-10T06:26:30.602013+0000","last_active":"2024-09-10T06:28:48.379565+0000","last_peered":"2024-09-10T06:28:48.379565+0000","last_clean":"2024-09-10T06:28:48.379565+0000","last_became_active":"2024-09-10T06:26:30.601672+0000","last_became_peered":"2024-09-10T06:26:30.601672+0000","last_unstale":"2024-09-10T06:28:48.379565+0000","last_undegraded":"2024-09-10T06:28:48.379565+0000","last_fullsized":"2024-09-10T06:28:48.379565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:52.012063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376473+0000","last_change":"2024-09-10T06:26:34.277010+0000","last_active":"2024-09-10T06:28:48.376473+0000","last_peered":"2024-09-10T06:28:48.376473+0000","last_clean":"2024-09-10T06:28:48.376473+0000","last_became_active":"2024-09-10T06:26:34.276197+0000","last_became_peered":"2024-09-10T06:26:34.276197+0000","last_unstale":"2024-09-10T06:28:48.376473+0000","last_undegraded":"2024-09-10T06:28:48.376473+0000","last_fullsized":"2024-09-10T06:28:48.376473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:32.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"76'11","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378266+0000","last_change":"2024-09-10T06:26:36.297514+0000","last_active":"2024-09-10T06:28:48.378266+0000","last_peered":"2024-09-10T06:28:48.378266+0000","last_clean":"2024-09-10T06:28:48.378266+0000","last_became_active":"2024-09-10T06:26:36.296615+0000","last_became_peered":"2024-09-10T06:26:36.296615+0000","last_unstale":"2024-09-10T06:28:48.378266+0000","last_undegraded":"2024-09-10T06:28:48.378266+0000","last_fullsized":"2024-09-10T06:28:48.378266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376508+0000","last_change":"2024-09-10T06:26:38.288794+0000","last_active":"2024-09-10T06:28:48.376508+0000","last_peered":"2024-09-10T06:28:48.376508+0000","last_clean":"2024-09-10T06:28:48.376508+0000","last_became_active":"2024-09-10T06:26:38.288055+0000","last_became_peered":"2024-09-10T06:26:38.288055+0000","last_unstale":"2024-09-10T06:28:48.376508+0000","last_undegraded":"2024-09-10T06:28:48.376508+0000","last_fullsized":"2024-09-10T06:28:48.376508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463498+0000","last_change":"2024-09-10T06:26:40.318067+0000","last_active":"2024-09-10T06:28:48.463498+0000","last_peered":"2024-09-10T06:28:48.463498+0000","last_clean":"2024-09-10T06:28:48.463498+0000","last_became_active":"2024-09-10T06:26:40.317244+0000","last_became_peered":"2024-09-10T06:26:40.317244+0000","last_unstale":"2024-09-10T06:28:48.463498+0000","last_undegraded":"2024-09-10T06:28:48.463498+0000","last_fullsized":"2024-09-10T06:28:48.463498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"76'2","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377260+0000","last_change":"2024-09-10T06:26:32.277908+0000","last_active":"2024-09-10T06:28:48.377260+0000","last_peered":"2024-09-10T06:28:48.377260+0000","last_clean":"2024-09-10T06:28:48.377260+0000","last_became_active":"2024-09-10T06:26:32.274812+0000","last_became_peered":"2024-09-10T06:26:32.274812+0000","last_unstale":"2024-09-10T06:28:48.377260+0000","last_undegraded":"2024-09-10T06:28:48.377260+0000","last_fullsized":"2024-09-10T06:28:48.377260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:37.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"73'10","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378238+0000","last_change":"2024-09-10T06:26:30.594013+0000","last_active":"2024-09-10T06:28:48.378238+0000","last_peered":"2024-09-10T06:28:48.378238+0000","last_clean":"2024-09-10T06:28:48.378238+0000","last_became_active":"2024-09-10T06:26:30.593687+0000","last_became_peered":"2024-09-10T06:26:30.593687+0000","last_unstale":"2024-09-10T06:28:48.378238+0000","last_undegraded":"2024-09-10T06:28:48.378238+0000","last_fullsized":"2024-09-10T06:28:48.378238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:37.375037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453204+0000","last_change":"2024-09-10T06:26:34.283392+0000","last_active":"2024-09-10T06:28:48.453204+0000","last_peered":"2024-09-10T06:28:48.453204+0000","last_clean":"2024-09-10T06:28:48.453204+0000","last_became_active":"2024-09-10T06:26:34.282931+0000","last_became_peered":"2024-09-10T06:26:34.282931+0000","last_unstale":"2024-09-10T06:28:48.453204+0000","last_undegraded":"2024-09-10T06:28:48.453204+0000","last_fullsized":"2024-09-10T06:28:48.453204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:01.310719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"76'15","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376888+0000","last_change":"2024-09-10T06:26:36.289834+0000","last_active":"2024-09-10T06:28:48.376888+0000","last_peered":"2024-09-10T06:28:48.376888+0000","last_clean":"2024-09-10T06:28:48.376888+0000","last_became_active":"2024-09-10T06:26:36.289033+0000","last_became_peered":"2024-09-10T06:26:36.289033+0000","last_unstale":"2024-09-10T06:28:48.376888+0000","last_undegraded":"2024-09-10T06:28:48.376888+0000","last_fullsized":"2024-09-10T06:28:48.376888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375946+0000","last_change":"2024-09-10T06:26:38.299568+0000","last_active":"2024-09-10T06:28:48.375946+0000","last_peered":"2024-09-10T06:28:48.375946+0000","last_clean":"2024-09-10T06:28:48.375946+0000","last_became_active":"2024-09-10T06:26:38.298779+0000","last_became_peered":"2024-09-10T06:26:38.298779+0000","last_unstale":"2024-09-10T06:28:48.375946+0000","last_undegraded":"2024-09-10T06:28:48.375946+0000","last_fullsized":"2024-09-10T06:28:48.375946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380965+0000","last_change":"2024-09-10T06:26:40.336329+0000","last_active":"2024-09-10T06:28:48.380965+0000","last_peered":"2024-09-10T06:28:48.380965+0000","last_clean":"2024-09-10T06:28:48.380965+0000","last_became_active":"2024-09-10T06:26:40.335348+0000","last_became_peered":"2024-09-10T06:26:40.335348+0000","last_unstale":"2024-09-10T06:28:48.380965+0000","last_undegraded":"2024-09-10T06:28:48.380965+0000","last_fullsized":"2024-09-10T06:28:48.380965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:40.653642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"62'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454263+0000","last_change":"2024-09-10T06:26:32.276392+0000","last_active":"2024-09-10T06:28:48.454263+0000","last_peered":"2024-09-10T06:28:48.454263+0000","last_clean":"2024-09-10T06:28:48.454263+0000","last_became_active":"2024-09-10T06:26:32.275855+0000","last_became_peered":"2024-09-10T06:26:32.275855+0000","last_unstale":"2024-09-10T06:28:48.454263+0000","last_undegraded":"2024-09-10T06:28:48.454263+0000","last_fullsized":"2024-09-10T06:28:48.454263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:34.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"73'11","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456654+0000","last_change":"2024-09-10T06:26:30.591577+0000","last_active":"2024-09-10T06:28:48.456654+0000","last_peered":"2024-09-10T06:28:48.456654+0000","last_clean":"2024-09-10T06:28:48.456654+0000","last_became_active":"2024-09-10T06:26:30.590801+0000","last_became_peered":"2024-09-10T06:26:30.590801+0000","last_unstale":"2024-09-10T06:28:48.456654+0000","last_undegraded":"2024-09-10T06:28:48.456654+0000","last_fullsized":"2024-09-10T06:28:48.456654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:16.066664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453895+0000","last_change":"2024-09-10T06:26:32.268621+0000","last_active":"2024-09-10T06:28:48.453895+0000","last_peered":"2024-09-10T06:28:48.453895+0000","last_clean":"2024-09-10T06:28:48.453895+0000","last_became_active":"2024-09-10T06:26:32.267915+0000","last_became_peered":"2024-09-10T06:26:32.267915+0000","last_unstale":"2024-09-10T06:28:48.453895+0000","last_undegraded":"2024-09-10T06:28:48.453895+0000","last_fullsized":"2024-09-10T06:28:48.453895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:10.670492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"73'10","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452875+0000","last_change":"2024-09-10T06:26:30.593794+0000","last_active":"2024-09-10T06:28:48.452875+0000","last_peered":"2024-09-10T06:28:48.452875+0000","last_clean":"2024-09-10T06:28:48.452875+0000","last_became_active":"2024-09-10T06:26:30.593506+0000","last_became_peered":"2024-09-10T06:26:30.593506+0000","last_unstale":"2024-09-10T06:28:48.452875+0000","last_undegraded":"2024-09-10T06:28:48.452875+0000","last_fullsized":"2024-09-10T06:28:48.452875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:29.521578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'6","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459260+0000","last_change":"2024-09-10T06:26:32.288497+0000","last_active":"2024-09-10T06:28:48.459260+0000","last_peered":"2024-09-10T06:28:48.459260+0000","last_clean":"2024-09-10T06:28:48.459260+0000","last_became_active":"2024-09-10T06:26:32.287839+0000","last_became_peered":"2024-09-10T06:26:32.287839+0000","last_unstale":"2024-09-10T06:28:48.459260+0000","last_undegraded":"2024-09-10T06:28:48.459260+0000","last_fullsized":"2024-09-10T06:28:48.459260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"72'5","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454219+0000","last_change":"2024-09-10T06:28:09.627267+0000","last_active":"2024-09-10T06:28:48.454219+0000","last_peered":"2024-09-10T06:28:48.454219+0000","last_clean":"2024-09-10T06:28:48.454219+0000","last_became_active":"2024-09-10T06:28:09.544344+0000","last_became_peered":"2024-09-10T06:28:09.544344+0000","last_unstale":"2024-09-10T06:28:48.454219+0000","last_undegraded":"2024-09-10T06:28:48.454219+0000","last_fullsized":"2024-09-10T06:28:48.454219+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:57.591444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"62'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454143+0000","last_change":"2024-09-10T06:26:32.272921+0000","last_active":"2024-09-10T06:28:48.454143+0000","last_peered":"2024-09-10T06:28:48.454143+0000","last_clean":"2024-09-10T06:28:48.454143+0000","last_became_active":"2024-09-10T06:26:32.272279+0000","last_became_peered":"2024-09-10T06:26:32.272279+0000","last_unstale":"2024-09-10T06:28:48.454143+0000","last_undegraded":"2024-09-10T06:28:48.454143+0000","last_fullsized":"2024-09-10T06:28:48.454143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:11.951551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"73'12","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376254+0000","last_change":"2024-09-10T06:26:30.579541+0000","last_active":"2024-09-10T06:28:48.376254+0000","last_peered":"2024-09-10T06:28:48.376254+0000","last_clean":"2024-09-10T06:28:48.376254+0000","last_became_active":"2024-09-10T06:26:30.579189+0000","last_became_peered":"2024-09-10T06:26:30.579189+0000","last_unstale":"2024-09-10T06:28:48.376254+0000","last_undegraded":"2024-09-10T06:28:48.376254+0000","last_fullsized":"2024-09-10T06:28:48.376254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:18.099885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377659+0000","last_change":"2024-09-10T06:26:32.260098+0000","last_active":"2024-09-10T06:28:48.377659+0000","last_peered":"2024-09-10T06:28:48.377659+0000","last_clean":"2024-09-10T06:28:48.377659+0000","last_became_active":"2024-09-10T06:26:32.259644+0000","last_became_peered":"2024-09-10T06:26:32.259644+0000","last_unstale":"2024-09-10T06:28:48.377659+0000","last_undegraded":"2024-09-10T06:28:48.377659+0000","last_fullsized":"2024-09-10T06:28:48.377659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"72'11","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378625+0000","last_change":"2024-09-10T06:26:30.576146+0000","last_active":"2024-09-10T06:28:48.378625+0000","last_peered":"2024-09-10T06:28:48.378625+0000","last_clean":"2024-09-10T06:28:48.378625+0000","last_became_active":"2024-09-10T06:26:30.575605+0000","last_became_peered":"2024-09-10T06:26:30.575605+0000","last_unstale":"2024-09-10T06:28:48.378625+0000","last_undegraded":"2024-09-10T06:28:48.378625+0000","last_fullsized":"2024-09-10T06:28:48.378625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"76'10","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378536+0000","last_change":"2024-09-10T06:26:32.277577+0000","last_active":"2024-09-10T06:28:48.378536+0000","last_peered":"2024-09-10T06:28:48.378536+0000","last_clean":"2024-09-10T06:28:48.378536+0000","last_became_active":"2024-09-10T06:26:32.272454+0000","last_became_peered":"2024-09-10T06:26:32.272454+0000","last_unstale":"2024-09-10T06:28:48.378536+0000","last_undegraded":"2024-09-10T06:28:48.378536+0000","last_fullsized":"2024-09-10T06:28:48.378536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"73'6","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454604+0000","last_change":"2024-09-10T06:26:30.579134+0000","last_active":"2024-09-10T06:28:48.454604+0000","last_peered":"2024-09-10T06:28:48.454604+0000","last_clean":"2024-09-10T06:28:48.454604+0000","last_became_active":"2024-09-10T06:26:30.578732+0000","last_became_peered":"2024-09-10T06:26:30.578732+0000","last_unstale":"2024-09-10T06:28:48.454604+0000","last_undegraded":"2024-09-10T06:28:48.454604+0000","last_fullsized":"2024-09-10T06:28:48.454604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:08.832907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375228+0000","last_change":"2024-09-10T06:26:32.270804+0000","last_active":"2024-09-10T06:28:48.375228+0000","last_peered":"2024-09-10T06:28:48.375228+0000","last_clean":"2024-09-10T06:28:48.375228+0000","last_became_active":"2024-09-10T06:26:32.270327+0000","last_became_peered":"2024-09-10T06:26:32.270327+0000","last_unstale":"2024-09-10T06:28:48.375228+0000","last_undegraded":"2024-09-10T06:28:48.375228+0000","last_fullsized":"2024-09-10T06:28:48.375228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"72'6","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459860+0000","last_change":"2024-09-10T06:26:30.598004+0000","last_active":"2024-09-10T06:28:48.459860+0000","last_peered":"2024-09-10T06:28:48.459860+0000","last_clean":"2024-09-10T06:28:48.459860+0000","last_became_active":"2024-09-10T06:26:30.596254+0000","last_became_peered":"2024-09-10T06:26:30.596254+0000","last_unstale":"2024-09-10T06:28:48.459860+0000","last_undegraded":"2024-09-10T06:28:48.459860+0000","last_fullsized":"2024-09-10T06:28:48.459860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'2","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456398+0000","last_change":"2024-09-10T06:26:32.284215+0000","last_active":"2024-09-10T06:28:48.456398+0000","last_peered":"2024-09-10T06:28:48.456398+0000","last_clean":"2024-09-10T06:28:48.456398+0000","last_became_active":"2024-09-10T06:26:32.275133+0000","last_became_peered":"2024-09-10T06:26:32.275133+0000","last_unstale":"2024-09-10T06:28:48.456398+0000","last_undegraded":"2024-09-10T06:28:48.456398+0000","last_fullsized":"2024-09-10T06:28:48.456398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:37.703268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"73'9","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379658+0000","last_change":"2024-09-10T06:26:30.580586+0000","last_active":"2024-09-10T06:28:48.379658+0000","last_peered":"2024-09-10T06:28:48.379658+0000","last_clean":"2024-09-10T06:28:48.379658+0000","last_became_active":"2024-09-10T06:26:30.580134+0000","last_became_peered":"2024-09-10T06:26:30.580134+0000","last_unstale":"2024-09-10T06:28:48.379658+0000","last_undegraded":"2024-09-10T06:28:48.379658+0000","last_fullsized":"2024-09-10T06:28:48.379658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378184+0000","last_change":"2024-09-10T06:26:32.256538+0000","last_active":"2024-09-10T06:28:48.378184+0000","last_peered":"2024-09-10T06:28:48.378184+0000","last_clean":"2024-09-10T06:28:48.378184+0000","last_became_active":"2024-09-10T06:26:32.256052+0000","last_became_peered":"2024-09-10T06:26:32.256052+0000","last_unstale":"2024-09-10T06:28:48.378184+0000","last_undegraded":"2024-09-10T06:28:48.378184+0000","last_fullsized":"2024-09-10T06:28:48.378184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:14.620472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"73'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457141+0000","last_change":"2024-09-10T06:26:30.585220+0000","last_active":"2024-09-10T06:28:48.457141+0000","last_peered":"2024-09-10T06:28:48.457141+0000","last_clean":"2024-09-10T06:28:48.457141+0000","last_became_active":"2024-09-10T06:26:30.584443+0000","last_became_peered":"2024-09-10T06:26:30.584443+0000","last_unstale":"2024-09-10T06:28:48.457141+0000","last_undegraded":"2024-09-10T06:28:48.457141+0000","last_fullsized":"2024-09-10T06:28:48.457141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380315+0000","last_change":"2024-09-10T06:26:32.259306+0000","last_active":"2024-09-10T06:28:48.380315+0000","last_peered":"2024-09-10T06:28:48.380315+0000","last_clean":"2024-09-10T06:28:48.380315+0000","last_became_active":"2024-09-10T06:26:32.258513+0000","last_became_peered":"2024-09-10T06:26:32.258513+0000","last_unstale":"2024-09-10T06:28:48.380315+0000","last_undegraded":"2024-09-10T06:28:48.380315+0000","last_fullsized":"2024-09-10T06:28:48.380315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"73'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376110+0000","last_change":"2024-09-10T06:26:30.581285+0000","last_active":"2024-09-10T06:28:48.376110+0000","last_peered":"2024-09-10T06:28:48.376110+0000","last_clean":"2024-09-10T06:28:48.376110+0000","last_became_active":"2024-09-10T06:26:30.580913+0000","last_became_peered":"2024-09-10T06:26:30.580913+0000","last_unstale":"2024-09-10T06:28:48.376110+0000","last_undegraded":"2024-09-10T06:28:48.376110+0000","last_fullsized":"2024-09-10T06:28:48.376110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"76'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455519+0000","last_change":"2024-09-10T06:26:32.274773+0000","last_active":"2024-09-10T06:28:48.455519+0000","last_peered":"2024-09-10T06:28:48.455519+0000","last_clean":"2024-09-10T06:28:48.455519+0000","last_became_active":"2024-09-10T06:26:32.274327+0000","last_became_peered":"2024-09-10T06:26:32.274327+0000","last_unstale":"2024-09-10T06:28:48.455519+0000","last_undegraded":"2024-09-10T06:28:48.455519+0000","last_fullsized":"2024-09-10T06:28:48.455519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:54.026434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"73'6","reported_seq":122,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454426+0000","last_change":"2024-09-10T06:27:08.592940+0000","last_active":"2024-09-10T06:28:48.454426+0000","last_peered":"2024-09-10T06:28:48.454426+0000","last_clean":"2024-09-10T06:28:48.454426+0000","last_became_active":"2024-09-10T06:27:08.592637+0000","last_became_peered":"2024-09-10T06:27:08.592637+0000","last_unstale":"2024-09-10T06:28:48.454426+0000","last_undegraded":"2024-09-10T06:28:48.454426+0000","last_fullsized":"2024-09-10T06:28:48.454426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:06.335302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380493+0000","last_change":"2024-09-10T06:26:32.279474+0000","last_active":"2024-09-10T06:28:48.380493+0000","last_peered":"2024-09-10T06:28:48.380493+0000","last_clean":"2024-09-10T06:28:48.380493+0000","last_became_active":"2024-09-10T06:26:32.278461+0000","last_became_peered":"2024-09-10T06:26:32.278461+0000","last_unstale":"2024-09-10T06:28:48.380493+0000","last_undegraded":"2024-09-10T06:28:48.380493+0000","last_fullsized":"2024-09-10T06:28:48.380493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"73'8","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376355+0000","last_change":"2024-09-10T06:26:30.605519+0000","last_active":"2024-09-10T06:28:48.376355+0000","last_peered":"2024-09-10T06:28:48.376355+0000","last_clean":"2024-09-10T06:28:48.376355+0000","last_became_active":"2024-09-10T06:26:30.605225+0000","last_became_peered":"2024-09-10T06:26:30.605225+0000","last_unstale":"2024-09-10T06:28:48.376355+0000","last_undegraded":"2024-09-10T06:28:48.376355+0000","last_fullsized":"2024-09-10T06:28:48.376355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"64'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462698+0000","last_change":"2024-09-10T06:26:32.267201+0000","last_active":"2024-09-10T06:28:48.462698+0000","last_peered":"2024-09-10T06:28:48.462698+0000","last_clean":"2024-09-10T06:28:48.462698+0000","last_became_active":"2024-09-10T06:26:32.266234+0000","last_became_peered":"2024-09-10T06:26:32.266234+0000","last_unstale":"2024-09-10T06:28:48.462698+0000","last_undegraded":"2024-09-10T06:28:48.462698+0000","last_fullsized":"2024-09-10T06:28:48.462698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"72'10","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458276+0000","last_change":"2024-09-10T06:26:30.596647+0000","last_active":"2024-09-10T06:28:48.458276+0000","last_peered":"2024-09-10T06:28:48.458276+0000","last_clean":"2024-09-10T06:28:48.458276+0000","last_became_active":"2024-09-10T06:26:30.593598+0000","last_became_peered":"2024-09-10T06:26:30.593598+0000","last_unstale":"2024-09-10T06:28:48.458276+0000","last_undegraded":"2024-09-10T06:28:48.458276+0000","last_fullsized":"2024-09-10T06:28:48.458276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"76'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375198+0000","last_change":"2024-09-10T06:26:32.278317+0000","last_active":"2024-09-10T06:28:48.375198+0000","last_peered":"2024-09-10T06:28:48.375198+0000","last_clean":"2024-09-10T06:28:48.375198+0000","last_became_active":"2024-09-10T06:26:32.278032+0000","last_became_peered":"2024-09-10T06:26:32.278032+0000","last_unstale":"2024-09-10T06:28:48.375198+0000","last_undegraded":"2024-09-10T06:28:48.375198+0000","last_fullsized":"2024-09-10T06:28:48.375198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:00.200118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"72'9","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464311+0000","last_change":"2024-09-10T06:26:30.580552+0000","last_active":"2024-09-10T06:28:48.464311+0000","last_peered":"2024-09-10T06:28:48.464311+0000","last_clean":"2024-09-10T06:28:48.464311+0000","last_became_active":"2024-09-10T06:26:30.579319+0000","last_became_peered":"2024-09-10T06:26:30.579319+0000","last_unstale":"2024-09-10T06:28:48.464311+0000","last_undegraded":"2024-09-10T06:28:48.464311+0000","last_fullsized":"2024-09-10T06:28:48.464311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:59.885311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"67'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375088+0000","last_change":"2024-09-10T06:26:32.257601+0000","last_active":"2024-09-10T06:28:48.375088+0000","last_peered":"2024-09-10T06:28:48.375088+0000","last_clean":"2024-09-10T06:28:48.375088+0000","last_became_active":"2024-09-10T06:26:32.256851+0000","last_became_peered":"2024-09-10T06:26:32.256851+0000","last_unstale":"2024-09-10T06:28:48.375088+0000","last_undegraded":"2024-09-10T06:28:48.375088+0000","last_fullsized":"2024-09-10T06:28:48.375088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"73'12","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455655+0000","last_change":"2024-09-10T06:28:47.047609+0000","last_active":"2024-09-10T06:28:48.455655+0000","last_peered":"2024-09-10T06:28:48.455655+0000","last_clean":"2024-09-10T06:28:48.455655+0000","last_became_active":"2024-09-10T06:28:46.326501+0000","last_became_peered":"2024-09-10T06:28:46.326501+0000","last_unstale":"2024-09-10T06:28:48.455655+0000","last_undegraded":"2024-09-10T06:28:48.455655+0000","last_fullsized":"2024-09-10T06:28:48.455655+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:33.793329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"62'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455403+0000","last_change":"2024-09-10T06:26:32.266768+0000","last_active":"2024-09-10T06:28:48.455403+0000","last_peered":"2024-09-10T06:28:48.455403+0000","last_clean":"2024-09-10T06:28:48.455403+0000","last_became_active":"2024-09-10T06:26:32.266000+0000","last_became_peered":"2024-09-10T06:26:32.266000+0000","last_unstale":"2024-09-10T06:28:48.455403+0000","last_undegraded":"2024-09-10T06:28:48.455403+0000","last_fullsized":"2024-09-10T06:28:48.455403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"72'9","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460809+0000","last_change":"2024-09-10T06:26:30.610309+0000","last_active":"2024-09-10T06:28:48.460809+0000","last_peered":"2024-09-10T06:28:48.460809+0000","last_clean":"2024-09-10T06:28:48.460809+0000","last_became_active":"2024-09-10T06:26:30.609674+0000","last_became_peered":"2024-09-10T06:26:30.609674+0000","last_unstale":"2024-09-10T06:28:48.460809+0000","last_undegraded":"2024-09-10T06:28:48.460809+0000","last_fullsized":"2024-09-10T06:28:48.460809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"73'10","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457073+0000","last_change":"2024-09-10T06:26:30.591365+0000","last_active":"2024-09-10T06:28:48.457073+0000","last_peered":"2024-09-10T06:28:48.457073+0000","last_clean":"2024-09-10T06:28:48.457073+0000","last_became_active":"2024-09-10T06:26:30.590640+0000","last_became_peered":"2024-09-10T06:26:30.590640+0000","last_unstale":"2024-09-10T06:28:48.457073+0000","last_undegraded":"2024-09-10T06:28:48.457073+0000","last_fullsized":"2024-09-10T06:28:48.457073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"67'10","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378124+0000","last_change":"2024-09-10T06:26:32.267333+0000","last_active":"2024-09-10T06:28:48.378124+0000","last_peered":"2024-09-10T06:28:48.378124+0000","last_clean":"2024-09-10T06:28:48.378124+0000","last_became_active":"2024-09-10T06:26:32.266876+0000","last_became_peered":"2024-09-10T06:26:32.266876+0000","last_unstale":"2024-09-10T06:28:48.378124+0000","last_undegraded":"2024-09-10T06:28:48.378124+0000","last_fullsized":"2024-09-10T06:28:48.378124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:02.483639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"73'13","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453736+0000","last_change":"2024-09-10T06:26:30.590924+0000","last_active":"2024-09-10T06:28:48.453736+0000","last_peered":"2024-09-10T06:28:48.453736+0000","last_clean":"2024-09-10T06:28:48.453736+0000","last_became_active":"2024-09-10T06:26:30.590415+0000","last_became_peered":"2024-09-10T06:26:30.590415+0000","last_unstale":"2024-09-10T06:28:48.453736+0000","last_undegraded":"2024-09-10T06:28:48.453736+0000","last_fullsized":"2024-09-10T06:28:48.453736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:32.460291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460280+0000","last_change":"2024-09-10T06:26:32.283339+0000","last_active":"2024-09-10T06:28:48.460280+0000","last_peered":"2024-09-10T06:28:48.460280+0000","last_clean":"2024-09-10T06:28:48.460280+0000","last_became_active":"2024-09-10T06:26:32.282581+0000","last_became_peered":"2024-09-10T06:26:32.282581+0000","last_unstale":"2024-09-10T06:28:48.460280+0000","last_undegraded":"2024-09-10T06:28:48.460280+0000","last_fullsized":"2024-09-10T06:28:48.460280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":808,"ondisk_log_size":808,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":160287,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":814,"num_read_kb":573,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":272742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":667,"ondisk_log_size":667,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":334,"num_read_kb":334,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":567,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":632,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":209715200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":651444,"kb_used_data":620252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93720396,"statfs":{"total":96636764160,"available":95969685504,"internally_reserved":0,"allocated":635138048,"data_stored":634594233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536128,"kb_used_data":504936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93835712,"statfs":{"total":96636764160,"available":96087769088,"internally_reserved":0,"allocated":517054464,"data_stored":516546322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":700076,"kb_used_data":668884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93671764,"statfs":{"total":96636764160,"available":95919886336,"internally_reserved":0,"allocated":684937216,"data_stored":684376545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757300,"kb_used_data":726108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93614540,"statfs":{"total":96636764160,"available":95861288960,"internally_reserved":0,"allocated":743534592,"data_stored":743038236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":710352,"kb_used_data":679160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93661488,"statfs":{"total":96636764160,"available":95909363712,"internally_reserved":0,"allocated":695459840,"data_stored":694924989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542180,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":433720,"kb_used_data":402528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93938120,"statfs":{"total":96636764160,"available":96192634880,"internally_reserved":0,"allocated":412188672,"data_stored":411692893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":439884,"kb_used_data":408696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93931956,"statfs":{"total":96636764160,"available":96186322944,"internally_reserved":0,"allocated":418504704,"data_stored":417979454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":712908,"kb_used_data":681716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93658932,"statfs":{"total":96636764160,"available":95906746368,"internally_reserved":0,"allocated":698077184,"data_stored":697554526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":696254464,"data_stored":696254464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":417333248,"data_stored":417333248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":411041792,"data_stored":411041792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":694157312,"data_stored":694157312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":742391808,"data_stored":742391808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":683671552,"data_stored":683671552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":515899392,"data_stored":515899392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":633339904,"data_stored":633339904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":122118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":59667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":18838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:28:51.899 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:28:52.230 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:28:52.236 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:28:52.246 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-09-10T06:28:51.461292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397797023,"num_objects":772,"num_object_clones":0,"num_object_copies":1544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":772,"num_whiteouts":0,"num_read":2073,"num_read_kb":1782,"num_write":1669,"num_write_kb":2367363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":209715508,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2473,"ondisk_log_size":2473,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4941812,"kb_used_data":4692280,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":750032908,"statfs":{"total":773094113280,"available":768033697792,"internally_reserved":0,"allocated":4804894720,"data_stored":4800707198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":117440666,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001998"},"pg_stats":[{"pgid":"3.3f","version":"73'12","reported_seq":126,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453692+0000","last_change":"2024-09-10T06:27:08.597414+0000","last_active":"2024-09-10T06:28:48.453692+0000","last_peered":"2024-09-10T06:28:48.453692+0000","last_clean":"2024-09-10T06:28:48.453692+0000","last_became_active":"2024-09-10T06:27:08.597026+0000","last_became_peered":"2024-09-10T06:27:08.597026+0000","last_unstale":"2024-09-10T06:28:48.453692+0000","last_undegraded":"2024-09-10T06:28:48.453692+0000","last_fullsized":"2024-09-10T06:28:48.453692+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:07.484952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"67'4","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456465+0000","last_change":"2024-09-10T06:26:32.279882+0000","last_active":"2024-09-10T06:28:48.456465+0000","last_peered":"2024-09-10T06:28:48.456465+0000","last_clean":"2024-09-10T06:28:48.456465+0000","last_became_active":"2024-09-10T06:26:32.279098+0000","last_became_peered":"2024-09-10T06:26:32.279098+0000","last_unstale":"2024-09-10T06:28:48.456465+0000","last_undegraded":"2024-09-10T06:28:48.456465+0000","last_fullsized":"2024-09-10T06:28:48.456465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"72'5","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454007+0000","last_change":"2024-09-10T06:26:30.573148+0000","last_active":"2024-09-10T06:28:48.454007+0000","last_peered":"2024-09-10T06:28:48.454007+0000","last_clean":"2024-09-10T06:28:48.454007+0000","last_became_active":"2024-09-10T06:26:30.572798+0000","last_became_peered":"2024-09-10T06:26:30.572798+0000","last_unstale":"2024-09-10T06:28:48.454007+0000","last_undegraded":"2024-09-10T06:28:48.454007+0000","last_fullsized":"2024-09-10T06:28:48.454007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:38.833715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"62'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457051+0000","last_change":"2024-09-10T06:26:32.276811+0000","last_active":"2024-09-10T06:28:48.457051+0000","last_peered":"2024-09-10T06:28:48.457051+0000","last_clean":"2024-09-10T06:28:48.457051+0000","last_became_active":"2024-09-10T06:26:32.275990+0000","last_became_peered":"2024-09-10T06:26:32.275990+0000","last_unstale":"2024-09-10T06:28:48.457051+0000","last_undegraded":"2024-09-10T06:28:48.457051+0000","last_fullsized":"2024-09-10T06:28:48.457051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"72'10","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377820+0000","last_change":"2024-09-10T06:26:30.578068+0000","last_active":"2024-09-10T06:28:48.377820+0000","last_peered":"2024-09-10T06:28:48.377820+0000","last_clean":"2024-09-10T06:28:48.377820+0000","last_became_active":"2024-09-10T06:26:30.577688+0000","last_became_peered":"2024-09-10T06:26:30.577688+0000","last_unstale":"2024-09-10T06:28:48.377820+0000","last_undegraded":"2024-09-10T06:28:48.377820+0000","last_fullsized":"2024-09-10T06:28:48.377820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:34.137079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377601+0000","last_change":"2024-09-10T06:26:32.256939+0000","last_active":"2024-09-10T06:28:48.377601+0000","last_peered":"2024-09-10T06:28:48.377601+0000","last_clean":"2024-09-10T06:28:48.377601+0000","last_became_active":"2024-09-10T06:26:32.256117+0000","last_became_peered":"2024-09-10T06:26:32.256117+0000","last_unstale":"2024-09-10T06:28:48.377601+0000","last_undegraded":"2024-09-10T06:28:48.377601+0000","last_fullsized":"2024-09-10T06:28:48.377601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:51.879604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"73'11","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461567+0000","last_change":"2024-09-10T06:26:30.593697+0000","last_active":"2024-09-10T06:28:48.461567+0000","last_peered":"2024-09-10T06:28:48.461567+0000","last_clean":"2024-09-10T06:28:48.461567+0000","last_became_active":"2024-09-10T06:26:30.591807+0000","last_became_peered":"2024-09-10T06:26:30.591807+0000","last_unstale":"2024-09-10T06:28:48.461567+0000","last_undegraded":"2024-09-10T06:28:48.461567+0000","last_fullsized":"2024-09-10T06:28:48.461567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376194+0000","last_change":"2024-09-10T06:26:32.264685+0000","last_active":"2024-09-10T06:28:48.376194+0000","last_peered":"2024-09-10T06:28:48.376194+0000","last_clean":"2024-09-10T06:28:48.376194+0000","last_became_active":"2024-09-10T06:26:32.264199+0000","last_became_peered":"2024-09-10T06:26:32.264199+0000","last_unstale":"2024-09-10T06:28:48.376194+0000","last_undegraded":"2024-09-10T06:28:48.376194+0000","last_fullsized":"2024-09-10T06:28:48.376194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:20.713066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"72'7","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457396+0000","last_change":"2024-09-10T06:28:09.653122+0000","last_active":"2024-09-10T06:28:48.457396+0000","last_peered":"2024-09-10T06:28:48.457396+0000","last_clean":"2024-09-10T06:28:48.457396+0000","last_became_active":"2024-09-10T06:28:09.546624+0000","last_became_peered":"2024-09-10T06:28:09.546624+0000","last_unstale":"2024-09-10T06:28:48.457396+0000","last_undegraded":"2024-09-10T06:28:48.457396+0000","last_fullsized":"2024-09-10T06:28:48.457396+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:57.805994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"67'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458405+0000","last_change":"2024-09-10T06:26:32.290741+0000","last_active":"2024-09-10T06:28:48.458405+0000","last_peered":"2024-09-10T06:28:48.458405+0000","last_clean":"2024-09-10T06:28:48.458405+0000","last_became_active":"2024-09-10T06:26:32.289840+0000","last_became_peered":"2024-09-10T06:26:32.289840+0000","last_unstale":"2024-09-10T06:28:48.458405+0000","last_undegraded":"2024-09-10T06:28:48.458405+0000","last_fullsized":"2024-09-10T06:28:48.458405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"73'6","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458751+0000","last_change":"2024-09-10T06:26:30.609817+0000","last_active":"2024-09-10T06:28:48.458751+0000","last_peered":"2024-09-10T06:28:48.458751+0000","last_clean":"2024-09-10T06:28:48.458751+0000","last_became_active":"2024-09-10T06:26:30.603330+0000","last_became_peered":"2024-09-10T06:26:30.603330+0000","last_unstale":"2024-09-10T06:28:48.458751+0000","last_undegraded":"2024-09-10T06:28:48.458751+0000","last_fullsized":"2024-09-10T06:28:48.458751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:09.523045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"67'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380006+0000","last_change":"2024-09-10T06:26:32.257050+0000","last_active":"2024-09-10T06:28:48.380006+0000","last_peered":"2024-09-10T06:28:48.380006+0000","last_clean":"2024-09-10T06:28:48.380006+0000","last_became_active":"2024-09-10T06:26:32.254437+0000","last_became_peered":"2024-09-10T06:26:32.254437+0000","last_unstale":"2024-09-10T06:28:48.380006+0000","last_undegraded":"2024-09-10T06:28:48.380006+0000","last_fullsized":"2024-09-10T06:28:48.380006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"72'14","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457521+0000","last_change":"2024-09-10T06:26:30.579756+0000","last_active":"2024-09-10T06:28:48.457521+0000","last_peered":"2024-09-10T06:28:48.457521+0000","last_clean":"2024-09-10T06:28:48.457521+0000","last_became_active":"2024-09-10T06:26:30.578033+0000","last_became_peered":"2024-09-10T06:26:30.578033+0000","last_unstale":"2024-09-10T06:28:48.457521+0000","last_undegraded":"2024-09-10T06:28:48.457521+0000","last_fullsized":"2024-09-10T06:28:48.457521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":22,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460066+0000","last_change":"2024-09-10T06:26:32.281248+0000","last_active":"2024-09-10T06:28:48.460066+0000","last_peered":"2024-09-10T06:28:48.460066+0000","last_clean":"2024-09-10T06:28:48.460066+0000","last_became_active":"2024-09-10T06:26:32.280480+0000","last_became_peered":"2024-09-10T06:26:32.280480+0000","last_unstale":"2024-09-10T06:28:48.460066+0000","last_undegraded":"2024-09-10T06:28:48.460066+0000","last_fullsized":"2024-09-10T06:28:48.460066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"73'8","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375906+0000","last_change":"2024-09-10T06:26:30.593213+0000","last_active":"2024-09-10T06:28:48.375906+0000","last_peered":"2024-09-10T06:28:48.375906+0000","last_clean":"2024-09-10T06:28:48.375906+0000","last_became_active":"2024-09-10T06:26:30.592770+0000","last_became_peered":"2024-09-10T06:26:30.592770+0000","last_unstale":"2024-09-10T06:28:48.375906+0000","last_undegraded":"2024-09-10T06:28:48.375906+0000","last_fullsized":"2024-09-10T06:28:48.375906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'10","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456049+0000","last_change":"2024-09-10T06:26:32.267430+0000","last_active":"2024-09-10T06:28:48.456049+0000","last_peered":"2024-09-10T06:28:48.456049+0000","last_clean":"2024-09-10T06:28:48.456049+0000","last_became_active":"2024-09-10T06:26:32.265788+0000","last_became_peered":"2024-09-10T06:26:32.265788+0000","last_unstale":"2024-09-10T06:28:48.456049+0000","last_undegraded":"2024-09-10T06:28:48.456049+0000","last_fullsized":"2024-09-10T06:28:48.456049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:19.180142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'10","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376998+0000","last_change":"2024-09-10T06:26:32.255038+0000","last_active":"2024-09-10T06:28:48.376998+0000","last_peered":"2024-09-10T06:28:48.376998+0000","last_clean":"2024-09-10T06:28:48.376998+0000","last_became_active":"2024-09-10T06:26:32.254281+0000","last_became_peered":"2024-09-10T06:26:32.254281+0000","last_unstale":"2024-09-10T06:28:48.376998+0000","last_undegraded":"2024-09-10T06:28:48.376998+0000","last_fullsized":"2024-09-10T06:28:48.376998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:46.363171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"73'9","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464563+0000","last_change":"2024-09-10T06:26:30.607280+0000","last_active":"2024-09-10T06:28:48.464563+0000","last_peered":"2024-09-10T06:28:48.464563+0000","last_clean":"2024-09-10T06:28:48.464563+0000","last_became_active":"2024-09-10T06:26:30.605602+0000","last_became_peered":"2024-09-10T06:26:30.605602+0000","last_unstale":"2024-09-10T06:28:48.464563+0000","last_undegraded":"2024-09-10T06:28:48.464563+0000","last_fullsized":"2024-09-10T06:28:48.464563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:49.865234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457282+0000","last_change":"2024-09-10T06:26:32.275913+0000","last_active":"2024-09-10T06:28:48.457282+0000","last_peered":"2024-09-10T06:28:48.457282+0000","last_clean":"2024-09-10T06:28:48.457282+0000","last_became_active":"2024-09-10T06:26:32.274264+0000","last_became_peered":"2024-09-10T06:26:32.274264+0000","last_unstale":"2024-09-10T06:28:48.457282+0000","last_undegraded":"2024-09-10T06:28:48.457282+0000","last_fullsized":"2024-09-10T06:28:48.457282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"72'5","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459316+0000","last_change":"2024-09-10T06:28:46.509018+0000","last_active":"2024-09-10T06:28:48.459316+0000","last_peered":"2024-09-10T06:28:48.459316+0000","last_clean":"2024-09-10T06:28:48.459316+0000","last_became_active":"2024-09-10T06:28:46.332355+0000","last_became_peered":"2024-09-10T06:28:46.332355+0000","last_unstale":"2024-09-10T06:28:48.459316+0000","last_undegraded":"2024-09-10T06:28:48.459316+0000","last_fullsized":"2024-09-10T06:28:48.459316+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:54.077676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459039+0000","last_change":"2024-09-10T06:26:32.279079+0000","last_active":"2024-09-10T06:28:48.459039+0000","last_peered":"2024-09-10T06:28:48.459039+0000","last_clean":"2024-09-10T06:28:48.459039+0000","last_became_active":"2024-09-10T06:26:32.278407+0000","last_became_peered":"2024-09-10T06:26:32.278407+0000","last_unstale":"2024-09-10T06:28:48.459039+0000","last_undegraded":"2024-09-10T06:28:48.459039+0000","last_fullsized":"2024-09-10T06:28:48.459039+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"73'10","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460652+0000","last_change":"2024-09-10T06:26:30.607368+0000","last_active":"2024-09-10T06:28:48.460652+0000","last_peered":"2024-09-10T06:28:48.460652+0000","last_clean":"2024-09-10T06:28:48.460652+0000","last_became_active":"2024-09-10T06:26:30.606807+0000","last_became_peered":"2024-09-10T06:26:30.606807+0000","last_unstale":"2024-09-10T06:28:48.460652+0000","last_undegraded":"2024-09-10T06:28:48.460652+0000","last_fullsized":"2024-09-10T06:28:48.460652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"76'8","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454789+0000","last_change":"2024-09-10T06:27:08.801987+0000","last_active":"2024-09-10T06:28:48.454789+0000","last_peered":"2024-09-10T06:28:48.454789+0000","last_clean":"2024-09-10T06:28:48.454789+0000","last_became_active":"2024-09-10T06:27:08.801461+0000","last_became_peered":"2024-09-10T06:27:08.801461+0000","last_unstale":"2024-09-10T06:28:48.454789+0000","last_undegraded":"2024-09-10T06:28:48.454789+0000","last_fullsized":"2024-09-10T06:28:48.454789+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"72'11","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379457+0000","last_change":"2024-09-10T06:26:30.598381+0000","last_active":"2024-09-10T06:28:48.379457+0000","last_peered":"2024-09-10T06:28:48.379457+0000","last_clean":"2024-09-10T06:28:48.379457+0000","last_became_active":"2024-09-10T06:26:30.597271+0000","last_became_peered":"2024-09-10T06:26:30.597271+0000","last_unstale":"2024-09-10T06:28:48.379457+0000","last_undegraded":"2024-09-10T06:28:48.379457+0000","last_fullsized":"2024-09-10T06:28:48.379457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:59.908548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455070+0000","last_change":"2024-09-10T06:26:32.247492+0000","last_active":"2024-09-10T06:28:48.455070+0000","last_peered":"2024-09-10T06:28:48.455070+0000","last_clean":"2024-09-10T06:28:48.455070+0000","last_became_active":"2024-09-10T06:26:32.246938+0000","last_became_peered":"2024-09-10T06:26:32.246938+0000","last_unstale":"2024-09-10T06:28:48.455070+0000","last_undegraded":"2024-09-10T06:28:48.455070+0000","last_fullsized":"2024-09-10T06:28:48.455070+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:01.766868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"73'11","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375472+0000","last_change":"2024-09-10T06:28:46.662120+0000","last_active":"2024-09-10T06:28:48.375472+0000","last_peered":"2024-09-10T06:28:48.375472+0000","last_clean":"2024-09-10T06:28:48.375472+0000","last_became_active":"2024-09-10T06:28:46.326710+0000","last_became_peered":"2024-09-10T06:28:46.326710+0000","last_unstale":"2024-09-10T06:28:48.375472+0000","last_undegraded":"2024-09-10T06:28:48.375472+0000","last_fullsized":"2024-09-10T06:28:48.375472+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:47.625969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380297+0000","last_change":"2024-09-10T06:26:32.278347+0000","last_active":"2024-09-10T06:28:48.380297+0000","last_peered":"2024-09-10T06:28:48.380297+0000","last_clean":"2024-09-10T06:28:48.380297+0000","last_became_active":"2024-09-10T06:26:32.275206+0000","last_became_peered":"2024-09-10T06:26:32.275206+0000","last_unstale":"2024-09-10T06:28:48.380297+0000","last_undegraded":"2024-09-10T06:28:48.380297+0000","last_fullsized":"2024-09-10T06:28:48.380297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"73'13","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375576+0000","last_change":"2024-09-10T06:26:30.572734+0000","last_active":"2024-09-10T06:28:48.375576+0000","last_peered":"2024-09-10T06:28:48.375576+0000","last_clean":"2024-09-10T06:28:48.375576+0000","last_became_active":"2024-09-10T06:26:30.572043+0000","last_became_peered":"2024-09-10T06:26:30.572043+0000","last_unstale":"2024-09-10T06:28:48.375576+0000","last_undegraded":"2024-09-10T06:28:48.375576+0000","last_fullsized":"2024-09-10T06:28:48.375576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"76'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376181+0000","last_change":"2024-09-10T06:26:40.323476+0000","last_active":"2024-09-10T06:28:48.376181+0000","last_peered":"2024-09-10T06:28:48.376181+0000","last_clean":"2024-09-10T06:28:48.376181+0000","last_became_active":"2024-09-10T06:26:40.322711+0000","last_became_peered":"2024-09-10T06:26:40.322711+0000","last_unstale":"2024-09-10T06:28:48.376181+0000","last_undegraded":"2024-09-10T06:28:48.376181+0000","last_fullsized":"2024-09-10T06:28:48.376181+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377930+0000","last_change":"2024-09-10T06:26:32.276274+0000","last_active":"2024-09-10T06:28:48.377930+0000","last_peered":"2024-09-10T06:28:48.377930+0000","last_clean":"2024-09-10T06:28:48.377930+0000","last_became_active":"2024-09-10T06:26:32.275889+0000","last_became_peered":"2024-09-10T06:26:32.275889+0000","last_unstale":"2024-09-10T06:28:48.377930+0000","last_undegraded":"2024-09-10T06:28:48.377930+0000","last_fullsized":"2024-09-10T06:28:48.377930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"72'14","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463117+0000","last_change":"2024-09-10T06:26:30.595738+0000","last_active":"2024-09-10T06:28:48.463117+0000","last_peered":"2024-09-10T06:28:48.463117+0000","last_clean":"2024-09-10T06:28:48.463117+0000","last_became_active":"2024-09-10T06:26:30.595128+0000","last_became_peered":"2024-09-10T06:26:30.595128+0000","last_unstale":"2024-09-10T06:28:48.463117+0000","last_undegraded":"2024-09-10T06:28:48.463117+0000","last_fullsized":"2024-09-10T06:28:48.463117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459157+0000","last_change":"2024-09-10T06:26:34.279824+0000","last_active":"2024-09-10T06:28:48.459157+0000","last_peered":"2024-09-10T06:28:48.459157+0000","last_clean":"2024-09-10T06:28:48.459157+0000","last_became_active":"2024-09-10T06:26:34.279074+0000","last_became_peered":"2024-09-10T06:26:34.279074+0000","last_unstale":"2024-09-10T06:28:48.459157+0000","last_undegraded":"2024-09-10T06:28:48.459157+0000","last_fullsized":"2024-09-10T06:28:48.459157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:40.507467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"76'15","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378326+0000","last_change":"2024-09-10T06:26:36.296703+0000","last_active":"2024-09-10T06:28:48.378326+0000","last_peered":"2024-09-10T06:28:48.378326+0000","last_clean":"2024-09-10T06:28:48.378326+0000","last_became_active":"2024-09-10T06:26:36.295786+0000","last_became_peered":"2024-09-10T06:26:36.295786+0000","last_unstale":"2024-09-10T06:28:48.378326+0000","last_undegraded":"2024-09-10T06:28:48.378326+0000","last_fullsized":"2024-09-10T06:28:48.378326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:31.699855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464287+0000","last_change":"2024-09-10T06:26:38.305468+0000","last_active":"2024-09-10T06:28:48.464287+0000","last_peered":"2024-09-10T06:28:48.464287+0000","last_clean":"2024-09-10T06:28:48.464287+0000","last_became_active":"2024-09-10T06:26:38.304847+0000","last_became_peered":"2024-09-10T06:26:38.304847+0000","last_unstale":"2024-09-10T06:28:48.464287+0000","last_undegraded":"2024-09-10T06:28:48.464287+0000","last_fullsized":"2024-09-10T06:28:48.464287+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:36.499856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":131,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456145+0000","last_change":"2024-09-10T06:26:40.331389+0000","last_active":"2024-09-10T06:28:48.456145+0000","last_peered":"2024-09-10T06:28:48.456145+0000","last_clean":"2024-09-10T06:28:48.456145+0000","last_became_active":"2024-09-10T06:26:40.330777+0000","last_became_peered":"2024-09-10T06:26:40.330777+0000","last_unstale":"2024-09-10T06:28:48.456145+0000","last_undegraded":"2024-09-10T06:28:48.456145+0000","last_fullsized":"2024-09-10T06:28:48.456145+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:22.792159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'4","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459576+0000","last_change":"2024-09-10T06:26:32.283112+0000","last_active":"2024-09-10T06:28:48.459576+0000","last_peered":"2024-09-10T06:28:48.459576+0000","last_clean":"2024-09-10T06:28:48.459576+0000","last_became_active":"2024-09-10T06:26:32.282263+0000","last_became_peered":"2024-09-10T06:26:32.282263+0000","last_unstale":"2024-09-10T06:28:48.459576+0000","last_undegraded":"2024-09-10T06:28:48.459576+0000","last_fullsized":"2024-09-10T06:28:48.459576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:02.124800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375652+0000","last_change":"2024-09-10T06:26:30.576489+0000","last_active":"2024-09-10T06:28:48.375652+0000","last_peered":"2024-09-10T06:28:48.375652+0000","last_clean":"2024-09-10T06:28:48.375652+0000","last_became_active":"2024-09-10T06:26:30.576039+0000","last_became_peered":"2024-09-10T06:26:30.576039+0000","last_unstale":"2024-09-10T06:28:48.375652+0000","last_undegraded":"2024-09-10T06:28:48.375652+0000","last_fullsized":"2024-09-10T06:28:48.375652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377578+0000","last_change":"2024-09-10T06:26:34.268758+0000","last_active":"2024-09-10T06:28:48.377578+0000","last_peered":"2024-09-10T06:28:48.377578+0000","last_clean":"2024-09-10T06:28:48.377578+0000","last_became_active":"2024-09-10T06:26:34.268279+0000","last_became_peered":"2024-09-10T06:26:34.268279+0000","last_unstale":"2024-09-10T06:28:48.377578+0000","last_undegraded":"2024-09-10T06:28:48.377578+0000","last_fullsized":"2024-09-10T06:28:48.377578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:42.052702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380314+0000","last_change":"2024-09-10T06:26:36.273991+0000","last_active":"2024-09-10T06:28:48.380314+0000","last_peered":"2024-09-10T06:28:48.380314+0000","last_clean":"2024-09-10T06:28:48.380314+0000","last_became_active":"2024-09-10T06:26:36.273138+0000","last_became_peered":"2024-09-10T06:26:36.273138+0000","last_unstale":"2024-09-10T06:28:48.380314+0000","last_undegraded":"2024-09-10T06:28:48.380314+0000","last_fullsized":"2024-09-10T06:28:48.380314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379703+0000","last_change":"2024-09-10T06:26:38.294543+0000","last_active":"2024-09-10T06:28:48.379703+0000","last_peered":"2024-09-10T06:28:48.379703+0000","last_clean":"2024-09-10T06:28:48.379703+0000","last_became_active":"2024-09-10T06:26:38.293754+0000","last_became_peered":"2024-09-10T06:26:38.293754+0000","last_unstale":"2024-09-10T06:28:48.379703+0000","last_undegraded":"2024-09-10T06:28:48.379703+0000","last_fullsized":"2024-09-10T06:28:48.379703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"62'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375255+0000","last_change":"2024-09-10T06:26:40.326998+0000","last_active":"2024-09-10T06:28:48.375255+0000","last_peered":"2024-09-10T06:28:48.375255+0000","last_clean":"2024-09-10T06:28:48.375255+0000","last_became_active":"2024-09-10T06:26:40.322648+0000","last_became_peered":"2024-09-10T06:26:40.322648+0000","last_unstale":"2024-09-10T06:28:48.375255+0000","last_undegraded":"2024-09-10T06:28:48.375255+0000","last_fullsized":"2024-09-10T06:28:48.375255+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:19.837495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379395+0000","last_change":"2024-09-10T06:26:32.256959+0000","last_active":"2024-09-10T06:28:48.379395+0000","last_peered":"2024-09-10T06:28:48.379395+0000","last_clean":"2024-09-10T06:28:48.379395+0000","last_became_active":"2024-09-10T06:26:32.256701+0000","last_became_peered":"2024-09-10T06:26:32.256701+0000","last_unstale":"2024-09-10T06:28:48.379395+0000","last_undegraded":"2024-09-10T06:28:48.379395+0000","last_fullsized":"2024-09-10T06:28:48.379395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"73'13","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457900+0000","last_change":"2024-09-10T06:26:30.598409+0000","last_active":"2024-09-10T06:28:48.457900+0000","last_peered":"2024-09-10T06:28:48.457900+0000","last_clean":"2024-09-10T06:28:48.457900+0000","last_became_active":"2024-09-10T06:26:30.597703+0000","last_became_peered":"2024-09-10T06:26:30.597703+0000","last_unstale":"2024-09-10T06:28:48.457900+0000","last_undegraded":"2024-09-10T06:28:48.457900+0000","last_fullsized":"2024-09-10T06:28:48.457900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379989+0000","last_change":"2024-09-10T06:26:34.268741+0000","last_active":"2024-09-10T06:28:48.379989+0000","last_peered":"2024-09-10T06:28:48.379989+0000","last_clean":"2024-09-10T06:28:48.379989+0000","last_became_active":"2024-09-10T06:26:34.268192+0000","last_became_peered":"2024-09-10T06:26:34.268192+0000","last_unstale":"2024-09-10T06:28:48.379989+0000","last_undegraded":"2024-09-10T06:28:48.379989+0000","last_fullsized":"2024-09-10T06:28:48.379989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:42:10.110645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454914+0000","last_change":"2024-09-10T06:26:36.275955+0000","last_active":"2024-09-10T06:28:48.454914+0000","last_peered":"2024-09-10T06:28:48.454914+0000","last_clean":"2024-09-10T06:28:48.454914+0000","last_became_active":"2024-09-10T06:26:36.275306+0000","last_became_peered":"2024-09-10T06:26:36.275306+0000","last_unstale":"2024-09-10T06:28:48.454914+0000","last_undegraded":"2024-09-10T06:28:48.454914+0000","last_fullsized":"2024-09-10T06:28:48.454914+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:03.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"76'101","reported_seq":400,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463206+0000","last_change":"2024-09-10T06:26:38.302764+0000","last_active":"2024-09-10T06:28:48.463206+0000","last_peered":"2024-09-10T06:28:48.463206+0000","last_clean":"2024-09-10T06:28:48.463206+0000","last_became_active":"2024-09-10T06:26:38.300326+0000","last_became_peered":"2024-09-10T06:26:38.300326+0000","last_unstale":"2024-09-10T06:28:48.463206+0000","last_undegraded":"2024-09-10T06:28:48.463206+0000","last_fullsized":"2024-09-10T06:28:48.463206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:29.851085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376468+0000","last_change":"2024-09-10T06:26:40.297893+0000","last_active":"2024-09-10T06:28:48.376468+0000","last_peered":"2024-09-10T06:28:48.376468+0000","last_clean":"2024-09-10T06:28:48.376468+0000","last_became_active":"2024-09-10T06:26:40.297296+0000","last_became_peered":"2024-09-10T06:26:40.297296+0000","last_unstale":"2024-09-10T06:28:48.376468+0000","last_undegraded":"2024-09-10T06:28:48.376468+0000","last_fullsized":"2024-09-10T06:28:48.376468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379578+0000","last_change":"2024-09-10T06:26:32.265005+0000","last_active":"2024-09-10T06:28:48.379578+0000","last_peered":"2024-09-10T06:28:48.379578+0000","last_clean":"2024-09-10T06:28:48.379578+0000","last_became_active":"2024-09-10T06:26:32.264334+0000","last_became_peered":"2024-09-10T06:26:32.264334+0000","last_unstale":"2024-09-10T06:28:48.379578+0000","last_undegraded":"2024-09-10T06:28:48.379578+0000","last_fullsized":"2024-09-10T06:28:48.379578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"73'13","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457010+0000","last_change":"2024-09-10T06:26:30.576242+0000","last_active":"2024-09-10T06:28:48.457010+0000","last_peered":"2024-09-10T06:28:48.457010+0000","last_clean":"2024-09-10T06:28:48.457010+0000","last_became_active":"2024-09-10T06:26:30.575433+0000","last_became_peered":"2024-09-10T06:26:30.575433+0000","last_unstale":"2024-09-10T06:28:48.457010+0000","last_undegraded":"2024-09-10T06:28:48.457010+0000","last_fullsized":"2024-09-10T06:28:48.457010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459940+0000","last_change":"2024-09-10T06:26:34.283701+0000","last_active":"2024-09-10T06:28:48.459940+0000","last_peered":"2024-09-10T06:28:48.459940+0000","last_clean":"2024-09-10T06:28:48.459940+0000","last_became_active":"2024-09-10T06:26:34.282941+0000","last_became_peered":"2024-09-10T06:26:34.282941+0000","last_unstale":"2024-09-10T06:28:48.459940+0000","last_undegraded":"2024-09-10T06:28:48.459940+0000","last_fullsized":"2024-09-10T06:28:48.459940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:29.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"76'16","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463333+0000","last_change":"2024-09-10T06:26:36.298510+0000","last_active":"2024-09-10T06:28:48.463333+0000","last_peered":"2024-09-10T06:28:48.463333+0000","last_clean":"2024-09-10T06:28:48.463333+0000","last_became_active":"2024-09-10T06:26:36.297309+0000","last_became_peered":"2024-09-10T06:26:36.297309+0000","last_unstale":"2024-09-10T06:28:48.463333+0000","last_undegraded":"2024-09-10T06:28:48.463333+0000","last_fullsized":"2024-09-10T06:28:48.463333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"76'101","reported_seq":267,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376948+0000","last_change":"2024-09-10T06:26:38.300228+0000","last_active":"2024-09-10T06:28:48.376948+0000","last_peered":"2024-09-10T06:28:48.376948+0000","last_clean":"2024-09-10T06:28:48.376948+0000","last_became_active":"2024-09-10T06:26:38.299355+0000","last_became_peered":"2024-09-10T06:26:38.299355+0000","last_unstale":"2024-09-10T06:28:48.376948+0000","last_undegraded":"2024-09-10T06:28:48.376948+0000","last_fullsized":"2024-09-10T06:28:48.376948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:20.050096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456891+0000","last_change":"2024-09-10T06:26:32.271283+0000","last_active":"2024-09-10T06:28:48.456891+0000","last_peered":"2024-09-10T06:28:48.456891+0000","last_clean":"2024-09-10T06:28:48.456891+0000","last_became_active":"2024-09-10T06:26:32.270496+0000","last_became_peered":"2024-09-10T06:26:32.270496+0000","last_unstale":"2024-09-10T06:28:48.456891+0000","last_undegraded":"2024-09-10T06:28:48.456891+0000","last_fullsized":"2024-09-10T06:28:48.456891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464629+0000","last_change":"2024-09-10T06:26:30.607373+0000","last_active":"2024-09-10T06:28:48.464629+0000","last_peered":"2024-09-10T06:28:48.464629+0000","last_clean":"2024-09-10T06:28:48.464629+0000","last_became_active":"2024-09-10T06:26:30.606685+0000","last_became_peered":"2024-09-10T06:26:30.606685+0000","last_unstale":"2024-09-10T06:28:48.464629+0000","last_undegraded":"2024-09-10T06:28:48.464629+0000","last_fullsized":"2024-09-10T06:28:48.464629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:35.705564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456456+0000","last_change":"2024-09-10T06:26:34.286925+0000","last_active":"2024-09-10T06:28:48.456456+0000","last_peered":"2024-09-10T06:28:48.456456+0000","last_clean":"2024-09-10T06:28:48.456456+0000","last_became_active":"2024-09-10T06:26:34.285787+0000","last_became_peered":"2024-09-10T06:26:34.285787+0000","last_unstale":"2024-09-10T06:28:48.456456+0000","last_undegraded":"2024-09-10T06:28:48.456456+0000","last_fullsized":"2024-09-10T06:28:48.456456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"76'25","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456092+0000","last_change":"2024-09-10T06:26:36.293988+0000","last_active":"2024-09-10T06:28:48.456092+0000","last_peered":"2024-09-10T06:28:48.456092+0000","last_clean":"2024-09-10T06:28:48.456092+0000","last_became_active":"2024-09-10T06:26:36.293226+0000","last_became_peered":"2024-09-10T06:26:36.293226+0000","last_unstale":"2024-09-10T06:28:48.456092+0000","last_undegraded":"2024-09-10T06:28:48.456092+0000","last_fullsized":"2024-09-10T06:28:48.456092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453801+0000","last_change":"2024-09-10T06:26:38.305826+0000","last_active":"2024-09-10T06:28:48.453801+0000","last_peered":"2024-09-10T06:28:48.453801+0000","last_clean":"2024-09-10T06:28:48.453801+0000","last_became_active":"2024-09-10T06:26:38.304601+0000","last_became_peered":"2024-09-10T06:26:38.304601+0000","last_unstale":"2024-09-10T06:28:48.453801+0000","last_undegraded":"2024-09-10T06:28:48.453801+0000","last_fullsized":"2024-09-10T06:28:48.453801+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:12.545261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"62'8","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460978+0000","last_change":"2024-09-10T06:26:40.332286+0000","last_active":"2024-09-10T06:28:48.460978+0000","last_peered":"2024-09-10T06:28:48.460978+0000","last_clean":"2024-09-10T06:28:48.460978+0000","last_became_active":"2024-09-10T06:26:40.331262+0000","last_became_peered":"2024-09-10T06:26:40.331262+0000","last_unstale":"2024-09-10T06:28:48.460978+0000","last_undegraded":"2024-09-10T06:28:48.460978+0000","last_fullsized":"2024-09-10T06:28:48.460978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377579+0000","last_change":"2024-09-10T06:26:32.262320+0000","last_active":"2024-09-10T06:28:48.377579+0000","last_peered":"2024-09-10T06:28:48.377579+0000","last_clean":"2024-09-10T06:28:48.377579+0000","last_became_active":"2024-09-10T06:26:32.261423+0000","last_became_peered":"2024-09-10T06:26:32.261423+0000","last_unstale":"2024-09-10T06:28:48.377579+0000","last_undegraded":"2024-09-10T06:28:48.377579+0000","last_fullsized":"2024-09-10T06:28:48.377579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"76'13","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464559+0000","last_change":"2024-09-10T06:26:30.595879+0000","last_active":"2024-09-10T06:28:48.464559+0000","last_peered":"2024-09-10T06:28:48.464559+0000","last_clean":"2024-09-10T06:28:48.464559+0000","last_became_active":"2024-09-10T06:26:30.595269+0000","last_became_peered":"2024-09-10T06:26:30.595269+0000","last_unstale":"2024-09-10T06:28:48.464559+0000","last_undegraded":"2024-09-10T06:28:48.464559+0000","last_fullsized":"2024-09-10T06:28:48.464559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453028+0000","last_change":"2024-09-10T06:26:34.266906+0000","last_active":"2024-09-10T06:28:48.453028+0000","last_peered":"2024-09-10T06:28:48.453028+0000","last_clean":"2024-09-10T06:28:48.453028+0000","last_became_active":"2024-09-10T06:26:34.266017+0000","last_became_peered":"2024-09-10T06:26:34.266017+0000","last_unstale":"2024-09-10T06:28:48.453028+0000","last_undegraded":"2024-09-10T06:28:48.453028+0000","last_fullsized":"2024-09-10T06:28:48.453028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:24.366166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"76'16","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378015+0000","last_change":"2024-09-10T06:26:36.297020+0000","last_active":"2024-09-10T06:28:48.378015+0000","last_peered":"2024-09-10T06:28:48.378015+0000","last_clean":"2024-09-10T06:28:48.378015+0000","last_became_active":"2024-09-10T06:26:36.295796+0000","last_became_peered":"2024-09-10T06:26:36.295796+0000","last_unstale":"2024-09-10T06:28:48.378015+0000","last_undegraded":"2024-09-10T06:28:48.378015+0000","last_fullsized":"2024-09-10T06:28:48.378015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375244+0000","last_change":"2024-09-10T06:26:38.297273+0000","last_active":"2024-09-10T06:28:48.375244+0000","last_peered":"2024-09-10T06:28:48.375244+0000","last_clean":"2024-09-10T06:28:48.375244+0000","last_became_active":"2024-09-10T06:26:38.296455+0000","last_became_peered":"2024-09-10T06:26:38.296455+0000","last_unstale":"2024-09-10T06:28:48.375244+0000","last_undegraded":"2024-09-10T06:28:48.375244+0000","last_fullsized":"2024-09-10T06:28:48.375244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:26.766702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458102+0000","last_change":"2024-09-10T06:26:40.328294+0000","last_active":"2024-09-10T06:28:48.458102+0000","last_peered":"2024-09-10T06:28:48.458102+0000","last_clean":"2024-09-10T06:28:48.458102+0000","last_became_active":"2024-09-10T06:26:40.327585+0000","last_became_peered":"2024-09-10T06:26:40.327585+0000","last_unstale":"2024-09-10T06:28:48.458102+0000","last_undegraded":"2024-09-10T06:28:48.458102+0000","last_fullsized":"2024-09-10T06:28:48.458102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.537210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458888+0000","last_change":"2024-09-10T06:27:08.600683+0000","last_active":"2024-09-10T06:28:48.458888+0000","last_peered":"2024-09-10T06:28:48.458888+0000","last_clean":"2024-09-10T06:28:48.458888+0000","last_became_active":"2024-09-10T06:27:08.599875+0000","last_became_peered":"2024-09-10T06:27:08.599875+0000","last_unstale":"2024-09-10T06:28:48.458888+0000","last_undegraded":"2024-09-10T06:28:48.458888+0000","last_fullsized":"2024-09-10T06:28:48.458888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:59.605814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464013+0000","last_change":"2024-09-10T06:26:30.611704+0000","last_active":"2024-09-10T06:28:48.464013+0000","last_peered":"2024-09-10T06:28:48.464013+0000","last_clean":"2024-09-10T06:28:48.464013+0000","last_became_active":"2024-09-10T06:26:30.611039+0000","last_became_peered":"2024-09-10T06:26:30.611039+0000","last_unstale":"2024-09-10T06:28:48.464013+0000","last_undegraded":"2024-09-10T06:28:48.464013+0000","last_fullsized":"2024-09-10T06:28:48.464013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455026+0000","last_change":"2024-09-10T06:26:34.263514+0000","last_active":"2024-09-10T06:28:48.455026+0000","last_peered":"2024-09-10T06:28:48.455026+0000","last_clean":"2024-09-10T06:28:48.455026+0000","last_became_active":"2024-09-10T06:26:34.262793+0000","last_became_peered":"2024-09-10T06:26:34.262793+0000","last_unstale":"2024-09-10T06:28:48.455026+0000","last_undegraded":"2024-09-10T06:28:48.455026+0000","last_fullsized":"2024-09-10T06:28:48.455026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:31.501738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"76'22","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455616+0000","last_change":"2024-09-10T06:26:36.299923+0000","last_active":"2024-09-10T06:28:48.455616+0000","last_peered":"2024-09-10T06:28:48.455616+0000","last_clean":"2024-09-10T06:28:48.455616+0000","last_became_active":"2024-09-10T06:26:36.299140+0000","last_became_peered":"2024-09-10T06:26:36.299140+0000","last_unstale":"2024-09-10T06:28:48.455616+0000","last_undegraded":"2024-09-10T06:28:48.455616+0000","last_fullsized":"2024-09-10T06:28:48.455616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:12.246303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"76'101","reported_seq":266,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.463347+0000","last_change":"2024-09-10T06:26:38.292019+0000","last_active":"2024-09-10T06:28:49.463347+0000","last_peered":"2024-09-10T06:28:49.463347+0000","last_clean":"2024-09-10T06:28:49.463347+0000","last_became_active":"2024-09-10T06:26:38.291322+0000","last_became_peered":"2024-09-10T06:26:38.291322+0000","last_unstale":"2024-09-10T06:28:49.463347+0000","last_undegraded":"2024-09-10T06:28:49.463347+0000","last_fullsized":"2024-09-10T06:28:49.463347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"64'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378724+0000","last_change":"2024-09-10T06:26:40.328427+0000","last_active":"2024-09-10T06:28:48.378724+0000","last_peered":"2024-09-10T06:28:48.378724+0000","last_clean":"2024-09-10T06:28:48.378724+0000","last_became_active":"2024-09-10T06:26:40.323249+0000","last_became_peered":"2024-09-10T06:26:40.323249+0000","last_unstale":"2024-09-10T06:28:48.378724+0000","last_undegraded":"2024-09-10T06:28:48.378724+0000","last_fullsized":"2024-09-10T06:28:48.378724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:50.823195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377190+0000","last_change":"2024-09-10T06:26:32.274824+0000","last_active":"2024-09-10T06:28:48.377190+0000","last_peered":"2024-09-10T06:28:48.377190+0000","last_clean":"2024-09-10T06:28:48.377190+0000","last_became_active":"2024-09-10T06:26:32.274496+0000","last_became_peered":"2024-09-10T06:26:32.274496+0000","last_unstale":"2024-09-10T06:28:48.377190+0000","last_undegraded":"2024-09-10T06:28:48.377190+0000","last_fullsized":"2024-09-10T06:28:48.377190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:39.513476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"73'7","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462108+0000","last_change":"2024-09-10T06:26:30.604684+0000","last_active":"2024-09-10T06:28:48.462108+0000","last_peered":"2024-09-10T06:28:48.462108+0000","last_clean":"2024-09-10T06:28:48.462108+0000","last_became_active":"2024-09-10T06:26:30.593432+0000","last_became_peered":"2024-09-10T06:26:30.593432+0000","last_unstale":"2024-09-10T06:28:48.462108+0000","last_undegraded":"2024-09-10T06:28:48.462108+0000","last_fullsized":"2024-09-10T06:28:48.462108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454621+0000","last_change":"2024-09-10T06:26:34.256662+0000","last_active":"2024-09-10T06:28:48.454621+0000","last_peered":"2024-09-10T06:28:48.454621+0000","last_clean":"2024-09-10T06:28:48.454621+0000","last_became_active":"2024-09-10T06:26:34.256256+0000","last_became_peered":"2024-09-10T06:26:34.256256+0000","last_unstale":"2024-09-10T06:28:48.454621+0000","last_undegraded":"2024-09-10T06:28:48.454621+0000","last_fullsized":"2024-09-10T06:28:48.454621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:35.549063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'26","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375816+0000","last_change":"2024-09-10T06:26:36.296631+0000","last_active":"2024-09-10T06:28:48.375816+0000","last_peered":"2024-09-10T06:28:48.375816+0000","last_clean":"2024-09-10T06:28:48.375816+0000","last_became_active":"2024-09-10T06:26:36.295838+0000","last_became_peered":"2024-09-10T06:26:36.295838+0000","last_unstale":"2024-09-10T06:28:48.375816+0000","last_undegraded":"2024-09-10T06:28:48.375816+0000","last_fullsized":"2024-09-10T06:28:48.375816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:04.271824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9809,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452870+0000","last_change":"2024-09-10T06:26:38.308698+0000","last_active":"2024-09-10T06:28:48.452870+0000","last_peered":"2024-09-10T06:28:48.452870+0000","last_clean":"2024-09-10T06:28:48.452870+0000","last_became_active":"2024-09-10T06:26:38.307965+0000","last_became_peered":"2024-09-10T06:26:38.307965+0000","last_unstale":"2024-09-10T06:28:48.452870+0000","last_undegraded":"2024-09-10T06:28:48.452870+0000","last_fullsized":"2024-09-10T06:28:48.452870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:04.566221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"62'4","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454102+0000","last_change":"2024-09-10T06:26:40.326474+0000","last_active":"2024-09-10T06:28:48.454102+0000","last_peered":"2024-09-10T06:28:48.454102+0000","last_clean":"2024-09-10T06:28:48.454102+0000","last_became_active":"2024-09-10T06:26:40.325731+0000","last_became_peered":"2024-09-10T06:26:40.325731+0000","last_unstale":"2024-09-10T06:28:48.454102+0000","last_undegraded":"2024-09-10T06:28:48.454102+0000","last_fullsized":"2024-09-10T06:28:48.454102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:19.400355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"64'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380025+0000","last_change":"2024-09-10T06:26:32.254177+0000","last_active":"2024-09-10T06:28:48.380025+0000","last_peered":"2024-09-10T06:28:48.380025+0000","last_clean":"2024-09-10T06:28:48.380025+0000","last_became_active":"2024-09-10T06:26:32.253154+0000","last_became_peered":"2024-09-10T06:26:32.253154+0000","last_unstale":"2024-09-10T06:28:48.380025+0000","last_undegraded":"2024-09-10T06:28:48.380025+0000","last_fullsized":"2024-09-10T06:28:48.380025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"72'5","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375194+0000","last_change":"2024-09-10T06:26:30.572406+0000","last_active":"2024-09-10T06:28:48.375194+0000","last_peered":"2024-09-10T06:28:48.375194+0000","last_clean":"2024-09-10T06:28:48.375194+0000","last_became_active":"2024-09-10T06:26:30.571829+0000","last_became_peered":"2024-09-10T06:26:30.571829+0000","last_unstale":"2024-09-10T06:28:48.375194+0000","last_undegraded":"2024-09-10T06:28:48.375194+0000","last_fullsized":"2024-09-10T06:28:48.375194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455283+0000","last_change":"2024-09-10T06:26:34.285406+0000","last_active":"2024-09-10T06:28:48.455283+0000","last_peered":"2024-09-10T06:28:48.455283+0000","last_clean":"2024-09-10T06:28:48.455283+0000","last_became_active":"2024-09-10T06:26:34.285004+0000","last_became_peered":"2024-09-10T06:26:34.285004+0000","last_unstale":"2024-09-10T06:28:48.455283+0000","last_undegraded":"2024-09-10T06:28:48.455283+0000","last_fullsized":"2024-09-10T06:28:48.455283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:03.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"87'21","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379938+0000","last_change":"2024-09-10T06:26:36.293191+0000","last_active":"2024-09-10T06:28:48.379938+0000","last_peered":"2024-09-10T06:28:48.379938+0000","last_clean":"2024-09-10T06:28:48.379938+0000","last_became_active":"2024-09-10T06:26:36.292423+0000","last_became_peered":"2024-09-10T06:26:36.292423+0000","last_unstale":"2024-09-10T06:28:48.379938+0000","last_undegraded":"2024-09-10T06:28:48.379938+0000","last_fullsized":"2024-09-10T06:28:48.379938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":28,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378086+0000","last_change":"2024-09-10T06:26:38.293667+0000","last_active":"2024-09-10T06:28:48.378086+0000","last_peered":"2024-09-10T06:28:48.378086+0000","last_clean":"2024-09-10T06:28:48.378086+0000","last_became_active":"2024-09-10T06:26:38.292918+0000","last_became_peered":"2024-09-10T06:26:38.292918+0000","last_unstale":"2024-09-10T06:28:48.378086+0000","last_undegraded":"2024-09-10T06:28:48.378086+0000","last_fullsized":"2024-09-10T06:28:48.378086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:57.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376446+0000","last_change":"2024-09-10T06:26:40.327061+0000","last_active":"2024-09-10T06:28:48.376446+0000","last_peered":"2024-09-10T06:28:48.376446+0000","last_clean":"2024-09-10T06:28:48.376446+0000","last_became_active":"2024-09-10T06:26:40.326431+0000","last_became_peered":"2024-09-10T06:26:40.326431+0000","last_unstale":"2024-09-10T06:28:48.376446+0000","last_undegraded":"2024-09-10T06:28:48.376446+0000","last_fullsized":"2024-09-10T06:28:48.376446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:27.631214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"64'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380722+0000","last_change":"2024-09-10T06:26:32.255139+0000","last_active":"2024-09-10T06:28:48.380722+0000","last_peered":"2024-09-10T06:28:48.380722+0000","last_clean":"2024-09-10T06:28:48.380722+0000","last_became_active":"2024-09-10T06:26:32.253524+0000","last_became_peered":"2024-09-10T06:26:32.253524+0000","last_unstale":"2024-09-10T06:28:48.380722+0000","last_undegraded":"2024-09-10T06:28:48.380722+0000","last_fullsized":"2024-09-10T06:28:48.380722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"73'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459281+0000","last_change":"2024-09-10T06:26:30.591838+0000","last_active":"2024-09-10T06:28:48.459281+0000","last_peered":"2024-09-10T06:28:48.459281+0000","last_clean":"2024-09-10T06:28:48.459281+0000","last_became_active":"2024-09-10T06:26:30.591125+0000","last_became_peered":"2024-09-10T06:26:30.591125+0000","last_unstale":"2024-09-10T06:28:48.459281+0000","last_undegraded":"2024-09-10T06:28:48.459281+0000","last_fullsized":"2024-09-10T06:28:48.459281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453621+0000","last_change":"2024-09-10T06:26:34.280391+0000","last_active":"2024-09-10T06:28:48.453621+0000","last_peered":"2024-09-10T06:28:48.453621+0000","last_clean":"2024-09-10T06:28:48.453621+0000","last_became_active":"2024-09-10T06:26:34.280058+0000","last_became_peered":"2024-09-10T06:26:34.280058+0000","last_unstale":"2024-09-10T06:28:48.453621+0000","last_undegraded":"2024-09-10T06:28:48.453621+0000","last_fullsized":"2024-09-10T06:28:48.453621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.461857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"76'23","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456011+0000","last_change":"2024-09-10T06:26:36.277547+0000","last_active":"2024-09-10T06:28:48.456011+0000","last_peered":"2024-09-10T06:28:48.456011+0000","last_clean":"2024-09-10T06:28:48.456011+0000","last_became_active":"2024-09-10T06:26:36.276965+0000","last_became_peered":"2024-09-10T06:26:36.276965+0000","last_unstale":"2024-09-10T06:28:48.456011+0000","last_undegraded":"2024-09-10T06:28:48.456011+0000","last_fullsized":"2024-09-10T06:28:48.456011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:43.212945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"76'101","reported_seq":296,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455231+0000","last_change":"2024-09-10T06:26:38.306134+0000","last_active":"2024-09-10T06:28:48.455231+0000","last_peered":"2024-09-10T06:28:48.455231+0000","last_clean":"2024-09-10T06:28:48.455231+0000","last_became_active":"2024-09-10T06:26:38.299012+0000","last_became_peered":"2024-09-10T06:26:38.299012+0000","last_unstale":"2024-09-10T06:28:48.455231+0000","last_undegraded":"2024-09-10T06:28:48.455231+0000","last_fullsized":"2024-09-10T06:28:48.455231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:37.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"61'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454114+0000","last_change":"2024-09-10T06:26:40.336036+0000","last_active":"2024-09-10T06:28:48.454114+0000","last_peered":"2024-09-10T06:28:48.454114+0000","last_clean":"2024-09-10T06:28:48.454114+0000","last_became_active":"2024-09-10T06:26:40.335302+0000","last_became_peered":"2024-09-10T06:26:40.335302+0000","last_unstale":"2024-09-10T06:28:48.454114+0000","last_undegraded":"2024-09-10T06:28:48.454114+0000","last_fullsized":"2024-09-10T06:28:48.454114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:24.024562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380676+0000","last_change":"2024-09-10T06:26:32.287897+0000","last_active":"2024-09-10T06:28:48.380676+0000","last_peered":"2024-09-10T06:28:48.380676+0000","last_clean":"2024-09-10T06:28:48.380676+0000","last_became_active":"2024-09-10T06:26:32.287315+0000","last_became_peered":"2024-09-10T06:26:32.287315+0000","last_unstale":"2024-09-10T06:28:48.380676+0000","last_undegraded":"2024-09-10T06:28:48.380676+0000","last_fullsized":"2024-09-10T06:28:48.380676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"73'7","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378593+0000","last_change":"2024-09-10T06:26:30.569192+0000","last_active":"2024-09-10T06:28:48.378593+0000","last_peered":"2024-09-10T06:28:48.378593+0000","last_clean":"2024-09-10T06:28:48.378593+0000","last_became_active":"2024-09-10T06:26:30.568464+0000","last_became_peered":"2024-09-10T06:26:30.568464+0000","last_unstale":"2024-09-10T06:28:48.378593+0000","last_undegraded":"2024-09-10T06:28:48.378593+0000","last_fullsized":"2024-09-10T06:28:48.378593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:58.987914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":280,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459913+0000","last_change":"2024-09-10T06:26:34.279935+0000","last_active":"2024-09-10T06:28:48.459913+0000","last_peered":"2024-09-10T06:28:48.459913+0000","last_clean":"2024-09-10T06:28:48.459913+0000","last_became_active":"2024-09-10T06:26:34.279192+0000","last_became_peered":"2024-09-10T06:26:34.279192+0000","last_unstale":"2024-09-10T06:28:48.459913+0000","last_undegraded":"2024-09-10T06:28:48.459913+0000","last_fullsized":"2024-09-10T06:28:48.459913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:18.753175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377130+0000","last_change":"2024-09-10T06:26:36.290330+0000","last_active":"2024-09-10T06:28:48.377130+0000","last_peered":"2024-09-10T06:28:48.377130+0000","last_clean":"2024-09-10T06:28:48.377130+0000","last_became_active":"2024-09-10T06:26:36.289527+0000","last_became_peered":"2024-09-10T06:26:36.289527+0000","last_unstale":"2024-09-10T06:28:48.377130+0000","last_undegraded":"2024-09-10T06:28:48.377130+0000","last_fullsized":"2024-09-10T06:28:48.377130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"76'101","reported_seq":308,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460319+0000","last_change":"2024-09-10T06:26:38.288663+0000","last_active":"2024-09-10T06:28:48.460319+0000","last_peered":"2024-09-10T06:28:48.460319+0000","last_clean":"2024-09-10T06:28:48.460319+0000","last_became_active":"2024-09-10T06:26:38.287740+0000","last_became_peered":"2024-09-10T06:26:38.287740+0000","last_unstale":"2024-09-10T06:28:48.460319+0000","last_undegraded":"2024-09-10T06:28:48.460319+0000","last_fullsized":"2024-09-10T06:28:48.460319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:22.078943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'8","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377335+0000","last_change":"2024-09-10T06:26:40.329737+0000","last_active":"2024-09-10T06:28:48.377335+0000","last_peered":"2024-09-10T06:28:48.377335+0000","last_clean":"2024-09-10T06:28:48.377335+0000","last_became_active":"2024-09-10T06:26:40.328952+0000","last_became_peered":"2024-09-10T06:26:40.328952+0000","last_unstale":"2024-09-10T06:28:48.377335+0000","last_undegraded":"2024-09-10T06:28:48.377335+0000","last_fullsized":"2024-09-10T06:28:48.377335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454598+0000","last_change":"2024-09-10T06:26:32.270997+0000","last_active":"2024-09-10T06:28:48.454598+0000","last_peered":"2024-09-10T06:28:48.454598+0000","last_clean":"2024-09-10T06:28:48.454598+0000","last_became_active":"2024-09-10T06:26:32.270265+0000","last_became_peered":"2024-09-10T06:26:32.270265+0000","last_unstale":"2024-09-10T06:28:48.454598+0000","last_undegraded":"2024-09-10T06:28:48.454598+0000","last_fullsized":"2024-09-10T06:28:48.454598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:33.067523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"73'11","reported_seq":127,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452795+0000","last_change":"2024-09-10T06:27:08.593158+0000","last_active":"2024-09-10T06:28:48.452795+0000","last_peered":"2024-09-10T06:28:48.452795+0000","last_clean":"2024-09-10T06:28:48.452795+0000","last_became_active":"2024-09-10T06:27:08.592864+0000","last_became_peered":"2024-09-10T06:27:08.592864+0000","last_unstale":"2024-09-10T06:28:48.452795+0000","last_undegraded":"2024-09-10T06:28:48.452795+0000","last_fullsized":"2024-09-10T06:28:48.452795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:35.185591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380176+0000","last_change":"2024-09-10T06:26:34.286497+0000","last_active":"2024-09-10T06:28:48.380176+0000","last_peered":"2024-09-10T06:28:48.380176+0000","last_clean":"2024-09-10T06:28:48.380176+0000","last_became_active":"2024-09-10T06:26:34.285334+0000","last_became_peered":"2024-09-10T06:26:34.285334+0000","last_unstale":"2024-09-10T06:28:48.380176+0000","last_undegraded":"2024-09-10T06:28:48.380176+0000","last_fullsized":"2024-09-10T06:28:48.380176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:54.506182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"76'23","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459007+0000","last_change":"2024-09-10T06:26:36.288213+0000","last_active":"2024-09-10T06:28:48.459007+0000","last_peered":"2024-09-10T06:28:48.459007+0000","last_clean":"2024-09-10T06:28:48.459007+0000","last_became_active":"2024-09-10T06:26:36.287468+0000","last_became_peered":"2024-09-10T06:26:36.287468+0000","last_unstale":"2024-09-10T06:28:48.459007+0000","last_undegraded":"2024-09-10T06:28:48.459007+0000","last_fullsized":"2024-09-10T06:28:48.459007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457629+0000","last_change":"2024-09-10T06:26:38.291943+0000","last_active":"2024-09-10T06:28:48.457629+0000","last_peered":"2024-09-10T06:28:48.457629+0000","last_clean":"2024-09-10T06:28:48.457629+0000","last_became_active":"2024-09-10T06:26:38.291214+0000","last_became_peered":"2024-09-10T06:26:38.291214+0000","last_unstale":"2024-09-10T06:28:48.457629+0000","last_undegraded":"2024-09-10T06:28:48.457629+0000","last_fullsized":"2024-09-10T06:28:48.457629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:56.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"67'4","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453374+0000","last_change":"2024-09-10T06:26:40.331977+0000","last_active":"2024-09-10T06:28:48.453374+0000","last_peered":"2024-09-10T06:28:48.453374+0000","last_clean":"2024-09-10T06:28:48.453374+0000","last_became_active":"2024-09-10T06:26:40.331502+0000","last_became_peered":"2024-09-10T06:26:40.331502+0000","last_unstale":"2024-09-10T06:28:48.453374+0000","last_undegraded":"2024-09-10T06:28:48.453374+0000","last_fullsized":"2024-09-10T06:28:48.453374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:43.572813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460459+0000","last_change":"2024-09-10T06:26:32.274623+0000","last_active":"2024-09-10T06:28:48.460459+0000","last_peered":"2024-09-10T06:28:48.460459+0000","last_clean":"2024-09-10T06:28:48.460459+0000","last_became_active":"2024-09-10T06:26:32.273727+0000","last_became_peered":"2024-09-10T06:26:32.273727+0000","last_unstale":"2024-09-10T06:28:48.460459+0000","last_undegraded":"2024-09-10T06:28:48.460459+0000","last_fullsized":"2024-09-10T06:28:48.460459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:15.364938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":258,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455693+0000","last_change":"2024-09-10T06:26:18.153206+0000","last_active":"2024-09-10T06:28:48.455693+0000","last_peered":"2024-09-10T06:28:48.455693+0000","last_clean":"2024-09-10T06:28:48.455693+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:28:48.455693+0000","last_undegraded":"2024-09-10T06:28:48.455693+0000","last_fullsized":"2024-09-10T06:28:48.455693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_clean_scrub_stamp":"2024-09-10T06:26:16.422775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:42.510577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460195+0000","last_change":"2024-09-10T06:26:25.532465+0000","last_active":"2024-09-10T06:28:48.460195+0000","last_peered":"2024-09-10T06:28:48.460195+0000","last_clean":"2024-09-10T06:28:48.460195+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:28:48.460195+0000","last_undegraded":"2024-09-10T06:28:48.460195+0000","last_fullsized":"2024-09-10T06:28:48.460195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:10.318844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"73'9","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375960+0000","last_change":"2024-09-10T06:26:30.606630+0000","last_active":"2024-09-10T06:28:48.375960+0000","last_peered":"2024-09-10T06:28:48.375960+0000","last_clean":"2024-09-10T06:28:48.375960+0000","last_became_active":"2024-09-10T06:26:30.606348+0000","last_became_peered":"2024-09-10T06:26:30.606348+0000","last_unstale":"2024-09-10T06:28:48.375960+0000","last_undegraded":"2024-09-10T06:28:48.375960+0000","last_fullsized":"2024-09-10T06:28:48.375960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462936+0000","last_change":"2024-09-10T06:26:34.287201+0000","last_active":"2024-09-10T06:28:48.462936+0000","last_peered":"2024-09-10T06:28:48.462936+0000","last_clean":"2024-09-10T06:28:48.462936+0000","last_became_active":"2024-09-10T06:26:34.285248+0000","last_became_peered":"2024-09-10T06:26:34.285248+0000","last_unstale":"2024-09-10T06:28:48.462936+0000","last_undegraded":"2024-09-10T06:28:48.462936+0000","last_fullsized":"2024-09-10T06:28:48.462936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:43.907684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"76'32","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460159+0000","last_change":"2024-09-10T06:26:36.296684+0000","last_active":"2024-09-10T06:28:48.460159+0000","last_peered":"2024-09-10T06:28:48.460159+0000","last_clean":"2024-09-10T06:28:48.460159+0000","last_became_active":"2024-09-10T06:26:36.295901+0000","last_became_peered":"2024-09-10T06:26:36.295901+0000","last_unstale":"2024-09-10T06:28:48.460159+0000","last_undegraded":"2024-09-10T06:28:48.460159+0000","last_fullsized":"2024-09-10T06:28:48.460159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61969,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378965+0000","last_change":"2024-09-10T06:26:38.306412+0000","last_active":"2024-09-10T06:28:48.378965+0000","last_peered":"2024-09-10T06:28:48.378965+0000","last_clean":"2024-09-10T06:28:48.378965+0000","last_became_active":"2024-09-10T06:26:38.305496+0000","last_became_peered":"2024-09-10T06:26:38.305496+0000","last_unstale":"2024-09-10T06:28:48.378965+0000","last_undegraded":"2024-09-10T06:28:48.378965+0000","last_fullsized":"2024-09-10T06:28:48.378965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.370035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"64'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456581+0000","last_change":"2024-09-10T06:26:40.331981+0000","last_active":"2024-09-10T06:28:48.456581+0000","last_peered":"2024-09-10T06:28:48.456581+0000","last_clean":"2024-09-10T06:28:48.456581+0000","last_became_active":"2024-09-10T06:26:40.331294+0000","last_became_peered":"2024-09-10T06:26:40.331294+0000","last_unstale":"2024-09-10T06:28:48.456581+0000","last_undegraded":"2024-09-10T06:28:48.456581+0000","last_fullsized":"2024-09-10T06:28:48.456581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:00.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379255+0000","last_change":"2024-09-10T06:26:32.278733+0000","last_active":"2024-09-10T06:28:48.379255+0000","last_peered":"2024-09-10T06:28:48.379255+0000","last_clean":"2024-09-10T06:28:48.379255+0000","last_became_active":"2024-09-10T06:26:32.278118+0000","last_became_peered":"2024-09-10T06:26:32.278118+0000","last_unstale":"2024-09-10T06:28:48.379255+0000","last_undegraded":"2024-09-10T06:28:48.379255+0000","last_fullsized":"2024-09-10T06:28:48.379255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:58.860666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455540+0000","last_change":"2024-09-10T06:26:26.180664+0000","last_active":"2024-09-10T06:28:48.455540+0000","last_peered":"2024-09-10T06:28:48.455540+0000","last_clean":"2024-09-10T06:28:48.455540+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:28:48.455540+0000","last_undegraded":"2024-09-10T06:28:48.455540+0000","last_fullsized":"2024-09-10T06:28:48.455540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:28.793045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"73'11","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375865+0000","last_change":"2024-09-10T06:26:30.594315+0000","last_active":"2024-09-10T06:28:48.375865+0000","last_peered":"2024-09-10T06:28:48.375865+0000","last_clean":"2024-09-10T06:28:48.375865+0000","last_became_active":"2024-09-10T06:26:30.593978+0000","last_became_peered":"2024-09-10T06:26:30.593978+0000","last_unstale":"2024-09-10T06:28:48.375865+0000","last_undegraded":"2024-09-10T06:28:48.375865+0000","last_fullsized":"2024-09-10T06:28:48.375865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:41.851632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460472+0000","last_change":"2024-09-10T06:26:34.279889+0000","last_active":"2024-09-10T06:28:48.460472+0000","last_peered":"2024-09-10T06:28:48.460472+0000","last_clean":"2024-09-10T06:28:48.460472+0000","last_became_active":"2024-09-10T06:26:34.279147+0000","last_became_peered":"2024-09-10T06:26:34.279147+0000","last_unstale":"2024-09-10T06:28:48.460472+0000","last_undegraded":"2024-09-10T06:28:48.460472+0000","last_fullsized":"2024-09-10T06:28:48.460472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:02.260309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"76'107","reported_seq":326,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453554+0000","last_change":"2024-09-10T06:26:36.290005+0000","last_active":"2024-09-10T06:28:48.453554+0000","last_peered":"2024-09-10T06:28:48.453554+0000","last_clean":"2024-09-10T06:28:48.453554+0000","last_became_active":"2024-09-10T06:26:36.289232+0000","last_became_peered":"2024-09-10T06:26:36.289232+0000","last_unstale":"2024-09-10T06:28:48.453554+0000","last_undegraded":"2024-09-10T06:28:48.453554+0000","last_fullsized":"2024-09-10T06:28:48.453554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:51.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":141,"num_read_kb":126,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463283+0000","last_change":"2024-09-10T06:26:38.302505+0000","last_active":"2024-09-10T06:28:48.463283+0000","last_peered":"2024-09-10T06:28:48.463283+0000","last_clean":"2024-09-10T06:28:48.463283+0000","last_became_active":"2024-09-10T06:26:38.301104+0000","last_became_peered":"2024-09-10T06:26:38.301104+0000","last_unstale":"2024-09-10T06:28:48.463283+0000","last_undegraded":"2024-09-10T06:28:48.463283+0000","last_fullsized":"2024-09-10T06:28:48.463283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.863622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"76'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453152+0000","last_change":"2024-09-10T06:26:40.320079+0000","last_active":"2024-09-10T06:28:48.453152+0000","last_peered":"2024-09-10T06:28:48.453152+0000","last_clean":"2024-09-10T06:28:48.453152+0000","last_became_active":"2024-09-10T06:26:40.319266+0000","last_became_peered":"2024-09-10T06:26:40.319266+0000","last_unstale":"2024-09-10T06:28:48.453152+0000","last_undegraded":"2024-09-10T06:28:48.453152+0000","last_fullsized":"2024-09-10T06:28:48.453152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:57.937745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"76'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454407+0000","last_change":"2024-09-10T06:26:32.282679+0000","last_active":"2024-09-10T06:28:48.454407+0000","last_peered":"2024-09-10T06:28:48.454407+0000","last_clean":"2024-09-10T06:28:48.454407+0000","last_became_active":"2024-09-10T06:26:32.282235+0000","last_became_peered":"2024-09-10T06:26:32.282235+0000","last_unstale":"2024-09-10T06:28:48.454407+0000","last_undegraded":"2024-09-10T06:28:48.454407+0000","last_fullsized":"2024-09-10T06:28:48.454407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:27.994318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454483+0000","last_change":"2024-09-10T06:26:25.979784+0000","last_active":"2024-09-10T06:28:48.454483+0000","last_peered":"2024-09-10T06:28:48.454483+0000","last_clean":"2024-09-10T06:28:48.454483+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:28:48.454483+0000","last_undegraded":"2024-09-10T06:28:48.454483+0000","last_fullsized":"2024-09-10T06:28:48.454483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:42.490682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"65'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453191+0000","last_change":"2024-09-10T06:26:30.570558+0000","last_active":"2024-09-10T06:28:48.453191+0000","last_peered":"2024-09-10T06:28:48.453191+0000","last_clean":"2024-09-10T06:28:48.453191+0000","last_became_active":"2024-09-10T06:26:30.570037+0000","last_became_peered":"2024-09-10T06:26:30.570037+0000","last_unstale":"2024-09-10T06:28:48.453191+0000","last_undegraded":"2024-09-10T06:28:48.453191+0000","last_fullsized":"2024-09-10T06:28:48.453191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:46.692143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455347+0000","last_change":"2024-09-10T06:26:34.284394+0000","last_active":"2024-09-10T06:28:48.455347+0000","last_peered":"2024-09-10T06:28:48.455347+0000","last_clean":"2024-09-10T06:28:48.455347+0000","last_became_active":"2024-09-10T06:26:34.283980+0000","last_became_peered":"2024-09-10T06:26:34.283980+0000","last_unstale":"2024-09-10T06:28:48.455347+0000","last_undegraded":"2024-09-10T06:28:48.455347+0000","last_fullsized":"2024-09-10T06:28:48.455347+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:38.061123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'18","reported_seq":240,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463679+0000","last_change":"2024-09-10T06:28:47.073398+0000","last_active":"2024-09-10T06:28:48.463679+0000","last_peered":"2024-09-10T06:28:48.463679+0000","last_clean":"2024-09-10T06:28:48.463679+0000","last_became_active":"2024-09-10T06:28:46.327631+0000","last_became_peered":"2024-09-10T06:28:46.327631+0000","last_unstale":"2024-09-10T06:28:48.463679+0000","last_undegraded":"2024-09-10T06:28:48.463679+0000","last_fullsized":"2024-09-10T06:28:48.463679+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:25.802510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375982+0000","last_change":"2024-09-10T06:26:38.292411+0000","last_active":"2024-09-10T06:28:48.375982+0000","last_peered":"2024-09-10T06:28:48.375982+0000","last_clean":"2024-09-10T06:28:48.375982+0000","last_became_active":"2024-09-10T06:26:38.291623+0000","last_became_peered":"2024-09-10T06:26:38.291623+0000","last_unstale":"2024-09-10T06:28:48.375982+0000","last_undegraded":"2024-09-10T06:28:48.375982+0000","last_fullsized":"2024-09-10T06:28:48.375982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377280+0000","last_change":"2024-09-10T06:26:40.303598+0000","last_active":"2024-09-10T06:28:48.377280+0000","last_peered":"2024-09-10T06:28:48.377280+0000","last_clean":"2024-09-10T06:28:48.377280+0000","last_became_active":"2024-09-10T06:26:40.302898+0000","last_became_peered":"2024-09-10T06:26:40.302898+0000","last_unstale":"2024-09-10T06:28:48.377280+0000","last_undegraded":"2024-09-10T06:28:48.377280+0000","last_fullsized":"2024-09-10T06:28:48.377280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:49.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"76'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453765+0000","last_change":"2024-09-10T06:26:32.273484+0000","last_active":"2024-09-10T06:28:48.453765+0000","last_peered":"2024-09-10T06:28:48.453765+0000","last_clean":"2024-09-10T06:28:48.453765+0000","last_became_active":"2024-09-10T06:26:32.273183+0000","last_became_peered":"2024-09-10T06:26:32.273183+0000","last_unstale":"2024-09-10T06:28:48.453765+0000","last_undegraded":"2024-09-10T06:28:48.453765+0000","last_fullsized":"2024-09-10T06:28:48.453765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:32.410538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459095+0000","last_change":"2024-09-10T06:26:25.534289+0000","last_active":"2024-09-10T06:28:48.459095+0000","last_peered":"2024-09-10T06:28:48.459095+0000","last_clean":"2024-09-10T06:28:48.459095+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:28:48.459095+0000","last_undegraded":"2024-09-10T06:28:48.459095+0000","last_fullsized":"2024-09-10T06:28:48.459095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:11.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379406+0000","last_change":"2024-09-10T06:26:30.579693+0000","last_active":"2024-09-10T06:28:48.379406+0000","last_peered":"2024-09-10T06:28:48.379406+0000","last_clean":"2024-09-10T06:28:48.379406+0000","last_became_active":"2024-09-10T06:26:30.577934+0000","last_became_peered":"2024-09-10T06:26:30.577934+0000","last_unstale":"2024-09-10T06:28:48.379406+0000","last_undegraded":"2024-09-10T06:28:48.379406+0000","last_fullsized":"2024-09-10T06:28:48.379406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:35.852655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377724+0000","last_change":"2024-09-10T06:26:34.275458+0000","last_active":"2024-09-10T06:28:48.377724+0000","last_peered":"2024-09-10T06:28:48.377724+0000","last_clean":"2024-09-10T06:28:48.377724+0000","last_became_active":"2024-09-10T06:26:34.274705+0000","last_became_peered":"2024-09-10T06:26:34.274705+0000","last_unstale":"2024-09-10T06:28:48.377724+0000","last_undegraded":"2024-09-10T06:28:48.377724+0000","last_fullsized":"2024-09-10T06:28:48.377724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:20.624872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379364+0000","last_change":"2024-09-10T06:26:36.266077+0000","last_active":"2024-09-10T06:28:48.379364+0000","last_peered":"2024-09-10T06:28:48.379364+0000","last_clean":"2024-09-10T06:28:48.379364+0000","last_became_active":"2024-09-10T06:26:36.265322+0000","last_became_peered":"2024-09-10T06:26:36.265322+0000","last_unstale":"2024-09-10T06:28:48.379364+0000","last_undegraded":"2024-09-10T06:28:48.379364+0000","last_fullsized":"2024-09-10T06:28:48.379364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459162+0000","last_change":"2024-09-10T06:28:46.345843+0000","last_active":"2024-09-10T06:28:48.459162+0000","last_peered":"2024-09-10T06:28:48.459162+0000","last_clean":"2024-09-10T06:28:48.459162+0000","last_became_active":"2024-09-10T06:28:46.344951+0000","last_became_peered":"2024-09-10T06:28:46.344951+0000","last_unstale":"2024-09-10T06:28:48.459162+0000","last_undegraded":"2024-09-10T06:28:48.459162+0000","last_fullsized":"2024-09-10T06:28:48.459162+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:17.825354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"76'8","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456074+0000","last_change":"2024-09-10T06:26:40.326887+0000","last_active":"2024-09-10T06:28:48.456074+0000","last_peered":"2024-09-10T06:28:48.456074+0000","last_clean":"2024-09-10T06:28:48.456074+0000","last_became_active":"2024-09-10T06:26:40.326130+0000","last_became_peered":"2024-09-10T06:26:40.326130+0000","last_unstale":"2024-09-10T06:28:48.456074+0000","last_undegraded":"2024-09-10T06:28:48.456074+0000","last_fullsized":"2024-09-10T06:28:48.456074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:28.237428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'8","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453524+0000","last_change":"2024-09-10T06:26:32.282586+0000","last_active":"2024-09-10T06:28:48.453524+0000","last_peered":"2024-09-10T06:28:48.453524+0000","last_clean":"2024-09-10T06:28:48.453524+0000","last_became_active":"2024-09-10T06:26:32.282086+0000","last_became_peered":"2024-09-10T06:26:32.282086+0000","last_unstale":"2024-09-10T06:28:48.453524+0000","last_undegraded":"2024-09-10T06:28:48.453524+0000","last_fullsized":"2024-09-10T06:28:48.453524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:44.269917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"73'16","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459611+0000","last_change":"2024-09-10T06:26:30.591913+0000","last_active":"2024-09-10T06:28:48.459611+0000","last_peered":"2024-09-10T06:28:48.459611+0000","last_clean":"2024-09-10T06:28:48.459611+0000","last_became_active":"2024-09-10T06:26:30.591140+0000","last_became_peered":"2024-09-10T06:26:30.591140+0000","last_unstale":"2024-09-10T06:28:48.459611+0000","last_undegraded":"2024-09-10T06:28:48.459611+0000","last_fullsized":"2024-09-10T06:28:48.459611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454261+0000","last_change":"2024-09-10T06:26:25.537497+0000","last_active":"2024-09-10T06:28:48.454261+0000","last_peered":"2024-09-10T06:28:48.454261+0000","last_clean":"2024-09-10T06:28:48.454261+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:28:48.454261+0000","last_undegraded":"2024-09-10T06:28:48.454261+0000","last_fullsized":"2024-09-10T06:28:48.454261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:44.787852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376269+0000","last_change":"2024-09-10T06:26:34.276099+0000","last_active":"2024-09-10T06:28:48.376269+0000","last_peered":"2024-09-10T06:28:48.376269+0000","last_clean":"2024-09-10T06:28:48.376269+0000","last_became_active":"2024-09-10T06:26:34.273984+0000","last_became_peered":"2024-09-10T06:26:34.273984+0000","last_unstale":"2024-09-10T06:28:48.376269+0000","last_undegraded":"2024-09-10T06:28:48.376269+0000","last_fullsized":"2024-09-10T06:28:48.376269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'31","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375444+0000","last_change":"2024-09-10T06:26:36.272589+0000","last_active":"2024-09-10T06:28:48.375444+0000","last_peered":"2024-09-10T06:28:48.375444+0000","last_clean":"2024-09-10T06:28:48.375444+0000","last_became_active":"2024-09-10T06:26:36.270914+0000","last_became_peered":"2024-09-10T06:26:36.270914+0000","last_unstale":"2024-09-10T06:28:48.375444+0000","last_undegraded":"2024-09-10T06:28:48.375444+0000","last_fullsized":"2024-09-10T06:28:48.375444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:20.764690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61858,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376397+0000","last_change":"2024-09-10T06:26:38.278069+0000","last_active":"2024-09-10T06:28:48.376397+0000","last_peered":"2024-09-10T06:28:48.376397+0000","last_clean":"2024-09-10T06:28:48.376397+0000","last_became_active":"2024-09-10T06:26:38.277261+0000","last_became_peered":"2024-09-10T06:26:38.277261+0000","last_unstale":"2024-09-10T06:28:48.376397+0000","last_undegraded":"2024-09-10T06:28:48.376397+0000","last_fullsized":"2024-09-10T06:28:48.376397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"67'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377903+0000","last_change":"2024-09-10T06:26:40.333741+0000","last_active":"2024-09-10T06:28:48.377903+0000","last_peered":"2024-09-10T06:28:48.377903+0000","last_clean":"2024-09-10T06:28:48.377903+0000","last_became_active":"2024-09-10T06:26:40.329701+0000","last_became_peered":"2024-09-10T06:26:40.329701+0000","last_unstale":"2024-09-10T06:28:48.377903+0000","last_undegraded":"2024-09-10T06:28:48.377903+0000","last_fullsized":"2024-09-10T06:28:48.377903+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:53.704790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"67'4","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376410+0000","last_change":"2024-09-10T06:26:32.275551+0000","last_active":"2024-09-10T06:28:48.376410+0000","last_peered":"2024-09-10T06:28:48.376410+0000","last_clean":"2024-09-10T06:28:48.376410+0000","last_became_active":"2024-09-10T06:26:32.274946+0000","last_became_peered":"2024-09-10T06:26:32.274946+0000","last_unstale":"2024-09-10T06:28:48.376410+0000","last_undegraded":"2024-09-10T06:28:48.376410+0000","last_fullsized":"2024-09-10T06:28:48.376410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"73'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454016+0000","last_change":"2024-09-10T06:26:30.565595+0000","last_active":"2024-09-10T06:28:48.454016+0000","last_peered":"2024-09-10T06:28:48.454016+0000","last_clean":"2024-09-10T06:28:48.454016+0000","last_became_active":"2024-09-10T06:26:30.565220+0000","last_became_peered":"2024-09-10T06:26:30.565220+0000","last_unstale":"2024-09-10T06:28:48.454016+0000","last_undegraded":"2024-09-10T06:28:48.454016+0000","last_fullsized":"2024-09-10T06:28:48.454016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:14.600216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464321+0000","last_change":"2024-09-10T06:26:26.180820+0000","last_active":"2024-09-10T06:28:48.464321+0000","last_peered":"2024-09-10T06:28:48.464321+0000","last_clean":"2024-09-10T06:28:48.464321+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:28:48.464321+0000","last_undegraded":"2024-09-10T06:28:48.464321+0000","last_fullsized":"2024-09-10T06:28:48.464321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:51.928304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458371+0000","last_change":"2024-09-10T06:26:34.272915+0000","last_active":"2024-09-10T06:28:48.458371+0000","last_peered":"2024-09-10T06:28:48.458371+0000","last_clean":"2024-09-10T06:28:48.458371+0000","last_became_active":"2024-09-10T06:26:34.272192+0000","last_became_peered":"2024-09-10T06:26:34.272192+0000","last_unstale":"2024-09-10T06:28:48.458371+0000","last_undegraded":"2024-09-10T06:28:48.458371+0000","last_fullsized":"2024-09-10T06:28:48.458371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:07.874348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453060+0000","last_change":"2024-09-10T06:26:36.291431+0000","last_active":"2024-09-10T06:28:48.453060+0000","last_peered":"2024-09-10T06:28:48.453060+0000","last_clean":"2024-09-10T06:28:48.453060+0000","last_became_active":"2024-09-10T06:26:36.290570+0000","last_became_peered":"2024-09-10T06:26:36.290570+0000","last_unstale":"2024-09-10T06:28:48.453060+0000","last_undegraded":"2024-09-10T06:28:48.453060+0000","last_fullsized":"2024-09-10T06:28:48.453060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:10.565531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"76'101","reported_seq":282,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456736+0000","last_change":"2024-09-10T06:26:38.312069+0000","last_active":"2024-09-10T06:28:48.456736+0000","last_peered":"2024-09-10T06:28:48.456736+0000","last_clean":"2024-09-10T06:28:48.456736+0000","last_became_active":"2024-09-10T06:26:38.310450+0000","last_became_peered":"2024-09-10T06:26:38.310450+0000","last_unstale":"2024-09-10T06:28:48.456736+0000","last_undegraded":"2024-09-10T06:28:48.456736+0000","last_fullsized":"2024-09-10T06:28:48.456736+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379742+0000","last_change":"2024-09-10T06:26:40.312990+0000","last_active":"2024-09-10T06:28:48.379742+0000","last_peered":"2024-09-10T06:28:48.379742+0000","last_clean":"2024-09-10T06:28:48.379742+0000","last_became_active":"2024-09-10T06:26:40.312266+0000","last_became_peered":"2024-09-10T06:26:40.312266+0000","last_unstale":"2024-09-10T06:28:48.379742+0000","last_undegraded":"2024-09-10T06:28:48.379742+0000","last_fullsized":"2024-09-10T06:28:48.379742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:15.777105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"76'4","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375253+0000","last_change":"2024-09-10T06:26:32.258874+0000","last_active":"2024-09-10T06:28:48.375253+0000","last_peered":"2024-09-10T06:28:48.375253+0000","last_clean":"2024-09-10T06:28:48.375253+0000","last_became_active":"2024-09-10T06:26:32.258337+0000","last_became_peered":"2024-09-10T06:26:32.258337+0000","last_unstale":"2024-09-10T06:28:48.375253+0000","last_undegraded":"2024-09-10T06:28:48.375253+0000","last_fullsized":"2024-09-10T06:28:48.375253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"73'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379418+0000","last_change":"2024-09-10T06:26:30.581501+0000","last_active":"2024-09-10T06:28:48.379418+0000","last_peered":"2024-09-10T06:28:48.379418+0000","last_clean":"2024-09-10T06:28:48.379418+0000","last_became_active":"2024-09-10T06:26:30.581115+0000","last_became_peered":"2024-09-10T06:26:30.581115+0000","last_unstale":"2024-09-10T06:28:48.379418+0000","last_undegraded":"2024-09-10T06:28:48.379418+0000","last_fullsized":"2024-09-10T06:28:48.379418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454045+0000","last_change":"2024-09-10T06:26:25.537295+0000","last_active":"2024-09-10T06:28:48.454045+0000","last_peered":"2024-09-10T06:28:48.454045+0000","last_clean":"2024-09-10T06:28:48.454045+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:28:48.454045+0000","last_undegraded":"2024-09-10T06:28:48.454045+0000","last_fullsized":"2024-09-10T06:28:48.454045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:32.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377381+0000","last_change":"2024-09-10T06:26:34.258956+0000","last_active":"2024-09-10T06:28:48.377381+0000","last_peered":"2024-09-10T06:28:48.377381+0000","last_clean":"2024-09-10T06:28:48.377381+0000","last_became_active":"2024-09-10T06:26:34.257739+0000","last_became_peered":"2024-09-10T06:26:34.257739+0000","last_unstale":"2024-09-10T06:28:48.377381+0000","last_undegraded":"2024-09-10T06:28:48.377381+0000","last_fullsized":"2024-09-10T06:28:48.377381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:18.547827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'10","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377884+0000","last_change":"2024-09-10T06:26:36.271096+0000","last_active":"2024-09-10T06:28:48.377884+0000","last_peered":"2024-09-10T06:28:48.377884+0000","last_clean":"2024-09-10T06:28:48.377884+0000","last_became_active":"2024-09-10T06:26:36.270325+0000","last_became_peered":"2024-09-10T06:26:36.270325+0000","last_unstale":"2024-09-10T06:28:48.377884+0000","last_undegraded":"2024-09-10T06:28:48.377884+0000","last_fullsized":"2024-09-10T06:28:48.377884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"76'101","reported_seq":268,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378782+0000","last_change":"2024-09-10T06:26:38.300795+0000","last_active":"2024-09-10T06:28:48.378782+0000","last_peered":"2024-09-10T06:28:48.378782+0000","last_clean":"2024-09-10T06:28:48.378782+0000","last_became_active":"2024-09-10T06:26:38.299466+0000","last_became_peered":"2024-09-10T06:26:38.299466+0000","last_unstale":"2024-09-10T06:28:48.378782+0000","last_undegraded":"2024-09-10T06:28:48.378782+0000","last_fullsized":"2024-09-10T06:28:48.378782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:38.641500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"67'4","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377170+0000","last_change":"2024-09-10T06:26:40.329688+0000","last_active":"2024-09-10T06:28:48.377170+0000","last_peered":"2024-09-10T06:28:48.377170+0000","last_clean":"2024-09-10T06:28:48.377170+0000","last_became_active":"2024-09-10T06:26:40.329009+0000","last_became_peered":"2024-09-10T06:26:40.329009+0000","last_unstale":"2024-09-10T06:28:48.377170+0000","last_undegraded":"2024-09-10T06:28:48.377170+0000","last_fullsized":"2024-09-10T06:28:48.377170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'8","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377758+0000","last_change":"2024-09-10T06:26:32.283524+0000","last_active":"2024-09-10T06:28:48.377758+0000","last_peered":"2024-09-10T06:28:48.377758+0000","last_clean":"2024-09-10T06:28:48.377758+0000","last_became_active":"2024-09-10T06:26:32.282794+0000","last_became_peered":"2024-09-10T06:26:32.282794+0000","last_unstale":"2024-09-10T06:28:48.377758+0000","last_undegraded":"2024-09-10T06:28:48.377758+0000","last_fullsized":"2024-09-10T06:28:48.377758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:11.537416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"73'6","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379512+0000","last_change":"2024-09-10T06:26:30.578273+0000","last_active":"2024-09-10T06:28:48.379512+0000","last_peered":"2024-09-10T06:28:48.379512+0000","last_clean":"2024-09-10T06:28:48.379512+0000","last_became_active":"2024-09-10T06:26:30.577985+0000","last_became_peered":"2024-09-10T06:26:30.577985+0000","last_unstale":"2024-09-10T06:28:48.379512+0000","last_undegraded":"2024-09-10T06:28:48.379512+0000","last_fullsized":"2024-09-10T06:28:48.379512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460109+0000","last_change":"2024-09-10T06:26:26.037773+0000","last_active":"2024-09-10T06:28:48.460109+0000","last_peered":"2024-09-10T06:28:48.460109+0000","last_clean":"2024-09-10T06:28:48.460109+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:28:48.460109+0000","last_undegraded":"2024-09-10T06:28:48.460109+0000","last_fullsized":"2024-09-10T06:28:48.460109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:21.949708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374863+0000","last_change":"2024-09-10T06:26:34.268710+0000","last_active":"2024-09-10T06:28:48.374863+0000","last_peered":"2024-09-10T06:28:48.374863+0000","last_clean":"2024-09-10T06:28:48.374863+0000","last_became_active":"2024-09-10T06:26:34.268359+0000","last_became_peered":"2024-09-10T06:26:34.268359+0000","last_unstale":"2024-09-10T06:28:48.374863+0000","last_undegraded":"2024-09-10T06:28:48.374863+0000","last_fullsized":"2024-09-10T06:28:48.374863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:27.191787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"76'37","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462144+0000","last_change":"2024-09-10T06:26:36.299700+0000","last_active":"2024-09-10T06:28:48.462144+0000","last_peered":"2024-09-10T06:28:48.462144+0000","last_clean":"2024-09-10T06:28:48.462144+0000","last_became_active":"2024-09-10T06:26:36.297606+0000","last_became_peered":"2024-09-10T06:26:36.297606+0000","last_unstale":"2024-09-10T06:28:48.462144+0000","last_undegraded":"2024-09-10T06:28:48.462144+0000","last_fullsized":"2024-09-10T06:28:48.462144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375382+0000","last_change":"2024-09-10T06:26:38.290601+0000","last_active":"2024-09-10T06:28:48.375382+0000","last_peered":"2024-09-10T06:28:48.375382+0000","last_clean":"2024-09-10T06:28:48.375382+0000","last_became_active":"2024-09-10T06:26:38.289589+0000","last_became_peered":"2024-09-10T06:26:38.289589+0000","last_unstale":"2024-09-10T06:28:48.375382+0000","last_undegraded":"2024-09-10T06:28:48.375382+0000","last_fullsized":"2024-09-10T06:28:48.375382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:22.625936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":131,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458535+0000","last_change":"2024-09-10T06:26:40.332819+0000","last_active":"2024-09-10T06:28:48.458535+0000","last_peered":"2024-09-10T06:28:48.458535+0000","last_clean":"2024-09-10T06:28:48.458535+0000","last_became_active":"2024-09-10T06:26:40.332160+0000","last_became_peered":"2024-09-10T06:26:40.332160+0000","last_unstale":"2024-09-10T06:28:48.458535+0000","last_undegraded":"2024-09-10T06:28:48.458535+0000","last_fullsized":"2024-09-10T06:28:48.458535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.784870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378032+0000","last_change":"2024-09-10T06:26:40.334393+0000","last_active":"2024-09-10T06:28:48.378032+0000","last_peered":"2024-09-10T06:28:48.378032+0000","last_clean":"2024-09-10T06:28:48.378032+0000","last_became_active":"2024-09-10T06:26:40.333474+0000","last_became_peered":"2024-09-10T06:26:40.333474+0000","last_unstale":"2024-09-10T06:28:48.378032+0000","last_undegraded":"2024-09-10T06:28:48.378032+0000","last_fullsized":"2024-09-10T06:28:48.378032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:35.031954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'6","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379068+0000","last_change":"2024-09-10T06:26:32.272914+0000","last_active":"2024-09-10T06:28:48.379068+0000","last_peered":"2024-09-10T06:28:48.379068+0000","last_clean":"2024-09-10T06:28:48.379068+0000","last_became_active":"2024-09-10T06:26:32.272178+0000","last_became_peered":"2024-09-10T06:26:32.272178+0000","last_unstale":"2024-09-10T06:28:48.379068+0000","last_undegraded":"2024-09-10T06:28:48.379068+0000","last_fullsized":"2024-09-10T06:28:48.379068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"72'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379651+0000","last_change":"2024-09-10T06:26:30.593531+0000","last_active":"2024-09-10T06:28:48.379651+0000","last_peered":"2024-09-10T06:28:48.379651+0000","last_clean":"2024-09-10T06:28:48.379651+0000","last_became_active":"2024-09-10T06:26:30.592753+0000","last_became_peered":"2024-09-10T06:26:30.592753+0000","last_unstale":"2024-09-10T06:28:48.379651+0000","last_undegraded":"2024-09-10T06:28:48.379651+0000","last_fullsized":"2024-09-10T06:28:48.379651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:14.506864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453648+0000","last_change":"2024-09-10T06:26:34.282877+0000","last_active":"2024-09-10T06:28:48.453648+0000","last_peered":"2024-09-10T06:28:48.453648+0000","last_clean":"2024-09-10T06:28:48.453648+0000","last_became_active":"2024-09-10T06:26:34.282281+0000","last_became_peered":"2024-09-10T06:26:34.282281+0000","last_unstale":"2024-09-10T06:28:48.453648+0000","last_undegraded":"2024-09-10T06:28:48.453648+0000","last_fullsized":"2024-09-10T06:28:48.453648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:41.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"76'17","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374470+0000","last_change":"2024-09-10T06:26:36.273166+0000","last_active":"2024-09-10T06:28:48.374470+0000","last_peered":"2024-09-10T06:28:48.374470+0000","last_clean":"2024-09-10T06:28:48.374470+0000","last_became_active":"2024-09-10T06:26:36.272386+0000","last_became_peered":"2024-09-10T06:26:36.272386+0000","last_unstale":"2024-09-10T06:28:48.374470+0000","last_undegraded":"2024-09-10T06:28:48.374470+0000","last_fullsized":"2024-09-10T06:28:48.374470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374423+0000","last_change":"2024-09-10T06:26:38.297347+0000","last_active":"2024-09-10T06:28:48.374423+0000","last_peered":"2024-09-10T06:28:48.374423+0000","last_clean":"2024-09-10T06:28:48.374423+0000","last_became_active":"2024-09-10T06:26:38.296600+0000","last_became_peered":"2024-09-10T06:26:38.296600+0000","last_unstale":"2024-09-10T06:28:48.374423+0000","last_undegraded":"2024-09-10T06:28:48.374423+0000","last_fullsized":"2024-09-10T06:28:48.374423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:08.758126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"67'20","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379025+0000","last_change":"2024-09-10T06:26:40.321844+0000","last_active":"2024-09-10T06:28:48.379025+0000","last_peered":"2024-09-10T06:28:48.379025+0000","last_clean":"2024-09-10T06:28:48.379025+0000","last_became_active":"2024-09-10T06:26:40.321097+0000","last_became_peered":"2024-09-10T06:26:40.321097+0000","last_unstale":"2024-09-10T06:28:48.379025+0000","last_undegraded":"2024-09-10T06:28:48.379025+0000","last_fullsized":"2024-09-10T06:28:48.379025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:10.004849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"67'6","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453385+0000","last_change":"2024-09-10T06:26:32.286989+0000","last_active":"2024-09-10T06:28:48.453385+0000","last_peered":"2024-09-10T06:28:48.453385+0000","last_clean":"2024-09-10T06:28:48.453385+0000","last_became_active":"2024-09-10T06:26:32.286519+0000","last_became_peered":"2024-09-10T06:26:32.286519+0000","last_unstale":"2024-09-10T06:28:48.453385+0000","last_undegraded":"2024-09-10T06:28:48.453385+0000","last_fullsized":"2024-09-10T06:28:48.453385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:31.592472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'6","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463876+0000","last_change":"2024-09-10T06:26:30.587315+0000","last_active":"2024-09-10T06:28:48.463876+0000","last_peered":"2024-09-10T06:28:48.463876+0000","last_clean":"2024-09-10T06:28:48.463876+0000","last_became_active":"2024-09-10T06:26:30.586611+0000","last_became_peered":"2024-09-10T06:26:30.586611+0000","last_unstale":"2024-09-10T06:28:48.463876+0000","last_undegraded":"2024-09-10T06:28:48.463876+0000","last_fullsized":"2024-09-10T06:28:48.463876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"27'1","reported_seq":215,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377034+0000","last_change":"2024-09-10T06:26:34.271770+0000","last_active":"2024-09-10T06:28:48.377034+0000","last_peered":"2024-09-10T06:28:48.377034+0000","last_clean":"2024-09-10T06:28:48.377034+0000","last_became_active":"2024-09-10T06:26:34.269875+0000","last_became_peered":"2024-09-10T06:26:34.269875+0000","last_unstale":"2024-09-10T06:28:48.377034+0000","last_undegraded":"2024-09-10T06:28:48.377034+0000","last_fullsized":"2024-09-10T06:28:48.377034+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:09.570079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"67'6","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375158+0000","last_change":"2024-09-10T06:26:36.289140+0000","last_active":"2024-09-10T06:28:48.375158+0000","last_peered":"2024-09-10T06:28:48.375158+0000","last_clean":"2024-09-10T06:28:48.375158+0000","last_became_active":"2024-09-10T06:26:36.288355+0000","last_became_peered":"2024-09-10T06:26:36.288355+0000","last_unstale":"2024-09-10T06:28:48.375158+0000","last_undegraded":"2024-09-10T06:28:48.375158+0000","last_fullsized":"2024-09-10T06:28:48.375158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:42.518982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456834+0000","last_change":"2024-09-10T06:26:38.302040+0000","last_active":"2024-09-10T06:28:48.456834+0000","last_peered":"2024-09-10T06:28:48.456834+0000","last_clean":"2024-09-10T06:28:48.456834+0000","last_became_active":"2024-09-10T06:26:38.301064+0000","last_became_peered":"2024-09-10T06:26:38.301064+0000","last_unstale":"2024-09-10T06:28:48.456834+0000","last_undegraded":"2024-09-10T06:28:48.456834+0000","last_fullsized":"2024-09-10T06:28:48.456834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:41.513255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"64'4","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377465+0000","last_change":"2024-09-10T06:26:40.322368+0000","last_active":"2024-09-10T06:28:48.377465+0000","last_peered":"2024-09-10T06:28:48.377465+0000","last_clean":"2024-09-10T06:28:48.377465+0000","last_became_active":"2024-09-10T06:26:40.321592+0000","last_became_peered":"2024-09-10T06:26:40.321592+0000","last_unstale":"2024-09-10T06:28:48.377465+0000","last_undegraded":"2024-09-10T06:28:48.377465+0000","last_fullsized":"2024-09-10T06:28:48.377465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:03.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"61'4","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375474+0000","last_change":"2024-09-10T06:26:32.259666+0000","last_active":"2024-09-10T06:28:48.375474+0000","last_peered":"2024-09-10T06:28:48.375474+0000","last_clean":"2024-09-10T06:28:48.375474+0000","last_became_active":"2024-09-10T06:26:32.258775+0000","last_became_peered":"2024-09-10T06:26:32.258775+0000","last_unstale":"2024-09-10T06:28:48.375474+0000","last_undegraded":"2024-09-10T06:28:48.375474+0000","last_fullsized":"2024-09-10T06:28:48.375474+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"72'13","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460480+0000","last_change":"2024-09-10T06:26:30.592773+0000","last_active":"2024-09-10T06:28:48.460480+0000","last_peered":"2024-09-10T06:28:48.460480+0000","last_clean":"2024-09-10T06:28:48.460480+0000","last_became_active":"2024-09-10T06:26:30.590566+0000","last_became_peered":"2024-09-10T06:26:30.590566+0000","last_unstale":"2024-09-10T06:28:48.460480+0000","last_undegraded":"2024-09-10T06:28:48.460480+0000","last_fullsized":"2024-09-10T06:28:48.460480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:35.688897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455019+0000","last_change":"2024-09-10T06:26:34.281690+0000","last_active":"2024-09-10T06:28:48.455019+0000","last_peered":"2024-09-10T06:28:48.455019+0000","last_clean":"2024-09-10T06:28:48.455019+0000","last_became_active":"2024-09-10T06:26:34.281008+0000","last_became_peered":"2024-09-10T06:26:34.281008+0000","last_unstale":"2024-09-10T06:28:48.455019+0000","last_undegraded":"2024-09-10T06:28:48.455019+0000","last_fullsized":"2024-09-10T06:28:48.455019+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"76'17","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375366+0000","last_change":"2024-09-10T06:26:36.277028+0000","last_active":"2024-09-10T06:28:48.375366+0000","last_peered":"2024-09-10T06:28:48.375366+0000","last_clean":"2024-09-10T06:28:48.375366+0000","last_became_active":"2024-09-10T06:26:36.276248+0000","last_became_peered":"2024-09-10T06:26:36.276248+0000","last_unstale":"2024-09-10T06:28:48.375366+0000","last_undegraded":"2024-09-10T06:28:48.375366+0000","last_fullsized":"2024-09-10T06:28:48.375366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:53.521681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457566+0000","last_change":"2024-09-10T06:28:46.344566+0000","last_active":"2024-09-10T06:28:48.457566+0000","last_peered":"2024-09-10T06:28:48.457566+0000","last_clean":"2024-09-10T06:28:48.457566+0000","last_became_active":"2024-09-10T06:28:46.343657+0000","last_became_peered":"2024-09-10T06:28:46.343657+0000","last_unstale":"2024-09-10T06:28:48.457566+0000","last_undegraded":"2024-09-10T06:28:48.457566+0000","last_fullsized":"2024-09-10T06:28:48.457566+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:25.681176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":131,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460750+0000","last_change":"2024-09-10T06:26:40.331445+0000","last_active":"2024-09-10T06:28:48.460750+0000","last_peered":"2024-09-10T06:28:48.460750+0000","last_clean":"2024-09-10T06:28:48.460750+0000","last_became_active":"2024-09-10T06:26:40.330707+0000","last_became_peered":"2024-09-10T06:26:40.330707+0000","last_unstale":"2024-09-10T06:28:48.460750+0000","last_undegraded":"2024-09-10T06:28:48.460750+0000","last_fullsized":"2024-09-10T06:28:48.460750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.822687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375689+0000","last_change":"2024-09-10T06:26:32.266221+0000","last_active":"2024-09-10T06:28:48.375689+0000","last_peered":"2024-09-10T06:28:48.375689+0000","last_clean":"2024-09-10T06:28:48.375689+0000","last_became_active":"2024-09-10T06:26:32.265705+0000","last_became_peered":"2024-09-10T06:26:32.265705+0000","last_unstale":"2024-09-10T06:28:48.375689+0000","last_undegraded":"2024-09-10T06:28:48.375689+0000","last_fullsized":"2024-09-10T06:28:48.375689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"73'9","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378292+0000","last_change":"2024-09-10T06:26:30.594335+0000","last_active":"2024-09-10T06:28:48.378292+0000","last_peered":"2024-09-10T06:28:48.378292+0000","last_clean":"2024-09-10T06:28:48.378292+0000","last_became_active":"2024-09-10T06:26:30.593326+0000","last_became_peered":"2024-09-10T06:26:30.593326+0000","last_unstale":"2024-09-10T06:28:48.378292+0000","last_undegraded":"2024-09-10T06:28:48.378292+0000","last_fullsized":"2024-09-10T06:28:48.378292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:37.297722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457321+0000","last_change":"2024-09-10T06:26:34.281915+0000","last_active":"2024-09-10T06:28:48.457321+0000","last_peered":"2024-09-10T06:28:48.457321+0000","last_clean":"2024-09-10T06:28:48.457321+0000","last_became_active":"2024-09-10T06:26:34.281147+0000","last_became_peered":"2024-09-10T06:26:34.281147+0000","last_unstale":"2024-09-10T06:28:48.457321+0000","last_undegraded":"2024-09-10T06:28:48.457321+0000","last_fullsized":"2024-09-10T06:28:48.457321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:41.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"76'15","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458102+0000","last_change":"2024-09-10T06:26:36.298537+0000","last_active":"2024-09-10T06:28:48.458102+0000","last_peered":"2024-09-10T06:28:48.458102+0000","last_clean":"2024-09-10T06:28:48.458102+0000","last_became_active":"2024-09-10T06:26:36.297372+0000","last_became_peered":"2024-09-10T06:26:36.297372+0000","last_unstale":"2024-09-10T06:28:48.458102+0000","last_undegraded":"2024-09-10T06:28:48.458102+0000","last_fullsized":"2024-09-10T06:28:48.458102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376039+0000","last_change":"2024-09-10T06:26:38.301461+0000","last_active":"2024-09-10T06:28:48.376039+0000","last_peered":"2024-09-10T06:28:48.376039+0000","last_clean":"2024-09-10T06:28:48.376039+0000","last_became_active":"2024-09-10T06:26:38.300580+0000","last_became_peered":"2024-09-10T06:26:38.300580+0000","last_unstale":"2024-09-10T06:28:48.376039+0000","last_undegraded":"2024-09-10T06:28:48.376039+0000","last_fullsized":"2024-09-10T06:28:48.376039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"67'10","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459745+0000","last_change":"2024-09-10T06:26:32.285276+0000","last_active":"2024-09-10T06:28:48.459745+0000","last_peered":"2024-09-10T06:28:48.459745+0000","last_clean":"2024-09-10T06:28:48.459745+0000","last_became_active":"2024-09-10T06:26:32.284457+0000","last_became_peered":"2024-09-10T06:26:32.284457+0000","last_unstale":"2024-09-10T06:28:48.459745+0000","last_undegraded":"2024-09-10T06:28:48.459745+0000","last_fullsized":"2024-09-10T06:28:48.459745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:37.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"72'7","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376160+0000","last_change":"2024-09-10T06:26:30.573339+0000","last_active":"2024-09-10T06:28:48.376160+0000","last_peered":"2024-09-10T06:28:48.376160+0000","last_clean":"2024-09-10T06:28:48.376160+0000","last_became_active":"2024-09-10T06:26:30.571377+0000","last_became_peered":"2024-09-10T06:26:30.571377+0000","last_unstale":"2024-09-10T06:28:48.376160+0000","last_undegraded":"2024-09-10T06:28:48.376160+0000","last_fullsized":"2024-09-10T06:28:48.376160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:59.752497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378936+0000","last_change":"2024-09-10T06:26:34.269013+0000","last_active":"2024-09-10T06:28:48.378936+0000","last_peered":"2024-09-10T06:28:48.378936+0000","last_clean":"2024-09-10T06:28:48.378936+0000","last_became_active":"2024-09-10T06:26:34.268677+0000","last_became_peered":"2024-09-10T06:26:34.268677+0000","last_unstale":"2024-09-10T06:28:48.378936+0000","last_undegraded":"2024-09-10T06:28:48.378936+0000","last_fullsized":"2024-09-10T06:28:48.378936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"76'24","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453725+0000","last_change":"2024-09-10T06:26:36.300362+0000","last_active":"2024-09-10T06:28:48.453725+0000","last_peered":"2024-09-10T06:28:48.453725+0000","last_clean":"2024-09-10T06:28:48.453725+0000","last_became_active":"2024-09-10T06:26:36.299645+0000","last_became_peered":"2024-09-10T06:26:36.299645+0000","last_unstale":"2024-09-10T06:28:48.453725+0000","last_undegraded":"2024-09-10T06:28:48.453725+0000","last_fullsized":"2024-09-10T06:28:48.453725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:17.424354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461216+0000","last_change":"2024-09-10T06:26:38.299751+0000","last_active":"2024-09-10T06:28:48.461216+0000","last_peered":"2024-09-10T06:28:48.461216+0000","last_clean":"2024-09-10T06:28:48.461216+0000","last_became_active":"2024-09-10T06:26:38.298414+0000","last_became_peered":"2024-09-10T06:26:38.298414+0000","last_unstale":"2024-09-10T06:28:48.461216+0000","last_undegraded":"2024-09-10T06:28:48.461216+0000","last_fullsized":"2024-09-10T06:28:48.461216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375074+0000","last_change":"2024-09-10T06:26:40.312752+0000","last_active":"2024-09-10T06:28:48.375074+0000","last_peered":"2024-09-10T06:28:48.375074+0000","last_clean":"2024-09-10T06:28:48.375074+0000","last_became_active":"2024-09-10T06:26:40.312026+0000","last_became_peered":"2024-09-10T06:26:40.312026+0000","last_unstale":"2024-09-10T06:28:48.375074+0000","last_undegraded":"2024-09-10T06:28:48.375074+0000","last_fullsized":"2024-09-10T06:28:48.375074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:50.071224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379114+0000","last_change":"2024-09-10T06:26:32.266934+0000","last_active":"2024-09-10T06:28:48.379114+0000","last_peered":"2024-09-10T06:28:48.379114+0000","last_clean":"2024-09-10T06:28:48.379114+0000","last_became_active":"2024-09-10T06:26:32.266682+0000","last_became_peered":"2024-09-10T06:26:32.266682+0000","last_unstale":"2024-09-10T06:28:48.379114+0000","last_undegraded":"2024-09-10T06:28:48.379114+0000","last_fullsized":"2024-09-10T06:28:48.379114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"73'15","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453902+0000","last_change":"2024-09-10T06:26:30.579097+0000","last_active":"2024-09-10T06:28:48.453902+0000","last_peered":"2024-09-10T06:28:48.453902+0000","last_clean":"2024-09-10T06:28:48.453902+0000","last_became_active":"2024-09-10T06:26:30.578692+0000","last_became_peered":"2024-09-10T06:26:30.578692+0000","last_unstale":"2024-09-10T06:28:48.453902+0000","last_undegraded":"2024-09-10T06:28:48.453902+0000","last_fullsized":"2024-09-10T06:28:48.453902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:15.878123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":23,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"27'1","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459372+0000","last_change":"2024-09-10T06:26:34.282356+0000","last_active":"2024-09-10T06:28:48.459372+0000","last_peered":"2024-09-10T06:28:48.459372+0000","last_clean":"2024-09-10T06:28:48.459372+0000","last_became_active":"2024-09-10T06:26:34.281167+0000","last_became_peered":"2024-09-10T06:26:34.281167+0000","last_unstale":"2024-09-10T06:28:48.459372+0000","last_undegraded":"2024-09-10T06:28:48.459372+0000","last_fullsized":"2024-09-10T06:28:48.459372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:59.042394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"76'22","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462615+0000","last_change":"2024-09-10T06:26:36.301277+0000","last_active":"2024-09-10T06:28:48.462615+0000","last_peered":"2024-09-10T06:28:48.462615+0000","last_clean":"2024-09-10T06:28:48.462615+0000","last_became_active":"2024-09-10T06:26:36.300501+0000","last_became_peered":"2024-09-10T06:26:36.300501+0000","last_unstale":"2024-09-10T06:28:48.462615+0000","last_undegraded":"2024-09-10T06:28:48.462615+0000","last_fullsized":"2024-09-10T06:28:48.462615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:38.477946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454290+0000","last_change":"2024-09-10T06:26:38.305737+0000","last_active":"2024-09-10T06:28:48.454290+0000","last_peered":"2024-09-10T06:28:48.454290+0000","last_clean":"2024-09-10T06:28:48.454290+0000","last_became_active":"2024-09-10T06:26:38.303318+0000","last_became_peered":"2024-09-10T06:26:38.303318+0000","last_unstale":"2024-09-10T06:28:48.454290+0000","last_undegraded":"2024-09-10T06:28:48.454290+0000","last_fullsized":"2024-09-10T06:28:48.454290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:52.587622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"67'10","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457986+0000","last_change":"2024-09-10T06:26:40.318587+0000","last_active":"2024-09-10T06:28:48.457986+0000","last_peered":"2024-09-10T06:28:48.457986+0000","last_clean":"2024-09-10T06:28:48.457986+0000","last_became_active":"2024-09-10T06:26:40.317695+0000","last_became_peered":"2024-09-10T06:26:40.317695+0000","last_unstale":"2024-09-10T06:28:48.457986+0000","last_undegraded":"2024-09-10T06:28:48.457986+0000","last_fullsized":"2024-09-10T06:28:48.457986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:48.298686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378998+0000","last_change":"2024-09-10T06:26:32.276218+0000","last_active":"2024-09-10T06:28:48.378998+0000","last_peered":"2024-09-10T06:28:48.378998+0000","last_clean":"2024-09-10T06:28:48.378998+0000","last_became_active":"2024-09-10T06:26:32.275805+0000","last_became_peered":"2024-09-10T06:26:32.275805+0000","last_unstale":"2024-09-10T06:28:48.378998+0000","last_undegraded":"2024-09-10T06:28:48.378998+0000","last_fullsized":"2024-09-10T06:28:48.378998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"73'7","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378792+0000","last_change":"2024-09-10T06:26:30.568731+0000","last_active":"2024-09-10T06:28:48.378792+0000","last_peered":"2024-09-10T06:28:48.378792+0000","last_clean":"2024-09-10T06:28:48.378792+0000","last_became_active":"2024-09-10T06:26:30.567937+0000","last_became_peered":"2024-09-10T06:26:30.567937+0000","last_unstale":"2024-09-10T06:28:48.378792+0000","last_undegraded":"2024-09-10T06:28:48.378792+0000","last_fullsized":"2024-09-10T06:28:48.378792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:18.974865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380790+0000","last_change":"2024-09-10T06:26:34.266227+0000","last_active":"2024-09-10T06:28:48.380790+0000","last_peered":"2024-09-10T06:28:48.380790+0000","last_clean":"2024-09-10T06:28:48.380790+0000","last_became_active":"2024-09-10T06:26:34.262443+0000","last_became_peered":"2024-09-10T06:26:34.262443+0000","last_unstale":"2024-09-10T06:28:48.380790+0000","last_undegraded":"2024-09-10T06:28:48.380790+0000","last_fullsized":"2024-09-10T06:28:48.380790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.918813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"76'18","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379862+0000","last_change":"2024-09-10T06:26:36.292958+0000","last_active":"2024-09-10T06:28:48.379862+0000","last_peered":"2024-09-10T06:28:48.379862+0000","last_clean":"2024-09-10T06:28:48.379862+0000","last_became_active":"2024-09-10T06:26:36.292149+0000","last_became_peered":"2024-09-10T06:26:36.292149+0000","last_unstale":"2024-09-10T06:28:48.379862+0000","last_undegraded":"2024-09-10T06:28:48.379862+0000","last_fullsized":"2024-09-10T06:28:48.379862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453832+0000","last_change":"2024-09-10T06:26:38.302991+0000","last_active":"2024-09-10T06:28:48.453832+0000","last_peered":"2024-09-10T06:28:48.453832+0000","last_clean":"2024-09-10T06:28:48.453832+0000","last_became_active":"2024-09-10T06:26:38.289306+0000","last_became_peered":"2024-09-10T06:26:38.289306+0000","last_unstale":"2024-09-10T06:28:48.453832+0000","last_undegraded":"2024-09-10T06:28:48.453832+0000","last_fullsized":"2024-09-10T06:28:48.453832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:57.625329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":131,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456388+0000","last_change":"2024-09-10T06:26:40.327627+0000","last_active":"2024-09-10T06:28:48.456388+0000","last_peered":"2024-09-10T06:28:48.456388+0000","last_clean":"2024-09-10T06:28:48.456388+0000","last_became_active":"2024-09-10T06:26:40.326888+0000","last_became_peered":"2024-09-10T06:26:40.326888+0000","last_unstale":"2024-09-10T06:28:48.456388+0000","last_undegraded":"2024-09-10T06:28:48.456388+0000","last_fullsized":"2024-09-10T06:28:48.456388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:41.122562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455150+0000","last_change":"2024-09-10T06:26:32.275071+0000","last_active":"2024-09-10T06:28:48.455150+0000","last_peered":"2024-09-10T06:28:48.455150+0000","last_clean":"2024-09-10T06:28:48.455150+0000","last_became_active":"2024-09-10T06:26:32.274395+0000","last_became_peered":"2024-09-10T06:26:32.274395+0000","last_unstale":"2024-09-10T06:28:48.455150+0000","last_undegraded":"2024-09-10T06:28:48.455150+0000","last_fullsized":"2024-09-10T06:28:48.455150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:51.369493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"73'7","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376168+0000","last_change":"2024-09-10T06:26:30.594599+0000","last_active":"2024-09-10T06:28:48.376168+0000","last_peered":"2024-09-10T06:28:48.376168+0000","last_clean":"2024-09-10T06:28:48.376168+0000","last_became_active":"2024-09-10T06:26:30.594058+0000","last_became_peered":"2024-09-10T06:26:30.594058+0000","last_unstale":"2024-09-10T06:28:48.376168+0000","last_undegraded":"2024-09-10T06:28:48.376168+0000","last_fullsized":"2024-09-10T06:28:48.376168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:18.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454398+0000","last_change":"2024-09-10T06:26:34.279538+0000","last_active":"2024-09-10T06:28:48.454398+0000","last_peered":"2024-09-10T06:28:48.454398+0000","last_clean":"2024-09-10T06:28:48.454398+0000","last_became_active":"2024-09-10T06:26:34.278871+0000","last_became_peered":"2024-09-10T06:26:34.278871+0000","last_unstale":"2024-09-10T06:28:48.454398+0000","last_undegraded":"2024-09-10T06:28:48.454398+0000","last_fullsized":"2024-09-10T06:28:48.454398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:13.203357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"71'12","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379969+0000","last_change":"2024-09-10T06:26:36.290976+0000","last_active":"2024-09-10T06:28:48.379969+0000","last_peered":"2024-09-10T06:28:48.379969+0000","last_clean":"2024-09-10T06:28:48.379969+0000","last_became_active":"2024-09-10T06:26:36.290265+0000","last_became_peered":"2024-09-10T06:26:36.290265+0000","last_unstale":"2024-09-10T06:28:48.379969+0000","last_undegraded":"2024-09-10T06:28:48.379969+0000","last_fullsized":"2024-09-10T06:28:48.379969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"76'101","reported_seq":270,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458883+0000","last_change":"2024-09-10T06:26:38.292031+0000","last_active":"2024-09-10T06:28:48.458883+0000","last_peered":"2024-09-10T06:28:48.458883+0000","last_clean":"2024-09-10T06:28:48.458883+0000","last_became_active":"2024-09-10T06:26:38.288791+0000","last_became_peered":"2024-09-10T06:26:38.288791+0000","last_unstale":"2024-09-10T06:28:48.458883+0000","last_undegraded":"2024-09-10T06:28:48.458883+0000","last_fullsized":"2024-09-10T06:28:48.458883+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:07.830355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"76'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454947+0000","last_change":"2024-09-10T06:26:40.336448+0000","last_active":"2024-09-10T06:28:48.454947+0000","last_peered":"2024-09-10T06:28:48.454947+0000","last_clean":"2024-09-10T06:28:48.454947+0000","last_became_active":"2024-09-10T06:26:40.335771+0000","last_became_peered":"2024-09-10T06:26:40.335771+0000","last_unstale":"2024-09-10T06:28:48.454947+0000","last_undegraded":"2024-09-10T06:28:48.454947+0000","last_fullsized":"2024-09-10T06:28:48.454947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378840+0000","last_change":"2024-09-10T06:26:32.262176+0000","last_active":"2024-09-10T06:28:48.378840+0000","last_peered":"2024-09-10T06:28:48.378840+0000","last_clean":"2024-09-10T06:28:48.378840+0000","last_became_active":"2024-09-10T06:26:32.261250+0000","last_became_peered":"2024-09-10T06:26:32.261250+0000","last_unstale":"2024-09-10T06:28:48.378840+0000","last_undegraded":"2024-09-10T06:28:48.378840+0000","last_fullsized":"2024-09-10T06:28:48.378840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"73'8","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461812+0000","last_change":"2024-09-10T06:26:30.604587+0000","last_active":"2024-09-10T06:28:48.461812+0000","last_peered":"2024-09-10T06:28:48.461812+0000","last_clean":"2024-09-10T06:28:48.461812+0000","last_became_active":"2024-09-10T06:26:30.603175+0000","last_became_peered":"2024-09-10T06:26:30.603175+0000","last_unstale":"2024-09-10T06:28:48.461812+0000","last_undegraded":"2024-09-10T06:28:48.461812+0000","last_fullsized":"2024-09-10T06:28:48.461812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458176+0000","last_change":"2024-09-10T06:26:34.286028+0000","last_active":"2024-09-10T06:28:48.458176+0000","last_peered":"2024-09-10T06:28:48.458176+0000","last_clean":"2024-09-10T06:28:48.458176+0000","last_became_active":"2024-09-10T06:26:34.285169+0000","last_became_peered":"2024-09-10T06:26:34.285169+0000","last_unstale":"2024-09-10T06:28:48.458176+0000","last_undegraded":"2024-09-10T06:28:48.458176+0000","last_fullsized":"2024-09-10T06:28:48.458176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:24.146088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"76'21","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456781+0000","last_change":"2024-09-10T06:26:36.292679+0000","last_active":"2024-09-10T06:28:48.456781+0000","last_peered":"2024-09-10T06:28:48.456781+0000","last_clean":"2024-09-10T06:28:48.456781+0000","last_became_active":"2024-09-10T06:26:36.288780+0000","last_became_peered":"2024-09-10T06:26:36.288780+0000","last_unstale":"2024-09-10T06:28:48.456781+0000","last_undegraded":"2024-09-10T06:28:48.456781+0000","last_fullsized":"2024-09-10T06:28:48.456781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374526+0000","last_change":"2024-09-10T06:26:38.293015+0000","last_active":"2024-09-10T06:28:48.374526+0000","last_peered":"2024-09-10T06:28:48.374526+0000","last_clean":"2024-09-10T06:28:48.374526+0000","last_became_active":"2024-09-10T06:26:38.292185+0000","last_became_peered":"2024-09-10T06:26:38.292185+0000","last_unstale":"2024-09-10T06:28:48.374526+0000","last_undegraded":"2024-09-10T06:28:48.374526+0000","last_fullsized":"2024-09-10T06:28:48.374526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:32.694777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"64'10","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464809+0000","last_change":"2024-09-10T06:26:40.336074+0000","last_active":"2024-09-10T06:28:48.464809+0000","last_peered":"2024-09-10T06:28:48.464809+0000","last_clean":"2024-09-10T06:28:48.464809+0000","last_became_active":"2024-09-10T06:26:40.335339+0000","last_became_peered":"2024-09-10T06:26:40.335339+0000","last_unstale":"2024-09-10T06:28:48.464809+0000","last_undegraded":"2024-09-10T06:28:48.464809+0000","last_fullsized":"2024-09-10T06:28:48.464809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378132+0000","last_change":"2024-09-10T06:26:32.262823+0000","last_active":"2024-09-10T06:28:48.378132+0000","last_peered":"2024-09-10T06:28:48.378132+0000","last_clean":"2024-09-10T06:28:48.378132+0000","last_became_active":"2024-09-10T06:26:32.262041+0000","last_became_peered":"2024-09-10T06:26:32.262041+0000","last_unstale":"2024-09-10T06:28:48.378132+0000","last_undegraded":"2024-09-10T06:28:48.378132+0000","last_fullsized":"2024-09-10T06:28:48.378132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:48.768083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"73'7","reported_seq":123,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455114+0000","last_change":"2024-09-10T06:27:08.868703+0000","last_active":"2024-09-10T06:28:48.455114+0000","last_peered":"2024-09-10T06:28:48.455114+0000","last_clean":"2024-09-10T06:28:48.455114+0000","last_became_active":"2024-09-10T06:27:08.868399+0000","last_became_peered":"2024-09-10T06:27:08.868399+0000","last_unstale":"2024-09-10T06:28:48.455114+0000","last_undegraded":"2024-09-10T06:28:48.455114+0000","last_fullsized":"2024-09-10T06:28:48.455114+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:20.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459766+0000","last_change":"2024-09-10T06:26:34.282651+0000","last_active":"2024-09-10T06:28:48.459766+0000","last_peered":"2024-09-10T06:28:48.459766+0000","last_clean":"2024-09-10T06:28:48.459766+0000","last_became_active":"2024-09-10T06:26:34.281777+0000","last_became_peered":"2024-09-10T06:26:34.281777+0000","last_unstale":"2024-09-10T06:28:48.459766+0000","last_undegraded":"2024-09-10T06:28:48.459766+0000","last_fullsized":"2024-09-10T06:28:48.459766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:42.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"76'15","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374806+0000","last_change":"2024-09-10T06:26:36.285192+0000","last_active":"2024-09-10T06:28:48.374806+0000","last_peered":"2024-09-10T06:28:48.374806+0000","last_clean":"2024-09-10T06:28:48.374806+0000","last_became_active":"2024-09-10T06:26:36.284470+0000","last_became_peered":"2024-09-10T06:26:36.284470+0000","last_unstale":"2024-09-10T06:28:48.374806+0000","last_undegraded":"2024-09-10T06:28:48.374806+0000","last_fullsized":"2024-09-10T06:28:48.374806+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:44.280458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456833+0000","last_change":"2024-09-10T06:26:38.303425+0000","last_active":"2024-09-10T06:28:48.456833+0000","last_peered":"2024-09-10T06:28:48.456833+0000","last_clean":"2024-09-10T06:28:48.456833+0000","last_became_active":"2024-09-10T06:26:38.302606+0000","last_became_peered":"2024-09-10T06:26:38.302606+0000","last_unstale":"2024-09-10T06:28:48.456833+0000","last_undegraded":"2024-09-10T06:28:48.456833+0000","last_fullsized":"2024-09-10T06:28:48.456833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:14.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"76'13","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379222+0000","last_change":"2024-09-10T06:26:40.311253+0000","last_active":"2024-09-10T06:28:48.379222+0000","last_peered":"2024-09-10T06:28:48.379222+0000","last_clean":"2024-09-10T06:28:48.379222+0000","last_became_active":"2024-09-10T06:26:40.310414+0000","last_became_peered":"2024-09-10T06:26:40.310414+0000","last_unstale":"2024-09-10T06:28:48.379222+0000","last_undegraded":"2024-09-10T06:28:48.379222+0000","last_fullsized":"2024-09-10T06:28:48.379222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:20.868195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375885+0000","last_change":"2024-09-10T06:26:32.262972+0000","last_active":"2024-09-10T06:28:48.375885+0000","last_peered":"2024-09-10T06:28:48.375885+0000","last_clean":"2024-09-10T06:28:48.375885+0000","last_became_active":"2024-09-10T06:26:32.262469+0000","last_became_peered":"2024-09-10T06:26:32.262469+0000","last_unstale":"2024-09-10T06:28:48.375885+0000","last_undegraded":"2024-09-10T06:28:48.375885+0000","last_fullsized":"2024-09-10T06:28:48.375885+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"72'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379565+0000","last_change":"2024-09-10T06:26:30.602013+0000","last_active":"2024-09-10T06:28:48.379565+0000","last_peered":"2024-09-10T06:28:48.379565+0000","last_clean":"2024-09-10T06:28:48.379565+0000","last_became_active":"2024-09-10T06:26:30.601672+0000","last_became_peered":"2024-09-10T06:26:30.601672+0000","last_unstale":"2024-09-10T06:28:48.379565+0000","last_undegraded":"2024-09-10T06:28:48.379565+0000","last_fullsized":"2024-09-10T06:28:48.379565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:52.012063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376473+0000","last_change":"2024-09-10T06:26:34.277010+0000","last_active":"2024-09-10T06:28:48.376473+0000","last_peered":"2024-09-10T06:28:48.376473+0000","last_clean":"2024-09-10T06:28:48.376473+0000","last_became_active":"2024-09-10T06:26:34.276197+0000","last_became_peered":"2024-09-10T06:26:34.276197+0000","last_unstale":"2024-09-10T06:28:48.376473+0000","last_undegraded":"2024-09-10T06:28:48.376473+0000","last_fullsized":"2024-09-10T06:28:48.376473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:32.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"76'11","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378266+0000","last_change":"2024-09-10T06:26:36.297514+0000","last_active":"2024-09-10T06:28:48.378266+0000","last_peered":"2024-09-10T06:28:48.378266+0000","last_clean":"2024-09-10T06:28:48.378266+0000","last_became_active":"2024-09-10T06:26:36.296615+0000","last_became_peered":"2024-09-10T06:26:36.296615+0000","last_unstale":"2024-09-10T06:28:48.378266+0000","last_undegraded":"2024-09-10T06:28:48.378266+0000","last_fullsized":"2024-09-10T06:28:48.378266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376508+0000","last_change":"2024-09-10T06:26:38.288794+0000","last_active":"2024-09-10T06:28:48.376508+0000","last_peered":"2024-09-10T06:28:48.376508+0000","last_clean":"2024-09-10T06:28:48.376508+0000","last_became_active":"2024-09-10T06:26:38.288055+0000","last_became_peered":"2024-09-10T06:26:38.288055+0000","last_unstale":"2024-09-10T06:28:48.376508+0000","last_undegraded":"2024-09-10T06:28:48.376508+0000","last_fullsized":"2024-09-10T06:28:48.376508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463498+0000","last_change":"2024-09-10T06:26:40.318067+0000","last_active":"2024-09-10T06:28:48.463498+0000","last_peered":"2024-09-10T06:28:48.463498+0000","last_clean":"2024-09-10T06:28:48.463498+0000","last_became_active":"2024-09-10T06:26:40.317244+0000","last_became_peered":"2024-09-10T06:26:40.317244+0000","last_unstale":"2024-09-10T06:28:48.463498+0000","last_undegraded":"2024-09-10T06:28:48.463498+0000","last_fullsized":"2024-09-10T06:28:48.463498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"76'2","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377260+0000","last_change":"2024-09-10T06:26:32.277908+0000","last_active":"2024-09-10T06:28:48.377260+0000","last_peered":"2024-09-10T06:28:48.377260+0000","last_clean":"2024-09-10T06:28:48.377260+0000","last_became_active":"2024-09-10T06:26:32.274812+0000","last_became_peered":"2024-09-10T06:26:32.274812+0000","last_unstale":"2024-09-10T06:28:48.377260+0000","last_undegraded":"2024-09-10T06:28:48.377260+0000","last_fullsized":"2024-09-10T06:28:48.377260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:37.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"73'10","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378238+0000","last_change":"2024-09-10T06:26:30.594013+0000","last_active":"2024-09-10T06:28:48.378238+0000","last_peered":"2024-09-10T06:28:48.378238+0000","last_clean":"2024-09-10T06:28:48.378238+0000","last_became_active":"2024-09-10T06:26:30.593687+0000","last_became_peered":"2024-09-10T06:26:30.593687+0000","last_unstale":"2024-09-10T06:28:48.378238+0000","last_undegraded":"2024-09-10T06:28:48.378238+0000","last_fullsized":"2024-09-10T06:28:48.378238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:37.375037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453204+0000","last_change":"2024-09-10T06:26:34.283392+0000","last_active":"2024-09-10T06:28:48.453204+0000","last_peered":"2024-09-10T06:28:48.453204+0000","last_clean":"2024-09-10T06:28:48.453204+0000","last_became_active":"2024-09-10T06:26:34.282931+0000","last_became_peered":"2024-09-10T06:26:34.282931+0000","last_unstale":"2024-09-10T06:28:48.453204+0000","last_undegraded":"2024-09-10T06:28:48.453204+0000","last_fullsized":"2024-09-10T06:28:48.453204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:01.310719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"76'15","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376888+0000","last_change":"2024-09-10T06:26:36.289834+0000","last_active":"2024-09-10T06:28:48.376888+0000","last_peered":"2024-09-10T06:28:48.376888+0000","last_clean":"2024-09-10T06:28:48.376888+0000","last_became_active":"2024-09-10T06:26:36.289033+0000","last_became_peered":"2024-09-10T06:26:36.289033+0000","last_unstale":"2024-09-10T06:28:48.376888+0000","last_undegraded":"2024-09-10T06:28:48.376888+0000","last_fullsized":"2024-09-10T06:28:48.376888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375946+0000","last_change":"2024-09-10T06:26:38.299568+0000","last_active":"2024-09-10T06:28:48.375946+0000","last_peered":"2024-09-10T06:28:48.375946+0000","last_clean":"2024-09-10T06:28:48.375946+0000","last_became_active":"2024-09-10T06:26:38.298779+0000","last_became_peered":"2024-09-10T06:26:38.298779+0000","last_unstale":"2024-09-10T06:28:48.375946+0000","last_undegraded":"2024-09-10T06:28:48.375946+0000","last_fullsized":"2024-09-10T06:28:48.375946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380965+0000","last_change":"2024-09-10T06:26:40.336329+0000","last_active":"2024-09-10T06:28:48.380965+0000","last_peered":"2024-09-10T06:28:48.380965+0000","last_clean":"2024-09-10T06:28:48.380965+0000","last_became_active":"2024-09-10T06:26:40.335348+0000","last_became_peered":"2024-09-10T06:26:40.335348+0000","last_unstale":"2024-09-10T06:28:48.380965+0000","last_undegraded":"2024-09-10T06:28:48.380965+0000","last_fullsized":"2024-09-10T06:28:48.380965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:40.653642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"62'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454263+0000","last_change":"2024-09-10T06:26:32.276392+0000","last_active":"2024-09-10T06:28:48.454263+0000","last_peered":"2024-09-10T06:28:48.454263+0000","last_clean":"2024-09-10T06:28:48.454263+0000","last_became_active":"2024-09-10T06:26:32.275855+0000","last_became_peered":"2024-09-10T06:26:32.275855+0000","last_unstale":"2024-09-10T06:28:48.454263+0000","last_undegraded":"2024-09-10T06:28:48.454263+0000","last_fullsized":"2024-09-10T06:28:48.454263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:34.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"73'11","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456654+0000","last_change":"2024-09-10T06:26:30.591577+0000","last_active":"2024-09-10T06:28:48.456654+0000","last_peered":"2024-09-10T06:28:48.456654+0000","last_clean":"2024-09-10T06:28:48.456654+0000","last_became_active":"2024-09-10T06:26:30.590801+0000","last_became_peered":"2024-09-10T06:26:30.590801+0000","last_unstale":"2024-09-10T06:28:48.456654+0000","last_undegraded":"2024-09-10T06:28:48.456654+0000","last_fullsized":"2024-09-10T06:28:48.456654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:16.066664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453895+0000","last_change":"2024-09-10T06:26:32.268621+0000","last_active":"2024-09-10T06:28:48.453895+0000","last_peered":"2024-09-10T06:28:48.453895+0000","last_clean":"2024-09-10T06:28:48.453895+0000","last_became_active":"2024-09-10T06:26:32.267915+0000","last_became_peered":"2024-09-10T06:26:32.267915+0000","last_unstale":"2024-09-10T06:28:48.453895+0000","last_undegraded":"2024-09-10T06:28:48.453895+0000","last_fullsized":"2024-09-10T06:28:48.453895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:10.670492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"73'10","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452875+0000","last_change":"2024-09-10T06:26:30.593794+0000","last_active":"2024-09-10T06:28:48.452875+0000","last_peered":"2024-09-10T06:28:48.452875+0000","last_clean":"2024-09-10T06:28:48.452875+0000","last_became_active":"2024-09-10T06:26:30.593506+0000","last_became_peered":"2024-09-10T06:26:30.593506+0000","last_unstale":"2024-09-10T06:28:48.452875+0000","last_undegraded":"2024-09-10T06:28:48.452875+0000","last_fullsized":"2024-09-10T06:28:48.452875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:29.521578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'6","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459260+0000","last_change":"2024-09-10T06:26:32.288497+0000","last_active":"2024-09-10T06:28:48.459260+0000","last_peered":"2024-09-10T06:28:48.459260+0000","last_clean":"2024-09-10T06:28:48.459260+0000","last_became_active":"2024-09-10T06:26:32.287839+0000","last_became_peered":"2024-09-10T06:26:32.287839+0000","last_unstale":"2024-09-10T06:28:48.459260+0000","last_undegraded":"2024-09-10T06:28:48.459260+0000","last_fullsized":"2024-09-10T06:28:48.459260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"72'5","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454219+0000","last_change":"2024-09-10T06:28:09.627267+0000","last_active":"2024-09-10T06:28:48.454219+0000","last_peered":"2024-09-10T06:28:48.454219+0000","last_clean":"2024-09-10T06:28:48.454219+0000","last_became_active":"2024-09-10T06:28:09.544344+0000","last_became_peered":"2024-09-10T06:28:09.544344+0000","last_unstale":"2024-09-10T06:28:48.454219+0000","last_undegraded":"2024-09-10T06:28:48.454219+0000","last_fullsized":"2024-09-10T06:28:48.454219+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:57.591444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"62'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454143+0000","last_change":"2024-09-10T06:26:32.272921+0000","last_active":"2024-09-10T06:28:48.454143+0000","last_peered":"2024-09-10T06:28:48.454143+0000","last_clean":"2024-09-10T06:28:48.454143+0000","last_became_active":"2024-09-10T06:26:32.272279+0000","last_became_peered":"2024-09-10T06:26:32.272279+0000","last_unstale":"2024-09-10T06:28:48.454143+0000","last_undegraded":"2024-09-10T06:28:48.454143+0000","last_fullsized":"2024-09-10T06:28:48.454143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:11.951551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"73'12","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376254+0000","last_change":"2024-09-10T06:26:30.579541+0000","last_active":"2024-09-10T06:28:48.376254+0000","last_peered":"2024-09-10T06:28:48.376254+0000","last_clean":"2024-09-10T06:28:48.376254+0000","last_became_active":"2024-09-10T06:26:30.579189+0000","last_became_peered":"2024-09-10T06:26:30.579189+0000","last_unstale":"2024-09-10T06:28:48.376254+0000","last_undegraded":"2024-09-10T06:28:48.376254+0000","last_fullsized":"2024-09-10T06:28:48.376254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:18.099885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377659+0000","last_change":"2024-09-10T06:26:32.260098+0000","last_active":"2024-09-10T06:28:48.377659+0000","last_peered":"2024-09-10T06:28:48.377659+0000","last_clean":"2024-09-10T06:28:48.377659+0000","last_became_active":"2024-09-10T06:26:32.259644+0000","last_became_peered":"2024-09-10T06:26:32.259644+0000","last_unstale":"2024-09-10T06:28:48.377659+0000","last_undegraded":"2024-09-10T06:28:48.377659+0000","last_fullsized":"2024-09-10T06:28:48.377659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"72'11","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378625+0000","last_change":"2024-09-10T06:26:30.576146+0000","last_active":"2024-09-10T06:28:48.378625+0000","last_peered":"2024-09-10T06:28:48.378625+0000","last_clean":"2024-09-10T06:28:48.378625+0000","last_became_active":"2024-09-10T06:26:30.575605+0000","last_became_peered":"2024-09-10T06:26:30.575605+0000","last_unstale":"2024-09-10T06:28:48.378625+0000","last_undegraded":"2024-09-10T06:28:48.378625+0000","last_fullsized":"2024-09-10T06:28:48.378625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"76'10","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378536+0000","last_change":"2024-09-10T06:26:32.277577+0000","last_active":"2024-09-10T06:28:48.378536+0000","last_peered":"2024-09-10T06:28:48.378536+0000","last_clean":"2024-09-10T06:28:48.378536+0000","last_became_active":"2024-09-10T06:26:32.272454+0000","last_became_peered":"2024-09-10T06:26:32.272454+0000","last_unstale":"2024-09-10T06:28:48.378536+0000","last_undegraded":"2024-09-10T06:28:48.378536+0000","last_fullsized":"2024-09-10T06:28:48.378536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"73'6","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454604+0000","last_change":"2024-09-10T06:26:30.579134+0000","last_active":"2024-09-10T06:28:48.454604+0000","last_peered":"2024-09-10T06:28:48.454604+0000","last_clean":"2024-09-10T06:28:48.454604+0000","last_became_active":"2024-09-10T06:26:30.578732+0000","last_became_peered":"2024-09-10T06:26:30.578732+0000","last_unstale":"2024-09-10T06:28:48.454604+0000","last_undegraded":"2024-09-10T06:28:48.454604+0000","last_fullsized":"2024-09-10T06:28:48.454604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:08.832907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375228+0000","last_change":"2024-09-10T06:26:32.270804+0000","last_active":"2024-09-10T06:28:48.375228+0000","last_peered":"2024-09-10T06:28:48.375228+0000","last_clean":"2024-09-10T06:28:48.375228+0000","last_became_active":"2024-09-10T06:26:32.270327+0000","last_became_peered":"2024-09-10T06:26:32.270327+0000","last_unstale":"2024-09-10T06:28:48.375228+0000","last_undegraded":"2024-09-10T06:28:48.375228+0000","last_fullsized":"2024-09-10T06:28:48.375228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"72'6","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459860+0000","last_change":"2024-09-10T06:26:30.598004+0000","last_active":"2024-09-10T06:28:48.459860+0000","last_peered":"2024-09-10T06:28:48.459860+0000","last_clean":"2024-09-10T06:28:48.459860+0000","last_became_active":"2024-09-10T06:26:30.596254+0000","last_became_peered":"2024-09-10T06:26:30.596254+0000","last_unstale":"2024-09-10T06:28:48.459860+0000","last_undegraded":"2024-09-10T06:28:48.459860+0000","last_fullsized":"2024-09-10T06:28:48.459860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'2","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456398+0000","last_change":"2024-09-10T06:26:32.284215+0000","last_active":"2024-09-10T06:28:48.456398+0000","last_peered":"2024-09-10T06:28:48.456398+0000","last_clean":"2024-09-10T06:28:48.456398+0000","last_became_active":"2024-09-10T06:26:32.275133+0000","last_became_peered":"2024-09-10T06:26:32.275133+0000","last_unstale":"2024-09-10T06:28:48.456398+0000","last_undegraded":"2024-09-10T06:28:48.456398+0000","last_fullsized":"2024-09-10T06:28:48.456398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:37.703268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"73'9","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379658+0000","last_change":"2024-09-10T06:26:30.580586+0000","last_active":"2024-09-10T06:28:48.379658+0000","last_peered":"2024-09-10T06:28:48.379658+0000","last_clean":"2024-09-10T06:28:48.379658+0000","last_became_active":"2024-09-10T06:26:30.580134+0000","last_became_peered":"2024-09-10T06:26:30.580134+0000","last_unstale":"2024-09-10T06:28:48.379658+0000","last_undegraded":"2024-09-10T06:28:48.379658+0000","last_fullsized":"2024-09-10T06:28:48.379658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378184+0000","last_change":"2024-09-10T06:26:32.256538+0000","last_active":"2024-09-10T06:28:48.378184+0000","last_peered":"2024-09-10T06:28:48.378184+0000","last_clean":"2024-09-10T06:28:48.378184+0000","last_became_active":"2024-09-10T06:26:32.256052+0000","last_became_peered":"2024-09-10T06:26:32.256052+0000","last_unstale":"2024-09-10T06:28:48.378184+0000","last_undegraded":"2024-09-10T06:28:48.378184+0000","last_fullsized":"2024-09-10T06:28:48.378184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:14.620472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"73'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457141+0000","last_change":"2024-09-10T06:26:30.585220+0000","last_active":"2024-09-10T06:28:48.457141+0000","last_peered":"2024-09-10T06:28:48.457141+0000","last_clean":"2024-09-10T06:28:48.457141+0000","last_became_active":"2024-09-10T06:26:30.584443+0000","last_became_peered":"2024-09-10T06:26:30.584443+0000","last_unstale":"2024-09-10T06:28:48.457141+0000","last_undegraded":"2024-09-10T06:28:48.457141+0000","last_fullsized":"2024-09-10T06:28:48.457141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380315+0000","last_change":"2024-09-10T06:26:32.259306+0000","last_active":"2024-09-10T06:28:48.380315+0000","last_peered":"2024-09-10T06:28:48.380315+0000","last_clean":"2024-09-10T06:28:48.380315+0000","last_became_active":"2024-09-10T06:26:32.258513+0000","last_became_peered":"2024-09-10T06:26:32.258513+0000","last_unstale":"2024-09-10T06:28:48.380315+0000","last_undegraded":"2024-09-10T06:28:48.380315+0000","last_fullsized":"2024-09-10T06:28:48.380315+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"73'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376110+0000","last_change":"2024-09-10T06:26:30.581285+0000","last_active":"2024-09-10T06:28:48.376110+0000","last_peered":"2024-09-10T06:28:48.376110+0000","last_clean":"2024-09-10T06:28:48.376110+0000","last_became_active":"2024-09-10T06:26:30.580913+0000","last_became_peered":"2024-09-10T06:26:30.580913+0000","last_unstale":"2024-09-10T06:28:48.376110+0000","last_undegraded":"2024-09-10T06:28:48.376110+0000","last_fullsized":"2024-09-10T06:28:48.376110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"76'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455519+0000","last_change":"2024-09-10T06:26:32.274773+0000","last_active":"2024-09-10T06:28:48.455519+0000","last_peered":"2024-09-10T06:28:48.455519+0000","last_clean":"2024-09-10T06:28:48.455519+0000","last_became_active":"2024-09-10T06:26:32.274327+0000","last_became_peered":"2024-09-10T06:26:32.274327+0000","last_unstale":"2024-09-10T06:28:48.455519+0000","last_undegraded":"2024-09-10T06:28:48.455519+0000","last_fullsized":"2024-09-10T06:28:48.455519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:54.026434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"73'6","reported_seq":122,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454426+0000","last_change":"2024-09-10T06:27:08.592940+0000","last_active":"2024-09-10T06:28:48.454426+0000","last_peered":"2024-09-10T06:28:48.454426+0000","last_clean":"2024-09-10T06:28:48.454426+0000","last_became_active":"2024-09-10T06:27:08.592637+0000","last_became_peered":"2024-09-10T06:27:08.592637+0000","last_unstale":"2024-09-10T06:28:48.454426+0000","last_undegraded":"2024-09-10T06:28:48.454426+0000","last_fullsized":"2024-09-10T06:28:48.454426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:06.335302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380493+0000","last_change":"2024-09-10T06:26:32.279474+0000","last_active":"2024-09-10T06:28:48.380493+0000","last_peered":"2024-09-10T06:28:48.380493+0000","last_clean":"2024-09-10T06:28:48.380493+0000","last_became_active":"2024-09-10T06:26:32.278461+0000","last_became_peered":"2024-09-10T06:26:32.278461+0000","last_unstale":"2024-09-10T06:28:48.380493+0000","last_undegraded":"2024-09-10T06:28:48.380493+0000","last_fullsized":"2024-09-10T06:28:48.380493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"73'8","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376355+0000","last_change":"2024-09-10T06:26:30.605519+0000","last_active":"2024-09-10T06:28:48.376355+0000","last_peered":"2024-09-10T06:28:48.376355+0000","last_clean":"2024-09-10T06:28:48.376355+0000","last_became_active":"2024-09-10T06:26:30.605225+0000","last_became_peered":"2024-09-10T06:26:30.605225+0000","last_unstale":"2024-09-10T06:28:48.376355+0000","last_undegraded":"2024-09-10T06:28:48.376355+0000","last_fullsized":"2024-09-10T06:28:48.376355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"64'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462698+0000","last_change":"2024-09-10T06:26:32.267201+0000","last_active":"2024-09-10T06:28:48.462698+0000","last_peered":"2024-09-10T06:28:48.462698+0000","last_clean":"2024-09-10T06:28:48.462698+0000","last_became_active":"2024-09-10T06:26:32.266234+0000","last_became_peered":"2024-09-10T06:26:32.266234+0000","last_unstale":"2024-09-10T06:28:48.462698+0000","last_undegraded":"2024-09-10T06:28:48.462698+0000","last_fullsized":"2024-09-10T06:28:48.462698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"72'10","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458276+0000","last_change":"2024-09-10T06:26:30.596647+0000","last_active":"2024-09-10T06:28:48.458276+0000","last_peered":"2024-09-10T06:28:48.458276+0000","last_clean":"2024-09-10T06:28:48.458276+0000","last_became_active":"2024-09-10T06:26:30.593598+0000","last_became_peered":"2024-09-10T06:26:30.593598+0000","last_unstale":"2024-09-10T06:28:48.458276+0000","last_undegraded":"2024-09-10T06:28:48.458276+0000","last_fullsized":"2024-09-10T06:28:48.458276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"76'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375198+0000","last_change":"2024-09-10T06:26:32.278317+0000","last_active":"2024-09-10T06:28:48.375198+0000","last_peered":"2024-09-10T06:28:48.375198+0000","last_clean":"2024-09-10T06:28:48.375198+0000","last_became_active":"2024-09-10T06:26:32.278032+0000","last_became_peered":"2024-09-10T06:26:32.278032+0000","last_unstale":"2024-09-10T06:28:48.375198+0000","last_undegraded":"2024-09-10T06:28:48.375198+0000","last_fullsized":"2024-09-10T06:28:48.375198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:00.200118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"72'9","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464311+0000","last_change":"2024-09-10T06:26:30.580552+0000","last_active":"2024-09-10T06:28:48.464311+0000","last_peered":"2024-09-10T06:28:48.464311+0000","last_clean":"2024-09-10T06:28:48.464311+0000","last_became_active":"2024-09-10T06:26:30.579319+0000","last_became_peered":"2024-09-10T06:26:30.579319+0000","last_unstale":"2024-09-10T06:28:48.464311+0000","last_undegraded":"2024-09-10T06:28:48.464311+0000","last_fullsized":"2024-09-10T06:28:48.464311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:59.885311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"67'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375088+0000","last_change":"2024-09-10T06:26:32.257601+0000","last_active":"2024-09-10T06:28:48.375088+0000","last_peered":"2024-09-10T06:28:48.375088+0000","last_clean":"2024-09-10T06:28:48.375088+0000","last_became_active":"2024-09-10T06:26:32.256851+0000","last_became_peered":"2024-09-10T06:26:32.256851+0000","last_unstale":"2024-09-10T06:28:48.375088+0000","last_undegraded":"2024-09-10T06:28:48.375088+0000","last_fullsized":"2024-09-10T06:28:48.375088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"73'12","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455655+0000","last_change":"2024-09-10T06:28:47.047609+0000","last_active":"2024-09-10T06:28:48.455655+0000","last_peered":"2024-09-10T06:28:48.455655+0000","last_clean":"2024-09-10T06:28:48.455655+0000","last_became_active":"2024-09-10T06:28:46.326501+0000","last_became_peered":"2024-09-10T06:28:46.326501+0000","last_unstale":"2024-09-10T06:28:48.455655+0000","last_undegraded":"2024-09-10T06:28:48.455655+0000","last_fullsized":"2024-09-10T06:28:48.455655+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:33.793329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"62'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455403+0000","last_change":"2024-09-10T06:26:32.266768+0000","last_active":"2024-09-10T06:28:48.455403+0000","last_peered":"2024-09-10T06:28:48.455403+0000","last_clean":"2024-09-10T06:28:48.455403+0000","last_became_active":"2024-09-10T06:26:32.266000+0000","last_became_peered":"2024-09-10T06:26:32.266000+0000","last_unstale":"2024-09-10T06:28:48.455403+0000","last_undegraded":"2024-09-10T06:28:48.455403+0000","last_fullsized":"2024-09-10T06:28:48.455403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"72'9","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460809+0000","last_change":"2024-09-10T06:26:30.610309+0000","last_active":"2024-09-10T06:28:48.460809+0000","last_peered":"2024-09-10T06:28:48.460809+0000","last_clean":"2024-09-10T06:28:48.460809+0000","last_became_active":"2024-09-10T06:26:30.609674+0000","last_became_peered":"2024-09-10T06:26:30.609674+0000","last_unstale":"2024-09-10T06:28:48.460809+0000","last_undegraded":"2024-09-10T06:28:48.460809+0000","last_fullsized":"2024-09-10T06:28:48.460809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"73'10","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457073+0000","last_change":"2024-09-10T06:26:30.591365+0000","last_active":"2024-09-10T06:28:48.457073+0000","last_peered":"2024-09-10T06:28:48.457073+0000","last_clean":"2024-09-10T06:28:48.457073+0000","last_became_active":"2024-09-10T06:26:30.590640+0000","last_became_peered":"2024-09-10T06:26:30.590640+0000","last_unstale":"2024-09-10T06:28:48.457073+0000","last_undegraded":"2024-09-10T06:28:48.457073+0000","last_fullsized":"2024-09-10T06:28:48.457073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"67'10","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378124+0000","last_change":"2024-09-10T06:26:32.267333+0000","last_active":"2024-09-10T06:28:48.378124+0000","last_peered":"2024-09-10T06:28:48.378124+0000","last_clean":"2024-09-10T06:28:48.378124+0000","last_became_active":"2024-09-10T06:26:32.266876+0000","last_became_peered":"2024-09-10T06:26:32.266876+0000","last_unstale":"2024-09-10T06:28:48.378124+0000","last_undegraded":"2024-09-10T06:28:48.378124+0000","last_fullsized":"2024-09-10T06:28:48.378124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:02.483639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"73'13","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453736+0000","last_change":"2024-09-10T06:26:30.590924+0000","last_active":"2024-09-10T06:28:48.453736+0000","last_peered":"2024-09-10T06:28:48.453736+0000","last_clean":"2024-09-10T06:28:48.453736+0000","last_became_active":"2024-09-10T06:26:30.590415+0000","last_became_peered":"2024-09-10T06:26:30.590415+0000","last_unstale":"2024-09-10T06:28:48.453736+0000","last_undegraded":"2024-09-10T06:28:48.453736+0000","last_fullsized":"2024-09-10T06:28:48.453736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:32.460291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460280+0000","last_change":"2024-09-10T06:26:32.283339+0000","last_active":"2024-09-10T06:28:48.460280+0000","last_peered":"2024-09-10T06:28:48.460280+0000","last_clean":"2024-09-10T06:28:48.460280+0000","last_became_active":"2024-09-10T06:26:32.282581+0000","last_became_peered":"2024-09-10T06:26:32.282581+0000","last_unstale":"2024-09-10T06:28:48.460280+0000","last_undegraded":"2024-09-10T06:28:48.460280+0000","last_fullsized":"2024-09-10T06:28:48.460280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":808,"ondisk_log_size":808,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":160287,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":814,"num_read_kb":573,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":272742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":667,"ondisk_log_size":667,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":334,"num_read_kb":334,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":567,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":632,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":209715200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":651444,"kb_used_data":620252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93720396,"statfs":{"total":96636764160,"available":95969685504,"internally_reserved":0,"allocated":635138048,"data_stored":634594233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536128,"kb_used_data":504936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93835712,"statfs":{"total":96636764160,"available":96087769088,"internally_reserved":0,"allocated":517054464,"data_stored":516546322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542180,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":700076,"kb_used_data":668884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93671764,"statfs":{"total":96636764160,"available":95919886336,"internally_reserved":0,"allocated":684937216,"data_stored":684376545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757300,"kb_used_data":726108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93614540,"statfs":{"total":96636764160,"available":95861288960,"internally_reserved":0,"allocated":743534592,"data_stored":743038236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542180,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":710352,"kb_used_data":679160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93661488,"statfs":{"total":96636764160,"available":95909363712,"internally_reserved":0,"allocated":695459840,"data_stored":694924989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542180,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":433720,"kb_used_data":402528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93938120,"statfs":{"total":96636764160,"available":96192634880,"internally_reserved":0,"allocated":412188672,"data_stored":411692893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542180,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":439884,"kb_used_data":408696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93931956,"statfs":{"total":96636764160,"available":96186322944,"internally_reserved":0,"allocated":418504704,"data_stored":417979454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":712908,"kb_used_data":681716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93658932,"statfs":{"total":96636764160,"available":95906746368,"internally_reserved":0,"allocated":698077184,"data_stored":697554526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":696254464,"data_stored":696254464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":417333248,"data_stored":417333248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":411041792,"data_stored":411041792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":694157312,"data_stored":694157312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":742391808,"data_stored":742391808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":683671552,"data_stored":683671552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":515899392,"data_stored":515899392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":633339904,"data_stored":633339904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":122118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":59667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":18838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:28:52.306 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-10T06:28:52.306 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-10T06:28:52.628 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-10T06:28:52.637 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-10T06:28:52.638 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:28:52.638 INFO:tasks.rgw.client.0.smithi112.stdout:2024-09-10T06:28:52.638+0000 7f8788954640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 32590) UID: 0 2024-09-10T06:28:52.638 INFO:tasks.rgw.client.0.smithi112.stdout:2024-09-10T06:28:52.638+0000 7f878c19ca40 -1 shutting down 2024-09-10T06:29:15.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-10T06:29:17.045 INFO:tasks.rgw.client.0:Stopped 2024-09-10T06:29:17.045 DEBUG:teuthology.orchestra.run.smithi112:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-10T06:29:17.052 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /etc/ceph/vault-root-token 2024-09-10T06:29:17.107 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-10T06:29:17.162 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-10T06:29:17.162 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-10T06:29:17.162 DEBUG:teuthology.orchestra.run.smithi112:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-10T06:29:17.965 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T06:29:17.975 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T06:29:17.976 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:29:18.314 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:29:18.320 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:29:18.331 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-10T06:29:17.473405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397797023,"num_objects":772,"num_object_clones":0,"num_object_copies":1544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":772,"num_whiteouts":0,"num_read":2073,"num_read_kb":1782,"num_write":1669,"num_write_kb":2367363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":209715508,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2483,"ondisk_log_size":2483,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4941768,"kb_used_data":4692280,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":750032952,"statfs":{"total":773094113280,"available":768033742848,"internally_reserved":0,"allocated":4804894720,"data_stored":4800707198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005735"},"pg_stats":[{"pgid":"3.3f","version":"73'12","reported_seq":127,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454157+0000","last_change":"2024-09-10T06:27:08.597414+0000","last_active":"2024-09-10T06:28:48.454157+0000","last_peered":"2024-09-10T06:28:48.454157+0000","last_clean":"2024-09-10T06:28:48.454157+0000","last_became_active":"2024-09-10T06:27:08.597026+0000","last_became_peered":"2024-09-10T06:27:08.597026+0000","last_unstale":"2024-09-10T06:28:48.454157+0000","last_undegraded":"2024-09-10T06:28:48.454157+0000","last_fullsized":"2024-09-10T06:28:48.454157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:07.484952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"67'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456583+0000","last_change":"2024-09-10T06:26:32.279882+0000","last_active":"2024-09-10T06:28:48.456583+0000","last_peered":"2024-09-10T06:28:48.456583+0000","last_clean":"2024-09-10T06:28:48.456583+0000","last_became_active":"2024-09-10T06:26:32.279098+0000","last_became_peered":"2024-09-10T06:26:32.279098+0000","last_unstale":"2024-09-10T06:28:48.456583+0000","last_undegraded":"2024-09-10T06:28:48.456583+0000","last_fullsized":"2024-09-10T06:28:48.456583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"72'5","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454007+0000","last_change":"2024-09-10T06:26:30.573148+0000","last_active":"2024-09-10T06:28:48.454007+0000","last_peered":"2024-09-10T06:28:48.454007+0000","last_clean":"2024-09-10T06:28:48.454007+0000","last_became_active":"2024-09-10T06:26:30.572798+0000","last_became_peered":"2024-09-10T06:26:30.572798+0000","last_unstale":"2024-09-10T06:28:48.454007+0000","last_undegraded":"2024-09-10T06:28:48.454007+0000","last_fullsized":"2024-09-10T06:28:48.454007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:38.833715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"62'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457162+0000","last_change":"2024-09-10T06:26:32.276811+0000","last_active":"2024-09-10T06:28:48.457162+0000","last_peered":"2024-09-10T06:28:48.457162+0000","last_clean":"2024-09-10T06:28:48.457162+0000","last_became_active":"2024-09-10T06:26:32.275990+0000","last_became_peered":"2024-09-10T06:26:32.275990+0000","last_unstale":"2024-09-10T06:28:48.457162+0000","last_undegraded":"2024-09-10T06:28:48.457162+0000","last_fullsized":"2024-09-10T06:28:48.457162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"72'10","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377820+0000","last_change":"2024-09-10T06:26:30.578068+0000","last_active":"2024-09-10T06:28:48.377820+0000","last_peered":"2024-09-10T06:28:48.377820+0000","last_clean":"2024-09-10T06:28:48.377820+0000","last_became_active":"2024-09-10T06:26:30.577688+0000","last_became_peered":"2024-09-10T06:26:30.577688+0000","last_unstale":"2024-09-10T06:28:48.377820+0000","last_undegraded":"2024-09-10T06:28:48.377820+0000","last_fullsized":"2024-09-10T06:28:48.377820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:34.137079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377720+0000","last_change":"2024-09-10T06:26:32.256939+0000","last_active":"2024-09-10T06:28:48.377720+0000","last_peered":"2024-09-10T06:28:48.377720+0000","last_clean":"2024-09-10T06:28:48.377720+0000","last_became_active":"2024-09-10T06:26:32.256117+0000","last_became_peered":"2024-09-10T06:26:32.256117+0000","last_unstale":"2024-09-10T06:28:48.377720+0000","last_undegraded":"2024-09-10T06:28:48.377720+0000","last_fullsized":"2024-09-10T06:28:48.377720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:51.879604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"73'11","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461567+0000","last_change":"2024-09-10T06:26:30.593697+0000","last_active":"2024-09-10T06:28:48.461567+0000","last_peered":"2024-09-10T06:28:48.461567+0000","last_clean":"2024-09-10T06:28:48.461567+0000","last_became_active":"2024-09-10T06:26:30.591807+0000","last_became_peered":"2024-09-10T06:26:30.591807+0000","last_unstale":"2024-09-10T06:28:48.461567+0000","last_undegraded":"2024-09-10T06:28:48.461567+0000","last_fullsized":"2024-09-10T06:28:48.461567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376230+0000","last_change":"2024-09-10T06:26:32.264685+0000","last_active":"2024-09-10T06:28:48.376230+0000","last_peered":"2024-09-10T06:28:48.376230+0000","last_clean":"2024-09-10T06:28:48.376230+0000","last_became_active":"2024-09-10T06:26:32.264199+0000","last_became_peered":"2024-09-10T06:26:32.264199+0000","last_unstale":"2024-09-10T06:28:48.376230+0000","last_undegraded":"2024-09-10T06:28:48.376230+0000","last_fullsized":"2024-09-10T06:28:48.376230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:20.713066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"72'7","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457396+0000","last_change":"2024-09-10T06:28:09.653122+0000","last_active":"2024-09-10T06:28:48.457396+0000","last_peered":"2024-09-10T06:28:48.457396+0000","last_clean":"2024-09-10T06:28:48.457396+0000","last_became_active":"2024-09-10T06:28:09.546624+0000","last_became_peered":"2024-09-10T06:28:09.546624+0000","last_unstale":"2024-09-10T06:28:48.457396+0000","last_undegraded":"2024-09-10T06:28:48.457396+0000","last_fullsized":"2024-09-10T06:28:48.457396+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:57.805994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"67'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458405+0000","last_change":"2024-09-10T06:26:32.290741+0000","last_active":"2024-09-10T06:28:48.458405+0000","last_peered":"2024-09-10T06:28:48.458405+0000","last_clean":"2024-09-10T06:28:48.458405+0000","last_became_active":"2024-09-10T06:26:32.289840+0000","last_became_peered":"2024-09-10T06:26:32.289840+0000","last_unstale":"2024-09-10T06:28:48.458405+0000","last_undegraded":"2024-09-10T06:28:48.458405+0000","last_fullsized":"2024-09-10T06:28:48.458405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"73'6","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458886+0000","last_change":"2024-09-10T06:26:30.609817+0000","last_active":"2024-09-10T06:28:48.458886+0000","last_peered":"2024-09-10T06:28:48.458886+0000","last_clean":"2024-09-10T06:28:48.458886+0000","last_became_active":"2024-09-10T06:26:30.603330+0000","last_became_peered":"2024-09-10T06:26:30.603330+0000","last_unstale":"2024-09-10T06:28:48.458886+0000","last_undegraded":"2024-09-10T06:28:48.458886+0000","last_fullsized":"2024-09-10T06:28:48.458886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:09.523045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"67'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380006+0000","last_change":"2024-09-10T06:26:32.257050+0000","last_active":"2024-09-10T06:28:48.380006+0000","last_peered":"2024-09-10T06:28:48.380006+0000","last_clean":"2024-09-10T06:28:48.380006+0000","last_became_active":"2024-09-10T06:26:32.254437+0000","last_became_peered":"2024-09-10T06:26:32.254437+0000","last_unstale":"2024-09-10T06:28:48.380006+0000","last_undegraded":"2024-09-10T06:28:48.380006+0000","last_fullsized":"2024-09-10T06:28:48.380006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"72'14","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457637+0000","last_change":"2024-09-10T06:26:30.579756+0000","last_active":"2024-09-10T06:28:48.457637+0000","last_peered":"2024-09-10T06:28:48.457637+0000","last_clean":"2024-09-10T06:28:48.457637+0000","last_became_active":"2024-09-10T06:26:30.578033+0000","last_became_peered":"2024-09-10T06:26:30.578033+0000","last_unstale":"2024-09-10T06:28:48.457637+0000","last_undegraded":"2024-09-10T06:28:48.457637+0000","last_fullsized":"2024-09-10T06:28:48.457637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":22,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460066+0000","last_change":"2024-09-10T06:26:32.281248+0000","last_active":"2024-09-10T06:28:48.460066+0000","last_peered":"2024-09-10T06:28:48.460066+0000","last_clean":"2024-09-10T06:28:48.460066+0000","last_became_active":"2024-09-10T06:26:32.280480+0000","last_became_peered":"2024-09-10T06:26:32.280480+0000","last_unstale":"2024-09-10T06:28:48.460066+0000","last_undegraded":"2024-09-10T06:28:48.460066+0000","last_fullsized":"2024-09-10T06:28:48.460066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"73'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376021+0000","last_change":"2024-09-10T06:26:30.593213+0000","last_active":"2024-09-10T06:28:48.376021+0000","last_peered":"2024-09-10T06:28:48.376021+0000","last_clean":"2024-09-10T06:28:48.376021+0000","last_became_active":"2024-09-10T06:26:30.592770+0000","last_became_peered":"2024-09-10T06:26:30.592770+0000","last_unstale":"2024-09-10T06:28:48.376021+0000","last_undegraded":"2024-09-10T06:28:48.376021+0000","last_fullsized":"2024-09-10T06:28:48.376021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'10","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456049+0000","last_change":"2024-09-10T06:26:32.267430+0000","last_active":"2024-09-10T06:28:48.456049+0000","last_peered":"2024-09-10T06:28:48.456049+0000","last_clean":"2024-09-10T06:28:48.456049+0000","last_became_active":"2024-09-10T06:26:32.265788+0000","last_became_peered":"2024-09-10T06:26:32.265788+0000","last_unstale":"2024-09-10T06:28:48.456049+0000","last_undegraded":"2024-09-10T06:28:48.456049+0000","last_fullsized":"2024-09-10T06:28:48.456049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:19.180142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'10","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377130+0000","last_change":"2024-09-10T06:26:32.255038+0000","last_active":"2024-09-10T06:28:48.377130+0000","last_peered":"2024-09-10T06:28:48.377130+0000","last_clean":"2024-09-10T06:28:48.377130+0000","last_became_active":"2024-09-10T06:26:32.254281+0000","last_became_peered":"2024-09-10T06:26:32.254281+0000","last_unstale":"2024-09-10T06:28:48.377130+0000","last_undegraded":"2024-09-10T06:28:48.377130+0000","last_fullsized":"2024-09-10T06:28:48.377130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:46.363171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"73'9","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464675+0000","last_change":"2024-09-10T06:26:30.607280+0000","last_active":"2024-09-10T06:28:48.464675+0000","last_peered":"2024-09-10T06:28:48.464675+0000","last_clean":"2024-09-10T06:28:48.464675+0000","last_became_active":"2024-09-10T06:26:30.605602+0000","last_became_peered":"2024-09-10T06:26:30.605602+0000","last_unstale":"2024-09-10T06:28:48.464675+0000","last_undegraded":"2024-09-10T06:28:48.464675+0000","last_fullsized":"2024-09-10T06:28:48.464675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:49.865234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457377+0000","last_change":"2024-09-10T06:26:32.275913+0000","last_active":"2024-09-10T06:28:48.457377+0000","last_peered":"2024-09-10T06:28:48.457377+0000","last_clean":"2024-09-10T06:28:48.457377+0000","last_became_active":"2024-09-10T06:26:32.274264+0000","last_became_peered":"2024-09-10T06:26:32.274264+0000","last_unstale":"2024-09-10T06:28:48.457377+0000","last_undegraded":"2024-09-10T06:28:48.457377+0000","last_fullsized":"2024-09-10T06:28:48.457377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"72'5","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459316+0000","last_change":"2024-09-10T06:28:46.509018+0000","last_active":"2024-09-10T06:28:48.459316+0000","last_peered":"2024-09-10T06:28:48.459316+0000","last_clean":"2024-09-10T06:28:48.459316+0000","last_became_active":"2024-09-10T06:28:46.332355+0000","last_became_peered":"2024-09-10T06:28:46.332355+0000","last_unstale":"2024-09-10T06:28:48.459316+0000","last_undegraded":"2024-09-10T06:28:48.459316+0000","last_fullsized":"2024-09-10T06:28:48.459316+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:54.077676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459140+0000","last_change":"2024-09-10T06:26:32.279079+0000","last_active":"2024-09-10T06:28:48.459140+0000","last_peered":"2024-09-10T06:28:48.459140+0000","last_clean":"2024-09-10T06:28:48.459140+0000","last_became_active":"2024-09-10T06:26:32.278407+0000","last_became_peered":"2024-09-10T06:26:32.278407+0000","last_unstale":"2024-09-10T06:28:48.459140+0000","last_undegraded":"2024-09-10T06:28:48.459140+0000","last_fullsized":"2024-09-10T06:28:48.459140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"73'10","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460707+0000","last_change":"2024-09-10T06:26:30.607368+0000","last_active":"2024-09-10T06:28:48.460707+0000","last_peered":"2024-09-10T06:28:48.460707+0000","last_clean":"2024-09-10T06:28:48.460707+0000","last_became_active":"2024-09-10T06:26:30.606807+0000","last_became_peered":"2024-09-10T06:26:30.606807+0000","last_unstale":"2024-09-10T06:28:48.460707+0000","last_undegraded":"2024-09-10T06:28:48.460707+0000","last_fullsized":"2024-09-10T06:28:48.460707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"76'8","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454841+0000","last_change":"2024-09-10T06:27:08.801987+0000","last_active":"2024-09-10T06:28:48.454841+0000","last_peered":"2024-09-10T06:28:48.454841+0000","last_clean":"2024-09-10T06:28:48.454841+0000","last_became_active":"2024-09-10T06:27:08.801461+0000","last_became_peered":"2024-09-10T06:27:08.801461+0000","last_unstale":"2024-09-10T06:28:48.454841+0000","last_undegraded":"2024-09-10T06:28:48.454841+0000","last_fullsized":"2024-09-10T06:28:48.454841+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"72'11","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379594+0000","last_change":"2024-09-10T06:26:30.598381+0000","last_active":"2024-09-10T06:28:48.379594+0000","last_peered":"2024-09-10T06:28:48.379594+0000","last_clean":"2024-09-10T06:28:48.379594+0000","last_became_active":"2024-09-10T06:26:30.597271+0000","last_became_peered":"2024-09-10T06:26:30.597271+0000","last_unstale":"2024-09-10T06:28:48.379594+0000","last_undegraded":"2024-09-10T06:28:48.379594+0000","last_fullsized":"2024-09-10T06:28:48.379594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:59.908548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455123+0000","last_change":"2024-09-10T06:26:32.247492+0000","last_active":"2024-09-10T06:28:48.455123+0000","last_peered":"2024-09-10T06:28:48.455123+0000","last_clean":"2024-09-10T06:28:48.455123+0000","last_became_active":"2024-09-10T06:26:32.246938+0000","last_became_peered":"2024-09-10T06:26:32.246938+0000","last_unstale":"2024-09-10T06:28:48.455123+0000","last_undegraded":"2024-09-10T06:28:48.455123+0000","last_fullsized":"2024-09-10T06:28:48.455123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:01.766868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"73'11","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376896+0000","last_change":"2024-09-10T06:28:46.662120+0000","last_active":"2024-09-10T06:28:48.376896+0000","last_peered":"2024-09-10T06:28:48.376896+0000","last_clean":"2024-09-10T06:28:48.376896+0000","last_became_active":"2024-09-10T06:28:46.326710+0000","last_became_peered":"2024-09-10T06:28:46.326710+0000","last_unstale":"2024-09-10T06:28:48.376896+0000","last_undegraded":"2024-09-10T06:28:48.376896+0000","last_fullsized":"2024-09-10T06:28:48.376896+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:47.625969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380427+0000","last_change":"2024-09-10T06:26:32.278347+0000","last_active":"2024-09-10T06:28:48.380427+0000","last_peered":"2024-09-10T06:28:48.380427+0000","last_clean":"2024-09-10T06:28:48.380427+0000","last_became_active":"2024-09-10T06:26:32.275206+0000","last_became_peered":"2024-09-10T06:26:32.275206+0000","last_unstale":"2024-09-10T06:28:48.380427+0000","last_undegraded":"2024-09-10T06:28:48.380427+0000","last_fullsized":"2024-09-10T06:28:48.380427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"73'13","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375576+0000","last_change":"2024-09-10T06:26:30.572734+0000","last_active":"2024-09-10T06:28:48.375576+0000","last_peered":"2024-09-10T06:28:48.375576+0000","last_clean":"2024-09-10T06:28:48.375576+0000","last_became_active":"2024-09-10T06:26:30.572043+0000","last_became_peered":"2024-09-10T06:26:30.572043+0000","last_unstale":"2024-09-10T06:28:48.375576+0000","last_undegraded":"2024-09-10T06:28:48.375576+0000","last_fullsized":"2024-09-10T06:28:48.375576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"76'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376329+0000","last_change":"2024-09-10T06:26:40.323476+0000","last_active":"2024-09-10T06:28:48.376329+0000","last_peered":"2024-09-10T06:28:48.376329+0000","last_clean":"2024-09-10T06:28:48.376329+0000","last_became_active":"2024-09-10T06:26:40.322711+0000","last_became_peered":"2024-09-10T06:26:40.322711+0000","last_unstale":"2024-09-10T06:28:48.376329+0000","last_undegraded":"2024-09-10T06:28:48.376329+0000","last_fullsized":"2024-09-10T06:28:48.376329+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378030+0000","last_change":"2024-09-10T06:26:32.276274+0000","last_active":"2024-09-10T06:28:48.378030+0000","last_peered":"2024-09-10T06:28:48.378030+0000","last_clean":"2024-09-10T06:28:48.378030+0000","last_became_active":"2024-09-10T06:26:32.275889+0000","last_became_peered":"2024-09-10T06:26:32.275889+0000","last_unstale":"2024-09-10T06:28:48.378030+0000","last_undegraded":"2024-09-10T06:28:48.378030+0000","last_fullsized":"2024-09-10T06:28:48.378030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"72'14","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463117+0000","last_change":"2024-09-10T06:26:30.595738+0000","last_active":"2024-09-10T06:28:48.463117+0000","last_peered":"2024-09-10T06:28:48.463117+0000","last_clean":"2024-09-10T06:28:48.463117+0000","last_became_active":"2024-09-10T06:26:30.595128+0000","last_became_peered":"2024-09-10T06:26:30.595128+0000","last_unstale":"2024-09-10T06:28:48.463117+0000","last_undegraded":"2024-09-10T06:28:48.463117+0000","last_fullsized":"2024-09-10T06:28:48.463117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459270+0000","last_change":"2024-09-10T06:26:34.279824+0000","last_active":"2024-09-10T06:28:48.459270+0000","last_peered":"2024-09-10T06:28:48.459270+0000","last_clean":"2024-09-10T06:28:48.459270+0000","last_became_active":"2024-09-10T06:26:34.279074+0000","last_became_peered":"2024-09-10T06:26:34.279074+0000","last_unstale":"2024-09-10T06:28:48.459270+0000","last_undegraded":"2024-09-10T06:28:48.459270+0000","last_fullsized":"2024-09-10T06:28:48.459270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:40.507467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"76'15","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378442+0000","last_change":"2024-09-10T06:26:36.296703+0000","last_active":"2024-09-10T06:28:48.378442+0000","last_peered":"2024-09-10T06:28:48.378442+0000","last_clean":"2024-09-10T06:28:48.378442+0000","last_became_active":"2024-09-10T06:26:36.295786+0000","last_became_peered":"2024-09-10T06:26:36.295786+0000","last_unstale":"2024-09-10T06:28:48.378442+0000","last_undegraded":"2024-09-10T06:28:48.378442+0000","last_fullsized":"2024-09-10T06:28:48.378442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:31.699855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464404+0000","last_change":"2024-09-10T06:26:38.305468+0000","last_active":"2024-09-10T06:28:48.464404+0000","last_peered":"2024-09-10T06:28:48.464404+0000","last_clean":"2024-09-10T06:28:48.464404+0000","last_became_active":"2024-09-10T06:26:38.304847+0000","last_became_peered":"2024-09-10T06:26:38.304847+0000","last_unstale":"2024-09-10T06:28:48.464404+0000","last_undegraded":"2024-09-10T06:28:48.464404+0000","last_fullsized":"2024-09-10T06:28:48.464404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:36.499856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456269+0000","last_change":"2024-09-10T06:26:40.331389+0000","last_active":"2024-09-10T06:28:48.456269+0000","last_peered":"2024-09-10T06:28:48.456269+0000","last_clean":"2024-09-10T06:28:48.456269+0000","last_became_active":"2024-09-10T06:26:40.330777+0000","last_became_peered":"2024-09-10T06:26:40.330777+0000","last_unstale":"2024-09-10T06:28:48.456269+0000","last_undegraded":"2024-09-10T06:28:48.456269+0000","last_fullsized":"2024-09-10T06:28:48.456269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:22.792159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459648+0000","last_change":"2024-09-10T06:26:32.283112+0000","last_active":"2024-09-10T06:28:48.459648+0000","last_peered":"2024-09-10T06:28:48.459648+0000","last_clean":"2024-09-10T06:28:48.459648+0000","last_became_active":"2024-09-10T06:26:32.282263+0000","last_became_peered":"2024-09-10T06:26:32.282263+0000","last_unstale":"2024-09-10T06:28:48.459648+0000","last_undegraded":"2024-09-10T06:28:48.459648+0000","last_fullsized":"2024-09-10T06:28:48.459648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:02.124800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375652+0000","last_change":"2024-09-10T06:26:30.576489+0000","last_active":"2024-09-10T06:28:48.375652+0000","last_peered":"2024-09-10T06:28:48.375652+0000","last_clean":"2024-09-10T06:28:48.375652+0000","last_became_active":"2024-09-10T06:26:30.576039+0000","last_became_peered":"2024-09-10T06:26:30.576039+0000","last_unstale":"2024-09-10T06:28:48.375652+0000","last_undegraded":"2024-09-10T06:28:48.375652+0000","last_fullsized":"2024-09-10T06:28:48.375652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377684+0000","last_change":"2024-09-10T06:26:34.268758+0000","last_active":"2024-09-10T06:28:48.377684+0000","last_peered":"2024-09-10T06:28:48.377684+0000","last_clean":"2024-09-10T06:28:48.377684+0000","last_became_active":"2024-09-10T06:26:34.268279+0000","last_became_peered":"2024-09-10T06:26:34.268279+0000","last_unstale":"2024-09-10T06:28:48.377684+0000","last_undegraded":"2024-09-10T06:28:48.377684+0000","last_fullsized":"2024-09-10T06:28:48.377684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:42.052702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380478+0000","last_change":"2024-09-10T06:26:36.273991+0000","last_active":"2024-09-10T06:28:48.380478+0000","last_peered":"2024-09-10T06:28:48.380478+0000","last_clean":"2024-09-10T06:28:48.380478+0000","last_became_active":"2024-09-10T06:26:36.273138+0000","last_became_peered":"2024-09-10T06:26:36.273138+0000","last_unstale":"2024-09-10T06:28:48.380478+0000","last_undegraded":"2024-09-10T06:28:48.380478+0000","last_fullsized":"2024-09-10T06:28:48.380478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379823+0000","last_change":"2024-09-10T06:26:38.294543+0000","last_active":"2024-09-10T06:28:48.379823+0000","last_peered":"2024-09-10T06:28:48.379823+0000","last_clean":"2024-09-10T06:28:48.379823+0000","last_became_active":"2024-09-10T06:26:38.293754+0000","last_became_peered":"2024-09-10T06:26:38.293754+0000","last_unstale":"2024-09-10T06:28:48.379823+0000","last_undegraded":"2024-09-10T06:28:48.379823+0000","last_fullsized":"2024-09-10T06:28:48.379823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"62'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375308+0000","last_change":"2024-09-10T06:26:40.326998+0000","last_active":"2024-09-10T06:28:48.375308+0000","last_peered":"2024-09-10T06:28:48.375308+0000","last_clean":"2024-09-10T06:28:48.375308+0000","last_became_active":"2024-09-10T06:26:40.322648+0000","last_became_peered":"2024-09-10T06:26:40.322648+0000","last_unstale":"2024-09-10T06:28:48.375308+0000","last_undegraded":"2024-09-10T06:28:48.375308+0000","last_fullsized":"2024-09-10T06:28:48.375308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:19.837495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"76'4","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379477+0000","last_change":"2024-09-10T06:26:32.256959+0000","last_active":"2024-09-10T06:28:48.379477+0000","last_peered":"2024-09-10T06:28:48.379477+0000","last_clean":"2024-09-10T06:28:48.379477+0000","last_became_active":"2024-09-10T06:26:32.256701+0000","last_became_peered":"2024-09-10T06:26:32.256701+0000","last_unstale":"2024-09-10T06:28:48.379477+0000","last_undegraded":"2024-09-10T06:28:48.379477+0000","last_fullsized":"2024-09-10T06:28:48.379477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"73'13","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457900+0000","last_change":"2024-09-10T06:26:30.598409+0000","last_active":"2024-09-10T06:28:48.457900+0000","last_peered":"2024-09-10T06:28:48.457900+0000","last_clean":"2024-09-10T06:28:48.457900+0000","last_became_active":"2024-09-10T06:26:30.597703+0000","last_became_peered":"2024-09-10T06:26:30.597703+0000","last_unstale":"2024-09-10T06:28:48.457900+0000","last_undegraded":"2024-09-10T06:28:48.457900+0000","last_fullsized":"2024-09-10T06:28:48.457900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380025+0000","last_change":"2024-09-10T06:26:34.268741+0000","last_active":"2024-09-10T06:28:48.380025+0000","last_peered":"2024-09-10T06:28:48.380025+0000","last_clean":"2024-09-10T06:28:48.380025+0000","last_became_active":"2024-09-10T06:26:34.268192+0000","last_became_peered":"2024-09-10T06:26:34.268192+0000","last_unstale":"2024-09-10T06:28:48.380025+0000","last_undegraded":"2024-09-10T06:28:48.380025+0000","last_fullsized":"2024-09-10T06:28:48.380025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:42:10.110645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454978+0000","last_change":"2024-09-10T06:26:36.275955+0000","last_active":"2024-09-10T06:28:48.454978+0000","last_peered":"2024-09-10T06:28:48.454978+0000","last_clean":"2024-09-10T06:28:48.454978+0000","last_became_active":"2024-09-10T06:26:36.275306+0000","last_became_peered":"2024-09-10T06:26:36.275306+0000","last_unstale":"2024-09-10T06:28:48.454978+0000","last_undegraded":"2024-09-10T06:28:48.454978+0000","last_fullsized":"2024-09-10T06:28:48.454978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:03.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'102","reported_seq":402,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:52.690214+0000","last_change":"2024-09-10T06:26:38.302764+0000","last_active":"2024-09-10T06:28:52.690214+0000","last_peered":"2024-09-10T06:28:52.690214+0000","last_clean":"2024-09-10T06:28:52.690214+0000","last_became_active":"2024-09-10T06:26:38.300326+0000","last_became_peered":"2024-09-10T06:26:38.300326+0000","last_unstale":"2024-09-10T06:28:52.690214+0000","last_undegraded":"2024-09-10T06:28:52.690214+0000","last_fullsized":"2024-09-10T06:28:52.690214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:29.851085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376634+0000","last_change":"2024-09-10T06:26:40.297893+0000","last_active":"2024-09-10T06:28:48.376634+0000","last_peered":"2024-09-10T06:28:48.376634+0000","last_clean":"2024-09-10T06:28:48.376634+0000","last_became_active":"2024-09-10T06:26:40.297296+0000","last_became_peered":"2024-09-10T06:26:40.297296+0000","last_unstale":"2024-09-10T06:28:48.376634+0000","last_undegraded":"2024-09-10T06:28:48.376634+0000","last_fullsized":"2024-09-10T06:28:48.376634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379613+0000","last_change":"2024-09-10T06:26:32.265005+0000","last_active":"2024-09-10T06:28:48.379613+0000","last_peered":"2024-09-10T06:28:48.379613+0000","last_clean":"2024-09-10T06:28:48.379613+0000","last_became_active":"2024-09-10T06:26:32.264334+0000","last_became_peered":"2024-09-10T06:26:32.264334+0000","last_unstale":"2024-09-10T06:28:48.379613+0000","last_undegraded":"2024-09-10T06:28:48.379613+0000","last_fullsized":"2024-09-10T06:28:48.379613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"73'13","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457010+0000","last_change":"2024-09-10T06:26:30.576242+0000","last_active":"2024-09-10T06:28:48.457010+0000","last_peered":"2024-09-10T06:28:48.457010+0000","last_clean":"2024-09-10T06:28:48.457010+0000","last_became_active":"2024-09-10T06:26:30.575433+0000","last_became_peered":"2024-09-10T06:26:30.575433+0000","last_unstale":"2024-09-10T06:28:48.457010+0000","last_undegraded":"2024-09-10T06:28:48.457010+0000","last_fullsized":"2024-09-10T06:28:48.457010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459995+0000","last_change":"2024-09-10T06:26:34.283701+0000","last_active":"2024-09-10T06:28:48.459995+0000","last_peered":"2024-09-10T06:28:48.459995+0000","last_clean":"2024-09-10T06:28:48.459995+0000","last_became_active":"2024-09-10T06:26:34.282941+0000","last_became_peered":"2024-09-10T06:26:34.282941+0000","last_unstale":"2024-09-10T06:28:48.459995+0000","last_undegraded":"2024-09-10T06:28:48.459995+0000","last_fullsized":"2024-09-10T06:28:48.459995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:29.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"76'16","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463444+0000","last_change":"2024-09-10T06:26:36.298510+0000","last_active":"2024-09-10T06:28:48.463444+0000","last_peered":"2024-09-10T06:28:48.463444+0000","last_clean":"2024-09-10T06:28:48.463444+0000","last_became_active":"2024-09-10T06:26:36.297309+0000","last_became_peered":"2024-09-10T06:26:36.297309+0000","last_unstale":"2024-09-10T06:28:48.463444+0000","last_undegraded":"2024-09-10T06:28:48.463444+0000","last_fullsized":"2024-09-10T06:28:48.463444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'102","reported_seq":269,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:52.696758+0000","last_change":"2024-09-10T06:26:38.300228+0000","last_active":"2024-09-10T06:28:52.696758+0000","last_peered":"2024-09-10T06:28:52.696758+0000","last_clean":"2024-09-10T06:28:52.696758+0000","last_became_active":"2024-09-10T06:26:38.299355+0000","last_became_peered":"2024-09-10T06:26:38.299355+0000","last_unstale":"2024-09-10T06:28:52.696758+0000","last_undegraded":"2024-09-10T06:28:52.696758+0000","last_fullsized":"2024-09-10T06:28:52.696758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:20.050096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456891+0000","last_change":"2024-09-10T06:26:32.271283+0000","last_active":"2024-09-10T06:28:48.456891+0000","last_peered":"2024-09-10T06:28:48.456891+0000","last_clean":"2024-09-10T06:28:48.456891+0000","last_became_active":"2024-09-10T06:26:32.270496+0000","last_became_peered":"2024-09-10T06:26:32.270496+0000","last_unstale":"2024-09-10T06:28:48.456891+0000","last_undegraded":"2024-09-10T06:28:48.456891+0000","last_fullsized":"2024-09-10T06:28:48.456891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464629+0000","last_change":"2024-09-10T06:26:30.607373+0000","last_active":"2024-09-10T06:28:48.464629+0000","last_peered":"2024-09-10T06:28:48.464629+0000","last_clean":"2024-09-10T06:28:48.464629+0000","last_became_active":"2024-09-10T06:26:30.606685+0000","last_became_peered":"2024-09-10T06:26:30.606685+0000","last_unstale":"2024-09-10T06:28:48.464629+0000","last_undegraded":"2024-09-10T06:28:48.464629+0000","last_fullsized":"2024-09-10T06:28:48.464629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:35.705564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456456+0000","last_change":"2024-09-10T06:26:34.286925+0000","last_active":"2024-09-10T06:28:48.456456+0000","last_peered":"2024-09-10T06:28:48.456456+0000","last_clean":"2024-09-10T06:28:48.456456+0000","last_became_active":"2024-09-10T06:26:34.285787+0000","last_became_peered":"2024-09-10T06:26:34.285787+0000","last_unstale":"2024-09-10T06:28:48.456456+0000","last_undegraded":"2024-09-10T06:28:48.456456+0000","last_fullsized":"2024-09-10T06:28:48.456456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"76'25","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456092+0000","last_change":"2024-09-10T06:26:36.293988+0000","last_active":"2024-09-10T06:28:48.456092+0000","last_peered":"2024-09-10T06:28:48.456092+0000","last_clean":"2024-09-10T06:28:48.456092+0000","last_became_active":"2024-09-10T06:26:36.293226+0000","last_became_peered":"2024-09-10T06:26:36.293226+0000","last_unstale":"2024-09-10T06:28:48.456092+0000","last_undegraded":"2024-09-10T06:28:48.456092+0000","last_fullsized":"2024-09-10T06:28:48.456092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453865+0000","last_change":"2024-09-10T06:26:38.305826+0000","last_active":"2024-09-10T06:28:48.453865+0000","last_peered":"2024-09-10T06:28:48.453865+0000","last_clean":"2024-09-10T06:28:48.453865+0000","last_became_active":"2024-09-10T06:26:38.304601+0000","last_became_peered":"2024-09-10T06:26:38.304601+0000","last_unstale":"2024-09-10T06:28:48.453865+0000","last_undegraded":"2024-09-10T06:28:48.453865+0000","last_fullsized":"2024-09-10T06:28:48.453865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:12.545261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"62'8","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460978+0000","last_change":"2024-09-10T06:26:40.332286+0000","last_active":"2024-09-10T06:28:48.460978+0000","last_peered":"2024-09-10T06:28:48.460978+0000","last_clean":"2024-09-10T06:28:48.460978+0000","last_became_active":"2024-09-10T06:26:40.331262+0000","last_became_peered":"2024-09-10T06:26:40.331262+0000","last_unstale":"2024-09-10T06:28:48.460978+0000","last_undegraded":"2024-09-10T06:28:48.460978+0000","last_fullsized":"2024-09-10T06:28:48.460978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377579+0000","last_change":"2024-09-10T06:26:32.262320+0000","last_active":"2024-09-10T06:28:48.377579+0000","last_peered":"2024-09-10T06:28:48.377579+0000","last_clean":"2024-09-10T06:28:48.377579+0000","last_became_active":"2024-09-10T06:26:32.261423+0000","last_became_peered":"2024-09-10T06:26:32.261423+0000","last_unstale":"2024-09-10T06:28:48.377579+0000","last_undegraded":"2024-09-10T06:28:48.377579+0000","last_fullsized":"2024-09-10T06:28:48.377579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"76'13","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464559+0000","last_change":"2024-09-10T06:26:30.595879+0000","last_active":"2024-09-10T06:28:48.464559+0000","last_peered":"2024-09-10T06:28:48.464559+0000","last_clean":"2024-09-10T06:28:48.464559+0000","last_became_active":"2024-09-10T06:26:30.595269+0000","last_became_peered":"2024-09-10T06:26:30.595269+0000","last_unstale":"2024-09-10T06:28:48.464559+0000","last_undegraded":"2024-09-10T06:28:48.464559+0000","last_fullsized":"2024-09-10T06:28:48.464559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453028+0000","last_change":"2024-09-10T06:26:34.266906+0000","last_active":"2024-09-10T06:28:48.453028+0000","last_peered":"2024-09-10T06:28:48.453028+0000","last_clean":"2024-09-10T06:28:48.453028+0000","last_became_active":"2024-09-10T06:26:34.266017+0000","last_became_peered":"2024-09-10T06:26:34.266017+0000","last_unstale":"2024-09-10T06:28:48.453028+0000","last_undegraded":"2024-09-10T06:28:48.453028+0000","last_fullsized":"2024-09-10T06:28:48.453028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:24.366166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"76'16","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378015+0000","last_change":"2024-09-10T06:26:36.297020+0000","last_active":"2024-09-10T06:28:48.378015+0000","last_peered":"2024-09-10T06:28:48.378015+0000","last_clean":"2024-09-10T06:28:48.378015+0000","last_became_active":"2024-09-10T06:26:36.295796+0000","last_became_peered":"2024-09-10T06:26:36.295796+0000","last_unstale":"2024-09-10T06:28:48.378015+0000","last_undegraded":"2024-09-10T06:28:48.378015+0000","last_fullsized":"2024-09-10T06:28:48.378015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375244+0000","last_change":"2024-09-10T06:26:38.297273+0000","last_active":"2024-09-10T06:28:48.375244+0000","last_peered":"2024-09-10T06:28:48.375244+0000","last_clean":"2024-09-10T06:28:48.375244+0000","last_became_active":"2024-09-10T06:26:38.296455+0000","last_became_peered":"2024-09-10T06:26:38.296455+0000","last_unstale":"2024-09-10T06:28:48.375244+0000","last_undegraded":"2024-09-10T06:28:48.375244+0000","last_fullsized":"2024-09-10T06:28:48.375244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:26.766702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458102+0000","last_change":"2024-09-10T06:26:40.328294+0000","last_active":"2024-09-10T06:28:48.458102+0000","last_peered":"2024-09-10T06:28:48.458102+0000","last_clean":"2024-09-10T06:28:48.458102+0000","last_became_active":"2024-09-10T06:26:40.327585+0000","last_became_peered":"2024-09-10T06:26:40.327585+0000","last_unstale":"2024-09-10T06:28:48.458102+0000","last_undegraded":"2024-09-10T06:28:48.458102+0000","last_fullsized":"2024-09-10T06:28:48.458102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.537210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458888+0000","last_change":"2024-09-10T06:27:08.600683+0000","last_active":"2024-09-10T06:28:48.458888+0000","last_peered":"2024-09-10T06:28:48.458888+0000","last_clean":"2024-09-10T06:28:48.458888+0000","last_became_active":"2024-09-10T06:27:08.599875+0000","last_became_peered":"2024-09-10T06:27:08.599875+0000","last_unstale":"2024-09-10T06:28:48.458888+0000","last_undegraded":"2024-09-10T06:28:48.458888+0000","last_fullsized":"2024-09-10T06:28:48.458888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:59.605814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464013+0000","last_change":"2024-09-10T06:26:30.611704+0000","last_active":"2024-09-10T06:28:48.464013+0000","last_peered":"2024-09-10T06:28:48.464013+0000","last_clean":"2024-09-10T06:28:48.464013+0000","last_became_active":"2024-09-10T06:26:30.611039+0000","last_became_peered":"2024-09-10T06:26:30.611039+0000","last_unstale":"2024-09-10T06:28:48.464013+0000","last_undegraded":"2024-09-10T06:28:48.464013+0000","last_fullsized":"2024-09-10T06:28:48.464013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455026+0000","last_change":"2024-09-10T06:26:34.263514+0000","last_active":"2024-09-10T06:28:48.455026+0000","last_peered":"2024-09-10T06:28:48.455026+0000","last_clean":"2024-09-10T06:28:48.455026+0000","last_became_active":"2024-09-10T06:26:34.262793+0000","last_became_peered":"2024-09-10T06:26:34.262793+0000","last_unstale":"2024-09-10T06:28:48.455026+0000","last_undegraded":"2024-09-10T06:28:48.455026+0000","last_fullsized":"2024-09-10T06:28:48.455026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:31.501738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"76'22","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455616+0000","last_change":"2024-09-10T06:26:36.299923+0000","last_active":"2024-09-10T06:28:48.455616+0000","last_peered":"2024-09-10T06:28:48.455616+0000","last_clean":"2024-09-10T06:28:48.455616+0000","last_became_active":"2024-09-10T06:26:36.299140+0000","last_became_peered":"2024-09-10T06:26:36.299140+0000","last_unstale":"2024-09-10T06:28:48.455616+0000","last_undegraded":"2024-09-10T06:28:48.455616+0000","last_fullsized":"2024-09-10T06:28:48.455616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:12.246303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'102","reported_seq":267,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:50.610563+0000","last_change":"2024-09-10T06:26:38.292019+0000","last_active":"2024-09-10T06:28:50.610563+0000","last_peered":"2024-09-10T06:28:50.610563+0000","last_clean":"2024-09-10T06:28:50.610563+0000","last_became_active":"2024-09-10T06:26:38.291322+0000","last_became_peered":"2024-09-10T06:26:38.291322+0000","last_unstale":"2024-09-10T06:28:50.610563+0000","last_undegraded":"2024-09-10T06:28:50.610563+0000","last_fullsized":"2024-09-10T06:28:50.610563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"64'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378724+0000","last_change":"2024-09-10T06:26:40.328427+0000","last_active":"2024-09-10T06:28:48.378724+0000","last_peered":"2024-09-10T06:28:48.378724+0000","last_clean":"2024-09-10T06:28:48.378724+0000","last_became_active":"2024-09-10T06:26:40.323249+0000","last_became_peered":"2024-09-10T06:26:40.323249+0000","last_unstale":"2024-09-10T06:28:48.378724+0000","last_undegraded":"2024-09-10T06:28:48.378724+0000","last_fullsized":"2024-09-10T06:28:48.378724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:50.823195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377190+0000","last_change":"2024-09-10T06:26:32.274824+0000","last_active":"2024-09-10T06:28:48.377190+0000","last_peered":"2024-09-10T06:28:48.377190+0000","last_clean":"2024-09-10T06:28:48.377190+0000","last_became_active":"2024-09-10T06:26:32.274496+0000","last_became_peered":"2024-09-10T06:26:32.274496+0000","last_unstale":"2024-09-10T06:28:48.377190+0000","last_undegraded":"2024-09-10T06:28:48.377190+0000","last_fullsized":"2024-09-10T06:28:48.377190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:39.513476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"73'7","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462108+0000","last_change":"2024-09-10T06:26:30.604684+0000","last_active":"2024-09-10T06:28:48.462108+0000","last_peered":"2024-09-10T06:28:48.462108+0000","last_clean":"2024-09-10T06:28:48.462108+0000","last_became_active":"2024-09-10T06:26:30.593432+0000","last_became_peered":"2024-09-10T06:26:30.593432+0000","last_unstale":"2024-09-10T06:28:48.462108+0000","last_undegraded":"2024-09-10T06:28:48.462108+0000","last_fullsized":"2024-09-10T06:28:48.462108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454621+0000","last_change":"2024-09-10T06:26:34.256662+0000","last_active":"2024-09-10T06:28:48.454621+0000","last_peered":"2024-09-10T06:28:48.454621+0000","last_clean":"2024-09-10T06:28:48.454621+0000","last_became_active":"2024-09-10T06:26:34.256256+0000","last_became_peered":"2024-09-10T06:26:34.256256+0000","last_unstale":"2024-09-10T06:28:48.454621+0000","last_undegraded":"2024-09-10T06:28:48.454621+0000","last_fullsized":"2024-09-10T06:28:48.454621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:35.549063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'26","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375816+0000","last_change":"2024-09-10T06:26:36.296631+0000","last_active":"2024-09-10T06:28:48.375816+0000","last_peered":"2024-09-10T06:28:48.375816+0000","last_clean":"2024-09-10T06:28:48.375816+0000","last_became_active":"2024-09-10T06:26:36.295838+0000","last_became_peered":"2024-09-10T06:26:36.295838+0000","last_unstale":"2024-09-10T06:28:48.375816+0000","last_undegraded":"2024-09-10T06:28:48.375816+0000","last_fullsized":"2024-09-10T06:28:48.375816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:04.271824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9809,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452870+0000","last_change":"2024-09-10T06:26:38.308698+0000","last_active":"2024-09-10T06:28:48.452870+0000","last_peered":"2024-09-10T06:28:48.452870+0000","last_clean":"2024-09-10T06:28:48.452870+0000","last_became_active":"2024-09-10T06:26:38.307965+0000","last_became_peered":"2024-09-10T06:26:38.307965+0000","last_unstale":"2024-09-10T06:28:48.452870+0000","last_undegraded":"2024-09-10T06:28:48.452870+0000","last_fullsized":"2024-09-10T06:28:48.452870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:04.566221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"62'4","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454102+0000","last_change":"2024-09-10T06:26:40.326474+0000","last_active":"2024-09-10T06:28:48.454102+0000","last_peered":"2024-09-10T06:28:48.454102+0000","last_clean":"2024-09-10T06:28:48.454102+0000","last_became_active":"2024-09-10T06:26:40.325731+0000","last_became_peered":"2024-09-10T06:26:40.325731+0000","last_unstale":"2024-09-10T06:28:48.454102+0000","last_undegraded":"2024-09-10T06:28:48.454102+0000","last_fullsized":"2024-09-10T06:28:48.454102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:19.400355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"64'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380025+0000","last_change":"2024-09-10T06:26:32.254177+0000","last_active":"2024-09-10T06:28:48.380025+0000","last_peered":"2024-09-10T06:28:48.380025+0000","last_clean":"2024-09-10T06:28:48.380025+0000","last_became_active":"2024-09-10T06:26:32.253154+0000","last_became_peered":"2024-09-10T06:26:32.253154+0000","last_unstale":"2024-09-10T06:28:48.380025+0000","last_undegraded":"2024-09-10T06:28:48.380025+0000","last_fullsized":"2024-09-10T06:28:48.380025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"72'5","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375194+0000","last_change":"2024-09-10T06:26:30.572406+0000","last_active":"2024-09-10T06:28:48.375194+0000","last_peered":"2024-09-10T06:28:48.375194+0000","last_clean":"2024-09-10T06:28:48.375194+0000","last_became_active":"2024-09-10T06:26:30.571829+0000","last_became_peered":"2024-09-10T06:26:30.571829+0000","last_unstale":"2024-09-10T06:28:48.375194+0000","last_undegraded":"2024-09-10T06:28:48.375194+0000","last_fullsized":"2024-09-10T06:28:48.375194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455283+0000","last_change":"2024-09-10T06:26:34.285406+0000","last_active":"2024-09-10T06:28:48.455283+0000","last_peered":"2024-09-10T06:28:48.455283+0000","last_clean":"2024-09-10T06:28:48.455283+0000","last_became_active":"2024-09-10T06:26:34.285004+0000","last_became_peered":"2024-09-10T06:26:34.285004+0000","last_unstale":"2024-09-10T06:28:48.455283+0000","last_undegraded":"2024-09-10T06:28:48.455283+0000","last_fullsized":"2024-09-10T06:28:48.455283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:03.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"87'21","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379938+0000","last_change":"2024-09-10T06:26:36.293191+0000","last_active":"2024-09-10T06:28:48.379938+0000","last_peered":"2024-09-10T06:28:48.379938+0000","last_clean":"2024-09-10T06:28:48.379938+0000","last_became_active":"2024-09-10T06:26:36.292423+0000","last_became_peered":"2024-09-10T06:26:36.292423+0000","last_unstale":"2024-09-10T06:28:48.379938+0000","last_undegraded":"2024-09-10T06:28:48.379938+0000","last_fullsized":"2024-09-10T06:28:48.379938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":28,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378126+0000","last_change":"2024-09-10T06:26:38.293667+0000","last_active":"2024-09-10T06:28:48.378126+0000","last_peered":"2024-09-10T06:28:48.378126+0000","last_clean":"2024-09-10T06:28:48.378126+0000","last_became_active":"2024-09-10T06:26:38.292918+0000","last_became_peered":"2024-09-10T06:26:38.292918+0000","last_unstale":"2024-09-10T06:28:48.378126+0000","last_undegraded":"2024-09-10T06:28:48.378126+0000","last_fullsized":"2024-09-10T06:28:48.378126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:57.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376446+0000","last_change":"2024-09-10T06:26:40.327061+0000","last_active":"2024-09-10T06:28:48.376446+0000","last_peered":"2024-09-10T06:28:48.376446+0000","last_clean":"2024-09-10T06:28:48.376446+0000","last_became_active":"2024-09-10T06:26:40.326431+0000","last_became_peered":"2024-09-10T06:26:40.326431+0000","last_unstale":"2024-09-10T06:28:48.376446+0000","last_undegraded":"2024-09-10T06:28:48.376446+0000","last_fullsized":"2024-09-10T06:28:48.376446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:27.631214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"64'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380722+0000","last_change":"2024-09-10T06:26:32.255139+0000","last_active":"2024-09-10T06:28:48.380722+0000","last_peered":"2024-09-10T06:28:48.380722+0000","last_clean":"2024-09-10T06:28:48.380722+0000","last_became_active":"2024-09-10T06:26:32.253524+0000","last_became_peered":"2024-09-10T06:26:32.253524+0000","last_unstale":"2024-09-10T06:28:48.380722+0000","last_undegraded":"2024-09-10T06:28:48.380722+0000","last_fullsized":"2024-09-10T06:28:48.380722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"73'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459281+0000","last_change":"2024-09-10T06:26:30.591838+0000","last_active":"2024-09-10T06:28:48.459281+0000","last_peered":"2024-09-10T06:28:48.459281+0000","last_clean":"2024-09-10T06:28:48.459281+0000","last_became_active":"2024-09-10T06:26:30.591125+0000","last_became_peered":"2024-09-10T06:26:30.591125+0000","last_unstale":"2024-09-10T06:28:48.459281+0000","last_undegraded":"2024-09-10T06:28:48.459281+0000","last_fullsized":"2024-09-10T06:28:48.459281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453621+0000","last_change":"2024-09-10T06:26:34.280391+0000","last_active":"2024-09-10T06:28:48.453621+0000","last_peered":"2024-09-10T06:28:48.453621+0000","last_clean":"2024-09-10T06:28:48.453621+0000","last_became_active":"2024-09-10T06:26:34.280058+0000","last_became_peered":"2024-09-10T06:26:34.280058+0000","last_unstale":"2024-09-10T06:28:48.453621+0000","last_undegraded":"2024-09-10T06:28:48.453621+0000","last_fullsized":"2024-09-10T06:28:48.453621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.461857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"76'23","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456011+0000","last_change":"2024-09-10T06:26:36.277547+0000","last_active":"2024-09-10T06:28:48.456011+0000","last_peered":"2024-09-10T06:28:48.456011+0000","last_clean":"2024-09-10T06:28:48.456011+0000","last_became_active":"2024-09-10T06:26:36.276965+0000","last_became_peered":"2024-09-10T06:26:36.276965+0000","last_unstale":"2024-09-10T06:28:48.456011+0000","last_undegraded":"2024-09-10T06:28:48.456011+0000","last_fullsized":"2024-09-10T06:28:48.456011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:43.212945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'102","reported_seq":298,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:52.691656+0000","last_change":"2024-09-10T06:26:38.306134+0000","last_active":"2024-09-10T06:28:52.691656+0000","last_peered":"2024-09-10T06:28:52.691656+0000","last_clean":"2024-09-10T06:28:52.691656+0000","last_became_active":"2024-09-10T06:26:38.299012+0000","last_became_peered":"2024-09-10T06:26:38.299012+0000","last_unstale":"2024-09-10T06:28:52.691656+0000","last_undegraded":"2024-09-10T06:28:52.691656+0000","last_fullsized":"2024-09-10T06:28:52.691656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:37.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"61'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454114+0000","last_change":"2024-09-10T06:26:40.336036+0000","last_active":"2024-09-10T06:28:48.454114+0000","last_peered":"2024-09-10T06:28:48.454114+0000","last_clean":"2024-09-10T06:28:48.454114+0000","last_became_active":"2024-09-10T06:26:40.335302+0000","last_became_peered":"2024-09-10T06:26:40.335302+0000","last_unstale":"2024-09-10T06:28:48.454114+0000","last_undegraded":"2024-09-10T06:28:48.454114+0000","last_fullsized":"2024-09-10T06:28:48.454114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:24.024562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380676+0000","last_change":"2024-09-10T06:26:32.287897+0000","last_active":"2024-09-10T06:28:48.380676+0000","last_peered":"2024-09-10T06:28:48.380676+0000","last_clean":"2024-09-10T06:28:48.380676+0000","last_became_active":"2024-09-10T06:26:32.287315+0000","last_became_peered":"2024-09-10T06:26:32.287315+0000","last_unstale":"2024-09-10T06:28:48.380676+0000","last_undegraded":"2024-09-10T06:28:48.380676+0000","last_fullsized":"2024-09-10T06:28:48.380676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"73'7","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378593+0000","last_change":"2024-09-10T06:26:30.569192+0000","last_active":"2024-09-10T06:28:48.378593+0000","last_peered":"2024-09-10T06:28:48.378593+0000","last_clean":"2024-09-10T06:28:48.378593+0000","last_became_active":"2024-09-10T06:26:30.568464+0000","last_became_peered":"2024-09-10T06:26:30.568464+0000","last_unstale":"2024-09-10T06:28:48.378593+0000","last_undegraded":"2024-09-10T06:28:48.378593+0000","last_fullsized":"2024-09-10T06:28:48.378593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:58.987914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":280,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459913+0000","last_change":"2024-09-10T06:26:34.279935+0000","last_active":"2024-09-10T06:28:48.459913+0000","last_peered":"2024-09-10T06:28:48.459913+0000","last_clean":"2024-09-10T06:28:48.459913+0000","last_became_active":"2024-09-10T06:26:34.279192+0000","last_became_peered":"2024-09-10T06:26:34.279192+0000","last_unstale":"2024-09-10T06:28:48.459913+0000","last_undegraded":"2024-09-10T06:28:48.459913+0000","last_fullsized":"2024-09-10T06:28:48.459913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:18.753175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377130+0000","last_change":"2024-09-10T06:26:36.290330+0000","last_active":"2024-09-10T06:28:48.377130+0000","last_peered":"2024-09-10T06:28:48.377130+0000","last_clean":"2024-09-10T06:28:48.377130+0000","last_became_active":"2024-09-10T06:26:36.289527+0000","last_became_peered":"2024-09-10T06:26:36.289527+0000","last_unstale":"2024-09-10T06:28:48.377130+0000","last_undegraded":"2024-09-10T06:28:48.377130+0000","last_fullsized":"2024-09-10T06:28:48.377130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'102","reported_seq":310,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:52.694787+0000","last_change":"2024-09-10T06:26:38.288663+0000","last_active":"2024-09-10T06:28:52.694787+0000","last_peered":"2024-09-10T06:28:52.694787+0000","last_clean":"2024-09-10T06:28:52.694787+0000","last_became_active":"2024-09-10T06:26:38.287740+0000","last_became_peered":"2024-09-10T06:26:38.287740+0000","last_unstale":"2024-09-10T06:28:52.694787+0000","last_undegraded":"2024-09-10T06:28:52.694787+0000","last_fullsized":"2024-09-10T06:28:52.694787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:22.078943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'8","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377335+0000","last_change":"2024-09-10T06:26:40.329737+0000","last_active":"2024-09-10T06:28:48.377335+0000","last_peered":"2024-09-10T06:28:48.377335+0000","last_clean":"2024-09-10T06:28:48.377335+0000","last_became_active":"2024-09-10T06:26:40.328952+0000","last_became_peered":"2024-09-10T06:26:40.328952+0000","last_unstale":"2024-09-10T06:28:48.377335+0000","last_undegraded":"2024-09-10T06:28:48.377335+0000","last_fullsized":"2024-09-10T06:28:48.377335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454598+0000","last_change":"2024-09-10T06:26:32.270997+0000","last_active":"2024-09-10T06:28:48.454598+0000","last_peered":"2024-09-10T06:28:48.454598+0000","last_clean":"2024-09-10T06:28:48.454598+0000","last_became_active":"2024-09-10T06:26:32.270265+0000","last_became_peered":"2024-09-10T06:26:32.270265+0000","last_unstale":"2024-09-10T06:28:48.454598+0000","last_undegraded":"2024-09-10T06:28:48.454598+0000","last_fullsized":"2024-09-10T06:28:48.454598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:33.067523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"73'11","reported_seq":127,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452795+0000","last_change":"2024-09-10T06:27:08.593158+0000","last_active":"2024-09-10T06:28:48.452795+0000","last_peered":"2024-09-10T06:28:48.452795+0000","last_clean":"2024-09-10T06:28:48.452795+0000","last_became_active":"2024-09-10T06:27:08.592864+0000","last_became_peered":"2024-09-10T06:27:08.592864+0000","last_unstale":"2024-09-10T06:28:48.452795+0000","last_undegraded":"2024-09-10T06:28:48.452795+0000","last_fullsized":"2024-09-10T06:28:48.452795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:35.185591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380176+0000","last_change":"2024-09-10T06:26:34.286497+0000","last_active":"2024-09-10T06:28:48.380176+0000","last_peered":"2024-09-10T06:28:48.380176+0000","last_clean":"2024-09-10T06:28:48.380176+0000","last_became_active":"2024-09-10T06:26:34.285334+0000","last_became_peered":"2024-09-10T06:26:34.285334+0000","last_unstale":"2024-09-10T06:28:48.380176+0000","last_undegraded":"2024-09-10T06:28:48.380176+0000","last_fullsized":"2024-09-10T06:28:48.380176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:54.506182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"76'23","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459007+0000","last_change":"2024-09-10T06:26:36.288213+0000","last_active":"2024-09-10T06:28:48.459007+0000","last_peered":"2024-09-10T06:28:48.459007+0000","last_clean":"2024-09-10T06:28:48.459007+0000","last_became_active":"2024-09-10T06:26:36.287468+0000","last_became_peered":"2024-09-10T06:26:36.287468+0000","last_unstale":"2024-09-10T06:28:48.459007+0000","last_undegraded":"2024-09-10T06:28:48.459007+0000","last_fullsized":"2024-09-10T06:28:48.459007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457697+0000","last_change":"2024-09-10T06:26:38.291943+0000","last_active":"2024-09-10T06:28:48.457697+0000","last_peered":"2024-09-10T06:28:48.457697+0000","last_clean":"2024-09-10T06:28:48.457697+0000","last_became_active":"2024-09-10T06:26:38.291214+0000","last_became_peered":"2024-09-10T06:26:38.291214+0000","last_unstale":"2024-09-10T06:28:48.457697+0000","last_undegraded":"2024-09-10T06:28:48.457697+0000","last_fullsized":"2024-09-10T06:28:48.457697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:56.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"67'4","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453374+0000","last_change":"2024-09-10T06:26:40.331977+0000","last_active":"2024-09-10T06:28:48.453374+0000","last_peered":"2024-09-10T06:28:48.453374+0000","last_clean":"2024-09-10T06:28:48.453374+0000","last_became_active":"2024-09-10T06:26:40.331502+0000","last_became_peered":"2024-09-10T06:26:40.331502+0000","last_unstale":"2024-09-10T06:28:48.453374+0000","last_undegraded":"2024-09-10T06:28:48.453374+0000","last_fullsized":"2024-09-10T06:28:48.453374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:43.572813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460459+0000","last_change":"2024-09-10T06:26:32.274623+0000","last_active":"2024-09-10T06:28:48.460459+0000","last_peered":"2024-09-10T06:28:48.460459+0000","last_clean":"2024-09-10T06:28:48.460459+0000","last_became_active":"2024-09-10T06:26:32.273727+0000","last_became_peered":"2024-09-10T06:26:32.273727+0000","last_unstale":"2024-09-10T06:28:48.460459+0000","last_undegraded":"2024-09-10T06:28:48.460459+0000","last_fullsized":"2024-09-10T06:28:48.460459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:15.364938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":258,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455693+0000","last_change":"2024-09-10T06:26:18.153206+0000","last_active":"2024-09-10T06:28:48.455693+0000","last_peered":"2024-09-10T06:28:48.455693+0000","last_clean":"2024-09-10T06:28:48.455693+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:28:48.455693+0000","last_undegraded":"2024-09-10T06:28:48.455693+0000","last_fullsized":"2024-09-10T06:28:48.455693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_clean_scrub_stamp":"2024-09-10T06:26:16.422775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:42.510577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460195+0000","last_change":"2024-09-10T06:26:25.532465+0000","last_active":"2024-09-10T06:28:48.460195+0000","last_peered":"2024-09-10T06:28:48.460195+0000","last_clean":"2024-09-10T06:28:48.460195+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:28:48.460195+0000","last_undegraded":"2024-09-10T06:28:48.460195+0000","last_fullsized":"2024-09-10T06:28:48.460195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:10.318844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"73'9","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375960+0000","last_change":"2024-09-10T06:26:30.606630+0000","last_active":"2024-09-10T06:28:48.375960+0000","last_peered":"2024-09-10T06:28:48.375960+0000","last_clean":"2024-09-10T06:28:48.375960+0000","last_became_active":"2024-09-10T06:26:30.606348+0000","last_became_peered":"2024-09-10T06:26:30.606348+0000","last_unstale":"2024-09-10T06:28:48.375960+0000","last_undegraded":"2024-09-10T06:28:48.375960+0000","last_fullsized":"2024-09-10T06:28:48.375960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462936+0000","last_change":"2024-09-10T06:26:34.287201+0000","last_active":"2024-09-10T06:28:48.462936+0000","last_peered":"2024-09-10T06:28:48.462936+0000","last_clean":"2024-09-10T06:28:48.462936+0000","last_became_active":"2024-09-10T06:26:34.285248+0000","last_became_peered":"2024-09-10T06:26:34.285248+0000","last_unstale":"2024-09-10T06:28:48.462936+0000","last_undegraded":"2024-09-10T06:28:48.462936+0000","last_fullsized":"2024-09-10T06:28:48.462936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:43.907684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"76'32","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460159+0000","last_change":"2024-09-10T06:26:36.296684+0000","last_active":"2024-09-10T06:28:48.460159+0000","last_peered":"2024-09-10T06:28:48.460159+0000","last_clean":"2024-09-10T06:28:48.460159+0000","last_became_active":"2024-09-10T06:26:36.295901+0000","last_became_peered":"2024-09-10T06:26:36.295901+0000","last_unstale":"2024-09-10T06:28:48.460159+0000","last_undegraded":"2024-09-10T06:28:48.460159+0000","last_fullsized":"2024-09-10T06:28:48.460159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61969,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378965+0000","last_change":"2024-09-10T06:26:38.306412+0000","last_active":"2024-09-10T06:28:48.378965+0000","last_peered":"2024-09-10T06:28:48.378965+0000","last_clean":"2024-09-10T06:28:48.378965+0000","last_became_active":"2024-09-10T06:26:38.305496+0000","last_became_peered":"2024-09-10T06:26:38.305496+0000","last_unstale":"2024-09-10T06:28:48.378965+0000","last_undegraded":"2024-09-10T06:28:48.378965+0000","last_fullsized":"2024-09-10T06:28:48.378965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.370035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"64'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456581+0000","last_change":"2024-09-10T06:26:40.331981+0000","last_active":"2024-09-10T06:28:48.456581+0000","last_peered":"2024-09-10T06:28:48.456581+0000","last_clean":"2024-09-10T06:28:48.456581+0000","last_became_active":"2024-09-10T06:26:40.331294+0000","last_became_peered":"2024-09-10T06:26:40.331294+0000","last_unstale":"2024-09-10T06:28:48.456581+0000","last_undegraded":"2024-09-10T06:28:48.456581+0000","last_fullsized":"2024-09-10T06:28:48.456581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:00.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379255+0000","last_change":"2024-09-10T06:26:32.278733+0000","last_active":"2024-09-10T06:28:48.379255+0000","last_peered":"2024-09-10T06:28:48.379255+0000","last_clean":"2024-09-10T06:28:48.379255+0000","last_became_active":"2024-09-10T06:26:32.278118+0000","last_became_peered":"2024-09-10T06:26:32.278118+0000","last_unstale":"2024-09-10T06:28:48.379255+0000","last_undegraded":"2024-09-10T06:28:48.379255+0000","last_fullsized":"2024-09-10T06:28:48.379255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:58.860666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455540+0000","last_change":"2024-09-10T06:26:26.180664+0000","last_active":"2024-09-10T06:28:48.455540+0000","last_peered":"2024-09-10T06:28:48.455540+0000","last_clean":"2024-09-10T06:28:48.455540+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:28:48.455540+0000","last_undegraded":"2024-09-10T06:28:48.455540+0000","last_fullsized":"2024-09-10T06:28:48.455540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:28.793045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"73'11","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375865+0000","last_change":"2024-09-10T06:26:30.594315+0000","last_active":"2024-09-10T06:28:48.375865+0000","last_peered":"2024-09-10T06:28:48.375865+0000","last_clean":"2024-09-10T06:28:48.375865+0000","last_became_active":"2024-09-10T06:26:30.593978+0000","last_became_peered":"2024-09-10T06:26:30.593978+0000","last_unstale":"2024-09-10T06:28:48.375865+0000","last_undegraded":"2024-09-10T06:28:48.375865+0000","last_fullsized":"2024-09-10T06:28:48.375865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:41.851632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460472+0000","last_change":"2024-09-10T06:26:34.279889+0000","last_active":"2024-09-10T06:28:48.460472+0000","last_peered":"2024-09-10T06:28:48.460472+0000","last_clean":"2024-09-10T06:28:48.460472+0000","last_became_active":"2024-09-10T06:26:34.279147+0000","last_became_peered":"2024-09-10T06:26:34.279147+0000","last_unstale":"2024-09-10T06:28:48.460472+0000","last_undegraded":"2024-09-10T06:28:48.460472+0000","last_fullsized":"2024-09-10T06:28:48.460472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:02.260309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'108","reported_seq":327,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.463494+0000","last_change":"2024-09-10T06:26:36.290005+0000","last_active":"2024-09-10T06:28:49.463494+0000","last_peered":"2024-09-10T06:28:49.463494+0000","last_clean":"2024-09-10T06:28:49.463494+0000","last_became_active":"2024-09-10T06:26:36.289232+0000","last_became_peered":"2024-09-10T06:26:36.289232+0000","last_unstale":"2024-09-10T06:28:49.463494+0000","last_undegraded":"2024-09-10T06:28:49.463494+0000","last_fullsized":"2024-09-10T06:28:49.463494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:51.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":141,"num_read_kb":126,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463283+0000","last_change":"2024-09-10T06:26:38.302505+0000","last_active":"2024-09-10T06:28:48.463283+0000","last_peered":"2024-09-10T06:28:48.463283+0000","last_clean":"2024-09-10T06:28:48.463283+0000","last_became_active":"2024-09-10T06:26:38.301104+0000","last_became_peered":"2024-09-10T06:26:38.301104+0000","last_unstale":"2024-09-10T06:28:48.463283+0000","last_undegraded":"2024-09-10T06:28:48.463283+0000","last_fullsized":"2024-09-10T06:28:48.463283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.863622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"76'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453152+0000","last_change":"2024-09-10T06:26:40.320079+0000","last_active":"2024-09-10T06:28:48.453152+0000","last_peered":"2024-09-10T06:28:48.453152+0000","last_clean":"2024-09-10T06:28:48.453152+0000","last_became_active":"2024-09-10T06:26:40.319266+0000","last_became_peered":"2024-09-10T06:26:40.319266+0000","last_unstale":"2024-09-10T06:28:48.453152+0000","last_undegraded":"2024-09-10T06:28:48.453152+0000","last_fullsized":"2024-09-10T06:28:48.453152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:57.937745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"76'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454407+0000","last_change":"2024-09-10T06:26:32.282679+0000","last_active":"2024-09-10T06:28:48.454407+0000","last_peered":"2024-09-10T06:28:48.454407+0000","last_clean":"2024-09-10T06:28:48.454407+0000","last_became_active":"2024-09-10T06:26:32.282235+0000","last_became_peered":"2024-09-10T06:26:32.282235+0000","last_unstale":"2024-09-10T06:28:48.454407+0000","last_undegraded":"2024-09-10T06:28:48.454407+0000","last_fullsized":"2024-09-10T06:28:48.454407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:27.994318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454483+0000","last_change":"2024-09-10T06:26:25.979784+0000","last_active":"2024-09-10T06:28:48.454483+0000","last_peered":"2024-09-10T06:28:48.454483+0000","last_clean":"2024-09-10T06:28:48.454483+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:28:48.454483+0000","last_undegraded":"2024-09-10T06:28:48.454483+0000","last_fullsized":"2024-09-10T06:28:48.454483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:42.490682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"65'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453191+0000","last_change":"2024-09-10T06:26:30.570558+0000","last_active":"2024-09-10T06:28:48.453191+0000","last_peered":"2024-09-10T06:28:48.453191+0000","last_clean":"2024-09-10T06:28:48.453191+0000","last_became_active":"2024-09-10T06:26:30.570037+0000","last_became_peered":"2024-09-10T06:26:30.570037+0000","last_unstale":"2024-09-10T06:28:48.453191+0000","last_undegraded":"2024-09-10T06:28:48.453191+0000","last_fullsized":"2024-09-10T06:28:48.453191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:46.692143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455347+0000","last_change":"2024-09-10T06:26:34.284394+0000","last_active":"2024-09-10T06:28:48.455347+0000","last_peered":"2024-09-10T06:28:48.455347+0000","last_clean":"2024-09-10T06:28:48.455347+0000","last_became_active":"2024-09-10T06:26:34.283980+0000","last_became_peered":"2024-09-10T06:26:34.283980+0000","last_unstale":"2024-09-10T06:28:48.455347+0000","last_undegraded":"2024-09-10T06:28:48.455347+0000","last_fullsized":"2024-09-10T06:28:48.455347+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:38.061123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'19","reported_seq":241,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.467565+0000","last_change":"2024-09-10T06:28:47.073398+0000","last_active":"2024-09-10T06:28:49.467565+0000","last_peered":"2024-09-10T06:28:49.467565+0000","last_clean":"2024-09-10T06:28:49.467565+0000","last_became_active":"2024-09-10T06:28:46.327631+0000","last_became_peered":"2024-09-10T06:28:46.327631+0000","last_unstale":"2024-09-10T06:28:49.467565+0000","last_undegraded":"2024-09-10T06:28:49.467565+0000","last_fullsized":"2024-09-10T06:28:49.467565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:25.802510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375982+0000","last_change":"2024-09-10T06:26:38.292411+0000","last_active":"2024-09-10T06:28:48.375982+0000","last_peered":"2024-09-10T06:28:48.375982+0000","last_clean":"2024-09-10T06:28:48.375982+0000","last_became_active":"2024-09-10T06:26:38.291623+0000","last_became_peered":"2024-09-10T06:26:38.291623+0000","last_unstale":"2024-09-10T06:28:48.375982+0000","last_undegraded":"2024-09-10T06:28:48.375982+0000","last_fullsized":"2024-09-10T06:28:48.375982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377385+0000","last_change":"2024-09-10T06:26:40.303598+0000","last_active":"2024-09-10T06:28:48.377385+0000","last_peered":"2024-09-10T06:28:48.377385+0000","last_clean":"2024-09-10T06:28:48.377385+0000","last_became_active":"2024-09-10T06:26:40.302898+0000","last_became_peered":"2024-09-10T06:26:40.302898+0000","last_unstale":"2024-09-10T06:28:48.377385+0000","last_undegraded":"2024-09-10T06:28:48.377385+0000","last_fullsized":"2024-09-10T06:28:48.377385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:49.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"76'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453765+0000","last_change":"2024-09-10T06:26:32.273484+0000","last_active":"2024-09-10T06:28:48.453765+0000","last_peered":"2024-09-10T06:28:48.453765+0000","last_clean":"2024-09-10T06:28:48.453765+0000","last_became_active":"2024-09-10T06:26:32.273183+0000","last_became_peered":"2024-09-10T06:26:32.273183+0000","last_unstale":"2024-09-10T06:28:48.453765+0000","last_undegraded":"2024-09-10T06:28:48.453765+0000","last_fullsized":"2024-09-10T06:28:48.453765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:32.410538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459095+0000","last_change":"2024-09-10T06:26:25.534289+0000","last_active":"2024-09-10T06:28:48.459095+0000","last_peered":"2024-09-10T06:28:48.459095+0000","last_clean":"2024-09-10T06:28:48.459095+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:28:48.459095+0000","last_undegraded":"2024-09-10T06:28:48.459095+0000","last_fullsized":"2024-09-10T06:28:48.459095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:11.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379406+0000","last_change":"2024-09-10T06:26:30.579693+0000","last_active":"2024-09-10T06:28:48.379406+0000","last_peered":"2024-09-10T06:28:48.379406+0000","last_clean":"2024-09-10T06:28:48.379406+0000","last_became_active":"2024-09-10T06:26:30.577934+0000","last_became_peered":"2024-09-10T06:26:30.577934+0000","last_unstale":"2024-09-10T06:28:48.379406+0000","last_undegraded":"2024-09-10T06:28:48.379406+0000","last_fullsized":"2024-09-10T06:28:48.379406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:35.852655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377724+0000","last_change":"2024-09-10T06:26:34.275458+0000","last_active":"2024-09-10T06:28:48.377724+0000","last_peered":"2024-09-10T06:28:48.377724+0000","last_clean":"2024-09-10T06:28:48.377724+0000","last_became_active":"2024-09-10T06:26:34.274705+0000","last_became_peered":"2024-09-10T06:26:34.274705+0000","last_unstale":"2024-09-10T06:28:48.377724+0000","last_undegraded":"2024-09-10T06:28:48.377724+0000","last_fullsized":"2024-09-10T06:28:48.377724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:20.624872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379364+0000","last_change":"2024-09-10T06:26:36.266077+0000","last_active":"2024-09-10T06:28:48.379364+0000","last_peered":"2024-09-10T06:28:48.379364+0000","last_clean":"2024-09-10T06:28:48.379364+0000","last_became_active":"2024-09-10T06:26:36.265322+0000","last_became_peered":"2024-09-10T06:26:36.265322+0000","last_unstale":"2024-09-10T06:28:48.379364+0000","last_undegraded":"2024-09-10T06:28:48.379364+0000","last_fullsized":"2024-09-10T06:28:48.379364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459162+0000","last_change":"2024-09-10T06:28:46.345843+0000","last_active":"2024-09-10T06:28:48.459162+0000","last_peered":"2024-09-10T06:28:48.459162+0000","last_clean":"2024-09-10T06:28:48.459162+0000","last_became_active":"2024-09-10T06:28:46.344951+0000","last_became_peered":"2024-09-10T06:28:46.344951+0000","last_unstale":"2024-09-10T06:28:48.459162+0000","last_undegraded":"2024-09-10T06:28:48.459162+0000","last_fullsized":"2024-09-10T06:28:48.459162+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:17.825354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"76'8","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456074+0000","last_change":"2024-09-10T06:26:40.326887+0000","last_active":"2024-09-10T06:28:48.456074+0000","last_peered":"2024-09-10T06:28:48.456074+0000","last_clean":"2024-09-10T06:28:48.456074+0000","last_became_active":"2024-09-10T06:26:40.326130+0000","last_became_peered":"2024-09-10T06:26:40.326130+0000","last_unstale":"2024-09-10T06:28:48.456074+0000","last_undegraded":"2024-09-10T06:28:48.456074+0000","last_fullsized":"2024-09-10T06:28:48.456074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:28.237428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'8","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453524+0000","last_change":"2024-09-10T06:26:32.282586+0000","last_active":"2024-09-10T06:28:48.453524+0000","last_peered":"2024-09-10T06:28:48.453524+0000","last_clean":"2024-09-10T06:28:48.453524+0000","last_became_active":"2024-09-10T06:26:32.282086+0000","last_became_peered":"2024-09-10T06:26:32.282086+0000","last_unstale":"2024-09-10T06:28:48.453524+0000","last_undegraded":"2024-09-10T06:28:48.453524+0000","last_fullsized":"2024-09-10T06:28:48.453524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:44.269917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"73'16","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459611+0000","last_change":"2024-09-10T06:26:30.591913+0000","last_active":"2024-09-10T06:28:48.459611+0000","last_peered":"2024-09-10T06:28:48.459611+0000","last_clean":"2024-09-10T06:28:48.459611+0000","last_became_active":"2024-09-10T06:26:30.591140+0000","last_became_peered":"2024-09-10T06:26:30.591140+0000","last_unstale":"2024-09-10T06:28:48.459611+0000","last_undegraded":"2024-09-10T06:28:48.459611+0000","last_fullsized":"2024-09-10T06:28:48.459611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454261+0000","last_change":"2024-09-10T06:26:25.537497+0000","last_active":"2024-09-10T06:28:48.454261+0000","last_peered":"2024-09-10T06:28:48.454261+0000","last_clean":"2024-09-10T06:28:48.454261+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:28:48.454261+0000","last_undegraded":"2024-09-10T06:28:48.454261+0000","last_fullsized":"2024-09-10T06:28:48.454261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:44.787852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376269+0000","last_change":"2024-09-10T06:26:34.276099+0000","last_active":"2024-09-10T06:28:48.376269+0000","last_peered":"2024-09-10T06:28:48.376269+0000","last_clean":"2024-09-10T06:28:48.376269+0000","last_became_active":"2024-09-10T06:26:34.273984+0000","last_became_peered":"2024-09-10T06:26:34.273984+0000","last_unstale":"2024-09-10T06:28:48.376269+0000","last_undegraded":"2024-09-10T06:28:48.376269+0000","last_fullsized":"2024-09-10T06:28:48.376269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'31","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375444+0000","last_change":"2024-09-10T06:26:36.272589+0000","last_active":"2024-09-10T06:28:48.375444+0000","last_peered":"2024-09-10T06:28:48.375444+0000","last_clean":"2024-09-10T06:28:48.375444+0000","last_became_active":"2024-09-10T06:26:36.270914+0000","last_became_peered":"2024-09-10T06:26:36.270914+0000","last_unstale":"2024-09-10T06:28:48.375444+0000","last_undegraded":"2024-09-10T06:28:48.375444+0000","last_fullsized":"2024-09-10T06:28:48.375444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:20.764690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61858,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376397+0000","last_change":"2024-09-10T06:26:38.278069+0000","last_active":"2024-09-10T06:28:48.376397+0000","last_peered":"2024-09-10T06:28:48.376397+0000","last_clean":"2024-09-10T06:28:48.376397+0000","last_became_active":"2024-09-10T06:26:38.277261+0000","last_became_peered":"2024-09-10T06:26:38.277261+0000","last_unstale":"2024-09-10T06:28:48.376397+0000","last_undegraded":"2024-09-10T06:28:48.376397+0000","last_fullsized":"2024-09-10T06:28:48.376397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"67'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378048+0000","last_change":"2024-09-10T06:26:40.333741+0000","last_active":"2024-09-10T06:28:48.378048+0000","last_peered":"2024-09-10T06:28:48.378048+0000","last_clean":"2024-09-10T06:28:48.378048+0000","last_became_active":"2024-09-10T06:26:40.329701+0000","last_became_peered":"2024-09-10T06:26:40.329701+0000","last_unstale":"2024-09-10T06:28:48.378048+0000","last_undegraded":"2024-09-10T06:28:48.378048+0000","last_fullsized":"2024-09-10T06:28:48.378048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:53.704790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"67'4","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376410+0000","last_change":"2024-09-10T06:26:32.275551+0000","last_active":"2024-09-10T06:28:48.376410+0000","last_peered":"2024-09-10T06:28:48.376410+0000","last_clean":"2024-09-10T06:28:48.376410+0000","last_became_active":"2024-09-10T06:26:32.274946+0000","last_became_peered":"2024-09-10T06:26:32.274946+0000","last_unstale":"2024-09-10T06:28:48.376410+0000","last_undegraded":"2024-09-10T06:28:48.376410+0000","last_fullsized":"2024-09-10T06:28:48.376410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"73'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454016+0000","last_change":"2024-09-10T06:26:30.565595+0000","last_active":"2024-09-10T06:28:48.454016+0000","last_peered":"2024-09-10T06:28:48.454016+0000","last_clean":"2024-09-10T06:28:48.454016+0000","last_became_active":"2024-09-10T06:26:30.565220+0000","last_became_peered":"2024-09-10T06:26:30.565220+0000","last_unstale":"2024-09-10T06:28:48.454016+0000","last_undegraded":"2024-09-10T06:28:48.454016+0000","last_fullsized":"2024-09-10T06:28:48.454016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:14.600216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464321+0000","last_change":"2024-09-10T06:26:26.180820+0000","last_active":"2024-09-10T06:28:48.464321+0000","last_peered":"2024-09-10T06:28:48.464321+0000","last_clean":"2024-09-10T06:28:48.464321+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:28:48.464321+0000","last_undegraded":"2024-09-10T06:28:48.464321+0000","last_fullsized":"2024-09-10T06:28:48.464321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:51.928304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458371+0000","last_change":"2024-09-10T06:26:34.272915+0000","last_active":"2024-09-10T06:28:48.458371+0000","last_peered":"2024-09-10T06:28:48.458371+0000","last_clean":"2024-09-10T06:28:48.458371+0000","last_became_active":"2024-09-10T06:26:34.272192+0000","last_became_peered":"2024-09-10T06:26:34.272192+0000","last_unstale":"2024-09-10T06:28:48.458371+0000","last_undegraded":"2024-09-10T06:28:48.458371+0000","last_fullsized":"2024-09-10T06:28:48.458371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:07.874348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453060+0000","last_change":"2024-09-10T06:26:36.291431+0000","last_active":"2024-09-10T06:28:48.453060+0000","last_peered":"2024-09-10T06:28:48.453060+0000","last_clean":"2024-09-10T06:28:48.453060+0000","last_became_active":"2024-09-10T06:26:36.290570+0000","last_became_peered":"2024-09-10T06:26:36.290570+0000","last_unstale":"2024-09-10T06:28:48.453060+0000","last_undegraded":"2024-09-10T06:28:48.453060+0000","last_fullsized":"2024-09-10T06:28:48.453060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:10.565531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'102","reported_seq":283,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.464656+0000","last_change":"2024-09-10T06:26:38.312069+0000","last_active":"2024-09-10T06:28:49.464656+0000","last_peered":"2024-09-10T06:28:49.464656+0000","last_clean":"2024-09-10T06:28:49.464656+0000","last_became_active":"2024-09-10T06:26:38.310450+0000","last_became_peered":"2024-09-10T06:26:38.310450+0000","last_unstale":"2024-09-10T06:28:49.464656+0000","last_undegraded":"2024-09-10T06:28:49.464656+0000","last_fullsized":"2024-09-10T06:28:49.464656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379767+0000","last_change":"2024-09-10T06:26:40.312990+0000","last_active":"2024-09-10T06:28:48.379767+0000","last_peered":"2024-09-10T06:28:48.379767+0000","last_clean":"2024-09-10T06:28:48.379767+0000","last_became_active":"2024-09-10T06:26:40.312266+0000","last_became_peered":"2024-09-10T06:26:40.312266+0000","last_unstale":"2024-09-10T06:28:48.379767+0000","last_undegraded":"2024-09-10T06:28:48.379767+0000","last_fullsized":"2024-09-10T06:28:48.379767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:15.777105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"76'4","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375253+0000","last_change":"2024-09-10T06:26:32.258874+0000","last_active":"2024-09-10T06:28:48.375253+0000","last_peered":"2024-09-10T06:28:48.375253+0000","last_clean":"2024-09-10T06:28:48.375253+0000","last_became_active":"2024-09-10T06:26:32.258337+0000","last_became_peered":"2024-09-10T06:26:32.258337+0000","last_unstale":"2024-09-10T06:28:48.375253+0000","last_undegraded":"2024-09-10T06:28:48.375253+0000","last_fullsized":"2024-09-10T06:28:48.375253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"73'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379418+0000","last_change":"2024-09-10T06:26:30.581501+0000","last_active":"2024-09-10T06:28:48.379418+0000","last_peered":"2024-09-10T06:28:48.379418+0000","last_clean":"2024-09-10T06:28:48.379418+0000","last_became_active":"2024-09-10T06:26:30.581115+0000","last_became_peered":"2024-09-10T06:26:30.581115+0000","last_unstale":"2024-09-10T06:28:48.379418+0000","last_undegraded":"2024-09-10T06:28:48.379418+0000","last_fullsized":"2024-09-10T06:28:48.379418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454045+0000","last_change":"2024-09-10T06:26:25.537295+0000","last_active":"2024-09-10T06:28:48.454045+0000","last_peered":"2024-09-10T06:28:48.454045+0000","last_clean":"2024-09-10T06:28:48.454045+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:28:48.454045+0000","last_undegraded":"2024-09-10T06:28:48.454045+0000","last_fullsized":"2024-09-10T06:28:48.454045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:32.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377381+0000","last_change":"2024-09-10T06:26:34.258956+0000","last_active":"2024-09-10T06:28:48.377381+0000","last_peered":"2024-09-10T06:28:48.377381+0000","last_clean":"2024-09-10T06:28:48.377381+0000","last_became_active":"2024-09-10T06:26:34.257739+0000","last_became_peered":"2024-09-10T06:26:34.257739+0000","last_unstale":"2024-09-10T06:28:48.377381+0000","last_undegraded":"2024-09-10T06:28:48.377381+0000","last_fullsized":"2024-09-10T06:28:48.377381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:18.547827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'10","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377884+0000","last_change":"2024-09-10T06:26:36.271096+0000","last_active":"2024-09-10T06:28:48.377884+0000","last_peered":"2024-09-10T06:28:48.377884+0000","last_clean":"2024-09-10T06:28:48.377884+0000","last_became_active":"2024-09-10T06:26:36.270325+0000","last_became_peered":"2024-09-10T06:26:36.270325+0000","last_unstale":"2024-09-10T06:28:48.377884+0000","last_undegraded":"2024-09-10T06:28:48.377884+0000","last_fullsized":"2024-09-10T06:28:48.377884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'102","reported_seq":269,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.464971+0000","last_change":"2024-09-10T06:26:38.300795+0000","last_active":"2024-09-10T06:28:49.464971+0000","last_peered":"2024-09-10T06:28:49.464971+0000","last_clean":"2024-09-10T06:28:49.464971+0000","last_became_active":"2024-09-10T06:26:38.299466+0000","last_became_peered":"2024-09-10T06:26:38.299466+0000","last_unstale":"2024-09-10T06:28:49.464971+0000","last_undegraded":"2024-09-10T06:28:49.464971+0000","last_fullsized":"2024-09-10T06:28:49.464971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:38.641500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"67'4","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377214+0000","last_change":"2024-09-10T06:26:40.329688+0000","last_active":"2024-09-10T06:28:48.377214+0000","last_peered":"2024-09-10T06:28:48.377214+0000","last_clean":"2024-09-10T06:28:48.377214+0000","last_became_active":"2024-09-10T06:26:40.329009+0000","last_became_peered":"2024-09-10T06:26:40.329009+0000","last_unstale":"2024-09-10T06:28:48.377214+0000","last_undegraded":"2024-09-10T06:28:48.377214+0000","last_fullsized":"2024-09-10T06:28:48.377214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'8","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377758+0000","last_change":"2024-09-10T06:26:32.283524+0000","last_active":"2024-09-10T06:28:48.377758+0000","last_peered":"2024-09-10T06:28:48.377758+0000","last_clean":"2024-09-10T06:28:48.377758+0000","last_became_active":"2024-09-10T06:26:32.282794+0000","last_became_peered":"2024-09-10T06:26:32.282794+0000","last_unstale":"2024-09-10T06:28:48.377758+0000","last_undegraded":"2024-09-10T06:28:48.377758+0000","last_fullsized":"2024-09-10T06:28:48.377758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:11.537416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"73'6","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379512+0000","last_change":"2024-09-10T06:26:30.578273+0000","last_active":"2024-09-10T06:28:48.379512+0000","last_peered":"2024-09-10T06:28:48.379512+0000","last_clean":"2024-09-10T06:28:48.379512+0000","last_became_active":"2024-09-10T06:26:30.577985+0000","last_became_peered":"2024-09-10T06:26:30.577985+0000","last_unstale":"2024-09-10T06:28:48.379512+0000","last_undegraded":"2024-09-10T06:28:48.379512+0000","last_fullsized":"2024-09-10T06:28:48.379512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460109+0000","last_change":"2024-09-10T06:26:26.037773+0000","last_active":"2024-09-10T06:28:48.460109+0000","last_peered":"2024-09-10T06:28:48.460109+0000","last_clean":"2024-09-10T06:28:48.460109+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:28:48.460109+0000","last_undegraded":"2024-09-10T06:28:48.460109+0000","last_fullsized":"2024-09-10T06:28:48.460109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:21.949708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374863+0000","last_change":"2024-09-10T06:26:34.268710+0000","last_active":"2024-09-10T06:28:48.374863+0000","last_peered":"2024-09-10T06:28:48.374863+0000","last_clean":"2024-09-10T06:28:48.374863+0000","last_became_active":"2024-09-10T06:26:34.268359+0000","last_became_peered":"2024-09-10T06:26:34.268359+0000","last_unstale":"2024-09-10T06:28:48.374863+0000","last_undegraded":"2024-09-10T06:28:48.374863+0000","last_fullsized":"2024-09-10T06:28:48.374863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:27.191787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"76'37","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462144+0000","last_change":"2024-09-10T06:26:36.299700+0000","last_active":"2024-09-10T06:28:48.462144+0000","last_peered":"2024-09-10T06:28:48.462144+0000","last_clean":"2024-09-10T06:28:48.462144+0000","last_became_active":"2024-09-10T06:26:36.297606+0000","last_became_peered":"2024-09-10T06:26:36.297606+0000","last_unstale":"2024-09-10T06:28:48.462144+0000","last_undegraded":"2024-09-10T06:28:48.462144+0000","last_fullsized":"2024-09-10T06:28:48.462144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375382+0000","last_change":"2024-09-10T06:26:38.290601+0000","last_active":"2024-09-10T06:28:48.375382+0000","last_peered":"2024-09-10T06:28:48.375382+0000","last_clean":"2024-09-10T06:28:48.375382+0000","last_became_active":"2024-09-10T06:26:38.289589+0000","last_became_peered":"2024-09-10T06:26:38.289589+0000","last_unstale":"2024-09-10T06:28:48.375382+0000","last_undegraded":"2024-09-10T06:28:48.375382+0000","last_fullsized":"2024-09-10T06:28:48.375382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:22.625936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458656+0000","last_change":"2024-09-10T06:26:40.332819+0000","last_active":"2024-09-10T06:28:48.458656+0000","last_peered":"2024-09-10T06:28:48.458656+0000","last_clean":"2024-09-10T06:28:48.458656+0000","last_became_active":"2024-09-10T06:26:40.332160+0000","last_became_peered":"2024-09-10T06:26:40.332160+0000","last_unstale":"2024-09-10T06:28:48.458656+0000","last_undegraded":"2024-09-10T06:28:48.458656+0000","last_fullsized":"2024-09-10T06:28:48.458656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.784870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378032+0000","last_change":"2024-09-10T06:26:40.334393+0000","last_active":"2024-09-10T06:28:48.378032+0000","last_peered":"2024-09-10T06:28:48.378032+0000","last_clean":"2024-09-10T06:28:48.378032+0000","last_became_active":"2024-09-10T06:26:40.333474+0000","last_became_peered":"2024-09-10T06:26:40.333474+0000","last_unstale":"2024-09-10T06:28:48.378032+0000","last_undegraded":"2024-09-10T06:28:48.378032+0000","last_fullsized":"2024-09-10T06:28:48.378032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:35.031954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'6","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379197+0000","last_change":"2024-09-10T06:26:32.272914+0000","last_active":"2024-09-10T06:28:48.379197+0000","last_peered":"2024-09-10T06:28:48.379197+0000","last_clean":"2024-09-10T06:28:48.379197+0000","last_became_active":"2024-09-10T06:26:32.272178+0000","last_became_peered":"2024-09-10T06:26:32.272178+0000","last_unstale":"2024-09-10T06:28:48.379197+0000","last_undegraded":"2024-09-10T06:28:48.379197+0000","last_fullsized":"2024-09-10T06:28:48.379197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"72'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379651+0000","last_change":"2024-09-10T06:26:30.593531+0000","last_active":"2024-09-10T06:28:48.379651+0000","last_peered":"2024-09-10T06:28:48.379651+0000","last_clean":"2024-09-10T06:28:48.379651+0000","last_became_active":"2024-09-10T06:26:30.592753+0000","last_became_peered":"2024-09-10T06:26:30.592753+0000","last_unstale":"2024-09-10T06:28:48.379651+0000","last_undegraded":"2024-09-10T06:28:48.379651+0000","last_fullsized":"2024-09-10T06:28:48.379651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:14.506864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453697+0000","last_change":"2024-09-10T06:26:34.282877+0000","last_active":"2024-09-10T06:28:48.453697+0000","last_peered":"2024-09-10T06:28:48.453697+0000","last_clean":"2024-09-10T06:28:48.453697+0000","last_became_active":"2024-09-10T06:26:34.282281+0000","last_became_peered":"2024-09-10T06:26:34.282281+0000","last_unstale":"2024-09-10T06:28:48.453697+0000","last_undegraded":"2024-09-10T06:28:48.453697+0000","last_fullsized":"2024-09-10T06:28:48.453697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:41.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"76'17","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374658+0000","last_change":"2024-09-10T06:26:36.273166+0000","last_active":"2024-09-10T06:28:48.374658+0000","last_peered":"2024-09-10T06:28:48.374658+0000","last_clean":"2024-09-10T06:28:48.374658+0000","last_became_active":"2024-09-10T06:26:36.272386+0000","last_became_peered":"2024-09-10T06:26:36.272386+0000","last_unstale":"2024-09-10T06:28:48.374658+0000","last_undegraded":"2024-09-10T06:28:48.374658+0000","last_fullsized":"2024-09-10T06:28:48.374658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374570+0000","last_change":"2024-09-10T06:26:38.297347+0000","last_active":"2024-09-10T06:28:48.374570+0000","last_peered":"2024-09-10T06:28:48.374570+0000","last_clean":"2024-09-10T06:28:48.374570+0000","last_became_active":"2024-09-10T06:26:38.296600+0000","last_became_peered":"2024-09-10T06:26:38.296600+0000","last_unstale":"2024-09-10T06:28:48.374570+0000","last_undegraded":"2024-09-10T06:28:48.374570+0000","last_fullsized":"2024-09-10T06:28:48.374570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:08.758126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"67'20","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379025+0000","last_change":"2024-09-10T06:26:40.321844+0000","last_active":"2024-09-10T06:28:48.379025+0000","last_peered":"2024-09-10T06:28:48.379025+0000","last_clean":"2024-09-10T06:28:48.379025+0000","last_became_active":"2024-09-10T06:26:40.321097+0000","last_became_peered":"2024-09-10T06:26:40.321097+0000","last_unstale":"2024-09-10T06:28:48.379025+0000","last_undegraded":"2024-09-10T06:28:48.379025+0000","last_fullsized":"2024-09-10T06:28:48.379025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:10.004849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"67'6","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453454+0000","last_change":"2024-09-10T06:26:32.286989+0000","last_active":"2024-09-10T06:28:48.453454+0000","last_peered":"2024-09-10T06:28:48.453454+0000","last_clean":"2024-09-10T06:28:48.453454+0000","last_became_active":"2024-09-10T06:26:32.286519+0000","last_became_peered":"2024-09-10T06:26:32.286519+0000","last_unstale":"2024-09-10T06:28:48.453454+0000","last_undegraded":"2024-09-10T06:28:48.453454+0000","last_fullsized":"2024-09-10T06:28:48.453454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:31.592472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'6","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464000+0000","last_change":"2024-09-10T06:26:30.587315+0000","last_active":"2024-09-10T06:28:48.464000+0000","last_peered":"2024-09-10T06:28:48.464000+0000","last_clean":"2024-09-10T06:28:48.464000+0000","last_became_active":"2024-09-10T06:26:30.586611+0000","last_became_peered":"2024-09-10T06:26:30.586611+0000","last_unstale":"2024-09-10T06:28:48.464000+0000","last_undegraded":"2024-09-10T06:28:48.464000+0000","last_fullsized":"2024-09-10T06:28:48.464000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"27'1","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377148+0000","last_change":"2024-09-10T06:26:34.271770+0000","last_active":"2024-09-10T06:28:48.377148+0000","last_peered":"2024-09-10T06:28:48.377148+0000","last_clean":"2024-09-10T06:28:48.377148+0000","last_became_active":"2024-09-10T06:26:34.269875+0000","last_became_peered":"2024-09-10T06:26:34.269875+0000","last_unstale":"2024-09-10T06:28:48.377148+0000","last_undegraded":"2024-09-10T06:28:48.377148+0000","last_fullsized":"2024-09-10T06:28:48.377148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:09.570079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"67'6","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375286+0000","last_change":"2024-09-10T06:26:36.289140+0000","last_active":"2024-09-10T06:28:48.375286+0000","last_peered":"2024-09-10T06:28:48.375286+0000","last_clean":"2024-09-10T06:28:48.375286+0000","last_became_active":"2024-09-10T06:26:36.288355+0000","last_became_peered":"2024-09-10T06:26:36.288355+0000","last_unstale":"2024-09-10T06:28:48.375286+0000","last_undegraded":"2024-09-10T06:28:48.375286+0000","last_fullsized":"2024-09-10T06:28:48.375286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:42.518982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456930+0000","last_change":"2024-09-10T06:26:38.302040+0000","last_active":"2024-09-10T06:28:48.456930+0000","last_peered":"2024-09-10T06:28:48.456930+0000","last_clean":"2024-09-10T06:28:48.456930+0000","last_became_active":"2024-09-10T06:26:38.301064+0000","last_became_peered":"2024-09-10T06:26:38.301064+0000","last_unstale":"2024-09-10T06:28:48.456930+0000","last_undegraded":"2024-09-10T06:28:48.456930+0000","last_fullsized":"2024-09-10T06:28:48.456930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:41.513255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"64'4","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377597+0000","last_change":"2024-09-10T06:26:40.322368+0000","last_active":"2024-09-10T06:28:48.377597+0000","last_peered":"2024-09-10T06:28:48.377597+0000","last_clean":"2024-09-10T06:28:48.377597+0000","last_became_active":"2024-09-10T06:26:40.321592+0000","last_became_peered":"2024-09-10T06:26:40.321592+0000","last_unstale":"2024-09-10T06:28:48.377597+0000","last_undegraded":"2024-09-10T06:28:48.377597+0000","last_fullsized":"2024-09-10T06:28:48.377597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:03.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"61'4","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375592+0000","last_change":"2024-09-10T06:26:32.259666+0000","last_active":"2024-09-10T06:28:48.375592+0000","last_peered":"2024-09-10T06:28:48.375592+0000","last_clean":"2024-09-10T06:28:48.375592+0000","last_became_active":"2024-09-10T06:26:32.258775+0000","last_became_peered":"2024-09-10T06:26:32.258775+0000","last_unstale":"2024-09-10T06:28:48.375592+0000","last_undegraded":"2024-09-10T06:28:48.375592+0000","last_fullsized":"2024-09-10T06:28:48.375592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"72'13","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460597+0000","last_change":"2024-09-10T06:26:30.592773+0000","last_active":"2024-09-10T06:28:48.460597+0000","last_peered":"2024-09-10T06:28:48.460597+0000","last_clean":"2024-09-10T06:28:48.460597+0000","last_became_active":"2024-09-10T06:26:30.590566+0000","last_became_peered":"2024-09-10T06:26:30.590566+0000","last_unstale":"2024-09-10T06:28:48.460597+0000","last_undegraded":"2024-09-10T06:28:48.460597+0000","last_fullsized":"2024-09-10T06:28:48.460597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:35.688897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455138+0000","last_change":"2024-09-10T06:26:34.281690+0000","last_active":"2024-09-10T06:28:48.455138+0000","last_peered":"2024-09-10T06:28:48.455138+0000","last_clean":"2024-09-10T06:28:48.455138+0000","last_became_active":"2024-09-10T06:26:34.281008+0000","last_became_peered":"2024-09-10T06:26:34.281008+0000","last_unstale":"2024-09-10T06:28:48.455138+0000","last_undegraded":"2024-09-10T06:28:48.455138+0000","last_fullsized":"2024-09-10T06:28:48.455138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"76'17","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375413+0000","last_change":"2024-09-10T06:26:36.277028+0000","last_active":"2024-09-10T06:28:48.375413+0000","last_peered":"2024-09-10T06:28:48.375413+0000","last_clean":"2024-09-10T06:28:48.375413+0000","last_became_active":"2024-09-10T06:26:36.276248+0000","last_became_peered":"2024-09-10T06:26:36.276248+0000","last_unstale":"2024-09-10T06:28:48.375413+0000","last_undegraded":"2024-09-10T06:28:48.375413+0000","last_fullsized":"2024-09-10T06:28:48.375413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:53.521681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457566+0000","last_change":"2024-09-10T06:28:46.344566+0000","last_active":"2024-09-10T06:28:48.457566+0000","last_peered":"2024-09-10T06:28:48.457566+0000","last_clean":"2024-09-10T06:28:48.457566+0000","last_became_active":"2024-09-10T06:28:46.343657+0000","last_became_peered":"2024-09-10T06:28:46.343657+0000","last_unstale":"2024-09-10T06:28:48.457566+0000","last_undegraded":"2024-09-10T06:28:48.457566+0000","last_fullsized":"2024-09-10T06:28:48.457566+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:25.681176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460858+0000","last_change":"2024-09-10T06:26:40.331445+0000","last_active":"2024-09-10T06:28:48.460858+0000","last_peered":"2024-09-10T06:28:48.460858+0000","last_clean":"2024-09-10T06:28:48.460858+0000","last_became_active":"2024-09-10T06:26:40.330707+0000","last_became_peered":"2024-09-10T06:26:40.330707+0000","last_unstale":"2024-09-10T06:28:48.460858+0000","last_undegraded":"2024-09-10T06:28:48.460858+0000","last_fullsized":"2024-09-10T06:28:48.460858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.822687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375781+0000","last_change":"2024-09-10T06:26:32.266221+0000","last_active":"2024-09-10T06:28:48.375781+0000","last_peered":"2024-09-10T06:28:48.375781+0000","last_clean":"2024-09-10T06:28:48.375781+0000","last_became_active":"2024-09-10T06:26:32.265705+0000","last_became_peered":"2024-09-10T06:26:32.265705+0000","last_unstale":"2024-09-10T06:28:48.375781+0000","last_undegraded":"2024-09-10T06:28:48.375781+0000","last_fullsized":"2024-09-10T06:28:48.375781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"73'9","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378324+0000","last_change":"2024-09-10T06:26:30.594335+0000","last_active":"2024-09-10T06:28:48.378324+0000","last_peered":"2024-09-10T06:28:48.378324+0000","last_clean":"2024-09-10T06:28:48.378324+0000","last_became_active":"2024-09-10T06:26:30.593326+0000","last_became_peered":"2024-09-10T06:26:30.593326+0000","last_unstale":"2024-09-10T06:28:48.378324+0000","last_undegraded":"2024-09-10T06:28:48.378324+0000","last_fullsized":"2024-09-10T06:28:48.378324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:37.297722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457418+0000","last_change":"2024-09-10T06:26:34.281915+0000","last_active":"2024-09-10T06:28:48.457418+0000","last_peered":"2024-09-10T06:28:48.457418+0000","last_clean":"2024-09-10T06:28:48.457418+0000","last_became_active":"2024-09-10T06:26:34.281147+0000","last_became_peered":"2024-09-10T06:26:34.281147+0000","last_unstale":"2024-09-10T06:28:48.457418+0000","last_undegraded":"2024-09-10T06:28:48.457418+0000","last_fullsized":"2024-09-10T06:28:48.457418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:41.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"76'15","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458225+0000","last_change":"2024-09-10T06:26:36.298537+0000","last_active":"2024-09-10T06:28:48.458225+0000","last_peered":"2024-09-10T06:28:48.458225+0000","last_clean":"2024-09-10T06:28:48.458225+0000","last_became_active":"2024-09-10T06:26:36.297372+0000","last_became_peered":"2024-09-10T06:26:36.297372+0000","last_unstale":"2024-09-10T06:28:48.458225+0000","last_undegraded":"2024-09-10T06:28:48.458225+0000","last_fullsized":"2024-09-10T06:28:48.458225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376070+0000","last_change":"2024-09-10T06:26:38.301461+0000","last_active":"2024-09-10T06:28:48.376070+0000","last_peered":"2024-09-10T06:28:48.376070+0000","last_clean":"2024-09-10T06:28:48.376070+0000","last_became_active":"2024-09-10T06:26:38.300580+0000","last_became_peered":"2024-09-10T06:26:38.300580+0000","last_unstale":"2024-09-10T06:28:48.376070+0000","last_undegraded":"2024-09-10T06:28:48.376070+0000","last_fullsized":"2024-09-10T06:28:48.376070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"67'10","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459745+0000","last_change":"2024-09-10T06:26:32.285276+0000","last_active":"2024-09-10T06:28:48.459745+0000","last_peered":"2024-09-10T06:28:48.459745+0000","last_clean":"2024-09-10T06:28:48.459745+0000","last_became_active":"2024-09-10T06:26:32.284457+0000","last_became_peered":"2024-09-10T06:26:32.284457+0000","last_unstale":"2024-09-10T06:28:48.459745+0000","last_undegraded":"2024-09-10T06:28:48.459745+0000","last_fullsized":"2024-09-10T06:28:48.459745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:37.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"72'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376276+0000","last_change":"2024-09-10T06:26:30.573339+0000","last_active":"2024-09-10T06:28:48.376276+0000","last_peered":"2024-09-10T06:28:48.376276+0000","last_clean":"2024-09-10T06:28:48.376276+0000","last_became_active":"2024-09-10T06:26:30.571377+0000","last_became_peered":"2024-09-10T06:26:30.571377+0000","last_unstale":"2024-09-10T06:28:48.376276+0000","last_undegraded":"2024-09-10T06:28:48.376276+0000","last_fullsized":"2024-09-10T06:28:48.376276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:59.752497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378936+0000","last_change":"2024-09-10T06:26:34.269013+0000","last_active":"2024-09-10T06:28:48.378936+0000","last_peered":"2024-09-10T06:28:48.378936+0000","last_clean":"2024-09-10T06:28:48.378936+0000","last_became_active":"2024-09-10T06:26:34.268677+0000","last_became_peered":"2024-09-10T06:26:34.268677+0000","last_unstale":"2024-09-10T06:28:48.378936+0000","last_undegraded":"2024-09-10T06:28:48.378936+0000","last_fullsized":"2024-09-10T06:28:48.378936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"76'24","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453781+0000","last_change":"2024-09-10T06:26:36.300362+0000","last_active":"2024-09-10T06:28:48.453781+0000","last_peered":"2024-09-10T06:28:48.453781+0000","last_clean":"2024-09-10T06:28:48.453781+0000","last_became_active":"2024-09-10T06:26:36.299645+0000","last_became_peered":"2024-09-10T06:26:36.299645+0000","last_unstale":"2024-09-10T06:28:48.453781+0000","last_undegraded":"2024-09-10T06:28:48.453781+0000","last_fullsized":"2024-09-10T06:28:48.453781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:17.424354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461312+0000","last_change":"2024-09-10T06:26:38.299751+0000","last_active":"2024-09-10T06:28:48.461312+0000","last_peered":"2024-09-10T06:28:48.461312+0000","last_clean":"2024-09-10T06:28:48.461312+0000","last_became_active":"2024-09-10T06:26:38.298414+0000","last_became_peered":"2024-09-10T06:26:38.298414+0000","last_unstale":"2024-09-10T06:28:48.461312+0000","last_undegraded":"2024-09-10T06:28:48.461312+0000","last_fullsized":"2024-09-10T06:28:48.461312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'2","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375129+0000","last_change":"2024-09-10T06:26:40.312752+0000","last_active":"2024-09-10T06:28:48.375129+0000","last_peered":"2024-09-10T06:28:48.375129+0000","last_clean":"2024-09-10T06:28:48.375129+0000","last_became_active":"2024-09-10T06:26:40.312026+0000","last_became_peered":"2024-09-10T06:26:40.312026+0000","last_unstale":"2024-09-10T06:28:48.375129+0000","last_undegraded":"2024-09-10T06:28:48.375129+0000","last_fullsized":"2024-09-10T06:28:48.375129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:50.071224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379114+0000","last_change":"2024-09-10T06:26:32.266934+0000","last_active":"2024-09-10T06:28:48.379114+0000","last_peered":"2024-09-10T06:28:48.379114+0000","last_clean":"2024-09-10T06:28:48.379114+0000","last_became_active":"2024-09-10T06:26:32.266682+0000","last_became_peered":"2024-09-10T06:26:32.266682+0000","last_unstale":"2024-09-10T06:28:48.379114+0000","last_undegraded":"2024-09-10T06:28:48.379114+0000","last_fullsized":"2024-09-10T06:28:48.379114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"73'15","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453970+0000","last_change":"2024-09-10T06:26:30.579097+0000","last_active":"2024-09-10T06:28:48.453970+0000","last_peered":"2024-09-10T06:28:48.453970+0000","last_clean":"2024-09-10T06:28:48.453970+0000","last_became_active":"2024-09-10T06:26:30.578692+0000","last_became_peered":"2024-09-10T06:26:30.578692+0000","last_unstale":"2024-09-10T06:28:48.453970+0000","last_undegraded":"2024-09-10T06:28:48.453970+0000","last_fullsized":"2024-09-10T06:28:48.453970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:15.878123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":23,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"27'1","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459372+0000","last_change":"2024-09-10T06:26:34.282356+0000","last_active":"2024-09-10T06:28:48.459372+0000","last_peered":"2024-09-10T06:28:48.459372+0000","last_clean":"2024-09-10T06:28:48.459372+0000","last_became_active":"2024-09-10T06:26:34.281167+0000","last_became_peered":"2024-09-10T06:26:34.281167+0000","last_unstale":"2024-09-10T06:28:48.459372+0000","last_undegraded":"2024-09-10T06:28:48.459372+0000","last_fullsized":"2024-09-10T06:28:48.459372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:59.042394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"76'22","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462750+0000","last_change":"2024-09-10T06:26:36.301277+0000","last_active":"2024-09-10T06:28:48.462750+0000","last_peered":"2024-09-10T06:28:48.462750+0000","last_clean":"2024-09-10T06:28:48.462750+0000","last_became_active":"2024-09-10T06:26:36.300501+0000","last_became_peered":"2024-09-10T06:26:36.300501+0000","last_unstale":"2024-09-10T06:28:48.462750+0000","last_undegraded":"2024-09-10T06:28:48.462750+0000","last_fullsized":"2024-09-10T06:28:48.462750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:38.477946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454339+0000","last_change":"2024-09-10T06:26:38.305737+0000","last_active":"2024-09-10T06:28:48.454339+0000","last_peered":"2024-09-10T06:28:48.454339+0000","last_clean":"2024-09-10T06:28:48.454339+0000","last_became_active":"2024-09-10T06:26:38.303318+0000","last_became_peered":"2024-09-10T06:26:38.303318+0000","last_unstale":"2024-09-10T06:28:48.454339+0000","last_undegraded":"2024-09-10T06:28:48.454339+0000","last_fullsized":"2024-09-10T06:28:48.454339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:52.587622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"67'10","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458108+0000","last_change":"2024-09-10T06:26:40.318587+0000","last_active":"2024-09-10T06:28:48.458108+0000","last_peered":"2024-09-10T06:28:48.458108+0000","last_clean":"2024-09-10T06:28:48.458108+0000","last_became_active":"2024-09-10T06:26:40.317695+0000","last_became_peered":"2024-09-10T06:26:40.317695+0000","last_unstale":"2024-09-10T06:28:48.458108+0000","last_undegraded":"2024-09-10T06:28:48.458108+0000","last_fullsized":"2024-09-10T06:28:48.458108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:48.298686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379045+0000","last_change":"2024-09-10T06:26:32.276218+0000","last_active":"2024-09-10T06:28:48.379045+0000","last_peered":"2024-09-10T06:28:48.379045+0000","last_clean":"2024-09-10T06:28:48.379045+0000","last_became_active":"2024-09-10T06:26:32.275805+0000","last_became_peered":"2024-09-10T06:26:32.275805+0000","last_unstale":"2024-09-10T06:28:48.379045+0000","last_undegraded":"2024-09-10T06:28:48.379045+0000","last_fullsized":"2024-09-10T06:28:48.379045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"73'7","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378905+0000","last_change":"2024-09-10T06:26:30.568731+0000","last_active":"2024-09-10T06:28:48.378905+0000","last_peered":"2024-09-10T06:28:48.378905+0000","last_clean":"2024-09-10T06:28:48.378905+0000","last_became_active":"2024-09-10T06:26:30.567937+0000","last_became_peered":"2024-09-10T06:26:30.567937+0000","last_unstale":"2024-09-10T06:28:48.378905+0000","last_undegraded":"2024-09-10T06:28:48.378905+0000","last_fullsized":"2024-09-10T06:28:48.378905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:18.974865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380895+0000","last_change":"2024-09-10T06:26:34.266227+0000","last_active":"2024-09-10T06:28:48.380895+0000","last_peered":"2024-09-10T06:28:48.380895+0000","last_clean":"2024-09-10T06:28:48.380895+0000","last_became_active":"2024-09-10T06:26:34.262443+0000","last_became_peered":"2024-09-10T06:26:34.262443+0000","last_unstale":"2024-09-10T06:28:48.380895+0000","last_undegraded":"2024-09-10T06:28:48.380895+0000","last_fullsized":"2024-09-10T06:28:48.380895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.918813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"76'18","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379862+0000","last_change":"2024-09-10T06:26:36.292958+0000","last_active":"2024-09-10T06:28:48.379862+0000","last_peered":"2024-09-10T06:28:48.379862+0000","last_clean":"2024-09-10T06:28:48.379862+0000","last_became_active":"2024-09-10T06:26:36.292149+0000","last_became_peered":"2024-09-10T06:26:36.292149+0000","last_unstale":"2024-09-10T06:28:48.379862+0000","last_undegraded":"2024-09-10T06:28:48.379862+0000","last_fullsized":"2024-09-10T06:28:48.379862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453832+0000","last_change":"2024-09-10T06:26:38.302991+0000","last_active":"2024-09-10T06:28:48.453832+0000","last_peered":"2024-09-10T06:28:48.453832+0000","last_clean":"2024-09-10T06:28:48.453832+0000","last_became_active":"2024-09-10T06:26:38.289306+0000","last_became_peered":"2024-09-10T06:26:38.289306+0000","last_unstale":"2024-09-10T06:28:48.453832+0000","last_undegraded":"2024-09-10T06:28:48.453832+0000","last_fullsized":"2024-09-10T06:28:48.453832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:57.625329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456492+0000","last_change":"2024-09-10T06:26:40.327627+0000","last_active":"2024-09-10T06:28:48.456492+0000","last_peered":"2024-09-10T06:28:48.456492+0000","last_clean":"2024-09-10T06:28:48.456492+0000","last_became_active":"2024-09-10T06:26:40.326888+0000","last_became_peered":"2024-09-10T06:26:40.326888+0000","last_unstale":"2024-09-10T06:28:48.456492+0000","last_undegraded":"2024-09-10T06:28:48.456492+0000","last_fullsized":"2024-09-10T06:28:48.456492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:41.122562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455208+0000","last_change":"2024-09-10T06:26:32.275071+0000","last_active":"2024-09-10T06:28:48.455208+0000","last_peered":"2024-09-10T06:28:48.455208+0000","last_clean":"2024-09-10T06:28:48.455208+0000","last_became_active":"2024-09-10T06:26:32.274395+0000","last_became_peered":"2024-09-10T06:26:32.274395+0000","last_unstale":"2024-09-10T06:28:48.455208+0000","last_undegraded":"2024-09-10T06:28:48.455208+0000","last_fullsized":"2024-09-10T06:28:48.455208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:51.369493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376206+0000","last_change":"2024-09-10T06:26:30.594599+0000","last_active":"2024-09-10T06:28:48.376206+0000","last_peered":"2024-09-10T06:28:48.376206+0000","last_clean":"2024-09-10T06:28:48.376206+0000","last_became_active":"2024-09-10T06:26:30.594058+0000","last_became_peered":"2024-09-10T06:26:30.594058+0000","last_unstale":"2024-09-10T06:28:48.376206+0000","last_undegraded":"2024-09-10T06:28:48.376206+0000","last_fullsized":"2024-09-10T06:28:48.376206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:18.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454445+0000","last_change":"2024-09-10T06:26:34.279538+0000","last_active":"2024-09-10T06:28:48.454445+0000","last_peered":"2024-09-10T06:28:48.454445+0000","last_clean":"2024-09-10T06:28:48.454445+0000","last_became_active":"2024-09-10T06:26:34.278871+0000","last_became_peered":"2024-09-10T06:26:34.278871+0000","last_unstale":"2024-09-10T06:28:48.454445+0000","last_undegraded":"2024-09-10T06:28:48.454445+0000","last_fullsized":"2024-09-10T06:28:48.454445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:13.203357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"71'12","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379969+0000","last_change":"2024-09-10T06:26:36.290976+0000","last_active":"2024-09-10T06:28:48.379969+0000","last_peered":"2024-09-10T06:28:48.379969+0000","last_clean":"2024-09-10T06:28:48.379969+0000","last_became_active":"2024-09-10T06:26:36.290265+0000","last_became_peered":"2024-09-10T06:26:36.290265+0000","last_unstale":"2024-09-10T06:28:48.379969+0000","last_undegraded":"2024-09-10T06:28:48.379969+0000","last_fullsized":"2024-09-10T06:28:48.379969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'102","reported_seq":271,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.464716+0000","last_change":"2024-09-10T06:26:38.292031+0000","last_active":"2024-09-10T06:28:49.464716+0000","last_peered":"2024-09-10T06:28:49.464716+0000","last_clean":"2024-09-10T06:28:49.464716+0000","last_became_active":"2024-09-10T06:26:38.288791+0000","last_became_peered":"2024-09-10T06:26:38.288791+0000","last_unstale":"2024-09-10T06:28:49.464716+0000","last_undegraded":"2024-09-10T06:28:49.464716+0000","last_fullsized":"2024-09-10T06:28:49.464716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:07.830355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"76'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455098+0000","last_change":"2024-09-10T06:26:40.336448+0000","last_active":"2024-09-10T06:28:48.455098+0000","last_peered":"2024-09-10T06:28:48.455098+0000","last_clean":"2024-09-10T06:28:48.455098+0000","last_became_active":"2024-09-10T06:26:40.335771+0000","last_became_peered":"2024-09-10T06:26:40.335771+0000","last_unstale":"2024-09-10T06:28:48.455098+0000","last_undegraded":"2024-09-10T06:28:48.455098+0000","last_fullsized":"2024-09-10T06:28:48.455098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378950+0000","last_change":"2024-09-10T06:26:32.262176+0000","last_active":"2024-09-10T06:28:48.378950+0000","last_peered":"2024-09-10T06:28:48.378950+0000","last_clean":"2024-09-10T06:28:48.378950+0000","last_became_active":"2024-09-10T06:26:32.261250+0000","last_became_peered":"2024-09-10T06:26:32.261250+0000","last_unstale":"2024-09-10T06:28:48.378950+0000","last_undegraded":"2024-09-10T06:28:48.378950+0000","last_fullsized":"2024-09-10T06:28:48.378950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"73'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461942+0000","last_change":"2024-09-10T06:26:30.604587+0000","last_active":"2024-09-10T06:28:48.461942+0000","last_peered":"2024-09-10T06:28:48.461942+0000","last_clean":"2024-09-10T06:28:48.461942+0000","last_became_active":"2024-09-10T06:26:30.603175+0000","last_became_peered":"2024-09-10T06:26:30.603175+0000","last_unstale":"2024-09-10T06:28:48.461942+0000","last_undegraded":"2024-09-10T06:28:48.461942+0000","last_fullsized":"2024-09-10T06:28:48.461942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458290+0000","last_change":"2024-09-10T06:26:34.286028+0000","last_active":"2024-09-10T06:28:48.458290+0000","last_peered":"2024-09-10T06:28:48.458290+0000","last_clean":"2024-09-10T06:28:48.458290+0000","last_became_active":"2024-09-10T06:26:34.285169+0000","last_became_peered":"2024-09-10T06:26:34.285169+0000","last_unstale":"2024-09-10T06:28:48.458290+0000","last_undegraded":"2024-09-10T06:28:48.458290+0000","last_fullsized":"2024-09-10T06:28:48.458290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:24.146088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"76'21","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456901+0000","last_change":"2024-09-10T06:26:36.292679+0000","last_active":"2024-09-10T06:28:48.456901+0000","last_peered":"2024-09-10T06:28:48.456901+0000","last_clean":"2024-09-10T06:28:48.456901+0000","last_became_active":"2024-09-10T06:26:36.288780+0000","last_became_peered":"2024-09-10T06:26:36.288780+0000","last_unstale":"2024-09-10T06:28:48.456901+0000","last_undegraded":"2024-09-10T06:28:48.456901+0000","last_fullsized":"2024-09-10T06:28:48.456901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374709+0000","last_change":"2024-09-10T06:26:38.293015+0000","last_active":"2024-09-10T06:28:48.374709+0000","last_peered":"2024-09-10T06:28:48.374709+0000","last_clean":"2024-09-10T06:28:48.374709+0000","last_became_active":"2024-09-10T06:26:38.292185+0000","last_became_peered":"2024-09-10T06:26:38.292185+0000","last_unstale":"2024-09-10T06:28:48.374709+0000","last_undegraded":"2024-09-10T06:28:48.374709+0000","last_fullsized":"2024-09-10T06:28:48.374709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:32.694777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"64'10","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464937+0000","last_change":"2024-09-10T06:26:40.336074+0000","last_active":"2024-09-10T06:28:48.464937+0000","last_peered":"2024-09-10T06:28:48.464937+0000","last_clean":"2024-09-10T06:28:48.464937+0000","last_became_active":"2024-09-10T06:26:40.335339+0000","last_became_peered":"2024-09-10T06:26:40.335339+0000","last_unstale":"2024-09-10T06:28:48.464937+0000","last_undegraded":"2024-09-10T06:28:48.464937+0000","last_fullsized":"2024-09-10T06:28:48.464937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378245+0000","last_change":"2024-09-10T06:26:32.262823+0000","last_active":"2024-09-10T06:28:48.378245+0000","last_peered":"2024-09-10T06:28:48.378245+0000","last_clean":"2024-09-10T06:28:48.378245+0000","last_became_active":"2024-09-10T06:26:32.262041+0000","last_became_peered":"2024-09-10T06:26:32.262041+0000","last_unstale":"2024-09-10T06:28:48.378245+0000","last_undegraded":"2024-09-10T06:28:48.378245+0000","last_fullsized":"2024-09-10T06:28:48.378245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:48.768083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"73'7","reported_seq":123,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455114+0000","last_change":"2024-09-10T06:27:08.868703+0000","last_active":"2024-09-10T06:28:48.455114+0000","last_peered":"2024-09-10T06:28:48.455114+0000","last_clean":"2024-09-10T06:28:48.455114+0000","last_became_active":"2024-09-10T06:27:08.868399+0000","last_became_peered":"2024-09-10T06:27:08.868399+0000","last_unstale":"2024-09-10T06:28:48.455114+0000","last_undegraded":"2024-09-10T06:28:48.455114+0000","last_fullsized":"2024-09-10T06:28:48.455114+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:20.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459883+0000","last_change":"2024-09-10T06:26:34.282651+0000","last_active":"2024-09-10T06:28:48.459883+0000","last_peered":"2024-09-10T06:28:48.459883+0000","last_clean":"2024-09-10T06:28:48.459883+0000","last_became_active":"2024-09-10T06:26:34.281777+0000","last_became_peered":"2024-09-10T06:26:34.281777+0000","last_unstale":"2024-09-10T06:28:48.459883+0000","last_undegraded":"2024-09-10T06:28:48.459883+0000","last_fullsized":"2024-09-10T06:28:48.459883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:42.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"76'15","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374940+0000","last_change":"2024-09-10T06:26:36.285192+0000","last_active":"2024-09-10T06:28:48.374940+0000","last_peered":"2024-09-10T06:28:48.374940+0000","last_clean":"2024-09-10T06:28:48.374940+0000","last_became_active":"2024-09-10T06:26:36.284470+0000","last_became_peered":"2024-09-10T06:26:36.284470+0000","last_unstale":"2024-09-10T06:28:48.374940+0000","last_undegraded":"2024-09-10T06:28:48.374940+0000","last_fullsized":"2024-09-10T06:28:48.374940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:44.280458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456932+0000","last_change":"2024-09-10T06:26:38.303425+0000","last_active":"2024-09-10T06:28:48.456932+0000","last_peered":"2024-09-10T06:28:48.456932+0000","last_clean":"2024-09-10T06:28:48.456932+0000","last_became_active":"2024-09-10T06:26:38.302606+0000","last_became_peered":"2024-09-10T06:26:38.302606+0000","last_unstale":"2024-09-10T06:28:48.456932+0000","last_undegraded":"2024-09-10T06:28:48.456932+0000","last_fullsized":"2024-09-10T06:28:48.456932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:14.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"76'13","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379260+0000","last_change":"2024-09-10T06:26:40.311253+0000","last_active":"2024-09-10T06:28:48.379260+0000","last_peered":"2024-09-10T06:28:48.379260+0000","last_clean":"2024-09-10T06:28:48.379260+0000","last_became_active":"2024-09-10T06:26:40.310414+0000","last_became_peered":"2024-09-10T06:26:40.310414+0000","last_unstale":"2024-09-10T06:28:48.379260+0000","last_undegraded":"2024-09-10T06:28:48.379260+0000","last_fullsized":"2024-09-10T06:28:48.379260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:20.868195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375984+0000","last_change":"2024-09-10T06:26:32.262972+0000","last_active":"2024-09-10T06:28:48.375984+0000","last_peered":"2024-09-10T06:28:48.375984+0000","last_clean":"2024-09-10T06:28:48.375984+0000","last_became_active":"2024-09-10T06:26:32.262469+0000","last_became_peered":"2024-09-10T06:26:32.262469+0000","last_unstale":"2024-09-10T06:28:48.375984+0000","last_undegraded":"2024-09-10T06:28:48.375984+0000","last_fullsized":"2024-09-10T06:28:48.375984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"72'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379565+0000","last_change":"2024-09-10T06:26:30.602013+0000","last_active":"2024-09-10T06:28:48.379565+0000","last_peered":"2024-09-10T06:28:48.379565+0000","last_clean":"2024-09-10T06:28:48.379565+0000","last_became_active":"2024-09-10T06:26:30.601672+0000","last_became_peered":"2024-09-10T06:26:30.601672+0000","last_unstale":"2024-09-10T06:28:48.379565+0000","last_undegraded":"2024-09-10T06:28:48.379565+0000","last_fullsized":"2024-09-10T06:28:48.379565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:52.012063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376590+0000","last_change":"2024-09-10T06:26:34.277010+0000","last_active":"2024-09-10T06:28:48.376590+0000","last_peered":"2024-09-10T06:28:48.376590+0000","last_clean":"2024-09-10T06:28:48.376590+0000","last_became_active":"2024-09-10T06:26:34.276197+0000","last_became_peered":"2024-09-10T06:26:34.276197+0000","last_unstale":"2024-09-10T06:28:48.376590+0000","last_undegraded":"2024-09-10T06:28:48.376590+0000","last_fullsized":"2024-09-10T06:28:48.376590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:32.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"76'11","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378378+0000","last_change":"2024-09-10T06:26:36.297514+0000","last_active":"2024-09-10T06:28:48.378378+0000","last_peered":"2024-09-10T06:28:48.378378+0000","last_clean":"2024-09-10T06:28:48.378378+0000","last_became_active":"2024-09-10T06:26:36.296615+0000","last_became_peered":"2024-09-10T06:26:36.296615+0000","last_unstale":"2024-09-10T06:28:48.378378+0000","last_undegraded":"2024-09-10T06:28:48.378378+0000","last_fullsized":"2024-09-10T06:28:48.378378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376631+0000","last_change":"2024-09-10T06:26:38.288794+0000","last_active":"2024-09-10T06:28:48.376631+0000","last_peered":"2024-09-10T06:28:48.376631+0000","last_clean":"2024-09-10T06:28:48.376631+0000","last_became_active":"2024-09-10T06:26:38.288055+0000","last_became_peered":"2024-09-10T06:26:38.288055+0000","last_unstale":"2024-09-10T06:28:48.376631+0000","last_undegraded":"2024-09-10T06:28:48.376631+0000","last_fullsized":"2024-09-10T06:28:48.376631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463598+0000","last_change":"2024-09-10T06:26:40.318067+0000","last_active":"2024-09-10T06:28:48.463598+0000","last_peered":"2024-09-10T06:28:48.463598+0000","last_clean":"2024-09-10T06:28:48.463598+0000","last_became_active":"2024-09-10T06:26:40.317244+0000","last_became_peered":"2024-09-10T06:26:40.317244+0000","last_unstale":"2024-09-10T06:28:48.463598+0000","last_undegraded":"2024-09-10T06:28:48.463598+0000","last_fullsized":"2024-09-10T06:28:48.463598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"76'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377374+0000","last_change":"2024-09-10T06:26:32.277908+0000","last_active":"2024-09-10T06:28:48.377374+0000","last_peered":"2024-09-10T06:28:48.377374+0000","last_clean":"2024-09-10T06:28:48.377374+0000","last_became_active":"2024-09-10T06:26:32.274812+0000","last_became_peered":"2024-09-10T06:26:32.274812+0000","last_unstale":"2024-09-10T06:28:48.377374+0000","last_undegraded":"2024-09-10T06:28:48.377374+0000","last_fullsized":"2024-09-10T06:28:48.377374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:37.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"73'10","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378238+0000","last_change":"2024-09-10T06:26:30.594013+0000","last_active":"2024-09-10T06:28:48.378238+0000","last_peered":"2024-09-10T06:28:48.378238+0000","last_clean":"2024-09-10T06:28:48.378238+0000","last_became_active":"2024-09-10T06:26:30.593687+0000","last_became_peered":"2024-09-10T06:26:30.593687+0000","last_unstale":"2024-09-10T06:28:48.378238+0000","last_undegraded":"2024-09-10T06:28:48.378238+0000","last_fullsized":"2024-09-10T06:28:48.378238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:37.375037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453258+0000","last_change":"2024-09-10T06:26:34.283392+0000","last_active":"2024-09-10T06:28:48.453258+0000","last_peered":"2024-09-10T06:28:48.453258+0000","last_clean":"2024-09-10T06:28:48.453258+0000","last_became_active":"2024-09-10T06:26:34.282931+0000","last_became_peered":"2024-09-10T06:26:34.282931+0000","last_unstale":"2024-09-10T06:28:48.453258+0000","last_undegraded":"2024-09-10T06:28:48.453258+0000","last_fullsized":"2024-09-10T06:28:48.453258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:01.310719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"76'15","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377000+0000","last_change":"2024-09-10T06:26:36.289834+0000","last_active":"2024-09-10T06:28:48.377000+0000","last_peered":"2024-09-10T06:28:48.377000+0000","last_clean":"2024-09-10T06:28:48.377000+0000","last_became_active":"2024-09-10T06:26:36.289033+0000","last_became_peered":"2024-09-10T06:26:36.289033+0000","last_unstale":"2024-09-10T06:28:48.377000+0000","last_undegraded":"2024-09-10T06:28:48.377000+0000","last_fullsized":"2024-09-10T06:28:48.377000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375982+0000","last_change":"2024-09-10T06:26:38.299568+0000","last_active":"2024-09-10T06:28:48.375982+0000","last_peered":"2024-09-10T06:28:48.375982+0000","last_clean":"2024-09-10T06:28:48.375982+0000","last_became_active":"2024-09-10T06:26:38.298779+0000","last_became_peered":"2024-09-10T06:26:38.298779+0000","last_unstale":"2024-09-10T06:28:48.375982+0000","last_undegraded":"2024-09-10T06:28:48.375982+0000","last_fullsized":"2024-09-10T06:28:48.375982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.381022+0000","last_change":"2024-09-10T06:26:40.336329+0000","last_active":"2024-09-10T06:28:48.381022+0000","last_peered":"2024-09-10T06:28:48.381022+0000","last_clean":"2024-09-10T06:28:48.381022+0000","last_became_active":"2024-09-10T06:26:40.335348+0000","last_became_peered":"2024-09-10T06:26:40.335348+0000","last_unstale":"2024-09-10T06:28:48.381022+0000","last_undegraded":"2024-09-10T06:28:48.381022+0000","last_fullsized":"2024-09-10T06:28:48.381022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:40.653642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"62'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454263+0000","last_change":"2024-09-10T06:26:32.276392+0000","last_active":"2024-09-10T06:28:48.454263+0000","last_peered":"2024-09-10T06:28:48.454263+0000","last_clean":"2024-09-10T06:28:48.454263+0000","last_became_active":"2024-09-10T06:26:32.275855+0000","last_became_peered":"2024-09-10T06:26:32.275855+0000","last_unstale":"2024-09-10T06:28:48.454263+0000","last_undegraded":"2024-09-10T06:28:48.454263+0000","last_fullsized":"2024-09-10T06:28:48.454263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:34.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"73'11","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456654+0000","last_change":"2024-09-10T06:26:30.591577+0000","last_active":"2024-09-10T06:28:48.456654+0000","last_peered":"2024-09-10T06:28:48.456654+0000","last_clean":"2024-09-10T06:28:48.456654+0000","last_became_active":"2024-09-10T06:26:30.590801+0000","last_became_peered":"2024-09-10T06:26:30.590801+0000","last_unstale":"2024-09-10T06:28:48.456654+0000","last_undegraded":"2024-09-10T06:28:48.456654+0000","last_fullsized":"2024-09-10T06:28:48.456654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:16.066664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453895+0000","last_change":"2024-09-10T06:26:32.268621+0000","last_active":"2024-09-10T06:28:48.453895+0000","last_peered":"2024-09-10T06:28:48.453895+0000","last_clean":"2024-09-10T06:28:48.453895+0000","last_became_active":"2024-09-10T06:26:32.267915+0000","last_became_peered":"2024-09-10T06:26:32.267915+0000","last_unstale":"2024-09-10T06:28:48.453895+0000","last_undegraded":"2024-09-10T06:28:48.453895+0000","last_fullsized":"2024-09-10T06:28:48.453895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:10.670492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"73'10","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452875+0000","last_change":"2024-09-10T06:26:30.593794+0000","last_active":"2024-09-10T06:28:48.452875+0000","last_peered":"2024-09-10T06:28:48.452875+0000","last_clean":"2024-09-10T06:28:48.452875+0000","last_became_active":"2024-09-10T06:26:30.593506+0000","last_became_peered":"2024-09-10T06:26:30.593506+0000","last_unstale":"2024-09-10T06:28:48.452875+0000","last_undegraded":"2024-09-10T06:28:48.452875+0000","last_fullsized":"2024-09-10T06:28:48.452875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:29.521578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'6","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459260+0000","last_change":"2024-09-10T06:26:32.288497+0000","last_active":"2024-09-10T06:28:48.459260+0000","last_peered":"2024-09-10T06:28:48.459260+0000","last_clean":"2024-09-10T06:28:48.459260+0000","last_became_active":"2024-09-10T06:26:32.287839+0000","last_became_peered":"2024-09-10T06:26:32.287839+0000","last_unstale":"2024-09-10T06:28:48.459260+0000","last_undegraded":"2024-09-10T06:28:48.459260+0000","last_fullsized":"2024-09-10T06:28:48.459260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"72'5","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454219+0000","last_change":"2024-09-10T06:28:09.627267+0000","last_active":"2024-09-10T06:28:48.454219+0000","last_peered":"2024-09-10T06:28:48.454219+0000","last_clean":"2024-09-10T06:28:48.454219+0000","last_became_active":"2024-09-10T06:28:09.544344+0000","last_became_peered":"2024-09-10T06:28:09.544344+0000","last_unstale":"2024-09-10T06:28:48.454219+0000","last_undegraded":"2024-09-10T06:28:48.454219+0000","last_fullsized":"2024-09-10T06:28:48.454219+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:57.591444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"62'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454143+0000","last_change":"2024-09-10T06:26:32.272921+0000","last_active":"2024-09-10T06:28:48.454143+0000","last_peered":"2024-09-10T06:28:48.454143+0000","last_clean":"2024-09-10T06:28:48.454143+0000","last_became_active":"2024-09-10T06:26:32.272279+0000","last_became_peered":"2024-09-10T06:26:32.272279+0000","last_unstale":"2024-09-10T06:28:48.454143+0000","last_undegraded":"2024-09-10T06:28:48.454143+0000","last_fullsized":"2024-09-10T06:28:48.454143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:11.951551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"73'12","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376254+0000","last_change":"2024-09-10T06:26:30.579541+0000","last_active":"2024-09-10T06:28:48.376254+0000","last_peered":"2024-09-10T06:28:48.376254+0000","last_clean":"2024-09-10T06:28:48.376254+0000","last_became_active":"2024-09-10T06:26:30.579189+0000","last_became_peered":"2024-09-10T06:26:30.579189+0000","last_unstale":"2024-09-10T06:28:48.376254+0000","last_undegraded":"2024-09-10T06:28:48.376254+0000","last_fullsized":"2024-09-10T06:28:48.376254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:18.099885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377659+0000","last_change":"2024-09-10T06:26:32.260098+0000","last_active":"2024-09-10T06:28:48.377659+0000","last_peered":"2024-09-10T06:28:48.377659+0000","last_clean":"2024-09-10T06:28:48.377659+0000","last_became_active":"2024-09-10T06:26:32.259644+0000","last_became_peered":"2024-09-10T06:26:32.259644+0000","last_unstale":"2024-09-10T06:28:48.377659+0000","last_undegraded":"2024-09-10T06:28:48.377659+0000","last_fullsized":"2024-09-10T06:28:48.377659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"72'11","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378625+0000","last_change":"2024-09-10T06:26:30.576146+0000","last_active":"2024-09-10T06:28:48.378625+0000","last_peered":"2024-09-10T06:28:48.378625+0000","last_clean":"2024-09-10T06:28:48.378625+0000","last_became_active":"2024-09-10T06:26:30.575605+0000","last_became_peered":"2024-09-10T06:26:30.575605+0000","last_unstale":"2024-09-10T06:28:48.378625+0000","last_undegraded":"2024-09-10T06:28:48.378625+0000","last_fullsized":"2024-09-10T06:28:48.378625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"76'10","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378536+0000","last_change":"2024-09-10T06:26:32.277577+0000","last_active":"2024-09-10T06:28:48.378536+0000","last_peered":"2024-09-10T06:28:48.378536+0000","last_clean":"2024-09-10T06:28:48.378536+0000","last_became_active":"2024-09-10T06:26:32.272454+0000","last_became_peered":"2024-09-10T06:26:32.272454+0000","last_unstale":"2024-09-10T06:28:48.378536+0000","last_undegraded":"2024-09-10T06:28:48.378536+0000","last_fullsized":"2024-09-10T06:28:48.378536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"73'6","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454604+0000","last_change":"2024-09-10T06:26:30.579134+0000","last_active":"2024-09-10T06:28:48.454604+0000","last_peered":"2024-09-10T06:28:48.454604+0000","last_clean":"2024-09-10T06:28:48.454604+0000","last_became_active":"2024-09-10T06:26:30.578732+0000","last_became_peered":"2024-09-10T06:26:30.578732+0000","last_unstale":"2024-09-10T06:28:48.454604+0000","last_undegraded":"2024-09-10T06:28:48.454604+0000","last_fullsized":"2024-09-10T06:28:48.454604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:08.832907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375228+0000","last_change":"2024-09-10T06:26:32.270804+0000","last_active":"2024-09-10T06:28:48.375228+0000","last_peered":"2024-09-10T06:28:48.375228+0000","last_clean":"2024-09-10T06:28:48.375228+0000","last_became_active":"2024-09-10T06:26:32.270327+0000","last_became_peered":"2024-09-10T06:26:32.270327+0000","last_unstale":"2024-09-10T06:28:48.375228+0000","last_undegraded":"2024-09-10T06:28:48.375228+0000","last_fullsized":"2024-09-10T06:28:48.375228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"72'6","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459860+0000","last_change":"2024-09-10T06:26:30.598004+0000","last_active":"2024-09-10T06:28:48.459860+0000","last_peered":"2024-09-10T06:28:48.459860+0000","last_clean":"2024-09-10T06:28:48.459860+0000","last_became_active":"2024-09-10T06:26:30.596254+0000","last_became_peered":"2024-09-10T06:26:30.596254+0000","last_unstale":"2024-09-10T06:28:48.459860+0000","last_undegraded":"2024-09-10T06:28:48.459860+0000","last_fullsized":"2024-09-10T06:28:48.459860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'2","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456398+0000","last_change":"2024-09-10T06:26:32.284215+0000","last_active":"2024-09-10T06:28:48.456398+0000","last_peered":"2024-09-10T06:28:48.456398+0000","last_clean":"2024-09-10T06:28:48.456398+0000","last_became_active":"2024-09-10T06:26:32.275133+0000","last_became_peered":"2024-09-10T06:26:32.275133+0000","last_unstale":"2024-09-10T06:28:48.456398+0000","last_undegraded":"2024-09-10T06:28:48.456398+0000","last_fullsized":"2024-09-10T06:28:48.456398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:37.703268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"73'9","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379658+0000","last_change":"2024-09-10T06:26:30.580586+0000","last_active":"2024-09-10T06:28:48.379658+0000","last_peered":"2024-09-10T06:28:48.379658+0000","last_clean":"2024-09-10T06:28:48.379658+0000","last_became_active":"2024-09-10T06:26:30.580134+0000","last_became_peered":"2024-09-10T06:26:30.580134+0000","last_unstale":"2024-09-10T06:28:48.379658+0000","last_undegraded":"2024-09-10T06:28:48.379658+0000","last_fullsized":"2024-09-10T06:28:48.379658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378230+0000","last_change":"2024-09-10T06:26:32.256538+0000","last_active":"2024-09-10T06:28:48.378230+0000","last_peered":"2024-09-10T06:28:48.378230+0000","last_clean":"2024-09-10T06:28:48.378230+0000","last_became_active":"2024-09-10T06:26:32.256052+0000","last_became_peered":"2024-09-10T06:26:32.256052+0000","last_unstale":"2024-09-10T06:28:48.378230+0000","last_undegraded":"2024-09-10T06:28:48.378230+0000","last_fullsized":"2024-09-10T06:28:48.378230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:14.620472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"73'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457141+0000","last_change":"2024-09-10T06:26:30.585220+0000","last_active":"2024-09-10T06:28:48.457141+0000","last_peered":"2024-09-10T06:28:48.457141+0000","last_clean":"2024-09-10T06:28:48.457141+0000","last_became_active":"2024-09-10T06:26:30.584443+0000","last_became_peered":"2024-09-10T06:26:30.584443+0000","last_unstale":"2024-09-10T06:28:48.457141+0000","last_undegraded":"2024-09-10T06:28:48.457141+0000","last_fullsized":"2024-09-10T06:28:48.457141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380479+0000","last_change":"2024-09-10T06:26:32.259306+0000","last_active":"2024-09-10T06:28:48.380479+0000","last_peered":"2024-09-10T06:28:48.380479+0000","last_clean":"2024-09-10T06:28:48.380479+0000","last_became_active":"2024-09-10T06:26:32.258513+0000","last_became_peered":"2024-09-10T06:26:32.258513+0000","last_unstale":"2024-09-10T06:28:48.380479+0000","last_undegraded":"2024-09-10T06:28:48.380479+0000","last_fullsized":"2024-09-10T06:28:48.380479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"73'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376110+0000","last_change":"2024-09-10T06:26:30.581285+0000","last_active":"2024-09-10T06:28:48.376110+0000","last_peered":"2024-09-10T06:28:48.376110+0000","last_clean":"2024-09-10T06:28:48.376110+0000","last_became_active":"2024-09-10T06:26:30.580913+0000","last_became_peered":"2024-09-10T06:26:30.580913+0000","last_unstale":"2024-09-10T06:28:48.376110+0000","last_undegraded":"2024-09-10T06:28:48.376110+0000","last_fullsized":"2024-09-10T06:28:48.376110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"76'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455519+0000","last_change":"2024-09-10T06:26:32.274773+0000","last_active":"2024-09-10T06:28:48.455519+0000","last_peered":"2024-09-10T06:28:48.455519+0000","last_clean":"2024-09-10T06:28:48.455519+0000","last_became_active":"2024-09-10T06:26:32.274327+0000","last_became_peered":"2024-09-10T06:26:32.274327+0000","last_unstale":"2024-09-10T06:28:48.455519+0000","last_undegraded":"2024-09-10T06:28:48.455519+0000","last_fullsized":"2024-09-10T06:28:48.455519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:54.026434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"73'6","reported_seq":122,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454426+0000","last_change":"2024-09-10T06:27:08.592940+0000","last_active":"2024-09-10T06:28:48.454426+0000","last_peered":"2024-09-10T06:28:48.454426+0000","last_clean":"2024-09-10T06:28:48.454426+0000","last_became_active":"2024-09-10T06:27:08.592637+0000","last_became_peered":"2024-09-10T06:27:08.592637+0000","last_unstale":"2024-09-10T06:28:48.454426+0000","last_undegraded":"2024-09-10T06:28:48.454426+0000","last_fullsized":"2024-09-10T06:28:48.454426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:06.335302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380493+0000","last_change":"2024-09-10T06:26:32.279474+0000","last_active":"2024-09-10T06:28:48.380493+0000","last_peered":"2024-09-10T06:28:48.380493+0000","last_clean":"2024-09-10T06:28:48.380493+0000","last_became_active":"2024-09-10T06:26:32.278461+0000","last_became_peered":"2024-09-10T06:26:32.278461+0000","last_unstale":"2024-09-10T06:28:48.380493+0000","last_undegraded":"2024-09-10T06:28:48.380493+0000","last_fullsized":"2024-09-10T06:28:48.380493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"73'8","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376355+0000","last_change":"2024-09-10T06:26:30.605519+0000","last_active":"2024-09-10T06:28:48.376355+0000","last_peered":"2024-09-10T06:28:48.376355+0000","last_clean":"2024-09-10T06:28:48.376355+0000","last_became_active":"2024-09-10T06:26:30.605225+0000","last_became_peered":"2024-09-10T06:26:30.605225+0000","last_unstale":"2024-09-10T06:28:48.376355+0000","last_undegraded":"2024-09-10T06:28:48.376355+0000","last_fullsized":"2024-09-10T06:28:48.376355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"64'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462698+0000","last_change":"2024-09-10T06:26:32.267201+0000","last_active":"2024-09-10T06:28:48.462698+0000","last_peered":"2024-09-10T06:28:48.462698+0000","last_clean":"2024-09-10T06:28:48.462698+0000","last_became_active":"2024-09-10T06:26:32.266234+0000","last_became_peered":"2024-09-10T06:26:32.266234+0000","last_unstale":"2024-09-10T06:28:48.462698+0000","last_undegraded":"2024-09-10T06:28:48.462698+0000","last_fullsized":"2024-09-10T06:28:48.462698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"72'10","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458276+0000","last_change":"2024-09-10T06:26:30.596647+0000","last_active":"2024-09-10T06:28:48.458276+0000","last_peered":"2024-09-10T06:28:48.458276+0000","last_clean":"2024-09-10T06:28:48.458276+0000","last_became_active":"2024-09-10T06:26:30.593598+0000","last_became_peered":"2024-09-10T06:26:30.593598+0000","last_unstale":"2024-09-10T06:28:48.458276+0000","last_undegraded":"2024-09-10T06:28:48.458276+0000","last_fullsized":"2024-09-10T06:28:48.458276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"76'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375198+0000","last_change":"2024-09-10T06:26:32.278317+0000","last_active":"2024-09-10T06:28:48.375198+0000","last_peered":"2024-09-10T06:28:48.375198+0000","last_clean":"2024-09-10T06:28:48.375198+0000","last_became_active":"2024-09-10T06:26:32.278032+0000","last_became_peered":"2024-09-10T06:26:32.278032+0000","last_unstale":"2024-09-10T06:28:48.375198+0000","last_undegraded":"2024-09-10T06:28:48.375198+0000","last_fullsized":"2024-09-10T06:28:48.375198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:00.200118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"72'9","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464311+0000","last_change":"2024-09-10T06:26:30.580552+0000","last_active":"2024-09-10T06:28:48.464311+0000","last_peered":"2024-09-10T06:28:48.464311+0000","last_clean":"2024-09-10T06:28:48.464311+0000","last_became_active":"2024-09-10T06:26:30.579319+0000","last_became_peered":"2024-09-10T06:26:30.579319+0000","last_unstale":"2024-09-10T06:28:48.464311+0000","last_undegraded":"2024-09-10T06:28:48.464311+0000","last_fullsized":"2024-09-10T06:28:48.464311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:59.885311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"67'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375088+0000","last_change":"2024-09-10T06:26:32.257601+0000","last_active":"2024-09-10T06:28:48.375088+0000","last_peered":"2024-09-10T06:28:48.375088+0000","last_clean":"2024-09-10T06:28:48.375088+0000","last_became_active":"2024-09-10T06:26:32.256851+0000","last_became_peered":"2024-09-10T06:26:32.256851+0000","last_unstale":"2024-09-10T06:28:48.375088+0000","last_undegraded":"2024-09-10T06:28:48.375088+0000","last_fullsized":"2024-09-10T06:28:48.375088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"73'12","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455655+0000","last_change":"2024-09-10T06:28:47.047609+0000","last_active":"2024-09-10T06:28:48.455655+0000","last_peered":"2024-09-10T06:28:48.455655+0000","last_clean":"2024-09-10T06:28:48.455655+0000","last_became_active":"2024-09-10T06:28:46.326501+0000","last_became_peered":"2024-09-10T06:28:46.326501+0000","last_unstale":"2024-09-10T06:28:48.455655+0000","last_undegraded":"2024-09-10T06:28:48.455655+0000","last_fullsized":"2024-09-10T06:28:48.455655+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:33.793329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"62'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455403+0000","last_change":"2024-09-10T06:26:32.266768+0000","last_active":"2024-09-10T06:28:48.455403+0000","last_peered":"2024-09-10T06:28:48.455403+0000","last_clean":"2024-09-10T06:28:48.455403+0000","last_became_active":"2024-09-10T06:26:32.266000+0000","last_became_peered":"2024-09-10T06:26:32.266000+0000","last_unstale":"2024-09-10T06:28:48.455403+0000","last_undegraded":"2024-09-10T06:28:48.455403+0000","last_fullsized":"2024-09-10T06:28:48.455403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"72'9","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460809+0000","last_change":"2024-09-10T06:26:30.610309+0000","last_active":"2024-09-10T06:28:48.460809+0000","last_peered":"2024-09-10T06:28:48.460809+0000","last_clean":"2024-09-10T06:28:48.460809+0000","last_became_active":"2024-09-10T06:26:30.609674+0000","last_became_peered":"2024-09-10T06:26:30.609674+0000","last_unstale":"2024-09-10T06:28:48.460809+0000","last_undegraded":"2024-09-10T06:28:48.460809+0000","last_fullsized":"2024-09-10T06:28:48.460809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"73'10","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457073+0000","last_change":"2024-09-10T06:26:30.591365+0000","last_active":"2024-09-10T06:28:48.457073+0000","last_peered":"2024-09-10T06:28:48.457073+0000","last_clean":"2024-09-10T06:28:48.457073+0000","last_became_active":"2024-09-10T06:26:30.590640+0000","last_became_peered":"2024-09-10T06:26:30.590640+0000","last_unstale":"2024-09-10T06:28:48.457073+0000","last_undegraded":"2024-09-10T06:28:48.457073+0000","last_fullsized":"2024-09-10T06:28:48.457073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"67'10","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378178+0000","last_change":"2024-09-10T06:26:32.267333+0000","last_active":"2024-09-10T06:28:48.378178+0000","last_peered":"2024-09-10T06:28:48.378178+0000","last_clean":"2024-09-10T06:28:48.378178+0000","last_became_active":"2024-09-10T06:26:32.266876+0000","last_became_peered":"2024-09-10T06:26:32.266876+0000","last_unstale":"2024-09-10T06:28:48.378178+0000","last_undegraded":"2024-09-10T06:28:48.378178+0000","last_fullsized":"2024-09-10T06:28:48.378178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:02.483639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"73'13","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453736+0000","last_change":"2024-09-10T06:26:30.590924+0000","last_active":"2024-09-10T06:28:48.453736+0000","last_peered":"2024-09-10T06:28:48.453736+0000","last_clean":"2024-09-10T06:28:48.453736+0000","last_became_active":"2024-09-10T06:26:30.590415+0000","last_became_peered":"2024-09-10T06:26:30.590415+0000","last_unstale":"2024-09-10T06:28:48.453736+0000","last_undegraded":"2024-09-10T06:28:48.453736+0000","last_fullsized":"2024-09-10T06:28:48.453736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:32.460291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460331+0000","last_change":"2024-09-10T06:26:32.283339+0000","last_active":"2024-09-10T06:28:48.460331+0000","last_peered":"2024-09-10T06:28:48.460331+0000","last_clean":"2024-09-10T06:28:48.460331+0000","last_became_active":"2024-09-10T06:26:32.282581+0000","last_became_peered":"2024-09-10T06:26:32.282581+0000","last_unstale":"2024-09-10T06:28:48.460331+0000","last_undegraded":"2024-09-10T06:28:48.460331+0000","last_fullsized":"2024-09-10T06:28:48.460331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":816,"ondisk_log_size":816,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":160287,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":814,"num_read_kb":573,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":272742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":669,"ondisk_log_size":669,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":334,"num_read_kb":334,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":567,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":632,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":209715200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542184,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":651436,"kb_used_data":620252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93720404,"statfs":{"total":96636764160,"available":95969693696,"internally_reserved":0,"allocated":635138048,"data_stored":634594233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542184,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536120,"kb_used_data":504936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93835720,"statfs":{"total":96636764160,"available":96087777280,"internally_reserved":0,"allocated":517054464,"data_stored":516546322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":700068,"kb_used_data":668884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93671772,"statfs":{"total":96636764160,"available":95919894528,"internally_reserved":0,"allocated":684937216,"data_stored":684376545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757300,"kb_used_data":726108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93614540,"statfs":{"total":96636764160,"available":95861288960,"internally_reserved":0,"allocated":743534592,"data_stored":743038236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":710344,"kb_used_data":679160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93661496,"statfs":{"total":96636764160,"available":95909371904,"internally_reserved":0,"allocated":695459840,"data_stored":694924989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":433712,"kb_used_data":402528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93938128,"statfs":{"total":96636764160,"available":96192643072,"internally_reserved":0,"allocated":412188672,"data_stored":411692893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":439880,"kb_used_data":408696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93931960,"statfs":{"total":96636764160,"available":96186327040,"internally_reserved":0,"allocated":418504704,"data_stored":417979454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":712908,"kb_used_data":681716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93658932,"statfs":{"total":96636764160,"available":95906746368,"internally_reserved":0,"allocated":698077184,"data_stored":697554526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":696254464,"data_stored":696254464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":417333248,"data_stored":417333248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":411041792,"data_stored":411041792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":694157312,"data_stored":694157312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":742391808,"data_stored":742391808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":683671552,"data_stored":683671552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":515899392,"data_stored":515899392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":633339904,"data_stored":633339904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":122118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":59667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":18838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:29:18.342 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:29:18.715 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:29:18.722 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:29:18.738 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-10T06:29:17.473405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397797023,"num_objects":772,"num_object_clones":0,"num_object_copies":1544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":772,"num_whiteouts":0,"num_read":2073,"num_read_kb":1782,"num_write":1669,"num_write_kb":2367363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":209715508,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2483,"ondisk_log_size":2483,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4941768,"kb_used_data":4692280,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":750032952,"statfs":{"total":773094113280,"available":768033742848,"internally_reserved":0,"allocated":4804894720,"data_stored":4800707198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005735"},"pg_stats":[{"pgid":"3.3f","version":"73'12","reported_seq":127,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454157+0000","last_change":"2024-09-10T06:27:08.597414+0000","last_active":"2024-09-10T06:28:48.454157+0000","last_peered":"2024-09-10T06:28:48.454157+0000","last_clean":"2024-09-10T06:28:48.454157+0000","last_became_active":"2024-09-10T06:27:08.597026+0000","last_became_peered":"2024-09-10T06:27:08.597026+0000","last_unstale":"2024-09-10T06:28:48.454157+0000","last_undegraded":"2024-09-10T06:28:48.454157+0000","last_fullsized":"2024-09-10T06:28:48.454157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:07.484952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"67'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456583+0000","last_change":"2024-09-10T06:26:32.279882+0000","last_active":"2024-09-10T06:28:48.456583+0000","last_peered":"2024-09-10T06:28:48.456583+0000","last_clean":"2024-09-10T06:28:48.456583+0000","last_became_active":"2024-09-10T06:26:32.279098+0000","last_became_peered":"2024-09-10T06:26:32.279098+0000","last_unstale":"2024-09-10T06:28:48.456583+0000","last_undegraded":"2024-09-10T06:28:48.456583+0000","last_fullsized":"2024-09-10T06:28:48.456583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"72'5","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454007+0000","last_change":"2024-09-10T06:26:30.573148+0000","last_active":"2024-09-10T06:28:48.454007+0000","last_peered":"2024-09-10T06:28:48.454007+0000","last_clean":"2024-09-10T06:28:48.454007+0000","last_became_active":"2024-09-10T06:26:30.572798+0000","last_became_peered":"2024-09-10T06:26:30.572798+0000","last_unstale":"2024-09-10T06:28:48.454007+0000","last_undegraded":"2024-09-10T06:28:48.454007+0000","last_fullsized":"2024-09-10T06:28:48.454007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:38.833715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"62'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457162+0000","last_change":"2024-09-10T06:26:32.276811+0000","last_active":"2024-09-10T06:28:48.457162+0000","last_peered":"2024-09-10T06:28:48.457162+0000","last_clean":"2024-09-10T06:28:48.457162+0000","last_became_active":"2024-09-10T06:26:32.275990+0000","last_became_peered":"2024-09-10T06:26:32.275990+0000","last_unstale":"2024-09-10T06:28:48.457162+0000","last_undegraded":"2024-09-10T06:28:48.457162+0000","last_fullsized":"2024-09-10T06:28:48.457162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"72'10","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377820+0000","last_change":"2024-09-10T06:26:30.578068+0000","last_active":"2024-09-10T06:28:48.377820+0000","last_peered":"2024-09-10T06:28:48.377820+0000","last_clean":"2024-09-10T06:28:48.377820+0000","last_became_active":"2024-09-10T06:26:30.577688+0000","last_became_peered":"2024-09-10T06:26:30.577688+0000","last_unstale":"2024-09-10T06:28:48.377820+0000","last_undegraded":"2024-09-10T06:28:48.377820+0000","last_fullsized":"2024-09-10T06:28:48.377820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:34.137079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377720+0000","last_change":"2024-09-10T06:26:32.256939+0000","last_active":"2024-09-10T06:28:48.377720+0000","last_peered":"2024-09-10T06:28:48.377720+0000","last_clean":"2024-09-10T06:28:48.377720+0000","last_became_active":"2024-09-10T06:26:32.256117+0000","last_became_peered":"2024-09-10T06:26:32.256117+0000","last_unstale":"2024-09-10T06:28:48.377720+0000","last_undegraded":"2024-09-10T06:28:48.377720+0000","last_fullsized":"2024-09-10T06:28:48.377720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:51.879604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"73'11","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461567+0000","last_change":"2024-09-10T06:26:30.593697+0000","last_active":"2024-09-10T06:28:48.461567+0000","last_peered":"2024-09-10T06:28:48.461567+0000","last_clean":"2024-09-10T06:28:48.461567+0000","last_became_active":"2024-09-10T06:26:30.591807+0000","last_became_peered":"2024-09-10T06:26:30.591807+0000","last_unstale":"2024-09-10T06:28:48.461567+0000","last_undegraded":"2024-09-10T06:28:48.461567+0000","last_fullsized":"2024-09-10T06:28:48.461567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376230+0000","last_change":"2024-09-10T06:26:32.264685+0000","last_active":"2024-09-10T06:28:48.376230+0000","last_peered":"2024-09-10T06:28:48.376230+0000","last_clean":"2024-09-10T06:28:48.376230+0000","last_became_active":"2024-09-10T06:26:32.264199+0000","last_became_peered":"2024-09-10T06:26:32.264199+0000","last_unstale":"2024-09-10T06:28:48.376230+0000","last_undegraded":"2024-09-10T06:28:48.376230+0000","last_fullsized":"2024-09-10T06:28:48.376230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:20.713066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"72'7","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457396+0000","last_change":"2024-09-10T06:28:09.653122+0000","last_active":"2024-09-10T06:28:48.457396+0000","last_peered":"2024-09-10T06:28:48.457396+0000","last_clean":"2024-09-10T06:28:48.457396+0000","last_became_active":"2024-09-10T06:28:09.546624+0000","last_became_peered":"2024-09-10T06:28:09.546624+0000","last_unstale":"2024-09-10T06:28:48.457396+0000","last_undegraded":"2024-09-10T06:28:48.457396+0000","last_fullsized":"2024-09-10T06:28:48.457396+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:57.805994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"67'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458405+0000","last_change":"2024-09-10T06:26:32.290741+0000","last_active":"2024-09-10T06:28:48.458405+0000","last_peered":"2024-09-10T06:28:48.458405+0000","last_clean":"2024-09-10T06:28:48.458405+0000","last_became_active":"2024-09-10T06:26:32.289840+0000","last_became_peered":"2024-09-10T06:26:32.289840+0000","last_unstale":"2024-09-10T06:28:48.458405+0000","last_undegraded":"2024-09-10T06:28:48.458405+0000","last_fullsized":"2024-09-10T06:28:48.458405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"73'6","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458886+0000","last_change":"2024-09-10T06:26:30.609817+0000","last_active":"2024-09-10T06:28:48.458886+0000","last_peered":"2024-09-10T06:28:48.458886+0000","last_clean":"2024-09-10T06:28:48.458886+0000","last_became_active":"2024-09-10T06:26:30.603330+0000","last_became_peered":"2024-09-10T06:26:30.603330+0000","last_unstale":"2024-09-10T06:28:48.458886+0000","last_undegraded":"2024-09-10T06:28:48.458886+0000","last_fullsized":"2024-09-10T06:28:48.458886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:09.523045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"67'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380006+0000","last_change":"2024-09-10T06:26:32.257050+0000","last_active":"2024-09-10T06:28:48.380006+0000","last_peered":"2024-09-10T06:28:48.380006+0000","last_clean":"2024-09-10T06:28:48.380006+0000","last_became_active":"2024-09-10T06:26:32.254437+0000","last_became_peered":"2024-09-10T06:26:32.254437+0000","last_unstale":"2024-09-10T06:28:48.380006+0000","last_undegraded":"2024-09-10T06:28:48.380006+0000","last_fullsized":"2024-09-10T06:28:48.380006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"72'14","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457637+0000","last_change":"2024-09-10T06:26:30.579756+0000","last_active":"2024-09-10T06:28:48.457637+0000","last_peered":"2024-09-10T06:28:48.457637+0000","last_clean":"2024-09-10T06:28:48.457637+0000","last_became_active":"2024-09-10T06:26:30.578033+0000","last_became_peered":"2024-09-10T06:26:30.578033+0000","last_unstale":"2024-09-10T06:28:48.457637+0000","last_undegraded":"2024-09-10T06:28:48.457637+0000","last_fullsized":"2024-09-10T06:28:48.457637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":22,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460066+0000","last_change":"2024-09-10T06:26:32.281248+0000","last_active":"2024-09-10T06:28:48.460066+0000","last_peered":"2024-09-10T06:28:48.460066+0000","last_clean":"2024-09-10T06:28:48.460066+0000","last_became_active":"2024-09-10T06:26:32.280480+0000","last_became_peered":"2024-09-10T06:26:32.280480+0000","last_unstale":"2024-09-10T06:28:48.460066+0000","last_undegraded":"2024-09-10T06:28:48.460066+0000","last_fullsized":"2024-09-10T06:28:48.460066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"73'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376021+0000","last_change":"2024-09-10T06:26:30.593213+0000","last_active":"2024-09-10T06:28:48.376021+0000","last_peered":"2024-09-10T06:28:48.376021+0000","last_clean":"2024-09-10T06:28:48.376021+0000","last_became_active":"2024-09-10T06:26:30.592770+0000","last_became_peered":"2024-09-10T06:26:30.592770+0000","last_unstale":"2024-09-10T06:28:48.376021+0000","last_undegraded":"2024-09-10T06:28:48.376021+0000","last_fullsized":"2024-09-10T06:28:48.376021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'10","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456049+0000","last_change":"2024-09-10T06:26:32.267430+0000","last_active":"2024-09-10T06:28:48.456049+0000","last_peered":"2024-09-10T06:28:48.456049+0000","last_clean":"2024-09-10T06:28:48.456049+0000","last_became_active":"2024-09-10T06:26:32.265788+0000","last_became_peered":"2024-09-10T06:26:32.265788+0000","last_unstale":"2024-09-10T06:28:48.456049+0000","last_undegraded":"2024-09-10T06:28:48.456049+0000","last_fullsized":"2024-09-10T06:28:48.456049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:19.180142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'10","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377130+0000","last_change":"2024-09-10T06:26:32.255038+0000","last_active":"2024-09-10T06:28:48.377130+0000","last_peered":"2024-09-10T06:28:48.377130+0000","last_clean":"2024-09-10T06:28:48.377130+0000","last_became_active":"2024-09-10T06:26:32.254281+0000","last_became_peered":"2024-09-10T06:26:32.254281+0000","last_unstale":"2024-09-10T06:28:48.377130+0000","last_undegraded":"2024-09-10T06:28:48.377130+0000","last_fullsized":"2024-09-10T06:28:48.377130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:46.363171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"73'9","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464675+0000","last_change":"2024-09-10T06:26:30.607280+0000","last_active":"2024-09-10T06:28:48.464675+0000","last_peered":"2024-09-10T06:28:48.464675+0000","last_clean":"2024-09-10T06:28:48.464675+0000","last_became_active":"2024-09-10T06:26:30.605602+0000","last_became_peered":"2024-09-10T06:26:30.605602+0000","last_unstale":"2024-09-10T06:28:48.464675+0000","last_undegraded":"2024-09-10T06:28:48.464675+0000","last_fullsized":"2024-09-10T06:28:48.464675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:49.865234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457377+0000","last_change":"2024-09-10T06:26:32.275913+0000","last_active":"2024-09-10T06:28:48.457377+0000","last_peered":"2024-09-10T06:28:48.457377+0000","last_clean":"2024-09-10T06:28:48.457377+0000","last_became_active":"2024-09-10T06:26:32.274264+0000","last_became_peered":"2024-09-10T06:26:32.274264+0000","last_unstale":"2024-09-10T06:28:48.457377+0000","last_undegraded":"2024-09-10T06:28:48.457377+0000","last_fullsized":"2024-09-10T06:28:48.457377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"72'5","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459316+0000","last_change":"2024-09-10T06:28:46.509018+0000","last_active":"2024-09-10T06:28:48.459316+0000","last_peered":"2024-09-10T06:28:48.459316+0000","last_clean":"2024-09-10T06:28:48.459316+0000","last_became_active":"2024-09-10T06:28:46.332355+0000","last_became_peered":"2024-09-10T06:28:46.332355+0000","last_unstale":"2024-09-10T06:28:48.459316+0000","last_undegraded":"2024-09-10T06:28:48.459316+0000","last_fullsized":"2024-09-10T06:28:48.459316+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:54.077676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459140+0000","last_change":"2024-09-10T06:26:32.279079+0000","last_active":"2024-09-10T06:28:48.459140+0000","last_peered":"2024-09-10T06:28:48.459140+0000","last_clean":"2024-09-10T06:28:48.459140+0000","last_became_active":"2024-09-10T06:26:32.278407+0000","last_became_peered":"2024-09-10T06:26:32.278407+0000","last_unstale":"2024-09-10T06:28:48.459140+0000","last_undegraded":"2024-09-10T06:28:48.459140+0000","last_fullsized":"2024-09-10T06:28:48.459140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"73'10","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460707+0000","last_change":"2024-09-10T06:26:30.607368+0000","last_active":"2024-09-10T06:28:48.460707+0000","last_peered":"2024-09-10T06:28:48.460707+0000","last_clean":"2024-09-10T06:28:48.460707+0000","last_became_active":"2024-09-10T06:26:30.606807+0000","last_became_peered":"2024-09-10T06:26:30.606807+0000","last_unstale":"2024-09-10T06:28:48.460707+0000","last_undegraded":"2024-09-10T06:28:48.460707+0000","last_fullsized":"2024-09-10T06:28:48.460707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"76'8","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454841+0000","last_change":"2024-09-10T06:27:08.801987+0000","last_active":"2024-09-10T06:28:48.454841+0000","last_peered":"2024-09-10T06:28:48.454841+0000","last_clean":"2024-09-10T06:28:48.454841+0000","last_became_active":"2024-09-10T06:27:08.801461+0000","last_became_peered":"2024-09-10T06:27:08.801461+0000","last_unstale":"2024-09-10T06:28:48.454841+0000","last_undegraded":"2024-09-10T06:28:48.454841+0000","last_fullsized":"2024-09-10T06:28:48.454841+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"72'11","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379594+0000","last_change":"2024-09-10T06:26:30.598381+0000","last_active":"2024-09-10T06:28:48.379594+0000","last_peered":"2024-09-10T06:28:48.379594+0000","last_clean":"2024-09-10T06:28:48.379594+0000","last_became_active":"2024-09-10T06:26:30.597271+0000","last_became_peered":"2024-09-10T06:26:30.597271+0000","last_unstale":"2024-09-10T06:28:48.379594+0000","last_undegraded":"2024-09-10T06:28:48.379594+0000","last_fullsized":"2024-09-10T06:28:48.379594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:59.908548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455123+0000","last_change":"2024-09-10T06:26:32.247492+0000","last_active":"2024-09-10T06:28:48.455123+0000","last_peered":"2024-09-10T06:28:48.455123+0000","last_clean":"2024-09-10T06:28:48.455123+0000","last_became_active":"2024-09-10T06:26:32.246938+0000","last_became_peered":"2024-09-10T06:26:32.246938+0000","last_unstale":"2024-09-10T06:28:48.455123+0000","last_undegraded":"2024-09-10T06:28:48.455123+0000","last_fullsized":"2024-09-10T06:28:48.455123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:01.766868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"73'11","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376896+0000","last_change":"2024-09-10T06:28:46.662120+0000","last_active":"2024-09-10T06:28:48.376896+0000","last_peered":"2024-09-10T06:28:48.376896+0000","last_clean":"2024-09-10T06:28:48.376896+0000","last_became_active":"2024-09-10T06:28:46.326710+0000","last_became_peered":"2024-09-10T06:28:46.326710+0000","last_unstale":"2024-09-10T06:28:48.376896+0000","last_undegraded":"2024-09-10T06:28:48.376896+0000","last_fullsized":"2024-09-10T06:28:48.376896+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:47.625969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380427+0000","last_change":"2024-09-10T06:26:32.278347+0000","last_active":"2024-09-10T06:28:48.380427+0000","last_peered":"2024-09-10T06:28:48.380427+0000","last_clean":"2024-09-10T06:28:48.380427+0000","last_became_active":"2024-09-10T06:26:32.275206+0000","last_became_peered":"2024-09-10T06:26:32.275206+0000","last_unstale":"2024-09-10T06:28:48.380427+0000","last_undegraded":"2024-09-10T06:28:48.380427+0000","last_fullsized":"2024-09-10T06:28:48.380427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"73'13","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375576+0000","last_change":"2024-09-10T06:26:30.572734+0000","last_active":"2024-09-10T06:28:48.375576+0000","last_peered":"2024-09-10T06:28:48.375576+0000","last_clean":"2024-09-10T06:28:48.375576+0000","last_became_active":"2024-09-10T06:26:30.572043+0000","last_became_peered":"2024-09-10T06:26:30.572043+0000","last_unstale":"2024-09-10T06:28:48.375576+0000","last_undegraded":"2024-09-10T06:28:48.375576+0000","last_fullsized":"2024-09-10T06:28:48.375576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"76'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376329+0000","last_change":"2024-09-10T06:26:40.323476+0000","last_active":"2024-09-10T06:28:48.376329+0000","last_peered":"2024-09-10T06:28:48.376329+0000","last_clean":"2024-09-10T06:28:48.376329+0000","last_became_active":"2024-09-10T06:26:40.322711+0000","last_became_peered":"2024-09-10T06:26:40.322711+0000","last_unstale":"2024-09-10T06:28:48.376329+0000","last_undegraded":"2024-09-10T06:28:48.376329+0000","last_fullsized":"2024-09-10T06:28:48.376329+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378030+0000","last_change":"2024-09-10T06:26:32.276274+0000","last_active":"2024-09-10T06:28:48.378030+0000","last_peered":"2024-09-10T06:28:48.378030+0000","last_clean":"2024-09-10T06:28:48.378030+0000","last_became_active":"2024-09-10T06:26:32.275889+0000","last_became_peered":"2024-09-10T06:26:32.275889+0000","last_unstale":"2024-09-10T06:28:48.378030+0000","last_undegraded":"2024-09-10T06:28:48.378030+0000","last_fullsized":"2024-09-10T06:28:48.378030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"72'14","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463117+0000","last_change":"2024-09-10T06:26:30.595738+0000","last_active":"2024-09-10T06:28:48.463117+0000","last_peered":"2024-09-10T06:28:48.463117+0000","last_clean":"2024-09-10T06:28:48.463117+0000","last_became_active":"2024-09-10T06:26:30.595128+0000","last_became_peered":"2024-09-10T06:26:30.595128+0000","last_unstale":"2024-09-10T06:28:48.463117+0000","last_undegraded":"2024-09-10T06:28:48.463117+0000","last_fullsized":"2024-09-10T06:28:48.463117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459270+0000","last_change":"2024-09-10T06:26:34.279824+0000","last_active":"2024-09-10T06:28:48.459270+0000","last_peered":"2024-09-10T06:28:48.459270+0000","last_clean":"2024-09-10T06:28:48.459270+0000","last_became_active":"2024-09-10T06:26:34.279074+0000","last_became_peered":"2024-09-10T06:26:34.279074+0000","last_unstale":"2024-09-10T06:28:48.459270+0000","last_undegraded":"2024-09-10T06:28:48.459270+0000","last_fullsized":"2024-09-10T06:28:48.459270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:40.507467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"76'15","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378442+0000","last_change":"2024-09-10T06:26:36.296703+0000","last_active":"2024-09-10T06:28:48.378442+0000","last_peered":"2024-09-10T06:28:48.378442+0000","last_clean":"2024-09-10T06:28:48.378442+0000","last_became_active":"2024-09-10T06:26:36.295786+0000","last_became_peered":"2024-09-10T06:26:36.295786+0000","last_unstale":"2024-09-10T06:28:48.378442+0000","last_undegraded":"2024-09-10T06:28:48.378442+0000","last_fullsized":"2024-09-10T06:28:48.378442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:31.699855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464404+0000","last_change":"2024-09-10T06:26:38.305468+0000","last_active":"2024-09-10T06:28:48.464404+0000","last_peered":"2024-09-10T06:28:48.464404+0000","last_clean":"2024-09-10T06:28:48.464404+0000","last_became_active":"2024-09-10T06:26:38.304847+0000","last_became_peered":"2024-09-10T06:26:38.304847+0000","last_unstale":"2024-09-10T06:28:48.464404+0000","last_undegraded":"2024-09-10T06:28:48.464404+0000","last_fullsized":"2024-09-10T06:28:48.464404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:36.499856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456269+0000","last_change":"2024-09-10T06:26:40.331389+0000","last_active":"2024-09-10T06:28:48.456269+0000","last_peered":"2024-09-10T06:28:48.456269+0000","last_clean":"2024-09-10T06:28:48.456269+0000","last_became_active":"2024-09-10T06:26:40.330777+0000","last_became_peered":"2024-09-10T06:26:40.330777+0000","last_unstale":"2024-09-10T06:28:48.456269+0000","last_undegraded":"2024-09-10T06:28:48.456269+0000","last_fullsized":"2024-09-10T06:28:48.456269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:22.792159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459648+0000","last_change":"2024-09-10T06:26:32.283112+0000","last_active":"2024-09-10T06:28:48.459648+0000","last_peered":"2024-09-10T06:28:48.459648+0000","last_clean":"2024-09-10T06:28:48.459648+0000","last_became_active":"2024-09-10T06:26:32.282263+0000","last_became_peered":"2024-09-10T06:26:32.282263+0000","last_unstale":"2024-09-10T06:28:48.459648+0000","last_undegraded":"2024-09-10T06:28:48.459648+0000","last_fullsized":"2024-09-10T06:28:48.459648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:02.124800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375652+0000","last_change":"2024-09-10T06:26:30.576489+0000","last_active":"2024-09-10T06:28:48.375652+0000","last_peered":"2024-09-10T06:28:48.375652+0000","last_clean":"2024-09-10T06:28:48.375652+0000","last_became_active":"2024-09-10T06:26:30.576039+0000","last_became_peered":"2024-09-10T06:26:30.576039+0000","last_unstale":"2024-09-10T06:28:48.375652+0000","last_undegraded":"2024-09-10T06:28:48.375652+0000","last_fullsized":"2024-09-10T06:28:48.375652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377684+0000","last_change":"2024-09-10T06:26:34.268758+0000","last_active":"2024-09-10T06:28:48.377684+0000","last_peered":"2024-09-10T06:28:48.377684+0000","last_clean":"2024-09-10T06:28:48.377684+0000","last_became_active":"2024-09-10T06:26:34.268279+0000","last_became_peered":"2024-09-10T06:26:34.268279+0000","last_unstale":"2024-09-10T06:28:48.377684+0000","last_undegraded":"2024-09-10T06:28:48.377684+0000","last_fullsized":"2024-09-10T06:28:48.377684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:42.052702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380478+0000","last_change":"2024-09-10T06:26:36.273991+0000","last_active":"2024-09-10T06:28:48.380478+0000","last_peered":"2024-09-10T06:28:48.380478+0000","last_clean":"2024-09-10T06:28:48.380478+0000","last_became_active":"2024-09-10T06:26:36.273138+0000","last_became_peered":"2024-09-10T06:26:36.273138+0000","last_unstale":"2024-09-10T06:28:48.380478+0000","last_undegraded":"2024-09-10T06:28:48.380478+0000","last_fullsized":"2024-09-10T06:28:48.380478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379823+0000","last_change":"2024-09-10T06:26:38.294543+0000","last_active":"2024-09-10T06:28:48.379823+0000","last_peered":"2024-09-10T06:28:48.379823+0000","last_clean":"2024-09-10T06:28:48.379823+0000","last_became_active":"2024-09-10T06:26:38.293754+0000","last_became_peered":"2024-09-10T06:26:38.293754+0000","last_unstale":"2024-09-10T06:28:48.379823+0000","last_undegraded":"2024-09-10T06:28:48.379823+0000","last_fullsized":"2024-09-10T06:28:48.379823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"62'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375308+0000","last_change":"2024-09-10T06:26:40.326998+0000","last_active":"2024-09-10T06:28:48.375308+0000","last_peered":"2024-09-10T06:28:48.375308+0000","last_clean":"2024-09-10T06:28:48.375308+0000","last_became_active":"2024-09-10T06:26:40.322648+0000","last_became_peered":"2024-09-10T06:26:40.322648+0000","last_unstale":"2024-09-10T06:28:48.375308+0000","last_undegraded":"2024-09-10T06:28:48.375308+0000","last_fullsized":"2024-09-10T06:28:48.375308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:19.837495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"76'4","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379477+0000","last_change":"2024-09-10T06:26:32.256959+0000","last_active":"2024-09-10T06:28:48.379477+0000","last_peered":"2024-09-10T06:28:48.379477+0000","last_clean":"2024-09-10T06:28:48.379477+0000","last_became_active":"2024-09-10T06:26:32.256701+0000","last_became_peered":"2024-09-10T06:26:32.256701+0000","last_unstale":"2024-09-10T06:28:48.379477+0000","last_undegraded":"2024-09-10T06:28:48.379477+0000","last_fullsized":"2024-09-10T06:28:48.379477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"73'13","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457900+0000","last_change":"2024-09-10T06:26:30.598409+0000","last_active":"2024-09-10T06:28:48.457900+0000","last_peered":"2024-09-10T06:28:48.457900+0000","last_clean":"2024-09-10T06:28:48.457900+0000","last_became_active":"2024-09-10T06:26:30.597703+0000","last_became_peered":"2024-09-10T06:26:30.597703+0000","last_unstale":"2024-09-10T06:28:48.457900+0000","last_undegraded":"2024-09-10T06:28:48.457900+0000","last_fullsized":"2024-09-10T06:28:48.457900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380025+0000","last_change":"2024-09-10T06:26:34.268741+0000","last_active":"2024-09-10T06:28:48.380025+0000","last_peered":"2024-09-10T06:28:48.380025+0000","last_clean":"2024-09-10T06:28:48.380025+0000","last_became_active":"2024-09-10T06:26:34.268192+0000","last_became_peered":"2024-09-10T06:26:34.268192+0000","last_unstale":"2024-09-10T06:28:48.380025+0000","last_undegraded":"2024-09-10T06:28:48.380025+0000","last_fullsized":"2024-09-10T06:28:48.380025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:42:10.110645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454978+0000","last_change":"2024-09-10T06:26:36.275955+0000","last_active":"2024-09-10T06:28:48.454978+0000","last_peered":"2024-09-10T06:28:48.454978+0000","last_clean":"2024-09-10T06:28:48.454978+0000","last_became_active":"2024-09-10T06:26:36.275306+0000","last_became_peered":"2024-09-10T06:26:36.275306+0000","last_unstale":"2024-09-10T06:28:48.454978+0000","last_undegraded":"2024-09-10T06:28:48.454978+0000","last_fullsized":"2024-09-10T06:28:48.454978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:03.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'102","reported_seq":402,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:52.690214+0000","last_change":"2024-09-10T06:26:38.302764+0000","last_active":"2024-09-10T06:28:52.690214+0000","last_peered":"2024-09-10T06:28:52.690214+0000","last_clean":"2024-09-10T06:28:52.690214+0000","last_became_active":"2024-09-10T06:26:38.300326+0000","last_became_peered":"2024-09-10T06:26:38.300326+0000","last_unstale":"2024-09-10T06:28:52.690214+0000","last_undegraded":"2024-09-10T06:28:52.690214+0000","last_fullsized":"2024-09-10T06:28:52.690214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:29.851085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376634+0000","last_change":"2024-09-10T06:26:40.297893+0000","last_active":"2024-09-10T06:28:48.376634+0000","last_peered":"2024-09-10T06:28:48.376634+0000","last_clean":"2024-09-10T06:28:48.376634+0000","last_became_active":"2024-09-10T06:26:40.297296+0000","last_became_peered":"2024-09-10T06:26:40.297296+0000","last_unstale":"2024-09-10T06:28:48.376634+0000","last_undegraded":"2024-09-10T06:28:48.376634+0000","last_fullsized":"2024-09-10T06:28:48.376634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379613+0000","last_change":"2024-09-10T06:26:32.265005+0000","last_active":"2024-09-10T06:28:48.379613+0000","last_peered":"2024-09-10T06:28:48.379613+0000","last_clean":"2024-09-10T06:28:48.379613+0000","last_became_active":"2024-09-10T06:26:32.264334+0000","last_became_peered":"2024-09-10T06:26:32.264334+0000","last_unstale":"2024-09-10T06:28:48.379613+0000","last_undegraded":"2024-09-10T06:28:48.379613+0000","last_fullsized":"2024-09-10T06:28:48.379613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"73'13","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457010+0000","last_change":"2024-09-10T06:26:30.576242+0000","last_active":"2024-09-10T06:28:48.457010+0000","last_peered":"2024-09-10T06:28:48.457010+0000","last_clean":"2024-09-10T06:28:48.457010+0000","last_became_active":"2024-09-10T06:26:30.575433+0000","last_became_peered":"2024-09-10T06:26:30.575433+0000","last_unstale":"2024-09-10T06:28:48.457010+0000","last_undegraded":"2024-09-10T06:28:48.457010+0000","last_fullsized":"2024-09-10T06:28:48.457010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459995+0000","last_change":"2024-09-10T06:26:34.283701+0000","last_active":"2024-09-10T06:28:48.459995+0000","last_peered":"2024-09-10T06:28:48.459995+0000","last_clean":"2024-09-10T06:28:48.459995+0000","last_became_active":"2024-09-10T06:26:34.282941+0000","last_became_peered":"2024-09-10T06:26:34.282941+0000","last_unstale":"2024-09-10T06:28:48.459995+0000","last_undegraded":"2024-09-10T06:28:48.459995+0000","last_fullsized":"2024-09-10T06:28:48.459995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:29.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"76'16","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463444+0000","last_change":"2024-09-10T06:26:36.298510+0000","last_active":"2024-09-10T06:28:48.463444+0000","last_peered":"2024-09-10T06:28:48.463444+0000","last_clean":"2024-09-10T06:28:48.463444+0000","last_became_active":"2024-09-10T06:26:36.297309+0000","last_became_peered":"2024-09-10T06:26:36.297309+0000","last_unstale":"2024-09-10T06:28:48.463444+0000","last_undegraded":"2024-09-10T06:28:48.463444+0000","last_fullsized":"2024-09-10T06:28:48.463444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'102","reported_seq":269,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:52.696758+0000","last_change":"2024-09-10T06:26:38.300228+0000","last_active":"2024-09-10T06:28:52.696758+0000","last_peered":"2024-09-10T06:28:52.696758+0000","last_clean":"2024-09-10T06:28:52.696758+0000","last_became_active":"2024-09-10T06:26:38.299355+0000","last_became_peered":"2024-09-10T06:26:38.299355+0000","last_unstale":"2024-09-10T06:28:52.696758+0000","last_undegraded":"2024-09-10T06:28:52.696758+0000","last_fullsized":"2024-09-10T06:28:52.696758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:20.050096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456891+0000","last_change":"2024-09-10T06:26:32.271283+0000","last_active":"2024-09-10T06:28:48.456891+0000","last_peered":"2024-09-10T06:28:48.456891+0000","last_clean":"2024-09-10T06:28:48.456891+0000","last_became_active":"2024-09-10T06:26:32.270496+0000","last_became_peered":"2024-09-10T06:26:32.270496+0000","last_unstale":"2024-09-10T06:28:48.456891+0000","last_undegraded":"2024-09-10T06:28:48.456891+0000","last_fullsized":"2024-09-10T06:28:48.456891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464629+0000","last_change":"2024-09-10T06:26:30.607373+0000","last_active":"2024-09-10T06:28:48.464629+0000","last_peered":"2024-09-10T06:28:48.464629+0000","last_clean":"2024-09-10T06:28:48.464629+0000","last_became_active":"2024-09-10T06:26:30.606685+0000","last_became_peered":"2024-09-10T06:26:30.606685+0000","last_unstale":"2024-09-10T06:28:48.464629+0000","last_undegraded":"2024-09-10T06:28:48.464629+0000","last_fullsized":"2024-09-10T06:28:48.464629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:35.705564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456456+0000","last_change":"2024-09-10T06:26:34.286925+0000","last_active":"2024-09-10T06:28:48.456456+0000","last_peered":"2024-09-10T06:28:48.456456+0000","last_clean":"2024-09-10T06:28:48.456456+0000","last_became_active":"2024-09-10T06:26:34.285787+0000","last_became_peered":"2024-09-10T06:26:34.285787+0000","last_unstale":"2024-09-10T06:28:48.456456+0000","last_undegraded":"2024-09-10T06:28:48.456456+0000","last_fullsized":"2024-09-10T06:28:48.456456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"76'25","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456092+0000","last_change":"2024-09-10T06:26:36.293988+0000","last_active":"2024-09-10T06:28:48.456092+0000","last_peered":"2024-09-10T06:28:48.456092+0000","last_clean":"2024-09-10T06:28:48.456092+0000","last_became_active":"2024-09-10T06:26:36.293226+0000","last_became_peered":"2024-09-10T06:26:36.293226+0000","last_unstale":"2024-09-10T06:28:48.456092+0000","last_undegraded":"2024-09-10T06:28:48.456092+0000","last_fullsized":"2024-09-10T06:28:48.456092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453865+0000","last_change":"2024-09-10T06:26:38.305826+0000","last_active":"2024-09-10T06:28:48.453865+0000","last_peered":"2024-09-10T06:28:48.453865+0000","last_clean":"2024-09-10T06:28:48.453865+0000","last_became_active":"2024-09-10T06:26:38.304601+0000","last_became_peered":"2024-09-10T06:26:38.304601+0000","last_unstale":"2024-09-10T06:28:48.453865+0000","last_undegraded":"2024-09-10T06:28:48.453865+0000","last_fullsized":"2024-09-10T06:28:48.453865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:12.545261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"62'8","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460978+0000","last_change":"2024-09-10T06:26:40.332286+0000","last_active":"2024-09-10T06:28:48.460978+0000","last_peered":"2024-09-10T06:28:48.460978+0000","last_clean":"2024-09-10T06:28:48.460978+0000","last_became_active":"2024-09-10T06:26:40.331262+0000","last_became_peered":"2024-09-10T06:26:40.331262+0000","last_unstale":"2024-09-10T06:28:48.460978+0000","last_undegraded":"2024-09-10T06:28:48.460978+0000","last_fullsized":"2024-09-10T06:28:48.460978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377579+0000","last_change":"2024-09-10T06:26:32.262320+0000","last_active":"2024-09-10T06:28:48.377579+0000","last_peered":"2024-09-10T06:28:48.377579+0000","last_clean":"2024-09-10T06:28:48.377579+0000","last_became_active":"2024-09-10T06:26:32.261423+0000","last_became_peered":"2024-09-10T06:26:32.261423+0000","last_unstale":"2024-09-10T06:28:48.377579+0000","last_undegraded":"2024-09-10T06:28:48.377579+0000","last_fullsized":"2024-09-10T06:28:48.377579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"76'13","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464559+0000","last_change":"2024-09-10T06:26:30.595879+0000","last_active":"2024-09-10T06:28:48.464559+0000","last_peered":"2024-09-10T06:28:48.464559+0000","last_clean":"2024-09-10T06:28:48.464559+0000","last_became_active":"2024-09-10T06:26:30.595269+0000","last_became_peered":"2024-09-10T06:26:30.595269+0000","last_unstale":"2024-09-10T06:28:48.464559+0000","last_undegraded":"2024-09-10T06:28:48.464559+0000","last_fullsized":"2024-09-10T06:28:48.464559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453028+0000","last_change":"2024-09-10T06:26:34.266906+0000","last_active":"2024-09-10T06:28:48.453028+0000","last_peered":"2024-09-10T06:28:48.453028+0000","last_clean":"2024-09-10T06:28:48.453028+0000","last_became_active":"2024-09-10T06:26:34.266017+0000","last_became_peered":"2024-09-10T06:26:34.266017+0000","last_unstale":"2024-09-10T06:28:48.453028+0000","last_undegraded":"2024-09-10T06:28:48.453028+0000","last_fullsized":"2024-09-10T06:28:48.453028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:24.366166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"76'16","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378015+0000","last_change":"2024-09-10T06:26:36.297020+0000","last_active":"2024-09-10T06:28:48.378015+0000","last_peered":"2024-09-10T06:28:48.378015+0000","last_clean":"2024-09-10T06:28:48.378015+0000","last_became_active":"2024-09-10T06:26:36.295796+0000","last_became_peered":"2024-09-10T06:26:36.295796+0000","last_unstale":"2024-09-10T06:28:48.378015+0000","last_undegraded":"2024-09-10T06:28:48.378015+0000","last_fullsized":"2024-09-10T06:28:48.378015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375244+0000","last_change":"2024-09-10T06:26:38.297273+0000","last_active":"2024-09-10T06:28:48.375244+0000","last_peered":"2024-09-10T06:28:48.375244+0000","last_clean":"2024-09-10T06:28:48.375244+0000","last_became_active":"2024-09-10T06:26:38.296455+0000","last_became_peered":"2024-09-10T06:26:38.296455+0000","last_unstale":"2024-09-10T06:28:48.375244+0000","last_undegraded":"2024-09-10T06:28:48.375244+0000","last_fullsized":"2024-09-10T06:28:48.375244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:26.766702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458102+0000","last_change":"2024-09-10T06:26:40.328294+0000","last_active":"2024-09-10T06:28:48.458102+0000","last_peered":"2024-09-10T06:28:48.458102+0000","last_clean":"2024-09-10T06:28:48.458102+0000","last_became_active":"2024-09-10T06:26:40.327585+0000","last_became_peered":"2024-09-10T06:26:40.327585+0000","last_unstale":"2024-09-10T06:28:48.458102+0000","last_undegraded":"2024-09-10T06:28:48.458102+0000","last_fullsized":"2024-09-10T06:28:48.458102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.537210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458888+0000","last_change":"2024-09-10T06:27:08.600683+0000","last_active":"2024-09-10T06:28:48.458888+0000","last_peered":"2024-09-10T06:28:48.458888+0000","last_clean":"2024-09-10T06:28:48.458888+0000","last_became_active":"2024-09-10T06:27:08.599875+0000","last_became_peered":"2024-09-10T06:27:08.599875+0000","last_unstale":"2024-09-10T06:28:48.458888+0000","last_undegraded":"2024-09-10T06:28:48.458888+0000","last_fullsized":"2024-09-10T06:28:48.458888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:59.605814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464013+0000","last_change":"2024-09-10T06:26:30.611704+0000","last_active":"2024-09-10T06:28:48.464013+0000","last_peered":"2024-09-10T06:28:48.464013+0000","last_clean":"2024-09-10T06:28:48.464013+0000","last_became_active":"2024-09-10T06:26:30.611039+0000","last_became_peered":"2024-09-10T06:26:30.611039+0000","last_unstale":"2024-09-10T06:28:48.464013+0000","last_undegraded":"2024-09-10T06:28:48.464013+0000","last_fullsized":"2024-09-10T06:28:48.464013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455026+0000","last_change":"2024-09-10T06:26:34.263514+0000","last_active":"2024-09-10T06:28:48.455026+0000","last_peered":"2024-09-10T06:28:48.455026+0000","last_clean":"2024-09-10T06:28:48.455026+0000","last_became_active":"2024-09-10T06:26:34.262793+0000","last_became_peered":"2024-09-10T06:26:34.262793+0000","last_unstale":"2024-09-10T06:28:48.455026+0000","last_undegraded":"2024-09-10T06:28:48.455026+0000","last_fullsized":"2024-09-10T06:28:48.455026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:31.501738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"76'22","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455616+0000","last_change":"2024-09-10T06:26:36.299923+0000","last_active":"2024-09-10T06:28:48.455616+0000","last_peered":"2024-09-10T06:28:48.455616+0000","last_clean":"2024-09-10T06:28:48.455616+0000","last_became_active":"2024-09-10T06:26:36.299140+0000","last_became_peered":"2024-09-10T06:26:36.299140+0000","last_unstale":"2024-09-10T06:28:48.455616+0000","last_undegraded":"2024-09-10T06:28:48.455616+0000","last_fullsized":"2024-09-10T06:28:48.455616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:12.246303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'102","reported_seq":267,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:50.610563+0000","last_change":"2024-09-10T06:26:38.292019+0000","last_active":"2024-09-10T06:28:50.610563+0000","last_peered":"2024-09-10T06:28:50.610563+0000","last_clean":"2024-09-10T06:28:50.610563+0000","last_became_active":"2024-09-10T06:26:38.291322+0000","last_became_peered":"2024-09-10T06:26:38.291322+0000","last_unstale":"2024-09-10T06:28:50.610563+0000","last_undegraded":"2024-09-10T06:28:50.610563+0000","last_fullsized":"2024-09-10T06:28:50.610563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"64'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378724+0000","last_change":"2024-09-10T06:26:40.328427+0000","last_active":"2024-09-10T06:28:48.378724+0000","last_peered":"2024-09-10T06:28:48.378724+0000","last_clean":"2024-09-10T06:28:48.378724+0000","last_became_active":"2024-09-10T06:26:40.323249+0000","last_became_peered":"2024-09-10T06:26:40.323249+0000","last_unstale":"2024-09-10T06:28:48.378724+0000","last_undegraded":"2024-09-10T06:28:48.378724+0000","last_fullsized":"2024-09-10T06:28:48.378724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:50.823195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377190+0000","last_change":"2024-09-10T06:26:32.274824+0000","last_active":"2024-09-10T06:28:48.377190+0000","last_peered":"2024-09-10T06:28:48.377190+0000","last_clean":"2024-09-10T06:28:48.377190+0000","last_became_active":"2024-09-10T06:26:32.274496+0000","last_became_peered":"2024-09-10T06:26:32.274496+0000","last_unstale":"2024-09-10T06:28:48.377190+0000","last_undegraded":"2024-09-10T06:28:48.377190+0000","last_fullsized":"2024-09-10T06:28:48.377190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:39.513476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"73'7","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462108+0000","last_change":"2024-09-10T06:26:30.604684+0000","last_active":"2024-09-10T06:28:48.462108+0000","last_peered":"2024-09-10T06:28:48.462108+0000","last_clean":"2024-09-10T06:28:48.462108+0000","last_became_active":"2024-09-10T06:26:30.593432+0000","last_became_peered":"2024-09-10T06:26:30.593432+0000","last_unstale":"2024-09-10T06:28:48.462108+0000","last_undegraded":"2024-09-10T06:28:48.462108+0000","last_fullsized":"2024-09-10T06:28:48.462108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454621+0000","last_change":"2024-09-10T06:26:34.256662+0000","last_active":"2024-09-10T06:28:48.454621+0000","last_peered":"2024-09-10T06:28:48.454621+0000","last_clean":"2024-09-10T06:28:48.454621+0000","last_became_active":"2024-09-10T06:26:34.256256+0000","last_became_peered":"2024-09-10T06:26:34.256256+0000","last_unstale":"2024-09-10T06:28:48.454621+0000","last_undegraded":"2024-09-10T06:28:48.454621+0000","last_fullsized":"2024-09-10T06:28:48.454621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:35.549063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'26","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375816+0000","last_change":"2024-09-10T06:26:36.296631+0000","last_active":"2024-09-10T06:28:48.375816+0000","last_peered":"2024-09-10T06:28:48.375816+0000","last_clean":"2024-09-10T06:28:48.375816+0000","last_became_active":"2024-09-10T06:26:36.295838+0000","last_became_peered":"2024-09-10T06:26:36.295838+0000","last_unstale":"2024-09-10T06:28:48.375816+0000","last_undegraded":"2024-09-10T06:28:48.375816+0000","last_fullsized":"2024-09-10T06:28:48.375816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:04.271824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9809,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452870+0000","last_change":"2024-09-10T06:26:38.308698+0000","last_active":"2024-09-10T06:28:48.452870+0000","last_peered":"2024-09-10T06:28:48.452870+0000","last_clean":"2024-09-10T06:28:48.452870+0000","last_became_active":"2024-09-10T06:26:38.307965+0000","last_became_peered":"2024-09-10T06:26:38.307965+0000","last_unstale":"2024-09-10T06:28:48.452870+0000","last_undegraded":"2024-09-10T06:28:48.452870+0000","last_fullsized":"2024-09-10T06:28:48.452870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:04.566221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"62'4","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454102+0000","last_change":"2024-09-10T06:26:40.326474+0000","last_active":"2024-09-10T06:28:48.454102+0000","last_peered":"2024-09-10T06:28:48.454102+0000","last_clean":"2024-09-10T06:28:48.454102+0000","last_became_active":"2024-09-10T06:26:40.325731+0000","last_became_peered":"2024-09-10T06:26:40.325731+0000","last_unstale":"2024-09-10T06:28:48.454102+0000","last_undegraded":"2024-09-10T06:28:48.454102+0000","last_fullsized":"2024-09-10T06:28:48.454102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:19.400355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"64'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380025+0000","last_change":"2024-09-10T06:26:32.254177+0000","last_active":"2024-09-10T06:28:48.380025+0000","last_peered":"2024-09-10T06:28:48.380025+0000","last_clean":"2024-09-10T06:28:48.380025+0000","last_became_active":"2024-09-10T06:26:32.253154+0000","last_became_peered":"2024-09-10T06:26:32.253154+0000","last_unstale":"2024-09-10T06:28:48.380025+0000","last_undegraded":"2024-09-10T06:28:48.380025+0000","last_fullsized":"2024-09-10T06:28:48.380025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"72'5","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375194+0000","last_change":"2024-09-10T06:26:30.572406+0000","last_active":"2024-09-10T06:28:48.375194+0000","last_peered":"2024-09-10T06:28:48.375194+0000","last_clean":"2024-09-10T06:28:48.375194+0000","last_became_active":"2024-09-10T06:26:30.571829+0000","last_became_peered":"2024-09-10T06:26:30.571829+0000","last_unstale":"2024-09-10T06:28:48.375194+0000","last_undegraded":"2024-09-10T06:28:48.375194+0000","last_fullsized":"2024-09-10T06:28:48.375194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455283+0000","last_change":"2024-09-10T06:26:34.285406+0000","last_active":"2024-09-10T06:28:48.455283+0000","last_peered":"2024-09-10T06:28:48.455283+0000","last_clean":"2024-09-10T06:28:48.455283+0000","last_became_active":"2024-09-10T06:26:34.285004+0000","last_became_peered":"2024-09-10T06:26:34.285004+0000","last_unstale":"2024-09-10T06:28:48.455283+0000","last_undegraded":"2024-09-10T06:28:48.455283+0000","last_fullsized":"2024-09-10T06:28:48.455283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:03.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"87'21","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379938+0000","last_change":"2024-09-10T06:26:36.293191+0000","last_active":"2024-09-10T06:28:48.379938+0000","last_peered":"2024-09-10T06:28:48.379938+0000","last_clean":"2024-09-10T06:28:48.379938+0000","last_became_active":"2024-09-10T06:26:36.292423+0000","last_became_peered":"2024-09-10T06:26:36.292423+0000","last_unstale":"2024-09-10T06:28:48.379938+0000","last_undegraded":"2024-09-10T06:28:48.379938+0000","last_fullsized":"2024-09-10T06:28:48.379938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":28,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378126+0000","last_change":"2024-09-10T06:26:38.293667+0000","last_active":"2024-09-10T06:28:48.378126+0000","last_peered":"2024-09-10T06:28:48.378126+0000","last_clean":"2024-09-10T06:28:48.378126+0000","last_became_active":"2024-09-10T06:26:38.292918+0000","last_became_peered":"2024-09-10T06:26:38.292918+0000","last_unstale":"2024-09-10T06:28:48.378126+0000","last_undegraded":"2024-09-10T06:28:48.378126+0000","last_fullsized":"2024-09-10T06:28:48.378126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:57.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376446+0000","last_change":"2024-09-10T06:26:40.327061+0000","last_active":"2024-09-10T06:28:48.376446+0000","last_peered":"2024-09-10T06:28:48.376446+0000","last_clean":"2024-09-10T06:28:48.376446+0000","last_became_active":"2024-09-10T06:26:40.326431+0000","last_became_peered":"2024-09-10T06:26:40.326431+0000","last_unstale":"2024-09-10T06:28:48.376446+0000","last_undegraded":"2024-09-10T06:28:48.376446+0000","last_fullsized":"2024-09-10T06:28:48.376446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:27.631214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"64'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380722+0000","last_change":"2024-09-10T06:26:32.255139+0000","last_active":"2024-09-10T06:28:48.380722+0000","last_peered":"2024-09-10T06:28:48.380722+0000","last_clean":"2024-09-10T06:28:48.380722+0000","last_became_active":"2024-09-10T06:26:32.253524+0000","last_became_peered":"2024-09-10T06:26:32.253524+0000","last_unstale":"2024-09-10T06:28:48.380722+0000","last_undegraded":"2024-09-10T06:28:48.380722+0000","last_fullsized":"2024-09-10T06:28:48.380722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"73'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459281+0000","last_change":"2024-09-10T06:26:30.591838+0000","last_active":"2024-09-10T06:28:48.459281+0000","last_peered":"2024-09-10T06:28:48.459281+0000","last_clean":"2024-09-10T06:28:48.459281+0000","last_became_active":"2024-09-10T06:26:30.591125+0000","last_became_peered":"2024-09-10T06:26:30.591125+0000","last_unstale":"2024-09-10T06:28:48.459281+0000","last_undegraded":"2024-09-10T06:28:48.459281+0000","last_fullsized":"2024-09-10T06:28:48.459281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453621+0000","last_change":"2024-09-10T06:26:34.280391+0000","last_active":"2024-09-10T06:28:48.453621+0000","last_peered":"2024-09-10T06:28:48.453621+0000","last_clean":"2024-09-10T06:28:48.453621+0000","last_became_active":"2024-09-10T06:26:34.280058+0000","last_became_peered":"2024-09-10T06:26:34.280058+0000","last_unstale":"2024-09-10T06:28:48.453621+0000","last_undegraded":"2024-09-10T06:28:48.453621+0000","last_fullsized":"2024-09-10T06:28:48.453621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.461857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"76'23","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456011+0000","last_change":"2024-09-10T06:26:36.277547+0000","last_active":"2024-09-10T06:28:48.456011+0000","last_peered":"2024-09-10T06:28:48.456011+0000","last_clean":"2024-09-10T06:28:48.456011+0000","last_became_active":"2024-09-10T06:26:36.276965+0000","last_became_peered":"2024-09-10T06:26:36.276965+0000","last_unstale":"2024-09-10T06:28:48.456011+0000","last_undegraded":"2024-09-10T06:28:48.456011+0000","last_fullsized":"2024-09-10T06:28:48.456011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:43.212945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'102","reported_seq":298,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:52.691656+0000","last_change":"2024-09-10T06:26:38.306134+0000","last_active":"2024-09-10T06:28:52.691656+0000","last_peered":"2024-09-10T06:28:52.691656+0000","last_clean":"2024-09-10T06:28:52.691656+0000","last_became_active":"2024-09-10T06:26:38.299012+0000","last_became_peered":"2024-09-10T06:26:38.299012+0000","last_unstale":"2024-09-10T06:28:52.691656+0000","last_undegraded":"2024-09-10T06:28:52.691656+0000","last_fullsized":"2024-09-10T06:28:52.691656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:37.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"61'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454114+0000","last_change":"2024-09-10T06:26:40.336036+0000","last_active":"2024-09-10T06:28:48.454114+0000","last_peered":"2024-09-10T06:28:48.454114+0000","last_clean":"2024-09-10T06:28:48.454114+0000","last_became_active":"2024-09-10T06:26:40.335302+0000","last_became_peered":"2024-09-10T06:26:40.335302+0000","last_unstale":"2024-09-10T06:28:48.454114+0000","last_undegraded":"2024-09-10T06:28:48.454114+0000","last_fullsized":"2024-09-10T06:28:48.454114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:24.024562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380676+0000","last_change":"2024-09-10T06:26:32.287897+0000","last_active":"2024-09-10T06:28:48.380676+0000","last_peered":"2024-09-10T06:28:48.380676+0000","last_clean":"2024-09-10T06:28:48.380676+0000","last_became_active":"2024-09-10T06:26:32.287315+0000","last_became_peered":"2024-09-10T06:26:32.287315+0000","last_unstale":"2024-09-10T06:28:48.380676+0000","last_undegraded":"2024-09-10T06:28:48.380676+0000","last_fullsized":"2024-09-10T06:28:48.380676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"73'7","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378593+0000","last_change":"2024-09-10T06:26:30.569192+0000","last_active":"2024-09-10T06:28:48.378593+0000","last_peered":"2024-09-10T06:28:48.378593+0000","last_clean":"2024-09-10T06:28:48.378593+0000","last_became_active":"2024-09-10T06:26:30.568464+0000","last_became_peered":"2024-09-10T06:26:30.568464+0000","last_unstale":"2024-09-10T06:28:48.378593+0000","last_undegraded":"2024-09-10T06:28:48.378593+0000","last_fullsized":"2024-09-10T06:28:48.378593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:58.987914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":280,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459913+0000","last_change":"2024-09-10T06:26:34.279935+0000","last_active":"2024-09-10T06:28:48.459913+0000","last_peered":"2024-09-10T06:28:48.459913+0000","last_clean":"2024-09-10T06:28:48.459913+0000","last_became_active":"2024-09-10T06:26:34.279192+0000","last_became_peered":"2024-09-10T06:26:34.279192+0000","last_unstale":"2024-09-10T06:28:48.459913+0000","last_undegraded":"2024-09-10T06:28:48.459913+0000","last_fullsized":"2024-09-10T06:28:48.459913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:18.753175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377130+0000","last_change":"2024-09-10T06:26:36.290330+0000","last_active":"2024-09-10T06:28:48.377130+0000","last_peered":"2024-09-10T06:28:48.377130+0000","last_clean":"2024-09-10T06:28:48.377130+0000","last_became_active":"2024-09-10T06:26:36.289527+0000","last_became_peered":"2024-09-10T06:26:36.289527+0000","last_unstale":"2024-09-10T06:28:48.377130+0000","last_undegraded":"2024-09-10T06:28:48.377130+0000","last_fullsized":"2024-09-10T06:28:48.377130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'102","reported_seq":310,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:52.694787+0000","last_change":"2024-09-10T06:26:38.288663+0000","last_active":"2024-09-10T06:28:52.694787+0000","last_peered":"2024-09-10T06:28:52.694787+0000","last_clean":"2024-09-10T06:28:52.694787+0000","last_became_active":"2024-09-10T06:26:38.287740+0000","last_became_peered":"2024-09-10T06:26:38.287740+0000","last_unstale":"2024-09-10T06:28:52.694787+0000","last_undegraded":"2024-09-10T06:28:52.694787+0000","last_fullsized":"2024-09-10T06:28:52.694787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:22.078943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'8","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377335+0000","last_change":"2024-09-10T06:26:40.329737+0000","last_active":"2024-09-10T06:28:48.377335+0000","last_peered":"2024-09-10T06:28:48.377335+0000","last_clean":"2024-09-10T06:28:48.377335+0000","last_became_active":"2024-09-10T06:26:40.328952+0000","last_became_peered":"2024-09-10T06:26:40.328952+0000","last_unstale":"2024-09-10T06:28:48.377335+0000","last_undegraded":"2024-09-10T06:28:48.377335+0000","last_fullsized":"2024-09-10T06:28:48.377335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454598+0000","last_change":"2024-09-10T06:26:32.270997+0000","last_active":"2024-09-10T06:28:48.454598+0000","last_peered":"2024-09-10T06:28:48.454598+0000","last_clean":"2024-09-10T06:28:48.454598+0000","last_became_active":"2024-09-10T06:26:32.270265+0000","last_became_peered":"2024-09-10T06:26:32.270265+0000","last_unstale":"2024-09-10T06:28:48.454598+0000","last_undegraded":"2024-09-10T06:28:48.454598+0000","last_fullsized":"2024-09-10T06:28:48.454598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:33.067523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"73'11","reported_seq":127,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452795+0000","last_change":"2024-09-10T06:27:08.593158+0000","last_active":"2024-09-10T06:28:48.452795+0000","last_peered":"2024-09-10T06:28:48.452795+0000","last_clean":"2024-09-10T06:28:48.452795+0000","last_became_active":"2024-09-10T06:27:08.592864+0000","last_became_peered":"2024-09-10T06:27:08.592864+0000","last_unstale":"2024-09-10T06:28:48.452795+0000","last_undegraded":"2024-09-10T06:28:48.452795+0000","last_fullsized":"2024-09-10T06:28:48.452795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:35.185591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380176+0000","last_change":"2024-09-10T06:26:34.286497+0000","last_active":"2024-09-10T06:28:48.380176+0000","last_peered":"2024-09-10T06:28:48.380176+0000","last_clean":"2024-09-10T06:28:48.380176+0000","last_became_active":"2024-09-10T06:26:34.285334+0000","last_became_peered":"2024-09-10T06:26:34.285334+0000","last_unstale":"2024-09-10T06:28:48.380176+0000","last_undegraded":"2024-09-10T06:28:48.380176+0000","last_fullsized":"2024-09-10T06:28:48.380176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:54.506182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"76'23","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459007+0000","last_change":"2024-09-10T06:26:36.288213+0000","last_active":"2024-09-10T06:28:48.459007+0000","last_peered":"2024-09-10T06:28:48.459007+0000","last_clean":"2024-09-10T06:28:48.459007+0000","last_became_active":"2024-09-10T06:26:36.287468+0000","last_became_peered":"2024-09-10T06:26:36.287468+0000","last_unstale":"2024-09-10T06:28:48.459007+0000","last_undegraded":"2024-09-10T06:28:48.459007+0000","last_fullsized":"2024-09-10T06:28:48.459007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457697+0000","last_change":"2024-09-10T06:26:38.291943+0000","last_active":"2024-09-10T06:28:48.457697+0000","last_peered":"2024-09-10T06:28:48.457697+0000","last_clean":"2024-09-10T06:28:48.457697+0000","last_became_active":"2024-09-10T06:26:38.291214+0000","last_became_peered":"2024-09-10T06:26:38.291214+0000","last_unstale":"2024-09-10T06:28:48.457697+0000","last_undegraded":"2024-09-10T06:28:48.457697+0000","last_fullsized":"2024-09-10T06:28:48.457697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:56.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"67'4","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453374+0000","last_change":"2024-09-10T06:26:40.331977+0000","last_active":"2024-09-10T06:28:48.453374+0000","last_peered":"2024-09-10T06:28:48.453374+0000","last_clean":"2024-09-10T06:28:48.453374+0000","last_became_active":"2024-09-10T06:26:40.331502+0000","last_became_peered":"2024-09-10T06:26:40.331502+0000","last_unstale":"2024-09-10T06:28:48.453374+0000","last_undegraded":"2024-09-10T06:28:48.453374+0000","last_fullsized":"2024-09-10T06:28:48.453374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:43.572813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460459+0000","last_change":"2024-09-10T06:26:32.274623+0000","last_active":"2024-09-10T06:28:48.460459+0000","last_peered":"2024-09-10T06:28:48.460459+0000","last_clean":"2024-09-10T06:28:48.460459+0000","last_became_active":"2024-09-10T06:26:32.273727+0000","last_became_peered":"2024-09-10T06:26:32.273727+0000","last_unstale":"2024-09-10T06:28:48.460459+0000","last_undegraded":"2024-09-10T06:28:48.460459+0000","last_fullsized":"2024-09-10T06:28:48.460459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:15.364938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":258,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455693+0000","last_change":"2024-09-10T06:26:18.153206+0000","last_active":"2024-09-10T06:28:48.455693+0000","last_peered":"2024-09-10T06:28:48.455693+0000","last_clean":"2024-09-10T06:28:48.455693+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:28:48.455693+0000","last_undegraded":"2024-09-10T06:28:48.455693+0000","last_fullsized":"2024-09-10T06:28:48.455693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_clean_scrub_stamp":"2024-09-10T06:26:16.422775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:42.510577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460195+0000","last_change":"2024-09-10T06:26:25.532465+0000","last_active":"2024-09-10T06:28:48.460195+0000","last_peered":"2024-09-10T06:28:48.460195+0000","last_clean":"2024-09-10T06:28:48.460195+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:28:48.460195+0000","last_undegraded":"2024-09-10T06:28:48.460195+0000","last_fullsized":"2024-09-10T06:28:48.460195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:10.318844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"73'9","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375960+0000","last_change":"2024-09-10T06:26:30.606630+0000","last_active":"2024-09-10T06:28:48.375960+0000","last_peered":"2024-09-10T06:28:48.375960+0000","last_clean":"2024-09-10T06:28:48.375960+0000","last_became_active":"2024-09-10T06:26:30.606348+0000","last_became_peered":"2024-09-10T06:26:30.606348+0000","last_unstale":"2024-09-10T06:28:48.375960+0000","last_undegraded":"2024-09-10T06:28:48.375960+0000","last_fullsized":"2024-09-10T06:28:48.375960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462936+0000","last_change":"2024-09-10T06:26:34.287201+0000","last_active":"2024-09-10T06:28:48.462936+0000","last_peered":"2024-09-10T06:28:48.462936+0000","last_clean":"2024-09-10T06:28:48.462936+0000","last_became_active":"2024-09-10T06:26:34.285248+0000","last_became_peered":"2024-09-10T06:26:34.285248+0000","last_unstale":"2024-09-10T06:28:48.462936+0000","last_undegraded":"2024-09-10T06:28:48.462936+0000","last_fullsized":"2024-09-10T06:28:48.462936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:43.907684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"76'32","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460159+0000","last_change":"2024-09-10T06:26:36.296684+0000","last_active":"2024-09-10T06:28:48.460159+0000","last_peered":"2024-09-10T06:28:48.460159+0000","last_clean":"2024-09-10T06:28:48.460159+0000","last_became_active":"2024-09-10T06:26:36.295901+0000","last_became_peered":"2024-09-10T06:26:36.295901+0000","last_unstale":"2024-09-10T06:28:48.460159+0000","last_undegraded":"2024-09-10T06:28:48.460159+0000","last_fullsized":"2024-09-10T06:28:48.460159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61969,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378965+0000","last_change":"2024-09-10T06:26:38.306412+0000","last_active":"2024-09-10T06:28:48.378965+0000","last_peered":"2024-09-10T06:28:48.378965+0000","last_clean":"2024-09-10T06:28:48.378965+0000","last_became_active":"2024-09-10T06:26:38.305496+0000","last_became_peered":"2024-09-10T06:26:38.305496+0000","last_unstale":"2024-09-10T06:28:48.378965+0000","last_undegraded":"2024-09-10T06:28:48.378965+0000","last_fullsized":"2024-09-10T06:28:48.378965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.370035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"64'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456581+0000","last_change":"2024-09-10T06:26:40.331981+0000","last_active":"2024-09-10T06:28:48.456581+0000","last_peered":"2024-09-10T06:28:48.456581+0000","last_clean":"2024-09-10T06:28:48.456581+0000","last_became_active":"2024-09-10T06:26:40.331294+0000","last_became_peered":"2024-09-10T06:26:40.331294+0000","last_unstale":"2024-09-10T06:28:48.456581+0000","last_undegraded":"2024-09-10T06:28:48.456581+0000","last_fullsized":"2024-09-10T06:28:48.456581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:00.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379255+0000","last_change":"2024-09-10T06:26:32.278733+0000","last_active":"2024-09-10T06:28:48.379255+0000","last_peered":"2024-09-10T06:28:48.379255+0000","last_clean":"2024-09-10T06:28:48.379255+0000","last_became_active":"2024-09-10T06:26:32.278118+0000","last_became_peered":"2024-09-10T06:26:32.278118+0000","last_unstale":"2024-09-10T06:28:48.379255+0000","last_undegraded":"2024-09-10T06:28:48.379255+0000","last_fullsized":"2024-09-10T06:28:48.379255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:58.860666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455540+0000","last_change":"2024-09-10T06:26:26.180664+0000","last_active":"2024-09-10T06:28:48.455540+0000","last_peered":"2024-09-10T06:28:48.455540+0000","last_clean":"2024-09-10T06:28:48.455540+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:28:48.455540+0000","last_undegraded":"2024-09-10T06:28:48.455540+0000","last_fullsized":"2024-09-10T06:28:48.455540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:28.793045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"73'11","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375865+0000","last_change":"2024-09-10T06:26:30.594315+0000","last_active":"2024-09-10T06:28:48.375865+0000","last_peered":"2024-09-10T06:28:48.375865+0000","last_clean":"2024-09-10T06:28:48.375865+0000","last_became_active":"2024-09-10T06:26:30.593978+0000","last_became_peered":"2024-09-10T06:26:30.593978+0000","last_unstale":"2024-09-10T06:28:48.375865+0000","last_undegraded":"2024-09-10T06:28:48.375865+0000","last_fullsized":"2024-09-10T06:28:48.375865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:41.851632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460472+0000","last_change":"2024-09-10T06:26:34.279889+0000","last_active":"2024-09-10T06:28:48.460472+0000","last_peered":"2024-09-10T06:28:48.460472+0000","last_clean":"2024-09-10T06:28:48.460472+0000","last_became_active":"2024-09-10T06:26:34.279147+0000","last_became_peered":"2024-09-10T06:26:34.279147+0000","last_unstale":"2024-09-10T06:28:48.460472+0000","last_undegraded":"2024-09-10T06:28:48.460472+0000","last_fullsized":"2024-09-10T06:28:48.460472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:02.260309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'108","reported_seq":327,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.463494+0000","last_change":"2024-09-10T06:26:36.290005+0000","last_active":"2024-09-10T06:28:49.463494+0000","last_peered":"2024-09-10T06:28:49.463494+0000","last_clean":"2024-09-10T06:28:49.463494+0000","last_became_active":"2024-09-10T06:26:36.289232+0000","last_became_peered":"2024-09-10T06:26:36.289232+0000","last_unstale":"2024-09-10T06:28:49.463494+0000","last_undegraded":"2024-09-10T06:28:49.463494+0000","last_fullsized":"2024-09-10T06:28:49.463494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:51.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":141,"num_read_kb":126,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463283+0000","last_change":"2024-09-10T06:26:38.302505+0000","last_active":"2024-09-10T06:28:48.463283+0000","last_peered":"2024-09-10T06:28:48.463283+0000","last_clean":"2024-09-10T06:28:48.463283+0000","last_became_active":"2024-09-10T06:26:38.301104+0000","last_became_peered":"2024-09-10T06:26:38.301104+0000","last_unstale":"2024-09-10T06:28:48.463283+0000","last_undegraded":"2024-09-10T06:28:48.463283+0000","last_fullsized":"2024-09-10T06:28:48.463283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.863622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"76'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453152+0000","last_change":"2024-09-10T06:26:40.320079+0000","last_active":"2024-09-10T06:28:48.453152+0000","last_peered":"2024-09-10T06:28:48.453152+0000","last_clean":"2024-09-10T06:28:48.453152+0000","last_became_active":"2024-09-10T06:26:40.319266+0000","last_became_peered":"2024-09-10T06:26:40.319266+0000","last_unstale":"2024-09-10T06:28:48.453152+0000","last_undegraded":"2024-09-10T06:28:48.453152+0000","last_fullsized":"2024-09-10T06:28:48.453152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:57.937745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"76'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454407+0000","last_change":"2024-09-10T06:26:32.282679+0000","last_active":"2024-09-10T06:28:48.454407+0000","last_peered":"2024-09-10T06:28:48.454407+0000","last_clean":"2024-09-10T06:28:48.454407+0000","last_became_active":"2024-09-10T06:26:32.282235+0000","last_became_peered":"2024-09-10T06:26:32.282235+0000","last_unstale":"2024-09-10T06:28:48.454407+0000","last_undegraded":"2024-09-10T06:28:48.454407+0000","last_fullsized":"2024-09-10T06:28:48.454407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:27.994318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454483+0000","last_change":"2024-09-10T06:26:25.979784+0000","last_active":"2024-09-10T06:28:48.454483+0000","last_peered":"2024-09-10T06:28:48.454483+0000","last_clean":"2024-09-10T06:28:48.454483+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:28:48.454483+0000","last_undegraded":"2024-09-10T06:28:48.454483+0000","last_fullsized":"2024-09-10T06:28:48.454483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:42.490682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"65'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453191+0000","last_change":"2024-09-10T06:26:30.570558+0000","last_active":"2024-09-10T06:28:48.453191+0000","last_peered":"2024-09-10T06:28:48.453191+0000","last_clean":"2024-09-10T06:28:48.453191+0000","last_became_active":"2024-09-10T06:26:30.570037+0000","last_became_peered":"2024-09-10T06:26:30.570037+0000","last_unstale":"2024-09-10T06:28:48.453191+0000","last_undegraded":"2024-09-10T06:28:48.453191+0000","last_fullsized":"2024-09-10T06:28:48.453191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:46.692143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455347+0000","last_change":"2024-09-10T06:26:34.284394+0000","last_active":"2024-09-10T06:28:48.455347+0000","last_peered":"2024-09-10T06:28:48.455347+0000","last_clean":"2024-09-10T06:28:48.455347+0000","last_became_active":"2024-09-10T06:26:34.283980+0000","last_became_peered":"2024-09-10T06:26:34.283980+0000","last_unstale":"2024-09-10T06:28:48.455347+0000","last_undegraded":"2024-09-10T06:28:48.455347+0000","last_fullsized":"2024-09-10T06:28:48.455347+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:38.061123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'19","reported_seq":241,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.467565+0000","last_change":"2024-09-10T06:28:47.073398+0000","last_active":"2024-09-10T06:28:49.467565+0000","last_peered":"2024-09-10T06:28:49.467565+0000","last_clean":"2024-09-10T06:28:49.467565+0000","last_became_active":"2024-09-10T06:28:46.327631+0000","last_became_peered":"2024-09-10T06:28:46.327631+0000","last_unstale":"2024-09-10T06:28:49.467565+0000","last_undegraded":"2024-09-10T06:28:49.467565+0000","last_fullsized":"2024-09-10T06:28:49.467565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:25.802510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375982+0000","last_change":"2024-09-10T06:26:38.292411+0000","last_active":"2024-09-10T06:28:48.375982+0000","last_peered":"2024-09-10T06:28:48.375982+0000","last_clean":"2024-09-10T06:28:48.375982+0000","last_became_active":"2024-09-10T06:26:38.291623+0000","last_became_peered":"2024-09-10T06:26:38.291623+0000","last_unstale":"2024-09-10T06:28:48.375982+0000","last_undegraded":"2024-09-10T06:28:48.375982+0000","last_fullsized":"2024-09-10T06:28:48.375982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377385+0000","last_change":"2024-09-10T06:26:40.303598+0000","last_active":"2024-09-10T06:28:48.377385+0000","last_peered":"2024-09-10T06:28:48.377385+0000","last_clean":"2024-09-10T06:28:48.377385+0000","last_became_active":"2024-09-10T06:26:40.302898+0000","last_became_peered":"2024-09-10T06:26:40.302898+0000","last_unstale":"2024-09-10T06:28:48.377385+0000","last_undegraded":"2024-09-10T06:28:48.377385+0000","last_fullsized":"2024-09-10T06:28:48.377385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:49.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"76'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453765+0000","last_change":"2024-09-10T06:26:32.273484+0000","last_active":"2024-09-10T06:28:48.453765+0000","last_peered":"2024-09-10T06:28:48.453765+0000","last_clean":"2024-09-10T06:28:48.453765+0000","last_became_active":"2024-09-10T06:26:32.273183+0000","last_became_peered":"2024-09-10T06:26:32.273183+0000","last_unstale":"2024-09-10T06:28:48.453765+0000","last_undegraded":"2024-09-10T06:28:48.453765+0000","last_fullsized":"2024-09-10T06:28:48.453765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:32.410538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459095+0000","last_change":"2024-09-10T06:26:25.534289+0000","last_active":"2024-09-10T06:28:48.459095+0000","last_peered":"2024-09-10T06:28:48.459095+0000","last_clean":"2024-09-10T06:28:48.459095+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:28:48.459095+0000","last_undegraded":"2024-09-10T06:28:48.459095+0000","last_fullsized":"2024-09-10T06:28:48.459095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:11.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379406+0000","last_change":"2024-09-10T06:26:30.579693+0000","last_active":"2024-09-10T06:28:48.379406+0000","last_peered":"2024-09-10T06:28:48.379406+0000","last_clean":"2024-09-10T06:28:48.379406+0000","last_became_active":"2024-09-10T06:26:30.577934+0000","last_became_peered":"2024-09-10T06:26:30.577934+0000","last_unstale":"2024-09-10T06:28:48.379406+0000","last_undegraded":"2024-09-10T06:28:48.379406+0000","last_fullsized":"2024-09-10T06:28:48.379406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:35.852655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377724+0000","last_change":"2024-09-10T06:26:34.275458+0000","last_active":"2024-09-10T06:28:48.377724+0000","last_peered":"2024-09-10T06:28:48.377724+0000","last_clean":"2024-09-10T06:28:48.377724+0000","last_became_active":"2024-09-10T06:26:34.274705+0000","last_became_peered":"2024-09-10T06:26:34.274705+0000","last_unstale":"2024-09-10T06:28:48.377724+0000","last_undegraded":"2024-09-10T06:28:48.377724+0000","last_fullsized":"2024-09-10T06:28:48.377724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:20.624872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379364+0000","last_change":"2024-09-10T06:26:36.266077+0000","last_active":"2024-09-10T06:28:48.379364+0000","last_peered":"2024-09-10T06:28:48.379364+0000","last_clean":"2024-09-10T06:28:48.379364+0000","last_became_active":"2024-09-10T06:26:36.265322+0000","last_became_peered":"2024-09-10T06:26:36.265322+0000","last_unstale":"2024-09-10T06:28:48.379364+0000","last_undegraded":"2024-09-10T06:28:48.379364+0000","last_fullsized":"2024-09-10T06:28:48.379364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459162+0000","last_change":"2024-09-10T06:28:46.345843+0000","last_active":"2024-09-10T06:28:48.459162+0000","last_peered":"2024-09-10T06:28:48.459162+0000","last_clean":"2024-09-10T06:28:48.459162+0000","last_became_active":"2024-09-10T06:28:46.344951+0000","last_became_peered":"2024-09-10T06:28:46.344951+0000","last_unstale":"2024-09-10T06:28:48.459162+0000","last_undegraded":"2024-09-10T06:28:48.459162+0000","last_fullsized":"2024-09-10T06:28:48.459162+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:17.825354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"76'8","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456074+0000","last_change":"2024-09-10T06:26:40.326887+0000","last_active":"2024-09-10T06:28:48.456074+0000","last_peered":"2024-09-10T06:28:48.456074+0000","last_clean":"2024-09-10T06:28:48.456074+0000","last_became_active":"2024-09-10T06:26:40.326130+0000","last_became_peered":"2024-09-10T06:26:40.326130+0000","last_unstale":"2024-09-10T06:28:48.456074+0000","last_undegraded":"2024-09-10T06:28:48.456074+0000","last_fullsized":"2024-09-10T06:28:48.456074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:28.237428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'8","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453524+0000","last_change":"2024-09-10T06:26:32.282586+0000","last_active":"2024-09-10T06:28:48.453524+0000","last_peered":"2024-09-10T06:28:48.453524+0000","last_clean":"2024-09-10T06:28:48.453524+0000","last_became_active":"2024-09-10T06:26:32.282086+0000","last_became_peered":"2024-09-10T06:26:32.282086+0000","last_unstale":"2024-09-10T06:28:48.453524+0000","last_undegraded":"2024-09-10T06:28:48.453524+0000","last_fullsized":"2024-09-10T06:28:48.453524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:44.269917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"73'16","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459611+0000","last_change":"2024-09-10T06:26:30.591913+0000","last_active":"2024-09-10T06:28:48.459611+0000","last_peered":"2024-09-10T06:28:48.459611+0000","last_clean":"2024-09-10T06:28:48.459611+0000","last_became_active":"2024-09-10T06:26:30.591140+0000","last_became_peered":"2024-09-10T06:26:30.591140+0000","last_unstale":"2024-09-10T06:28:48.459611+0000","last_undegraded":"2024-09-10T06:28:48.459611+0000","last_fullsized":"2024-09-10T06:28:48.459611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454261+0000","last_change":"2024-09-10T06:26:25.537497+0000","last_active":"2024-09-10T06:28:48.454261+0000","last_peered":"2024-09-10T06:28:48.454261+0000","last_clean":"2024-09-10T06:28:48.454261+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:28:48.454261+0000","last_undegraded":"2024-09-10T06:28:48.454261+0000","last_fullsized":"2024-09-10T06:28:48.454261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:44.787852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376269+0000","last_change":"2024-09-10T06:26:34.276099+0000","last_active":"2024-09-10T06:28:48.376269+0000","last_peered":"2024-09-10T06:28:48.376269+0000","last_clean":"2024-09-10T06:28:48.376269+0000","last_became_active":"2024-09-10T06:26:34.273984+0000","last_became_peered":"2024-09-10T06:26:34.273984+0000","last_unstale":"2024-09-10T06:28:48.376269+0000","last_undegraded":"2024-09-10T06:28:48.376269+0000","last_fullsized":"2024-09-10T06:28:48.376269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'31","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375444+0000","last_change":"2024-09-10T06:26:36.272589+0000","last_active":"2024-09-10T06:28:48.375444+0000","last_peered":"2024-09-10T06:28:48.375444+0000","last_clean":"2024-09-10T06:28:48.375444+0000","last_became_active":"2024-09-10T06:26:36.270914+0000","last_became_peered":"2024-09-10T06:26:36.270914+0000","last_unstale":"2024-09-10T06:28:48.375444+0000","last_undegraded":"2024-09-10T06:28:48.375444+0000","last_fullsized":"2024-09-10T06:28:48.375444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:20.764690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61858,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376397+0000","last_change":"2024-09-10T06:26:38.278069+0000","last_active":"2024-09-10T06:28:48.376397+0000","last_peered":"2024-09-10T06:28:48.376397+0000","last_clean":"2024-09-10T06:28:48.376397+0000","last_became_active":"2024-09-10T06:26:38.277261+0000","last_became_peered":"2024-09-10T06:26:38.277261+0000","last_unstale":"2024-09-10T06:28:48.376397+0000","last_undegraded":"2024-09-10T06:28:48.376397+0000","last_fullsized":"2024-09-10T06:28:48.376397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"67'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378048+0000","last_change":"2024-09-10T06:26:40.333741+0000","last_active":"2024-09-10T06:28:48.378048+0000","last_peered":"2024-09-10T06:28:48.378048+0000","last_clean":"2024-09-10T06:28:48.378048+0000","last_became_active":"2024-09-10T06:26:40.329701+0000","last_became_peered":"2024-09-10T06:26:40.329701+0000","last_unstale":"2024-09-10T06:28:48.378048+0000","last_undegraded":"2024-09-10T06:28:48.378048+0000","last_fullsized":"2024-09-10T06:28:48.378048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:53.704790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"67'4","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376410+0000","last_change":"2024-09-10T06:26:32.275551+0000","last_active":"2024-09-10T06:28:48.376410+0000","last_peered":"2024-09-10T06:28:48.376410+0000","last_clean":"2024-09-10T06:28:48.376410+0000","last_became_active":"2024-09-10T06:26:32.274946+0000","last_became_peered":"2024-09-10T06:26:32.274946+0000","last_unstale":"2024-09-10T06:28:48.376410+0000","last_undegraded":"2024-09-10T06:28:48.376410+0000","last_fullsized":"2024-09-10T06:28:48.376410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"73'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454016+0000","last_change":"2024-09-10T06:26:30.565595+0000","last_active":"2024-09-10T06:28:48.454016+0000","last_peered":"2024-09-10T06:28:48.454016+0000","last_clean":"2024-09-10T06:28:48.454016+0000","last_became_active":"2024-09-10T06:26:30.565220+0000","last_became_peered":"2024-09-10T06:26:30.565220+0000","last_unstale":"2024-09-10T06:28:48.454016+0000","last_undegraded":"2024-09-10T06:28:48.454016+0000","last_fullsized":"2024-09-10T06:28:48.454016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:14.600216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464321+0000","last_change":"2024-09-10T06:26:26.180820+0000","last_active":"2024-09-10T06:28:48.464321+0000","last_peered":"2024-09-10T06:28:48.464321+0000","last_clean":"2024-09-10T06:28:48.464321+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:28:48.464321+0000","last_undegraded":"2024-09-10T06:28:48.464321+0000","last_fullsized":"2024-09-10T06:28:48.464321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:51.928304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458371+0000","last_change":"2024-09-10T06:26:34.272915+0000","last_active":"2024-09-10T06:28:48.458371+0000","last_peered":"2024-09-10T06:28:48.458371+0000","last_clean":"2024-09-10T06:28:48.458371+0000","last_became_active":"2024-09-10T06:26:34.272192+0000","last_became_peered":"2024-09-10T06:26:34.272192+0000","last_unstale":"2024-09-10T06:28:48.458371+0000","last_undegraded":"2024-09-10T06:28:48.458371+0000","last_fullsized":"2024-09-10T06:28:48.458371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:07.874348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453060+0000","last_change":"2024-09-10T06:26:36.291431+0000","last_active":"2024-09-10T06:28:48.453060+0000","last_peered":"2024-09-10T06:28:48.453060+0000","last_clean":"2024-09-10T06:28:48.453060+0000","last_became_active":"2024-09-10T06:26:36.290570+0000","last_became_peered":"2024-09-10T06:26:36.290570+0000","last_unstale":"2024-09-10T06:28:48.453060+0000","last_undegraded":"2024-09-10T06:28:48.453060+0000","last_fullsized":"2024-09-10T06:28:48.453060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:10.565531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'102","reported_seq":283,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.464656+0000","last_change":"2024-09-10T06:26:38.312069+0000","last_active":"2024-09-10T06:28:49.464656+0000","last_peered":"2024-09-10T06:28:49.464656+0000","last_clean":"2024-09-10T06:28:49.464656+0000","last_became_active":"2024-09-10T06:26:38.310450+0000","last_became_peered":"2024-09-10T06:26:38.310450+0000","last_unstale":"2024-09-10T06:28:49.464656+0000","last_undegraded":"2024-09-10T06:28:49.464656+0000","last_fullsized":"2024-09-10T06:28:49.464656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379767+0000","last_change":"2024-09-10T06:26:40.312990+0000","last_active":"2024-09-10T06:28:48.379767+0000","last_peered":"2024-09-10T06:28:48.379767+0000","last_clean":"2024-09-10T06:28:48.379767+0000","last_became_active":"2024-09-10T06:26:40.312266+0000","last_became_peered":"2024-09-10T06:26:40.312266+0000","last_unstale":"2024-09-10T06:28:48.379767+0000","last_undegraded":"2024-09-10T06:28:48.379767+0000","last_fullsized":"2024-09-10T06:28:48.379767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:15.777105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"76'4","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375253+0000","last_change":"2024-09-10T06:26:32.258874+0000","last_active":"2024-09-10T06:28:48.375253+0000","last_peered":"2024-09-10T06:28:48.375253+0000","last_clean":"2024-09-10T06:28:48.375253+0000","last_became_active":"2024-09-10T06:26:32.258337+0000","last_became_peered":"2024-09-10T06:26:32.258337+0000","last_unstale":"2024-09-10T06:28:48.375253+0000","last_undegraded":"2024-09-10T06:28:48.375253+0000","last_fullsized":"2024-09-10T06:28:48.375253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"73'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379418+0000","last_change":"2024-09-10T06:26:30.581501+0000","last_active":"2024-09-10T06:28:48.379418+0000","last_peered":"2024-09-10T06:28:48.379418+0000","last_clean":"2024-09-10T06:28:48.379418+0000","last_became_active":"2024-09-10T06:26:30.581115+0000","last_became_peered":"2024-09-10T06:26:30.581115+0000","last_unstale":"2024-09-10T06:28:48.379418+0000","last_undegraded":"2024-09-10T06:28:48.379418+0000","last_fullsized":"2024-09-10T06:28:48.379418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454045+0000","last_change":"2024-09-10T06:26:25.537295+0000","last_active":"2024-09-10T06:28:48.454045+0000","last_peered":"2024-09-10T06:28:48.454045+0000","last_clean":"2024-09-10T06:28:48.454045+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:28:48.454045+0000","last_undegraded":"2024-09-10T06:28:48.454045+0000","last_fullsized":"2024-09-10T06:28:48.454045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:32.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377381+0000","last_change":"2024-09-10T06:26:34.258956+0000","last_active":"2024-09-10T06:28:48.377381+0000","last_peered":"2024-09-10T06:28:48.377381+0000","last_clean":"2024-09-10T06:28:48.377381+0000","last_became_active":"2024-09-10T06:26:34.257739+0000","last_became_peered":"2024-09-10T06:26:34.257739+0000","last_unstale":"2024-09-10T06:28:48.377381+0000","last_undegraded":"2024-09-10T06:28:48.377381+0000","last_fullsized":"2024-09-10T06:28:48.377381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:18.547827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'10","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377884+0000","last_change":"2024-09-10T06:26:36.271096+0000","last_active":"2024-09-10T06:28:48.377884+0000","last_peered":"2024-09-10T06:28:48.377884+0000","last_clean":"2024-09-10T06:28:48.377884+0000","last_became_active":"2024-09-10T06:26:36.270325+0000","last_became_peered":"2024-09-10T06:26:36.270325+0000","last_unstale":"2024-09-10T06:28:48.377884+0000","last_undegraded":"2024-09-10T06:28:48.377884+0000","last_fullsized":"2024-09-10T06:28:48.377884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'102","reported_seq":269,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.464971+0000","last_change":"2024-09-10T06:26:38.300795+0000","last_active":"2024-09-10T06:28:49.464971+0000","last_peered":"2024-09-10T06:28:49.464971+0000","last_clean":"2024-09-10T06:28:49.464971+0000","last_became_active":"2024-09-10T06:26:38.299466+0000","last_became_peered":"2024-09-10T06:26:38.299466+0000","last_unstale":"2024-09-10T06:28:49.464971+0000","last_undegraded":"2024-09-10T06:28:49.464971+0000","last_fullsized":"2024-09-10T06:28:49.464971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:38.641500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"67'4","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377214+0000","last_change":"2024-09-10T06:26:40.329688+0000","last_active":"2024-09-10T06:28:48.377214+0000","last_peered":"2024-09-10T06:28:48.377214+0000","last_clean":"2024-09-10T06:28:48.377214+0000","last_became_active":"2024-09-10T06:26:40.329009+0000","last_became_peered":"2024-09-10T06:26:40.329009+0000","last_unstale":"2024-09-10T06:28:48.377214+0000","last_undegraded":"2024-09-10T06:28:48.377214+0000","last_fullsized":"2024-09-10T06:28:48.377214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'8","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377758+0000","last_change":"2024-09-10T06:26:32.283524+0000","last_active":"2024-09-10T06:28:48.377758+0000","last_peered":"2024-09-10T06:28:48.377758+0000","last_clean":"2024-09-10T06:28:48.377758+0000","last_became_active":"2024-09-10T06:26:32.282794+0000","last_became_peered":"2024-09-10T06:26:32.282794+0000","last_unstale":"2024-09-10T06:28:48.377758+0000","last_undegraded":"2024-09-10T06:28:48.377758+0000","last_fullsized":"2024-09-10T06:28:48.377758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:11.537416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"73'6","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379512+0000","last_change":"2024-09-10T06:26:30.578273+0000","last_active":"2024-09-10T06:28:48.379512+0000","last_peered":"2024-09-10T06:28:48.379512+0000","last_clean":"2024-09-10T06:28:48.379512+0000","last_became_active":"2024-09-10T06:26:30.577985+0000","last_became_peered":"2024-09-10T06:26:30.577985+0000","last_unstale":"2024-09-10T06:28:48.379512+0000","last_undegraded":"2024-09-10T06:28:48.379512+0000","last_fullsized":"2024-09-10T06:28:48.379512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460109+0000","last_change":"2024-09-10T06:26:26.037773+0000","last_active":"2024-09-10T06:28:48.460109+0000","last_peered":"2024-09-10T06:28:48.460109+0000","last_clean":"2024-09-10T06:28:48.460109+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:28:48.460109+0000","last_undegraded":"2024-09-10T06:28:48.460109+0000","last_fullsized":"2024-09-10T06:28:48.460109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:21.949708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374863+0000","last_change":"2024-09-10T06:26:34.268710+0000","last_active":"2024-09-10T06:28:48.374863+0000","last_peered":"2024-09-10T06:28:48.374863+0000","last_clean":"2024-09-10T06:28:48.374863+0000","last_became_active":"2024-09-10T06:26:34.268359+0000","last_became_peered":"2024-09-10T06:26:34.268359+0000","last_unstale":"2024-09-10T06:28:48.374863+0000","last_undegraded":"2024-09-10T06:28:48.374863+0000","last_fullsized":"2024-09-10T06:28:48.374863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:27.191787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"76'37","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462144+0000","last_change":"2024-09-10T06:26:36.299700+0000","last_active":"2024-09-10T06:28:48.462144+0000","last_peered":"2024-09-10T06:28:48.462144+0000","last_clean":"2024-09-10T06:28:48.462144+0000","last_became_active":"2024-09-10T06:26:36.297606+0000","last_became_peered":"2024-09-10T06:26:36.297606+0000","last_unstale":"2024-09-10T06:28:48.462144+0000","last_undegraded":"2024-09-10T06:28:48.462144+0000","last_fullsized":"2024-09-10T06:28:48.462144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375382+0000","last_change":"2024-09-10T06:26:38.290601+0000","last_active":"2024-09-10T06:28:48.375382+0000","last_peered":"2024-09-10T06:28:48.375382+0000","last_clean":"2024-09-10T06:28:48.375382+0000","last_became_active":"2024-09-10T06:26:38.289589+0000","last_became_peered":"2024-09-10T06:26:38.289589+0000","last_unstale":"2024-09-10T06:28:48.375382+0000","last_undegraded":"2024-09-10T06:28:48.375382+0000","last_fullsized":"2024-09-10T06:28:48.375382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:22.625936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458656+0000","last_change":"2024-09-10T06:26:40.332819+0000","last_active":"2024-09-10T06:28:48.458656+0000","last_peered":"2024-09-10T06:28:48.458656+0000","last_clean":"2024-09-10T06:28:48.458656+0000","last_became_active":"2024-09-10T06:26:40.332160+0000","last_became_peered":"2024-09-10T06:26:40.332160+0000","last_unstale":"2024-09-10T06:28:48.458656+0000","last_undegraded":"2024-09-10T06:28:48.458656+0000","last_fullsized":"2024-09-10T06:28:48.458656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.784870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378032+0000","last_change":"2024-09-10T06:26:40.334393+0000","last_active":"2024-09-10T06:28:48.378032+0000","last_peered":"2024-09-10T06:28:48.378032+0000","last_clean":"2024-09-10T06:28:48.378032+0000","last_became_active":"2024-09-10T06:26:40.333474+0000","last_became_peered":"2024-09-10T06:26:40.333474+0000","last_unstale":"2024-09-10T06:28:48.378032+0000","last_undegraded":"2024-09-10T06:28:48.378032+0000","last_fullsized":"2024-09-10T06:28:48.378032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:35.031954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'6","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379197+0000","last_change":"2024-09-10T06:26:32.272914+0000","last_active":"2024-09-10T06:28:48.379197+0000","last_peered":"2024-09-10T06:28:48.379197+0000","last_clean":"2024-09-10T06:28:48.379197+0000","last_became_active":"2024-09-10T06:26:32.272178+0000","last_became_peered":"2024-09-10T06:26:32.272178+0000","last_unstale":"2024-09-10T06:28:48.379197+0000","last_undegraded":"2024-09-10T06:28:48.379197+0000","last_fullsized":"2024-09-10T06:28:48.379197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"72'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379651+0000","last_change":"2024-09-10T06:26:30.593531+0000","last_active":"2024-09-10T06:28:48.379651+0000","last_peered":"2024-09-10T06:28:48.379651+0000","last_clean":"2024-09-10T06:28:48.379651+0000","last_became_active":"2024-09-10T06:26:30.592753+0000","last_became_peered":"2024-09-10T06:26:30.592753+0000","last_unstale":"2024-09-10T06:28:48.379651+0000","last_undegraded":"2024-09-10T06:28:48.379651+0000","last_fullsized":"2024-09-10T06:28:48.379651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:14.506864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453697+0000","last_change":"2024-09-10T06:26:34.282877+0000","last_active":"2024-09-10T06:28:48.453697+0000","last_peered":"2024-09-10T06:28:48.453697+0000","last_clean":"2024-09-10T06:28:48.453697+0000","last_became_active":"2024-09-10T06:26:34.282281+0000","last_became_peered":"2024-09-10T06:26:34.282281+0000","last_unstale":"2024-09-10T06:28:48.453697+0000","last_undegraded":"2024-09-10T06:28:48.453697+0000","last_fullsized":"2024-09-10T06:28:48.453697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:41.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"76'17","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374658+0000","last_change":"2024-09-10T06:26:36.273166+0000","last_active":"2024-09-10T06:28:48.374658+0000","last_peered":"2024-09-10T06:28:48.374658+0000","last_clean":"2024-09-10T06:28:48.374658+0000","last_became_active":"2024-09-10T06:26:36.272386+0000","last_became_peered":"2024-09-10T06:26:36.272386+0000","last_unstale":"2024-09-10T06:28:48.374658+0000","last_undegraded":"2024-09-10T06:28:48.374658+0000","last_fullsized":"2024-09-10T06:28:48.374658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374570+0000","last_change":"2024-09-10T06:26:38.297347+0000","last_active":"2024-09-10T06:28:48.374570+0000","last_peered":"2024-09-10T06:28:48.374570+0000","last_clean":"2024-09-10T06:28:48.374570+0000","last_became_active":"2024-09-10T06:26:38.296600+0000","last_became_peered":"2024-09-10T06:26:38.296600+0000","last_unstale":"2024-09-10T06:28:48.374570+0000","last_undegraded":"2024-09-10T06:28:48.374570+0000","last_fullsized":"2024-09-10T06:28:48.374570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:08.758126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"67'20","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379025+0000","last_change":"2024-09-10T06:26:40.321844+0000","last_active":"2024-09-10T06:28:48.379025+0000","last_peered":"2024-09-10T06:28:48.379025+0000","last_clean":"2024-09-10T06:28:48.379025+0000","last_became_active":"2024-09-10T06:26:40.321097+0000","last_became_peered":"2024-09-10T06:26:40.321097+0000","last_unstale":"2024-09-10T06:28:48.379025+0000","last_undegraded":"2024-09-10T06:28:48.379025+0000","last_fullsized":"2024-09-10T06:28:48.379025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:10.004849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"67'6","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453454+0000","last_change":"2024-09-10T06:26:32.286989+0000","last_active":"2024-09-10T06:28:48.453454+0000","last_peered":"2024-09-10T06:28:48.453454+0000","last_clean":"2024-09-10T06:28:48.453454+0000","last_became_active":"2024-09-10T06:26:32.286519+0000","last_became_peered":"2024-09-10T06:26:32.286519+0000","last_unstale":"2024-09-10T06:28:48.453454+0000","last_undegraded":"2024-09-10T06:28:48.453454+0000","last_fullsized":"2024-09-10T06:28:48.453454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:31.592472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'6","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464000+0000","last_change":"2024-09-10T06:26:30.587315+0000","last_active":"2024-09-10T06:28:48.464000+0000","last_peered":"2024-09-10T06:28:48.464000+0000","last_clean":"2024-09-10T06:28:48.464000+0000","last_became_active":"2024-09-10T06:26:30.586611+0000","last_became_peered":"2024-09-10T06:26:30.586611+0000","last_unstale":"2024-09-10T06:28:48.464000+0000","last_undegraded":"2024-09-10T06:28:48.464000+0000","last_fullsized":"2024-09-10T06:28:48.464000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"27'1","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377148+0000","last_change":"2024-09-10T06:26:34.271770+0000","last_active":"2024-09-10T06:28:48.377148+0000","last_peered":"2024-09-10T06:28:48.377148+0000","last_clean":"2024-09-10T06:28:48.377148+0000","last_became_active":"2024-09-10T06:26:34.269875+0000","last_became_peered":"2024-09-10T06:26:34.269875+0000","last_unstale":"2024-09-10T06:28:48.377148+0000","last_undegraded":"2024-09-10T06:28:48.377148+0000","last_fullsized":"2024-09-10T06:28:48.377148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:09.570079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"67'6","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375286+0000","last_change":"2024-09-10T06:26:36.289140+0000","last_active":"2024-09-10T06:28:48.375286+0000","last_peered":"2024-09-10T06:28:48.375286+0000","last_clean":"2024-09-10T06:28:48.375286+0000","last_became_active":"2024-09-10T06:26:36.288355+0000","last_became_peered":"2024-09-10T06:26:36.288355+0000","last_unstale":"2024-09-10T06:28:48.375286+0000","last_undegraded":"2024-09-10T06:28:48.375286+0000","last_fullsized":"2024-09-10T06:28:48.375286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:42.518982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456930+0000","last_change":"2024-09-10T06:26:38.302040+0000","last_active":"2024-09-10T06:28:48.456930+0000","last_peered":"2024-09-10T06:28:48.456930+0000","last_clean":"2024-09-10T06:28:48.456930+0000","last_became_active":"2024-09-10T06:26:38.301064+0000","last_became_peered":"2024-09-10T06:26:38.301064+0000","last_unstale":"2024-09-10T06:28:48.456930+0000","last_undegraded":"2024-09-10T06:28:48.456930+0000","last_fullsized":"2024-09-10T06:28:48.456930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:41.513255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"64'4","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377597+0000","last_change":"2024-09-10T06:26:40.322368+0000","last_active":"2024-09-10T06:28:48.377597+0000","last_peered":"2024-09-10T06:28:48.377597+0000","last_clean":"2024-09-10T06:28:48.377597+0000","last_became_active":"2024-09-10T06:26:40.321592+0000","last_became_peered":"2024-09-10T06:26:40.321592+0000","last_unstale":"2024-09-10T06:28:48.377597+0000","last_undegraded":"2024-09-10T06:28:48.377597+0000","last_fullsized":"2024-09-10T06:28:48.377597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:03.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"61'4","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375592+0000","last_change":"2024-09-10T06:26:32.259666+0000","last_active":"2024-09-10T06:28:48.375592+0000","last_peered":"2024-09-10T06:28:48.375592+0000","last_clean":"2024-09-10T06:28:48.375592+0000","last_became_active":"2024-09-10T06:26:32.258775+0000","last_became_peered":"2024-09-10T06:26:32.258775+0000","last_unstale":"2024-09-10T06:28:48.375592+0000","last_undegraded":"2024-09-10T06:28:48.375592+0000","last_fullsized":"2024-09-10T06:28:48.375592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"72'13","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460597+0000","last_change":"2024-09-10T06:26:30.592773+0000","last_active":"2024-09-10T06:28:48.460597+0000","last_peered":"2024-09-10T06:28:48.460597+0000","last_clean":"2024-09-10T06:28:48.460597+0000","last_became_active":"2024-09-10T06:26:30.590566+0000","last_became_peered":"2024-09-10T06:26:30.590566+0000","last_unstale":"2024-09-10T06:28:48.460597+0000","last_undegraded":"2024-09-10T06:28:48.460597+0000","last_fullsized":"2024-09-10T06:28:48.460597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:35.688897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455138+0000","last_change":"2024-09-10T06:26:34.281690+0000","last_active":"2024-09-10T06:28:48.455138+0000","last_peered":"2024-09-10T06:28:48.455138+0000","last_clean":"2024-09-10T06:28:48.455138+0000","last_became_active":"2024-09-10T06:26:34.281008+0000","last_became_peered":"2024-09-10T06:26:34.281008+0000","last_unstale":"2024-09-10T06:28:48.455138+0000","last_undegraded":"2024-09-10T06:28:48.455138+0000","last_fullsized":"2024-09-10T06:28:48.455138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"76'17","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375413+0000","last_change":"2024-09-10T06:26:36.277028+0000","last_active":"2024-09-10T06:28:48.375413+0000","last_peered":"2024-09-10T06:28:48.375413+0000","last_clean":"2024-09-10T06:28:48.375413+0000","last_became_active":"2024-09-10T06:26:36.276248+0000","last_became_peered":"2024-09-10T06:26:36.276248+0000","last_unstale":"2024-09-10T06:28:48.375413+0000","last_undegraded":"2024-09-10T06:28:48.375413+0000","last_fullsized":"2024-09-10T06:28:48.375413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:53.521681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457566+0000","last_change":"2024-09-10T06:28:46.344566+0000","last_active":"2024-09-10T06:28:48.457566+0000","last_peered":"2024-09-10T06:28:48.457566+0000","last_clean":"2024-09-10T06:28:48.457566+0000","last_became_active":"2024-09-10T06:28:46.343657+0000","last_became_peered":"2024-09-10T06:28:46.343657+0000","last_unstale":"2024-09-10T06:28:48.457566+0000","last_undegraded":"2024-09-10T06:28:48.457566+0000","last_fullsized":"2024-09-10T06:28:48.457566+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:25.681176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460858+0000","last_change":"2024-09-10T06:26:40.331445+0000","last_active":"2024-09-10T06:28:48.460858+0000","last_peered":"2024-09-10T06:28:48.460858+0000","last_clean":"2024-09-10T06:28:48.460858+0000","last_became_active":"2024-09-10T06:26:40.330707+0000","last_became_peered":"2024-09-10T06:26:40.330707+0000","last_unstale":"2024-09-10T06:28:48.460858+0000","last_undegraded":"2024-09-10T06:28:48.460858+0000","last_fullsized":"2024-09-10T06:28:48.460858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.822687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375781+0000","last_change":"2024-09-10T06:26:32.266221+0000","last_active":"2024-09-10T06:28:48.375781+0000","last_peered":"2024-09-10T06:28:48.375781+0000","last_clean":"2024-09-10T06:28:48.375781+0000","last_became_active":"2024-09-10T06:26:32.265705+0000","last_became_peered":"2024-09-10T06:26:32.265705+0000","last_unstale":"2024-09-10T06:28:48.375781+0000","last_undegraded":"2024-09-10T06:28:48.375781+0000","last_fullsized":"2024-09-10T06:28:48.375781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"73'9","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378324+0000","last_change":"2024-09-10T06:26:30.594335+0000","last_active":"2024-09-10T06:28:48.378324+0000","last_peered":"2024-09-10T06:28:48.378324+0000","last_clean":"2024-09-10T06:28:48.378324+0000","last_became_active":"2024-09-10T06:26:30.593326+0000","last_became_peered":"2024-09-10T06:26:30.593326+0000","last_unstale":"2024-09-10T06:28:48.378324+0000","last_undegraded":"2024-09-10T06:28:48.378324+0000","last_fullsized":"2024-09-10T06:28:48.378324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:37.297722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457418+0000","last_change":"2024-09-10T06:26:34.281915+0000","last_active":"2024-09-10T06:28:48.457418+0000","last_peered":"2024-09-10T06:28:48.457418+0000","last_clean":"2024-09-10T06:28:48.457418+0000","last_became_active":"2024-09-10T06:26:34.281147+0000","last_became_peered":"2024-09-10T06:26:34.281147+0000","last_unstale":"2024-09-10T06:28:48.457418+0000","last_undegraded":"2024-09-10T06:28:48.457418+0000","last_fullsized":"2024-09-10T06:28:48.457418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:41.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"76'15","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458225+0000","last_change":"2024-09-10T06:26:36.298537+0000","last_active":"2024-09-10T06:28:48.458225+0000","last_peered":"2024-09-10T06:28:48.458225+0000","last_clean":"2024-09-10T06:28:48.458225+0000","last_became_active":"2024-09-10T06:26:36.297372+0000","last_became_peered":"2024-09-10T06:26:36.297372+0000","last_unstale":"2024-09-10T06:28:48.458225+0000","last_undegraded":"2024-09-10T06:28:48.458225+0000","last_fullsized":"2024-09-10T06:28:48.458225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376070+0000","last_change":"2024-09-10T06:26:38.301461+0000","last_active":"2024-09-10T06:28:48.376070+0000","last_peered":"2024-09-10T06:28:48.376070+0000","last_clean":"2024-09-10T06:28:48.376070+0000","last_became_active":"2024-09-10T06:26:38.300580+0000","last_became_peered":"2024-09-10T06:26:38.300580+0000","last_unstale":"2024-09-10T06:28:48.376070+0000","last_undegraded":"2024-09-10T06:28:48.376070+0000","last_fullsized":"2024-09-10T06:28:48.376070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"67'10","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459745+0000","last_change":"2024-09-10T06:26:32.285276+0000","last_active":"2024-09-10T06:28:48.459745+0000","last_peered":"2024-09-10T06:28:48.459745+0000","last_clean":"2024-09-10T06:28:48.459745+0000","last_became_active":"2024-09-10T06:26:32.284457+0000","last_became_peered":"2024-09-10T06:26:32.284457+0000","last_unstale":"2024-09-10T06:28:48.459745+0000","last_undegraded":"2024-09-10T06:28:48.459745+0000","last_fullsized":"2024-09-10T06:28:48.459745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:37.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"72'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376276+0000","last_change":"2024-09-10T06:26:30.573339+0000","last_active":"2024-09-10T06:28:48.376276+0000","last_peered":"2024-09-10T06:28:48.376276+0000","last_clean":"2024-09-10T06:28:48.376276+0000","last_became_active":"2024-09-10T06:26:30.571377+0000","last_became_peered":"2024-09-10T06:26:30.571377+0000","last_unstale":"2024-09-10T06:28:48.376276+0000","last_undegraded":"2024-09-10T06:28:48.376276+0000","last_fullsized":"2024-09-10T06:28:48.376276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:59.752497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378936+0000","last_change":"2024-09-10T06:26:34.269013+0000","last_active":"2024-09-10T06:28:48.378936+0000","last_peered":"2024-09-10T06:28:48.378936+0000","last_clean":"2024-09-10T06:28:48.378936+0000","last_became_active":"2024-09-10T06:26:34.268677+0000","last_became_peered":"2024-09-10T06:26:34.268677+0000","last_unstale":"2024-09-10T06:28:48.378936+0000","last_undegraded":"2024-09-10T06:28:48.378936+0000","last_fullsized":"2024-09-10T06:28:48.378936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"76'24","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453781+0000","last_change":"2024-09-10T06:26:36.300362+0000","last_active":"2024-09-10T06:28:48.453781+0000","last_peered":"2024-09-10T06:28:48.453781+0000","last_clean":"2024-09-10T06:28:48.453781+0000","last_became_active":"2024-09-10T06:26:36.299645+0000","last_became_peered":"2024-09-10T06:26:36.299645+0000","last_unstale":"2024-09-10T06:28:48.453781+0000","last_undegraded":"2024-09-10T06:28:48.453781+0000","last_fullsized":"2024-09-10T06:28:48.453781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:17.424354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461312+0000","last_change":"2024-09-10T06:26:38.299751+0000","last_active":"2024-09-10T06:28:48.461312+0000","last_peered":"2024-09-10T06:28:48.461312+0000","last_clean":"2024-09-10T06:28:48.461312+0000","last_became_active":"2024-09-10T06:26:38.298414+0000","last_became_peered":"2024-09-10T06:26:38.298414+0000","last_unstale":"2024-09-10T06:28:48.461312+0000","last_undegraded":"2024-09-10T06:28:48.461312+0000","last_fullsized":"2024-09-10T06:28:48.461312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'2","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375129+0000","last_change":"2024-09-10T06:26:40.312752+0000","last_active":"2024-09-10T06:28:48.375129+0000","last_peered":"2024-09-10T06:28:48.375129+0000","last_clean":"2024-09-10T06:28:48.375129+0000","last_became_active":"2024-09-10T06:26:40.312026+0000","last_became_peered":"2024-09-10T06:26:40.312026+0000","last_unstale":"2024-09-10T06:28:48.375129+0000","last_undegraded":"2024-09-10T06:28:48.375129+0000","last_fullsized":"2024-09-10T06:28:48.375129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:50.071224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379114+0000","last_change":"2024-09-10T06:26:32.266934+0000","last_active":"2024-09-10T06:28:48.379114+0000","last_peered":"2024-09-10T06:28:48.379114+0000","last_clean":"2024-09-10T06:28:48.379114+0000","last_became_active":"2024-09-10T06:26:32.266682+0000","last_became_peered":"2024-09-10T06:26:32.266682+0000","last_unstale":"2024-09-10T06:28:48.379114+0000","last_undegraded":"2024-09-10T06:28:48.379114+0000","last_fullsized":"2024-09-10T06:28:48.379114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"73'15","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453970+0000","last_change":"2024-09-10T06:26:30.579097+0000","last_active":"2024-09-10T06:28:48.453970+0000","last_peered":"2024-09-10T06:28:48.453970+0000","last_clean":"2024-09-10T06:28:48.453970+0000","last_became_active":"2024-09-10T06:26:30.578692+0000","last_became_peered":"2024-09-10T06:26:30.578692+0000","last_unstale":"2024-09-10T06:28:48.453970+0000","last_undegraded":"2024-09-10T06:28:48.453970+0000","last_fullsized":"2024-09-10T06:28:48.453970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:15.878123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":23,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"27'1","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459372+0000","last_change":"2024-09-10T06:26:34.282356+0000","last_active":"2024-09-10T06:28:48.459372+0000","last_peered":"2024-09-10T06:28:48.459372+0000","last_clean":"2024-09-10T06:28:48.459372+0000","last_became_active":"2024-09-10T06:26:34.281167+0000","last_became_peered":"2024-09-10T06:26:34.281167+0000","last_unstale":"2024-09-10T06:28:48.459372+0000","last_undegraded":"2024-09-10T06:28:48.459372+0000","last_fullsized":"2024-09-10T06:28:48.459372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:59.042394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"76'22","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462750+0000","last_change":"2024-09-10T06:26:36.301277+0000","last_active":"2024-09-10T06:28:48.462750+0000","last_peered":"2024-09-10T06:28:48.462750+0000","last_clean":"2024-09-10T06:28:48.462750+0000","last_became_active":"2024-09-10T06:26:36.300501+0000","last_became_peered":"2024-09-10T06:26:36.300501+0000","last_unstale":"2024-09-10T06:28:48.462750+0000","last_undegraded":"2024-09-10T06:28:48.462750+0000","last_fullsized":"2024-09-10T06:28:48.462750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:38.477946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454339+0000","last_change":"2024-09-10T06:26:38.305737+0000","last_active":"2024-09-10T06:28:48.454339+0000","last_peered":"2024-09-10T06:28:48.454339+0000","last_clean":"2024-09-10T06:28:48.454339+0000","last_became_active":"2024-09-10T06:26:38.303318+0000","last_became_peered":"2024-09-10T06:26:38.303318+0000","last_unstale":"2024-09-10T06:28:48.454339+0000","last_undegraded":"2024-09-10T06:28:48.454339+0000","last_fullsized":"2024-09-10T06:28:48.454339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:52.587622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"67'10","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458108+0000","last_change":"2024-09-10T06:26:40.318587+0000","last_active":"2024-09-10T06:28:48.458108+0000","last_peered":"2024-09-10T06:28:48.458108+0000","last_clean":"2024-09-10T06:28:48.458108+0000","last_became_active":"2024-09-10T06:26:40.317695+0000","last_became_peered":"2024-09-10T06:26:40.317695+0000","last_unstale":"2024-09-10T06:28:48.458108+0000","last_undegraded":"2024-09-10T06:28:48.458108+0000","last_fullsized":"2024-09-10T06:28:48.458108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:48.298686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379045+0000","last_change":"2024-09-10T06:26:32.276218+0000","last_active":"2024-09-10T06:28:48.379045+0000","last_peered":"2024-09-10T06:28:48.379045+0000","last_clean":"2024-09-10T06:28:48.379045+0000","last_became_active":"2024-09-10T06:26:32.275805+0000","last_became_peered":"2024-09-10T06:26:32.275805+0000","last_unstale":"2024-09-10T06:28:48.379045+0000","last_undegraded":"2024-09-10T06:28:48.379045+0000","last_fullsized":"2024-09-10T06:28:48.379045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"73'7","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378905+0000","last_change":"2024-09-10T06:26:30.568731+0000","last_active":"2024-09-10T06:28:48.378905+0000","last_peered":"2024-09-10T06:28:48.378905+0000","last_clean":"2024-09-10T06:28:48.378905+0000","last_became_active":"2024-09-10T06:26:30.567937+0000","last_became_peered":"2024-09-10T06:26:30.567937+0000","last_unstale":"2024-09-10T06:28:48.378905+0000","last_undegraded":"2024-09-10T06:28:48.378905+0000","last_fullsized":"2024-09-10T06:28:48.378905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:18.974865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380895+0000","last_change":"2024-09-10T06:26:34.266227+0000","last_active":"2024-09-10T06:28:48.380895+0000","last_peered":"2024-09-10T06:28:48.380895+0000","last_clean":"2024-09-10T06:28:48.380895+0000","last_became_active":"2024-09-10T06:26:34.262443+0000","last_became_peered":"2024-09-10T06:26:34.262443+0000","last_unstale":"2024-09-10T06:28:48.380895+0000","last_undegraded":"2024-09-10T06:28:48.380895+0000","last_fullsized":"2024-09-10T06:28:48.380895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.918813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"76'18","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379862+0000","last_change":"2024-09-10T06:26:36.292958+0000","last_active":"2024-09-10T06:28:48.379862+0000","last_peered":"2024-09-10T06:28:48.379862+0000","last_clean":"2024-09-10T06:28:48.379862+0000","last_became_active":"2024-09-10T06:26:36.292149+0000","last_became_peered":"2024-09-10T06:26:36.292149+0000","last_unstale":"2024-09-10T06:28:48.379862+0000","last_undegraded":"2024-09-10T06:28:48.379862+0000","last_fullsized":"2024-09-10T06:28:48.379862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453832+0000","last_change":"2024-09-10T06:26:38.302991+0000","last_active":"2024-09-10T06:28:48.453832+0000","last_peered":"2024-09-10T06:28:48.453832+0000","last_clean":"2024-09-10T06:28:48.453832+0000","last_became_active":"2024-09-10T06:26:38.289306+0000","last_became_peered":"2024-09-10T06:26:38.289306+0000","last_unstale":"2024-09-10T06:28:48.453832+0000","last_undegraded":"2024-09-10T06:28:48.453832+0000","last_fullsized":"2024-09-10T06:28:48.453832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:57.625329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456492+0000","last_change":"2024-09-10T06:26:40.327627+0000","last_active":"2024-09-10T06:28:48.456492+0000","last_peered":"2024-09-10T06:28:48.456492+0000","last_clean":"2024-09-10T06:28:48.456492+0000","last_became_active":"2024-09-10T06:26:40.326888+0000","last_became_peered":"2024-09-10T06:26:40.326888+0000","last_unstale":"2024-09-10T06:28:48.456492+0000","last_undegraded":"2024-09-10T06:28:48.456492+0000","last_fullsized":"2024-09-10T06:28:48.456492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:41.122562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455208+0000","last_change":"2024-09-10T06:26:32.275071+0000","last_active":"2024-09-10T06:28:48.455208+0000","last_peered":"2024-09-10T06:28:48.455208+0000","last_clean":"2024-09-10T06:28:48.455208+0000","last_became_active":"2024-09-10T06:26:32.274395+0000","last_became_peered":"2024-09-10T06:26:32.274395+0000","last_unstale":"2024-09-10T06:28:48.455208+0000","last_undegraded":"2024-09-10T06:28:48.455208+0000","last_fullsized":"2024-09-10T06:28:48.455208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:51.369493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376206+0000","last_change":"2024-09-10T06:26:30.594599+0000","last_active":"2024-09-10T06:28:48.376206+0000","last_peered":"2024-09-10T06:28:48.376206+0000","last_clean":"2024-09-10T06:28:48.376206+0000","last_became_active":"2024-09-10T06:26:30.594058+0000","last_became_peered":"2024-09-10T06:26:30.594058+0000","last_unstale":"2024-09-10T06:28:48.376206+0000","last_undegraded":"2024-09-10T06:28:48.376206+0000","last_fullsized":"2024-09-10T06:28:48.376206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:18.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454445+0000","last_change":"2024-09-10T06:26:34.279538+0000","last_active":"2024-09-10T06:28:48.454445+0000","last_peered":"2024-09-10T06:28:48.454445+0000","last_clean":"2024-09-10T06:28:48.454445+0000","last_became_active":"2024-09-10T06:26:34.278871+0000","last_became_peered":"2024-09-10T06:26:34.278871+0000","last_unstale":"2024-09-10T06:28:48.454445+0000","last_undegraded":"2024-09-10T06:28:48.454445+0000","last_fullsized":"2024-09-10T06:28:48.454445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:13.203357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"71'12","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379969+0000","last_change":"2024-09-10T06:26:36.290976+0000","last_active":"2024-09-10T06:28:48.379969+0000","last_peered":"2024-09-10T06:28:48.379969+0000","last_clean":"2024-09-10T06:28:48.379969+0000","last_became_active":"2024-09-10T06:26:36.290265+0000","last_became_peered":"2024-09-10T06:26:36.290265+0000","last_unstale":"2024-09-10T06:28:48.379969+0000","last_undegraded":"2024-09-10T06:28:48.379969+0000","last_fullsized":"2024-09-10T06:28:48.379969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'102","reported_seq":271,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.464716+0000","last_change":"2024-09-10T06:26:38.292031+0000","last_active":"2024-09-10T06:28:49.464716+0000","last_peered":"2024-09-10T06:28:49.464716+0000","last_clean":"2024-09-10T06:28:49.464716+0000","last_became_active":"2024-09-10T06:26:38.288791+0000","last_became_peered":"2024-09-10T06:26:38.288791+0000","last_unstale":"2024-09-10T06:28:49.464716+0000","last_undegraded":"2024-09-10T06:28:49.464716+0000","last_fullsized":"2024-09-10T06:28:49.464716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:07.830355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"76'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455098+0000","last_change":"2024-09-10T06:26:40.336448+0000","last_active":"2024-09-10T06:28:48.455098+0000","last_peered":"2024-09-10T06:28:48.455098+0000","last_clean":"2024-09-10T06:28:48.455098+0000","last_became_active":"2024-09-10T06:26:40.335771+0000","last_became_peered":"2024-09-10T06:26:40.335771+0000","last_unstale":"2024-09-10T06:28:48.455098+0000","last_undegraded":"2024-09-10T06:28:48.455098+0000","last_fullsized":"2024-09-10T06:28:48.455098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378950+0000","last_change":"2024-09-10T06:26:32.262176+0000","last_active":"2024-09-10T06:28:48.378950+0000","last_peered":"2024-09-10T06:28:48.378950+0000","last_clean":"2024-09-10T06:28:48.378950+0000","last_became_active":"2024-09-10T06:26:32.261250+0000","last_became_peered":"2024-09-10T06:26:32.261250+0000","last_unstale":"2024-09-10T06:28:48.378950+0000","last_undegraded":"2024-09-10T06:28:48.378950+0000","last_fullsized":"2024-09-10T06:28:48.378950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"73'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461942+0000","last_change":"2024-09-10T06:26:30.604587+0000","last_active":"2024-09-10T06:28:48.461942+0000","last_peered":"2024-09-10T06:28:48.461942+0000","last_clean":"2024-09-10T06:28:48.461942+0000","last_became_active":"2024-09-10T06:26:30.603175+0000","last_became_peered":"2024-09-10T06:26:30.603175+0000","last_unstale":"2024-09-10T06:28:48.461942+0000","last_undegraded":"2024-09-10T06:28:48.461942+0000","last_fullsized":"2024-09-10T06:28:48.461942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458290+0000","last_change":"2024-09-10T06:26:34.286028+0000","last_active":"2024-09-10T06:28:48.458290+0000","last_peered":"2024-09-10T06:28:48.458290+0000","last_clean":"2024-09-10T06:28:48.458290+0000","last_became_active":"2024-09-10T06:26:34.285169+0000","last_became_peered":"2024-09-10T06:26:34.285169+0000","last_unstale":"2024-09-10T06:28:48.458290+0000","last_undegraded":"2024-09-10T06:28:48.458290+0000","last_fullsized":"2024-09-10T06:28:48.458290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:24.146088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"76'21","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456901+0000","last_change":"2024-09-10T06:26:36.292679+0000","last_active":"2024-09-10T06:28:48.456901+0000","last_peered":"2024-09-10T06:28:48.456901+0000","last_clean":"2024-09-10T06:28:48.456901+0000","last_became_active":"2024-09-10T06:26:36.288780+0000","last_became_peered":"2024-09-10T06:26:36.288780+0000","last_unstale":"2024-09-10T06:28:48.456901+0000","last_undegraded":"2024-09-10T06:28:48.456901+0000","last_fullsized":"2024-09-10T06:28:48.456901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374709+0000","last_change":"2024-09-10T06:26:38.293015+0000","last_active":"2024-09-10T06:28:48.374709+0000","last_peered":"2024-09-10T06:28:48.374709+0000","last_clean":"2024-09-10T06:28:48.374709+0000","last_became_active":"2024-09-10T06:26:38.292185+0000","last_became_peered":"2024-09-10T06:26:38.292185+0000","last_unstale":"2024-09-10T06:28:48.374709+0000","last_undegraded":"2024-09-10T06:28:48.374709+0000","last_fullsized":"2024-09-10T06:28:48.374709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:32.694777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"64'10","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464937+0000","last_change":"2024-09-10T06:26:40.336074+0000","last_active":"2024-09-10T06:28:48.464937+0000","last_peered":"2024-09-10T06:28:48.464937+0000","last_clean":"2024-09-10T06:28:48.464937+0000","last_became_active":"2024-09-10T06:26:40.335339+0000","last_became_peered":"2024-09-10T06:26:40.335339+0000","last_unstale":"2024-09-10T06:28:48.464937+0000","last_undegraded":"2024-09-10T06:28:48.464937+0000","last_fullsized":"2024-09-10T06:28:48.464937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378245+0000","last_change":"2024-09-10T06:26:32.262823+0000","last_active":"2024-09-10T06:28:48.378245+0000","last_peered":"2024-09-10T06:28:48.378245+0000","last_clean":"2024-09-10T06:28:48.378245+0000","last_became_active":"2024-09-10T06:26:32.262041+0000","last_became_peered":"2024-09-10T06:26:32.262041+0000","last_unstale":"2024-09-10T06:28:48.378245+0000","last_undegraded":"2024-09-10T06:28:48.378245+0000","last_fullsized":"2024-09-10T06:28:48.378245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:48.768083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"73'7","reported_seq":123,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455114+0000","last_change":"2024-09-10T06:27:08.868703+0000","last_active":"2024-09-10T06:28:48.455114+0000","last_peered":"2024-09-10T06:28:48.455114+0000","last_clean":"2024-09-10T06:28:48.455114+0000","last_became_active":"2024-09-10T06:27:08.868399+0000","last_became_peered":"2024-09-10T06:27:08.868399+0000","last_unstale":"2024-09-10T06:28:48.455114+0000","last_undegraded":"2024-09-10T06:28:48.455114+0000","last_fullsized":"2024-09-10T06:28:48.455114+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:20.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459883+0000","last_change":"2024-09-10T06:26:34.282651+0000","last_active":"2024-09-10T06:28:48.459883+0000","last_peered":"2024-09-10T06:28:48.459883+0000","last_clean":"2024-09-10T06:28:48.459883+0000","last_became_active":"2024-09-10T06:26:34.281777+0000","last_became_peered":"2024-09-10T06:26:34.281777+0000","last_unstale":"2024-09-10T06:28:48.459883+0000","last_undegraded":"2024-09-10T06:28:48.459883+0000","last_fullsized":"2024-09-10T06:28:48.459883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:42.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"76'15","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374940+0000","last_change":"2024-09-10T06:26:36.285192+0000","last_active":"2024-09-10T06:28:48.374940+0000","last_peered":"2024-09-10T06:28:48.374940+0000","last_clean":"2024-09-10T06:28:48.374940+0000","last_became_active":"2024-09-10T06:26:36.284470+0000","last_became_peered":"2024-09-10T06:26:36.284470+0000","last_unstale":"2024-09-10T06:28:48.374940+0000","last_undegraded":"2024-09-10T06:28:48.374940+0000","last_fullsized":"2024-09-10T06:28:48.374940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:44.280458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456932+0000","last_change":"2024-09-10T06:26:38.303425+0000","last_active":"2024-09-10T06:28:48.456932+0000","last_peered":"2024-09-10T06:28:48.456932+0000","last_clean":"2024-09-10T06:28:48.456932+0000","last_became_active":"2024-09-10T06:26:38.302606+0000","last_became_peered":"2024-09-10T06:26:38.302606+0000","last_unstale":"2024-09-10T06:28:48.456932+0000","last_undegraded":"2024-09-10T06:28:48.456932+0000","last_fullsized":"2024-09-10T06:28:48.456932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:14.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"76'13","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379260+0000","last_change":"2024-09-10T06:26:40.311253+0000","last_active":"2024-09-10T06:28:48.379260+0000","last_peered":"2024-09-10T06:28:48.379260+0000","last_clean":"2024-09-10T06:28:48.379260+0000","last_became_active":"2024-09-10T06:26:40.310414+0000","last_became_peered":"2024-09-10T06:26:40.310414+0000","last_unstale":"2024-09-10T06:28:48.379260+0000","last_undegraded":"2024-09-10T06:28:48.379260+0000","last_fullsized":"2024-09-10T06:28:48.379260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:20.868195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375984+0000","last_change":"2024-09-10T06:26:32.262972+0000","last_active":"2024-09-10T06:28:48.375984+0000","last_peered":"2024-09-10T06:28:48.375984+0000","last_clean":"2024-09-10T06:28:48.375984+0000","last_became_active":"2024-09-10T06:26:32.262469+0000","last_became_peered":"2024-09-10T06:26:32.262469+0000","last_unstale":"2024-09-10T06:28:48.375984+0000","last_undegraded":"2024-09-10T06:28:48.375984+0000","last_fullsized":"2024-09-10T06:28:48.375984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"72'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379565+0000","last_change":"2024-09-10T06:26:30.602013+0000","last_active":"2024-09-10T06:28:48.379565+0000","last_peered":"2024-09-10T06:28:48.379565+0000","last_clean":"2024-09-10T06:28:48.379565+0000","last_became_active":"2024-09-10T06:26:30.601672+0000","last_became_peered":"2024-09-10T06:26:30.601672+0000","last_unstale":"2024-09-10T06:28:48.379565+0000","last_undegraded":"2024-09-10T06:28:48.379565+0000","last_fullsized":"2024-09-10T06:28:48.379565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:52.012063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376590+0000","last_change":"2024-09-10T06:26:34.277010+0000","last_active":"2024-09-10T06:28:48.376590+0000","last_peered":"2024-09-10T06:28:48.376590+0000","last_clean":"2024-09-10T06:28:48.376590+0000","last_became_active":"2024-09-10T06:26:34.276197+0000","last_became_peered":"2024-09-10T06:26:34.276197+0000","last_unstale":"2024-09-10T06:28:48.376590+0000","last_undegraded":"2024-09-10T06:28:48.376590+0000","last_fullsized":"2024-09-10T06:28:48.376590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:32.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"76'11","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378378+0000","last_change":"2024-09-10T06:26:36.297514+0000","last_active":"2024-09-10T06:28:48.378378+0000","last_peered":"2024-09-10T06:28:48.378378+0000","last_clean":"2024-09-10T06:28:48.378378+0000","last_became_active":"2024-09-10T06:26:36.296615+0000","last_became_peered":"2024-09-10T06:26:36.296615+0000","last_unstale":"2024-09-10T06:28:48.378378+0000","last_undegraded":"2024-09-10T06:28:48.378378+0000","last_fullsized":"2024-09-10T06:28:48.378378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376631+0000","last_change":"2024-09-10T06:26:38.288794+0000","last_active":"2024-09-10T06:28:48.376631+0000","last_peered":"2024-09-10T06:28:48.376631+0000","last_clean":"2024-09-10T06:28:48.376631+0000","last_became_active":"2024-09-10T06:26:38.288055+0000","last_became_peered":"2024-09-10T06:26:38.288055+0000","last_unstale":"2024-09-10T06:28:48.376631+0000","last_undegraded":"2024-09-10T06:28:48.376631+0000","last_fullsized":"2024-09-10T06:28:48.376631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463598+0000","last_change":"2024-09-10T06:26:40.318067+0000","last_active":"2024-09-10T06:28:48.463598+0000","last_peered":"2024-09-10T06:28:48.463598+0000","last_clean":"2024-09-10T06:28:48.463598+0000","last_became_active":"2024-09-10T06:26:40.317244+0000","last_became_peered":"2024-09-10T06:26:40.317244+0000","last_unstale":"2024-09-10T06:28:48.463598+0000","last_undegraded":"2024-09-10T06:28:48.463598+0000","last_fullsized":"2024-09-10T06:28:48.463598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"76'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377374+0000","last_change":"2024-09-10T06:26:32.277908+0000","last_active":"2024-09-10T06:28:48.377374+0000","last_peered":"2024-09-10T06:28:48.377374+0000","last_clean":"2024-09-10T06:28:48.377374+0000","last_became_active":"2024-09-10T06:26:32.274812+0000","last_became_peered":"2024-09-10T06:26:32.274812+0000","last_unstale":"2024-09-10T06:28:48.377374+0000","last_undegraded":"2024-09-10T06:28:48.377374+0000","last_fullsized":"2024-09-10T06:28:48.377374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:37.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"73'10","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378238+0000","last_change":"2024-09-10T06:26:30.594013+0000","last_active":"2024-09-10T06:28:48.378238+0000","last_peered":"2024-09-10T06:28:48.378238+0000","last_clean":"2024-09-10T06:28:48.378238+0000","last_became_active":"2024-09-10T06:26:30.593687+0000","last_became_peered":"2024-09-10T06:26:30.593687+0000","last_unstale":"2024-09-10T06:28:48.378238+0000","last_undegraded":"2024-09-10T06:28:48.378238+0000","last_fullsized":"2024-09-10T06:28:48.378238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:37.375037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453258+0000","last_change":"2024-09-10T06:26:34.283392+0000","last_active":"2024-09-10T06:28:48.453258+0000","last_peered":"2024-09-10T06:28:48.453258+0000","last_clean":"2024-09-10T06:28:48.453258+0000","last_became_active":"2024-09-10T06:26:34.282931+0000","last_became_peered":"2024-09-10T06:26:34.282931+0000","last_unstale":"2024-09-10T06:28:48.453258+0000","last_undegraded":"2024-09-10T06:28:48.453258+0000","last_fullsized":"2024-09-10T06:28:48.453258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:01.310719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"76'15","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377000+0000","last_change":"2024-09-10T06:26:36.289834+0000","last_active":"2024-09-10T06:28:48.377000+0000","last_peered":"2024-09-10T06:28:48.377000+0000","last_clean":"2024-09-10T06:28:48.377000+0000","last_became_active":"2024-09-10T06:26:36.289033+0000","last_became_peered":"2024-09-10T06:26:36.289033+0000","last_unstale":"2024-09-10T06:28:48.377000+0000","last_undegraded":"2024-09-10T06:28:48.377000+0000","last_fullsized":"2024-09-10T06:28:48.377000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375982+0000","last_change":"2024-09-10T06:26:38.299568+0000","last_active":"2024-09-10T06:28:48.375982+0000","last_peered":"2024-09-10T06:28:48.375982+0000","last_clean":"2024-09-10T06:28:48.375982+0000","last_became_active":"2024-09-10T06:26:38.298779+0000","last_became_peered":"2024-09-10T06:26:38.298779+0000","last_unstale":"2024-09-10T06:28:48.375982+0000","last_undegraded":"2024-09-10T06:28:48.375982+0000","last_fullsized":"2024-09-10T06:28:48.375982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.381022+0000","last_change":"2024-09-10T06:26:40.336329+0000","last_active":"2024-09-10T06:28:48.381022+0000","last_peered":"2024-09-10T06:28:48.381022+0000","last_clean":"2024-09-10T06:28:48.381022+0000","last_became_active":"2024-09-10T06:26:40.335348+0000","last_became_peered":"2024-09-10T06:26:40.335348+0000","last_unstale":"2024-09-10T06:28:48.381022+0000","last_undegraded":"2024-09-10T06:28:48.381022+0000","last_fullsized":"2024-09-10T06:28:48.381022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:40.653642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"62'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454263+0000","last_change":"2024-09-10T06:26:32.276392+0000","last_active":"2024-09-10T06:28:48.454263+0000","last_peered":"2024-09-10T06:28:48.454263+0000","last_clean":"2024-09-10T06:28:48.454263+0000","last_became_active":"2024-09-10T06:26:32.275855+0000","last_became_peered":"2024-09-10T06:26:32.275855+0000","last_unstale":"2024-09-10T06:28:48.454263+0000","last_undegraded":"2024-09-10T06:28:48.454263+0000","last_fullsized":"2024-09-10T06:28:48.454263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:34.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"73'11","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456654+0000","last_change":"2024-09-10T06:26:30.591577+0000","last_active":"2024-09-10T06:28:48.456654+0000","last_peered":"2024-09-10T06:28:48.456654+0000","last_clean":"2024-09-10T06:28:48.456654+0000","last_became_active":"2024-09-10T06:26:30.590801+0000","last_became_peered":"2024-09-10T06:26:30.590801+0000","last_unstale":"2024-09-10T06:28:48.456654+0000","last_undegraded":"2024-09-10T06:28:48.456654+0000","last_fullsized":"2024-09-10T06:28:48.456654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:16.066664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453895+0000","last_change":"2024-09-10T06:26:32.268621+0000","last_active":"2024-09-10T06:28:48.453895+0000","last_peered":"2024-09-10T06:28:48.453895+0000","last_clean":"2024-09-10T06:28:48.453895+0000","last_became_active":"2024-09-10T06:26:32.267915+0000","last_became_peered":"2024-09-10T06:26:32.267915+0000","last_unstale":"2024-09-10T06:28:48.453895+0000","last_undegraded":"2024-09-10T06:28:48.453895+0000","last_fullsized":"2024-09-10T06:28:48.453895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:10.670492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"73'10","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452875+0000","last_change":"2024-09-10T06:26:30.593794+0000","last_active":"2024-09-10T06:28:48.452875+0000","last_peered":"2024-09-10T06:28:48.452875+0000","last_clean":"2024-09-10T06:28:48.452875+0000","last_became_active":"2024-09-10T06:26:30.593506+0000","last_became_peered":"2024-09-10T06:26:30.593506+0000","last_unstale":"2024-09-10T06:28:48.452875+0000","last_undegraded":"2024-09-10T06:28:48.452875+0000","last_fullsized":"2024-09-10T06:28:48.452875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:29.521578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'6","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459260+0000","last_change":"2024-09-10T06:26:32.288497+0000","last_active":"2024-09-10T06:28:48.459260+0000","last_peered":"2024-09-10T06:28:48.459260+0000","last_clean":"2024-09-10T06:28:48.459260+0000","last_became_active":"2024-09-10T06:26:32.287839+0000","last_became_peered":"2024-09-10T06:26:32.287839+0000","last_unstale":"2024-09-10T06:28:48.459260+0000","last_undegraded":"2024-09-10T06:28:48.459260+0000","last_fullsized":"2024-09-10T06:28:48.459260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"72'5","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454219+0000","last_change":"2024-09-10T06:28:09.627267+0000","last_active":"2024-09-10T06:28:48.454219+0000","last_peered":"2024-09-10T06:28:48.454219+0000","last_clean":"2024-09-10T06:28:48.454219+0000","last_became_active":"2024-09-10T06:28:09.544344+0000","last_became_peered":"2024-09-10T06:28:09.544344+0000","last_unstale":"2024-09-10T06:28:48.454219+0000","last_undegraded":"2024-09-10T06:28:48.454219+0000","last_fullsized":"2024-09-10T06:28:48.454219+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:57.591444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"62'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454143+0000","last_change":"2024-09-10T06:26:32.272921+0000","last_active":"2024-09-10T06:28:48.454143+0000","last_peered":"2024-09-10T06:28:48.454143+0000","last_clean":"2024-09-10T06:28:48.454143+0000","last_became_active":"2024-09-10T06:26:32.272279+0000","last_became_peered":"2024-09-10T06:26:32.272279+0000","last_unstale":"2024-09-10T06:28:48.454143+0000","last_undegraded":"2024-09-10T06:28:48.454143+0000","last_fullsized":"2024-09-10T06:28:48.454143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:11.951551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"73'12","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376254+0000","last_change":"2024-09-10T06:26:30.579541+0000","last_active":"2024-09-10T06:28:48.376254+0000","last_peered":"2024-09-10T06:28:48.376254+0000","last_clean":"2024-09-10T06:28:48.376254+0000","last_became_active":"2024-09-10T06:26:30.579189+0000","last_became_peered":"2024-09-10T06:26:30.579189+0000","last_unstale":"2024-09-10T06:28:48.376254+0000","last_undegraded":"2024-09-10T06:28:48.376254+0000","last_fullsized":"2024-09-10T06:28:48.376254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:18.099885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377659+0000","last_change":"2024-09-10T06:26:32.260098+0000","last_active":"2024-09-10T06:28:48.377659+0000","last_peered":"2024-09-10T06:28:48.377659+0000","last_clean":"2024-09-10T06:28:48.377659+0000","last_became_active":"2024-09-10T06:26:32.259644+0000","last_became_peered":"2024-09-10T06:26:32.259644+0000","last_unstale":"2024-09-10T06:28:48.377659+0000","last_undegraded":"2024-09-10T06:28:48.377659+0000","last_fullsized":"2024-09-10T06:28:48.377659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"72'11","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378625+0000","last_change":"2024-09-10T06:26:30.576146+0000","last_active":"2024-09-10T06:28:48.378625+0000","last_peered":"2024-09-10T06:28:48.378625+0000","last_clean":"2024-09-10T06:28:48.378625+0000","last_became_active":"2024-09-10T06:26:30.575605+0000","last_became_peered":"2024-09-10T06:26:30.575605+0000","last_unstale":"2024-09-10T06:28:48.378625+0000","last_undegraded":"2024-09-10T06:28:48.378625+0000","last_fullsized":"2024-09-10T06:28:48.378625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"76'10","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378536+0000","last_change":"2024-09-10T06:26:32.277577+0000","last_active":"2024-09-10T06:28:48.378536+0000","last_peered":"2024-09-10T06:28:48.378536+0000","last_clean":"2024-09-10T06:28:48.378536+0000","last_became_active":"2024-09-10T06:26:32.272454+0000","last_became_peered":"2024-09-10T06:26:32.272454+0000","last_unstale":"2024-09-10T06:28:48.378536+0000","last_undegraded":"2024-09-10T06:28:48.378536+0000","last_fullsized":"2024-09-10T06:28:48.378536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"73'6","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454604+0000","last_change":"2024-09-10T06:26:30.579134+0000","last_active":"2024-09-10T06:28:48.454604+0000","last_peered":"2024-09-10T06:28:48.454604+0000","last_clean":"2024-09-10T06:28:48.454604+0000","last_became_active":"2024-09-10T06:26:30.578732+0000","last_became_peered":"2024-09-10T06:26:30.578732+0000","last_unstale":"2024-09-10T06:28:48.454604+0000","last_undegraded":"2024-09-10T06:28:48.454604+0000","last_fullsized":"2024-09-10T06:28:48.454604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:08.832907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375228+0000","last_change":"2024-09-10T06:26:32.270804+0000","last_active":"2024-09-10T06:28:48.375228+0000","last_peered":"2024-09-10T06:28:48.375228+0000","last_clean":"2024-09-10T06:28:48.375228+0000","last_became_active":"2024-09-10T06:26:32.270327+0000","last_became_peered":"2024-09-10T06:26:32.270327+0000","last_unstale":"2024-09-10T06:28:48.375228+0000","last_undegraded":"2024-09-10T06:28:48.375228+0000","last_fullsized":"2024-09-10T06:28:48.375228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"72'6","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459860+0000","last_change":"2024-09-10T06:26:30.598004+0000","last_active":"2024-09-10T06:28:48.459860+0000","last_peered":"2024-09-10T06:28:48.459860+0000","last_clean":"2024-09-10T06:28:48.459860+0000","last_became_active":"2024-09-10T06:26:30.596254+0000","last_became_peered":"2024-09-10T06:26:30.596254+0000","last_unstale":"2024-09-10T06:28:48.459860+0000","last_undegraded":"2024-09-10T06:28:48.459860+0000","last_fullsized":"2024-09-10T06:28:48.459860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'2","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456398+0000","last_change":"2024-09-10T06:26:32.284215+0000","last_active":"2024-09-10T06:28:48.456398+0000","last_peered":"2024-09-10T06:28:48.456398+0000","last_clean":"2024-09-10T06:28:48.456398+0000","last_became_active":"2024-09-10T06:26:32.275133+0000","last_became_peered":"2024-09-10T06:26:32.275133+0000","last_unstale":"2024-09-10T06:28:48.456398+0000","last_undegraded":"2024-09-10T06:28:48.456398+0000","last_fullsized":"2024-09-10T06:28:48.456398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:37.703268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"73'9","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379658+0000","last_change":"2024-09-10T06:26:30.580586+0000","last_active":"2024-09-10T06:28:48.379658+0000","last_peered":"2024-09-10T06:28:48.379658+0000","last_clean":"2024-09-10T06:28:48.379658+0000","last_became_active":"2024-09-10T06:26:30.580134+0000","last_became_peered":"2024-09-10T06:26:30.580134+0000","last_unstale":"2024-09-10T06:28:48.379658+0000","last_undegraded":"2024-09-10T06:28:48.379658+0000","last_fullsized":"2024-09-10T06:28:48.379658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378230+0000","last_change":"2024-09-10T06:26:32.256538+0000","last_active":"2024-09-10T06:28:48.378230+0000","last_peered":"2024-09-10T06:28:48.378230+0000","last_clean":"2024-09-10T06:28:48.378230+0000","last_became_active":"2024-09-10T06:26:32.256052+0000","last_became_peered":"2024-09-10T06:26:32.256052+0000","last_unstale":"2024-09-10T06:28:48.378230+0000","last_undegraded":"2024-09-10T06:28:48.378230+0000","last_fullsized":"2024-09-10T06:28:48.378230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:14.620472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"73'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457141+0000","last_change":"2024-09-10T06:26:30.585220+0000","last_active":"2024-09-10T06:28:48.457141+0000","last_peered":"2024-09-10T06:28:48.457141+0000","last_clean":"2024-09-10T06:28:48.457141+0000","last_became_active":"2024-09-10T06:26:30.584443+0000","last_became_peered":"2024-09-10T06:26:30.584443+0000","last_unstale":"2024-09-10T06:28:48.457141+0000","last_undegraded":"2024-09-10T06:28:48.457141+0000","last_fullsized":"2024-09-10T06:28:48.457141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380479+0000","last_change":"2024-09-10T06:26:32.259306+0000","last_active":"2024-09-10T06:28:48.380479+0000","last_peered":"2024-09-10T06:28:48.380479+0000","last_clean":"2024-09-10T06:28:48.380479+0000","last_became_active":"2024-09-10T06:26:32.258513+0000","last_became_peered":"2024-09-10T06:26:32.258513+0000","last_unstale":"2024-09-10T06:28:48.380479+0000","last_undegraded":"2024-09-10T06:28:48.380479+0000","last_fullsized":"2024-09-10T06:28:48.380479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"73'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376110+0000","last_change":"2024-09-10T06:26:30.581285+0000","last_active":"2024-09-10T06:28:48.376110+0000","last_peered":"2024-09-10T06:28:48.376110+0000","last_clean":"2024-09-10T06:28:48.376110+0000","last_became_active":"2024-09-10T06:26:30.580913+0000","last_became_peered":"2024-09-10T06:26:30.580913+0000","last_unstale":"2024-09-10T06:28:48.376110+0000","last_undegraded":"2024-09-10T06:28:48.376110+0000","last_fullsized":"2024-09-10T06:28:48.376110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"76'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455519+0000","last_change":"2024-09-10T06:26:32.274773+0000","last_active":"2024-09-10T06:28:48.455519+0000","last_peered":"2024-09-10T06:28:48.455519+0000","last_clean":"2024-09-10T06:28:48.455519+0000","last_became_active":"2024-09-10T06:26:32.274327+0000","last_became_peered":"2024-09-10T06:26:32.274327+0000","last_unstale":"2024-09-10T06:28:48.455519+0000","last_undegraded":"2024-09-10T06:28:48.455519+0000","last_fullsized":"2024-09-10T06:28:48.455519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:54.026434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"73'6","reported_seq":122,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454426+0000","last_change":"2024-09-10T06:27:08.592940+0000","last_active":"2024-09-10T06:28:48.454426+0000","last_peered":"2024-09-10T06:28:48.454426+0000","last_clean":"2024-09-10T06:28:48.454426+0000","last_became_active":"2024-09-10T06:27:08.592637+0000","last_became_peered":"2024-09-10T06:27:08.592637+0000","last_unstale":"2024-09-10T06:28:48.454426+0000","last_undegraded":"2024-09-10T06:28:48.454426+0000","last_fullsized":"2024-09-10T06:28:48.454426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:06.335302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380493+0000","last_change":"2024-09-10T06:26:32.279474+0000","last_active":"2024-09-10T06:28:48.380493+0000","last_peered":"2024-09-10T06:28:48.380493+0000","last_clean":"2024-09-10T06:28:48.380493+0000","last_became_active":"2024-09-10T06:26:32.278461+0000","last_became_peered":"2024-09-10T06:26:32.278461+0000","last_unstale":"2024-09-10T06:28:48.380493+0000","last_undegraded":"2024-09-10T06:28:48.380493+0000","last_fullsized":"2024-09-10T06:28:48.380493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"73'8","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376355+0000","last_change":"2024-09-10T06:26:30.605519+0000","last_active":"2024-09-10T06:28:48.376355+0000","last_peered":"2024-09-10T06:28:48.376355+0000","last_clean":"2024-09-10T06:28:48.376355+0000","last_became_active":"2024-09-10T06:26:30.605225+0000","last_became_peered":"2024-09-10T06:26:30.605225+0000","last_unstale":"2024-09-10T06:28:48.376355+0000","last_undegraded":"2024-09-10T06:28:48.376355+0000","last_fullsized":"2024-09-10T06:28:48.376355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"64'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462698+0000","last_change":"2024-09-10T06:26:32.267201+0000","last_active":"2024-09-10T06:28:48.462698+0000","last_peered":"2024-09-10T06:28:48.462698+0000","last_clean":"2024-09-10T06:28:48.462698+0000","last_became_active":"2024-09-10T06:26:32.266234+0000","last_became_peered":"2024-09-10T06:26:32.266234+0000","last_unstale":"2024-09-10T06:28:48.462698+0000","last_undegraded":"2024-09-10T06:28:48.462698+0000","last_fullsized":"2024-09-10T06:28:48.462698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"72'10","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458276+0000","last_change":"2024-09-10T06:26:30.596647+0000","last_active":"2024-09-10T06:28:48.458276+0000","last_peered":"2024-09-10T06:28:48.458276+0000","last_clean":"2024-09-10T06:28:48.458276+0000","last_became_active":"2024-09-10T06:26:30.593598+0000","last_became_peered":"2024-09-10T06:26:30.593598+0000","last_unstale":"2024-09-10T06:28:48.458276+0000","last_undegraded":"2024-09-10T06:28:48.458276+0000","last_fullsized":"2024-09-10T06:28:48.458276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"76'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375198+0000","last_change":"2024-09-10T06:26:32.278317+0000","last_active":"2024-09-10T06:28:48.375198+0000","last_peered":"2024-09-10T06:28:48.375198+0000","last_clean":"2024-09-10T06:28:48.375198+0000","last_became_active":"2024-09-10T06:26:32.278032+0000","last_became_peered":"2024-09-10T06:26:32.278032+0000","last_unstale":"2024-09-10T06:28:48.375198+0000","last_undegraded":"2024-09-10T06:28:48.375198+0000","last_fullsized":"2024-09-10T06:28:48.375198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:00.200118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"72'9","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464311+0000","last_change":"2024-09-10T06:26:30.580552+0000","last_active":"2024-09-10T06:28:48.464311+0000","last_peered":"2024-09-10T06:28:48.464311+0000","last_clean":"2024-09-10T06:28:48.464311+0000","last_became_active":"2024-09-10T06:26:30.579319+0000","last_became_peered":"2024-09-10T06:26:30.579319+0000","last_unstale":"2024-09-10T06:28:48.464311+0000","last_undegraded":"2024-09-10T06:28:48.464311+0000","last_fullsized":"2024-09-10T06:28:48.464311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:59.885311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"67'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375088+0000","last_change":"2024-09-10T06:26:32.257601+0000","last_active":"2024-09-10T06:28:48.375088+0000","last_peered":"2024-09-10T06:28:48.375088+0000","last_clean":"2024-09-10T06:28:48.375088+0000","last_became_active":"2024-09-10T06:26:32.256851+0000","last_became_peered":"2024-09-10T06:26:32.256851+0000","last_unstale":"2024-09-10T06:28:48.375088+0000","last_undegraded":"2024-09-10T06:28:48.375088+0000","last_fullsized":"2024-09-10T06:28:48.375088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"73'12","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455655+0000","last_change":"2024-09-10T06:28:47.047609+0000","last_active":"2024-09-10T06:28:48.455655+0000","last_peered":"2024-09-10T06:28:48.455655+0000","last_clean":"2024-09-10T06:28:48.455655+0000","last_became_active":"2024-09-10T06:28:46.326501+0000","last_became_peered":"2024-09-10T06:28:46.326501+0000","last_unstale":"2024-09-10T06:28:48.455655+0000","last_undegraded":"2024-09-10T06:28:48.455655+0000","last_fullsized":"2024-09-10T06:28:48.455655+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:33.793329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"62'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455403+0000","last_change":"2024-09-10T06:26:32.266768+0000","last_active":"2024-09-10T06:28:48.455403+0000","last_peered":"2024-09-10T06:28:48.455403+0000","last_clean":"2024-09-10T06:28:48.455403+0000","last_became_active":"2024-09-10T06:26:32.266000+0000","last_became_peered":"2024-09-10T06:26:32.266000+0000","last_unstale":"2024-09-10T06:28:48.455403+0000","last_undegraded":"2024-09-10T06:28:48.455403+0000","last_fullsized":"2024-09-10T06:28:48.455403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"72'9","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460809+0000","last_change":"2024-09-10T06:26:30.610309+0000","last_active":"2024-09-10T06:28:48.460809+0000","last_peered":"2024-09-10T06:28:48.460809+0000","last_clean":"2024-09-10T06:28:48.460809+0000","last_became_active":"2024-09-10T06:26:30.609674+0000","last_became_peered":"2024-09-10T06:26:30.609674+0000","last_unstale":"2024-09-10T06:28:48.460809+0000","last_undegraded":"2024-09-10T06:28:48.460809+0000","last_fullsized":"2024-09-10T06:28:48.460809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"73'10","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457073+0000","last_change":"2024-09-10T06:26:30.591365+0000","last_active":"2024-09-10T06:28:48.457073+0000","last_peered":"2024-09-10T06:28:48.457073+0000","last_clean":"2024-09-10T06:28:48.457073+0000","last_became_active":"2024-09-10T06:26:30.590640+0000","last_became_peered":"2024-09-10T06:26:30.590640+0000","last_unstale":"2024-09-10T06:28:48.457073+0000","last_undegraded":"2024-09-10T06:28:48.457073+0000","last_fullsized":"2024-09-10T06:28:48.457073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"67'10","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378178+0000","last_change":"2024-09-10T06:26:32.267333+0000","last_active":"2024-09-10T06:28:48.378178+0000","last_peered":"2024-09-10T06:28:48.378178+0000","last_clean":"2024-09-10T06:28:48.378178+0000","last_became_active":"2024-09-10T06:26:32.266876+0000","last_became_peered":"2024-09-10T06:26:32.266876+0000","last_unstale":"2024-09-10T06:28:48.378178+0000","last_undegraded":"2024-09-10T06:28:48.378178+0000","last_fullsized":"2024-09-10T06:28:48.378178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:02.483639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"73'13","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453736+0000","last_change":"2024-09-10T06:26:30.590924+0000","last_active":"2024-09-10T06:28:48.453736+0000","last_peered":"2024-09-10T06:28:48.453736+0000","last_clean":"2024-09-10T06:28:48.453736+0000","last_became_active":"2024-09-10T06:26:30.590415+0000","last_became_peered":"2024-09-10T06:26:30.590415+0000","last_unstale":"2024-09-10T06:28:48.453736+0000","last_undegraded":"2024-09-10T06:28:48.453736+0000","last_fullsized":"2024-09-10T06:28:48.453736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:32.460291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460331+0000","last_change":"2024-09-10T06:26:32.283339+0000","last_active":"2024-09-10T06:28:48.460331+0000","last_peered":"2024-09-10T06:28:48.460331+0000","last_clean":"2024-09-10T06:28:48.460331+0000","last_became_active":"2024-09-10T06:26:32.282581+0000","last_became_peered":"2024-09-10T06:26:32.282581+0000","last_unstale":"2024-09-10T06:28:48.460331+0000","last_undegraded":"2024-09-10T06:28:48.460331+0000","last_fullsized":"2024-09-10T06:28:48.460331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":816,"ondisk_log_size":816,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":160287,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":814,"num_read_kb":573,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":272742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":669,"ondisk_log_size":669,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":334,"num_read_kb":334,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":567,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":632,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":209715200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542184,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":651436,"kb_used_data":620252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93720404,"statfs":{"total":96636764160,"available":95969693696,"internally_reserved":0,"allocated":635138048,"data_stored":634594233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542184,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536120,"kb_used_data":504936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93835720,"statfs":{"total":96636764160,"available":96087777280,"internally_reserved":0,"allocated":517054464,"data_stored":516546322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":700068,"kb_used_data":668884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93671772,"statfs":{"total":96636764160,"available":95919894528,"internally_reserved":0,"allocated":684937216,"data_stored":684376545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757300,"kb_used_data":726108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93614540,"statfs":{"total":96636764160,"available":95861288960,"internally_reserved":0,"allocated":743534592,"data_stored":743038236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":710344,"kb_used_data":679160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93661496,"statfs":{"total":96636764160,"available":95909371904,"internally_reserved":0,"allocated":695459840,"data_stored":694924989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":433712,"kb_used_data":402528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93938128,"statfs":{"total":96636764160,"available":96192643072,"internally_reserved":0,"allocated":412188672,"data_stored":411692893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":439880,"kb_used_data":408696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93931960,"statfs":{"total":96636764160,"available":96186327040,"internally_reserved":0,"allocated":418504704,"data_stored":417979454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":712908,"kb_used_data":681716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93658932,"statfs":{"total":96636764160,"available":95906746368,"internally_reserved":0,"allocated":698077184,"data_stored":697554526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":696254464,"data_stored":696254464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":417333248,"data_stored":417333248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":411041792,"data_stored":411041792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":694157312,"data_stored":694157312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":742391808,"data_stored":742391808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":683671552,"data_stored":683671552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":515899392,"data_stored":515899392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":633339904,"data_stored":633339904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":122118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":59667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":18838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:29:18.747 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T06:29:18.747 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:29:19.112 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:29:19.119 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:29:19.127 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-10T06:29:17.473405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2397797023,"num_objects":772,"num_object_clones":0,"num_object_copies":1544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":772,"num_whiteouts":0,"num_read":2073,"num_read_kb":1782,"num_write":1669,"num_write_kb":2367363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":209715508,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2483,"ondisk_log_size":2483,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4941768,"kb_used_data":4692280,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":750032952,"statfs":{"total":773094113280,"available":768033742848,"internally_reserved":0,"allocated":4804894720,"data_stored":4800707198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005735"},"pg_stats":[{"pgid":"3.3f","version":"73'12","reported_seq":127,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454157+0000","last_change":"2024-09-10T06:27:08.597414+0000","last_active":"2024-09-10T06:28:48.454157+0000","last_peered":"2024-09-10T06:28:48.454157+0000","last_clean":"2024-09-10T06:28:48.454157+0000","last_became_active":"2024-09-10T06:27:08.597026+0000","last_became_peered":"2024-09-10T06:27:08.597026+0000","last_unstale":"2024-09-10T06:28:48.454157+0000","last_undegraded":"2024-09-10T06:28:48.454157+0000","last_fullsized":"2024-09-10T06:28:48.454157+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:07.484952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"67'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456583+0000","last_change":"2024-09-10T06:26:32.279882+0000","last_active":"2024-09-10T06:28:48.456583+0000","last_peered":"2024-09-10T06:28:48.456583+0000","last_clean":"2024-09-10T06:28:48.456583+0000","last_became_active":"2024-09-10T06:26:32.279098+0000","last_became_peered":"2024-09-10T06:26:32.279098+0000","last_unstale":"2024-09-10T06:28:48.456583+0000","last_undegraded":"2024-09-10T06:28:48.456583+0000","last_fullsized":"2024-09-10T06:28:48.456583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"72'5","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454007+0000","last_change":"2024-09-10T06:26:30.573148+0000","last_active":"2024-09-10T06:28:48.454007+0000","last_peered":"2024-09-10T06:28:48.454007+0000","last_clean":"2024-09-10T06:28:48.454007+0000","last_became_active":"2024-09-10T06:26:30.572798+0000","last_became_peered":"2024-09-10T06:26:30.572798+0000","last_unstale":"2024-09-10T06:28:48.454007+0000","last_undegraded":"2024-09-10T06:28:48.454007+0000","last_fullsized":"2024-09-10T06:28:48.454007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:38.833715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"62'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457162+0000","last_change":"2024-09-10T06:26:32.276811+0000","last_active":"2024-09-10T06:28:48.457162+0000","last_peered":"2024-09-10T06:28:48.457162+0000","last_clean":"2024-09-10T06:28:48.457162+0000","last_became_active":"2024-09-10T06:26:32.275990+0000","last_became_peered":"2024-09-10T06:26:32.275990+0000","last_unstale":"2024-09-10T06:28:48.457162+0000","last_undegraded":"2024-09-10T06:28:48.457162+0000","last_fullsized":"2024-09-10T06:28:48.457162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"72'10","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377820+0000","last_change":"2024-09-10T06:26:30.578068+0000","last_active":"2024-09-10T06:28:48.377820+0000","last_peered":"2024-09-10T06:28:48.377820+0000","last_clean":"2024-09-10T06:28:48.377820+0000","last_became_active":"2024-09-10T06:26:30.577688+0000","last_became_peered":"2024-09-10T06:26:30.577688+0000","last_unstale":"2024-09-10T06:28:48.377820+0000","last_undegraded":"2024-09-10T06:28:48.377820+0000","last_fullsized":"2024-09-10T06:28:48.377820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:34.137079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377720+0000","last_change":"2024-09-10T06:26:32.256939+0000","last_active":"2024-09-10T06:28:48.377720+0000","last_peered":"2024-09-10T06:28:48.377720+0000","last_clean":"2024-09-10T06:28:48.377720+0000","last_became_active":"2024-09-10T06:26:32.256117+0000","last_became_peered":"2024-09-10T06:26:32.256117+0000","last_unstale":"2024-09-10T06:28:48.377720+0000","last_undegraded":"2024-09-10T06:28:48.377720+0000","last_fullsized":"2024-09-10T06:28:48.377720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:51.879604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"73'11","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461567+0000","last_change":"2024-09-10T06:26:30.593697+0000","last_active":"2024-09-10T06:28:48.461567+0000","last_peered":"2024-09-10T06:28:48.461567+0000","last_clean":"2024-09-10T06:28:48.461567+0000","last_became_active":"2024-09-10T06:26:30.591807+0000","last_became_peered":"2024-09-10T06:26:30.591807+0000","last_unstale":"2024-09-10T06:28:48.461567+0000","last_undegraded":"2024-09-10T06:28:48.461567+0000","last_fullsized":"2024-09-10T06:28:48.461567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376230+0000","last_change":"2024-09-10T06:26:32.264685+0000","last_active":"2024-09-10T06:28:48.376230+0000","last_peered":"2024-09-10T06:28:48.376230+0000","last_clean":"2024-09-10T06:28:48.376230+0000","last_became_active":"2024-09-10T06:26:32.264199+0000","last_became_peered":"2024-09-10T06:26:32.264199+0000","last_unstale":"2024-09-10T06:28:48.376230+0000","last_undegraded":"2024-09-10T06:28:48.376230+0000","last_fullsized":"2024-09-10T06:28:48.376230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:20.713066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"72'7","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457396+0000","last_change":"2024-09-10T06:28:09.653122+0000","last_active":"2024-09-10T06:28:48.457396+0000","last_peered":"2024-09-10T06:28:48.457396+0000","last_clean":"2024-09-10T06:28:48.457396+0000","last_became_active":"2024-09-10T06:28:09.546624+0000","last_became_peered":"2024-09-10T06:28:09.546624+0000","last_unstale":"2024-09-10T06:28:48.457396+0000","last_undegraded":"2024-09-10T06:28:48.457396+0000","last_fullsized":"2024-09-10T06:28:48.457396+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:57.805994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"67'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458405+0000","last_change":"2024-09-10T06:26:32.290741+0000","last_active":"2024-09-10T06:28:48.458405+0000","last_peered":"2024-09-10T06:28:48.458405+0000","last_clean":"2024-09-10T06:28:48.458405+0000","last_became_active":"2024-09-10T06:26:32.289840+0000","last_became_peered":"2024-09-10T06:26:32.289840+0000","last_unstale":"2024-09-10T06:28:48.458405+0000","last_undegraded":"2024-09-10T06:28:48.458405+0000","last_fullsized":"2024-09-10T06:28:48.458405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"73'6","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458886+0000","last_change":"2024-09-10T06:26:30.609817+0000","last_active":"2024-09-10T06:28:48.458886+0000","last_peered":"2024-09-10T06:28:48.458886+0000","last_clean":"2024-09-10T06:28:48.458886+0000","last_became_active":"2024-09-10T06:26:30.603330+0000","last_became_peered":"2024-09-10T06:26:30.603330+0000","last_unstale":"2024-09-10T06:28:48.458886+0000","last_undegraded":"2024-09-10T06:28:48.458886+0000","last_fullsized":"2024-09-10T06:28:48.458886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:09.523045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"67'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380006+0000","last_change":"2024-09-10T06:26:32.257050+0000","last_active":"2024-09-10T06:28:48.380006+0000","last_peered":"2024-09-10T06:28:48.380006+0000","last_clean":"2024-09-10T06:28:48.380006+0000","last_became_active":"2024-09-10T06:26:32.254437+0000","last_became_peered":"2024-09-10T06:26:32.254437+0000","last_unstale":"2024-09-10T06:28:48.380006+0000","last_undegraded":"2024-09-10T06:28:48.380006+0000","last_fullsized":"2024-09-10T06:28:48.380006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"72'14","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457637+0000","last_change":"2024-09-10T06:26:30.579756+0000","last_active":"2024-09-10T06:28:48.457637+0000","last_peered":"2024-09-10T06:28:48.457637+0000","last_clean":"2024-09-10T06:28:48.457637+0000","last_became_active":"2024-09-10T06:26:30.578033+0000","last_became_peered":"2024-09-10T06:26:30.578033+0000","last_unstale":"2024-09-10T06:28:48.457637+0000","last_undegraded":"2024-09-10T06:28:48.457637+0000","last_fullsized":"2024-09-10T06:28:48.457637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":22,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460066+0000","last_change":"2024-09-10T06:26:32.281248+0000","last_active":"2024-09-10T06:28:48.460066+0000","last_peered":"2024-09-10T06:28:48.460066+0000","last_clean":"2024-09-10T06:28:48.460066+0000","last_became_active":"2024-09-10T06:26:32.280480+0000","last_became_peered":"2024-09-10T06:26:32.280480+0000","last_unstale":"2024-09-10T06:28:48.460066+0000","last_undegraded":"2024-09-10T06:28:48.460066+0000","last_fullsized":"2024-09-10T06:28:48.460066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"73'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376021+0000","last_change":"2024-09-10T06:26:30.593213+0000","last_active":"2024-09-10T06:28:48.376021+0000","last_peered":"2024-09-10T06:28:48.376021+0000","last_clean":"2024-09-10T06:28:48.376021+0000","last_became_active":"2024-09-10T06:26:30.592770+0000","last_became_peered":"2024-09-10T06:26:30.592770+0000","last_unstale":"2024-09-10T06:28:48.376021+0000","last_undegraded":"2024-09-10T06:28:48.376021+0000","last_fullsized":"2024-09-10T06:28:48.376021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'10","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456049+0000","last_change":"2024-09-10T06:26:32.267430+0000","last_active":"2024-09-10T06:28:48.456049+0000","last_peered":"2024-09-10T06:28:48.456049+0000","last_clean":"2024-09-10T06:28:48.456049+0000","last_became_active":"2024-09-10T06:26:32.265788+0000","last_became_peered":"2024-09-10T06:26:32.265788+0000","last_unstale":"2024-09-10T06:28:48.456049+0000","last_undegraded":"2024-09-10T06:28:48.456049+0000","last_fullsized":"2024-09-10T06:28:48.456049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:19.180142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'10","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377130+0000","last_change":"2024-09-10T06:26:32.255038+0000","last_active":"2024-09-10T06:28:48.377130+0000","last_peered":"2024-09-10T06:28:48.377130+0000","last_clean":"2024-09-10T06:28:48.377130+0000","last_became_active":"2024-09-10T06:26:32.254281+0000","last_became_peered":"2024-09-10T06:26:32.254281+0000","last_unstale":"2024-09-10T06:28:48.377130+0000","last_undegraded":"2024-09-10T06:28:48.377130+0000","last_fullsized":"2024-09-10T06:28:48.377130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:46.363171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"73'9","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464675+0000","last_change":"2024-09-10T06:26:30.607280+0000","last_active":"2024-09-10T06:28:48.464675+0000","last_peered":"2024-09-10T06:28:48.464675+0000","last_clean":"2024-09-10T06:28:48.464675+0000","last_became_active":"2024-09-10T06:26:30.605602+0000","last_became_peered":"2024-09-10T06:26:30.605602+0000","last_unstale":"2024-09-10T06:28:48.464675+0000","last_undegraded":"2024-09-10T06:28:48.464675+0000","last_fullsized":"2024-09-10T06:28:48.464675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:49.865234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457377+0000","last_change":"2024-09-10T06:26:32.275913+0000","last_active":"2024-09-10T06:28:48.457377+0000","last_peered":"2024-09-10T06:28:48.457377+0000","last_clean":"2024-09-10T06:28:48.457377+0000","last_became_active":"2024-09-10T06:26:32.274264+0000","last_became_peered":"2024-09-10T06:26:32.274264+0000","last_unstale":"2024-09-10T06:28:48.457377+0000","last_undegraded":"2024-09-10T06:28:48.457377+0000","last_fullsized":"2024-09-10T06:28:48.457377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"72'5","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459316+0000","last_change":"2024-09-10T06:28:46.509018+0000","last_active":"2024-09-10T06:28:48.459316+0000","last_peered":"2024-09-10T06:28:48.459316+0000","last_clean":"2024-09-10T06:28:48.459316+0000","last_became_active":"2024-09-10T06:28:46.332355+0000","last_became_peered":"2024-09-10T06:28:46.332355+0000","last_unstale":"2024-09-10T06:28:48.459316+0000","last_undegraded":"2024-09-10T06:28:48.459316+0000","last_fullsized":"2024-09-10T06:28:48.459316+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:54.077676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459140+0000","last_change":"2024-09-10T06:26:32.279079+0000","last_active":"2024-09-10T06:28:48.459140+0000","last_peered":"2024-09-10T06:28:48.459140+0000","last_clean":"2024-09-10T06:28:48.459140+0000","last_became_active":"2024-09-10T06:26:32.278407+0000","last_became_peered":"2024-09-10T06:26:32.278407+0000","last_unstale":"2024-09-10T06:28:48.459140+0000","last_undegraded":"2024-09-10T06:28:48.459140+0000","last_fullsized":"2024-09-10T06:28:48.459140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"73'10","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460707+0000","last_change":"2024-09-10T06:26:30.607368+0000","last_active":"2024-09-10T06:28:48.460707+0000","last_peered":"2024-09-10T06:28:48.460707+0000","last_clean":"2024-09-10T06:28:48.460707+0000","last_became_active":"2024-09-10T06:26:30.606807+0000","last_became_peered":"2024-09-10T06:26:30.606807+0000","last_unstale":"2024-09-10T06:28:48.460707+0000","last_undegraded":"2024-09-10T06:28:48.460707+0000","last_fullsized":"2024-09-10T06:28:48.460707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"76'8","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454841+0000","last_change":"2024-09-10T06:27:08.801987+0000","last_active":"2024-09-10T06:28:48.454841+0000","last_peered":"2024-09-10T06:28:48.454841+0000","last_clean":"2024-09-10T06:28:48.454841+0000","last_became_active":"2024-09-10T06:27:08.801461+0000","last_became_peered":"2024-09-10T06:27:08.801461+0000","last_unstale":"2024-09-10T06:28:48.454841+0000","last_undegraded":"2024-09-10T06:28:48.454841+0000","last_fullsized":"2024-09-10T06:28:48.454841+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"72'11","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379594+0000","last_change":"2024-09-10T06:26:30.598381+0000","last_active":"2024-09-10T06:28:48.379594+0000","last_peered":"2024-09-10T06:28:48.379594+0000","last_clean":"2024-09-10T06:28:48.379594+0000","last_became_active":"2024-09-10T06:26:30.597271+0000","last_became_peered":"2024-09-10T06:26:30.597271+0000","last_unstale":"2024-09-10T06:28:48.379594+0000","last_undegraded":"2024-09-10T06:28:48.379594+0000","last_fullsized":"2024-09-10T06:28:48.379594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:59.908548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455123+0000","last_change":"2024-09-10T06:26:32.247492+0000","last_active":"2024-09-10T06:28:48.455123+0000","last_peered":"2024-09-10T06:28:48.455123+0000","last_clean":"2024-09-10T06:28:48.455123+0000","last_became_active":"2024-09-10T06:26:32.246938+0000","last_became_peered":"2024-09-10T06:26:32.246938+0000","last_unstale":"2024-09-10T06:28:48.455123+0000","last_undegraded":"2024-09-10T06:28:48.455123+0000","last_fullsized":"2024-09-10T06:28:48.455123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:01.766868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"73'11","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376896+0000","last_change":"2024-09-10T06:28:46.662120+0000","last_active":"2024-09-10T06:28:48.376896+0000","last_peered":"2024-09-10T06:28:48.376896+0000","last_clean":"2024-09-10T06:28:48.376896+0000","last_became_active":"2024-09-10T06:28:46.326710+0000","last_became_peered":"2024-09-10T06:28:46.326710+0000","last_unstale":"2024-09-10T06:28:48.376896+0000","last_undegraded":"2024-09-10T06:28:48.376896+0000","last_fullsized":"2024-09-10T06:28:48.376896+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:47.625969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380427+0000","last_change":"2024-09-10T06:26:32.278347+0000","last_active":"2024-09-10T06:28:48.380427+0000","last_peered":"2024-09-10T06:28:48.380427+0000","last_clean":"2024-09-10T06:28:48.380427+0000","last_became_active":"2024-09-10T06:26:32.275206+0000","last_became_peered":"2024-09-10T06:26:32.275206+0000","last_unstale":"2024-09-10T06:28:48.380427+0000","last_undegraded":"2024-09-10T06:28:48.380427+0000","last_fullsized":"2024-09-10T06:28:48.380427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"73'13","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375576+0000","last_change":"2024-09-10T06:26:30.572734+0000","last_active":"2024-09-10T06:28:48.375576+0000","last_peered":"2024-09-10T06:28:48.375576+0000","last_clean":"2024-09-10T06:28:48.375576+0000","last_became_active":"2024-09-10T06:26:30.572043+0000","last_became_peered":"2024-09-10T06:26:30.572043+0000","last_unstale":"2024-09-10T06:28:48.375576+0000","last_undegraded":"2024-09-10T06:28:48.375576+0000","last_fullsized":"2024-09-10T06:28:48.375576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"76'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376329+0000","last_change":"2024-09-10T06:26:40.323476+0000","last_active":"2024-09-10T06:28:48.376329+0000","last_peered":"2024-09-10T06:28:48.376329+0000","last_clean":"2024-09-10T06:28:48.376329+0000","last_became_active":"2024-09-10T06:26:40.322711+0000","last_became_peered":"2024-09-10T06:26:40.322711+0000","last_unstale":"2024-09-10T06:28:48.376329+0000","last_undegraded":"2024-09-10T06:28:48.376329+0000","last_fullsized":"2024-09-10T06:28:48.376329+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378030+0000","last_change":"2024-09-10T06:26:32.276274+0000","last_active":"2024-09-10T06:28:48.378030+0000","last_peered":"2024-09-10T06:28:48.378030+0000","last_clean":"2024-09-10T06:28:48.378030+0000","last_became_active":"2024-09-10T06:26:32.275889+0000","last_became_peered":"2024-09-10T06:26:32.275889+0000","last_unstale":"2024-09-10T06:28:48.378030+0000","last_undegraded":"2024-09-10T06:28:48.378030+0000","last_fullsized":"2024-09-10T06:28:48.378030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"72'14","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463117+0000","last_change":"2024-09-10T06:26:30.595738+0000","last_active":"2024-09-10T06:28:48.463117+0000","last_peered":"2024-09-10T06:28:48.463117+0000","last_clean":"2024-09-10T06:28:48.463117+0000","last_became_active":"2024-09-10T06:26:30.595128+0000","last_became_peered":"2024-09-10T06:26:30.595128+0000","last_unstale":"2024-09-10T06:28:48.463117+0000","last_undegraded":"2024-09-10T06:28:48.463117+0000","last_fullsized":"2024-09-10T06:28:48.463117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459270+0000","last_change":"2024-09-10T06:26:34.279824+0000","last_active":"2024-09-10T06:28:48.459270+0000","last_peered":"2024-09-10T06:28:48.459270+0000","last_clean":"2024-09-10T06:28:48.459270+0000","last_became_active":"2024-09-10T06:26:34.279074+0000","last_became_peered":"2024-09-10T06:26:34.279074+0000","last_unstale":"2024-09-10T06:28:48.459270+0000","last_undegraded":"2024-09-10T06:28:48.459270+0000","last_fullsized":"2024-09-10T06:28:48.459270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:40.507467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"76'15","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378442+0000","last_change":"2024-09-10T06:26:36.296703+0000","last_active":"2024-09-10T06:28:48.378442+0000","last_peered":"2024-09-10T06:28:48.378442+0000","last_clean":"2024-09-10T06:28:48.378442+0000","last_became_active":"2024-09-10T06:26:36.295786+0000","last_became_peered":"2024-09-10T06:26:36.295786+0000","last_unstale":"2024-09-10T06:28:48.378442+0000","last_undegraded":"2024-09-10T06:28:48.378442+0000","last_fullsized":"2024-09-10T06:28:48.378442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:31.699855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464404+0000","last_change":"2024-09-10T06:26:38.305468+0000","last_active":"2024-09-10T06:28:48.464404+0000","last_peered":"2024-09-10T06:28:48.464404+0000","last_clean":"2024-09-10T06:28:48.464404+0000","last_became_active":"2024-09-10T06:26:38.304847+0000","last_became_peered":"2024-09-10T06:26:38.304847+0000","last_unstale":"2024-09-10T06:28:48.464404+0000","last_undegraded":"2024-09-10T06:28:48.464404+0000","last_fullsized":"2024-09-10T06:28:48.464404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:36.499856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456269+0000","last_change":"2024-09-10T06:26:40.331389+0000","last_active":"2024-09-10T06:28:48.456269+0000","last_peered":"2024-09-10T06:28:48.456269+0000","last_clean":"2024-09-10T06:28:48.456269+0000","last_became_active":"2024-09-10T06:26:40.330777+0000","last_became_peered":"2024-09-10T06:26:40.330777+0000","last_unstale":"2024-09-10T06:28:48.456269+0000","last_undegraded":"2024-09-10T06:28:48.456269+0000","last_fullsized":"2024-09-10T06:28:48.456269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:22.792159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459648+0000","last_change":"2024-09-10T06:26:32.283112+0000","last_active":"2024-09-10T06:28:48.459648+0000","last_peered":"2024-09-10T06:28:48.459648+0000","last_clean":"2024-09-10T06:28:48.459648+0000","last_became_active":"2024-09-10T06:26:32.282263+0000","last_became_peered":"2024-09-10T06:26:32.282263+0000","last_unstale":"2024-09-10T06:28:48.459648+0000","last_undegraded":"2024-09-10T06:28:48.459648+0000","last_fullsized":"2024-09-10T06:28:48.459648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:02.124800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375652+0000","last_change":"2024-09-10T06:26:30.576489+0000","last_active":"2024-09-10T06:28:48.375652+0000","last_peered":"2024-09-10T06:28:48.375652+0000","last_clean":"2024-09-10T06:28:48.375652+0000","last_became_active":"2024-09-10T06:26:30.576039+0000","last_became_peered":"2024-09-10T06:26:30.576039+0000","last_unstale":"2024-09-10T06:28:48.375652+0000","last_undegraded":"2024-09-10T06:28:48.375652+0000","last_fullsized":"2024-09-10T06:28:48.375652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377684+0000","last_change":"2024-09-10T06:26:34.268758+0000","last_active":"2024-09-10T06:28:48.377684+0000","last_peered":"2024-09-10T06:28:48.377684+0000","last_clean":"2024-09-10T06:28:48.377684+0000","last_became_active":"2024-09-10T06:26:34.268279+0000","last_became_peered":"2024-09-10T06:26:34.268279+0000","last_unstale":"2024-09-10T06:28:48.377684+0000","last_undegraded":"2024-09-10T06:28:48.377684+0000","last_fullsized":"2024-09-10T06:28:48.377684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:42.052702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380478+0000","last_change":"2024-09-10T06:26:36.273991+0000","last_active":"2024-09-10T06:28:48.380478+0000","last_peered":"2024-09-10T06:28:48.380478+0000","last_clean":"2024-09-10T06:28:48.380478+0000","last_became_active":"2024-09-10T06:26:36.273138+0000","last_became_peered":"2024-09-10T06:26:36.273138+0000","last_unstale":"2024-09-10T06:28:48.380478+0000","last_undegraded":"2024-09-10T06:28:48.380478+0000","last_fullsized":"2024-09-10T06:28:48.380478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379823+0000","last_change":"2024-09-10T06:26:38.294543+0000","last_active":"2024-09-10T06:28:48.379823+0000","last_peered":"2024-09-10T06:28:48.379823+0000","last_clean":"2024-09-10T06:28:48.379823+0000","last_became_active":"2024-09-10T06:26:38.293754+0000","last_became_peered":"2024-09-10T06:26:38.293754+0000","last_unstale":"2024-09-10T06:28:48.379823+0000","last_undegraded":"2024-09-10T06:28:48.379823+0000","last_fullsized":"2024-09-10T06:28:48.379823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"62'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375308+0000","last_change":"2024-09-10T06:26:40.326998+0000","last_active":"2024-09-10T06:28:48.375308+0000","last_peered":"2024-09-10T06:28:48.375308+0000","last_clean":"2024-09-10T06:28:48.375308+0000","last_became_active":"2024-09-10T06:26:40.322648+0000","last_became_peered":"2024-09-10T06:26:40.322648+0000","last_unstale":"2024-09-10T06:28:48.375308+0000","last_undegraded":"2024-09-10T06:28:48.375308+0000","last_fullsized":"2024-09-10T06:28:48.375308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:19.837495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"76'4","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379477+0000","last_change":"2024-09-10T06:26:32.256959+0000","last_active":"2024-09-10T06:28:48.379477+0000","last_peered":"2024-09-10T06:28:48.379477+0000","last_clean":"2024-09-10T06:28:48.379477+0000","last_became_active":"2024-09-10T06:26:32.256701+0000","last_became_peered":"2024-09-10T06:26:32.256701+0000","last_unstale":"2024-09-10T06:28:48.379477+0000","last_undegraded":"2024-09-10T06:28:48.379477+0000","last_fullsized":"2024-09-10T06:28:48.379477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"73'13","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457900+0000","last_change":"2024-09-10T06:26:30.598409+0000","last_active":"2024-09-10T06:28:48.457900+0000","last_peered":"2024-09-10T06:28:48.457900+0000","last_clean":"2024-09-10T06:28:48.457900+0000","last_became_active":"2024-09-10T06:26:30.597703+0000","last_became_peered":"2024-09-10T06:26:30.597703+0000","last_unstale":"2024-09-10T06:28:48.457900+0000","last_undegraded":"2024-09-10T06:28:48.457900+0000","last_fullsized":"2024-09-10T06:28:48.457900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380025+0000","last_change":"2024-09-10T06:26:34.268741+0000","last_active":"2024-09-10T06:28:48.380025+0000","last_peered":"2024-09-10T06:28:48.380025+0000","last_clean":"2024-09-10T06:28:48.380025+0000","last_became_active":"2024-09-10T06:26:34.268192+0000","last_became_peered":"2024-09-10T06:26:34.268192+0000","last_unstale":"2024-09-10T06:28:48.380025+0000","last_undegraded":"2024-09-10T06:28:48.380025+0000","last_fullsized":"2024-09-10T06:28:48.380025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:42:10.110645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454978+0000","last_change":"2024-09-10T06:26:36.275955+0000","last_active":"2024-09-10T06:28:48.454978+0000","last_peered":"2024-09-10T06:28:48.454978+0000","last_clean":"2024-09-10T06:28:48.454978+0000","last_became_active":"2024-09-10T06:26:36.275306+0000","last_became_peered":"2024-09-10T06:26:36.275306+0000","last_unstale":"2024-09-10T06:28:48.454978+0000","last_undegraded":"2024-09-10T06:28:48.454978+0000","last_fullsized":"2024-09-10T06:28:48.454978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:03.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'102","reported_seq":402,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:52.690214+0000","last_change":"2024-09-10T06:26:38.302764+0000","last_active":"2024-09-10T06:28:52.690214+0000","last_peered":"2024-09-10T06:28:52.690214+0000","last_clean":"2024-09-10T06:28:52.690214+0000","last_became_active":"2024-09-10T06:26:38.300326+0000","last_became_peered":"2024-09-10T06:26:38.300326+0000","last_unstale":"2024-09-10T06:28:52.690214+0000","last_undegraded":"2024-09-10T06:28:52.690214+0000","last_fullsized":"2024-09-10T06:28:52.690214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:29.851085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376634+0000","last_change":"2024-09-10T06:26:40.297893+0000","last_active":"2024-09-10T06:28:48.376634+0000","last_peered":"2024-09-10T06:28:48.376634+0000","last_clean":"2024-09-10T06:28:48.376634+0000","last_became_active":"2024-09-10T06:26:40.297296+0000","last_became_peered":"2024-09-10T06:26:40.297296+0000","last_unstale":"2024-09-10T06:28:48.376634+0000","last_undegraded":"2024-09-10T06:28:48.376634+0000","last_fullsized":"2024-09-10T06:28:48.376634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379613+0000","last_change":"2024-09-10T06:26:32.265005+0000","last_active":"2024-09-10T06:28:48.379613+0000","last_peered":"2024-09-10T06:28:48.379613+0000","last_clean":"2024-09-10T06:28:48.379613+0000","last_became_active":"2024-09-10T06:26:32.264334+0000","last_became_peered":"2024-09-10T06:26:32.264334+0000","last_unstale":"2024-09-10T06:28:48.379613+0000","last_undegraded":"2024-09-10T06:28:48.379613+0000","last_fullsized":"2024-09-10T06:28:48.379613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"73'13","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457010+0000","last_change":"2024-09-10T06:26:30.576242+0000","last_active":"2024-09-10T06:28:48.457010+0000","last_peered":"2024-09-10T06:28:48.457010+0000","last_clean":"2024-09-10T06:28:48.457010+0000","last_became_active":"2024-09-10T06:26:30.575433+0000","last_became_peered":"2024-09-10T06:26:30.575433+0000","last_unstale":"2024-09-10T06:28:48.457010+0000","last_undegraded":"2024-09-10T06:28:48.457010+0000","last_fullsized":"2024-09-10T06:28:48.457010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459995+0000","last_change":"2024-09-10T06:26:34.283701+0000","last_active":"2024-09-10T06:28:48.459995+0000","last_peered":"2024-09-10T06:28:48.459995+0000","last_clean":"2024-09-10T06:28:48.459995+0000","last_became_active":"2024-09-10T06:26:34.282941+0000","last_became_peered":"2024-09-10T06:26:34.282941+0000","last_unstale":"2024-09-10T06:28:48.459995+0000","last_undegraded":"2024-09-10T06:28:48.459995+0000","last_fullsized":"2024-09-10T06:28:48.459995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:29.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"76'16","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463444+0000","last_change":"2024-09-10T06:26:36.298510+0000","last_active":"2024-09-10T06:28:48.463444+0000","last_peered":"2024-09-10T06:28:48.463444+0000","last_clean":"2024-09-10T06:28:48.463444+0000","last_became_active":"2024-09-10T06:26:36.297309+0000","last_became_peered":"2024-09-10T06:26:36.297309+0000","last_unstale":"2024-09-10T06:28:48.463444+0000","last_undegraded":"2024-09-10T06:28:48.463444+0000","last_fullsized":"2024-09-10T06:28:48.463444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'102","reported_seq":269,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:52.696758+0000","last_change":"2024-09-10T06:26:38.300228+0000","last_active":"2024-09-10T06:28:52.696758+0000","last_peered":"2024-09-10T06:28:52.696758+0000","last_clean":"2024-09-10T06:28:52.696758+0000","last_became_active":"2024-09-10T06:26:38.299355+0000","last_became_peered":"2024-09-10T06:26:38.299355+0000","last_unstale":"2024-09-10T06:28:52.696758+0000","last_undegraded":"2024-09-10T06:28:52.696758+0000","last_fullsized":"2024-09-10T06:28:52.696758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:20.050096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456891+0000","last_change":"2024-09-10T06:26:32.271283+0000","last_active":"2024-09-10T06:28:48.456891+0000","last_peered":"2024-09-10T06:28:48.456891+0000","last_clean":"2024-09-10T06:28:48.456891+0000","last_became_active":"2024-09-10T06:26:32.270496+0000","last_became_peered":"2024-09-10T06:26:32.270496+0000","last_unstale":"2024-09-10T06:28:48.456891+0000","last_undegraded":"2024-09-10T06:28:48.456891+0000","last_fullsized":"2024-09-10T06:28:48.456891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464629+0000","last_change":"2024-09-10T06:26:30.607373+0000","last_active":"2024-09-10T06:28:48.464629+0000","last_peered":"2024-09-10T06:28:48.464629+0000","last_clean":"2024-09-10T06:28:48.464629+0000","last_became_active":"2024-09-10T06:26:30.606685+0000","last_became_peered":"2024-09-10T06:26:30.606685+0000","last_unstale":"2024-09-10T06:28:48.464629+0000","last_undegraded":"2024-09-10T06:28:48.464629+0000","last_fullsized":"2024-09-10T06:28:48.464629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:35.705564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456456+0000","last_change":"2024-09-10T06:26:34.286925+0000","last_active":"2024-09-10T06:28:48.456456+0000","last_peered":"2024-09-10T06:28:48.456456+0000","last_clean":"2024-09-10T06:28:48.456456+0000","last_became_active":"2024-09-10T06:26:34.285787+0000","last_became_peered":"2024-09-10T06:26:34.285787+0000","last_unstale":"2024-09-10T06:28:48.456456+0000","last_undegraded":"2024-09-10T06:28:48.456456+0000","last_fullsized":"2024-09-10T06:28:48.456456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"76'25","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456092+0000","last_change":"2024-09-10T06:26:36.293988+0000","last_active":"2024-09-10T06:28:48.456092+0000","last_peered":"2024-09-10T06:28:48.456092+0000","last_clean":"2024-09-10T06:28:48.456092+0000","last_became_active":"2024-09-10T06:26:36.293226+0000","last_became_peered":"2024-09-10T06:26:36.293226+0000","last_unstale":"2024-09-10T06:28:48.456092+0000","last_undegraded":"2024-09-10T06:28:48.456092+0000","last_fullsized":"2024-09-10T06:28:48.456092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453865+0000","last_change":"2024-09-10T06:26:38.305826+0000","last_active":"2024-09-10T06:28:48.453865+0000","last_peered":"2024-09-10T06:28:48.453865+0000","last_clean":"2024-09-10T06:28:48.453865+0000","last_became_active":"2024-09-10T06:26:38.304601+0000","last_became_peered":"2024-09-10T06:26:38.304601+0000","last_unstale":"2024-09-10T06:28:48.453865+0000","last_undegraded":"2024-09-10T06:28:48.453865+0000","last_fullsized":"2024-09-10T06:28:48.453865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:12.545261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"62'8","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460978+0000","last_change":"2024-09-10T06:26:40.332286+0000","last_active":"2024-09-10T06:28:48.460978+0000","last_peered":"2024-09-10T06:28:48.460978+0000","last_clean":"2024-09-10T06:28:48.460978+0000","last_became_active":"2024-09-10T06:26:40.331262+0000","last_became_peered":"2024-09-10T06:26:40.331262+0000","last_unstale":"2024-09-10T06:28:48.460978+0000","last_undegraded":"2024-09-10T06:28:48.460978+0000","last_fullsized":"2024-09-10T06:28:48.460978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377579+0000","last_change":"2024-09-10T06:26:32.262320+0000","last_active":"2024-09-10T06:28:48.377579+0000","last_peered":"2024-09-10T06:28:48.377579+0000","last_clean":"2024-09-10T06:28:48.377579+0000","last_became_active":"2024-09-10T06:26:32.261423+0000","last_became_peered":"2024-09-10T06:26:32.261423+0000","last_unstale":"2024-09-10T06:28:48.377579+0000","last_undegraded":"2024-09-10T06:28:48.377579+0000","last_fullsized":"2024-09-10T06:28:48.377579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"76'13","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464559+0000","last_change":"2024-09-10T06:26:30.595879+0000","last_active":"2024-09-10T06:28:48.464559+0000","last_peered":"2024-09-10T06:28:48.464559+0000","last_clean":"2024-09-10T06:28:48.464559+0000","last_became_active":"2024-09-10T06:26:30.595269+0000","last_became_peered":"2024-09-10T06:26:30.595269+0000","last_unstale":"2024-09-10T06:28:48.464559+0000","last_undegraded":"2024-09-10T06:28:48.464559+0000","last_fullsized":"2024-09-10T06:28:48.464559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453028+0000","last_change":"2024-09-10T06:26:34.266906+0000","last_active":"2024-09-10T06:28:48.453028+0000","last_peered":"2024-09-10T06:28:48.453028+0000","last_clean":"2024-09-10T06:28:48.453028+0000","last_became_active":"2024-09-10T06:26:34.266017+0000","last_became_peered":"2024-09-10T06:26:34.266017+0000","last_unstale":"2024-09-10T06:28:48.453028+0000","last_undegraded":"2024-09-10T06:28:48.453028+0000","last_fullsized":"2024-09-10T06:28:48.453028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:24.366166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"76'16","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378015+0000","last_change":"2024-09-10T06:26:36.297020+0000","last_active":"2024-09-10T06:28:48.378015+0000","last_peered":"2024-09-10T06:28:48.378015+0000","last_clean":"2024-09-10T06:28:48.378015+0000","last_became_active":"2024-09-10T06:26:36.295796+0000","last_became_peered":"2024-09-10T06:26:36.295796+0000","last_unstale":"2024-09-10T06:28:48.378015+0000","last_undegraded":"2024-09-10T06:28:48.378015+0000","last_fullsized":"2024-09-10T06:28:48.378015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375244+0000","last_change":"2024-09-10T06:26:38.297273+0000","last_active":"2024-09-10T06:28:48.375244+0000","last_peered":"2024-09-10T06:28:48.375244+0000","last_clean":"2024-09-10T06:28:48.375244+0000","last_became_active":"2024-09-10T06:26:38.296455+0000","last_became_peered":"2024-09-10T06:26:38.296455+0000","last_unstale":"2024-09-10T06:28:48.375244+0000","last_undegraded":"2024-09-10T06:28:48.375244+0000","last_fullsized":"2024-09-10T06:28:48.375244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:26.766702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458102+0000","last_change":"2024-09-10T06:26:40.328294+0000","last_active":"2024-09-10T06:28:48.458102+0000","last_peered":"2024-09-10T06:28:48.458102+0000","last_clean":"2024-09-10T06:28:48.458102+0000","last_became_active":"2024-09-10T06:26:40.327585+0000","last_became_peered":"2024-09-10T06:26:40.327585+0000","last_unstale":"2024-09-10T06:28:48.458102+0000","last_undegraded":"2024-09-10T06:28:48.458102+0000","last_fullsized":"2024-09-10T06:28:48.458102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.537210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458888+0000","last_change":"2024-09-10T06:27:08.600683+0000","last_active":"2024-09-10T06:28:48.458888+0000","last_peered":"2024-09-10T06:28:48.458888+0000","last_clean":"2024-09-10T06:28:48.458888+0000","last_became_active":"2024-09-10T06:27:08.599875+0000","last_became_peered":"2024-09-10T06:27:08.599875+0000","last_unstale":"2024-09-10T06:28:48.458888+0000","last_undegraded":"2024-09-10T06:28:48.458888+0000","last_fullsized":"2024-09-10T06:28:48.458888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:59.605814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464013+0000","last_change":"2024-09-10T06:26:30.611704+0000","last_active":"2024-09-10T06:28:48.464013+0000","last_peered":"2024-09-10T06:28:48.464013+0000","last_clean":"2024-09-10T06:28:48.464013+0000","last_became_active":"2024-09-10T06:26:30.611039+0000","last_became_peered":"2024-09-10T06:26:30.611039+0000","last_unstale":"2024-09-10T06:28:48.464013+0000","last_undegraded":"2024-09-10T06:28:48.464013+0000","last_fullsized":"2024-09-10T06:28:48.464013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455026+0000","last_change":"2024-09-10T06:26:34.263514+0000","last_active":"2024-09-10T06:28:48.455026+0000","last_peered":"2024-09-10T06:28:48.455026+0000","last_clean":"2024-09-10T06:28:48.455026+0000","last_became_active":"2024-09-10T06:26:34.262793+0000","last_became_peered":"2024-09-10T06:26:34.262793+0000","last_unstale":"2024-09-10T06:28:48.455026+0000","last_undegraded":"2024-09-10T06:28:48.455026+0000","last_fullsized":"2024-09-10T06:28:48.455026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:31.501738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"76'22","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455616+0000","last_change":"2024-09-10T06:26:36.299923+0000","last_active":"2024-09-10T06:28:48.455616+0000","last_peered":"2024-09-10T06:28:48.455616+0000","last_clean":"2024-09-10T06:28:48.455616+0000","last_became_active":"2024-09-10T06:26:36.299140+0000","last_became_peered":"2024-09-10T06:26:36.299140+0000","last_unstale":"2024-09-10T06:28:48.455616+0000","last_undegraded":"2024-09-10T06:28:48.455616+0000","last_fullsized":"2024-09-10T06:28:48.455616+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:12.246303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'102","reported_seq":267,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:50.610563+0000","last_change":"2024-09-10T06:26:38.292019+0000","last_active":"2024-09-10T06:28:50.610563+0000","last_peered":"2024-09-10T06:28:50.610563+0000","last_clean":"2024-09-10T06:28:50.610563+0000","last_became_active":"2024-09-10T06:26:38.291322+0000","last_became_peered":"2024-09-10T06:26:38.291322+0000","last_unstale":"2024-09-10T06:28:50.610563+0000","last_undegraded":"2024-09-10T06:28:50.610563+0000","last_fullsized":"2024-09-10T06:28:50.610563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"64'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378724+0000","last_change":"2024-09-10T06:26:40.328427+0000","last_active":"2024-09-10T06:28:48.378724+0000","last_peered":"2024-09-10T06:28:48.378724+0000","last_clean":"2024-09-10T06:28:48.378724+0000","last_became_active":"2024-09-10T06:26:40.323249+0000","last_became_peered":"2024-09-10T06:26:40.323249+0000","last_unstale":"2024-09-10T06:28:48.378724+0000","last_undegraded":"2024-09-10T06:28:48.378724+0000","last_fullsized":"2024-09-10T06:28:48.378724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:50.823195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377190+0000","last_change":"2024-09-10T06:26:32.274824+0000","last_active":"2024-09-10T06:28:48.377190+0000","last_peered":"2024-09-10T06:28:48.377190+0000","last_clean":"2024-09-10T06:28:48.377190+0000","last_became_active":"2024-09-10T06:26:32.274496+0000","last_became_peered":"2024-09-10T06:26:32.274496+0000","last_unstale":"2024-09-10T06:28:48.377190+0000","last_undegraded":"2024-09-10T06:28:48.377190+0000","last_fullsized":"2024-09-10T06:28:48.377190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:39.513476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"73'7","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462108+0000","last_change":"2024-09-10T06:26:30.604684+0000","last_active":"2024-09-10T06:28:48.462108+0000","last_peered":"2024-09-10T06:28:48.462108+0000","last_clean":"2024-09-10T06:28:48.462108+0000","last_became_active":"2024-09-10T06:26:30.593432+0000","last_became_peered":"2024-09-10T06:26:30.593432+0000","last_unstale":"2024-09-10T06:28:48.462108+0000","last_undegraded":"2024-09-10T06:28:48.462108+0000","last_fullsized":"2024-09-10T06:28:48.462108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454621+0000","last_change":"2024-09-10T06:26:34.256662+0000","last_active":"2024-09-10T06:28:48.454621+0000","last_peered":"2024-09-10T06:28:48.454621+0000","last_clean":"2024-09-10T06:28:48.454621+0000","last_became_active":"2024-09-10T06:26:34.256256+0000","last_became_peered":"2024-09-10T06:26:34.256256+0000","last_unstale":"2024-09-10T06:28:48.454621+0000","last_undegraded":"2024-09-10T06:28:48.454621+0000","last_fullsized":"2024-09-10T06:28:48.454621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:35.549063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"76'26","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375816+0000","last_change":"2024-09-10T06:26:36.296631+0000","last_active":"2024-09-10T06:28:48.375816+0000","last_peered":"2024-09-10T06:28:48.375816+0000","last_clean":"2024-09-10T06:28:48.375816+0000","last_became_active":"2024-09-10T06:26:36.295838+0000","last_became_peered":"2024-09-10T06:26:36.295838+0000","last_unstale":"2024-09-10T06:28:48.375816+0000","last_undegraded":"2024-09-10T06:28:48.375816+0000","last_fullsized":"2024-09-10T06:28:48.375816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:04.271824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9809,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452870+0000","last_change":"2024-09-10T06:26:38.308698+0000","last_active":"2024-09-10T06:28:48.452870+0000","last_peered":"2024-09-10T06:28:48.452870+0000","last_clean":"2024-09-10T06:28:48.452870+0000","last_became_active":"2024-09-10T06:26:38.307965+0000","last_became_peered":"2024-09-10T06:26:38.307965+0000","last_unstale":"2024-09-10T06:28:48.452870+0000","last_undegraded":"2024-09-10T06:28:48.452870+0000","last_fullsized":"2024-09-10T06:28:48.452870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:04.566221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"62'4","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454102+0000","last_change":"2024-09-10T06:26:40.326474+0000","last_active":"2024-09-10T06:28:48.454102+0000","last_peered":"2024-09-10T06:28:48.454102+0000","last_clean":"2024-09-10T06:28:48.454102+0000","last_became_active":"2024-09-10T06:26:40.325731+0000","last_became_peered":"2024-09-10T06:26:40.325731+0000","last_unstale":"2024-09-10T06:28:48.454102+0000","last_undegraded":"2024-09-10T06:28:48.454102+0000","last_fullsized":"2024-09-10T06:28:48.454102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:19.400355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"64'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380025+0000","last_change":"2024-09-10T06:26:32.254177+0000","last_active":"2024-09-10T06:28:48.380025+0000","last_peered":"2024-09-10T06:28:48.380025+0000","last_clean":"2024-09-10T06:28:48.380025+0000","last_became_active":"2024-09-10T06:26:32.253154+0000","last_became_peered":"2024-09-10T06:26:32.253154+0000","last_unstale":"2024-09-10T06:28:48.380025+0000","last_undegraded":"2024-09-10T06:28:48.380025+0000","last_fullsized":"2024-09-10T06:28:48.380025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"72'5","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375194+0000","last_change":"2024-09-10T06:26:30.572406+0000","last_active":"2024-09-10T06:28:48.375194+0000","last_peered":"2024-09-10T06:28:48.375194+0000","last_clean":"2024-09-10T06:28:48.375194+0000","last_became_active":"2024-09-10T06:26:30.571829+0000","last_became_peered":"2024-09-10T06:26:30.571829+0000","last_unstale":"2024-09-10T06:28:48.375194+0000","last_undegraded":"2024-09-10T06:28:48.375194+0000","last_fullsized":"2024-09-10T06:28:48.375194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455283+0000","last_change":"2024-09-10T06:26:34.285406+0000","last_active":"2024-09-10T06:28:48.455283+0000","last_peered":"2024-09-10T06:28:48.455283+0000","last_clean":"2024-09-10T06:28:48.455283+0000","last_became_active":"2024-09-10T06:26:34.285004+0000","last_became_peered":"2024-09-10T06:26:34.285004+0000","last_unstale":"2024-09-10T06:28:48.455283+0000","last_undegraded":"2024-09-10T06:28:48.455283+0000","last_fullsized":"2024-09-10T06:28:48.455283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:03.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"87'21","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379938+0000","last_change":"2024-09-10T06:26:36.293191+0000","last_active":"2024-09-10T06:28:48.379938+0000","last_peered":"2024-09-10T06:28:48.379938+0000","last_clean":"2024-09-10T06:28:48.379938+0000","last_became_active":"2024-09-10T06:26:36.292423+0000","last_became_peered":"2024-09-10T06:26:36.292423+0000","last_unstale":"2024-09-10T06:28:48.379938+0000","last_undegraded":"2024-09-10T06:28:48.379938+0000","last_fullsized":"2024-09-10T06:28:48.379938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":28,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378126+0000","last_change":"2024-09-10T06:26:38.293667+0000","last_active":"2024-09-10T06:28:48.378126+0000","last_peered":"2024-09-10T06:28:48.378126+0000","last_clean":"2024-09-10T06:28:48.378126+0000","last_became_active":"2024-09-10T06:26:38.292918+0000","last_became_peered":"2024-09-10T06:26:38.292918+0000","last_unstale":"2024-09-10T06:28:48.378126+0000","last_undegraded":"2024-09-10T06:28:48.378126+0000","last_fullsized":"2024-09-10T06:28:48.378126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:57.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376446+0000","last_change":"2024-09-10T06:26:40.327061+0000","last_active":"2024-09-10T06:28:48.376446+0000","last_peered":"2024-09-10T06:28:48.376446+0000","last_clean":"2024-09-10T06:28:48.376446+0000","last_became_active":"2024-09-10T06:26:40.326431+0000","last_became_peered":"2024-09-10T06:26:40.326431+0000","last_unstale":"2024-09-10T06:28:48.376446+0000","last_undegraded":"2024-09-10T06:28:48.376446+0000","last_fullsized":"2024-09-10T06:28:48.376446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:27.631214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"64'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380722+0000","last_change":"2024-09-10T06:26:32.255139+0000","last_active":"2024-09-10T06:28:48.380722+0000","last_peered":"2024-09-10T06:28:48.380722+0000","last_clean":"2024-09-10T06:28:48.380722+0000","last_became_active":"2024-09-10T06:26:32.253524+0000","last_became_peered":"2024-09-10T06:26:32.253524+0000","last_unstale":"2024-09-10T06:28:48.380722+0000","last_undegraded":"2024-09-10T06:28:48.380722+0000","last_fullsized":"2024-09-10T06:28:48.380722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"73'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459281+0000","last_change":"2024-09-10T06:26:30.591838+0000","last_active":"2024-09-10T06:28:48.459281+0000","last_peered":"2024-09-10T06:28:48.459281+0000","last_clean":"2024-09-10T06:28:48.459281+0000","last_became_active":"2024-09-10T06:26:30.591125+0000","last_became_peered":"2024-09-10T06:26:30.591125+0000","last_unstale":"2024-09-10T06:28:48.459281+0000","last_undegraded":"2024-09-10T06:28:48.459281+0000","last_fullsized":"2024-09-10T06:28:48.459281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453621+0000","last_change":"2024-09-10T06:26:34.280391+0000","last_active":"2024-09-10T06:28:48.453621+0000","last_peered":"2024-09-10T06:28:48.453621+0000","last_clean":"2024-09-10T06:28:48.453621+0000","last_became_active":"2024-09-10T06:26:34.280058+0000","last_became_peered":"2024-09-10T06:26:34.280058+0000","last_unstale":"2024-09-10T06:28:48.453621+0000","last_undegraded":"2024-09-10T06:28:48.453621+0000","last_fullsized":"2024-09-10T06:28:48.453621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.461857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"76'23","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456011+0000","last_change":"2024-09-10T06:26:36.277547+0000","last_active":"2024-09-10T06:28:48.456011+0000","last_peered":"2024-09-10T06:28:48.456011+0000","last_clean":"2024-09-10T06:28:48.456011+0000","last_became_active":"2024-09-10T06:26:36.276965+0000","last_became_peered":"2024-09-10T06:26:36.276965+0000","last_unstale":"2024-09-10T06:28:48.456011+0000","last_undegraded":"2024-09-10T06:28:48.456011+0000","last_fullsized":"2024-09-10T06:28:48.456011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:43.212945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":20,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'102","reported_seq":298,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:52.691656+0000","last_change":"2024-09-10T06:26:38.306134+0000","last_active":"2024-09-10T06:28:52.691656+0000","last_peered":"2024-09-10T06:28:52.691656+0000","last_clean":"2024-09-10T06:28:52.691656+0000","last_became_active":"2024-09-10T06:26:38.299012+0000","last_became_peered":"2024-09-10T06:26:38.299012+0000","last_unstale":"2024-09-10T06:28:52.691656+0000","last_undegraded":"2024-09-10T06:28:52.691656+0000","last_fullsized":"2024-09-10T06:28:52.691656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:37.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"61'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454114+0000","last_change":"2024-09-10T06:26:40.336036+0000","last_active":"2024-09-10T06:28:48.454114+0000","last_peered":"2024-09-10T06:28:48.454114+0000","last_clean":"2024-09-10T06:28:48.454114+0000","last_became_active":"2024-09-10T06:26:40.335302+0000","last_became_peered":"2024-09-10T06:26:40.335302+0000","last_unstale":"2024-09-10T06:28:48.454114+0000","last_undegraded":"2024-09-10T06:28:48.454114+0000","last_fullsized":"2024-09-10T06:28:48.454114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:24.024562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380676+0000","last_change":"2024-09-10T06:26:32.287897+0000","last_active":"2024-09-10T06:28:48.380676+0000","last_peered":"2024-09-10T06:28:48.380676+0000","last_clean":"2024-09-10T06:28:48.380676+0000","last_became_active":"2024-09-10T06:26:32.287315+0000","last_became_peered":"2024-09-10T06:26:32.287315+0000","last_unstale":"2024-09-10T06:28:48.380676+0000","last_undegraded":"2024-09-10T06:28:48.380676+0000","last_fullsized":"2024-09-10T06:28:48.380676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"73'7","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378593+0000","last_change":"2024-09-10T06:26:30.569192+0000","last_active":"2024-09-10T06:28:48.378593+0000","last_peered":"2024-09-10T06:28:48.378593+0000","last_clean":"2024-09-10T06:28:48.378593+0000","last_became_active":"2024-09-10T06:26:30.568464+0000","last_became_peered":"2024-09-10T06:26:30.568464+0000","last_unstale":"2024-09-10T06:28:48.378593+0000","last_undegraded":"2024-09-10T06:28:48.378593+0000","last_fullsized":"2024-09-10T06:28:48.378593+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:58.987914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":280,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459913+0000","last_change":"2024-09-10T06:26:34.279935+0000","last_active":"2024-09-10T06:28:48.459913+0000","last_peered":"2024-09-10T06:28:48.459913+0000","last_clean":"2024-09-10T06:28:48.459913+0000","last_became_active":"2024-09-10T06:26:34.279192+0000","last_became_peered":"2024-09-10T06:26:34.279192+0000","last_unstale":"2024-09-10T06:28:48.459913+0000","last_undegraded":"2024-09-10T06:28:48.459913+0000","last_fullsized":"2024-09-10T06:28:48.459913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:18.753175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377130+0000","last_change":"2024-09-10T06:26:36.290330+0000","last_active":"2024-09-10T06:28:48.377130+0000","last_peered":"2024-09-10T06:28:48.377130+0000","last_clean":"2024-09-10T06:28:48.377130+0000","last_became_active":"2024-09-10T06:26:36.289527+0000","last_became_peered":"2024-09-10T06:26:36.289527+0000","last_unstale":"2024-09-10T06:28:48.377130+0000","last_undegraded":"2024-09-10T06:28:48.377130+0000","last_fullsized":"2024-09-10T06:28:48.377130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'102","reported_seq":310,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:52.694787+0000","last_change":"2024-09-10T06:26:38.288663+0000","last_active":"2024-09-10T06:28:52.694787+0000","last_peered":"2024-09-10T06:28:52.694787+0000","last_clean":"2024-09-10T06:28:52.694787+0000","last_became_active":"2024-09-10T06:26:38.287740+0000","last_became_peered":"2024-09-10T06:26:38.287740+0000","last_unstale":"2024-09-10T06:28:52.694787+0000","last_undegraded":"2024-09-10T06:28:52.694787+0000","last_fullsized":"2024-09-10T06:28:52.694787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:22.078943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'8","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377335+0000","last_change":"2024-09-10T06:26:40.329737+0000","last_active":"2024-09-10T06:28:48.377335+0000","last_peered":"2024-09-10T06:28:48.377335+0000","last_clean":"2024-09-10T06:28:48.377335+0000","last_became_active":"2024-09-10T06:26:40.328952+0000","last_became_peered":"2024-09-10T06:26:40.328952+0000","last_unstale":"2024-09-10T06:28:48.377335+0000","last_undegraded":"2024-09-10T06:28:48.377335+0000","last_fullsized":"2024-09-10T06:28:48.377335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454598+0000","last_change":"2024-09-10T06:26:32.270997+0000","last_active":"2024-09-10T06:28:48.454598+0000","last_peered":"2024-09-10T06:28:48.454598+0000","last_clean":"2024-09-10T06:28:48.454598+0000","last_became_active":"2024-09-10T06:26:32.270265+0000","last_became_peered":"2024-09-10T06:26:32.270265+0000","last_unstale":"2024-09-10T06:28:48.454598+0000","last_undegraded":"2024-09-10T06:28:48.454598+0000","last_fullsized":"2024-09-10T06:28:48.454598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:33.067523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"73'11","reported_seq":127,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452795+0000","last_change":"2024-09-10T06:27:08.593158+0000","last_active":"2024-09-10T06:28:48.452795+0000","last_peered":"2024-09-10T06:28:48.452795+0000","last_clean":"2024-09-10T06:28:48.452795+0000","last_became_active":"2024-09-10T06:27:08.592864+0000","last_became_peered":"2024-09-10T06:27:08.592864+0000","last_unstale":"2024-09-10T06:28:48.452795+0000","last_undegraded":"2024-09-10T06:28:48.452795+0000","last_fullsized":"2024-09-10T06:28:48.452795+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:35.185591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380176+0000","last_change":"2024-09-10T06:26:34.286497+0000","last_active":"2024-09-10T06:28:48.380176+0000","last_peered":"2024-09-10T06:28:48.380176+0000","last_clean":"2024-09-10T06:28:48.380176+0000","last_became_active":"2024-09-10T06:26:34.285334+0000","last_became_peered":"2024-09-10T06:26:34.285334+0000","last_unstale":"2024-09-10T06:28:48.380176+0000","last_undegraded":"2024-09-10T06:28:48.380176+0000","last_fullsized":"2024-09-10T06:28:48.380176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:54.506182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"76'23","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459007+0000","last_change":"2024-09-10T06:26:36.288213+0000","last_active":"2024-09-10T06:28:48.459007+0000","last_peered":"2024-09-10T06:28:48.459007+0000","last_clean":"2024-09-10T06:28:48.459007+0000","last_became_active":"2024-09-10T06:26:36.287468+0000","last_became_peered":"2024-09-10T06:26:36.287468+0000","last_unstale":"2024-09-10T06:28:48.459007+0000","last_undegraded":"2024-09-10T06:28:48.459007+0000","last_fullsized":"2024-09-10T06:28:48.459007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457697+0000","last_change":"2024-09-10T06:26:38.291943+0000","last_active":"2024-09-10T06:28:48.457697+0000","last_peered":"2024-09-10T06:28:48.457697+0000","last_clean":"2024-09-10T06:28:48.457697+0000","last_became_active":"2024-09-10T06:26:38.291214+0000","last_became_peered":"2024-09-10T06:26:38.291214+0000","last_unstale":"2024-09-10T06:28:48.457697+0000","last_undegraded":"2024-09-10T06:28:48.457697+0000","last_fullsized":"2024-09-10T06:28:48.457697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:56.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"67'4","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453374+0000","last_change":"2024-09-10T06:26:40.331977+0000","last_active":"2024-09-10T06:28:48.453374+0000","last_peered":"2024-09-10T06:28:48.453374+0000","last_clean":"2024-09-10T06:28:48.453374+0000","last_became_active":"2024-09-10T06:26:40.331502+0000","last_became_peered":"2024-09-10T06:26:40.331502+0000","last_unstale":"2024-09-10T06:28:48.453374+0000","last_undegraded":"2024-09-10T06:28:48.453374+0000","last_fullsized":"2024-09-10T06:28:48.453374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:43.572813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460459+0000","last_change":"2024-09-10T06:26:32.274623+0000","last_active":"2024-09-10T06:28:48.460459+0000","last_peered":"2024-09-10T06:28:48.460459+0000","last_clean":"2024-09-10T06:28:48.460459+0000","last_became_active":"2024-09-10T06:26:32.273727+0000","last_became_peered":"2024-09-10T06:26:32.273727+0000","last_unstale":"2024-09-10T06:28:48.460459+0000","last_undegraded":"2024-09-10T06:28:48.460459+0000","last_fullsized":"2024-09-10T06:28:48.460459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:15.364938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":258,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455693+0000","last_change":"2024-09-10T06:26:18.153206+0000","last_active":"2024-09-10T06:28:48.455693+0000","last_peered":"2024-09-10T06:28:48.455693+0000","last_clean":"2024-09-10T06:28:48.455693+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:28:48.455693+0000","last_undegraded":"2024-09-10T06:28:48.455693+0000","last_fullsized":"2024-09-10T06:28:48.455693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_clean_scrub_stamp":"2024-09-10T06:26:16.422775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:42.510577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460195+0000","last_change":"2024-09-10T06:26:25.532465+0000","last_active":"2024-09-10T06:28:48.460195+0000","last_peered":"2024-09-10T06:28:48.460195+0000","last_clean":"2024-09-10T06:28:48.460195+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:28:48.460195+0000","last_undegraded":"2024-09-10T06:28:48.460195+0000","last_fullsized":"2024-09-10T06:28:48.460195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:10.318844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"73'9","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375960+0000","last_change":"2024-09-10T06:26:30.606630+0000","last_active":"2024-09-10T06:28:48.375960+0000","last_peered":"2024-09-10T06:28:48.375960+0000","last_clean":"2024-09-10T06:28:48.375960+0000","last_became_active":"2024-09-10T06:26:30.606348+0000","last_became_peered":"2024-09-10T06:26:30.606348+0000","last_unstale":"2024-09-10T06:28:48.375960+0000","last_undegraded":"2024-09-10T06:28:48.375960+0000","last_fullsized":"2024-09-10T06:28:48.375960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462936+0000","last_change":"2024-09-10T06:26:34.287201+0000","last_active":"2024-09-10T06:28:48.462936+0000","last_peered":"2024-09-10T06:28:48.462936+0000","last_clean":"2024-09-10T06:28:48.462936+0000","last_became_active":"2024-09-10T06:26:34.285248+0000","last_became_peered":"2024-09-10T06:26:34.285248+0000","last_unstale":"2024-09-10T06:28:48.462936+0000","last_undegraded":"2024-09-10T06:28:48.462936+0000","last_fullsized":"2024-09-10T06:28:48.462936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:43.907684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"76'32","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460159+0000","last_change":"2024-09-10T06:26:36.296684+0000","last_active":"2024-09-10T06:28:48.460159+0000","last_peered":"2024-09-10T06:28:48.460159+0000","last_clean":"2024-09-10T06:28:48.460159+0000","last_became_active":"2024-09-10T06:26:36.295901+0000","last_became_peered":"2024-09-10T06:26:36.295901+0000","last_unstale":"2024-09-10T06:28:48.460159+0000","last_undegraded":"2024-09-10T06:28:48.460159+0000","last_fullsized":"2024-09-10T06:28:48.460159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61969,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378965+0000","last_change":"2024-09-10T06:26:38.306412+0000","last_active":"2024-09-10T06:28:48.378965+0000","last_peered":"2024-09-10T06:28:48.378965+0000","last_clean":"2024-09-10T06:28:48.378965+0000","last_became_active":"2024-09-10T06:26:38.305496+0000","last_became_peered":"2024-09-10T06:26:38.305496+0000","last_unstale":"2024-09-10T06:28:48.378965+0000","last_undegraded":"2024-09-10T06:28:48.378965+0000","last_fullsized":"2024-09-10T06:28:48.378965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.370035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"64'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456581+0000","last_change":"2024-09-10T06:26:40.331981+0000","last_active":"2024-09-10T06:28:48.456581+0000","last_peered":"2024-09-10T06:28:48.456581+0000","last_clean":"2024-09-10T06:28:48.456581+0000","last_became_active":"2024-09-10T06:26:40.331294+0000","last_became_peered":"2024-09-10T06:26:40.331294+0000","last_unstale":"2024-09-10T06:28:48.456581+0000","last_undegraded":"2024-09-10T06:28:48.456581+0000","last_fullsized":"2024-09-10T06:28:48.456581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:00.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379255+0000","last_change":"2024-09-10T06:26:32.278733+0000","last_active":"2024-09-10T06:28:48.379255+0000","last_peered":"2024-09-10T06:28:48.379255+0000","last_clean":"2024-09-10T06:28:48.379255+0000","last_became_active":"2024-09-10T06:26:32.278118+0000","last_became_peered":"2024-09-10T06:26:32.278118+0000","last_unstale":"2024-09-10T06:28:48.379255+0000","last_undegraded":"2024-09-10T06:28:48.379255+0000","last_fullsized":"2024-09-10T06:28:48.379255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:58.860666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455540+0000","last_change":"2024-09-10T06:26:26.180664+0000","last_active":"2024-09-10T06:28:48.455540+0000","last_peered":"2024-09-10T06:28:48.455540+0000","last_clean":"2024-09-10T06:28:48.455540+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:28:48.455540+0000","last_undegraded":"2024-09-10T06:28:48.455540+0000","last_fullsized":"2024-09-10T06:28:48.455540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:28.793045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"73'11","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375865+0000","last_change":"2024-09-10T06:26:30.594315+0000","last_active":"2024-09-10T06:28:48.375865+0000","last_peered":"2024-09-10T06:28:48.375865+0000","last_clean":"2024-09-10T06:28:48.375865+0000","last_became_active":"2024-09-10T06:26:30.593978+0000","last_became_peered":"2024-09-10T06:26:30.593978+0000","last_unstale":"2024-09-10T06:28:48.375865+0000","last_undegraded":"2024-09-10T06:28:48.375865+0000","last_fullsized":"2024-09-10T06:28:48.375865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:41.851632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460472+0000","last_change":"2024-09-10T06:26:34.279889+0000","last_active":"2024-09-10T06:28:48.460472+0000","last_peered":"2024-09-10T06:28:48.460472+0000","last_clean":"2024-09-10T06:28:48.460472+0000","last_became_active":"2024-09-10T06:26:34.279147+0000","last_became_peered":"2024-09-10T06:26:34.279147+0000","last_unstale":"2024-09-10T06:28:48.460472+0000","last_undegraded":"2024-09-10T06:28:48.460472+0000","last_fullsized":"2024-09-10T06:28:48.460472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:02.260309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'108","reported_seq":327,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.463494+0000","last_change":"2024-09-10T06:26:36.290005+0000","last_active":"2024-09-10T06:28:49.463494+0000","last_peered":"2024-09-10T06:28:49.463494+0000","last_clean":"2024-09-10T06:28:49.463494+0000","last_became_active":"2024-09-10T06:26:36.289232+0000","last_became_peered":"2024-09-10T06:26:36.289232+0000","last_unstale":"2024-09-10T06:28:49.463494+0000","last_undegraded":"2024-09-10T06:28:49.463494+0000","last_fullsized":"2024-09-10T06:28:49.463494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:51.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":141,"num_read_kb":126,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463283+0000","last_change":"2024-09-10T06:26:38.302505+0000","last_active":"2024-09-10T06:28:48.463283+0000","last_peered":"2024-09-10T06:28:48.463283+0000","last_clean":"2024-09-10T06:28:48.463283+0000","last_became_active":"2024-09-10T06:26:38.301104+0000","last_became_peered":"2024-09-10T06:26:38.301104+0000","last_unstale":"2024-09-10T06:28:48.463283+0000","last_undegraded":"2024-09-10T06:28:48.463283+0000","last_fullsized":"2024-09-10T06:28:48.463283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.863622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"76'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453152+0000","last_change":"2024-09-10T06:26:40.320079+0000","last_active":"2024-09-10T06:28:48.453152+0000","last_peered":"2024-09-10T06:28:48.453152+0000","last_clean":"2024-09-10T06:28:48.453152+0000","last_became_active":"2024-09-10T06:26:40.319266+0000","last_became_peered":"2024-09-10T06:26:40.319266+0000","last_unstale":"2024-09-10T06:28:48.453152+0000","last_undegraded":"2024-09-10T06:28:48.453152+0000","last_fullsized":"2024-09-10T06:28:48.453152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:57.937745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"76'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454407+0000","last_change":"2024-09-10T06:26:32.282679+0000","last_active":"2024-09-10T06:28:48.454407+0000","last_peered":"2024-09-10T06:28:48.454407+0000","last_clean":"2024-09-10T06:28:48.454407+0000","last_became_active":"2024-09-10T06:26:32.282235+0000","last_became_peered":"2024-09-10T06:26:32.282235+0000","last_unstale":"2024-09-10T06:28:48.454407+0000","last_undegraded":"2024-09-10T06:28:48.454407+0000","last_fullsized":"2024-09-10T06:28:48.454407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:27.994318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454483+0000","last_change":"2024-09-10T06:26:25.979784+0000","last_active":"2024-09-10T06:28:48.454483+0000","last_peered":"2024-09-10T06:28:48.454483+0000","last_clean":"2024-09-10T06:28:48.454483+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:28:48.454483+0000","last_undegraded":"2024-09-10T06:28:48.454483+0000","last_fullsized":"2024-09-10T06:28:48.454483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:42.490682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"65'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453191+0000","last_change":"2024-09-10T06:26:30.570558+0000","last_active":"2024-09-10T06:28:48.453191+0000","last_peered":"2024-09-10T06:28:48.453191+0000","last_clean":"2024-09-10T06:28:48.453191+0000","last_became_active":"2024-09-10T06:26:30.570037+0000","last_became_peered":"2024-09-10T06:26:30.570037+0000","last_unstale":"2024-09-10T06:28:48.453191+0000","last_undegraded":"2024-09-10T06:28:48.453191+0000","last_fullsized":"2024-09-10T06:28:48.453191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:46.692143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455347+0000","last_change":"2024-09-10T06:26:34.284394+0000","last_active":"2024-09-10T06:28:48.455347+0000","last_peered":"2024-09-10T06:28:48.455347+0000","last_clean":"2024-09-10T06:28:48.455347+0000","last_became_active":"2024-09-10T06:26:34.283980+0000","last_became_peered":"2024-09-10T06:26:34.283980+0000","last_unstale":"2024-09-10T06:28:48.455347+0000","last_undegraded":"2024-09-10T06:28:48.455347+0000","last_fullsized":"2024-09-10T06:28:48.455347+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:38.061123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'19","reported_seq":241,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.467565+0000","last_change":"2024-09-10T06:28:47.073398+0000","last_active":"2024-09-10T06:28:49.467565+0000","last_peered":"2024-09-10T06:28:49.467565+0000","last_clean":"2024-09-10T06:28:49.467565+0000","last_became_active":"2024-09-10T06:28:46.327631+0000","last_became_peered":"2024-09-10T06:28:46.327631+0000","last_unstale":"2024-09-10T06:28:49.467565+0000","last_undegraded":"2024-09-10T06:28:49.467565+0000","last_fullsized":"2024-09-10T06:28:49.467565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:25.802510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375982+0000","last_change":"2024-09-10T06:26:38.292411+0000","last_active":"2024-09-10T06:28:48.375982+0000","last_peered":"2024-09-10T06:28:48.375982+0000","last_clean":"2024-09-10T06:28:48.375982+0000","last_became_active":"2024-09-10T06:26:38.291623+0000","last_became_peered":"2024-09-10T06:26:38.291623+0000","last_unstale":"2024-09-10T06:28:48.375982+0000","last_undegraded":"2024-09-10T06:28:48.375982+0000","last_fullsized":"2024-09-10T06:28:48.375982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377385+0000","last_change":"2024-09-10T06:26:40.303598+0000","last_active":"2024-09-10T06:28:48.377385+0000","last_peered":"2024-09-10T06:28:48.377385+0000","last_clean":"2024-09-10T06:28:48.377385+0000","last_became_active":"2024-09-10T06:26:40.302898+0000","last_became_peered":"2024-09-10T06:26:40.302898+0000","last_unstale":"2024-09-10T06:28:48.377385+0000","last_undegraded":"2024-09-10T06:28:48.377385+0000","last_fullsized":"2024-09-10T06:28:48.377385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:49.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"76'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453765+0000","last_change":"2024-09-10T06:26:32.273484+0000","last_active":"2024-09-10T06:28:48.453765+0000","last_peered":"2024-09-10T06:28:48.453765+0000","last_clean":"2024-09-10T06:28:48.453765+0000","last_became_active":"2024-09-10T06:26:32.273183+0000","last_became_peered":"2024-09-10T06:26:32.273183+0000","last_unstale":"2024-09-10T06:28:48.453765+0000","last_undegraded":"2024-09-10T06:28:48.453765+0000","last_fullsized":"2024-09-10T06:28:48.453765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:32.410538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459095+0000","last_change":"2024-09-10T06:26:25.534289+0000","last_active":"2024-09-10T06:28:48.459095+0000","last_peered":"2024-09-10T06:28:48.459095+0000","last_clean":"2024-09-10T06:28:48.459095+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:28:48.459095+0000","last_undegraded":"2024-09-10T06:28:48.459095+0000","last_fullsized":"2024-09-10T06:28:48.459095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:11.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379406+0000","last_change":"2024-09-10T06:26:30.579693+0000","last_active":"2024-09-10T06:28:48.379406+0000","last_peered":"2024-09-10T06:28:48.379406+0000","last_clean":"2024-09-10T06:28:48.379406+0000","last_became_active":"2024-09-10T06:26:30.577934+0000","last_became_peered":"2024-09-10T06:26:30.577934+0000","last_unstale":"2024-09-10T06:28:48.379406+0000","last_undegraded":"2024-09-10T06:28:48.379406+0000","last_fullsized":"2024-09-10T06:28:48.379406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:35.852655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377724+0000","last_change":"2024-09-10T06:26:34.275458+0000","last_active":"2024-09-10T06:28:48.377724+0000","last_peered":"2024-09-10T06:28:48.377724+0000","last_clean":"2024-09-10T06:28:48.377724+0000","last_became_active":"2024-09-10T06:26:34.274705+0000","last_became_peered":"2024-09-10T06:26:34.274705+0000","last_unstale":"2024-09-10T06:28:48.377724+0000","last_undegraded":"2024-09-10T06:28:48.377724+0000","last_fullsized":"2024-09-10T06:28:48.377724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:20.624872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379364+0000","last_change":"2024-09-10T06:26:36.266077+0000","last_active":"2024-09-10T06:28:48.379364+0000","last_peered":"2024-09-10T06:28:48.379364+0000","last_clean":"2024-09-10T06:28:48.379364+0000","last_became_active":"2024-09-10T06:26:36.265322+0000","last_became_peered":"2024-09-10T06:26:36.265322+0000","last_unstale":"2024-09-10T06:28:48.379364+0000","last_undegraded":"2024-09-10T06:28:48.379364+0000","last_fullsized":"2024-09-10T06:28:48.379364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459162+0000","last_change":"2024-09-10T06:28:46.345843+0000","last_active":"2024-09-10T06:28:48.459162+0000","last_peered":"2024-09-10T06:28:48.459162+0000","last_clean":"2024-09-10T06:28:48.459162+0000","last_became_active":"2024-09-10T06:28:46.344951+0000","last_became_peered":"2024-09-10T06:28:46.344951+0000","last_unstale":"2024-09-10T06:28:48.459162+0000","last_undegraded":"2024-09-10T06:28:48.459162+0000","last_fullsized":"2024-09-10T06:28:48.459162+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:17.825354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"76'8","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456074+0000","last_change":"2024-09-10T06:26:40.326887+0000","last_active":"2024-09-10T06:28:48.456074+0000","last_peered":"2024-09-10T06:28:48.456074+0000","last_clean":"2024-09-10T06:28:48.456074+0000","last_became_active":"2024-09-10T06:26:40.326130+0000","last_became_peered":"2024-09-10T06:26:40.326130+0000","last_unstale":"2024-09-10T06:28:48.456074+0000","last_undegraded":"2024-09-10T06:28:48.456074+0000","last_fullsized":"2024-09-10T06:28:48.456074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:28.237428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'8","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453524+0000","last_change":"2024-09-10T06:26:32.282586+0000","last_active":"2024-09-10T06:28:48.453524+0000","last_peered":"2024-09-10T06:28:48.453524+0000","last_clean":"2024-09-10T06:28:48.453524+0000","last_became_active":"2024-09-10T06:26:32.282086+0000","last_became_peered":"2024-09-10T06:26:32.282086+0000","last_unstale":"2024-09-10T06:28:48.453524+0000","last_undegraded":"2024-09-10T06:28:48.453524+0000","last_fullsized":"2024-09-10T06:28:48.453524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:44.269917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"73'16","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459611+0000","last_change":"2024-09-10T06:26:30.591913+0000","last_active":"2024-09-10T06:28:48.459611+0000","last_peered":"2024-09-10T06:28:48.459611+0000","last_clean":"2024-09-10T06:28:48.459611+0000","last_became_active":"2024-09-10T06:26:30.591140+0000","last_became_peered":"2024-09-10T06:26:30.591140+0000","last_unstale":"2024-09-10T06:28:48.459611+0000","last_undegraded":"2024-09-10T06:28:48.459611+0000","last_fullsized":"2024-09-10T06:28:48.459611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454261+0000","last_change":"2024-09-10T06:26:25.537497+0000","last_active":"2024-09-10T06:28:48.454261+0000","last_peered":"2024-09-10T06:28:48.454261+0000","last_clean":"2024-09-10T06:28:48.454261+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:28:48.454261+0000","last_undegraded":"2024-09-10T06:28:48.454261+0000","last_fullsized":"2024-09-10T06:28:48.454261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:44.787852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376269+0000","last_change":"2024-09-10T06:26:34.276099+0000","last_active":"2024-09-10T06:28:48.376269+0000","last_peered":"2024-09-10T06:28:48.376269+0000","last_clean":"2024-09-10T06:28:48.376269+0000","last_became_active":"2024-09-10T06:26:34.273984+0000","last_became_peered":"2024-09-10T06:26:34.273984+0000","last_unstale":"2024-09-10T06:28:48.376269+0000","last_undegraded":"2024-09-10T06:28:48.376269+0000","last_fullsized":"2024-09-10T06:28:48.376269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"76'31","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375444+0000","last_change":"2024-09-10T06:26:36.272589+0000","last_active":"2024-09-10T06:28:48.375444+0000","last_peered":"2024-09-10T06:28:48.375444+0000","last_clean":"2024-09-10T06:28:48.375444+0000","last_became_active":"2024-09-10T06:26:36.270914+0000","last_became_peered":"2024-09-10T06:26:36.270914+0000","last_unstale":"2024-09-10T06:28:48.375444+0000","last_undegraded":"2024-09-10T06:28:48.375444+0000","last_fullsized":"2024-09-10T06:28:48.375444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:20.764690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61858,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":36,"num_read_kb":24,"num_write":22,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376397+0000","last_change":"2024-09-10T06:26:38.278069+0000","last_active":"2024-09-10T06:28:48.376397+0000","last_peered":"2024-09-10T06:28:48.376397+0000","last_clean":"2024-09-10T06:28:48.376397+0000","last_became_active":"2024-09-10T06:26:38.277261+0000","last_became_peered":"2024-09-10T06:26:38.277261+0000","last_unstale":"2024-09-10T06:28:48.376397+0000","last_undegraded":"2024-09-10T06:28:48.376397+0000","last_fullsized":"2024-09-10T06:28:48.376397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"67'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378048+0000","last_change":"2024-09-10T06:26:40.333741+0000","last_active":"2024-09-10T06:28:48.378048+0000","last_peered":"2024-09-10T06:28:48.378048+0000","last_clean":"2024-09-10T06:28:48.378048+0000","last_became_active":"2024-09-10T06:26:40.329701+0000","last_became_peered":"2024-09-10T06:26:40.329701+0000","last_unstale":"2024-09-10T06:28:48.378048+0000","last_undegraded":"2024-09-10T06:28:48.378048+0000","last_fullsized":"2024-09-10T06:28:48.378048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:53.704790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"67'4","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376410+0000","last_change":"2024-09-10T06:26:32.275551+0000","last_active":"2024-09-10T06:28:48.376410+0000","last_peered":"2024-09-10T06:28:48.376410+0000","last_clean":"2024-09-10T06:28:48.376410+0000","last_became_active":"2024-09-10T06:26:32.274946+0000","last_became_peered":"2024-09-10T06:26:32.274946+0000","last_unstale":"2024-09-10T06:28:48.376410+0000","last_undegraded":"2024-09-10T06:28:48.376410+0000","last_fullsized":"2024-09-10T06:28:48.376410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"73'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454016+0000","last_change":"2024-09-10T06:26:30.565595+0000","last_active":"2024-09-10T06:28:48.454016+0000","last_peered":"2024-09-10T06:28:48.454016+0000","last_clean":"2024-09-10T06:28:48.454016+0000","last_became_active":"2024-09-10T06:26:30.565220+0000","last_became_peered":"2024-09-10T06:26:30.565220+0000","last_unstale":"2024-09-10T06:28:48.454016+0000","last_undegraded":"2024-09-10T06:28:48.454016+0000","last_fullsized":"2024-09-10T06:28:48.454016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:14.600216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464321+0000","last_change":"2024-09-10T06:26:26.180820+0000","last_active":"2024-09-10T06:28:48.464321+0000","last_peered":"2024-09-10T06:28:48.464321+0000","last_clean":"2024-09-10T06:28:48.464321+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:28:48.464321+0000","last_undegraded":"2024-09-10T06:28:48.464321+0000","last_fullsized":"2024-09-10T06:28:48.464321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:51.928304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458371+0000","last_change":"2024-09-10T06:26:34.272915+0000","last_active":"2024-09-10T06:28:48.458371+0000","last_peered":"2024-09-10T06:28:48.458371+0000","last_clean":"2024-09-10T06:28:48.458371+0000","last_became_active":"2024-09-10T06:26:34.272192+0000","last_became_peered":"2024-09-10T06:26:34.272192+0000","last_unstale":"2024-09-10T06:28:48.458371+0000","last_undegraded":"2024-09-10T06:28:48.458371+0000","last_fullsized":"2024-09-10T06:28:48.458371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:07.874348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453060+0000","last_change":"2024-09-10T06:26:36.291431+0000","last_active":"2024-09-10T06:28:48.453060+0000","last_peered":"2024-09-10T06:28:48.453060+0000","last_clean":"2024-09-10T06:28:48.453060+0000","last_became_active":"2024-09-10T06:26:36.290570+0000","last_became_peered":"2024-09-10T06:26:36.290570+0000","last_unstale":"2024-09-10T06:28:48.453060+0000","last_undegraded":"2024-09-10T06:28:48.453060+0000","last_fullsized":"2024-09-10T06:28:48.453060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:10.565531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'102","reported_seq":283,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.464656+0000","last_change":"2024-09-10T06:26:38.312069+0000","last_active":"2024-09-10T06:28:49.464656+0000","last_peered":"2024-09-10T06:28:49.464656+0000","last_clean":"2024-09-10T06:28:49.464656+0000","last_became_active":"2024-09-10T06:26:38.310450+0000","last_became_peered":"2024-09-10T06:26:38.310450+0000","last_unstale":"2024-09-10T06:28:49.464656+0000","last_undegraded":"2024-09-10T06:28:49.464656+0000","last_fullsized":"2024-09-10T06:28:49.464656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379767+0000","last_change":"2024-09-10T06:26:40.312990+0000","last_active":"2024-09-10T06:28:48.379767+0000","last_peered":"2024-09-10T06:28:48.379767+0000","last_clean":"2024-09-10T06:28:48.379767+0000","last_became_active":"2024-09-10T06:26:40.312266+0000","last_became_peered":"2024-09-10T06:26:40.312266+0000","last_unstale":"2024-09-10T06:28:48.379767+0000","last_undegraded":"2024-09-10T06:28:48.379767+0000","last_fullsized":"2024-09-10T06:28:48.379767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:15.777105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"76'4","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375253+0000","last_change":"2024-09-10T06:26:32.258874+0000","last_active":"2024-09-10T06:28:48.375253+0000","last_peered":"2024-09-10T06:28:48.375253+0000","last_clean":"2024-09-10T06:28:48.375253+0000","last_became_active":"2024-09-10T06:26:32.258337+0000","last_became_peered":"2024-09-10T06:26:32.258337+0000","last_unstale":"2024-09-10T06:28:48.375253+0000","last_undegraded":"2024-09-10T06:28:48.375253+0000","last_fullsized":"2024-09-10T06:28:48.375253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"73'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379418+0000","last_change":"2024-09-10T06:26:30.581501+0000","last_active":"2024-09-10T06:28:48.379418+0000","last_peered":"2024-09-10T06:28:48.379418+0000","last_clean":"2024-09-10T06:28:48.379418+0000","last_became_active":"2024-09-10T06:26:30.581115+0000","last_became_peered":"2024-09-10T06:26:30.581115+0000","last_unstale":"2024-09-10T06:28:48.379418+0000","last_undegraded":"2024-09-10T06:28:48.379418+0000","last_fullsized":"2024-09-10T06:28:48.379418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454045+0000","last_change":"2024-09-10T06:26:25.537295+0000","last_active":"2024-09-10T06:28:48.454045+0000","last_peered":"2024-09-10T06:28:48.454045+0000","last_clean":"2024-09-10T06:28:48.454045+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:28:48.454045+0000","last_undegraded":"2024-09-10T06:28:48.454045+0000","last_fullsized":"2024-09-10T06:28:48.454045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:32.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377381+0000","last_change":"2024-09-10T06:26:34.258956+0000","last_active":"2024-09-10T06:28:48.377381+0000","last_peered":"2024-09-10T06:28:48.377381+0000","last_clean":"2024-09-10T06:28:48.377381+0000","last_became_active":"2024-09-10T06:26:34.257739+0000","last_became_peered":"2024-09-10T06:26:34.257739+0000","last_unstale":"2024-09-10T06:28:48.377381+0000","last_undegraded":"2024-09-10T06:28:48.377381+0000","last_fullsized":"2024-09-10T06:28:48.377381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:18.547827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'10","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377884+0000","last_change":"2024-09-10T06:26:36.271096+0000","last_active":"2024-09-10T06:28:48.377884+0000","last_peered":"2024-09-10T06:28:48.377884+0000","last_clean":"2024-09-10T06:28:48.377884+0000","last_became_active":"2024-09-10T06:26:36.270325+0000","last_became_peered":"2024-09-10T06:26:36.270325+0000","last_unstale":"2024-09-10T06:28:48.377884+0000","last_undegraded":"2024-09-10T06:28:48.377884+0000","last_fullsized":"2024-09-10T06:28:48.377884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'102","reported_seq":269,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.464971+0000","last_change":"2024-09-10T06:26:38.300795+0000","last_active":"2024-09-10T06:28:49.464971+0000","last_peered":"2024-09-10T06:28:49.464971+0000","last_clean":"2024-09-10T06:28:49.464971+0000","last_became_active":"2024-09-10T06:26:38.299466+0000","last_became_peered":"2024-09-10T06:26:38.299466+0000","last_unstale":"2024-09-10T06:28:49.464971+0000","last_undegraded":"2024-09-10T06:28:49.464971+0000","last_fullsized":"2024-09-10T06:28:49.464971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:38.641500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"67'4","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377214+0000","last_change":"2024-09-10T06:26:40.329688+0000","last_active":"2024-09-10T06:28:48.377214+0000","last_peered":"2024-09-10T06:28:48.377214+0000","last_clean":"2024-09-10T06:28:48.377214+0000","last_became_active":"2024-09-10T06:26:40.329009+0000","last_became_peered":"2024-09-10T06:26:40.329009+0000","last_unstale":"2024-09-10T06:28:48.377214+0000","last_undegraded":"2024-09-10T06:28:48.377214+0000","last_fullsized":"2024-09-10T06:28:48.377214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'8","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377758+0000","last_change":"2024-09-10T06:26:32.283524+0000","last_active":"2024-09-10T06:28:48.377758+0000","last_peered":"2024-09-10T06:28:48.377758+0000","last_clean":"2024-09-10T06:28:48.377758+0000","last_became_active":"2024-09-10T06:26:32.282794+0000","last_became_peered":"2024-09-10T06:26:32.282794+0000","last_unstale":"2024-09-10T06:28:48.377758+0000","last_undegraded":"2024-09-10T06:28:48.377758+0000","last_fullsized":"2024-09-10T06:28:48.377758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:11.537416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"73'6","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379512+0000","last_change":"2024-09-10T06:26:30.578273+0000","last_active":"2024-09-10T06:28:48.379512+0000","last_peered":"2024-09-10T06:28:48.379512+0000","last_clean":"2024-09-10T06:28:48.379512+0000","last_became_active":"2024-09-10T06:26:30.577985+0000","last_became_peered":"2024-09-10T06:26:30.577985+0000","last_unstale":"2024-09-10T06:28:48.379512+0000","last_undegraded":"2024-09-10T06:28:48.379512+0000","last_fullsized":"2024-09-10T06:28:48.379512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460109+0000","last_change":"2024-09-10T06:26:26.037773+0000","last_active":"2024-09-10T06:28:48.460109+0000","last_peered":"2024-09-10T06:28:48.460109+0000","last_clean":"2024-09-10T06:28:48.460109+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:28:48.460109+0000","last_undegraded":"2024-09-10T06:28:48.460109+0000","last_fullsized":"2024-09-10T06:28:48.460109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:21.949708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374863+0000","last_change":"2024-09-10T06:26:34.268710+0000","last_active":"2024-09-10T06:28:48.374863+0000","last_peered":"2024-09-10T06:28:48.374863+0000","last_clean":"2024-09-10T06:28:48.374863+0000","last_became_active":"2024-09-10T06:26:34.268359+0000","last_became_peered":"2024-09-10T06:26:34.268359+0000","last_unstale":"2024-09-10T06:28:48.374863+0000","last_undegraded":"2024-09-10T06:28:48.374863+0000","last_fullsized":"2024-09-10T06:28:48.374863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:27.191787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"76'37","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462144+0000","last_change":"2024-09-10T06:26:36.299700+0000","last_active":"2024-09-10T06:28:48.462144+0000","last_peered":"2024-09-10T06:28:48.462144+0000","last_clean":"2024-09-10T06:28:48.462144+0000","last_became_active":"2024-09-10T06:26:36.297606+0000","last_became_peered":"2024-09-10T06:26:36.297606+0000","last_unstale":"2024-09-10T06:28:48.462144+0000","last_undegraded":"2024-09-10T06:28:48.462144+0000","last_fullsized":"2024-09-10T06:28:48.462144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375382+0000","last_change":"2024-09-10T06:26:38.290601+0000","last_active":"2024-09-10T06:28:48.375382+0000","last_peered":"2024-09-10T06:28:48.375382+0000","last_clean":"2024-09-10T06:28:48.375382+0000","last_became_active":"2024-09-10T06:26:38.289589+0000","last_became_peered":"2024-09-10T06:26:38.289589+0000","last_unstale":"2024-09-10T06:28:48.375382+0000","last_undegraded":"2024-09-10T06:28:48.375382+0000","last_fullsized":"2024-09-10T06:28:48.375382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:22.625936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458656+0000","last_change":"2024-09-10T06:26:40.332819+0000","last_active":"2024-09-10T06:28:48.458656+0000","last_peered":"2024-09-10T06:28:48.458656+0000","last_clean":"2024-09-10T06:28:48.458656+0000","last_became_active":"2024-09-10T06:26:40.332160+0000","last_became_peered":"2024-09-10T06:26:40.332160+0000","last_unstale":"2024-09-10T06:28:48.458656+0000","last_undegraded":"2024-09-10T06:28:48.458656+0000","last_fullsized":"2024-09-10T06:28:48.458656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.784870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378032+0000","last_change":"2024-09-10T06:26:40.334393+0000","last_active":"2024-09-10T06:28:48.378032+0000","last_peered":"2024-09-10T06:28:48.378032+0000","last_clean":"2024-09-10T06:28:48.378032+0000","last_became_active":"2024-09-10T06:26:40.333474+0000","last_became_peered":"2024-09-10T06:26:40.333474+0000","last_unstale":"2024-09-10T06:28:48.378032+0000","last_undegraded":"2024-09-10T06:28:48.378032+0000","last_fullsized":"2024-09-10T06:28:48.378032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:35.031954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'6","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379197+0000","last_change":"2024-09-10T06:26:32.272914+0000","last_active":"2024-09-10T06:28:48.379197+0000","last_peered":"2024-09-10T06:28:48.379197+0000","last_clean":"2024-09-10T06:28:48.379197+0000","last_became_active":"2024-09-10T06:26:32.272178+0000","last_became_peered":"2024-09-10T06:26:32.272178+0000","last_unstale":"2024-09-10T06:28:48.379197+0000","last_undegraded":"2024-09-10T06:28:48.379197+0000","last_fullsized":"2024-09-10T06:28:48.379197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"72'8","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379651+0000","last_change":"2024-09-10T06:26:30.593531+0000","last_active":"2024-09-10T06:28:48.379651+0000","last_peered":"2024-09-10T06:28:48.379651+0000","last_clean":"2024-09-10T06:28:48.379651+0000","last_became_active":"2024-09-10T06:26:30.592753+0000","last_became_peered":"2024-09-10T06:26:30.592753+0000","last_unstale":"2024-09-10T06:28:48.379651+0000","last_undegraded":"2024-09-10T06:28:48.379651+0000","last_fullsized":"2024-09-10T06:28:48.379651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:14.506864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453697+0000","last_change":"2024-09-10T06:26:34.282877+0000","last_active":"2024-09-10T06:28:48.453697+0000","last_peered":"2024-09-10T06:28:48.453697+0000","last_clean":"2024-09-10T06:28:48.453697+0000","last_became_active":"2024-09-10T06:26:34.282281+0000","last_became_peered":"2024-09-10T06:26:34.282281+0000","last_unstale":"2024-09-10T06:28:48.453697+0000","last_undegraded":"2024-09-10T06:28:48.453697+0000","last_fullsized":"2024-09-10T06:28:48.453697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:41.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"76'17","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374658+0000","last_change":"2024-09-10T06:26:36.273166+0000","last_active":"2024-09-10T06:28:48.374658+0000","last_peered":"2024-09-10T06:28:48.374658+0000","last_clean":"2024-09-10T06:28:48.374658+0000","last_became_active":"2024-09-10T06:26:36.272386+0000","last_became_peered":"2024-09-10T06:26:36.272386+0000","last_unstale":"2024-09-10T06:28:48.374658+0000","last_undegraded":"2024-09-10T06:28:48.374658+0000","last_fullsized":"2024-09-10T06:28:48.374658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374570+0000","last_change":"2024-09-10T06:26:38.297347+0000","last_active":"2024-09-10T06:28:48.374570+0000","last_peered":"2024-09-10T06:28:48.374570+0000","last_clean":"2024-09-10T06:28:48.374570+0000","last_became_active":"2024-09-10T06:26:38.296600+0000","last_became_peered":"2024-09-10T06:26:38.296600+0000","last_unstale":"2024-09-10T06:28:48.374570+0000","last_undegraded":"2024-09-10T06:28:48.374570+0000","last_fullsized":"2024-09-10T06:28:48.374570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:08.758126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"67'20","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379025+0000","last_change":"2024-09-10T06:26:40.321844+0000","last_active":"2024-09-10T06:28:48.379025+0000","last_peered":"2024-09-10T06:28:48.379025+0000","last_clean":"2024-09-10T06:28:48.379025+0000","last_became_active":"2024-09-10T06:26:40.321097+0000","last_became_peered":"2024-09-10T06:26:40.321097+0000","last_unstale":"2024-09-10T06:28:48.379025+0000","last_undegraded":"2024-09-10T06:28:48.379025+0000","last_fullsized":"2024-09-10T06:28:48.379025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:10.004849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"67'6","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453454+0000","last_change":"2024-09-10T06:26:32.286989+0000","last_active":"2024-09-10T06:28:48.453454+0000","last_peered":"2024-09-10T06:28:48.453454+0000","last_clean":"2024-09-10T06:28:48.453454+0000","last_became_active":"2024-09-10T06:26:32.286519+0000","last_became_peered":"2024-09-10T06:26:32.286519+0000","last_unstale":"2024-09-10T06:28:48.453454+0000","last_undegraded":"2024-09-10T06:28:48.453454+0000","last_fullsized":"2024-09-10T06:28:48.453454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:31.592472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"72'6","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464000+0000","last_change":"2024-09-10T06:26:30.587315+0000","last_active":"2024-09-10T06:28:48.464000+0000","last_peered":"2024-09-10T06:28:48.464000+0000","last_clean":"2024-09-10T06:28:48.464000+0000","last_became_active":"2024-09-10T06:26:30.586611+0000","last_became_peered":"2024-09-10T06:26:30.586611+0000","last_unstale":"2024-09-10T06:28:48.464000+0000","last_undegraded":"2024-09-10T06:28:48.464000+0000","last_fullsized":"2024-09-10T06:28:48.464000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"27'1","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377148+0000","last_change":"2024-09-10T06:26:34.271770+0000","last_active":"2024-09-10T06:28:48.377148+0000","last_peered":"2024-09-10T06:28:48.377148+0000","last_clean":"2024-09-10T06:28:48.377148+0000","last_became_active":"2024-09-10T06:26:34.269875+0000","last_became_peered":"2024-09-10T06:26:34.269875+0000","last_unstale":"2024-09-10T06:28:48.377148+0000","last_undegraded":"2024-09-10T06:28:48.377148+0000","last_fullsized":"2024-09-10T06:28:48.377148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:09.570079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"67'6","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375286+0000","last_change":"2024-09-10T06:26:36.289140+0000","last_active":"2024-09-10T06:28:48.375286+0000","last_peered":"2024-09-10T06:28:48.375286+0000","last_clean":"2024-09-10T06:28:48.375286+0000","last_became_active":"2024-09-10T06:26:36.288355+0000","last_became_peered":"2024-09-10T06:26:36.288355+0000","last_unstale":"2024-09-10T06:28:48.375286+0000","last_undegraded":"2024-09-10T06:28:48.375286+0000","last_fullsized":"2024-09-10T06:28:48.375286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:42.518982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456930+0000","last_change":"2024-09-10T06:26:38.302040+0000","last_active":"2024-09-10T06:28:48.456930+0000","last_peered":"2024-09-10T06:28:48.456930+0000","last_clean":"2024-09-10T06:28:48.456930+0000","last_became_active":"2024-09-10T06:26:38.301064+0000","last_became_peered":"2024-09-10T06:26:38.301064+0000","last_unstale":"2024-09-10T06:28:48.456930+0000","last_undegraded":"2024-09-10T06:28:48.456930+0000","last_fullsized":"2024-09-10T06:28:48.456930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:41.513255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"64'4","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377597+0000","last_change":"2024-09-10T06:26:40.322368+0000","last_active":"2024-09-10T06:28:48.377597+0000","last_peered":"2024-09-10T06:28:48.377597+0000","last_clean":"2024-09-10T06:28:48.377597+0000","last_became_active":"2024-09-10T06:26:40.321592+0000","last_became_peered":"2024-09-10T06:26:40.321592+0000","last_unstale":"2024-09-10T06:28:48.377597+0000","last_undegraded":"2024-09-10T06:28:48.377597+0000","last_fullsized":"2024-09-10T06:28:48.377597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:03.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"61'4","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375592+0000","last_change":"2024-09-10T06:26:32.259666+0000","last_active":"2024-09-10T06:28:48.375592+0000","last_peered":"2024-09-10T06:28:48.375592+0000","last_clean":"2024-09-10T06:28:48.375592+0000","last_became_active":"2024-09-10T06:26:32.258775+0000","last_became_peered":"2024-09-10T06:26:32.258775+0000","last_unstale":"2024-09-10T06:28:48.375592+0000","last_undegraded":"2024-09-10T06:28:48.375592+0000","last_fullsized":"2024-09-10T06:28:48.375592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"72'13","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460597+0000","last_change":"2024-09-10T06:26:30.592773+0000","last_active":"2024-09-10T06:28:48.460597+0000","last_peered":"2024-09-10T06:28:48.460597+0000","last_clean":"2024-09-10T06:28:48.460597+0000","last_became_active":"2024-09-10T06:26:30.590566+0000","last_became_peered":"2024-09-10T06:26:30.590566+0000","last_unstale":"2024-09-10T06:28:48.460597+0000","last_undegraded":"2024-09-10T06:28:48.460597+0000","last_fullsized":"2024-09-10T06:28:48.460597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:35.688897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455138+0000","last_change":"2024-09-10T06:26:34.281690+0000","last_active":"2024-09-10T06:28:48.455138+0000","last_peered":"2024-09-10T06:28:48.455138+0000","last_clean":"2024-09-10T06:28:48.455138+0000","last_became_active":"2024-09-10T06:26:34.281008+0000","last_became_peered":"2024-09-10T06:26:34.281008+0000","last_unstale":"2024-09-10T06:28:48.455138+0000","last_undegraded":"2024-09-10T06:28:48.455138+0000","last_fullsized":"2024-09-10T06:28:48.455138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"76'17","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375413+0000","last_change":"2024-09-10T06:26:36.277028+0000","last_active":"2024-09-10T06:28:48.375413+0000","last_peered":"2024-09-10T06:28:48.375413+0000","last_clean":"2024-09-10T06:28:48.375413+0000","last_became_active":"2024-09-10T06:26:36.276248+0000","last_became_peered":"2024-09-10T06:26:36.276248+0000","last_unstale":"2024-09-10T06:28:48.375413+0000","last_undegraded":"2024-09-10T06:28:48.375413+0000","last_fullsized":"2024-09-10T06:28:48.375413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:53.521681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457566+0000","last_change":"2024-09-10T06:28:46.344566+0000","last_active":"2024-09-10T06:28:48.457566+0000","last_peered":"2024-09-10T06:28:48.457566+0000","last_clean":"2024-09-10T06:28:48.457566+0000","last_became_active":"2024-09-10T06:28:46.343657+0000","last_became_peered":"2024-09-10T06:28:46.343657+0000","last_unstale":"2024-09-10T06:28:48.457566+0000","last_undegraded":"2024-09-10T06:28:48.457566+0000","last_fullsized":"2024-09-10T06:28:48.457566+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:25.681176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460858+0000","last_change":"2024-09-10T06:26:40.331445+0000","last_active":"2024-09-10T06:28:48.460858+0000","last_peered":"2024-09-10T06:28:48.460858+0000","last_clean":"2024-09-10T06:28:48.460858+0000","last_became_active":"2024-09-10T06:26:40.330707+0000","last_became_peered":"2024-09-10T06:26:40.330707+0000","last_unstale":"2024-09-10T06:28:48.460858+0000","last_undegraded":"2024-09-10T06:28:48.460858+0000","last_fullsized":"2024-09-10T06:28:48.460858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.822687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375781+0000","last_change":"2024-09-10T06:26:32.266221+0000","last_active":"2024-09-10T06:28:48.375781+0000","last_peered":"2024-09-10T06:28:48.375781+0000","last_clean":"2024-09-10T06:28:48.375781+0000","last_became_active":"2024-09-10T06:26:32.265705+0000","last_became_peered":"2024-09-10T06:26:32.265705+0000","last_unstale":"2024-09-10T06:28:48.375781+0000","last_undegraded":"2024-09-10T06:28:48.375781+0000","last_fullsized":"2024-09-10T06:28:48.375781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"73'9","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378324+0000","last_change":"2024-09-10T06:26:30.594335+0000","last_active":"2024-09-10T06:28:48.378324+0000","last_peered":"2024-09-10T06:28:48.378324+0000","last_clean":"2024-09-10T06:28:48.378324+0000","last_became_active":"2024-09-10T06:26:30.593326+0000","last_became_peered":"2024-09-10T06:26:30.593326+0000","last_unstale":"2024-09-10T06:28:48.378324+0000","last_undegraded":"2024-09-10T06:28:48.378324+0000","last_fullsized":"2024-09-10T06:28:48.378324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:37.297722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457418+0000","last_change":"2024-09-10T06:26:34.281915+0000","last_active":"2024-09-10T06:28:48.457418+0000","last_peered":"2024-09-10T06:28:48.457418+0000","last_clean":"2024-09-10T06:28:48.457418+0000","last_became_active":"2024-09-10T06:26:34.281147+0000","last_became_peered":"2024-09-10T06:26:34.281147+0000","last_unstale":"2024-09-10T06:28:48.457418+0000","last_undegraded":"2024-09-10T06:28:48.457418+0000","last_fullsized":"2024-09-10T06:28:48.457418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:41.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"76'15","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458225+0000","last_change":"2024-09-10T06:26:36.298537+0000","last_active":"2024-09-10T06:28:48.458225+0000","last_peered":"2024-09-10T06:28:48.458225+0000","last_clean":"2024-09-10T06:28:48.458225+0000","last_became_active":"2024-09-10T06:26:36.297372+0000","last_became_peered":"2024-09-10T06:26:36.297372+0000","last_unstale":"2024-09-10T06:28:48.458225+0000","last_undegraded":"2024-09-10T06:28:48.458225+0000","last_fullsized":"2024-09-10T06:28:48.458225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376070+0000","last_change":"2024-09-10T06:26:38.301461+0000","last_active":"2024-09-10T06:28:48.376070+0000","last_peered":"2024-09-10T06:28:48.376070+0000","last_clean":"2024-09-10T06:28:48.376070+0000","last_became_active":"2024-09-10T06:26:38.300580+0000","last_became_peered":"2024-09-10T06:26:38.300580+0000","last_unstale":"2024-09-10T06:28:48.376070+0000","last_undegraded":"2024-09-10T06:28:48.376070+0000","last_fullsized":"2024-09-10T06:28:48.376070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"67'10","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459745+0000","last_change":"2024-09-10T06:26:32.285276+0000","last_active":"2024-09-10T06:28:48.459745+0000","last_peered":"2024-09-10T06:28:48.459745+0000","last_clean":"2024-09-10T06:28:48.459745+0000","last_became_active":"2024-09-10T06:26:32.284457+0000","last_became_peered":"2024-09-10T06:26:32.284457+0000","last_unstale":"2024-09-10T06:28:48.459745+0000","last_undegraded":"2024-09-10T06:28:48.459745+0000","last_fullsized":"2024-09-10T06:28:48.459745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:37.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"72'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376276+0000","last_change":"2024-09-10T06:26:30.573339+0000","last_active":"2024-09-10T06:28:48.376276+0000","last_peered":"2024-09-10T06:28:48.376276+0000","last_clean":"2024-09-10T06:28:48.376276+0000","last_became_active":"2024-09-10T06:26:30.571377+0000","last_became_peered":"2024-09-10T06:26:30.571377+0000","last_unstale":"2024-09-10T06:28:48.376276+0000","last_undegraded":"2024-09-10T06:28:48.376276+0000","last_fullsized":"2024-09-10T06:28:48.376276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:59.752497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378936+0000","last_change":"2024-09-10T06:26:34.269013+0000","last_active":"2024-09-10T06:28:48.378936+0000","last_peered":"2024-09-10T06:28:48.378936+0000","last_clean":"2024-09-10T06:28:48.378936+0000","last_became_active":"2024-09-10T06:26:34.268677+0000","last_became_peered":"2024-09-10T06:26:34.268677+0000","last_unstale":"2024-09-10T06:28:48.378936+0000","last_undegraded":"2024-09-10T06:28:48.378936+0000","last_fullsized":"2024-09-10T06:28:48.378936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"76'24","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453781+0000","last_change":"2024-09-10T06:26:36.300362+0000","last_active":"2024-09-10T06:28:48.453781+0000","last_peered":"2024-09-10T06:28:48.453781+0000","last_clean":"2024-09-10T06:28:48.453781+0000","last_became_active":"2024-09-10T06:26:36.299645+0000","last_became_peered":"2024-09-10T06:26:36.299645+0000","last_unstale":"2024-09-10T06:28:48.453781+0000","last_undegraded":"2024-09-10T06:28:48.453781+0000","last_fullsized":"2024-09-10T06:28:48.453781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:17.424354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461312+0000","last_change":"2024-09-10T06:26:38.299751+0000","last_active":"2024-09-10T06:28:48.461312+0000","last_peered":"2024-09-10T06:28:48.461312+0000","last_clean":"2024-09-10T06:28:48.461312+0000","last_became_active":"2024-09-10T06:26:38.298414+0000","last_became_peered":"2024-09-10T06:26:38.298414+0000","last_unstale":"2024-09-10T06:28:48.461312+0000","last_undegraded":"2024-09-10T06:28:48.461312+0000","last_fullsized":"2024-09-10T06:28:48.461312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'2","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375129+0000","last_change":"2024-09-10T06:26:40.312752+0000","last_active":"2024-09-10T06:28:48.375129+0000","last_peered":"2024-09-10T06:28:48.375129+0000","last_clean":"2024-09-10T06:28:48.375129+0000","last_became_active":"2024-09-10T06:26:40.312026+0000","last_became_peered":"2024-09-10T06:26:40.312026+0000","last_unstale":"2024-09-10T06:28:48.375129+0000","last_undegraded":"2024-09-10T06:28:48.375129+0000","last_fullsized":"2024-09-10T06:28:48.375129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:50.071224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379114+0000","last_change":"2024-09-10T06:26:32.266934+0000","last_active":"2024-09-10T06:28:48.379114+0000","last_peered":"2024-09-10T06:28:48.379114+0000","last_clean":"2024-09-10T06:28:48.379114+0000","last_became_active":"2024-09-10T06:26:32.266682+0000","last_became_peered":"2024-09-10T06:26:32.266682+0000","last_unstale":"2024-09-10T06:28:48.379114+0000","last_undegraded":"2024-09-10T06:28:48.379114+0000","last_fullsized":"2024-09-10T06:28:48.379114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"73'15","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453970+0000","last_change":"2024-09-10T06:26:30.579097+0000","last_active":"2024-09-10T06:28:48.453970+0000","last_peered":"2024-09-10T06:28:48.453970+0000","last_clean":"2024-09-10T06:28:48.453970+0000","last_became_active":"2024-09-10T06:26:30.578692+0000","last_became_peered":"2024-09-10T06:26:30.578692+0000","last_unstale":"2024-09-10T06:28:48.453970+0000","last_undegraded":"2024-09-10T06:28:48.453970+0000","last_fullsized":"2024-09-10T06:28:48.453970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:15.878123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":23,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"27'1","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459372+0000","last_change":"2024-09-10T06:26:34.282356+0000","last_active":"2024-09-10T06:28:48.459372+0000","last_peered":"2024-09-10T06:28:48.459372+0000","last_clean":"2024-09-10T06:28:48.459372+0000","last_became_active":"2024-09-10T06:26:34.281167+0000","last_became_peered":"2024-09-10T06:26:34.281167+0000","last_unstale":"2024-09-10T06:28:48.459372+0000","last_undegraded":"2024-09-10T06:28:48.459372+0000","last_fullsized":"2024-09-10T06:28:48.459372+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:59.042394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"76'22","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462750+0000","last_change":"2024-09-10T06:26:36.301277+0000","last_active":"2024-09-10T06:28:48.462750+0000","last_peered":"2024-09-10T06:28:48.462750+0000","last_clean":"2024-09-10T06:28:48.462750+0000","last_became_active":"2024-09-10T06:26:36.300501+0000","last_became_peered":"2024-09-10T06:26:36.300501+0000","last_unstale":"2024-09-10T06:28:48.462750+0000","last_undegraded":"2024-09-10T06:28:48.462750+0000","last_fullsized":"2024-09-10T06:28:48.462750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:38.477946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454339+0000","last_change":"2024-09-10T06:26:38.305737+0000","last_active":"2024-09-10T06:28:48.454339+0000","last_peered":"2024-09-10T06:28:48.454339+0000","last_clean":"2024-09-10T06:28:48.454339+0000","last_became_active":"2024-09-10T06:26:38.303318+0000","last_became_peered":"2024-09-10T06:26:38.303318+0000","last_unstale":"2024-09-10T06:28:48.454339+0000","last_undegraded":"2024-09-10T06:28:48.454339+0000","last_fullsized":"2024-09-10T06:28:48.454339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:52.587622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"67'10","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458108+0000","last_change":"2024-09-10T06:26:40.318587+0000","last_active":"2024-09-10T06:28:48.458108+0000","last_peered":"2024-09-10T06:28:48.458108+0000","last_clean":"2024-09-10T06:28:48.458108+0000","last_became_active":"2024-09-10T06:26:40.317695+0000","last_became_peered":"2024-09-10T06:26:40.317695+0000","last_unstale":"2024-09-10T06:28:48.458108+0000","last_undegraded":"2024-09-10T06:28:48.458108+0000","last_fullsized":"2024-09-10T06:28:48.458108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:48.298686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379045+0000","last_change":"2024-09-10T06:26:32.276218+0000","last_active":"2024-09-10T06:28:48.379045+0000","last_peered":"2024-09-10T06:28:48.379045+0000","last_clean":"2024-09-10T06:28:48.379045+0000","last_became_active":"2024-09-10T06:26:32.275805+0000","last_became_peered":"2024-09-10T06:26:32.275805+0000","last_unstale":"2024-09-10T06:28:48.379045+0000","last_undegraded":"2024-09-10T06:28:48.379045+0000","last_fullsized":"2024-09-10T06:28:48.379045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"73'7","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378905+0000","last_change":"2024-09-10T06:26:30.568731+0000","last_active":"2024-09-10T06:28:48.378905+0000","last_peered":"2024-09-10T06:28:48.378905+0000","last_clean":"2024-09-10T06:28:48.378905+0000","last_became_active":"2024-09-10T06:26:30.567937+0000","last_became_peered":"2024-09-10T06:26:30.567937+0000","last_unstale":"2024-09-10T06:28:48.378905+0000","last_undegraded":"2024-09-10T06:28:48.378905+0000","last_fullsized":"2024-09-10T06:28:48.378905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:18.974865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380895+0000","last_change":"2024-09-10T06:26:34.266227+0000","last_active":"2024-09-10T06:28:48.380895+0000","last_peered":"2024-09-10T06:28:48.380895+0000","last_clean":"2024-09-10T06:28:48.380895+0000","last_became_active":"2024-09-10T06:26:34.262443+0000","last_became_peered":"2024-09-10T06:26:34.262443+0000","last_unstale":"2024-09-10T06:28:48.380895+0000","last_undegraded":"2024-09-10T06:28:48.380895+0000","last_fullsized":"2024-09-10T06:28:48.380895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.918813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"76'18","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379862+0000","last_change":"2024-09-10T06:26:36.292958+0000","last_active":"2024-09-10T06:28:48.379862+0000","last_peered":"2024-09-10T06:28:48.379862+0000","last_clean":"2024-09-10T06:28:48.379862+0000","last_became_active":"2024-09-10T06:26:36.292149+0000","last_became_peered":"2024-09-10T06:26:36.292149+0000","last_unstale":"2024-09-10T06:28:48.379862+0000","last_undegraded":"2024-09-10T06:28:48.379862+0000","last_fullsized":"2024-09-10T06:28:48.379862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453832+0000","last_change":"2024-09-10T06:26:38.302991+0000","last_active":"2024-09-10T06:28:48.453832+0000","last_peered":"2024-09-10T06:28:48.453832+0000","last_clean":"2024-09-10T06:28:48.453832+0000","last_became_active":"2024-09-10T06:26:38.289306+0000","last_became_peered":"2024-09-10T06:26:38.289306+0000","last_unstale":"2024-09-10T06:28:48.453832+0000","last_undegraded":"2024-09-10T06:28:48.453832+0000","last_fullsized":"2024-09-10T06:28:48.453832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:57.625329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456492+0000","last_change":"2024-09-10T06:26:40.327627+0000","last_active":"2024-09-10T06:28:48.456492+0000","last_peered":"2024-09-10T06:28:48.456492+0000","last_clean":"2024-09-10T06:28:48.456492+0000","last_became_active":"2024-09-10T06:26:40.326888+0000","last_became_peered":"2024-09-10T06:26:40.326888+0000","last_unstale":"2024-09-10T06:28:48.456492+0000","last_undegraded":"2024-09-10T06:28:48.456492+0000","last_fullsized":"2024-09-10T06:28:48.456492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:41.122562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455208+0000","last_change":"2024-09-10T06:26:32.275071+0000","last_active":"2024-09-10T06:28:48.455208+0000","last_peered":"2024-09-10T06:28:48.455208+0000","last_clean":"2024-09-10T06:28:48.455208+0000","last_became_active":"2024-09-10T06:26:32.274395+0000","last_became_peered":"2024-09-10T06:26:32.274395+0000","last_unstale":"2024-09-10T06:28:48.455208+0000","last_undegraded":"2024-09-10T06:28:48.455208+0000","last_fullsized":"2024-09-10T06:28:48.455208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:51.369493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"73'7","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376206+0000","last_change":"2024-09-10T06:26:30.594599+0000","last_active":"2024-09-10T06:28:48.376206+0000","last_peered":"2024-09-10T06:28:48.376206+0000","last_clean":"2024-09-10T06:28:48.376206+0000","last_became_active":"2024-09-10T06:26:30.594058+0000","last_became_peered":"2024-09-10T06:26:30.594058+0000","last_unstale":"2024-09-10T06:28:48.376206+0000","last_undegraded":"2024-09-10T06:28:48.376206+0000","last_fullsized":"2024-09-10T06:28:48.376206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:18.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454445+0000","last_change":"2024-09-10T06:26:34.279538+0000","last_active":"2024-09-10T06:28:48.454445+0000","last_peered":"2024-09-10T06:28:48.454445+0000","last_clean":"2024-09-10T06:28:48.454445+0000","last_became_active":"2024-09-10T06:26:34.278871+0000","last_became_peered":"2024-09-10T06:26:34.278871+0000","last_unstale":"2024-09-10T06:28:48.454445+0000","last_undegraded":"2024-09-10T06:28:48.454445+0000","last_fullsized":"2024-09-10T06:28:48.454445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:13.203357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"71'12","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379969+0000","last_change":"2024-09-10T06:26:36.290976+0000","last_active":"2024-09-10T06:28:48.379969+0000","last_peered":"2024-09-10T06:28:48.379969+0000","last_clean":"2024-09-10T06:28:48.379969+0000","last_became_active":"2024-09-10T06:26:36.290265+0000","last_became_peered":"2024-09-10T06:26:36.290265+0000","last_unstale":"2024-09-10T06:28:48.379969+0000","last_undegraded":"2024-09-10T06:28:48.379969+0000","last_fullsized":"2024-09-10T06:28:48.379969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'102","reported_seq":271,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.464716+0000","last_change":"2024-09-10T06:26:38.292031+0000","last_active":"2024-09-10T06:28:49.464716+0000","last_peered":"2024-09-10T06:28:49.464716+0000","last_clean":"2024-09-10T06:28:49.464716+0000","last_became_active":"2024-09-10T06:26:38.288791+0000","last_became_peered":"2024-09-10T06:26:38.288791+0000","last_unstale":"2024-09-10T06:28:49.464716+0000","last_undegraded":"2024-09-10T06:28:49.464716+0000","last_fullsized":"2024-09-10T06:28:49.464716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:07.830355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"76'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455098+0000","last_change":"2024-09-10T06:26:40.336448+0000","last_active":"2024-09-10T06:28:48.455098+0000","last_peered":"2024-09-10T06:28:48.455098+0000","last_clean":"2024-09-10T06:28:48.455098+0000","last_became_active":"2024-09-10T06:26:40.335771+0000","last_became_peered":"2024-09-10T06:26:40.335771+0000","last_unstale":"2024-09-10T06:28:48.455098+0000","last_undegraded":"2024-09-10T06:28:48.455098+0000","last_fullsized":"2024-09-10T06:28:48.455098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378950+0000","last_change":"2024-09-10T06:26:32.262176+0000","last_active":"2024-09-10T06:28:48.378950+0000","last_peered":"2024-09-10T06:28:48.378950+0000","last_clean":"2024-09-10T06:28:48.378950+0000","last_became_active":"2024-09-10T06:26:32.261250+0000","last_became_peered":"2024-09-10T06:26:32.261250+0000","last_unstale":"2024-09-10T06:28:48.378950+0000","last_undegraded":"2024-09-10T06:28:48.378950+0000","last_fullsized":"2024-09-10T06:28:48.378950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"73'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461942+0000","last_change":"2024-09-10T06:26:30.604587+0000","last_active":"2024-09-10T06:28:48.461942+0000","last_peered":"2024-09-10T06:28:48.461942+0000","last_clean":"2024-09-10T06:28:48.461942+0000","last_became_active":"2024-09-10T06:26:30.603175+0000","last_became_peered":"2024-09-10T06:26:30.603175+0000","last_unstale":"2024-09-10T06:28:48.461942+0000","last_undegraded":"2024-09-10T06:28:48.461942+0000","last_fullsized":"2024-09-10T06:28:48.461942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458290+0000","last_change":"2024-09-10T06:26:34.286028+0000","last_active":"2024-09-10T06:28:48.458290+0000","last_peered":"2024-09-10T06:28:48.458290+0000","last_clean":"2024-09-10T06:28:48.458290+0000","last_became_active":"2024-09-10T06:26:34.285169+0000","last_became_peered":"2024-09-10T06:26:34.285169+0000","last_unstale":"2024-09-10T06:28:48.458290+0000","last_undegraded":"2024-09-10T06:28:48.458290+0000","last_fullsized":"2024-09-10T06:28:48.458290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:24.146088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"76'21","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456901+0000","last_change":"2024-09-10T06:26:36.292679+0000","last_active":"2024-09-10T06:28:48.456901+0000","last_peered":"2024-09-10T06:28:48.456901+0000","last_clean":"2024-09-10T06:28:48.456901+0000","last_became_active":"2024-09-10T06:26:36.288780+0000","last_became_peered":"2024-09-10T06:26:36.288780+0000","last_unstale":"2024-09-10T06:28:48.456901+0000","last_undegraded":"2024-09-10T06:28:48.456901+0000","last_fullsized":"2024-09-10T06:28:48.456901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374709+0000","last_change":"2024-09-10T06:26:38.293015+0000","last_active":"2024-09-10T06:28:48.374709+0000","last_peered":"2024-09-10T06:28:48.374709+0000","last_clean":"2024-09-10T06:28:48.374709+0000","last_became_active":"2024-09-10T06:26:38.292185+0000","last_became_peered":"2024-09-10T06:26:38.292185+0000","last_unstale":"2024-09-10T06:28:48.374709+0000","last_undegraded":"2024-09-10T06:28:48.374709+0000","last_fullsized":"2024-09-10T06:28:48.374709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:32.694777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"64'10","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464937+0000","last_change":"2024-09-10T06:26:40.336074+0000","last_active":"2024-09-10T06:28:48.464937+0000","last_peered":"2024-09-10T06:28:48.464937+0000","last_clean":"2024-09-10T06:28:48.464937+0000","last_became_active":"2024-09-10T06:26:40.335339+0000","last_became_peered":"2024-09-10T06:26:40.335339+0000","last_unstale":"2024-09-10T06:28:48.464937+0000","last_undegraded":"2024-09-10T06:28:48.464937+0000","last_fullsized":"2024-09-10T06:28:48.464937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378245+0000","last_change":"2024-09-10T06:26:32.262823+0000","last_active":"2024-09-10T06:28:48.378245+0000","last_peered":"2024-09-10T06:28:48.378245+0000","last_clean":"2024-09-10T06:28:48.378245+0000","last_became_active":"2024-09-10T06:26:32.262041+0000","last_became_peered":"2024-09-10T06:26:32.262041+0000","last_unstale":"2024-09-10T06:28:48.378245+0000","last_undegraded":"2024-09-10T06:28:48.378245+0000","last_fullsized":"2024-09-10T06:28:48.378245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:48.768083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"73'7","reported_seq":123,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455114+0000","last_change":"2024-09-10T06:27:08.868703+0000","last_active":"2024-09-10T06:28:48.455114+0000","last_peered":"2024-09-10T06:28:48.455114+0000","last_clean":"2024-09-10T06:28:48.455114+0000","last_became_active":"2024-09-10T06:27:08.868399+0000","last_became_peered":"2024-09-10T06:27:08.868399+0000","last_unstale":"2024-09-10T06:28:48.455114+0000","last_undegraded":"2024-09-10T06:28:48.455114+0000","last_fullsized":"2024-09-10T06:28:48.455114+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:20.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459883+0000","last_change":"2024-09-10T06:26:34.282651+0000","last_active":"2024-09-10T06:28:48.459883+0000","last_peered":"2024-09-10T06:28:48.459883+0000","last_clean":"2024-09-10T06:28:48.459883+0000","last_became_active":"2024-09-10T06:26:34.281777+0000","last_became_peered":"2024-09-10T06:26:34.281777+0000","last_unstale":"2024-09-10T06:28:48.459883+0000","last_undegraded":"2024-09-10T06:28:48.459883+0000","last_fullsized":"2024-09-10T06:28:48.459883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:42.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"76'15","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374940+0000","last_change":"2024-09-10T06:26:36.285192+0000","last_active":"2024-09-10T06:28:48.374940+0000","last_peered":"2024-09-10T06:28:48.374940+0000","last_clean":"2024-09-10T06:28:48.374940+0000","last_became_active":"2024-09-10T06:26:36.284470+0000","last_became_peered":"2024-09-10T06:26:36.284470+0000","last_unstale":"2024-09-10T06:28:48.374940+0000","last_undegraded":"2024-09-10T06:28:48.374940+0000","last_fullsized":"2024-09-10T06:28:48.374940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:44.280458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456932+0000","last_change":"2024-09-10T06:26:38.303425+0000","last_active":"2024-09-10T06:28:48.456932+0000","last_peered":"2024-09-10T06:28:48.456932+0000","last_clean":"2024-09-10T06:28:48.456932+0000","last_became_active":"2024-09-10T06:26:38.302606+0000","last_became_peered":"2024-09-10T06:26:38.302606+0000","last_unstale":"2024-09-10T06:28:48.456932+0000","last_undegraded":"2024-09-10T06:28:48.456932+0000","last_fullsized":"2024-09-10T06:28:48.456932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:14.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"76'13","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379260+0000","last_change":"2024-09-10T06:26:40.311253+0000","last_active":"2024-09-10T06:28:48.379260+0000","last_peered":"2024-09-10T06:28:48.379260+0000","last_clean":"2024-09-10T06:28:48.379260+0000","last_became_active":"2024-09-10T06:26:40.310414+0000","last_became_peered":"2024-09-10T06:26:40.310414+0000","last_unstale":"2024-09-10T06:28:48.379260+0000","last_undegraded":"2024-09-10T06:28:48.379260+0000","last_fullsized":"2024-09-10T06:28:48.379260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:20.868195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375984+0000","last_change":"2024-09-10T06:26:32.262972+0000","last_active":"2024-09-10T06:28:48.375984+0000","last_peered":"2024-09-10T06:28:48.375984+0000","last_clean":"2024-09-10T06:28:48.375984+0000","last_became_active":"2024-09-10T06:26:32.262469+0000","last_became_peered":"2024-09-10T06:26:32.262469+0000","last_unstale":"2024-09-10T06:28:48.375984+0000","last_undegraded":"2024-09-10T06:28:48.375984+0000","last_fullsized":"2024-09-10T06:28:48.375984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"72'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379565+0000","last_change":"2024-09-10T06:26:30.602013+0000","last_active":"2024-09-10T06:28:48.379565+0000","last_peered":"2024-09-10T06:28:48.379565+0000","last_clean":"2024-09-10T06:28:48.379565+0000","last_became_active":"2024-09-10T06:26:30.601672+0000","last_became_peered":"2024-09-10T06:26:30.601672+0000","last_unstale":"2024-09-10T06:28:48.379565+0000","last_undegraded":"2024-09-10T06:28:48.379565+0000","last_fullsized":"2024-09-10T06:28:48.379565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:52.012063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376590+0000","last_change":"2024-09-10T06:26:34.277010+0000","last_active":"2024-09-10T06:28:48.376590+0000","last_peered":"2024-09-10T06:28:48.376590+0000","last_clean":"2024-09-10T06:28:48.376590+0000","last_became_active":"2024-09-10T06:26:34.276197+0000","last_became_peered":"2024-09-10T06:26:34.276197+0000","last_unstale":"2024-09-10T06:28:48.376590+0000","last_undegraded":"2024-09-10T06:28:48.376590+0000","last_fullsized":"2024-09-10T06:28:48.376590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:32.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"76'11","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378378+0000","last_change":"2024-09-10T06:26:36.297514+0000","last_active":"2024-09-10T06:28:48.378378+0000","last_peered":"2024-09-10T06:28:48.378378+0000","last_clean":"2024-09-10T06:28:48.378378+0000","last_became_active":"2024-09-10T06:26:36.296615+0000","last_became_peered":"2024-09-10T06:26:36.296615+0000","last_unstale":"2024-09-10T06:28:48.378378+0000","last_undegraded":"2024-09-10T06:28:48.378378+0000","last_fullsized":"2024-09-10T06:28:48.378378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376631+0000","last_change":"2024-09-10T06:26:38.288794+0000","last_active":"2024-09-10T06:28:48.376631+0000","last_peered":"2024-09-10T06:28:48.376631+0000","last_clean":"2024-09-10T06:28:48.376631+0000","last_became_active":"2024-09-10T06:26:38.288055+0000","last_became_peered":"2024-09-10T06:26:38.288055+0000","last_unstale":"2024-09-10T06:28:48.376631+0000","last_undegraded":"2024-09-10T06:28:48.376631+0000","last_fullsized":"2024-09-10T06:28:48.376631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463598+0000","last_change":"2024-09-10T06:26:40.318067+0000","last_active":"2024-09-10T06:28:48.463598+0000","last_peered":"2024-09-10T06:28:48.463598+0000","last_clean":"2024-09-10T06:28:48.463598+0000","last_became_active":"2024-09-10T06:26:40.317244+0000","last_became_peered":"2024-09-10T06:26:40.317244+0000","last_unstale":"2024-09-10T06:28:48.463598+0000","last_undegraded":"2024-09-10T06:28:48.463598+0000","last_fullsized":"2024-09-10T06:28:48.463598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"76'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377374+0000","last_change":"2024-09-10T06:26:32.277908+0000","last_active":"2024-09-10T06:28:48.377374+0000","last_peered":"2024-09-10T06:28:48.377374+0000","last_clean":"2024-09-10T06:28:48.377374+0000","last_became_active":"2024-09-10T06:26:32.274812+0000","last_became_peered":"2024-09-10T06:26:32.274812+0000","last_unstale":"2024-09-10T06:28:48.377374+0000","last_undegraded":"2024-09-10T06:28:48.377374+0000","last_fullsized":"2024-09-10T06:28:48.377374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:37.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"73'10","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378238+0000","last_change":"2024-09-10T06:26:30.594013+0000","last_active":"2024-09-10T06:28:48.378238+0000","last_peered":"2024-09-10T06:28:48.378238+0000","last_clean":"2024-09-10T06:28:48.378238+0000","last_became_active":"2024-09-10T06:26:30.593687+0000","last_became_peered":"2024-09-10T06:26:30.593687+0000","last_unstale":"2024-09-10T06:28:48.378238+0000","last_undegraded":"2024-09-10T06:28:48.378238+0000","last_fullsized":"2024-09-10T06:28:48.378238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:37.375037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453258+0000","last_change":"2024-09-10T06:26:34.283392+0000","last_active":"2024-09-10T06:28:48.453258+0000","last_peered":"2024-09-10T06:28:48.453258+0000","last_clean":"2024-09-10T06:28:48.453258+0000","last_became_active":"2024-09-10T06:26:34.282931+0000","last_became_peered":"2024-09-10T06:26:34.282931+0000","last_unstale":"2024-09-10T06:28:48.453258+0000","last_undegraded":"2024-09-10T06:28:48.453258+0000","last_fullsized":"2024-09-10T06:28:48.453258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:01.310719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"76'15","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377000+0000","last_change":"2024-09-10T06:26:36.289834+0000","last_active":"2024-09-10T06:28:48.377000+0000","last_peered":"2024-09-10T06:28:48.377000+0000","last_clean":"2024-09-10T06:28:48.377000+0000","last_became_active":"2024-09-10T06:26:36.289033+0000","last_became_peered":"2024-09-10T06:26:36.289033+0000","last_unstale":"2024-09-10T06:28:48.377000+0000","last_undegraded":"2024-09-10T06:28:48.377000+0000","last_fullsized":"2024-09-10T06:28:48.377000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375982+0000","last_change":"2024-09-10T06:26:38.299568+0000","last_active":"2024-09-10T06:28:48.375982+0000","last_peered":"2024-09-10T06:28:48.375982+0000","last_clean":"2024-09-10T06:28:48.375982+0000","last_became_active":"2024-09-10T06:26:38.298779+0000","last_became_peered":"2024-09-10T06:26:38.298779+0000","last_unstale":"2024-09-10T06:28:48.375982+0000","last_undegraded":"2024-09-10T06:28:48.375982+0000","last_fullsized":"2024-09-10T06:28:48.375982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.381022+0000","last_change":"2024-09-10T06:26:40.336329+0000","last_active":"2024-09-10T06:28:48.381022+0000","last_peered":"2024-09-10T06:28:48.381022+0000","last_clean":"2024-09-10T06:28:48.381022+0000","last_became_active":"2024-09-10T06:26:40.335348+0000","last_became_peered":"2024-09-10T06:26:40.335348+0000","last_unstale":"2024-09-10T06:28:48.381022+0000","last_undegraded":"2024-09-10T06:28:48.381022+0000","last_fullsized":"2024-09-10T06:28:48.381022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:40.653642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"62'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454263+0000","last_change":"2024-09-10T06:26:32.276392+0000","last_active":"2024-09-10T06:28:48.454263+0000","last_peered":"2024-09-10T06:28:48.454263+0000","last_clean":"2024-09-10T06:28:48.454263+0000","last_became_active":"2024-09-10T06:26:32.275855+0000","last_became_peered":"2024-09-10T06:26:32.275855+0000","last_unstale":"2024-09-10T06:28:48.454263+0000","last_undegraded":"2024-09-10T06:28:48.454263+0000","last_fullsized":"2024-09-10T06:28:48.454263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:34.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"73'11","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456654+0000","last_change":"2024-09-10T06:26:30.591577+0000","last_active":"2024-09-10T06:28:48.456654+0000","last_peered":"2024-09-10T06:28:48.456654+0000","last_clean":"2024-09-10T06:28:48.456654+0000","last_became_active":"2024-09-10T06:26:30.590801+0000","last_became_peered":"2024-09-10T06:26:30.590801+0000","last_unstale":"2024-09-10T06:28:48.456654+0000","last_undegraded":"2024-09-10T06:28:48.456654+0000","last_fullsized":"2024-09-10T06:28:48.456654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:16.066664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453895+0000","last_change":"2024-09-10T06:26:32.268621+0000","last_active":"2024-09-10T06:28:48.453895+0000","last_peered":"2024-09-10T06:28:48.453895+0000","last_clean":"2024-09-10T06:28:48.453895+0000","last_became_active":"2024-09-10T06:26:32.267915+0000","last_became_peered":"2024-09-10T06:26:32.267915+0000","last_unstale":"2024-09-10T06:28:48.453895+0000","last_undegraded":"2024-09-10T06:28:48.453895+0000","last_fullsized":"2024-09-10T06:28:48.453895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:10.670492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"73'10","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452875+0000","last_change":"2024-09-10T06:26:30.593794+0000","last_active":"2024-09-10T06:28:48.452875+0000","last_peered":"2024-09-10T06:28:48.452875+0000","last_clean":"2024-09-10T06:28:48.452875+0000","last_became_active":"2024-09-10T06:26:30.593506+0000","last_became_peered":"2024-09-10T06:26:30.593506+0000","last_unstale":"2024-09-10T06:28:48.452875+0000","last_undegraded":"2024-09-10T06:28:48.452875+0000","last_fullsized":"2024-09-10T06:28:48.452875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:29.521578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'6","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459260+0000","last_change":"2024-09-10T06:26:32.288497+0000","last_active":"2024-09-10T06:28:48.459260+0000","last_peered":"2024-09-10T06:28:48.459260+0000","last_clean":"2024-09-10T06:28:48.459260+0000","last_became_active":"2024-09-10T06:26:32.287839+0000","last_became_peered":"2024-09-10T06:26:32.287839+0000","last_unstale":"2024-09-10T06:28:48.459260+0000","last_undegraded":"2024-09-10T06:28:48.459260+0000","last_fullsized":"2024-09-10T06:28:48.459260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"72'5","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454219+0000","last_change":"2024-09-10T06:28:09.627267+0000","last_active":"2024-09-10T06:28:48.454219+0000","last_peered":"2024-09-10T06:28:48.454219+0000","last_clean":"2024-09-10T06:28:48.454219+0000","last_became_active":"2024-09-10T06:28:09.544344+0000","last_became_peered":"2024-09-10T06:28:09.544344+0000","last_unstale":"2024-09-10T06:28:48.454219+0000","last_undegraded":"2024-09-10T06:28:48.454219+0000","last_fullsized":"2024-09-10T06:28:48.454219+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:57.591444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"62'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454143+0000","last_change":"2024-09-10T06:26:32.272921+0000","last_active":"2024-09-10T06:28:48.454143+0000","last_peered":"2024-09-10T06:28:48.454143+0000","last_clean":"2024-09-10T06:28:48.454143+0000","last_became_active":"2024-09-10T06:26:32.272279+0000","last_became_peered":"2024-09-10T06:26:32.272279+0000","last_unstale":"2024-09-10T06:28:48.454143+0000","last_undegraded":"2024-09-10T06:28:48.454143+0000","last_fullsized":"2024-09-10T06:28:48.454143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:11.951551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"73'12","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376254+0000","last_change":"2024-09-10T06:26:30.579541+0000","last_active":"2024-09-10T06:28:48.376254+0000","last_peered":"2024-09-10T06:28:48.376254+0000","last_clean":"2024-09-10T06:28:48.376254+0000","last_became_active":"2024-09-10T06:26:30.579189+0000","last_became_peered":"2024-09-10T06:26:30.579189+0000","last_unstale":"2024-09-10T06:28:48.376254+0000","last_undegraded":"2024-09-10T06:28:48.376254+0000","last_fullsized":"2024-09-10T06:28:48.376254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:18.099885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377659+0000","last_change":"2024-09-10T06:26:32.260098+0000","last_active":"2024-09-10T06:28:48.377659+0000","last_peered":"2024-09-10T06:28:48.377659+0000","last_clean":"2024-09-10T06:28:48.377659+0000","last_became_active":"2024-09-10T06:26:32.259644+0000","last_became_peered":"2024-09-10T06:26:32.259644+0000","last_unstale":"2024-09-10T06:28:48.377659+0000","last_undegraded":"2024-09-10T06:28:48.377659+0000","last_fullsized":"2024-09-10T06:28:48.377659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"72'11","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378625+0000","last_change":"2024-09-10T06:26:30.576146+0000","last_active":"2024-09-10T06:28:48.378625+0000","last_peered":"2024-09-10T06:28:48.378625+0000","last_clean":"2024-09-10T06:28:48.378625+0000","last_became_active":"2024-09-10T06:26:30.575605+0000","last_became_peered":"2024-09-10T06:26:30.575605+0000","last_unstale":"2024-09-10T06:28:48.378625+0000","last_undegraded":"2024-09-10T06:28:48.378625+0000","last_fullsized":"2024-09-10T06:28:48.378625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"76'10","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378536+0000","last_change":"2024-09-10T06:26:32.277577+0000","last_active":"2024-09-10T06:28:48.378536+0000","last_peered":"2024-09-10T06:28:48.378536+0000","last_clean":"2024-09-10T06:28:48.378536+0000","last_became_active":"2024-09-10T06:26:32.272454+0000","last_became_peered":"2024-09-10T06:26:32.272454+0000","last_unstale":"2024-09-10T06:28:48.378536+0000","last_undegraded":"2024-09-10T06:28:48.378536+0000","last_fullsized":"2024-09-10T06:28:48.378536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"73'6","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454604+0000","last_change":"2024-09-10T06:26:30.579134+0000","last_active":"2024-09-10T06:28:48.454604+0000","last_peered":"2024-09-10T06:28:48.454604+0000","last_clean":"2024-09-10T06:28:48.454604+0000","last_became_active":"2024-09-10T06:26:30.578732+0000","last_became_peered":"2024-09-10T06:26:30.578732+0000","last_unstale":"2024-09-10T06:28:48.454604+0000","last_undegraded":"2024-09-10T06:28:48.454604+0000","last_fullsized":"2024-09-10T06:28:48.454604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:08.832907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375228+0000","last_change":"2024-09-10T06:26:32.270804+0000","last_active":"2024-09-10T06:28:48.375228+0000","last_peered":"2024-09-10T06:28:48.375228+0000","last_clean":"2024-09-10T06:28:48.375228+0000","last_became_active":"2024-09-10T06:26:32.270327+0000","last_became_peered":"2024-09-10T06:26:32.270327+0000","last_unstale":"2024-09-10T06:28:48.375228+0000","last_undegraded":"2024-09-10T06:28:48.375228+0000","last_fullsized":"2024-09-10T06:28:48.375228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"72'6","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459860+0000","last_change":"2024-09-10T06:26:30.598004+0000","last_active":"2024-09-10T06:28:48.459860+0000","last_peered":"2024-09-10T06:28:48.459860+0000","last_clean":"2024-09-10T06:28:48.459860+0000","last_became_active":"2024-09-10T06:26:30.596254+0000","last_became_peered":"2024-09-10T06:26:30.596254+0000","last_unstale":"2024-09-10T06:28:48.459860+0000","last_undegraded":"2024-09-10T06:28:48.459860+0000","last_fullsized":"2024-09-10T06:28:48.459860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'2","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456398+0000","last_change":"2024-09-10T06:26:32.284215+0000","last_active":"2024-09-10T06:28:48.456398+0000","last_peered":"2024-09-10T06:28:48.456398+0000","last_clean":"2024-09-10T06:28:48.456398+0000","last_became_active":"2024-09-10T06:26:32.275133+0000","last_became_peered":"2024-09-10T06:26:32.275133+0000","last_unstale":"2024-09-10T06:28:48.456398+0000","last_undegraded":"2024-09-10T06:28:48.456398+0000","last_fullsized":"2024-09-10T06:28:48.456398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:37.703268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"73'9","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379658+0000","last_change":"2024-09-10T06:26:30.580586+0000","last_active":"2024-09-10T06:28:48.379658+0000","last_peered":"2024-09-10T06:28:48.379658+0000","last_clean":"2024-09-10T06:28:48.379658+0000","last_became_active":"2024-09-10T06:26:30.580134+0000","last_became_peered":"2024-09-10T06:26:30.580134+0000","last_unstale":"2024-09-10T06:28:48.379658+0000","last_undegraded":"2024-09-10T06:28:48.379658+0000","last_fullsized":"2024-09-10T06:28:48.379658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378230+0000","last_change":"2024-09-10T06:26:32.256538+0000","last_active":"2024-09-10T06:28:48.378230+0000","last_peered":"2024-09-10T06:28:48.378230+0000","last_clean":"2024-09-10T06:28:48.378230+0000","last_became_active":"2024-09-10T06:26:32.256052+0000","last_became_peered":"2024-09-10T06:26:32.256052+0000","last_unstale":"2024-09-10T06:28:48.378230+0000","last_undegraded":"2024-09-10T06:28:48.378230+0000","last_fullsized":"2024-09-10T06:28:48.378230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:14.620472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"73'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457141+0000","last_change":"2024-09-10T06:26:30.585220+0000","last_active":"2024-09-10T06:28:48.457141+0000","last_peered":"2024-09-10T06:28:48.457141+0000","last_clean":"2024-09-10T06:28:48.457141+0000","last_became_active":"2024-09-10T06:26:30.584443+0000","last_became_peered":"2024-09-10T06:26:30.584443+0000","last_unstale":"2024-09-10T06:28:48.457141+0000","last_undegraded":"2024-09-10T06:28:48.457141+0000","last_fullsized":"2024-09-10T06:28:48.457141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380479+0000","last_change":"2024-09-10T06:26:32.259306+0000","last_active":"2024-09-10T06:28:48.380479+0000","last_peered":"2024-09-10T06:28:48.380479+0000","last_clean":"2024-09-10T06:28:48.380479+0000","last_became_active":"2024-09-10T06:26:32.258513+0000","last_became_peered":"2024-09-10T06:26:32.258513+0000","last_unstale":"2024-09-10T06:28:48.380479+0000","last_undegraded":"2024-09-10T06:28:48.380479+0000","last_fullsized":"2024-09-10T06:28:48.380479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"73'7","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376110+0000","last_change":"2024-09-10T06:26:30.581285+0000","last_active":"2024-09-10T06:28:48.376110+0000","last_peered":"2024-09-10T06:28:48.376110+0000","last_clean":"2024-09-10T06:28:48.376110+0000","last_became_active":"2024-09-10T06:26:30.580913+0000","last_became_peered":"2024-09-10T06:26:30.580913+0000","last_unstale":"2024-09-10T06:28:48.376110+0000","last_undegraded":"2024-09-10T06:28:48.376110+0000","last_fullsized":"2024-09-10T06:28:48.376110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"76'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455519+0000","last_change":"2024-09-10T06:26:32.274773+0000","last_active":"2024-09-10T06:28:48.455519+0000","last_peered":"2024-09-10T06:28:48.455519+0000","last_clean":"2024-09-10T06:28:48.455519+0000","last_became_active":"2024-09-10T06:26:32.274327+0000","last_became_peered":"2024-09-10T06:26:32.274327+0000","last_unstale":"2024-09-10T06:28:48.455519+0000","last_undegraded":"2024-09-10T06:28:48.455519+0000","last_fullsized":"2024-09-10T06:28:48.455519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:54.026434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"73'6","reported_seq":122,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454426+0000","last_change":"2024-09-10T06:27:08.592940+0000","last_active":"2024-09-10T06:28:48.454426+0000","last_peered":"2024-09-10T06:28:48.454426+0000","last_clean":"2024-09-10T06:28:48.454426+0000","last_became_active":"2024-09-10T06:27:08.592637+0000","last_became_peered":"2024-09-10T06:27:08.592637+0000","last_unstale":"2024-09-10T06:28:48.454426+0000","last_undegraded":"2024-09-10T06:28:48.454426+0000","last_fullsized":"2024-09-10T06:28:48.454426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:06.335302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380493+0000","last_change":"2024-09-10T06:26:32.279474+0000","last_active":"2024-09-10T06:28:48.380493+0000","last_peered":"2024-09-10T06:28:48.380493+0000","last_clean":"2024-09-10T06:28:48.380493+0000","last_became_active":"2024-09-10T06:26:32.278461+0000","last_became_peered":"2024-09-10T06:26:32.278461+0000","last_unstale":"2024-09-10T06:28:48.380493+0000","last_undegraded":"2024-09-10T06:28:48.380493+0000","last_fullsized":"2024-09-10T06:28:48.380493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"73'8","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376355+0000","last_change":"2024-09-10T06:26:30.605519+0000","last_active":"2024-09-10T06:28:48.376355+0000","last_peered":"2024-09-10T06:28:48.376355+0000","last_clean":"2024-09-10T06:28:48.376355+0000","last_became_active":"2024-09-10T06:26:30.605225+0000","last_became_peered":"2024-09-10T06:26:30.605225+0000","last_unstale":"2024-09-10T06:28:48.376355+0000","last_undegraded":"2024-09-10T06:28:48.376355+0000","last_fullsized":"2024-09-10T06:28:48.376355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"64'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462698+0000","last_change":"2024-09-10T06:26:32.267201+0000","last_active":"2024-09-10T06:28:48.462698+0000","last_peered":"2024-09-10T06:28:48.462698+0000","last_clean":"2024-09-10T06:28:48.462698+0000","last_became_active":"2024-09-10T06:26:32.266234+0000","last_became_peered":"2024-09-10T06:26:32.266234+0000","last_unstale":"2024-09-10T06:28:48.462698+0000","last_undegraded":"2024-09-10T06:28:48.462698+0000","last_fullsized":"2024-09-10T06:28:48.462698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"72'10","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458276+0000","last_change":"2024-09-10T06:26:30.596647+0000","last_active":"2024-09-10T06:28:48.458276+0000","last_peered":"2024-09-10T06:28:48.458276+0000","last_clean":"2024-09-10T06:28:48.458276+0000","last_became_active":"2024-09-10T06:26:30.593598+0000","last_became_peered":"2024-09-10T06:26:30.593598+0000","last_unstale":"2024-09-10T06:28:48.458276+0000","last_undegraded":"2024-09-10T06:28:48.458276+0000","last_fullsized":"2024-09-10T06:28:48.458276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"76'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375198+0000","last_change":"2024-09-10T06:26:32.278317+0000","last_active":"2024-09-10T06:28:48.375198+0000","last_peered":"2024-09-10T06:28:48.375198+0000","last_clean":"2024-09-10T06:28:48.375198+0000","last_became_active":"2024-09-10T06:26:32.278032+0000","last_became_peered":"2024-09-10T06:26:32.278032+0000","last_unstale":"2024-09-10T06:28:48.375198+0000","last_undegraded":"2024-09-10T06:28:48.375198+0000","last_fullsized":"2024-09-10T06:28:48.375198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:00.200118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"72'9","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464311+0000","last_change":"2024-09-10T06:26:30.580552+0000","last_active":"2024-09-10T06:28:48.464311+0000","last_peered":"2024-09-10T06:28:48.464311+0000","last_clean":"2024-09-10T06:28:48.464311+0000","last_became_active":"2024-09-10T06:26:30.579319+0000","last_became_peered":"2024-09-10T06:26:30.579319+0000","last_unstale":"2024-09-10T06:28:48.464311+0000","last_undegraded":"2024-09-10T06:28:48.464311+0000","last_fullsized":"2024-09-10T06:28:48.464311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:59.885311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"67'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375088+0000","last_change":"2024-09-10T06:26:32.257601+0000","last_active":"2024-09-10T06:28:48.375088+0000","last_peered":"2024-09-10T06:28:48.375088+0000","last_clean":"2024-09-10T06:28:48.375088+0000","last_became_active":"2024-09-10T06:26:32.256851+0000","last_became_peered":"2024-09-10T06:26:32.256851+0000","last_unstale":"2024-09-10T06:28:48.375088+0000","last_undegraded":"2024-09-10T06:28:48.375088+0000","last_fullsized":"2024-09-10T06:28:48.375088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"73'12","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455655+0000","last_change":"2024-09-10T06:28:47.047609+0000","last_active":"2024-09-10T06:28:48.455655+0000","last_peered":"2024-09-10T06:28:48.455655+0000","last_clean":"2024-09-10T06:28:48.455655+0000","last_became_active":"2024-09-10T06:28:46.326501+0000","last_became_peered":"2024-09-10T06:28:46.326501+0000","last_unstale":"2024-09-10T06:28:48.455655+0000","last_undegraded":"2024-09-10T06:28:48.455655+0000","last_fullsized":"2024-09-10T06:28:48.455655+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:33.793329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"62'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455403+0000","last_change":"2024-09-10T06:26:32.266768+0000","last_active":"2024-09-10T06:28:48.455403+0000","last_peered":"2024-09-10T06:28:48.455403+0000","last_clean":"2024-09-10T06:28:48.455403+0000","last_became_active":"2024-09-10T06:26:32.266000+0000","last_became_peered":"2024-09-10T06:26:32.266000+0000","last_unstale":"2024-09-10T06:28:48.455403+0000","last_undegraded":"2024-09-10T06:28:48.455403+0000","last_fullsized":"2024-09-10T06:28:48.455403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"72'9","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460809+0000","last_change":"2024-09-10T06:26:30.610309+0000","last_active":"2024-09-10T06:28:48.460809+0000","last_peered":"2024-09-10T06:28:48.460809+0000","last_clean":"2024-09-10T06:28:48.460809+0000","last_became_active":"2024-09-10T06:26:30.609674+0000","last_became_peered":"2024-09-10T06:26:30.609674+0000","last_unstale":"2024-09-10T06:28:48.460809+0000","last_undegraded":"2024-09-10T06:28:48.460809+0000","last_fullsized":"2024-09-10T06:28:48.460809+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"73'10","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457073+0000","last_change":"2024-09-10T06:26:30.591365+0000","last_active":"2024-09-10T06:28:48.457073+0000","last_peered":"2024-09-10T06:28:48.457073+0000","last_clean":"2024-09-10T06:28:48.457073+0000","last_became_active":"2024-09-10T06:26:30.590640+0000","last_became_peered":"2024-09-10T06:26:30.590640+0000","last_unstale":"2024-09-10T06:28:48.457073+0000","last_undegraded":"2024-09-10T06:28:48.457073+0000","last_fullsized":"2024-09-10T06:28:48.457073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"67'10","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378178+0000","last_change":"2024-09-10T06:26:32.267333+0000","last_active":"2024-09-10T06:28:48.378178+0000","last_peered":"2024-09-10T06:28:48.378178+0000","last_clean":"2024-09-10T06:28:48.378178+0000","last_became_active":"2024-09-10T06:26:32.266876+0000","last_became_peered":"2024-09-10T06:26:32.266876+0000","last_unstale":"2024-09-10T06:28:48.378178+0000","last_undegraded":"2024-09-10T06:28:48.378178+0000","last_fullsized":"2024-09-10T06:28:48.378178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:02.483639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"73'13","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453736+0000","last_change":"2024-09-10T06:26:30.590924+0000","last_active":"2024-09-10T06:28:48.453736+0000","last_peered":"2024-09-10T06:28:48.453736+0000","last_clean":"2024-09-10T06:28:48.453736+0000","last_became_active":"2024-09-10T06:26:30.590415+0000","last_became_peered":"2024-09-10T06:26:30.590415+0000","last_unstale":"2024-09-10T06:28:48.453736+0000","last_undegraded":"2024-09-10T06:28:48.453736+0000","last_fullsized":"2024-09-10T06:28:48.453736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:32.460291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460331+0000","last_change":"2024-09-10T06:26:32.283339+0000","last_active":"2024-09-10T06:28:48.460331+0000","last_peered":"2024-09-10T06:28:48.460331+0000","last_clean":"2024-09-10T06:28:48.460331+0000","last_became_active":"2024-09-10T06:26:32.282581+0000","last_became_peered":"2024-09-10T06:26:32.282581+0000","last_unstale":"2024-09-10T06:28:48.460331+0000","last_undegraded":"2024-09-10T06:28:48.460331+0000","last_fullsized":"2024-09-10T06:28:48.460331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":816,"ondisk_log_size":816,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":160287,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":814,"num_read_kb":573,"num_write":459,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":272742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":669,"ondisk_log_size":669,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":334,"num_read_kb":334,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":567,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2397044736,"num_objects":572,"num_object_clones":0,"num_object_copies":1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":572,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":632,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":209715200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4794089472,"data_stored":4794089472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542184,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":651436,"kb_used_data":620252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93720404,"statfs":{"total":96636764160,"available":95969693696,"internally_reserved":0,"allocated":635138048,"data_stored":634594233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542184,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":536120,"kb_used_data":504936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93835720,"statfs":{"total":96636764160,"available":96087777280,"internally_reserved":0,"allocated":517054464,"data_stored":516546322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":700068,"kb_used_data":668884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93671772,"statfs":{"total":96636764160,"available":95919894528,"internally_reserved":0,"allocated":684937216,"data_stored":684376545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":757300,"kb_used_data":726108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93614540,"statfs":{"total":96636764160,"available":95861288960,"internally_reserved":0,"allocated":743534592,"data_stored":743038236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":710344,"kb_used_data":679160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93661496,"statfs":{"total":96636764160,"available":95909371904,"internally_reserved":0,"allocated":695459840,"data_stored":694924989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":433712,"kb_used_data":402528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93938128,"statfs":{"total":96636764160,"available":96192643072,"internally_reserved":0,"allocated":412188672,"data_stored":411692893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":439880,"kb_used_data":408696,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93931960,"statfs":{"total":96636764160,"available":96186327040,"internally_reserved":0,"allocated":418504704,"data_stored":417979454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":712908,"kb_used_data":681716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93658932,"statfs":{"total":96636764160,"available":95906746368,"internally_reserved":0,"allocated":698077184,"data_stored":697554526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":696254464,"data_stored":696254464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":417333248,"data_stored":417333248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":411041792,"data_stored":411041792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":694157312,"data_stored":694157312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":742391808,"data_stored":742391808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":683671552,"data_stored":683671552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":515899392,"data_stored":515899392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":633339904,"data_stored":633339904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":5932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":122118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":59667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":18838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:29:19.137 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T06:29:19.483 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:29:19.483 INFO:teuthology.orchestra.run.smithi112.stdout:{"epoch":95,"fsid":"be773357-a22c-4a27-af42-3fbac58c722b","created":"2024-09-10T06:26:02.514361+0000","modified":"2024-09-10T06:28:48.361520+0000","last_up_change":"2024-09-10T06:26:15.419770+0000","last_in_change":"2024-09-10T06:26:05.513752+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T06:26:15.461819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T06:26:21.721813+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-10T06:26:29.046847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-10T06:26:30.892297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-10T06:26:32.542139+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-10T06:26:34.398475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-10T06:26:36.315894+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-10T06:26:38.424525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"27b822ad-8298-4dd0-be44-f898fd6b155b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6816","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6817","nonce":1694936705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6818","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6819","nonce":1694936705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6822","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6823","nonce":1694936705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6820","nonce":1694936705},{"type":"v1","addr":"172.21.15.112:6821","nonce":1694936705}]},"public_addr":"172.21.15.112:6817/1694936705","cluster_addr":"172.21.15.112:6819/1694936705","heartbeat_back_addr":"172.21.15.112:6823/1694936705","heartbeat_front_addr":"172.21.15.112:6821/1694936705","state":["exists","up"]},{"osd":1,"uuid":"68108054-a914-4f7c-a6dd-1e8a2775cff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6824","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6825","nonce":3700063340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6826","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6827","nonce":3700063340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6830","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6831","nonce":3700063340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6828","nonce":3700063340},{"type":"v1","addr":"172.21.15.112:6829","nonce":3700063340}]},"public_addr":"172.21.15.112:6825/3700063340","cluster_addr":"172.21.15.112:6827/3700063340","heartbeat_back_addr":"172.21.15.112:6831/3700063340","heartbeat_front_addr":"172.21.15.112:6829/3700063340","state":["exists","up"]},{"osd":2,"uuid":"0b12ab6c-743b-446a-92de-3d7722320117","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6808","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6809","nonce":3923792425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6810","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6811","nonce":3923792425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6814","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6815","nonce":3923792425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6812","nonce":3923792425},{"type":"v1","addr":"172.21.15.112:6813","nonce":3923792425}]},"public_addr":"172.21.15.112:6809/3923792425","cluster_addr":"172.21.15.112:6811/3923792425","heartbeat_back_addr":"172.21.15.112:6815/3923792425","heartbeat_front_addr":"172.21.15.112:6813/3923792425","state":["exists","up"]},{"osd":3,"uuid":"a468aa3a-22fb-414c-9e7c-fbe79ae3eafd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6800","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6801","nonce":3428884615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6802","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6803","nonce":3428884615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6806","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6807","nonce":3428884615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.112:6804","nonce":3428884615},{"type":"v1","addr":"172.21.15.112:6805","nonce":3428884615}]},"public_addr":"172.21.15.112:6801/3428884615","cluster_addr":"172.21.15.112:6803/3428884615","heartbeat_back_addr":"172.21.15.112:6807/3428884615","heartbeat_front_addr":"172.21.15.112:6805/3428884615","state":["exists","up"]},{"osd":4,"uuid":"e64b5d77-9d7c-4d5f-8ad6-91d3e77d5479","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6809","nonce":4200633864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6811","nonce":4200633864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6815","nonce":4200633864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":4200633864},{"type":"v1","addr":"172.21.15.120:6813","nonce":4200633864}]},"public_addr":"172.21.15.120:6809/4200633864","cluster_addr":"172.21.15.120:6811/4200633864","heartbeat_back_addr":"172.21.15.120:6815/4200633864","heartbeat_front_addr":"172.21.15.120:6813/4200633864","state":["exists","up"]},{"osd":5,"uuid":"bdcce7db-9a36-423b-9a96-368a4a6b6270","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6801","nonce":1878513652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6803","nonce":1878513652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6807","nonce":1878513652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":1878513652},{"type":"v1","addr":"172.21.15.120:6805","nonce":1878513652}]},"public_addr":"172.21.15.120:6801/1878513652","cluster_addr":"172.21.15.120:6803/1878513652","heartbeat_back_addr":"172.21.15.120:6807/1878513652","heartbeat_front_addr":"172.21.15.120:6805/1878513652","state":["exists","up"]},{"osd":6,"uuid":"8eedb98d-014b-4f07-a704-a4b01e8002cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6817","nonce":663776414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6818","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6819","nonce":663776414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6823","nonce":663776414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6820","nonce":663776414},{"type":"v1","addr":"172.21.15.120:6821","nonce":663776414}]},"public_addr":"172.21.15.120:6817/663776414","cluster_addr":"172.21.15.120:6819/663776414","heartbeat_back_addr":"172.21.15.120:6823/663776414","heartbeat_front_addr":"172.21.15.120:6821/663776414","state":["exists","up"]},{"osd":7,"uuid":"72eece21-94cd-4ed1-9f02-4d2d1edaf136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":92,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6824","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6825","nonce":4213847863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6827","nonce":4213847863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6831","nonce":4213847863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6828","nonce":4213847863},{"type":"v1","addr":"172.21.15.120:6829","nonce":4213847863}]},"public_addr":"172.21.15.120:6825/4213847863","cluster_addr":"172.21.15.120:6827/4213847863","heartbeat_back_addr":"172.21.15.120:6831/4213847863","heartbeat_front_addr":"172.21.15.120:6829/4213847863","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.186913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.656858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.014588+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.353407+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.086903+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:11.731547+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.034165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T06:26:12.207613+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":6}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T06:29:20.501 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T06:29:20.502 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T06:29:20.664 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:29:20.664 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T06:29:20.664 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:29:20.681 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T06:29:20.979 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T06:29:20.999 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T06:29:20.999 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T06:29:21.153 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:29:21.153 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T06:29:21.153 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:29:21.170 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T06:29:21.461 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T06:29:21.479 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T06:29:21.479 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T06:29:21.612 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:29:21.613 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T06:29:21.613 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:29:21.628 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T06:29:21.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-10T06:29:21.913 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T06:29:21.932 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T06:29:21.932 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T06:29:22.079 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:29:22.080 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T06:29:22.080 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:29:22.094 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T06:29:22.378 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T06:29:22.397 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T06:29:22.397 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T06:29:22.542 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:29:22.542 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T06:29:22.542 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:29:22.559 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T06:29:22.842 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T06:29:22.859 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T06:29:22.859 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T06:29:22.997 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:29:22.998 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T06:29:22.998 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:29:23.013 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T06:29:23.317 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T06:29:23.337 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T06:29:23.337 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T06:29:23.489 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:29:23.489 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T06:29:23.490 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:29:23.505 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T06:29:23.795 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T06:29:23.814 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T06:29:23.814 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T06:29:23.962 INFO:teuthology.orchestra.run.smithi112.stdout:{ 2024-09-10T06:29:23.962 INFO:teuthology.orchestra.run.smithi112.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T06:29:23.963 INFO:teuthology.orchestra.run.smithi112.stdout:} 2024-09-10T06:29:23.977 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T06:29:24.255 INFO:teuthology.orchestra.run.smithi112.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T06:29:24.273 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:29:24.587 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:29:24.596 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:29:24.612 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-10T06:29:23.476624+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":619618,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":2868,"num_read_kb":2295,"num_write":2317,"num_write_kb":2367369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":209715508,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3183,"ondisk_log_size":3183,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260024,"kb_used_data":10256,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714696,"statfs":{"total":773094113280,"available":772827848704,"internally_reserved":0,"allocated":10502144,"data_stored":6352388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2397177405,"num_objects":-572,"num_object_clones":0,"num_object_copies":-1144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-572,"num_whiteouts":0,"num_read":795,"num_read_kb":513,"num_write":648,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006049"},"pg_stats":[{"pgid":"3.3f","version":"95'24","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.876673+0000","last_change":"2024-09-10T06:27:08.597414+0000","last_active":"2024-09-10T06:29:17.876673+0000","last_peered":"2024-09-10T06:29:17.876673+0000","last_clean":"2024-09-10T06:29:17.876673+0000","last_became_active":"2024-09-10T06:27:08.597026+0000","last_became_peered":"2024-09-10T06:27:08.597026+0000","last_unstale":"2024-09-10T06:29:17.876673+0000","last_undegraded":"2024-09-10T06:29:17.876673+0000","last_fullsized":"2024-09-10T06:29:17.876673+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:07.484952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"67'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456583+0000","last_change":"2024-09-10T06:26:32.279882+0000","last_active":"2024-09-10T06:28:48.456583+0000","last_peered":"2024-09-10T06:28:48.456583+0000","last_clean":"2024-09-10T06:28:48.456583+0000","last_became_active":"2024-09-10T06:26:32.279098+0000","last_became_peered":"2024-09-10T06:26:32.279098+0000","last_unstale":"2024-09-10T06:28:48.456583+0000","last_undegraded":"2024-09-10T06:28:48.456583+0000","last_fullsized":"2024-09-10T06:28:48.456583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"95'10","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.881733+0000","last_change":"2024-09-10T06:26:30.573148+0000","last_active":"2024-09-10T06:29:17.881733+0000","last_peered":"2024-09-10T06:29:17.881733+0000","last_clean":"2024-09-10T06:29:17.881733+0000","last_became_active":"2024-09-10T06:26:30.572798+0000","last_became_peered":"2024-09-10T06:26:30.572798+0000","last_unstale":"2024-09-10T06:29:17.881733+0000","last_undegraded":"2024-09-10T06:29:17.881733+0000","last_fullsized":"2024-09-10T06:29:17.881733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:27:38.833715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"62'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457162+0000","last_change":"2024-09-10T06:26:32.276811+0000","last_active":"2024-09-10T06:28:48.457162+0000","last_peered":"2024-09-10T06:28:48.457162+0000","last_clean":"2024-09-10T06:28:48.457162+0000","last_became_active":"2024-09-10T06:26:32.275990+0000","last_became_peered":"2024-09-10T06:26:32.275990+0000","last_unstale":"2024-09-10T06:28:48.457162+0000","last_undegraded":"2024-09-10T06:28:48.457162+0000","last_fullsized":"2024-09-10T06:28:48.457162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"95'18","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.889637+0000","last_change":"2024-09-10T06:26:30.578068+0000","last_active":"2024-09-10T06:29:17.889637+0000","last_peered":"2024-09-10T06:29:17.889637+0000","last_clean":"2024-09-10T06:29:17.889637+0000","last_became_active":"2024-09-10T06:26:30.577688+0000","last_became_peered":"2024-09-10T06:26:30.577688+0000","last_unstale":"2024-09-10T06:29:17.889637+0000","last_undegraded":"2024-09-10T06:29:17.889637+0000","last_fullsized":"2024-09-10T06:29:17.889637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:34.137079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":26,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377720+0000","last_change":"2024-09-10T06:26:32.256939+0000","last_active":"2024-09-10T06:28:48.377720+0000","last_peered":"2024-09-10T06:28:48.377720+0000","last_clean":"2024-09-10T06:28:48.377720+0000","last_became_active":"2024-09-10T06:26:32.256117+0000","last_became_peered":"2024-09-10T06:26:32.256117+0000","last_unstale":"2024-09-10T06:28:48.377720+0000","last_undegraded":"2024-09-10T06:28:48.377720+0000","last_fullsized":"2024-09-10T06:28:48.377720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:51.879604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"95'22","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.809344+0000","last_change":"2024-09-10T06:26:30.593697+0000","last_active":"2024-09-10T06:29:17.809344+0000","last_peered":"2024-09-10T06:29:17.809344+0000","last_clean":"2024-09-10T06:29:17.809344+0000","last_became_active":"2024-09-10T06:26:30.591807+0000","last_became_peered":"2024-09-10T06:26:30.591807+0000","last_unstale":"2024-09-10T06:29:17.809344+0000","last_undegraded":"2024-09-10T06:29:17.809344+0000","last_fullsized":"2024-09-10T06:29:17.809344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376230+0000","last_change":"2024-09-10T06:26:32.264685+0000","last_active":"2024-09-10T06:28:48.376230+0000","last_peered":"2024-09-10T06:28:48.376230+0000","last_clean":"2024-09-10T06:28:48.376230+0000","last_became_active":"2024-09-10T06:26:32.264199+0000","last_became_peered":"2024-09-10T06:26:32.264199+0000","last_unstale":"2024-09-10T06:28:48.376230+0000","last_undegraded":"2024-09-10T06:28:48.376230+0000","last_fullsized":"2024-09-10T06:28:48.376230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:20.713066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"95'14","reported_seq":78,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.864965+0000","last_change":"2024-09-10T06:28:09.653122+0000","last_active":"2024-09-10T06:29:17.864965+0000","last_peered":"2024-09-10T06:29:17.864965+0000","last_clean":"2024-09-10T06:29:17.864965+0000","last_became_active":"2024-09-10T06:28:09.546624+0000","last_became_peered":"2024-09-10T06:28:09.546624+0000","last_unstale":"2024-09-10T06:29:17.864965+0000","last_undegraded":"2024-09-10T06:29:17.864965+0000","last_fullsized":"2024-09-10T06:29:17.864965+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:18:57.805994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"67'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458405+0000","last_change":"2024-09-10T06:26:32.290741+0000","last_active":"2024-09-10T06:28:48.458405+0000","last_peered":"2024-09-10T06:28:48.458405+0000","last_clean":"2024-09-10T06:28:48.458405+0000","last_became_active":"2024-09-10T06:26:32.289840+0000","last_became_peered":"2024-09-10T06:26:32.289840+0000","last_unstale":"2024-09-10T06:28:48.458405+0000","last_undegraded":"2024-09-10T06:28:48.458405+0000","last_fullsized":"2024-09-10T06:28:48.458405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"95'12","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.745009+0000","last_change":"2024-09-10T06:26:30.609817+0000","last_active":"2024-09-10T06:29:17.745009+0000","last_peered":"2024-09-10T06:29:17.745009+0000","last_clean":"2024-09-10T06:29:17.745009+0000","last_became_active":"2024-09-10T06:26:30.603330+0000","last_became_peered":"2024-09-10T06:26:30.603330+0000","last_unstale":"2024-09-10T06:29:17.745009+0000","last_undegraded":"2024-09-10T06:29:17.745009+0000","last_fullsized":"2024-09-10T06:29:17.745009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:09.523045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"67'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380006+0000","last_change":"2024-09-10T06:26:32.257050+0000","last_active":"2024-09-10T06:28:48.380006+0000","last_peered":"2024-09-10T06:28:48.380006+0000","last_clean":"2024-09-10T06:28:48.380006+0000","last_became_active":"2024-09-10T06:26:32.254437+0000","last_became_peered":"2024-09-10T06:26:32.254437+0000","last_unstale":"2024-09-10T06:28:48.380006+0000","last_undegraded":"2024-09-10T06:28:48.380006+0000","last_fullsized":"2024-09-10T06:28:48.380006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"95'26","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.897968+0000","last_change":"2024-09-10T06:26:30.579756+0000","last_active":"2024-09-10T06:29:17.897968+0000","last_peered":"2024-09-10T06:29:17.897968+0000","last_clean":"2024-09-10T06:29:17.897968+0000","last_became_active":"2024-09-10T06:26:30.578033+0000","last_became_peered":"2024-09-10T06:26:30.578033+0000","last_unstale":"2024-09-10T06:29:17.897968+0000","last_undegraded":"2024-09-10T06:29:17.897968+0000","last_fullsized":"2024-09-10T06:29:17.897968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":34,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460066+0000","last_change":"2024-09-10T06:26:32.281248+0000","last_active":"2024-09-10T06:28:48.460066+0000","last_peered":"2024-09-10T06:28:48.460066+0000","last_clean":"2024-09-10T06:28:48.460066+0000","last_became_active":"2024-09-10T06:26:32.280480+0000","last_became_peered":"2024-09-10T06:26:32.280480+0000","last_unstale":"2024-09-10T06:28:48.460066+0000","last_undegraded":"2024-09-10T06:28:48.460066+0000","last_fullsized":"2024-09-10T06:28:48.460066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"95'16","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.864392+0000","last_change":"2024-09-10T06:26:30.593213+0000","last_active":"2024-09-10T06:29:17.864392+0000","last_peered":"2024-09-10T06:29:17.864392+0000","last_clean":"2024-09-10T06:29:17.864392+0000","last_became_active":"2024-09-10T06:26:30.592770+0000","last_became_peered":"2024-09-10T06:26:30.592770+0000","last_unstale":"2024-09-10T06:29:17.864392+0000","last_undegraded":"2024-09-10T06:29:17.864392+0000","last_fullsized":"2024-09-10T06:29:17.864392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'10","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456049+0000","last_change":"2024-09-10T06:26:32.267430+0000","last_active":"2024-09-10T06:28:48.456049+0000","last_peered":"2024-09-10T06:28:48.456049+0000","last_clean":"2024-09-10T06:28:48.456049+0000","last_became_active":"2024-09-10T06:26:32.265788+0000","last_became_peered":"2024-09-10T06:26:32.265788+0000","last_unstale":"2024-09-10T06:28:48.456049+0000","last_undegraded":"2024-09-10T06:28:48.456049+0000","last_fullsized":"2024-09-10T06:28:48.456049+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:17:19.180142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'10","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377130+0000","last_change":"2024-09-10T06:26:32.255038+0000","last_active":"2024-09-10T06:28:48.377130+0000","last_peered":"2024-09-10T06:28:48.377130+0000","last_clean":"2024-09-10T06:28:48.377130+0000","last_became_active":"2024-09-10T06:26:32.254281+0000","last_became_peered":"2024-09-10T06:26:32.254281+0000","last_unstale":"2024-09-10T06:28:48.377130+0000","last_undegraded":"2024-09-10T06:28:48.377130+0000","last_fullsized":"2024-09-10T06:28:48.377130+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:46.363171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"95'18","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.841844+0000","last_change":"2024-09-10T06:26:30.607280+0000","last_active":"2024-09-10T06:29:17.841844+0000","last_peered":"2024-09-10T06:29:17.841844+0000","last_clean":"2024-09-10T06:29:17.841844+0000","last_became_active":"2024-09-10T06:26:30.605602+0000","last_became_peered":"2024-09-10T06:26:30.605602+0000","last_unstale":"2024-09-10T06:29:17.841844+0000","last_undegraded":"2024-09-10T06:29:17.841844+0000","last_fullsized":"2024-09-10T06:29:17.841844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:49.865234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457377+0000","last_change":"2024-09-10T06:26:32.275913+0000","last_active":"2024-09-10T06:28:48.457377+0000","last_peered":"2024-09-10T06:28:48.457377+0000","last_clean":"2024-09-10T06:28:48.457377+0000","last_became_active":"2024-09-10T06:26:32.274264+0000","last_became_peered":"2024-09-10T06:26:32.274264+0000","last_unstale":"2024-09-10T06:28:48.457377+0000","last_undegraded":"2024-09-10T06:28:48.457377+0000","last_fullsized":"2024-09-10T06:28:48.457377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'10","reported_seq":32,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.849414+0000","last_change":"2024-09-10T06:28:46.509018+0000","last_active":"2024-09-10T06:29:17.849414+0000","last_peered":"2024-09-10T06:29:17.849414+0000","last_clean":"2024-09-10T06:29:17.849414+0000","last_became_active":"2024-09-10T06:28:46.332355+0000","last_became_peered":"2024-09-10T06:28:46.332355+0000","last_unstale":"2024-09-10T06:29:17.849414+0000","last_undegraded":"2024-09-10T06:29:17.849414+0000","last_fullsized":"2024-09-10T06:29:17.849414+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:28:54.077676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459140+0000","last_change":"2024-09-10T06:26:32.279079+0000","last_active":"2024-09-10T06:28:48.459140+0000","last_peered":"2024-09-10T06:28:48.459140+0000","last_clean":"2024-09-10T06:28:48.459140+0000","last_became_active":"2024-09-10T06:26:32.278407+0000","last_became_peered":"2024-09-10T06:26:32.278407+0000","last_unstale":"2024-09-10T06:28:48.459140+0000","last_undegraded":"2024-09-10T06:28:48.459140+0000","last_fullsized":"2024-09-10T06:28:48.459140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"95'20","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.898253+0000","last_change":"2024-09-10T06:26:30.607368+0000","last_active":"2024-09-10T06:29:17.898253+0000","last_peered":"2024-09-10T06:29:17.898253+0000","last_clean":"2024-09-10T06:29:17.898253+0000","last_became_active":"2024-09-10T06:26:30.606807+0000","last_became_peered":"2024-09-10T06:26:30.606807+0000","last_unstale":"2024-09-10T06:29:17.898253+0000","last_undegraded":"2024-09-10T06:29:17.898253+0000","last_fullsized":"2024-09-10T06:29:17.898253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:05:28.564681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"76'8","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454841+0000","last_change":"2024-09-10T06:27:08.801987+0000","last_active":"2024-09-10T06:28:48.454841+0000","last_peered":"2024-09-10T06:28:48.454841+0000","last_clean":"2024-09-10T06:28:48.454841+0000","last_became_active":"2024-09-10T06:27:08.801461+0000","last_became_peered":"2024-09-10T06:27:08.801461+0000","last_unstale":"2024-09-10T06:28:48.454841+0000","last_undegraded":"2024-09-10T06:28:48.454841+0000","last_fullsized":"2024-09-10T06:28:48.454841+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"95'22","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.892618+0000","last_change":"2024-09-10T06:26:30.598381+0000","last_active":"2024-09-10T06:29:17.892618+0000","last_peered":"2024-09-10T06:29:17.892618+0000","last_clean":"2024-09-10T06:29:17.892618+0000","last_became_active":"2024-09-10T06:26:30.597271+0000","last_became_peered":"2024-09-10T06:26:30.597271+0000","last_unstale":"2024-09-10T06:29:17.892618+0000","last_undegraded":"2024-09-10T06:29:17.892618+0000","last_fullsized":"2024-09-10T06:29:17.892618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:59.908548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455123+0000","last_change":"2024-09-10T06:26:32.247492+0000","last_active":"2024-09-10T06:28:48.455123+0000","last_peered":"2024-09-10T06:28:48.455123+0000","last_clean":"2024-09-10T06:28:48.455123+0000","last_became_active":"2024-09-10T06:26:32.246938+0000","last_became_peered":"2024-09-10T06:26:32.246938+0000","last_unstale":"2024-09-10T06:28:48.455123+0000","last_undegraded":"2024-09-10T06:28:48.455123+0000","last_fullsized":"2024-09-10T06:28:48.455123+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:59:01.766868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"95'22","reported_seq":228,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.903737+0000","last_change":"2024-09-10T06:28:46.662120+0000","last_active":"2024-09-10T06:29:17.903737+0000","last_peered":"2024-09-10T06:29:17.903737+0000","last_clean":"2024-09-10T06:29:17.903737+0000","last_became_active":"2024-09-10T06:28:46.326710+0000","last_became_peered":"2024-09-10T06:28:46.326710+0000","last_unstale":"2024-09-10T06:29:17.903737+0000","last_undegraded":"2024-09-10T06:29:17.903737+0000","last_fullsized":"2024-09-10T06:29:17.903737+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:47.625969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380427+0000","last_change":"2024-09-10T06:26:32.278347+0000","last_active":"2024-09-10T06:28:48.380427+0000","last_peered":"2024-09-10T06:28:48.380427+0000","last_clean":"2024-09-10T06:28:48.380427+0000","last_became_active":"2024-09-10T06:26:32.275206+0000","last_became_peered":"2024-09-10T06:26:32.275206+0000","last_unstale":"2024-09-10T06:28:48.380427+0000","last_undegraded":"2024-09-10T06:28:48.380427+0000","last_fullsized":"2024-09-10T06:28:48.380427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"95'24","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.889459+0000","last_change":"2024-09-10T06:26:30.572734+0000","last_active":"2024-09-10T06:29:17.889459+0000","last_peered":"2024-09-10T06:29:17.889459+0000","last_clean":"2024-09-10T06:29:17.889459+0000","last_became_active":"2024-09-10T06:26:30.572043+0000","last_became_peered":"2024-09-10T06:26:30.572043+0000","last_unstale":"2024-09-10T06:29:17.889459+0000","last_undegraded":"2024-09-10T06:29:17.889459+0000","last_fullsized":"2024-09-10T06:29:17.889459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":32,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"76'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376329+0000","last_change":"2024-09-10T06:26:40.323476+0000","last_active":"2024-09-10T06:28:48.376329+0000","last_peered":"2024-09-10T06:28:48.376329+0000","last_clean":"2024-09-10T06:28:48.376329+0000","last_became_active":"2024-09-10T06:26:40.322711+0000","last_became_peered":"2024-09-10T06:26:40.322711+0000","last_unstale":"2024-09-10T06:28:48.376329+0000","last_undegraded":"2024-09-10T06:28:48.376329+0000","last_fullsized":"2024-09-10T06:28:48.376329+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378030+0000","last_change":"2024-09-10T06:26:32.276274+0000","last_active":"2024-09-10T06:28:48.378030+0000","last_peered":"2024-09-10T06:28:48.378030+0000","last_clean":"2024-09-10T06:28:48.378030+0000","last_became_active":"2024-09-10T06:26:32.275889+0000","last_became_peered":"2024-09-10T06:26:32.275889+0000","last_unstale":"2024-09-10T06:28:48.378030+0000","last_undegraded":"2024-09-10T06:28:48.378030+0000","last_fullsized":"2024-09-10T06:28:48.378030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"95'28","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.890163+0000","last_change":"2024-09-10T06:26:30.595738+0000","last_active":"2024-09-10T06:29:17.890163+0000","last_peered":"2024-09-10T06:29:17.890163+0000","last_clean":"2024-09-10T06:29:17.890163+0000","last_became_active":"2024-09-10T06:26:30.595128+0000","last_became_peered":"2024-09-10T06:26:30.595128+0000","last_unstale":"2024-09-10T06:29:17.890163+0000","last_undegraded":"2024-09-10T06:29:17.890163+0000","last_fullsized":"2024-09-10T06:29:17.890163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459270+0000","last_change":"2024-09-10T06:26:34.279824+0000","last_active":"2024-09-10T06:28:48.459270+0000","last_peered":"2024-09-10T06:28:48.459270+0000","last_clean":"2024-09-10T06:28:48.459270+0000","last_became_active":"2024-09-10T06:26:34.279074+0000","last_became_peered":"2024-09-10T06:26:34.279074+0000","last_unstale":"2024-09-10T06:28:48.459270+0000","last_undegraded":"2024-09-10T06:28:48.459270+0000","last_fullsized":"2024-09-10T06:28:48.459270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:40.507467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"95'18","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.517752+0000","last_change":"2024-09-10T06:26:36.296703+0000","last_active":"2024-09-10T06:29:17.517752+0000","last_peered":"2024-09-10T06:29:17.517752+0000","last_clean":"2024-09-10T06:29:17.517752+0000","last_became_active":"2024-09-10T06:26:36.295786+0000","last_became_peered":"2024-09-10T06:26:36.295786+0000","last_unstale":"2024-09-10T06:29:17.517752+0000","last_undegraded":"2024-09-10T06:29:17.517752+0000","last_fullsized":"2024-09-10T06:29:17.517752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:31.699855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464404+0000","last_change":"2024-09-10T06:26:38.305468+0000","last_active":"2024-09-10T06:28:48.464404+0000","last_peered":"2024-09-10T06:28:48.464404+0000","last_clean":"2024-09-10T06:28:48.464404+0000","last_became_active":"2024-09-10T06:26:38.304847+0000","last_became_peered":"2024-09-10T06:26:38.304847+0000","last_unstale":"2024-09-10T06:28:48.464404+0000","last_undegraded":"2024-09-10T06:28:48.464404+0000","last_fullsized":"2024-09-10T06:28:48.464404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:36.499856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456269+0000","last_change":"2024-09-10T06:26:40.331389+0000","last_active":"2024-09-10T06:28:48.456269+0000","last_peered":"2024-09-10T06:28:48.456269+0000","last_clean":"2024-09-10T06:28:48.456269+0000","last_became_active":"2024-09-10T06:26:40.330777+0000","last_became_peered":"2024-09-10T06:26:40.330777+0000","last_unstale":"2024-09-10T06:28:48.456269+0000","last_undegraded":"2024-09-10T06:28:48.456269+0000","last_fullsized":"2024-09-10T06:28:48.456269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:22.792159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459648+0000","last_change":"2024-09-10T06:26:32.283112+0000","last_active":"2024-09-10T06:28:48.459648+0000","last_peered":"2024-09-10T06:28:48.459648+0000","last_clean":"2024-09-10T06:28:48.459648+0000","last_became_active":"2024-09-10T06:26:32.282263+0000","last_became_peered":"2024-09-10T06:26:32.282263+0000","last_unstale":"2024-09-10T06:28:48.459648+0000","last_undegraded":"2024-09-10T06:28:48.459648+0000","last_fullsized":"2024-09-10T06:28:48.459648+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:02.124800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"95'14","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.863463+0000","last_change":"2024-09-10T06:26:30.576489+0000","last_active":"2024-09-10T06:29:17.863463+0000","last_peered":"2024-09-10T06:29:17.863463+0000","last_clean":"2024-09-10T06:29:17.863463+0000","last_became_active":"2024-09-10T06:26:30.576039+0000","last_became_peered":"2024-09-10T06:26:30.576039+0000","last_unstale":"2024-09-10T06:29:17.863463+0000","last_undegraded":"2024-09-10T06:29:17.863463+0000","last_fullsized":"2024-09-10T06:29:17.863463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377684+0000","last_change":"2024-09-10T06:26:34.268758+0000","last_active":"2024-09-10T06:28:48.377684+0000","last_peered":"2024-09-10T06:28:48.377684+0000","last_clean":"2024-09-10T06:28:48.377684+0000","last_became_active":"2024-09-10T06:26:34.268279+0000","last_became_peered":"2024-09-10T06:26:34.268279+0000","last_unstale":"2024-09-10T06:28:48.377684+0000","last_undegraded":"2024-09-10T06:28:48.377684+0000","last_fullsized":"2024-09-10T06:28:48.377684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:42.052702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380478+0000","last_change":"2024-09-10T06:26:36.273991+0000","last_active":"2024-09-10T06:28:48.380478+0000","last_peered":"2024-09-10T06:28:48.380478+0000","last_clean":"2024-09-10T06:28:48.380478+0000","last_became_active":"2024-09-10T06:26:36.273138+0000","last_became_peered":"2024-09-10T06:26:36.273138+0000","last_unstale":"2024-09-10T06:28:48.380478+0000","last_undegraded":"2024-09-10T06:28:48.380478+0000","last_fullsized":"2024-09-10T06:28:48.380478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379823+0000","last_change":"2024-09-10T06:26:38.294543+0000","last_active":"2024-09-10T06:28:48.379823+0000","last_peered":"2024-09-10T06:28:48.379823+0000","last_clean":"2024-09-10T06:28:48.379823+0000","last_became_active":"2024-09-10T06:26:38.293754+0000","last_became_peered":"2024-09-10T06:26:38.293754+0000","last_unstale":"2024-09-10T06:28:48.379823+0000","last_undegraded":"2024-09-10T06:28:48.379823+0000","last_fullsized":"2024-09-10T06:28:48.379823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"62'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375308+0000","last_change":"2024-09-10T06:26:40.326998+0000","last_active":"2024-09-10T06:28:48.375308+0000","last_peered":"2024-09-10T06:28:48.375308+0000","last_clean":"2024-09-10T06:28:48.375308+0000","last_became_active":"2024-09-10T06:26:40.322648+0000","last_became_peered":"2024-09-10T06:26:40.322648+0000","last_unstale":"2024-09-10T06:28:48.375308+0000","last_undegraded":"2024-09-10T06:28:48.375308+0000","last_fullsized":"2024-09-10T06:28:48.375308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:19.837495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"76'4","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379477+0000","last_change":"2024-09-10T06:26:32.256959+0000","last_active":"2024-09-10T06:28:48.379477+0000","last_peered":"2024-09-10T06:28:48.379477+0000","last_clean":"2024-09-10T06:28:48.379477+0000","last_became_active":"2024-09-10T06:26:32.256701+0000","last_became_peered":"2024-09-10T06:26:32.256701+0000","last_unstale":"2024-09-10T06:28:48.379477+0000","last_undegraded":"2024-09-10T06:28:48.379477+0000","last_fullsized":"2024-09-10T06:28:48.379477+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"95'26","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.856167+0000","last_change":"2024-09-10T06:26:30.598409+0000","last_active":"2024-09-10T06:29:17.856167+0000","last_peered":"2024-09-10T06:29:17.856167+0000","last_clean":"2024-09-10T06:29:17.856167+0000","last_became_active":"2024-09-10T06:26:30.597703+0000","last_became_peered":"2024-09-10T06:26:30.597703+0000","last_unstale":"2024-09-10T06:29:17.856167+0000","last_undegraded":"2024-09-10T06:29:17.856167+0000","last_fullsized":"2024-09-10T06:29:17.856167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380025+0000","last_change":"2024-09-10T06:26:34.268741+0000","last_active":"2024-09-10T06:28:48.380025+0000","last_peered":"2024-09-10T06:28:48.380025+0000","last_clean":"2024-09-10T06:28:48.380025+0000","last_became_active":"2024-09-10T06:26:34.268192+0000","last_became_peered":"2024-09-10T06:26:34.268192+0000","last_unstale":"2024-09-10T06:28:48.380025+0000","last_undegraded":"2024-09-10T06:28:48.380025+0000","last_fullsized":"2024-09-10T06:28:48.380025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:42:10.110645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'10","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454978+0000","last_change":"2024-09-10T06:26:36.275955+0000","last_active":"2024-09-10T06:28:48.454978+0000","last_peered":"2024-09-10T06:28:48.454978+0000","last_clean":"2024-09-10T06:28:48.454978+0000","last_became_active":"2024-09-10T06:26:36.275306+0000","last_became_peered":"2024-09-10T06:26:36.275306+0000","last_unstale":"2024-09-10T06:28:48.454978+0000","last_undegraded":"2024-09-10T06:28:48.454978+0000","last_fullsized":"2024-09-10T06:28:48.454978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:03.899587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'105","reported_seq":405,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.323456+0000","last_change":"2024-09-10T06:26:38.302764+0000","last_active":"2024-09-10T06:29:17.323456+0000","last_peered":"2024-09-10T06:29:17.323456+0000","last_clean":"2024-09-10T06:29:17.323456+0000","last_became_active":"2024-09-10T06:26:38.300326+0000","last_became_peered":"2024-09-10T06:26:38.300326+0000","last_unstale":"2024-09-10T06:29:17.323456+0000","last_undegraded":"2024-09-10T06:29:17.323456+0000","last_fullsized":"2024-09-10T06:29:17.323456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:29.851085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376634+0000","last_change":"2024-09-10T06:26:40.297893+0000","last_active":"2024-09-10T06:28:48.376634+0000","last_peered":"2024-09-10T06:28:48.376634+0000","last_clean":"2024-09-10T06:28:48.376634+0000","last_became_active":"2024-09-10T06:26:40.297296+0000","last_became_peered":"2024-09-10T06:26:40.297296+0000","last_unstale":"2024-09-10T06:28:48.376634+0000","last_undegraded":"2024-09-10T06:28:48.376634+0000","last_fullsized":"2024-09-10T06:28:48.376634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379613+0000","last_change":"2024-09-10T06:26:32.265005+0000","last_active":"2024-09-10T06:28:48.379613+0000","last_peered":"2024-09-10T06:28:48.379613+0000","last_clean":"2024-09-10T06:28:48.379613+0000","last_became_active":"2024-09-10T06:26:32.264334+0000","last_became_peered":"2024-09-10T06:26:32.264334+0000","last_unstale":"2024-09-10T06:28:48.379613+0000","last_undegraded":"2024-09-10T06:28:48.379613+0000","last_fullsized":"2024-09-10T06:28:48.379613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"95'26","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.841056+0000","last_change":"2024-09-10T06:26:30.576242+0000","last_active":"2024-09-10T06:29:17.841056+0000","last_peered":"2024-09-10T06:29:17.841056+0000","last_clean":"2024-09-10T06:29:17.841056+0000","last_became_active":"2024-09-10T06:26:30.575433+0000","last_became_peered":"2024-09-10T06:26:30.575433+0000","last_unstale":"2024-09-10T06:29:17.841056+0000","last_undegraded":"2024-09-10T06:29:17.841056+0000","last_fullsized":"2024-09-10T06:29:17.841056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:30.878686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459995+0000","last_change":"2024-09-10T06:26:34.283701+0000","last_active":"2024-09-10T06:28:48.459995+0000","last_peered":"2024-09-10T06:28:48.459995+0000","last_clean":"2024-09-10T06:28:48.459995+0000","last_became_active":"2024-09-10T06:26:34.282941+0000","last_became_peered":"2024-09-10T06:26:34.282941+0000","last_unstale":"2024-09-10T06:28:48.459995+0000","last_undegraded":"2024-09-10T06:28:48.459995+0000","last_fullsized":"2024-09-10T06:28:48.459995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:29.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"95'19","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.481712+0000","last_change":"2024-09-10T06:26:36.298510+0000","last_active":"2024-09-10T06:29:17.481712+0000","last_peered":"2024-09-10T06:29:17.481712+0000","last_clean":"2024-09-10T06:29:17.481712+0000","last_became_active":"2024-09-10T06:26:36.297309+0000","last_became_peered":"2024-09-10T06:26:36.297309+0000","last_unstale":"2024-09-10T06:29:17.481712+0000","last_undegraded":"2024-09-10T06:29:17.481712+0000","last_fullsized":"2024-09-10T06:29:17.481712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'105","reported_seq":272,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.329858+0000","last_change":"2024-09-10T06:26:38.300228+0000","last_active":"2024-09-10T06:29:17.329858+0000","last_peered":"2024-09-10T06:29:17.329858+0000","last_clean":"2024-09-10T06:29:17.329858+0000","last_became_active":"2024-09-10T06:26:38.299355+0000","last_became_peered":"2024-09-10T06:26:38.299355+0000","last_unstale":"2024-09-10T06:29:17.329858+0000","last_undegraded":"2024-09-10T06:29:17.329858+0000","last_fullsized":"2024-09-10T06:29:17.329858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:20.050096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456891+0000","last_change":"2024-09-10T06:26:32.271283+0000","last_active":"2024-09-10T06:28:48.456891+0000","last_peered":"2024-09-10T06:28:48.456891+0000","last_clean":"2024-09-10T06:28:48.456891+0000","last_became_active":"2024-09-10T06:26:32.270496+0000","last_became_peered":"2024-09-10T06:26:32.270496+0000","last_unstale":"2024-09-10T06:28:48.456891+0000","last_undegraded":"2024-09-10T06:28:48.456891+0000","last_fullsized":"2024-09-10T06:28:48.456891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"95'14","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.848934+0000","last_change":"2024-09-10T06:26:30.607373+0000","last_active":"2024-09-10T06:29:17.848934+0000","last_peered":"2024-09-10T06:29:17.848934+0000","last_clean":"2024-09-10T06:29:17.848934+0000","last_became_active":"2024-09-10T06:26:30.606685+0000","last_became_peered":"2024-09-10T06:26:30.606685+0000","last_unstale":"2024-09-10T06:29:17.848934+0000","last_undegraded":"2024-09-10T06:29:17.848934+0000","last_fullsized":"2024-09-10T06:29:17.848934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:35.705564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456456+0000","last_change":"2024-09-10T06:26:34.286925+0000","last_active":"2024-09-10T06:28:48.456456+0000","last_peered":"2024-09-10T06:28:48.456456+0000","last_clean":"2024-09-10T06:28:48.456456+0000","last_became_active":"2024-09-10T06:26:34.285787+0000","last_became_peered":"2024-09-10T06:26:34.285787+0000","last_unstale":"2024-09-10T06:28:48.456456+0000","last_undegraded":"2024-09-10T06:28:48.456456+0000","last_fullsized":"2024-09-10T06:28:48.456456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"95'28","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.734400+0000","last_change":"2024-09-10T06:26:36.293988+0000","last_active":"2024-09-10T06:29:17.734400+0000","last_peered":"2024-09-10T06:29:17.734400+0000","last_clean":"2024-09-10T06:29:17.734400+0000","last_became_active":"2024-09-10T06:26:36.293226+0000","last_became_peered":"2024-09-10T06:26:36.293226+0000","last_unstale":"2024-09-10T06:29:17.734400+0000","last_undegraded":"2024-09-10T06:29:17.734400+0000","last_fullsized":"2024-09-10T06:29:17.734400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453865+0000","last_change":"2024-09-10T06:26:38.305826+0000","last_active":"2024-09-10T06:28:48.453865+0000","last_peered":"2024-09-10T06:28:48.453865+0000","last_clean":"2024-09-10T06:28:48.453865+0000","last_became_active":"2024-09-10T06:26:38.304601+0000","last_became_peered":"2024-09-10T06:26:38.304601+0000","last_unstale":"2024-09-10T06:28:48.453865+0000","last_undegraded":"2024-09-10T06:28:48.453865+0000","last_fullsized":"2024-09-10T06:28:48.453865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:12.545261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"62'8","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460978+0000","last_change":"2024-09-10T06:26:40.332286+0000","last_active":"2024-09-10T06:28:48.460978+0000","last_peered":"2024-09-10T06:28:48.460978+0000","last_clean":"2024-09-10T06:28:48.460978+0000","last_became_active":"2024-09-10T06:26:40.331262+0000","last_became_peered":"2024-09-10T06:26:40.331262+0000","last_unstale":"2024-09-10T06:28:48.460978+0000","last_undegraded":"2024-09-10T06:28:48.460978+0000","last_fullsized":"2024-09-10T06:28:48.460978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377579+0000","last_change":"2024-09-10T06:26:32.262320+0000","last_active":"2024-09-10T06:28:48.377579+0000","last_peered":"2024-09-10T06:28:48.377579+0000","last_clean":"2024-09-10T06:28:48.377579+0000","last_became_active":"2024-09-10T06:26:32.261423+0000","last_became_peered":"2024-09-10T06:26:32.261423+0000","last_unstale":"2024-09-10T06:28:48.377579+0000","last_undegraded":"2024-09-10T06:28:48.377579+0000","last_fullsized":"2024-09-10T06:28:48.377579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:42.133516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"95'24","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.882154+0000","last_change":"2024-09-10T06:26:30.595879+0000","last_active":"2024-09-10T06:29:17.882154+0000","last_peered":"2024-09-10T06:29:17.882154+0000","last_clean":"2024-09-10T06:29:17.882154+0000","last_became_active":"2024-09-10T06:26:30.595269+0000","last_became_peered":"2024-09-10T06:26:30.595269+0000","last_unstale":"2024-09-10T06:29:17.882154+0000","last_undegraded":"2024-09-10T06:29:17.882154+0000","last_fullsized":"2024-09-10T06:29:17.882154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":32,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453028+0000","last_change":"2024-09-10T06:26:34.266906+0000","last_active":"2024-09-10T06:28:48.453028+0000","last_peered":"2024-09-10T06:28:48.453028+0000","last_clean":"2024-09-10T06:28:48.453028+0000","last_became_active":"2024-09-10T06:26:34.266017+0000","last_became_peered":"2024-09-10T06:26:34.266017+0000","last_unstale":"2024-09-10T06:28:48.453028+0000","last_undegraded":"2024-09-10T06:28:48.453028+0000","last_fullsized":"2024-09-10T06:28:48.453028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:28:24.366166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"95'20","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.935405+0000","last_change":"2024-09-10T06:26:36.297020+0000","last_active":"2024-09-10T06:29:17.935405+0000","last_peered":"2024-09-10T06:29:17.935405+0000","last_clean":"2024-09-10T06:29:17.935405+0000","last_became_active":"2024-09-10T06:26:36.295796+0000","last_became_peered":"2024-09-10T06:26:36.295796+0000","last_unstale":"2024-09-10T06:29:17.935405+0000","last_undegraded":"2024-09-10T06:29:17.935405+0000","last_fullsized":"2024-09-10T06:29:17.935405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":38,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375244+0000","last_change":"2024-09-10T06:26:38.297273+0000","last_active":"2024-09-10T06:28:48.375244+0000","last_peered":"2024-09-10T06:28:48.375244+0000","last_clean":"2024-09-10T06:28:48.375244+0000","last_became_active":"2024-09-10T06:26:38.296455+0000","last_became_peered":"2024-09-10T06:26:38.296455+0000","last_unstale":"2024-09-10T06:28:48.375244+0000","last_undegraded":"2024-09-10T06:28:48.375244+0000","last_fullsized":"2024-09-10T06:28:48.375244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:26.766702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458102+0000","last_change":"2024-09-10T06:26:40.328294+0000","last_active":"2024-09-10T06:28:48.458102+0000","last_peered":"2024-09-10T06:28:48.458102+0000","last_clean":"2024-09-10T06:28:48.458102+0000","last_became_active":"2024-09-10T06:26:40.327585+0000","last_became_peered":"2024-09-10T06:26:40.327585+0000","last_unstale":"2024-09-10T06:28:48.458102+0000","last_undegraded":"2024-09-10T06:28:48.458102+0000","last_fullsized":"2024-09-10T06:28:48.458102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.537210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458888+0000","last_change":"2024-09-10T06:27:08.600683+0000","last_active":"2024-09-10T06:28:48.458888+0000","last_peered":"2024-09-10T06:28:48.458888+0000","last_clean":"2024-09-10T06:28:48.458888+0000","last_became_active":"2024-09-10T06:27:08.599875+0000","last_became_peered":"2024-09-10T06:27:08.599875+0000","last_unstale":"2024-09-10T06:28:48.458888+0000","last_undegraded":"2024-09-10T06:28:48.458888+0000","last_fullsized":"2024-09-10T06:28:48.458888+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:59.605814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"95'14","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.886820+0000","last_change":"2024-09-10T06:26:30.611704+0000","last_active":"2024-09-10T06:29:17.886820+0000","last_peered":"2024-09-10T06:29:17.886820+0000","last_clean":"2024-09-10T06:29:17.886820+0000","last_became_active":"2024-09-10T06:26:30.611039+0000","last_became_peered":"2024-09-10T06:26:30.611039+0000","last_unstale":"2024-09-10T06:29:17.886820+0000","last_undegraded":"2024-09-10T06:29:17.886820+0000","last_fullsized":"2024-09-10T06:29:17.886820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455026+0000","last_change":"2024-09-10T06:26:34.263514+0000","last_active":"2024-09-10T06:28:48.455026+0000","last_peered":"2024-09-10T06:28:48.455026+0000","last_clean":"2024-09-10T06:28:48.455026+0000","last_became_active":"2024-09-10T06:26:34.262793+0000","last_became_peered":"2024-09-10T06:26:34.262793+0000","last_unstale":"2024-09-10T06:28:48.455026+0000","last_undegraded":"2024-09-10T06:28:48.455026+0000","last_fullsized":"2024-09-10T06:28:48.455026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:23:31.501738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"95'26","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.753735+0000","last_change":"2024-09-10T06:26:36.299923+0000","last_active":"2024-09-10T06:29:17.753735+0000","last_peered":"2024-09-10T06:29:17.753735+0000","last_clean":"2024-09-10T06:29:17.753735+0000","last_became_active":"2024-09-10T06:26:36.299140+0000","last_became_peered":"2024-09-10T06:26:36.299140+0000","last_unstale":"2024-09-10T06:29:17.753735+0000","last_undegraded":"2024-09-10T06:29:17.753735+0000","last_fullsized":"2024-09-10T06:29:17.753735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:12.246303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":44,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'105","reported_seq":270,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.330984+0000","last_change":"2024-09-10T06:26:38.292019+0000","last_active":"2024-09-10T06:29:17.330984+0000","last_peered":"2024-09-10T06:29:17.330984+0000","last_clean":"2024-09-10T06:29:17.330984+0000","last_became_active":"2024-09-10T06:26:38.291322+0000","last_became_peered":"2024-09-10T06:26:38.291322+0000","last_unstale":"2024-09-10T06:29:17.330984+0000","last_undegraded":"2024-09-10T06:29:17.330984+0000","last_fullsized":"2024-09-10T06:29:17.330984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"64'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378724+0000","last_change":"2024-09-10T06:26:40.328427+0000","last_active":"2024-09-10T06:28:48.378724+0000","last_peered":"2024-09-10T06:28:48.378724+0000","last_clean":"2024-09-10T06:28:48.378724+0000","last_became_active":"2024-09-10T06:26:40.323249+0000","last_became_peered":"2024-09-10T06:26:40.323249+0000","last_unstale":"2024-09-10T06:28:48.378724+0000","last_undegraded":"2024-09-10T06:28:48.378724+0000","last_fullsized":"2024-09-10T06:28:48.378724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:50.823195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377190+0000","last_change":"2024-09-10T06:26:32.274824+0000","last_active":"2024-09-10T06:28:48.377190+0000","last_peered":"2024-09-10T06:28:48.377190+0000","last_clean":"2024-09-10T06:28:48.377190+0000","last_became_active":"2024-09-10T06:26:32.274496+0000","last_became_peered":"2024-09-10T06:26:32.274496+0000","last_unstale":"2024-09-10T06:28:48.377190+0000","last_undegraded":"2024-09-10T06:28:48.377190+0000","last_fullsized":"2024-09-10T06:28:48.377190+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:39.513476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"95'14","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.835414+0000","last_change":"2024-09-10T06:26:30.604684+0000","last_active":"2024-09-10T06:29:17.835414+0000","last_peered":"2024-09-10T06:29:17.835414+0000","last_clean":"2024-09-10T06:29:17.835414+0000","last_became_active":"2024-09-10T06:26:30.593432+0000","last_became_peered":"2024-09-10T06:26:30.593432+0000","last_unstale":"2024-09-10T06:29:17.835414+0000","last_undegraded":"2024-09-10T06:29:17.835414+0000","last_fullsized":"2024-09-10T06:29:17.835414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:57.422765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454621+0000","last_change":"2024-09-10T06:26:34.256662+0000","last_active":"2024-09-10T06:28:48.454621+0000","last_peered":"2024-09-10T06:28:48.454621+0000","last_clean":"2024-09-10T06:28:48.454621+0000","last_became_active":"2024-09-10T06:26:34.256256+0000","last_became_peered":"2024-09-10T06:26:34.256256+0000","last_unstale":"2024-09-10T06:28:48.454621+0000","last_undegraded":"2024-09-10T06:28:48.454621+0000","last_fullsized":"2024-09-10T06:28:48.454621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:34:35.549063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"95'33","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.772462+0000","last_change":"2024-09-10T06:26:36.296631+0000","last_active":"2024-09-10T06:29:17.772462+0000","last_peered":"2024-09-10T06:29:17.772462+0000","last_clean":"2024-09-10T06:29:17.772462+0000","last_became_active":"2024-09-10T06:26:36.295838+0000","last_became_peered":"2024-09-10T06:26:36.295838+0000","last_unstale":"2024-09-10T06:29:17.772462+0000","last_undegraded":"2024-09-10T06:29:17.772462+0000","last_fullsized":"2024-09-10T06:29:17.772462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:04.271824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":49,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.452870+0000","last_change":"2024-09-10T06:26:38.308698+0000","last_active":"2024-09-10T06:28:48.452870+0000","last_peered":"2024-09-10T06:28:48.452870+0000","last_clean":"2024-09-10T06:28:48.452870+0000","last_became_active":"2024-09-10T06:26:38.307965+0000","last_became_peered":"2024-09-10T06:26:38.307965+0000","last_unstale":"2024-09-10T06:28:48.452870+0000","last_undegraded":"2024-09-10T06:28:48.452870+0000","last_fullsized":"2024-09-10T06:28:48.452870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:04.566221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"62'4","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454102+0000","last_change":"2024-09-10T06:26:40.326474+0000","last_active":"2024-09-10T06:28:48.454102+0000","last_peered":"2024-09-10T06:28:48.454102+0000","last_clean":"2024-09-10T06:28:48.454102+0000","last_became_active":"2024-09-10T06:26:40.325731+0000","last_became_peered":"2024-09-10T06:26:40.325731+0000","last_unstale":"2024-09-10T06:28:48.454102+0000","last_undegraded":"2024-09-10T06:28:48.454102+0000","last_fullsized":"2024-09-10T06:28:48.454102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:19.400355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"64'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380025+0000","last_change":"2024-09-10T06:26:32.254177+0000","last_active":"2024-09-10T06:28:48.380025+0000","last_peered":"2024-09-10T06:28:48.380025+0000","last_clean":"2024-09-10T06:28:48.380025+0000","last_became_active":"2024-09-10T06:26:32.253154+0000","last_became_peered":"2024-09-10T06:26:32.253154+0000","last_unstale":"2024-09-10T06:28:48.380025+0000","last_undegraded":"2024-09-10T06:28:48.380025+0000","last_fullsized":"2024-09-10T06:28:48.380025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'10","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.849511+0000","last_change":"2024-09-10T06:26:30.572406+0000","last_active":"2024-09-10T06:29:17.849511+0000","last_peered":"2024-09-10T06:29:17.849511+0000","last_clean":"2024-09-10T06:29:17.849511+0000","last_became_active":"2024-09-10T06:26:30.571829+0000","last_became_peered":"2024-09-10T06:26:30.571829+0000","last_unstale":"2024-09-10T06:29:17.849511+0000","last_undegraded":"2024-09-10T06:29:17.849511+0000","last_fullsized":"2024-09-10T06:29:17.849511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455283+0000","last_change":"2024-09-10T06:26:34.285406+0000","last_active":"2024-09-10T06:28:48.455283+0000","last_peered":"2024-09-10T06:28:48.455283+0000","last_clean":"2024-09-10T06:28:48.455283+0000","last_became_active":"2024-09-10T06:26:34.285004+0000","last_became_peered":"2024-09-10T06:26:34.285004+0000","last_unstale":"2024-09-10T06:28:48.455283+0000","last_undegraded":"2024-09-10T06:28:48.455283+0000","last_fullsized":"2024-09-10T06:28:48.455283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:03.587636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"95'24","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.426311+0000","last_change":"2024-09-10T06:26:36.293191+0000","last_active":"2024-09-10T06:29:17.426311+0000","last_peered":"2024-09-10T06:29:17.426311+0000","last_clean":"2024-09-10T06:29:17.426311+0000","last_became_active":"2024-09-10T06:26:36.292423+0000","last_became_peered":"2024-09-10T06:26:36.292423+0000","last_unstale":"2024-09-10T06:29:17.426311+0000","last_undegraded":"2024-09-10T06:29:17.426311+0000","last_fullsized":"2024-09-10T06:29:17.426311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":30,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378126+0000","last_change":"2024-09-10T06:26:38.293667+0000","last_active":"2024-09-10T06:28:48.378126+0000","last_peered":"2024-09-10T06:28:48.378126+0000","last_clean":"2024-09-10T06:28:48.378126+0000","last_became_active":"2024-09-10T06:26:38.292918+0000","last_became_peered":"2024-09-10T06:26:38.292918+0000","last_unstale":"2024-09-10T06:28:48.378126+0000","last_undegraded":"2024-09-10T06:28:48.378126+0000","last_fullsized":"2024-09-10T06:28:48.378126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:57.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376446+0000","last_change":"2024-09-10T06:26:40.327061+0000","last_active":"2024-09-10T06:28:48.376446+0000","last_peered":"2024-09-10T06:28:48.376446+0000","last_clean":"2024-09-10T06:28:48.376446+0000","last_became_active":"2024-09-10T06:26:40.326431+0000","last_became_peered":"2024-09-10T06:26:40.326431+0000","last_unstale":"2024-09-10T06:28:48.376446+0000","last_undegraded":"2024-09-10T06:28:48.376446+0000","last_fullsized":"2024-09-10T06:28:48.376446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:27.631214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"64'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380722+0000","last_change":"2024-09-10T06:26:32.255139+0000","last_active":"2024-09-10T06:28:48.380722+0000","last_peered":"2024-09-10T06:28:48.380722+0000","last_clean":"2024-09-10T06:28:48.380722+0000","last_became_active":"2024-09-10T06:26:32.253524+0000","last_became_peered":"2024-09-10T06:26:32.253524+0000","last_unstale":"2024-09-10T06:28:48.380722+0000","last_undegraded":"2024-09-10T06:28:48.380722+0000","last_fullsized":"2024-09-10T06:28:48.380722+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:05.752393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'16","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.848461+0000","last_change":"2024-09-10T06:26:30.591838+0000","last_active":"2024-09-10T06:29:17.848461+0000","last_peered":"2024-09-10T06:29:17.848461+0000","last_clean":"2024-09-10T06:29:17.848461+0000","last_became_active":"2024-09-10T06:26:30.591125+0000","last_became_peered":"2024-09-10T06:26:30.591125+0000","last_unstale":"2024-09-10T06:29:17.848461+0000","last_undegraded":"2024-09-10T06:29:17.848461+0000","last_fullsized":"2024-09-10T06:29:17.848461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453621+0000","last_change":"2024-09-10T06:26:34.280391+0000","last_active":"2024-09-10T06:28:48.453621+0000","last_peered":"2024-09-10T06:28:48.453621+0000","last_clean":"2024-09-10T06:28:48.453621+0000","last_became_active":"2024-09-10T06:26:34.280058+0000","last_became_peered":"2024-09-10T06:26:34.280058+0000","last_unstale":"2024-09-10T06:28:48.453621+0000","last_undegraded":"2024-09-10T06:28:48.453621+0000","last_fullsized":"2024-09-10T06:28:48.453621+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:30.461857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"95'26","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.909956+0000","last_change":"2024-09-10T06:26:36.277547+0000","last_active":"2024-09-10T06:29:17.909956+0000","last_peered":"2024-09-10T06:29:17.909956+0000","last_clean":"2024-09-10T06:29:17.909956+0000","last_became_active":"2024-09-10T06:26:36.276965+0000","last_became_peered":"2024-09-10T06:26:36.276965+0000","last_unstale":"2024-09-10T06:29:17.909956+0000","last_undegraded":"2024-09-10T06:29:17.909956+0000","last_fullsized":"2024-09-10T06:29:17.909956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:43.212945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'105","reported_seq":301,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.325594+0000","last_change":"2024-09-10T06:26:38.306134+0000","last_active":"2024-09-10T06:29:17.325594+0000","last_peered":"2024-09-10T06:29:17.325594+0000","last_clean":"2024-09-10T06:29:17.325594+0000","last_became_active":"2024-09-10T06:26:38.299012+0000","last_became_peered":"2024-09-10T06:26:38.299012+0000","last_unstale":"2024-09-10T06:29:17.325594+0000","last_undegraded":"2024-09-10T06:29:17.325594+0000","last_fullsized":"2024-09-10T06:29:17.325594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:37.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"61'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454114+0000","last_change":"2024-09-10T06:26:40.336036+0000","last_active":"2024-09-10T06:28:48.454114+0000","last_peered":"2024-09-10T06:28:48.454114+0000","last_clean":"2024-09-10T06:28:48.454114+0000","last_became_active":"2024-09-10T06:26:40.335302+0000","last_became_peered":"2024-09-10T06:26:40.335302+0000","last_unstale":"2024-09-10T06:28:48.454114+0000","last_undegraded":"2024-09-10T06:28:48.454114+0000","last_fullsized":"2024-09-10T06:28:48.454114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:24.024562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380676+0000","last_change":"2024-09-10T06:26:32.287897+0000","last_active":"2024-09-10T06:28:48.380676+0000","last_peered":"2024-09-10T06:28:48.380676+0000","last_clean":"2024-09-10T06:28:48.380676+0000","last_became_active":"2024-09-10T06:26:32.287315+0000","last_became_peered":"2024-09-10T06:26:32.287315+0000","last_unstale":"2024-09-10T06:28:48.380676+0000","last_undegraded":"2024-09-10T06:28:48.380676+0000","last_fullsized":"2024-09-10T06:28:48.380676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'14","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.826745+0000","last_change":"2024-09-10T06:26:30.569192+0000","last_active":"2024-09-10T06:29:17.826745+0000","last_peered":"2024-09-10T06:29:17.826745+0000","last_clean":"2024-09-10T06:29:17.826745+0000","last_became_active":"2024-09-10T06:26:30.568464+0000","last_became_peered":"2024-09-10T06:26:30.568464+0000","last_unstale":"2024-09-10T06:29:17.826745+0000","last_undegraded":"2024-09-10T06:29:17.826745+0000","last_fullsized":"2024-09-10T06:29:17.826745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:58.987914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":284,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.291130+0000","last_change":"2024-09-10T06:26:34.279935+0000","last_active":"2024-09-10T06:29:17.291130+0000","last_peered":"2024-09-10T06:29:17.291130+0000","last_clean":"2024-09-10T06:29:17.291130+0000","last_became_active":"2024-09-10T06:26:34.279192+0000","last_became_peered":"2024-09-10T06:26:34.279192+0000","last_unstale":"2024-09-10T06:29:17.291130+0000","last_undegraded":"2024-09-10T06:29:17.291130+0000","last_fullsized":"2024-09-10T06:29:17.291130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:18.753175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377130+0000","last_change":"2024-09-10T06:26:36.290330+0000","last_active":"2024-09-10T06:28:48.377130+0000","last_peered":"2024-09-10T06:28:48.377130+0000","last_clean":"2024-09-10T06:28:48.377130+0000","last_became_active":"2024-09-10T06:26:36.289527+0000","last_became_peered":"2024-09-10T06:26:36.289527+0000","last_unstale":"2024-09-10T06:28:48.377130+0000","last_undegraded":"2024-09-10T06:28:48.377130+0000","last_fullsized":"2024-09-10T06:28:48.377130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'105","reported_seq":313,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.327392+0000","last_change":"2024-09-10T06:26:38.288663+0000","last_active":"2024-09-10T06:29:17.327392+0000","last_peered":"2024-09-10T06:29:17.327392+0000","last_clean":"2024-09-10T06:29:17.327392+0000","last_became_active":"2024-09-10T06:26:38.287740+0000","last_became_peered":"2024-09-10T06:26:38.287740+0000","last_unstale":"2024-09-10T06:29:17.327392+0000","last_undegraded":"2024-09-10T06:29:17.327392+0000","last_fullsized":"2024-09-10T06:29:17.327392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:22.078943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'8","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377335+0000","last_change":"2024-09-10T06:26:40.329737+0000","last_active":"2024-09-10T06:28:48.377335+0000","last_peered":"2024-09-10T06:28:48.377335+0000","last_clean":"2024-09-10T06:28:48.377335+0000","last_became_active":"2024-09-10T06:26:40.328952+0000","last_became_peered":"2024-09-10T06:26:40.328952+0000","last_unstale":"2024-09-10T06:28:48.377335+0000","last_undegraded":"2024-09-10T06:28:48.377335+0000","last_fullsized":"2024-09-10T06:28:48.377335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454598+0000","last_change":"2024-09-10T06:26:32.270997+0000","last_active":"2024-09-10T06:28:48.454598+0000","last_peered":"2024-09-10T06:28:48.454598+0000","last_clean":"2024-09-10T06:28:48.454598+0000","last_became_active":"2024-09-10T06:26:32.270265+0000","last_became_peered":"2024-09-10T06:26:32.270265+0000","last_unstale":"2024-09-10T06:28:48.454598+0000","last_undegraded":"2024-09-10T06:28:48.454598+0000","last_fullsized":"2024-09-10T06:28:48.454598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:33.067523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"95'22","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.889302+0000","last_change":"2024-09-10T06:27:08.593158+0000","last_active":"2024-09-10T06:29:17.889302+0000","last_peered":"2024-09-10T06:29:17.889302+0000","last_clean":"2024-09-10T06:29:17.889302+0000","last_became_active":"2024-09-10T06:27:08.592864+0000","last_became_peered":"2024-09-10T06:27:08.592864+0000","last_unstale":"2024-09-10T06:29:17.889302+0000","last_undegraded":"2024-09-10T06:29:17.889302+0000","last_fullsized":"2024-09-10T06:29:17.889302+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:35.185591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380176+0000","last_change":"2024-09-10T06:26:34.286497+0000","last_active":"2024-09-10T06:28:48.380176+0000","last_peered":"2024-09-10T06:28:48.380176+0000","last_clean":"2024-09-10T06:28:48.380176+0000","last_became_active":"2024-09-10T06:26:34.285334+0000","last_became_peered":"2024-09-10T06:26:34.285334+0000","last_unstale":"2024-09-10T06:28:48.380176+0000","last_undegraded":"2024-09-10T06:28:48.380176+0000","last_fullsized":"2024-09-10T06:28:48.380176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:54.506182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"95'26","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.525558+0000","last_change":"2024-09-10T06:26:36.288213+0000","last_active":"2024-09-10T06:29:17.525558+0000","last_peered":"2024-09-10T06:29:17.525558+0000","last_clean":"2024-09-10T06:29:17.525558+0000","last_became_active":"2024-09-10T06:26:36.287468+0000","last_became_peered":"2024-09-10T06:26:36.287468+0000","last_unstale":"2024-09-10T06:29:17.525558+0000","last_undegraded":"2024-09-10T06:29:17.525558+0000","last_fullsized":"2024-09-10T06:29:17.525558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457697+0000","last_change":"2024-09-10T06:26:38.291943+0000","last_active":"2024-09-10T06:28:48.457697+0000","last_peered":"2024-09-10T06:28:48.457697+0000","last_clean":"2024-09-10T06:28:48.457697+0000","last_became_active":"2024-09-10T06:26:38.291214+0000","last_became_peered":"2024-09-10T06:26:38.291214+0000","last_unstale":"2024-09-10T06:28:48.457697+0000","last_undegraded":"2024-09-10T06:28:48.457697+0000","last_fullsized":"2024-09-10T06:28:48.457697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:56.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"67'4","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453374+0000","last_change":"2024-09-10T06:26:40.331977+0000","last_active":"2024-09-10T06:28:48.453374+0000","last_peered":"2024-09-10T06:28:48.453374+0000","last_clean":"2024-09-10T06:28:48.453374+0000","last_became_active":"2024-09-10T06:26:40.331502+0000","last_became_peered":"2024-09-10T06:26:40.331502+0000","last_unstale":"2024-09-10T06:28:48.453374+0000","last_undegraded":"2024-09-10T06:28:48.453374+0000","last_fullsized":"2024-09-10T06:28:48.453374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:43.572813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'4","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460459+0000","last_change":"2024-09-10T06:26:32.274623+0000","last_active":"2024-09-10T06:28:48.460459+0000","last_peered":"2024-09-10T06:28:48.460459+0000","last_clean":"2024-09-10T06:28:48.460459+0000","last_became_active":"2024-09-10T06:26:32.273727+0000","last_became_peered":"2024-09-10T06:26:32.273727+0000","last_unstale":"2024-09-10T06:28:48.460459+0000","last_undegraded":"2024-09-10T06:28:48.460459+0000","last_fullsized":"2024-09-10T06:28:48.460459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:15.364938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":258,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455693+0000","last_change":"2024-09-10T06:26:18.153206+0000","last_active":"2024-09-10T06:28:48.455693+0000","last_peered":"2024-09-10T06:28:48.455693+0000","last_clean":"2024-09-10T06:28:48.455693+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:28:48.455693+0000","last_undegraded":"2024-09-10T06:28:48.455693+0000","last_fullsized":"2024-09-10T06:28:48.455693+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:16.422775+0000","last_clean_scrub_stamp":"2024-09-10T06:26:16.422775+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:07:42.510577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460195+0000","last_change":"2024-09-10T06:26:25.532465+0000","last_active":"2024-09-10T06:28:48.460195+0000","last_peered":"2024-09-10T06:28:48.460195+0000","last_clean":"2024-09-10T06:28:48.460195+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:28:48.460195+0000","last_undegraded":"2024-09-10T06:28:48.460195+0000","last_fullsized":"2024-09-10T06:28:48.460195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:26:10.318844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'18","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.897882+0000","last_change":"2024-09-10T06:26:30.606630+0000","last_active":"2024-09-10T06:29:17.897882+0000","last_peered":"2024-09-10T06:29:17.897882+0000","last_clean":"2024-09-10T06:29:17.897882+0000","last_became_active":"2024-09-10T06:26:30.606348+0000","last_became_peered":"2024-09-10T06:26:30.606348+0000","last_unstale":"2024-09-10T06:29:17.897882+0000","last_undegraded":"2024-09-10T06:29:17.897882+0000","last_fullsized":"2024-09-10T06:29:17.897882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462936+0000","last_change":"2024-09-10T06:26:34.287201+0000","last_active":"2024-09-10T06:28:48.462936+0000","last_peered":"2024-09-10T06:28:48.462936+0000","last_clean":"2024-09-10T06:28:48.462936+0000","last_became_active":"2024-09-10T06:26:34.285248+0000","last_became_peered":"2024-09-10T06:26:34.285248+0000","last_unstale":"2024-09-10T06:28:48.462936+0000","last_undegraded":"2024-09-10T06:28:48.462936+0000","last_fullsized":"2024-09-10T06:28:48.462936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:39:43.907684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"95'42","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.786714+0000","last_change":"2024-09-10T06:26:36.296684+0000","last_active":"2024-09-10T06:29:17.786714+0000","last_peered":"2024-09-10T06:29:17.786714+0000","last_clean":"2024-09-10T06:29:17.786714+0000","last_became_active":"2024-09-10T06:26:36.295901+0000","last_became_peered":"2024-09-10T06:26:36.295901+0000","last_unstale":"2024-09-10T06:29:17.786714+0000","last_undegraded":"2024-09-10T06:29:17.786714+0000","last_fullsized":"2024-09-10T06:29:17.786714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":160,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378965+0000","last_change":"2024-09-10T06:26:38.306412+0000","last_active":"2024-09-10T06:28:48.378965+0000","last_peered":"2024-09-10T06:28:48.378965+0000","last_clean":"2024-09-10T06:28:48.378965+0000","last_became_active":"2024-09-10T06:26:38.305496+0000","last_became_peered":"2024-09-10T06:26:38.305496+0000","last_unstale":"2024-09-10T06:28:48.378965+0000","last_undegraded":"2024-09-10T06:28:48.378965+0000","last_fullsized":"2024-09-10T06:28:48.378965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.370035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"64'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456581+0000","last_change":"2024-09-10T06:26:40.331981+0000","last_active":"2024-09-10T06:28:48.456581+0000","last_peered":"2024-09-10T06:28:48.456581+0000","last_clean":"2024-09-10T06:28:48.456581+0000","last_became_active":"2024-09-10T06:26:40.331294+0000","last_became_peered":"2024-09-10T06:26:40.331294+0000","last_unstale":"2024-09-10T06:28:48.456581+0000","last_undegraded":"2024-09-10T06:28:48.456581+0000","last_fullsized":"2024-09-10T06:28:48.456581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:00.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379255+0000","last_change":"2024-09-10T06:26:32.278733+0000","last_active":"2024-09-10T06:28:48.379255+0000","last_peered":"2024-09-10T06:28:48.379255+0000","last_clean":"2024-09-10T06:28:48.379255+0000","last_became_active":"2024-09-10T06:26:32.278118+0000","last_became_peered":"2024-09-10T06:26:32.278118+0000","last_unstale":"2024-09-10T06:28:48.379255+0000","last_undegraded":"2024-09-10T06:28:48.379255+0000","last_fullsized":"2024-09-10T06:28:48.379255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:58.860666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455540+0000","last_change":"2024-09-10T06:26:26.180664+0000","last_active":"2024-09-10T06:28:48.455540+0000","last_peered":"2024-09-10T06:28:48.455540+0000","last_clean":"2024-09-10T06:28:48.455540+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:28:48.455540+0000","last_undegraded":"2024-09-10T06:28:48.455540+0000","last_fullsized":"2024-09-10T06:28:48.455540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:28.793045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"95'22","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.867148+0000","last_change":"2024-09-10T06:26:30.594315+0000","last_active":"2024-09-10T06:29:17.867148+0000","last_peered":"2024-09-10T06:29:17.867148+0000","last_clean":"2024-09-10T06:29:17.867148+0000","last_became_active":"2024-09-10T06:26:30.593978+0000","last_became_peered":"2024-09-10T06:26:30.593978+0000","last_unstale":"2024-09-10T06:29:17.867148+0000","last_undegraded":"2024-09-10T06:29:17.867148+0000","last_fullsized":"2024-09-10T06:29:17.867148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:41.851632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460472+0000","last_change":"2024-09-10T06:26:34.279889+0000","last_active":"2024-09-10T06:28:48.460472+0000","last_peered":"2024-09-10T06:28:48.460472+0000","last_clean":"2024-09-10T06:28:48.460472+0000","last_became_active":"2024-09-10T06:26:34.279147+0000","last_became_peered":"2024-09-10T06:26:34.279147+0000","last_unstale":"2024-09-10T06:28:48.460472+0000","last_undegraded":"2024-09-10T06:28:48.460472+0000","last_fullsized":"2024-09-10T06:28:48.460472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:02.260309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'119","reported_seq":351,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.940308+0000","last_change":"2024-09-10T06:26:36.290005+0000","last_active":"2024-09-10T06:29:17.940308+0000","last_peered":"2024-09-10T06:29:17.940308+0000","last_clean":"2024-09-10T06:29:17.940308+0000","last_became_active":"2024-09-10T06:26:36.289232+0000","last_became_peered":"2024-09-10T06:26:36.289232+0000","last_unstale":"2024-09-10T06:29:17.940308+0000","last_undegraded":"2024-09-10T06:29:17.940308+0000","last_fullsized":"2024-09-10T06:29:17.940308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:51.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":162,"num_read_kb":147,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463283+0000","last_change":"2024-09-10T06:26:38.302505+0000","last_active":"2024-09-10T06:28:48.463283+0000","last_peered":"2024-09-10T06:28:48.463283+0000","last_clean":"2024-09-10T06:28:48.463283+0000","last_became_active":"2024-09-10T06:26:38.301104+0000","last_became_peered":"2024-09-10T06:26:38.301104+0000","last_unstale":"2024-09-10T06:28:48.463283+0000","last_undegraded":"2024-09-10T06:28:48.463283+0000","last_fullsized":"2024-09-10T06:28:48.463283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.863622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"76'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453152+0000","last_change":"2024-09-10T06:26:40.320079+0000","last_active":"2024-09-10T06:28:48.453152+0000","last_peered":"2024-09-10T06:28:48.453152+0000","last_clean":"2024-09-10T06:28:48.453152+0000","last_became_active":"2024-09-10T06:26:40.319266+0000","last_became_peered":"2024-09-10T06:26:40.319266+0000","last_unstale":"2024-09-10T06:28:48.453152+0000","last_undegraded":"2024-09-10T06:28:48.453152+0000","last_fullsized":"2024-09-10T06:28:48.453152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:57.937745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"76'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454407+0000","last_change":"2024-09-10T06:26:32.282679+0000","last_active":"2024-09-10T06:28:48.454407+0000","last_peered":"2024-09-10T06:28:48.454407+0000","last_clean":"2024-09-10T06:28:48.454407+0000","last_became_active":"2024-09-10T06:26:32.282235+0000","last_became_peered":"2024-09-10T06:26:32.282235+0000","last_unstale":"2024-09-10T06:28:48.454407+0000","last_undegraded":"2024-09-10T06:28:48.454407+0000","last_fullsized":"2024-09-10T06:28:48.454407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:02:27.994318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454483+0000","last_change":"2024-09-10T06:26:25.979784+0000","last_active":"2024-09-10T06:28:48.454483+0000","last_peered":"2024-09-10T06:28:48.454483+0000","last_clean":"2024-09-10T06:28:48.454483+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:28:48.454483+0000","last_undegraded":"2024-09-10T06:28:48.454483+0000","last_fullsized":"2024-09-10T06:28:48.454483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:42.490682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"95'16","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.872126+0000","last_change":"2024-09-10T06:26:30.570558+0000","last_active":"2024-09-10T06:29:17.872126+0000","last_peered":"2024-09-10T06:29:17.872126+0000","last_clean":"2024-09-10T06:29:17.872126+0000","last_became_active":"2024-09-10T06:26:30.570037+0000","last_became_peered":"2024-09-10T06:26:30.570037+0000","last_unstale":"2024-09-10T06:29:17.872126+0000","last_undegraded":"2024-09-10T06:29:17.872126+0000","last_fullsized":"2024-09-10T06:29:17.872126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:28:46.692143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455347+0000","last_change":"2024-09-10T06:26:34.284394+0000","last_active":"2024-09-10T06:28:48.455347+0000","last_peered":"2024-09-10T06:28:48.455347+0000","last_clean":"2024-09-10T06:28:48.455347+0000","last_became_active":"2024-09-10T06:26:34.283980+0000","last_became_peered":"2024-09-10T06:26:34.283980+0000","last_unstale":"2024-09-10T06:28:48.455347+0000","last_undegraded":"2024-09-10T06:28:48.455347+0000","last_fullsized":"2024-09-10T06:28:48.455347+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:01:38.061123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'19","reported_seq":241,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.467565+0000","last_change":"2024-09-10T06:28:47.073398+0000","last_active":"2024-09-10T06:28:49.467565+0000","last_peered":"2024-09-10T06:28:49.467565+0000","last_clean":"2024-09-10T06:28:49.467565+0000","last_became_active":"2024-09-10T06:28:46.327631+0000","last_became_peered":"2024-09-10T06:28:46.327631+0000","last_unstale":"2024-09-10T06:28:49.467565+0000","last_undegraded":"2024-09-10T06:28:49.467565+0000","last_fullsized":"2024-09-10T06:28:49.467565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:25.802510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375982+0000","last_change":"2024-09-10T06:26:38.292411+0000","last_active":"2024-09-10T06:28:48.375982+0000","last_peered":"2024-09-10T06:28:48.375982+0000","last_clean":"2024-09-10T06:28:48.375982+0000","last_became_active":"2024-09-10T06:26:38.291623+0000","last_became_peered":"2024-09-10T06:26:38.291623+0000","last_unstale":"2024-09-10T06:28:48.375982+0000","last_undegraded":"2024-09-10T06:28:48.375982+0000","last_fullsized":"2024-09-10T06:28:48.375982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377385+0000","last_change":"2024-09-10T06:26:40.303598+0000","last_active":"2024-09-10T06:28:48.377385+0000","last_peered":"2024-09-10T06:28:48.377385+0000","last_clean":"2024-09-10T06:28:48.377385+0000","last_became_active":"2024-09-10T06:26:40.302898+0000","last_became_peered":"2024-09-10T06:26:40.302898+0000","last_unstale":"2024-09-10T06:28:48.377385+0000","last_undegraded":"2024-09-10T06:28:48.377385+0000","last_fullsized":"2024-09-10T06:28:48.377385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:49.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"76'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453765+0000","last_change":"2024-09-10T06:26:32.273484+0000","last_active":"2024-09-10T06:28:48.453765+0000","last_peered":"2024-09-10T06:28:48.453765+0000","last_clean":"2024-09-10T06:28:48.453765+0000","last_became_active":"2024-09-10T06:26:32.273183+0000","last_became_peered":"2024-09-10T06:26:32.273183+0000","last_unstale":"2024-09-10T06:28:48.453765+0000","last_undegraded":"2024-09-10T06:28:48.453765+0000","last_fullsized":"2024-09-10T06:28:48.453765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:32.410538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459095+0000","last_change":"2024-09-10T06:26:25.534289+0000","last_active":"2024-09-10T06:28:48.459095+0000","last_peered":"2024-09-10T06:28:48.459095+0000","last_clean":"2024-09-10T06:28:48.459095+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:28:48.459095+0000","last_undegraded":"2024-09-10T06:28:48.459095+0000","last_fullsized":"2024-09-10T06:28:48.459095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:11.915255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"95'16","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.859756+0000","last_change":"2024-09-10T06:26:30.579693+0000","last_active":"2024-09-10T06:29:17.859756+0000","last_peered":"2024-09-10T06:29:17.859756+0000","last_clean":"2024-09-10T06:29:17.859756+0000","last_became_active":"2024-09-10T06:26:30.577934+0000","last_became_peered":"2024-09-10T06:26:30.577934+0000","last_unstale":"2024-09-10T06:29:17.859756+0000","last_undegraded":"2024-09-10T06:29:17.859756+0000","last_fullsized":"2024-09-10T06:29:17.859756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:35.852655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377724+0000","last_change":"2024-09-10T06:26:34.275458+0000","last_active":"2024-09-10T06:28:48.377724+0000","last_peered":"2024-09-10T06:28:48.377724+0000","last_clean":"2024-09-10T06:28:48.377724+0000","last_became_active":"2024-09-10T06:26:34.274705+0000","last_became_peered":"2024-09-10T06:26:34.274705+0000","last_unstale":"2024-09-10T06:28:48.377724+0000","last_undegraded":"2024-09-10T06:28:48.377724+0000","last_fullsized":"2024-09-10T06:28:48.377724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:20.624872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379364+0000","last_change":"2024-09-10T06:26:36.266077+0000","last_active":"2024-09-10T06:28:48.379364+0000","last_peered":"2024-09-10T06:28:48.379364+0000","last_clean":"2024-09-10T06:28:48.379364+0000","last_became_active":"2024-09-10T06:26:36.265322+0000","last_became_peered":"2024-09-10T06:26:36.265322+0000","last_unstale":"2024-09-10T06:28:48.379364+0000","last_undegraded":"2024-09-10T06:28:48.379364+0000","last_fullsized":"2024-09-10T06:28:48.379364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459162+0000","last_change":"2024-09-10T06:28:46.345843+0000","last_active":"2024-09-10T06:28:48.459162+0000","last_peered":"2024-09-10T06:28:48.459162+0000","last_clean":"2024-09-10T06:28:48.459162+0000","last_became_active":"2024-09-10T06:28:46.344951+0000","last_became_peered":"2024-09-10T06:28:46.344951+0000","last_unstale":"2024-09-10T06:28:48.459162+0000","last_undegraded":"2024-09-10T06:28:48.459162+0000","last_fullsized":"2024-09-10T06:28:48.459162+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:17.825354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"76'8","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456074+0000","last_change":"2024-09-10T06:26:40.326887+0000","last_active":"2024-09-10T06:28:48.456074+0000","last_peered":"2024-09-10T06:28:48.456074+0000","last_clean":"2024-09-10T06:28:48.456074+0000","last_became_active":"2024-09-10T06:26:40.326130+0000","last_became_peered":"2024-09-10T06:26:40.326130+0000","last_unstale":"2024-09-10T06:28:48.456074+0000","last_undegraded":"2024-09-10T06:28:48.456074+0000","last_fullsized":"2024-09-10T06:28:48.456074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:28.237428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'8","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453524+0000","last_change":"2024-09-10T06:26:32.282586+0000","last_active":"2024-09-10T06:28:48.453524+0000","last_peered":"2024-09-10T06:28:48.453524+0000","last_clean":"2024-09-10T06:28:48.453524+0000","last_became_active":"2024-09-10T06:26:32.282086+0000","last_became_peered":"2024-09-10T06:26:32.282086+0000","last_unstale":"2024-09-10T06:28:48.453524+0000","last_undegraded":"2024-09-10T06:28:48.453524+0000","last_fullsized":"2024-09-10T06:28:48.453524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:46:44.269917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'32","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.924808+0000","last_change":"2024-09-10T06:26:30.591913+0000","last_active":"2024-09-10T06:29:17.924808+0000","last_peered":"2024-09-10T06:29:17.924808+0000","last_clean":"2024-09-10T06:29:17.924808+0000","last_became_active":"2024-09-10T06:26:30.591140+0000","last_became_peered":"2024-09-10T06:26:30.591140+0000","last_unstale":"2024-09-10T06:29:17.924808+0000","last_undegraded":"2024-09-10T06:29:17.924808+0000","last_fullsized":"2024-09-10T06:29:17.924808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:09:40.119146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454261+0000","last_change":"2024-09-10T06:26:25.537497+0000","last_active":"2024-09-10T06:28:48.454261+0000","last_peered":"2024-09-10T06:28:48.454261+0000","last_clean":"2024-09-10T06:28:48.454261+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:28:48.454261+0000","last_undegraded":"2024-09-10T06:28:48.454261+0000","last_fullsized":"2024-09-10T06:28:48.454261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:36:44.787852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376269+0000","last_change":"2024-09-10T06:26:34.276099+0000","last_active":"2024-09-10T06:28:48.376269+0000","last_peered":"2024-09-10T06:28:48.376269+0000","last_clean":"2024-09-10T06:28:48.376269+0000","last_became_active":"2024-09-10T06:26:34.273984+0000","last_became_peered":"2024-09-10T06:26:34.273984+0000","last_unstale":"2024-09-10T06:28:48.376269+0000","last_undegraded":"2024-09-10T06:28:48.376269+0000","last_fullsized":"2024-09-10T06:28:48.376269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"95'38","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.905345+0000","last_change":"2024-09-10T06:26:36.272589+0000","last_active":"2024-09-10T06:29:17.905345+0000","last_peered":"2024-09-10T06:29:17.905345+0000","last_clean":"2024-09-10T06:29:17.905345+0000","last_became_active":"2024-09-10T06:26:36.270914+0000","last_became_peered":"2024-09-10T06:26:36.270914+0000","last_unstale":"2024-09-10T06:29:17.905345+0000","last_undegraded":"2024-09-10T06:29:17.905345+0000","last_fullsized":"2024-09-10T06:29:17.905345+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:20.764690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":157,"num_write":28,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376397+0000","last_change":"2024-09-10T06:26:38.278069+0000","last_active":"2024-09-10T06:28:48.376397+0000","last_peered":"2024-09-10T06:28:48.376397+0000","last_clean":"2024-09-10T06:28:48.376397+0000","last_became_active":"2024-09-10T06:26:38.277261+0000","last_became_peered":"2024-09-10T06:26:38.277261+0000","last_unstale":"2024-09-10T06:28:48.376397+0000","last_undegraded":"2024-09-10T06:28:48.376397+0000","last_fullsized":"2024-09-10T06:28:48.376397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"67'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378048+0000","last_change":"2024-09-10T06:26:40.333741+0000","last_active":"2024-09-10T06:28:48.378048+0000","last_peered":"2024-09-10T06:28:48.378048+0000","last_clean":"2024-09-10T06:28:48.378048+0000","last_became_active":"2024-09-10T06:26:40.329701+0000","last_became_peered":"2024-09-10T06:26:40.329701+0000","last_unstale":"2024-09-10T06:28:48.378048+0000","last_undegraded":"2024-09-10T06:28:48.378048+0000","last_fullsized":"2024-09-10T06:28:48.378048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:53.704790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"67'4","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376410+0000","last_change":"2024-09-10T06:26:32.275551+0000","last_active":"2024-09-10T06:28:48.376410+0000","last_peered":"2024-09-10T06:28:48.376410+0000","last_clean":"2024-09-10T06:28:48.376410+0000","last_became_active":"2024-09-10T06:26:32.274946+0000","last_became_peered":"2024-09-10T06:26:32.274946+0000","last_unstale":"2024-09-10T06:28:48.376410+0000","last_undegraded":"2024-09-10T06:28:48.376410+0000","last_fullsized":"2024-09-10T06:28:48.376410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"95'16","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.822940+0000","last_change":"2024-09-10T06:26:30.565595+0000","last_active":"2024-09-10T06:29:17.822940+0000","last_peered":"2024-09-10T06:29:17.822940+0000","last_clean":"2024-09-10T06:29:17.822940+0000","last_became_active":"2024-09-10T06:26:30.565220+0000","last_became_peered":"2024-09-10T06:26:30.565220+0000","last_unstale":"2024-09-10T06:29:17.822940+0000","last_undegraded":"2024-09-10T06:29:17.822940+0000","last_fullsized":"2024-09-10T06:29:17.822940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:14.600216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464321+0000","last_change":"2024-09-10T06:26:26.180820+0000","last_active":"2024-09-10T06:28:48.464321+0000","last_peered":"2024-09-10T06:28:48.464321+0000","last_clean":"2024-09-10T06:28:48.464321+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:28:48.464321+0000","last_undegraded":"2024-09-10T06:28:48.464321+0000","last_fullsized":"2024-09-10T06:28:48.464321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:45:51.928304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458371+0000","last_change":"2024-09-10T06:26:34.272915+0000","last_active":"2024-09-10T06:28:48.458371+0000","last_peered":"2024-09-10T06:28:48.458371+0000","last_clean":"2024-09-10T06:28:48.458371+0000","last_became_active":"2024-09-10T06:26:34.272192+0000","last_became_peered":"2024-09-10T06:26:34.272192+0000","last_unstale":"2024-09-10T06:28:48.458371+0000","last_undegraded":"2024-09-10T06:28:48.458371+0000","last_fullsized":"2024-09-10T06:28:48.458371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:07.874348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453060+0000","last_change":"2024-09-10T06:26:36.291431+0000","last_active":"2024-09-10T06:28:48.453060+0000","last_peered":"2024-09-10T06:28:48.453060+0000","last_clean":"2024-09-10T06:28:48.453060+0000","last_became_active":"2024-09-10T06:26:36.290570+0000","last_became_peered":"2024-09-10T06:26:36.290570+0000","last_unstale":"2024-09-10T06:28:48.453060+0000","last_undegraded":"2024-09-10T06:28:48.453060+0000","last_fullsized":"2024-09-10T06:28:48.453060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:10.565531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'105","reported_seq":286,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.321737+0000","last_change":"2024-09-10T06:26:38.312069+0000","last_active":"2024-09-10T06:29:17.321737+0000","last_peered":"2024-09-10T06:29:17.321737+0000","last_clean":"2024-09-10T06:29:17.321737+0000","last_became_active":"2024-09-10T06:26:38.310450+0000","last_became_peered":"2024-09-10T06:26:38.310450+0000","last_unstale":"2024-09-10T06:29:17.321737+0000","last_undegraded":"2024-09-10T06:29:17.321737+0000","last_fullsized":"2024-09-10T06:29:17.321737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379767+0000","last_change":"2024-09-10T06:26:40.312990+0000","last_active":"2024-09-10T06:28:48.379767+0000","last_peered":"2024-09-10T06:28:48.379767+0000","last_clean":"2024-09-10T06:28:48.379767+0000","last_became_active":"2024-09-10T06:26:40.312266+0000","last_became_peered":"2024-09-10T06:26:40.312266+0000","last_unstale":"2024-09-10T06:28:48.379767+0000","last_undegraded":"2024-09-10T06:28:48.379767+0000","last_fullsized":"2024-09-10T06:28:48.379767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:15.777105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"76'4","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375253+0000","last_change":"2024-09-10T06:26:32.258874+0000","last_active":"2024-09-10T06:28:48.375253+0000","last_peered":"2024-09-10T06:28:48.375253+0000","last_clean":"2024-09-10T06:28:48.375253+0000","last_became_active":"2024-09-10T06:26:32.258337+0000","last_became_peered":"2024-09-10T06:26:32.258337+0000","last_unstale":"2024-09-10T06:28:48.375253+0000","last_undegraded":"2024-09-10T06:28:48.375253+0000","last_fullsized":"2024-09-10T06:28:48.375253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"95'16","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.864059+0000","last_change":"2024-09-10T06:26:30.581501+0000","last_active":"2024-09-10T06:29:17.864059+0000","last_peered":"2024-09-10T06:29:17.864059+0000","last_clean":"2024-09-10T06:29:17.864059+0000","last_became_active":"2024-09-10T06:26:30.581115+0000","last_became_peered":"2024-09-10T06:26:30.581115+0000","last_unstale":"2024-09-10T06:29:17.864059+0000","last_undegraded":"2024-09-10T06:29:17.864059+0000","last_fullsized":"2024-09-10T06:29:17.864059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:26.818002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454045+0000","last_change":"2024-09-10T06:26:25.537295+0000","last_active":"2024-09-10T06:28:48.454045+0000","last_peered":"2024-09-10T06:28:48.454045+0000","last_clean":"2024-09-10T06:28:48.454045+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:28:48.454045+0000","last_undegraded":"2024-09-10T06:28:48.454045+0000","last_fullsized":"2024-09-10T06:28:48.454045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:03:32.638325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377381+0000","last_change":"2024-09-10T06:26:34.258956+0000","last_active":"2024-09-10T06:28:48.377381+0000","last_peered":"2024-09-10T06:28:48.377381+0000","last_clean":"2024-09-10T06:28:48.377381+0000","last_became_active":"2024-09-10T06:26:34.257739+0000","last_became_peered":"2024-09-10T06:26:34.257739+0000","last_unstale":"2024-09-10T06:28:48.377381+0000","last_undegraded":"2024-09-10T06:28:48.377381+0000","last_fullsized":"2024-09-10T06:28:48.377381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:18.547827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'10","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377884+0000","last_change":"2024-09-10T06:26:36.271096+0000","last_active":"2024-09-10T06:28:48.377884+0000","last_peered":"2024-09-10T06:28:48.377884+0000","last_clean":"2024-09-10T06:28:48.377884+0000","last_became_active":"2024-09-10T06:26:36.270325+0000","last_became_peered":"2024-09-10T06:26:36.270325+0000","last_unstale":"2024-09-10T06:28:48.377884+0000","last_undegraded":"2024-09-10T06:28:48.377884+0000","last_fullsized":"2024-09-10T06:28:48.377884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'105","reported_seq":272,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.328189+0000","last_change":"2024-09-10T06:26:38.300795+0000","last_active":"2024-09-10T06:29:17.328189+0000","last_peered":"2024-09-10T06:29:17.328189+0000","last_clean":"2024-09-10T06:29:17.328189+0000","last_became_active":"2024-09-10T06:26:38.299466+0000","last_became_peered":"2024-09-10T06:26:38.299466+0000","last_unstale":"2024-09-10T06:29:17.328189+0000","last_undegraded":"2024-09-10T06:29:17.328189+0000","last_fullsized":"2024-09-10T06:29:17.328189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:38.641500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"67'4","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377214+0000","last_change":"2024-09-10T06:26:40.329688+0000","last_active":"2024-09-10T06:28:48.377214+0000","last_peered":"2024-09-10T06:28:48.377214+0000","last_clean":"2024-09-10T06:28:48.377214+0000","last_became_active":"2024-09-10T06:26:40.329009+0000","last_became_peered":"2024-09-10T06:26:40.329009+0000","last_unstale":"2024-09-10T06:28:48.377214+0000","last_undegraded":"2024-09-10T06:28:48.377214+0000","last_fullsized":"2024-09-10T06:28:48.377214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'8","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377758+0000","last_change":"2024-09-10T06:26:32.283524+0000","last_active":"2024-09-10T06:28:48.377758+0000","last_peered":"2024-09-10T06:28:48.377758+0000","last_clean":"2024-09-10T06:28:48.377758+0000","last_became_active":"2024-09-10T06:26:32.282794+0000","last_became_peered":"2024-09-10T06:26:32.282794+0000","last_unstale":"2024-09-10T06:28:48.377758+0000","last_undegraded":"2024-09-10T06:28:48.377758+0000","last_fullsized":"2024-09-10T06:28:48.377758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:11.537416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'12","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.930725+0000","last_change":"2024-09-10T06:26:30.578273+0000","last_active":"2024-09-10T06:29:17.930725+0000","last_peered":"2024-09-10T06:29:17.930725+0000","last_clean":"2024-09-10T06:29:17.930725+0000","last_became_active":"2024-09-10T06:26:30.577985+0000","last_became_peered":"2024-09-10T06:26:30.577985+0000","last_unstale":"2024-09-10T06:29:17.930725+0000","last_undegraded":"2024-09-10T06:29:17.930725+0000","last_fullsized":"2024-09-10T06:29:17.930725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460109+0000","last_change":"2024-09-10T06:26:26.037773+0000","last_active":"2024-09-10T06:28:48.460109+0000","last_peered":"2024-09-10T06:28:48.460109+0000","last_clean":"2024-09-10T06:28:48.460109+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:28:48.460109+0000","last_undegraded":"2024-09-10T06:28:48.460109+0000","last_fullsized":"2024-09-10T06:28:48.460109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:22.472290+0000","last_clean_scrub_stamp":"2024-09-10T06:26:22.472290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:21.949708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374863+0000","last_change":"2024-09-10T06:26:34.268710+0000","last_active":"2024-09-10T06:28:48.374863+0000","last_peered":"2024-09-10T06:28:48.374863+0000","last_clean":"2024-09-10T06:28:48.374863+0000","last_became_active":"2024-09-10T06:26:34.268359+0000","last_became_peered":"2024-09-10T06:26:34.268359+0000","last_unstale":"2024-09-10T06:28:48.374863+0000","last_undegraded":"2024-09-10T06:28:48.374863+0000","last_fullsized":"2024-09-10T06:28:48.374863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:27.191787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"95'46","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.510298+0000","last_change":"2024-09-10T06:26:36.299700+0000","last_active":"2024-09-10T06:29:17.510298+0000","last_peered":"2024-09-10T06:29:17.510298+0000","last_clean":"2024-09-10T06:29:17.510298+0000","last_became_active":"2024-09-10T06:26:36.297606+0000","last_became_peered":"2024-09-10T06:26:36.297606+0000","last_unstale":"2024-09-10T06:29:17.510298+0000","last_undegraded":"2024-09-10T06:29:17.510298+0000","last_fullsized":"2024-09-10T06:29:17.510298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375382+0000","last_change":"2024-09-10T06:26:38.290601+0000","last_active":"2024-09-10T06:28:48.375382+0000","last_peered":"2024-09-10T06:28:48.375382+0000","last_clean":"2024-09-10T06:28:48.375382+0000","last_became_active":"2024-09-10T06:26:38.289589+0000","last_became_peered":"2024-09-10T06:26:38.289589+0000","last_unstale":"2024-09-10T06:28:48.375382+0000","last_undegraded":"2024-09-10T06:28:48.375382+0000","last_fullsized":"2024-09-10T06:28:48.375382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:22.625936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458656+0000","last_change":"2024-09-10T06:26:40.332819+0000","last_active":"2024-09-10T06:28:48.458656+0000","last_peered":"2024-09-10T06:28:48.458656+0000","last_clean":"2024-09-10T06:28:48.458656+0000","last_became_active":"2024-09-10T06:26:40.332160+0000","last_became_peered":"2024-09-10T06:26:40.332160+0000","last_unstale":"2024-09-10T06:28:48.458656+0000","last_undegraded":"2024-09-10T06:28:48.458656+0000","last_fullsized":"2024-09-10T06:28:48.458656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.784870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378032+0000","last_change":"2024-09-10T06:26:40.334393+0000","last_active":"2024-09-10T06:28:48.378032+0000","last_peered":"2024-09-10T06:28:48.378032+0000","last_clean":"2024-09-10T06:28:48.378032+0000","last_became_active":"2024-09-10T06:26:40.333474+0000","last_became_peered":"2024-09-10T06:26:40.333474+0000","last_unstale":"2024-09-10T06:28:48.378032+0000","last_undegraded":"2024-09-10T06:28:48.378032+0000","last_fullsized":"2024-09-10T06:28:48.378032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:35.031954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'6","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379197+0000","last_change":"2024-09-10T06:26:32.272914+0000","last_active":"2024-09-10T06:28:48.379197+0000","last_peered":"2024-09-10T06:28:48.379197+0000","last_clean":"2024-09-10T06:28:48.379197+0000","last_became_active":"2024-09-10T06:26:32.272178+0000","last_became_peered":"2024-09-10T06:26:32.272178+0000","last_unstale":"2024-09-10T06:28:48.379197+0000","last_undegraded":"2024-09-10T06:28:48.379197+0000","last_fullsized":"2024-09-10T06:28:48.379197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"95'16","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.868588+0000","last_change":"2024-09-10T06:26:30.593531+0000","last_active":"2024-09-10T06:29:17.868588+0000","last_peered":"2024-09-10T06:29:17.868588+0000","last_clean":"2024-09-10T06:29:17.868588+0000","last_became_active":"2024-09-10T06:26:30.592753+0000","last_became_peered":"2024-09-10T06:26:30.592753+0000","last_unstale":"2024-09-10T06:29:17.868588+0000","last_undegraded":"2024-09-10T06:29:17.868588+0000","last_fullsized":"2024-09-10T06:29:17.868588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:14.506864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453697+0000","last_change":"2024-09-10T06:26:34.282877+0000","last_active":"2024-09-10T06:28:48.453697+0000","last_peered":"2024-09-10T06:28:48.453697+0000","last_clean":"2024-09-10T06:28:48.453697+0000","last_became_active":"2024-09-10T06:26:34.282281+0000","last_became_peered":"2024-09-10T06:26:34.282281+0000","last_unstale":"2024-09-10T06:28:48.453697+0000","last_undegraded":"2024-09-10T06:28:48.453697+0000","last_fullsized":"2024-09-10T06:28:48.453697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:41.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"95'20","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.737305+0000","last_change":"2024-09-10T06:26:36.273166+0000","last_active":"2024-09-10T06:29:17.737305+0000","last_peered":"2024-09-10T06:29:17.737305+0000","last_clean":"2024-09-10T06:29:17.737305+0000","last_became_active":"2024-09-10T06:26:36.272386+0000","last_became_peered":"2024-09-10T06:26:36.272386+0000","last_unstale":"2024-09-10T06:29:17.737305+0000","last_undegraded":"2024-09-10T06:29:17.737305+0000","last_fullsized":"2024-09-10T06:29:17.737305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374570+0000","last_change":"2024-09-10T06:26:38.297347+0000","last_active":"2024-09-10T06:28:48.374570+0000","last_peered":"2024-09-10T06:28:48.374570+0000","last_clean":"2024-09-10T06:28:48.374570+0000","last_became_active":"2024-09-10T06:26:38.296600+0000","last_became_peered":"2024-09-10T06:26:38.296600+0000","last_unstale":"2024-09-10T06:28:48.374570+0000","last_undegraded":"2024-09-10T06:28:48.374570+0000","last_fullsized":"2024-09-10T06:28:48.374570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:08.758126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"67'20","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379025+0000","last_change":"2024-09-10T06:26:40.321844+0000","last_active":"2024-09-10T06:28:48.379025+0000","last_peered":"2024-09-10T06:28:48.379025+0000","last_clean":"2024-09-10T06:28:48.379025+0000","last_became_active":"2024-09-10T06:26:40.321097+0000","last_became_peered":"2024-09-10T06:26:40.321097+0000","last_unstale":"2024-09-10T06:28:48.379025+0000","last_undegraded":"2024-09-10T06:28:48.379025+0000","last_fullsized":"2024-09-10T06:28:48.379025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:10.004849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"67'6","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453454+0000","last_change":"2024-09-10T06:26:32.286989+0000","last_active":"2024-09-10T06:28:48.453454+0000","last_peered":"2024-09-10T06:28:48.453454+0000","last_clean":"2024-09-10T06:28:48.453454+0000","last_became_active":"2024-09-10T06:26:32.286519+0000","last_became_peered":"2024-09-10T06:26:32.286519+0000","last_unstale":"2024-09-10T06:28:48.453454+0000","last_undegraded":"2024-09-10T06:28:48.453454+0000","last_fullsized":"2024-09-10T06:28:48.453454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:40:31.592472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"95'12","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.860512+0000","last_change":"2024-09-10T06:26:30.587315+0000","last_active":"2024-09-10T06:29:17.860512+0000","last_peered":"2024-09-10T06:29:17.860512+0000","last_clean":"2024-09-10T06:29:17.860512+0000","last_became_active":"2024-09-10T06:26:30.586611+0000","last_became_peered":"2024-09-10T06:26:30.586611+0000","last_unstale":"2024-09-10T06:29:17.860512+0000","last_undegraded":"2024-09-10T06:29:17.860512+0000","last_fullsized":"2024-09-10T06:29:17.860512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"27'1","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.278125+0000","last_change":"2024-09-10T06:26:34.271770+0000","last_active":"2024-09-10T06:29:17.278125+0000","last_peered":"2024-09-10T06:29:17.278125+0000","last_clean":"2024-09-10T06:29:17.278125+0000","last_became_active":"2024-09-10T06:26:34.269875+0000","last_became_peered":"2024-09-10T06:26:34.269875+0000","last_unstale":"2024-09-10T06:29:17.278125+0000","last_undegraded":"2024-09-10T06:29:17.278125+0000","last_fullsized":"2024-09-10T06:29:17.278125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:09.570079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"67'6","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375286+0000","last_change":"2024-09-10T06:26:36.289140+0000","last_active":"2024-09-10T06:28:48.375286+0000","last_peered":"2024-09-10T06:28:48.375286+0000","last_clean":"2024-09-10T06:28:48.375286+0000","last_became_active":"2024-09-10T06:26:36.288355+0000","last_became_peered":"2024-09-10T06:26:36.288355+0000","last_unstale":"2024-09-10T06:28:48.375286+0000","last_undegraded":"2024-09-10T06:28:48.375286+0000","last_fullsized":"2024-09-10T06:28:48.375286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:42.518982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456930+0000","last_change":"2024-09-10T06:26:38.302040+0000","last_active":"2024-09-10T06:28:48.456930+0000","last_peered":"2024-09-10T06:28:48.456930+0000","last_clean":"2024-09-10T06:28:48.456930+0000","last_became_active":"2024-09-10T06:26:38.301064+0000","last_became_peered":"2024-09-10T06:26:38.301064+0000","last_unstale":"2024-09-10T06:28:48.456930+0000","last_undegraded":"2024-09-10T06:28:48.456930+0000","last_fullsized":"2024-09-10T06:28:48.456930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:41.513255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"64'4","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377597+0000","last_change":"2024-09-10T06:26:40.322368+0000","last_active":"2024-09-10T06:28:48.377597+0000","last_peered":"2024-09-10T06:28:48.377597+0000","last_clean":"2024-09-10T06:28:48.377597+0000","last_became_active":"2024-09-10T06:26:40.321592+0000","last_became_peered":"2024-09-10T06:26:40.321592+0000","last_unstale":"2024-09-10T06:28:48.377597+0000","last_undegraded":"2024-09-10T06:28:48.377597+0000","last_fullsized":"2024-09-10T06:28:48.377597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:03.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"61'4","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375592+0000","last_change":"2024-09-10T06:26:32.259666+0000","last_active":"2024-09-10T06:28:48.375592+0000","last_peered":"2024-09-10T06:28:48.375592+0000","last_clean":"2024-09-10T06:28:48.375592+0000","last_became_active":"2024-09-10T06:26:32.258775+0000","last_became_peered":"2024-09-10T06:26:32.258775+0000","last_unstale":"2024-09-10T06:28:48.375592+0000","last_undegraded":"2024-09-10T06:28:48.375592+0000","last_fullsized":"2024-09-10T06:28:48.375592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:02:06.626488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"95'24","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.895473+0000","last_change":"2024-09-10T06:26:30.592773+0000","last_active":"2024-09-10T06:29:17.895473+0000","last_peered":"2024-09-10T06:29:17.895473+0000","last_clean":"2024-09-10T06:29:17.895473+0000","last_became_active":"2024-09-10T06:26:30.590566+0000","last_became_peered":"2024-09-10T06:26:30.590566+0000","last_unstale":"2024-09-10T06:29:17.895473+0000","last_undegraded":"2024-09-10T06:29:17.895473+0000","last_fullsized":"2024-09-10T06:29:17.895473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:35.688897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":32,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455138+0000","last_change":"2024-09-10T06:26:34.281690+0000","last_active":"2024-09-10T06:28:48.455138+0000","last_peered":"2024-09-10T06:28:48.455138+0000","last_clean":"2024-09-10T06:28:48.455138+0000","last_became_active":"2024-09-10T06:26:34.281008+0000","last_became_peered":"2024-09-10T06:26:34.281008+0000","last_unstale":"2024-09-10T06:28:48.455138+0000","last_undegraded":"2024-09-10T06:28:48.455138+0000","last_fullsized":"2024-09-10T06:28:48.455138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"95'20","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.472823+0000","last_change":"2024-09-10T06:26:36.277028+0000","last_active":"2024-09-10T06:29:17.472823+0000","last_peered":"2024-09-10T06:29:17.472823+0000","last_clean":"2024-09-10T06:29:17.472823+0000","last_became_active":"2024-09-10T06:26:36.276248+0000","last_became_peered":"2024-09-10T06:26:36.276248+0000","last_unstale":"2024-09-10T06:29:17.472823+0000","last_undegraded":"2024-09-10T06:29:17.472823+0000","last_fullsized":"2024-09-10T06:29:17.472823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:53.521681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457566+0000","last_change":"2024-09-10T06:28:46.344566+0000","last_active":"2024-09-10T06:28:48.457566+0000","last_peered":"2024-09-10T06:28:48.457566+0000","last_clean":"2024-09-10T06:28:48.457566+0000","last_became_active":"2024-09-10T06:28:46.343657+0000","last_became_peered":"2024-09-10T06:28:46.343657+0000","last_unstale":"2024-09-10T06:28:48.457566+0000","last_undegraded":"2024-09-10T06:28:48.457566+0000","last_fullsized":"2024-09-10T06:28:48.457566+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:25.681176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460858+0000","last_change":"2024-09-10T06:26:40.331445+0000","last_active":"2024-09-10T06:28:48.460858+0000","last_peered":"2024-09-10T06:28:48.460858+0000","last_clean":"2024-09-10T06:28:48.460858+0000","last_became_active":"2024-09-10T06:26:40.330707+0000","last_became_peered":"2024-09-10T06:26:40.330707+0000","last_unstale":"2024-09-10T06:28:48.460858+0000","last_undegraded":"2024-09-10T06:28:48.460858+0000","last_fullsized":"2024-09-10T06:28:48.460858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.822687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375781+0000","last_change":"2024-09-10T06:26:32.266221+0000","last_active":"2024-09-10T06:28:48.375781+0000","last_peered":"2024-09-10T06:28:48.375781+0000","last_clean":"2024-09-10T06:28:48.375781+0000","last_became_active":"2024-09-10T06:26:32.265705+0000","last_became_peered":"2024-09-10T06:26:32.265705+0000","last_unstale":"2024-09-10T06:28:48.375781+0000","last_undegraded":"2024-09-10T06:28:48.375781+0000","last_fullsized":"2024-09-10T06:28:48.375781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"95'18","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.844979+0000","last_change":"2024-09-10T06:26:30.594335+0000","last_active":"2024-09-10T06:29:17.844979+0000","last_peered":"2024-09-10T06:29:17.844979+0000","last_clean":"2024-09-10T06:29:17.844979+0000","last_became_active":"2024-09-10T06:26:30.593326+0000","last_became_peered":"2024-09-10T06:26:30.593326+0000","last_unstale":"2024-09-10T06:29:17.844979+0000","last_undegraded":"2024-09-10T06:29:17.844979+0000","last_fullsized":"2024-09-10T06:29:17.844979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:37.297722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457418+0000","last_change":"2024-09-10T06:26:34.281915+0000","last_active":"2024-09-10T06:28:48.457418+0000","last_peered":"2024-09-10T06:28:48.457418+0000","last_clean":"2024-09-10T06:28:48.457418+0000","last_became_active":"2024-09-10T06:26:34.281147+0000","last_became_peered":"2024-09-10T06:26:34.281147+0000","last_unstale":"2024-09-10T06:28:48.457418+0000","last_undegraded":"2024-09-10T06:28:48.457418+0000","last_fullsized":"2024-09-10T06:28:48.457418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:41.201430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"95'18","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.439882+0000","last_change":"2024-09-10T06:26:36.298537+0000","last_active":"2024-09-10T06:29:17.439882+0000","last_peered":"2024-09-10T06:29:17.439882+0000","last_clean":"2024-09-10T06:29:17.439882+0000","last_became_active":"2024-09-10T06:26:36.297372+0000","last_became_peered":"2024-09-10T06:26:36.297372+0000","last_unstale":"2024-09-10T06:29:17.439882+0000","last_undegraded":"2024-09-10T06:29:17.439882+0000","last_fullsized":"2024-09-10T06:29:17.439882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376070+0000","last_change":"2024-09-10T06:26:38.301461+0000","last_active":"2024-09-10T06:28:48.376070+0000","last_peered":"2024-09-10T06:28:48.376070+0000","last_clean":"2024-09-10T06:28:48.376070+0000","last_became_active":"2024-09-10T06:26:38.300580+0000","last_became_peered":"2024-09-10T06:26:38.300580+0000","last_unstale":"2024-09-10T06:28:48.376070+0000","last_undegraded":"2024-09-10T06:28:48.376070+0000","last_fullsized":"2024-09-10T06:28:48.376070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"67'10","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459745+0000","last_change":"2024-09-10T06:26:32.285276+0000","last_active":"2024-09-10T06:28:48.459745+0000","last_peered":"2024-09-10T06:28:48.459745+0000","last_clean":"2024-09-10T06:28:48.459745+0000","last_became_active":"2024-09-10T06:26:32.284457+0000","last_became_peered":"2024-09-10T06:26:32.284457+0000","last_unstale":"2024-09-10T06:28:48.459745+0000","last_undegraded":"2024-09-10T06:28:48.459745+0000","last_fullsized":"2024-09-10T06:28:48.459745+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:22:37.340388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"95'14","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.858404+0000","last_change":"2024-09-10T06:26:30.573339+0000","last_active":"2024-09-10T06:29:17.858404+0000","last_peered":"2024-09-10T06:29:17.858404+0000","last_clean":"2024-09-10T06:29:17.858404+0000","last_became_active":"2024-09-10T06:26:30.571377+0000","last_became_peered":"2024-09-10T06:26:30.571377+0000","last_unstale":"2024-09-10T06:29:17.858404+0000","last_undegraded":"2024-09-10T06:29:17.858404+0000","last_fullsized":"2024-09-10T06:29:17.858404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:59.752497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378936+0000","last_change":"2024-09-10T06:26:34.269013+0000","last_active":"2024-09-10T06:28:48.378936+0000","last_peered":"2024-09-10T06:28:48.378936+0000","last_clean":"2024-09-10T06:28:48.378936+0000","last_became_active":"2024-09-10T06:26:34.268677+0000","last_became_peered":"2024-09-10T06:26:34.268677+0000","last_unstale":"2024-09-10T06:28:48.378936+0000","last_undegraded":"2024-09-10T06:28:48.378936+0000","last_fullsized":"2024-09-10T06:28:48.378936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"95'30","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.782628+0000","last_change":"2024-09-10T06:26:36.300362+0000","last_active":"2024-09-10T06:29:17.782628+0000","last_peered":"2024-09-10T06:29:17.782628+0000","last_clean":"2024-09-10T06:29:17.782628+0000","last_became_active":"2024-09-10T06:26:36.299645+0000","last_became_peered":"2024-09-10T06:26:36.299645+0000","last_unstale":"2024-09-10T06:29:17.782628+0000","last_undegraded":"2024-09-10T06:29:17.782628+0000","last_fullsized":"2024-09-10T06:29:17.782628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:17.424354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461312+0000","last_change":"2024-09-10T06:26:38.299751+0000","last_active":"2024-09-10T06:28:48.461312+0000","last_peered":"2024-09-10T06:28:48.461312+0000","last_clean":"2024-09-10T06:28:48.461312+0000","last_became_active":"2024-09-10T06:26:38.298414+0000","last_became_peered":"2024-09-10T06:26:38.298414+0000","last_unstale":"2024-09-10T06:28:48.461312+0000","last_undegraded":"2024-09-10T06:28:48.461312+0000","last_fullsized":"2024-09-10T06:28:48.461312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'2","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375129+0000","last_change":"2024-09-10T06:26:40.312752+0000","last_active":"2024-09-10T06:28:48.375129+0000","last_peered":"2024-09-10T06:28:48.375129+0000","last_clean":"2024-09-10T06:28:48.375129+0000","last_became_active":"2024-09-10T06:26:40.312026+0000","last_became_peered":"2024-09-10T06:26:40.312026+0000","last_unstale":"2024-09-10T06:28:48.375129+0000","last_undegraded":"2024-09-10T06:28:48.375129+0000","last_fullsized":"2024-09-10T06:28:48.375129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:50.071224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379114+0000","last_change":"2024-09-10T06:26:32.266934+0000","last_active":"2024-09-10T06:28:48.379114+0000","last_peered":"2024-09-10T06:28:48.379114+0000","last_clean":"2024-09-10T06:28:48.379114+0000","last_became_active":"2024-09-10T06:26:32.266682+0000","last_became_peered":"2024-09-10T06:26:32.266682+0000","last_unstale":"2024-09-10T06:28:48.379114+0000","last_undegraded":"2024-09-10T06:28:48.379114+0000","last_fullsized":"2024-09-10T06:28:48.379114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'28","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.874059+0000","last_change":"2024-09-10T06:26:30.579097+0000","last_active":"2024-09-10T06:29:17.874059+0000","last_peered":"2024-09-10T06:29:17.874059+0000","last_clean":"2024-09-10T06:29:17.874059+0000","last_became_active":"2024-09-10T06:26:30.578692+0000","last_became_peered":"2024-09-10T06:26:30.578692+0000","last_unstale":"2024-09-10T06:29:17.874059+0000","last_undegraded":"2024-09-10T06:29:17.874059+0000","last_fullsized":"2024-09-10T06:29:17.874059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:15.878123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":36,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"27'1","reported_seq":214,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.276344+0000","last_change":"2024-09-10T06:26:34.282356+0000","last_active":"2024-09-10T06:29:17.276344+0000","last_peered":"2024-09-10T06:29:17.276344+0000","last_clean":"2024-09-10T06:29:17.276344+0000","last_became_active":"2024-09-10T06:26:34.281167+0000","last_became_peered":"2024-09-10T06:26:34.281167+0000","last_unstale":"2024-09-10T06:29:17.276344+0000","last_undegraded":"2024-09-10T06:29:17.276344+0000","last_fullsized":"2024-09-10T06:29:17.276344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:57:59.042394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"95'26","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.456999+0000","last_change":"2024-09-10T06:26:36.301277+0000","last_active":"2024-09-10T06:29:17.456999+0000","last_peered":"2024-09-10T06:29:17.456999+0000","last_clean":"2024-09-10T06:29:17.456999+0000","last_became_active":"2024-09-10T06:26:36.300501+0000","last_became_peered":"2024-09-10T06:26:36.300501+0000","last_unstale":"2024-09-10T06:29:17.456999+0000","last_undegraded":"2024-09-10T06:29:17.456999+0000","last_fullsized":"2024-09-10T06:29:17.456999+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:38.477946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454339+0000","last_change":"2024-09-10T06:26:38.305737+0000","last_active":"2024-09-10T06:28:48.454339+0000","last_peered":"2024-09-10T06:28:48.454339+0000","last_clean":"2024-09-10T06:28:48.454339+0000","last_became_active":"2024-09-10T06:26:38.303318+0000","last_became_peered":"2024-09-10T06:26:38.303318+0000","last_unstale":"2024-09-10T06:28:48.454339+0000","last_undegraded":"2024-09-10T06:28:48.454339+0000","last_fullsized":"2024-09-10T06:28:48.454339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:52.587622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"67'10","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458108+0000","last_change":"2024-09-10T06:26:40.318587+0000","last_active":"2024-09-10T06:28:48.458108+0000","last_peered":"2024-09-10T06:28:48.458108+0000","last_clean":"2024-09-10T06:28:48.458108+0000","last_became_active":"2024-09-10T06:26:40.317695+0000","last_became_peered":"2024-09-10T06:26:40.317695+0000","last_unstale":"2024-09-10T06:28:48.458108+0000","last_undegraded":"2024-09-10T06:28:48.458108+0000","last_fullsized":"2024-09-10T06:28:48.458108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:48.298686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379045+0000","last_change":"2024-09-10T06:26:32.276218+0000","last_active":"2024-09-10T06:28:48.379045+0000","last_peered":"2024-09-10T06:28:48.379045+0000","last_clean":"2024-09-10T06:28:48.379045+0000","last_became_active":"2024-09-10T06:26:32.275805+0000","last_became_peered":"2024-09-10T06:26:32.275805+0000","last_unstale":"2024-09-10T06:28:48.379045+0000","last_undegraded":"2024-09-10T06:28:48.379045+0000","last_fullsized":"2024-09-10T06:28:48.379045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"95'14","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.872831+0000","last_change":"2024-09-10T06:26:30.568731+0000","last_active":"2024-09-10T06:29:17.872831+0000","last_peered":"2024-09-10T06:29:17.872831+0000","last_clean":"2024-09-10T06:29:17.872831+0000","last_became_active":"2024-09-10T06:26:30.567937+0000","last_became_peered":"2024-09-10T06:26:30.567937+0000","last_unstale":"2024-09-10T06:29:17.872831+0000","last_undegraded":"2024-09-10T06:29:17.872831+0000","last_fullsized":"2024-09-10T06:29:17.872831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:18.974865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380895+0000","last_change":"2024-09-10T06:26:34.266227+0000","last_active":"2024-09-10T06:28:48.380895+0000","last_peered":"2024-09-10T06:28:48.380895+0000","last_clean":"2024-09-10T06:28:48.380895+0000","last_became_active":"2024-09-10T06:26:34.262443+0000","last_became_peered":"2024-09-10T06:26:34.262443+0000","last_unstale":"2024-09-10T06:28:48.380895+0000","last_undegraded":"2024-09-10T06:28:48.380895+0000","last_fullsized":"2024-09-10T06:28:48.380895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.918813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"95'21","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.775723+0000","last_change":"2024-09-10T06:26:36.292958+0000","last_active":"2024-09-10T06:29:17.775723+0000","last_peered":"2024-09-10T06:29:17.775723+0000","last_clean":"2024-09-10T06:29:17.775723+0000","last_became_active":"2024-09-10T06:26:36.292149+0000","last_became_peered":"2024-09-10T06:26:36.292149+0000","last_unstale":"2024-09-10T06:29:17.775723+0000","last_undegraded":"2024-09-10T06:29:17.775723+0000","last_fullsized":"2024-09-10T06:29:17.775723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453832+0000","last_change":"2024-09-10T06:26:38.302991+0000","last_active":"2024-09-10T06:28:48.453832+0000","last_peered":"2024-09-10T06:28:48.453832+0000","last_clean":"2024-09-10T06:28:48.453832+0000","last_became_active":"2024-09-10T06:26:38.289306+0000","last_became_peered":"2024-09-10T06:26:38.289306+0000","last_unstale":"2024-09-10T06:28:48.453832+0000","last_undegraded":"2024-09-10T06:28:48.453832+0000","last_fullsized":"2024-09-10T06:28:48.453832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:57.625329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456492+0000","last_change":"2024-09-10T06:26:40.327627+0000","last_active":"2024-09-10T06:28:48.456492+0000","last_peered":"2024-09-10T06:28:48.456492+0000","last_clean":"2024-09-10T06:28:48.456492+0000","last_became_active":"2024-09-10T06:26:40.326888+0000","last_became_peered":"2024-09-10T06:26:40.326888+0000","last_unstale":"2024-09-10T06:28:48.456492+0000","last_undegraded":"2024-09-10T06:28:48.456492+0000","last_fullsized":"2024-09-10T06:28:48.456492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:41.122562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455208+0000","last_change":"2024-09-10T06:26:32.275071+0000","last_active":"2024-09-10T06:28:48.455208+0000","last_peered":"2024-09-10T06:28:48.455208+0000","last_clean":"2024-09-10T06:28:48.455208+0000","last_became_active":"2024-09-10T06:26:32.274395+0000","last_became_peered":"2024-09-10T06:26:32.274395+0000","last_unstale":"2024-09-10T06:28:48.455208+0000","last_undegraded":"2024-09-10T06:28:48.455208+0000","last_fullsized":"2024-09-10T06:28:48.455208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:51.369493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"95'14","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.882420+0000","last_change":"2024-09-10T06:26:30.594599+0000","last_active":"2024-09-10T06:29:17.882420+0000","last_peered":"2024-09-10T06:29:17.882420+0000","last_clean":"2024-09-10T06:29:17.882420+0000","last_became_active":"2024-09-10T06:26:30.594058+0000","last_became_peered":"2024-09-10T06:26:30.594058+0000","last_unstale":"2024-09-10T06:29:17.882420+0000","last_undegraded":"2024-09-10T06:29:17.882420+0000","last_fullsized":"2024-09-10T06:29:17.882420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:18.396692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454445+0000","last_change":"2024-09-10T06:26:34.279538+0000","last_active":"2024-09-10T06:28:48.454445+0000","last_peered":"2024-09-10T06:28:48.454445+0000","last_clean":"2024-09-10T06:28:48.454445+0000","last_became_active":"2024-09-10T06:26:34.278871+0000","last_became_peered":"2024-09-10T06:26:34.278871+0000","last_unstale":"2024-09-10T06:28:48.454445+0000","last_undegraded":"2024-09-10T06:28:48.454445+0000","last_fullsized":"2024-09-10T06:28:48.454445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:13.203357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"71'12","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379969+0000","last_change":"2024-09-10T06:26:36.290976+0000","last_active":"2024-09-10T06:28:48.379969+0000","last_peered":"2024-09-10T06:28:48.379969+0000","last_clean":"2024-09-10T06:28:48.379969+0000","last_became_active":"2024-09-10T06:26:36.290265+0000","last_became_peered":"2024-09-10T06:26:36.290265+0000","last_unstale":"2024-09-10T06:28:48.379969+0000","last_undegraded":"2024-09-10T06:28:48.379969+0000","last_fullsized":"2024-09-10T06:28:48.379969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'105","reported_seq":274,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.319705+0000","last_change":"2024-09-10T06:26:38.292031+0000","last_active":"2024-09-10T06:29:17.319705+0000","last_peered":"2024-09-10T06:29:17.319705+0000","last_clean":"2024-09-10T06:29:17.319705+0000","last_became_active":"2024-09-10T06:26:38.288791+0000","last_became_peered":"2024-09-10T06:26:38.288791+0000","last_unstale":"2024-09-10T06:29:17.319705+0000","last_undegraded":"2024-09-10T06:29:17.319705+0000","last_fullsized":"2024-09-10T06:29:17.319705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:07.830355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"76'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455098+0000","last_change":"2024-09-10T06:26:40.336448+0000","last_active":"2024-09-10T06:28:48.455098+0000","last_peered":"2024-09-10T06:28:48.455098+0000","last_clean":"2024-09-10T06:28:48.455098+0000","last_became_active":"2024-09-10T06:26:40.335771+0000","last_became_peered":"2024-09-10T06:26:40.335771+0000","last_unstale":"2024-09-10T06:28:48.455098+0000","last_undegraded":"2024-09-10T06:28:48.455098+0000","last_fullsized":"2024-09-10T06:28:48.455098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378950+0000","last_change":"2024-09-10T06:26:32.262176+0000","last_active":"2024-09-10T06:28:48.378950+0000","last_peered":"2024-09-10T06:28:48.378950+0000","last_clean":"2024-09-10T06:28:48.378950+0000","last_became_active":"2024-09-10T06:26:32.261250+0000","last_became_peered":"2024-09-10T06:26:32.261250+0000","last_unstale":"2024-09-10T06:28:48.378950+0000","last_undegraded":"2024-09-10T06:28:48.378950+0000","last_fullsized":"2024-09-10T06:28:48.378950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:59:06.186394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"95'16","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.860950+0000","last_change":"2024-09-10T06:26:30.604587+0000","last_active":"2024-09-10T06:29:17.860950+0000","last_peered":"2024-09-10T06:29:17.860950+0000","last_clean":"2024-09-10T06:29:17.860950+0000","last_became_active":"2024-09-10T06:26:30.603175+0000","last_became_peered":"2024-09-10T06:26:30.603175+0000","last_unstale":"2024-09-10T06:29:17.860950+0000","last_undegraded":"2024-09-10T06:29:17.860950+0000","last_fullsized":"2024-09-10T06:29:17.860950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458290+0000","last_change":"2024-09-10T06:26:34.286028+0000","last_active":"2024-09-10T06:28:48.458290+0000","last_peered":"2024-09-10T06:28:48.458290+0000","last_clean":"2024-09-10T06:28:48.458290+0000","last_became_active":"2024-09-10T06:26:34.285169+0000","last_became_peered":"2024-09-10T06:26:34.285169+0000","last_unstale":"2024-09-10T06:28:48.458290+0000","last_undegraded":"2024-09-10T06:28:48.458290+0000","last_fullsized":"2024-09-10T06:28:48.458290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:24.146088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"95'24","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.913573+0000","last_change":"2024-09-10T06:26:36.292679+0000","last_active":"2024-09-10T06:29:17.913573+0000","last_peered":"2024-09-10T06:29:17.913573+0000","last_clean":"2024-09-10T06:29:17.913573+0000","last_became_active":"2024-09-10T06:26:36.288780+0000","last_became_peered":"2024-09-10T06:26:36.288780+0000","last_unstale":"2024-09-10T06:29:17.913573+0000","last_undegraded":"2024-09-10T06:29:17.913573+0000","last_fullsized":"2024-09-10T06:29:17.913573+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374709+0000","last_change":"2024-09-10T06:26:38.293015+0000","last_active":"2024-09-10T06:28:48.374709+0000","last_peered":"2024-09-10T06:28:48.374709+0000","last_clean":"2024-09-10T06:28:48.374709+0000","last_became_active":"2024-09-10T06:26:38.292185+0000","last_became_peered":"2024-09-10T06:26:38.292185+0000","last_unstale":"2024-09-10T06:28:48.374709+0000","last_undegraded":"2024-09-10T06:28:48.374709+0000","last_fullsized":"2024-09-10T06:28:48.374709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:32.694777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"64'10","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464937+0000","last_change":"2024-09-10T06:26:40.336074+0000","last_active":"2024-09-10T06:28:48.464937+0000","last_peered":"2024-09-10T06:28:48.464937+0000","last_clean":"2024-09-10T06:28:48.464937+0000","last_became_active":"2024-09-10T06:26:40.335339+0000","last_became_peered":"2024-09-10T06:26:40.335339+0000","last_unstale":"2024-09-10T06:28:48.464937+0000","last_undegraded":"2024-09-10T06:28:48.464937+0000","last_fullsized":"2024-09-10T06:28:48.464937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378245+0000","last_change":"2024-09-10T06:26:32.262823+0000","last_active":"2024-09-10T06:28:48.378245+0000","last_peered":"2024-09-10T06:28:48.378245+0000","last_clean":"2024-09-10T06:28:48.378245+0000","last_became_active":"2024-09-10T06:26:32.262041+0000","last_became_peered":"2024-09-10T06:26:32.262041+0000","last_unstale":"2024-09-10T06:28:48.378245+0000","last_undegraded":"2024-09-10T06:28:48.378245+0000","last_fullsized":"2024-09-10T06:28:48.378245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:10:48.768083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"95'14","reported_seq":130,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.815599+0000","last_change":"2024-09-10T06:27:08.868703+0000","last_active":"2024-09-10T06:29:17.815599+0000","last_peered":"2024-09-10T06:29:17.815599+0000","last_clean":"2024-09-10T06:29:17.815599+0000","last_became_active":"2024-09-10T06:27:08.868399+0000","last_became_peered":"2024-09-10T06:27:08.868399+0000","last_unstale":"2024-09-10T06:29:17.815599+0000","last_undegraded":"2024-09-10T06:29:17.815599+0000","last_fullsized":"2024-09-10T06:29:17.815599+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:20.532682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459883+0000","last_change":"2024-09-10T06:26:34.282651+0000","last_active":"2024-09-10T06:28:48.459883+0000","last_peered":"2024-09-10T06:28:48.459883+0000","last_clean":"2024-09-10T06:28:48.459883+0000","last_became_active":"2024-09-10T06:26:34.281777+0000","last_became_peered":"2024-09-10T06:26:34.281777+0000","last_unstale":"2024-09-10T06:28:48.459883+0000","last_undegraded":"2024-09-10T06:28:48.459883+0000","last_fullsized":"2024-09-10T06:28:48.459883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:42.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"95'18","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.916486+0000","last_change":"2024-09-10T06:26:36.285192+0000","last_active":"2024-09-10T06:29:17.916486+0000","last_peered":"2024-09-10T06:29:17.916486+0000","last_clean":"2024-09-10T06:29:17.916486+0000","last_became_active":"2024-09-10T06:26:36.284470+0000","last_became_peered":"2024-09-10T06:26:36.284470+0000","last_unstale":"2024-09-10T06:29:17.916486+0000","last_undegraded":"2024-09-10T06:29:17.916486+0000","last_fullsized":"2024-09-10T06:29:17.916486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:44.280458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456932+0000","last_change":"2024-09-10T06:26:38.303425+0000","last_active":"2024-09-10T06:28:48.456932+0000","last_peered":"2024-09-10T06:28:48.456932+0000","last_clean":"2024-09-10T06:28:48.456932+0000","last_became_active":"2024-09-10T06:26:38.302606+0000","last_became_peered":"2024-09-10T06:26:38.302606+0000","last_unstale":"2024-09-10T06:28:48.456932+0000","last_undegraded":"2024-09-10T06:28:48.456932+0000","last_fullsized":"2024-09-10T06:28:48.456932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:14.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"76'13","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379260+0000","last_change":"2024-09-10T06:26:40.311253+0000","last_active":"2024-09-10T06:28:48.379260+0000","last_peered":"2024-09-10T06:28:48.379260+0000","last_clean":"2024-09-10T06:28:48.379260+0000","last_became_active":"2024-09-10T06:26:40.310414+0000","last_became_peered":"2024-09-10T06:26:40.310414+0000","last_unstale":"2024-09-10T06:28:48.379260+0000","last_undegraded":"2024-09-10T06:28:48.379260+0000","last_fullsized":"2024-09-10T06:28:48.379260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:20.868195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375984+0000","last_change":"2024-09-10T06:26:32.262972+0000","last_active":"2024-09-10T06:28:48.375984+0000","last_peered":"2024-09-10T06:28:48.375984+0000","last_clean":"2024-09-10T06:28:48.375984+0000","last_became_active":"2024-09-10T06:26:32.262469+0000","last_became_peered":"2024-09-10T06:26:32.262469+0000","last_unstale":"2024-09-10T06:28:48.375984+0000","last_undegraded":"2024-09-10T06:28:48.375984+0000","last_fullsized":"2024-09-10T06:28:48.375984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"95'14","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.901812+0000","last_change":"2024-09-10T06:26:30.602013+0000","last_active":"2024-09-10T06:29:17.901812+0000","last_peered":"2024-09-10T06:29:17.901812+0000","last_clean":"2024-09-10T06:29:17.901812+0000","last_became_active":"2024-09-10T06:26:30.601672+0000","last_became_peered":"2024-09-10T06:26:30.601672+0000","last_unstale":"2024-09-10T06:29:17.901812+0000","last_undegraded":"2024-09-10T06:29:17.901812+0000","last_fullsized":"2024-09-10T06:29:17.901812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:52.012063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376590+0000","last_change":"2024-09-10T06:26:34.277010+0000","last_active":"2024-09-10T06:28:48.376590+0000","last_peered":"2024-09-10T06:28:48.376590+0000","last_clean":"2024-09-10T06:28:48.376590+0000","last_became_active":"2024-09-10T06:26:34.276197+0000","last_became_peered":"2024-09-10T06:26:34.276197+0000","last_unstale":"2024-09-10T06:28:48.376590+0000","last_undegraded":"2024-09-10T06:28:48.376590+0000","last_fullsized":"2024-09-10T06:28:48.376590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:32.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"95'14","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.756849+0000","last_change":"2024-09-10T06:26:36.297514+0000","last_active":"2024-09-10T06:29:17.756849+0000","last_peered":"2024-09-10T06:29:17.756849+0000","last_clean":"2024-09-10T06:29:17.756849+0000","last_became_active":"2024-09-10T06:26:36.296615+0000","last_became_peered":"2024-09-10T06:26:36.296615+0000","last_unstale":"2024-09-10T06:29:17.756849+0000","last_undegraded":"2024-09-10T06:29:17.756849+0000","last_fullsized":"2024-09-10T06:29:17.756849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376631+0000","last_change":"2024-09-10T06:26:38.288794+0000","last_active":"2024-09-10T06:28:48.376631+0000","last_peered":"2024-09-10T06:28:48.376631+0000","last_clean":"2024-09-10T06:28:48.376631+0000","last_became_active":"2024-09-10T06:26:38.288055+0000","last_became_peered":"2024-09-10T06:26:38.288055+0000","last_unstale":"2024-09-10T06:28:48.376631+0000","last_undegraded":"2024-09-10T06:28:48.376631+0000","last_fullsized":"2024-09-10T06:28:48.376631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463598+0000","last_change":"2024-09-10T06:26:40.318067+0000","last_active":"2024-09-10T06:28:48.463598+0000","last_peered":"2024-09-10T06:28:48.463598+0000","last_clean":"2024-09-10T06:28:48.463598+0000","last_became_active":"2024-09-10T06:26:40.317244+0000","last_became_peered":"2024-09-10T06:26:40.317244+0000","last_unstale":"2024-09-10T06:28:48.463598+0000","last_undegraded":"2024-09-10T06:28:48.463598+0000","last_fullsized":"2024-09-10T06:28:48.463598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"76'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377374+0000","last_change":"2024-09-10T06:26:32.277908+0000","last_active":"2024-09-10T06:28:48.377374+0000","last_peered":"2024-09-10T06:28:48.377374+0000","last_clean":"2024-09-10T06:28:48.377374+0000","last_became_active":"2024-09-10T06:26:32.274812+0000","last_became_peered":"2024-09-10T06:26:32.274812+0000","last_unstale":"2024-09-10T06:28:48.377374+0000","last_undegraded":"2024-09-10T06:28:48.377374+0000","last_fullsized":"2024-09-10T06:28:48.377374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:18:37.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"95'20","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.864007+0000","last_change":"2024-09-10T06:26:30.594013+0000","last_active":"2024-09-10T06:29:17.864007+0000","last_peered":"2024-09-10T06:29:17.864007+0000","last_clean":"2024-09-10T06:29:17.864007+0000","last_became_active":"2024-09-10T06:26:30.593687+0000","last_became_peered":"2024-09-10T06:26:30.593687+0000","last_unstale":"2024-09-10T06:29:17.864007+0000","last_undegraded":"2024-09-10T06:29:17.864007+0000","last_fullsized":"2024-09-10T06:29:17.864007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:37.375037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453258+0000","last_change":"2024-09-10T06:26:34.283392+0000","last_active":"2024-09-10T06:28:48.453258+0000","last_peered":"2024-09-10T06:28:48.453258+0000","last_clean":"2024-09-10T06:28:48.453258+0000","last_became_active":"2024-09-10T06:26:34.282931+0000","last_became_peered":"2024-09-10T06:26:34.282931+0000","last_unstale":"2024-09-10T06:28:48.453258+0000","last_undegraded":"2024-09-10T06:28:48.453258+0000","last_fullsized":"2024-09-10T06:28:48.453258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:01.310719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"95'18","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.779335+0000","last_change":"2024-09-10T06:26:36.289834+0000","last_active":"2024-09-10T06:29:17.779335+0000","last_peered":"2024-09-10T06:29:17.779335+0000","last_clean":"2024-09-10T06:29:17.779335+0000","last_became_active":"2024-09-10T06:26:36.289033+0000","last_became_peered":"2024-09-10T06:26:36.289033+0000","last_unstale":"2024-09-10T06:29:17.779335+0000","last_undegraded":"2024-09-10T06:29:17.779335+0000","last_fullsized":"2024-09-10T06:29:17.779335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375982+0000","last_change":"2024-09-10T06:26:38.299568+0000","last_active":"2024-09-10T06:28:48.375982+0000","last_peered":"2024-09-10T06:28:48.375982+0000","last_clean":"2024-09-10T06:28:48.375982+0000","last_became_active":"2024-09-10T06:26:38.298779+0000","last_became_peered":"2024-09-10T06:26:38.298779+0000","last_unstale":"2024-09-10T06:28:48.375982+0000","last_undegraded":"2024-09-10T06:28:48.375982+0000","last_fullsized":"2024-09-10T06:28:48.375982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.381022+0000","last_change":"2024-09-10T06:26:40.336329+0000","last_active":"2024-09-10T06:28:48.381022+0000","last_peered":"2024-09-10T06:28:48.381022+0000","last_clean":"2024-09-10T06:28:48.381022+0000","last_became_active":"2024-09-10T06:26:40.335348+0000","last_became_peered":"2024-09-10T06:26:40.335348+0000","last_unstale":"2024-09-10T06:28:48.381022+0000","last_undegraded":"2024-09-10T06:28:48.381022+0000","last_fullsized":"2024-09-10T06:28:48.381022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:40.653642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"62'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454263+0000","last_change":"2024-09-10T06:26:32.276392+0000","last_active":"2024-09-10T06:28:48.454263+0000","last_peered":"2024-09-10T06:28:48.454263+0000","last_clean":"2024-09-10T06:28:48.454263+0000","last_became_active":"2024-09-10T06:26:32.275855+0000","last_became_peered":"2024-09-10T06:26:32.275855+0000","last_unstale":"2024-09-10T06:28:48.454263+0000","last_undegraded":"2024-09-10T06:28:48.454263+0000","last_fullsized":"2024-09-10T06:28:48.454263+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:34.845713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"95'22","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.931023+0000","last_change":"2024-09-10T06:26:30.591577+0000","last_active":"2024-09-10T06:29:17.931023+0000","last_peered":"2024-09-10T06:29:17.931023+0000","last_clean":"2024-09-10T06:29:17.931023+0000","last_became_active":"2024-09-10T06:26:30.590801+0000","last_became_peered":"2024-09-10T06:26:30.590801+0000","last_unstale":"2024-09-10T06:29:17.931023+0000","last_undegraded":"2024-09-10T06:29:17.931023+0000","last_fullsized":"2024-09-10T06:29:17.931023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:16.066664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453895+0000","last_change":"2024-09-10T06:26:32.268621+0000","last_active":"2024-09-10T06:28:48.453895+0000","last_peered":"2024-09-10T06:28:48.453895+0000","last_clean":"2024-09-10T06:28:48.453895+0000","last_became_active":"2024-09-10T06:26:32.267915+0000","last_became_peered":"2024-09-10T06:26:32.267915+0000","last_unstale":"2024-09-10T06:28:48.453895+0000","last_undegraded":"2024-09-10T06:28:48.453895+0000","last_fullsized":"2024-09-10T06:28:48.453895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:10:10.670492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"95'20","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.815789+0000","last_change":"2024-09-10T06:26:30.593794+0000","last_active":"2024-09-10T06:29:17.815789+0000","last_peered":"2024-09-10T06:29:17.815789+0000","last_clean":"2024-09-10T06:29:17.815789+0000","last_became_active":"2024-09-10T06:26:30.593506+0000","last_became_peered":"2024-09-10T06:26:30.593506+0000","last_unstale":"2024-09-10T06:29:17.815789+0000","last_undegraded":"2024-09-10T06:29:17.815789+0000","last_fullsized":"2024-09-10T06:29:17.815789+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:29.521578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'6","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459260+0000","last_change":"2024-09-10T06:26:32.288497+0000","last_active":"2024-09-10T06:28:48.459260+0000","last_peered":"2024-09-10T06:28:48.459260+0000","last_clean":"2024-09-10T06:28:48.459260+0000","last_became_active":"2024-09-10T06:26:32.287839+0000","last_became_peered":"2024-09-10T06:26:32.287839+0000","last_unstale":"2024-09-10T06:28:48.459260+0000","last_undegraded":"2024-09-10T06:28:48.459260+0000","last_fullsized":"2024-09-10T06:28:48.459260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:16.373388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"95'10","reported_seq":75,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.844463+0000","last_change":"2024-09-10T06:28:09.627267+0000","last_active":"2024-09-10T06:29:17.844463+0000","last_peered":"2024-09-10T06:29:17.844463+0000","last_clean":"2024-09-10T06:29:17.844463+0000","last_became_active":"2024-09-10T06:28:09.544344+0000","last_became_peered":"2024-09-10T06:28:09.544344+0000","last_unstale":"2024-09-10T06:29:17.844463+0000","last_undegraded":"2024-09-10T06:29:17.844463+0000","last_fullsized":"2024-09-10T06:29:17.844463+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:57.591444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"62'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454143+0000","last_change":"2024-09-10T06:26:32.272921+0000","last_active":"2024-09-10T06:28:48.454143+0000","last_peered":"2024-09-10T06:28:48.454143+0000","last_clean":"2024-09-10T06:28:48.454143+0000","last_became_active":"2024-09-10T06:26:32.272279+0000","last_became_peered":"2024-09-10T06:26:32.272279+0000","last_unstale":"2024-09-10T06:28:48.454143+0000","last_undegraded":"2024-09-10T06:28:48.454143+0000","last_fullsized":"2024-09-10T06:28:48.454143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:47:11.951551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"95'24","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.873440+0000","last_change":"2024-09-10T06:26:30.579541+0000","last_active":"2024-09-10T06:29:17.873440+0000","last_peered":"2024-09-10T06:29:17.873440+0000","last_clean":"2024-09-10T06:29:17.873440+0000","last_became_active":"2024-09-10T06:26:30.579189+0000","last_became_peered":"2024-09-10T06:26:30.579189+0000","last_unstale":"2024-09-10T06:29:17.873440+0000","last_undegraded":"2024-09-10T06:29:17.873440+0000","last_fullsized":"2024-09-10T06:29:17.873440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:18.099885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377659+0000","last_change":"2024-09-10T06:26:32.260098+0000","last_active":"2024-09-10T06:28:48.377659+0000","last_peered":"2024-09-10T06:28:48.377659+0000","last_clean":"2024-09-10T06:28:48.377659+0000","last_became_active":"2024-09-10T06:26:32.259644+0000","last_became_peered":"2024-09-10T06:26:32.259644+0000","last_unstale":"2024-09-10T06:28:48.377659+0000","last_undegraded":"2024-09-10T06:28:48.377659+0000","last_fullsized":"2024-09-10T06:28:48.377659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:14:23.027904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"95'22","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.884406+0000","last_change":"2024-09-10T06:26:30.576146+0000","last_active":"2024-09-10T06:29:17.884406+0000","last_peered":"2024-09-10T06:29:17.884406+0000","last_clean":"2024-09-10T06:29:17.884406+0000","last_became_active":"2024-09-10T06:26:30.575605+0000","last_became_peered":"2024-09-10T06:26:30.575605+0000","last_unstale":"2024-09-10T06:29:17.884406+0000","last_undegraded":"2024-09-10T06:29:17.884406+0000","last_fullsized":"2024-09-10T06:29:17.884406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"76'10","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378536+0000","last_change":"2024-09-10T06:26:32.277577+0000","last_active":"2024-09-10T06:28:48.378536+0000","last_peered":"2024-09-10T06:28:48.378536+0000","last_clean":"2024-09-10T06:28:48.378536+0000","last_became_active":"2024-09-10T06:26:32.272454+0000","last_became_peered":"2024-09-10T06:26:32.272454+0000","last_unstale":"2024-09-10T06:28:48.378536+0000","last_undegraded":"2024-09-10T06:28:48.378536+0000","last_fullsized":"2024-09-10T06:28:48.378536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"95'12","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.832334+0000","last_change":"2024-09-10T06:26:30.579134+0000","last_active":"2024-09-10T06:29:17.832334+0000","last_peered":"2024-09-10T06:29:17.832334+0000","last_clean":"2024-09-10T06:29:17.832334+0000","last_became_active":"2024-09-10T06:26:30.578732+0000","last_became_peered":"2024-09-10T06:26:30.578732+0000","last_unstale":"2024-09-10T06:29:17.832334+0000","last_undegraded":"2024-09-10T06:29:17.832334+0000","last_fullsized":"2024-09-10T06:29:17.832334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:09:08.832907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375228+0000","last_change":"2024-09-10T06:26:32.270804+0000","last_active":"2024-09-10T06:28:48.375228+0000","last_peered":"2024-09-10T06:28:48.375228+0000","last_clean":"2024-09-10T06:28:48.375228+0000","last_became_active":"2024-09-10T06:26:32.270327+0000","last_became_peered":"2024-09-10T06:26:32.270327+0000","last_unstale":"2024-09-10T06:28:48.375228+0000","last_undegraded":"2024-09-10T06:28:48.375228+0000","last_fullsized":"2024-09-10T06:28:48.375228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:55.051166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"95'12","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.854663+0000","last_change":"2024-09-10T06:26:30.598004+0000","last_active":"2024-09-10T06:29:17.854663+0000","last_peered":"2024-09-10T06:29:17.854663+0000","last_clean":"2024-09-10T06:29:17.854663+0000","last_became_active":"2024-09-10T06:26:30.596254+0000","last_became_peered":"2024-09-10T06:26:30.596254+0000","last_unstale":"2024-09-10T06:29:17.854663+0000","last_undegraded":"2024-09-10T06:29:17.854663+0000","last_fullsized":"2024-09-10T06:29:17.854663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:11:49.355122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'2","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456398+0000","last_change":"2024-09-10T06:26:32.284215+0000","last_active":"2024-09-10T06:28:48.456398+0000","last_peered":"2024-09-10T06:28:48.456398+0000","last_clean":"2024-09-10T06:28:48.456398+0000","last_became_active":"2024-09-10T06:26:32.275133+0000","last_became_peered":"2024-09-10T06:26:32.275133+0000","last_unstale":"2024-09-10T06:28:48.456398+0000","last_undegraded":"2024-09-10T06:28:48.456398+0000","last_fullsized":"2024-09-10T06:28:48.456398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:37.703268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"95'18","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.880299+0000","last_change":"2024-09-10T06:26:30.580586+0000","last_active":"2024-09-10T06:29:17.880299+0000","last_peered":"2024-09-10T06:29:17.880299+0000","last_clean":"2024-09-10T06:29:17.880299+0000","last_became_active":"2024-09-10T06:26:30.580134+0000","last_became_peered":"2024-09-10T06:26:30.580134+0000","last_unstale":"2024-09-10T06:29:17.880299+0000","last_undegraded":"2024-09-10T06:29:17.880299+0000","last_fullsized":"2024-09-10T06:29:17.880299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:30:16.643189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378230+0000","last_change":"2024-09-10T06:26:32.256538+0000","last_active":"2024-09-10T06:28:48.378230+0000","last_peered":"2024-09-10T06:28:48.378230+0000","last_clean":"2024-09-10T06:28:48.378230+0000","last_became_active":"2024-09-10T06:26:32.256052+0000","last_became_peered":"2024-09-10T06:26:32.256052+0000","last_unstale":"2024-09-10T06:28:48.378230+0000","last_undegraded":"2024-09-10T06:28:48.378230+0000","last_fullsized":"2024-09-10T06:28:48.378230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:14.620472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"95'16","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.925827+0000","last_change":"2024-09-10T06:26:30.585220+0000","last_active":"2024-09-10T06:29:17.925827+0000","last_peered":"2024-09-10T06:29:17.925827+0000","last_clean":"2024-09-10T06:29:17.925827+0000","last_became_active":"2024-09-10T06:26:30.584443+0000","last_became_peered":"2024-09-10T06:26:30.584443+0000","last_unstale":"2024-09-10T06:29:17.925827+0000","last_undegraded":"2024-09-10T06:29:17.925827+0000","last_fullsized":"2024-09-10T06:29:17.925827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:45:06.243226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380479+0000","last_change":"2024-09-10T06:26:32.259306+0000","last_active":"2024-09-10T06:28:48.380479+0000","last_peered":"2024-09-10T06:28:48.380479+0000","last_clean":"2024-09-10T06:28:48.380479+0000","last_became_active":"2024-09-10T06:26:32.258513+0000","last_became_peered":"2024-09-10T06:26:32.258513+0000","last_unstale":"2024-09-10T06:28:48.380479+0000","last_undegraded":"2024-09-10T06:28:48.380479+0000","last_fullsized":"2024-09-10T06:28:48.380479+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"95'14","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.853961+0000","last_change":"2024-09-10T06:26:30.581285+0000","last_active":"2024-09-10T06:29:17.853961+0000","last_peered":"2024-09-10T06:29:17.853961+0000","last_clean":"2024-09-10T06:29:17.853961+0000","last_became_active":"2024-09-10T06:26:30.580913+0000","last_became_peered":"2024-09-10T06:26:30.580913+0000","last_unstale":"2024-09-10T06:29:17.853961+0000","last_undegraded":"2024-09-10T06:29:17.853961+0000","last_fullsized":"2024-09-10T06:29:17.853961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:30:43.618477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"76'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455519+0000","last_change":"2024-09-10T06:26:32.274773+0000","last_active":"2024-09-10T06:28:48.455519+0000","last_peered":"2024-09-10T06:28:48.455519+0000","last_clean":"2024-09-10T06:28:48.455519+0000","last_became_active":"2024-09-10T06:26:32.274327+0000","last_became_peered":"2024-09-10T06:26:32.274327+0000","last_unstale":"2024-09-10T06:28:48.455519+0000","last_undegraded":"2024-09-10T06:28:48.455519+0000","last_fullsized":"2024-09-10T06:28:48.455519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:54.026434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"95'12","reported_seq":128,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.849950+0000","last_change":"2024-09-10T06:27:08.592940+0000","last_active":"2024-09-10T06:29:17.849950+0000","last_peered":"2024-09-10T06:29:17.849950+0000","last_clean":"2024-09-10T06:29:17.849950+0000","last_became_active":"2024-09-10T06:27:08.592637+0000","last_became_peered":"2024-09-10T06:27:08.592637+0000","last_unstale":"2024-09-10T06:29:17.849950+0000","last_undegraded":"2024-09-10T06:29:17.849950+0000","last_fullsized":"2024-09-10T06:29:17.849950+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:06.335302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380493+0000","last_change":"2024-09-10T06:26:32.279474+0000","last_active":"2024-09-10T06:28:48.380493+0000","last_peered":"2024-09-10T06:28:48.380493+0000","last_clean":"2024-09-10T06:28:48.380493+0000","last_became_active":"2024-09-10T06:26:32.278461+0000","last_became_peered":"2024-09-10T06:26:32.278461+0000","last_unstale":"2024-09-10T06:28:48.380493+0000","last_undegraded":"2024-09-10T06:28:48.380493+0000","last_fullsized":"2024-09-10T06:28:48.380493+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:31.762492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"95'16","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.824245+0000","last_change":"2024-09-10T06:26:30.605519+0000","last_active":"2024-09-10T06:29:17.824245+0000","last_peered":"2024-09-10T06:29:17.824245+0000","last_clean":"2024-09-10T06:29:17.824245+0000","last_became_active":"2024-09-10T06:26:30.605225+0000","last_became_peered":"2024-09-10T06:26:30.605225+0000","last_unstale":"2024-09-10T06:29:17.824245+0000","last_undegraded":"2024-09-10T06:29:17.824245+0000","last_fullsized":"2024-09-10T06:29:17.824245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:44:06.677332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"64'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462698+0000","last_change":"2024-09-10T06:26:32.267201+0000","last_active":"2024-09-10T06:28:48.462698+0000","last_peered":"2024-09-10T06:28:48.462698+0000","last_clean":"2024-09-10T06:28:48.462698+0000","last_became_active":"2024-09-10T06:26:32.266234+0000","last_became_peered":"2024-09-10T06:26:32.266234+0000","last_unstale":"2024-09-10T06:28:48.462698+0000","last_undegraded":"2024-09-10T06:28:48.462698+0000","last_fullsized":"2024-09-10T06:28:48.462698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"95'20","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.926814+0000","last_change":"2024-09-10T06:26:30.596647+0000","last_active":"2024-09-10T06:29:17.926814+0000","last_peered":"2024-09-10T06:29:17.926814+0000","last_clean":"2024-09-10T06:29:17.926814+0000","last_became_active":"2024-09-10T06:26:30.593598+0000","last_became_peered":"2024-09-10T06:26:30.593598+0000","last_unstale":"2024-09-10T06:29:17.926814+0000","last_undegraded":"2024-09-10T06:29:17.926814+0000","last_fullsized":"2024-09-10T06:29:17.926814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:39.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"76'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375198+0000","last_change":"2024-09-10T06:26:32.278317+0000","last_active":"2024-09-10T06:28:48.375198+0000","last_peered":"2024-09-10T06:28:48.375198+0000","last_clean":"2024-09-10T06:28:48.375198+0000","last_became_active":"2024-09-10T06:26:32.278032+0000","last_became_peered":"2024-09-10T06:26:32.278032+0000","last_unstale":"2024-09-10T06:28:48.375198+0000","last_undegraded":"2024-09-10T06:28:48.375198+0000","last_fullsized":"2024-09-10T06:28:48.375198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:24:00.200118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"95'18","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.873299+0000","last_change":"2024-09-10T06:26:30.580552+0000","last_active":"2024-09-10T06:29:17.873299+0000","last_peered":"2024-09-10T06:29:17.873299+0000","last_clean":"2024-09-10T06:29:17.873299+0000","last_became_active":"2024-09-10T06:26:30.579319+0000","last_became_peered":"2024-09-10T06:26:30.579319+0000","last_unstale":"2024-09-10T06:29:17.873299+0000","last_undegraded":"2024-09-10T06:29:17.873299+0000","last_fullsized":"2024-09-10T06:29:17.873299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:59.885311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"67'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375088+0000","last_change":"2024-09-10T06:26:32.257601+0000","last_active":"2024-09-10T06:28:48.375088+0000","last_peered":"2024-09-10T06:28:48.375088+0000","last_clean":"2024-09-10T06:28:48.375088+0000","last_became_active":"2024-09-10T06:26:32.256851+0000","last_became_peered":"2024-09-10T06:26:32.256851+0000","last_unstale":"2024-09-10T06:28:48.375088+0000","last_undegraded":"2024-09-10T06:28:48.375088+0000","last_fullsized":"2024-09-10T06:28:48.375088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"95'24","reported_seq":229,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.895199+0000","last_change":"2024-09-10T06:28:47.047609+0000","last_active":"2024-09-10T06:29:17.895199+0000","last_peered":"2024-09-10T06:29:17.895199+0000","last_clean":"2024-09-10T06:29:17.895199+0000","last_became_active":"2024-09-10T06:28:46.326501+0000","last_became_peered":"2024-09-10T06:28:46.326501+0000","last_unstale":"2024-09-10T06:29:17.895199+0000","last_undegraded":"2024-09-10T06:29:17.895199+0000","last_fullsized":"2024-09-10T06:29:17.895199+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:33.793329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"62'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455403+0000","last_change":"2024-09-10T06:26:32.266768+0000","last_active":"2024-09-10T06:28:48.455403+0000","last_peered":"2024-09-10T06:28:48.455403+0000","last_clean":"2024-09-10T06:28:48.455403+0000","last_became_active":"2024-09-10T06:26:32.266000+0000","last_became_peered":"2024-09-10T06:26:32.266000+0000","last_unstale":"2024-09-10T06:28:48.455403+0000","last_undegraded":"2024-09-10T06:28:48.455403+0000","last_fullsized":"2024-09-10T06:28:48.455403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:10:05.197557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"95'18","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.836370+0000","last_change":"2024-09-10T06:26:30.610309+0000","last_active":"2024-09-10T06:29:17.836370+0000","last_peered":"2024-09-10T06:29:17.836370+0000","last_clean":"2024-09-10T06:29:17.836370+0000","last_became_active":"2024-09-10T06:26:30.609674+0000","last_became_peered":"2024-09-10T06:26:30.609674+0000","last_unstale":"2024-09-10T06:29:17.836370+0000","last_undegraded":"2024-09-10T06:29:17.836370+0000","last_fullsized":"2024-09-10T06:29:17.836370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:13.350567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"95'20","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.929575+0000","last_change":"2024-09-10T06:26:30.591365+0000","last_active":"2024-09-10T06:29:17.929575+0000","last_peered":"2024-09-10T06:29:17.929575+0000","last_clean":"2024-09-10T06:29:17.929575+0000","last_became_active":"2024-09-10T06:26:30.590640+0000","last_became_peered":"2024-09-10T06:26:30.590640+0000","last_unstale":"2024-09-10T06:29:17.929575+0000","last_undegraded":"2024-09-10T06:29:17.929575+0000","last_fullsized":"2024-09-10T06:29:17.929575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:01.767821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"67'10","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378178+0000","last_change":"2024-09-10T06:26:32.267333+0000","last_active":"2024-09-10T06:28:48.378178+0000","last_peered":"2024-09-10T06:28:48.378178+0000","last_clean":"2024-09-10T06:28:48.378178+0000","last_became_active":"2024-09-10T06:26:32.266876+0000","last_became_peered":"2024-09-10T06:26:32.266876+0000","last_unstale":"2024-09-10T06:28:48.378178+0000","last_undegraded":"2024-09-10T06:28:48.378178+0000","last_fullsized":"2024-09-10T06:28:48.378178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:46:02.483639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"95'26","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.825151+0000","last_change":"2024-09-10T06:26:30.590924+0000","last_active":"2024-09-10T06:29:17.825151+0000","last_peered":"2024-09-10T06:29:17.825151+0000","last_clean":"2024-09-10T06:29:17.825151+0000","last_became_active":"2024-09-10T06:26:30.590415+0000","last_became_peered":"2024-09-10T06:26:30.590415+0000","last_unstale":"2024-09-10T06:29:17.825151+0000","last_undegraded":"2024-09-10T06:29:17.825151+0000","last_fullsized":"2024-09-10T06:29:17.825151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:32.460291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460331+0000","last_change":"2024-09-10T06:26:32.283339+0000","last_active":"2024-09-10T06:28:48.460331+0000","last_peered":"2024-09-10T06:28:48.460331+0000","last_clean":"2024-09-10T06:28:48.460331+0000","last_became_active":"2024-09-10T06:26:32.282581+0000","last_became_peered":"2024-09-10T06:26:32.282581+0000","last_unstale":"2024-09-10T06:28:48.460331+0000","last_undegraded":"2024-09-10T06:28:48.460331+0000","last_fullsized":"2024-09-10T06:28:48.460331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:08.349673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":840,"ondisk_log_size":840,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":27618,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1027,"num_read_kb":1076,"num_write":535,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":773,"ondisk_log_size":773,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":344,"num_read_kb":344,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":567,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":15,"num_write":1204,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":209715200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1156,"ondisk_log_size":1156,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32940,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338900,"statfs":{"total":96636764160,"available":96603033600,"internally_reserved":0,"allocated":1769472,"data_stored":1236965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1155072,"data_stored":646930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1200128,"data_stored":646784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542185,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1142784,"data_stored":646428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1171456,"data_stored":646769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1138688,"data_stored":645499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1171456,"data_stored":646206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542185,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32964,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338876,"statfs":{"total":96636764160,"available":96603009024,"internally_reserved":0,"allocated":1753088,"data_stored":1236807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:29:24.624 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.624 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.624 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.625 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.625 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.625 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.625 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.625 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.625 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.625 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.625 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.625 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.625 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.626 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.626 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.626 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.626 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.626 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.626 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.626 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.626 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.627 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.627 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.627 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.627 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.627 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.627 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.627 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.627 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.627 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.628 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.628 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.628 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.628 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.628 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.628 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.628 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.628 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.628 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.629 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.629 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.629 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.629 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.629 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.629 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.629 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.629 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.630 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.630 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.630 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.630 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.630 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.630 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.630 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.630 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.630 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.631 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.631 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.631 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.631 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.631 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.631 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.631 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.631 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.631 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.632 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.632 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.632 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.632 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.632 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.632 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.632 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.632 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.632 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.633 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.633 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.633 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.633 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.633 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.633 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.633 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.633 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.633 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.634 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.634 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.634 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.634 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.634 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.634 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.634 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.634 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.634 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.635 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.635 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.635 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.635 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.635 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.635 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.635 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.635 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.635 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.636 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T06:26:16.422775+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.636 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T06:26:22.472290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.636 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.636 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.636 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.636 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.636 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.636 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.637 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T06:26:22.472290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.637 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.637 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.637 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.637 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.637 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.637 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.637 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-10T06:26:22.472290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.637 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.638 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.638 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.638 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.638 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.638 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.638 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T06:26:22.472290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.638 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.638 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.638 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.639 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.639 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.639 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.639 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.639 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T06:26:22.472290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.639 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.639 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.639 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.639 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.640 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.640 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.640 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T06:26:22.472290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.640 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.640 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.640 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.640 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.640 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.640 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.641 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T06:26:22.472290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.641 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.641 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.641 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.641 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.641 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.641 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.641 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T06:26:22.472290+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=22, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.641 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.642 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.642 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.642 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.642 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.642 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.642 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.642 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.642 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.642 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.643 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.643 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.643 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.643 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.643 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.643 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.643 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.643 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.643 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.644 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.644 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.644 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.644 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.644 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.644 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.644 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.644 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.644 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.645 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.645 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.645 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.645 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.645 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.645 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.645 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.645 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.645 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.646 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.646 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.646 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.646 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.646 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.646 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.646 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.646 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.646 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.647 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.647 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.647 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.647 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.647 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.647 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.647 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.647 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.647 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.648 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.648 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.648 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.648 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.648 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.648 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.648 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.648 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.648 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.649 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.649 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.649 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.649 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.649 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.649 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.649 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.649 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.649 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.650 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.650 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.650 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.650 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.650 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.650 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.650 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.650 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.650 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.651 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.651 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.651 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.651 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.651 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.651 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.651 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.651 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.651 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.652 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.652 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.652 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.652 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.652 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.652 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.652 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.652 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.652 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.653 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.653 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.653 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.653 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.653 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.653 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.653 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.653 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.653 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.654 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.654 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.654 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:24.654 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T06:29:44.655 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:29:44.986 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:29:44.991 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:29:45.002 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-10T06:29:43.486503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":619618,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":2868,"num_read_kb":2295,"num_write":2317,"num_write_kb":2367369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":209715508,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3195,"ondisk_log_size":3195,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263888,"kb_used_data":10256,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754710832,"statfs":{"total":773094113280,"available":772823891968,"internally_reserved":0,"allocated":10502144,"data_stored":6352388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006565"},"pg_stats":[{"pgid":"3.3f","version":"95'24","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.708872+0000","last_change":"2024-09-10T06:29:27.708872+0000","last_active":"2024-09-10T06:29:27.708872+0000","last_peered":"2024-09-10T06:29:27.708872+0000","last_clean":"2024-09-10T06:29:27.708872+0000","last_became_active":"2024-09-10T06:27:08.597026+0000","last_became_peered":"2024-09-10T06:27:08.597026+0000","last_unstale":"2024-09-10T06:29:27.708872+0000","last_undegraded":"2024-09-10T06:29:27.708872+0000","last_fullsized":"2024-09-10T06:29:27.708872+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:27.708694+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:27.708694+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.708694+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:43.032190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"67'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.274618+0000","last_change":"2024-09-10T06:29:39.274618+0000","last_active":"2024-09-10T06:29:39.274618+0000","last_peered":"2024-09-10T06:29:39.274618+0000","last_clean":"2024-09-10T06:29:39.274618+0000","last_became_active":"2024-09-10T06:26:32.279098+0000","last_became_peered":"2024-09-10T06:26:32.279098+0000","last_unstale":"2024-09-10T06:29:39.274618+0000","last_undegraded":"2024-09-10T06:29:39.274618+0000","last_fullsized":"2024-09-10T06:29:39.274618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:39.274400+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:39.274400+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.274400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:55.846716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"95'10","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:22.776727+0000","last_change":"2024-09-10T06:29:22.776727+0000","last_active":"2024-09-10T06:29:22.776727+0000","last_peered":"2024-09-10T06:29:22.776727+0000","last_clean":"2024-09-10T06:29:22.776727+0000","last_became_active":"2024-09-10T06:26:30.572798+0000","last_became_peered":"2024-09-10T06:26:30.572798+0000","last_unstale":"2024-09-10T06:29:22.776727+0000","last_undegraded":"2024-09-10T06:29:22.776727+0000","last_fullsized":"2024-09-10T06:29:22.776727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-10T06:29:22.776555+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-10T06:29:22.776555+0000","last_clean_scrub_stamp":"2024-09-10T06:29:22.776555+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:35.963583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"62'2","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.234971+0000","last_change":"2024-09-10T06:29:38.234971+0000","last_active":"2024-09-10T06:29:38.234971+0000","last_peered":"2024-09-10T06:29:38.234971+0000","last_clean":"2024-09-10T06:29:38.234971+0000","last_became_active":"2024-09-10T06:26:32.275990+0000","last_became_peered":"2024-09-10T06:26:32.275990+0000","last_unstale":"2024-09-10T06:29:38.234971+0000","last_undegraded":"2024-09-10T06:29:38.234971+0000","last_fullsized":"2024-09-10T06:29:38.234971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-10T06:29:38.234787+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-10T06:29:38.234787+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.234787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:21.233377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"95'18","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.536070+0000","last_change":"2024-09-10T06:29:31.536070+0000","last_active":"2024-09-10T06:29:31.536070+0000","last_peered":"2024-09-10T06:29:31.536070+0000","last_clean":"2024-09-10T06:29:31.536070+0000","last_became_active":"2024-09-10T06:26:30.577688+0000","last_became_peered":"2024-09-10T06:26:30.577688+0000","last_unstale":"2024-09-10T06:29:31.536070+0000","last_undegraded":"2024-09-10T06:29:31.536070+0000","last_fullsized":"2024-09-10T06:29:31.536070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:31.535858+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:31.535858+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.535858+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:58.685339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":26,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377720+0000","last_change":"2024-09-10T06:26:32.256939+0000","last_active":"2024-09-10T06:28:48.377720+0000","last_peered":"2024-09-10T06:28:48.377720+0000","last_clean":"2024-09-10T06:28:48.377720+0000","last_became_active":"2024-09-10T06:26:32.256117+0000","last_became_peered":"2024-09-10T06:26:32.256117+0000","last_unstale":"2024-09-10T06:28:48.377720+0000","last_undegraded":"2024-09-10T06:28:48.377720+0000","last_fullsized":"2024-09-10T06:28:48.377720+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:51.879604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"95'22","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.278259+0000","last_change":"2024-09-10T06:29:33.278259+0000","last_active":"2024-09-10T06:29:33.278259+0000","last_peered":"2024-09-10T06:29:33.278259+0000","last_clean":"2024-09-10T06:29:33.278259+0000","last_became_active":"2024-09-10T06:26:30.591807+0000","last_became_peered":"2024-09-10T06:26:30.591807+0000","last_unstale":"2024-09-10T06:29:33.278259+0000","last_undegraded":"2024-09-10T06:29:33.278259+0000","last_fullsized":"2024-09-10T06:29:33.278259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:33.278071+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:33.278071+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.278071+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:12.210815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.636019+0000","last_change":"2024-09-10T06:29:39.636019+0000","last_active":"2024-09-10T06:29:39.636019+0000","last_peered":"2024-09-10T06:29:39.636019+0000","last_clean":"2024-09-10T06:29:39.636019+0000","last_became_active":"2024-09-10T06:26:32.264199+0000","last_became_peered":"2024-09-10T06:26:32.264199+0000","last_unstale":"2024-09-10T06:29:39.636019+0000","last_undegraded":"2024-09-10T06:29:39.636019+0000","last_fullsized":"2024-09-10T06:29:39.636019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:39.635843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:39.635843+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.635843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:47.814837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"95'14","reported_seq":86,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.454785+0000","last_change":"2024-09-10T06:29:32.454785+0000","last_active":"2024-09-10T06:29:32.454785+0000","last_peered":"2024-09-10T06:29:32.454785+0000","last_clean":"2024-09-10T06:29:32.454785+0000","last_became_active":"2024-09-10T06:28:09.546624+0000","last_became_peered":"2024-09-10T06:28:09.546624+0000","last_unstale":"2024-09-10T06:29:32.454785+0000","last_undegraded":"2024-09-10T06:29:32.454785+0000","last_fullsized":"2024-09-10T06:29:32.454785+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:32.454564+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:32.454564+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.454564+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:28.594324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"67'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.382374+0000","last_change":"2024-09-10T06:29:37.382374+0000","last_active":"2024-09-10T06:29:37.382374+0000","last_peered":"2024-09-10T06:29:37.382374+0000","last_clean":"2024-09-10T06:29:37.382374+0000","last_became_active":"2024-09-10T06:26:32.289840+0000","last_became_peered":"2024-09-10T06:26:32.289840+0000","last_unstale":"2024-09-10T06:29:37.382374+0000","last_undegraded":"2024-09-10T06:29:37.382374+0000","last_fullsized":"2024-09-10T06:29:37.382374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:37.382087+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:37.382087+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.382087+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:43.663439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"95'12","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.244429+0000","last_change":"2024-09-10T06:29:32.244429+0000","last_active":"2024-09-10T06:29:32.244429+0000","last_peered":"2024-09-10T06:29:32.244429+0000","last_clean":"2024-09-10T06:29:32.244429+0000","last_became_active":"2024-09-10T06:26:30.603330+0000","last_became_peered":"2024-09-10T06:26:30.603330+0000","last_unstale":"2024-09-10T06:29:32.244429+0000","last_undegraded":"2024-09-10T06:29:32.244429+0000","last_fullsized":"2024-09-10T06:29:32.244429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:32.244240+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:32.244240+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.244240+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:52.040413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"67'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380006+0000","last_change":"2024-09-10T06:26:32.257050+0000","last_active":"2024-09-10T06:28:48.380006+0000","last_peered":"2024-09-10T06:28:48.380006+0000","last_clean":"2024-09-10T06:28:48.380006+0000","last_became_active":"2024-09-10T06:26:32.254437+0000","last_became_peered":"2024-09-10T06:26:32.254437+0000","last_unstale":"2024-09-10T06:28:48.380006+0000","last_undegraded":"2024-09-10T06:28:48.380006+0000","last_fullsized":"2024-09-10T06:28:48.380006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"95'26","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.321454+0000","last_change":"2024-09-10T06:29:34.321454+0000","last_active":"2024-09-10T06:29:34.321454+0000","last_peered":"2024-09-10T06:29:34.321454+0000","last_clean":"2024-09-10T06:29:34.321454+0000","last_became_active":"2024-09-10T06:26:30.578033+0000","last_became_peered":"2024-09-10T06:26:30.578033+0000","last_unstale":"2024-09-10T06:29:34.321454+0000","last_undegraded":"2024-09-10T06:29:34.321454+0000","last_fullsized":"2024-09-10T06:29:34.321454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-10T06:29:34.321257+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-10T06:29:34.321257+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.321257+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:29.693727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":34,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"76'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.283018+0000","last_change":"2024-09-10T06:29:38.283018+0000","last_active":"2024-09-10T06:29:38.283018+0000","last_peered":"2024-09-10T06:29:38.283018+0000","last_clean":"2024-09-10T06:29:38.283018+0000","last_became_active":"2024-09-10T06:26:32.280480+0000","last_became_peered":"2024-09-10T06:26:32.280480+0000","last_unstale":"2024-09-10T06:29:38.283018+0000","last_undegraded":"2024-09-10T06:29:38.283018+0000","last_fullsized":"2024-09-10T06:29:38.283018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:38.282778+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:38.282778+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.282778+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:46.590502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"95'16","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.860335+0000","last_change":"2024-09-10T06:29:39.860335+0000","last_active":"2024-09-10T06:29:39.860335+0000","last_peered":"2024-09-10T06:29:39.860335+0000","last_clean":"2024-09-10T06:29:39.860335+0000","last_became_active":"2024-09-10T06:26:30.592770+0000","last_became_peered":"2024-09-10T06:26:30.592770+0000","last_unstale":"2024-09-10T06:29:39.860335+0000","last_undegraded":"2024-09-10T06:29:39.860335+0000","last_fullsized":"2024-09-10T06:29:39.860335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:39.860132+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:39.860132+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.860132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:55.569488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'10","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.493294+0000","last_change":"2024-09-10T06:29:36.493294+0000","last_active":"2024-09-10T06:29:36.493294+0000","last_peered":"2024-09-10T06:29:36.493294+0000","last_clean":"2024-09-10T06:29:36.493294+0000","last_became_active":"2024-09-10T06:26:32.265788+0000","last_became_peered":"2024-09-10T06:26:32.265788+0000","last_unstale":"2024-09-10T06:29:36.493294+0000","last_undegraded":"2024-09-10T06:29:36.493294+0000","last_fullsized":"2024-09-10T06:29:36.493294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T06:29:36.493094+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T06:29:36.493094+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.493094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:13.006231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'10","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.168415+0000","last_change":"2024-09-10T06:29:40.168415+0000","last_active":"2024-09-10T06:29:40.168415+0000","last_peered":"2024-09-10T06:29:40.168415+0000","last_clean":"2024-09-10T06:29:40.168415+0000","last_became_active":"2024-09-10T06:26:32.254281+0000","last_became_peered":"2024-09-10T06:26:32.254281+0000","last_unstale":"2024-09-10T06:29:40.168415+0000","last_undegraded":"2024-09-10T06:29:40.168415+0000","last_fullsized":"2024-09-10T06:29:40.168415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'10","last_scrub_stamp":"2024-09-10T06:29:40.168233+0000","last_deep_scrub":"76'10","last_deep_scrub_stamp":"2024-09-10T06:29:40.168233+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.168233+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:54.261144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"95'18","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.290785+0000","last_change":"2024-09-10T06:29:35.290785+0000","last_active":"2024-09-10T06:29:35.290785+0000","last_peered":"2024-09-10T06:29:35.290785+0000","last_clean":"2024-09-10T06:29:35.290785+0000","last_became_active":"2024-09-10T06:26:30.605602+0000","last_became_peered":"2024-09-10T06:26:30.605602+0000","last_unstale":"2024-09-10T06:29:35.290785+0000","last_undegraded":"2024-09-10T06:29:35.290785+0000","last_fullsized":"2024-09-10T06:29:35.290785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:35.290595+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:35.290595+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.290595+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:48.831881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.274245+0000","last_change":"2024-09-10T06:29:37.274245+0000","last_active":"2024-09-10T06:29:37.274245+0000","last_peered":"2024-09-10T06:29:37.274245+0000","last_clean":"2024-09-10T06:29:37.274245+0000","last_became_active":"2024-09-10T06:26:32.274264+0000","last_became_peered":"2024-09-10T06:26:32.274264+0000","last_unstale":"2024-09-10T06:29:37.274245+0000","last_undegraded":"2024-09-10T06:29:37.274245+0000","last_fullsized":"2024-09-10T06:29:37.274245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.274064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.274064+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.274064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:35.281894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'10","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.448555+0000","last_change":"2024-09-10T06:29:31.448555+0000","last_active":"2024-09-10T06:29:31.448555+0000","last_peered":"2024-09-10T06:29:31.448555+0000","last_clean":"2024-09-10T06:29:31.448555+0000","last_became_active":"2024-09-10T06:28:46.332355+0000","last_became_peered":"2024-09-10T06:28:46.332355+0000","last_unstale":"2024-09-10T06:29:31.448555+0000","last_undegraded":"2024-09-10T06:29:31.448555+0000","last_fullsized":"2024-09-10T06:29:31.448555+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-10T06:29:31.448378+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-10T06:29:31.448378+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.448378+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:22.005148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.327524+0000","last_change":"2024-09-10T06:29:37.327524+0000","last_active":"2024-09-10T06:29:37.327524+0000","last_peered":"2024-09-10T06:29:37.327524+0000","last_clean":"2024-09-10T06:29:37.327524+0000","last_became_active":"2024-09-10T06:26:32.278407+0000","last_became_peered":"2024-09-10T06:26:32.278407+0000","last_unstale":"2024-09-10T06:29:37.327524+0000","last_undegraded":"2024-09-10T06:29:37.327524+0000","last_fullsized":"2024-09-10T06:29:37.327524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.327343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.327343+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.327343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:43.648199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"95'20","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.434236+0000","last_change":"2024-09-10T06:29:30.434236+0000","last_active":"2024-09-10T06:29:30.434236+0000","last_peered":"2024-09-10T06:29:30.434236+0000","last_clean":"2024-09-10T06:29:30.434236+0000","last_became_active":"2024-09-10T06:26:30.606807+0000","last_became_peered":"2024-09-10T06:26:30.606807+0000","last_unstale":"2024-09-10T06:29:30.434236+0000","last_undegraded":"2024-09-10T06:29:30.434236+0000","last_fullsized":"2024-09-10T06:29:30.434236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:30.434051+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:30.434051+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.434051+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:40.417294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"76'8","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.536701+0000","last_change":"2024-09-10T06:29:32.536701+0000","last_active":"2024-09-10T06:29:32.536701+0000","last_peered":"2024-09-10T06:29:32.536701+0000","last_clean":"2024-09-10T06:29:32.536701+0000","last_became_active":"2024-09-10T06:27:08.801461+0000","last_became_peered":"2024-09-10T06:27:08.801461+0000","last_unstale":"2024-09-10T06:29:32.536701+0000","last_undegraded":"2024-09-10T06:29:32.536701+0000","last_fullsized":"2024-09-10T06:29:32.536701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'8","last_scrub_stamp":"2024-09-10T06:29:32.536506+0000","last_deep_scrub":"76'8","last_deep_scrub_stamp":"2024-09-10T06:29:32.536506+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.536506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:43.474143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"95'22","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.069975+0000","last_change":"2024-09-10T06:29:27.069975+0000","last_active":"2024-09-10T06:29:27.069975+0000","last_peered":"2024-09-10T06:29:27.069975+0000","last_clean":"2024-09-10T06:29:27.069975+0000","last_became_active":"2024-09-10T06:26:30.597271+0000","last_became_peered":"2024-09-10T06:26:30.597271+0000","last_unstale":"2024-09-10T06:29:27.069975+0000","last_undegraded":"2024-09-10T06:29:27.069975+0000","last_fullsized":"2024-09-10T06:29:27.069975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:27.069733+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:27.069733+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.069733+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:42.474681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.482195+0000","last_change":"2024-09-10T06:29:30.482195+0000","last_active":"2024-09-10T06:29:30.482195+0000","last_peered":"2024-09-10T06:29:30.482195+0000","last_clean":"2024-09-10T06:29:30.482195+0000","last_became_active":"2024-09-10T06:26:32.246938+0000","last_became_peered":"2024-09-10T06:26:32.246938+0000","last_unstale":"2024-09-10T06:29:30.482195+0000","last_undegraded":"2024-09-10T06:29:30.482195+0000","last_fullsized":"2024-09-10T06:29:30.482195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:30.481993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:30.481993+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.481993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:26.249980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"95'22","reported_seq":236,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.153479+0000","last_change":"2024-09-10T06:29:28.153479+0000","last_active":"2024-09-10T06:29:28.153479+0000","last_peered":"2024-09-10T06:29:28.153479+0000","last_clean":"2024-09-10T06:29:28.153479+0000","last_became_active":"2024-09-10T06:28:46.326710+0000","last_became_peered":"2024-09-10T06:28:46.326710+0000","last_unstale":"2024-09-10T06:29:28.153479+0000","last_undegraded":"2024-09-10T06:29:28.153479+0000","last_fullsized":"2024-09-10T06:29:28.153479+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:28.153264+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:28.153264+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.153264+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:44.327241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380427+0000","last_change":"2024-09-10T06:26:32.278347+0000","last_active":"2024-09-10T06:28:48.380427+0000","last_peered":"2024-09-10T06:28:48.380427+0000","last_clean":"2024-09-10T06:28:48.380427+0000","last_became_active":"2024-09-10T06:26:32.275206+0000","last_became_peered":"2024-09-10T06:26:32.275206+0000","last_unstale":"2024-09-10T06:28:48.380427+0000","last_undegraded":"2024-09-10T06:28:48.380427+0000","last_fullsized":"2024-09-10T06:28:48.380427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.463475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"95'24","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.531466+0000","last_change":"2024-09-10T06:29:29.531466+0000","last_active":"2024-09-10T06:29:29.531466+0000","last_peered":"2024-09-10T06:29:29.531466+0000","last_clean":"2024-09-10T06:29:29.531466+0000","last_became_active":"2024-09-10T06:26:30.572043+0000","last_became_peered":"2024-09-10T06:26:30.572043+0000","last_unstale":"2024-09-10T06:29:29.531466+0000","last_undegraded":"2024-09-10T06:29:29.531466+0000","last_fullsized":"2024-09-10T06:29:29.531466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:29.531261+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:29.531261+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.531261+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:28.219225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":32,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"76'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376329+0000","last_change":"2024-09-10T06:26:40.323476+0000","last_active":"2024-09-10T06:28:48.376329+0000","last_peered":"2024-09-10T06:28:48.376329+0000","last_clean":"2024-09-10T06:28:48.376329+0000","last_became_active":"2024-09-10T06:26:40.322711+0000","last_became_peered":"2024-09-10T06:26:40.322711+0000","last_unstale":"2024-09-10T06:28:48.376329+0000","last_undegraded":"2024-09-10T06:28:48.376329+0000","last_fullsized":"2024-09-10T06:28:48.376329+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.095654+0000","last_change":"2024-09-10T06:29:34.095654+0000","last_active":"2024-09-10T06:29:34.095654+0000","last_peered":"2024-09-10T06:29:34.095654+0000","last_clean":"2024-09-10T06:29:34.095654+0000","last_became_active":"2024-09-10T06:26:32.275889+0000","last_became_peered":"2024-09-10T06:26:32.275889+0000","last_unstale":"2024-09-10T06:29:34.095654+0000","last_undegraded":"2024-09-10T06:29:34.095654+0000","last_fullsized":"2024-09-10T06:29:34.095654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:34.095475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:34.095475+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.095475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:44.266638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"95'28","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.363170+0000","last_change":"2024-09-10T06:29:32.363170+0000","last_active":"2024-09-10T06:29:32.363170+0000","last_peered":"2024-09-10T06:29:32.363170+0000","last_clean":"2024-09-10T06:29:32.363170+0000","last_became_active":"2024-09-10T06:26:30.595128+0000","last_became_peered":"2024-09-10T06:26:30.595128+0000","last_unstale":"2024-09-10T06:29:32.363170+0000","last_undegraded":"2024-09-10T06:29:32.363170+0000","last_fullsized":"2024-09-10T06:29:32.363170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'28","last_scrub_stamp":"2024-09-10T06:29:32.362977+0000","last_deep_scrub":"95'28","last_deep_scrub_stamp":"2024-09-10T06:29:32.362977+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.362977+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:54.103860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459270+0000","last_change":"2024-09-10T06:26:34.279824+0000","last_active":"2024-09-10T06:28:48.459270+0000","last_peered":"2024-09-10T06:28:48.459270+0000","last_clean":"2024-09-10T06:28:48.459270+0000","last_became_active":"2024-09-10T06:26:34.279074+0000","last_became_peered":"2024-09-10T06:26:34.279074+0000","last_unstale":"2024-09-10T06:28:48.459270+0000","last_undegraded":"2024-09-10T06:28:48.459270+0000","last_fullsized":"2024-09-10T06:28:48.459270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:40.507467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"95'18","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.517752+0000","last_change":"2024-09-10T06:26:36.296703+0000","last_active":"2024-09-10T06:29:17.517752+0000","last_peered":"2024-09-10T06:29:17.517752+0000","last_clean":"2024-09-10T06:29:17.517752+0000","last_became_active":"2024-09-10T06:26:36.295786+0000","last_became_peered":"2024-09-10T06:26:36.295786+0000","last_unstale":"2024-09-10T06:29:17.517752+0000","last_undegraded":"2024-09-10T06:29:17.517752+0000","last_fullsized":"2024-09-10T06:29:17.517752+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:31.699855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464404+0000","last_change":"2024-09-10T06:26:38.305468+0000","last_active":"2024-09-10T06:28:48.464404+0000","last_peered":"2024-09-10T06:28:48.464404+0000","last_clean":"2024-09-10T06:28:48.464404+0000","last_became_active":"2024-09-10T06:26:38.304847+0000","last_became_peered":"2024-09-10T06:26:38.304847+0000","last_unstale":"2024-09-10T06:28:48.464404+0000","last_undegraded":"2024-09-10T06:28:48.464404+0000","last_fullsized":"2024-09-10T06:28:48.464404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:23:36.499856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456269+0000","last_change":"2024-09-10T06:26:40.331389+0000","last_active":"2024-09-10T06:28:48.456269+0000","last_peered":"2024-09-10T06:28:48.456269+0000","last_clean":"2024-09-10T06:28:48.456269+0000","last_became_active":"2024-09-10T06:26:40.330777+0000","last_became_peered":"2024-09-10T06:26:40.330777+0000","last_unstale":"2024-09-10T06:28:48.456269+0000","last_undegraded":"2024-09-10T06:28:48.456269+0000","last_fullsized":"2024-09-10T06:28:48.456269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:22.792159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.286857+0000","last_change":"2024-09-10T06:29:35.286857+0000","last_active":"2024-09-10T06:29:35.286857+0000","last_peered":"2024-09-10T06:29:35.286857+0000","last_clean":"2024-09-10T06:29:35.286857+0000","last_became_active":"2024-09-10T06:26:32.282263+0000","last_became_peered":"2024-09-10T06:26:32.282263+0000","last_unstale":"2024-09-10T06:29:35.286857+0000","last_undegraded":"2024-09-10T06:29:35.286857+0000","last_fullsized":"2024-09-10T06:29:35.286857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:35.286670+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:35.286670+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.286670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:17.003291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"95'14","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:21.505766+0000","last_change":"2024-09-10T06:29:21.505766+0000","last_active":"2024-09-10T06:29:21.505766+0000","last_peered":"2024-09-10T06:29:21.505766+0000","last_clean":"2024-09-10T06:29:21.505766+0000","last_became_active":"2024-09-10T06:26:30.576039+0000","last_became_peered":"2024-09-10T06:26:30.576039+0000","last_unstale":"2024-09-10T06:29:21.505766+0000","last_undegraded":"2024-09-10T06:29:21.505766+0000","last_fullsized":"2024-09-10T06:29:21.505766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:21.505699+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:21.505699+0000","last_clean_scrub_stamp":"2024-09-10T06:29:21.505699+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:43.246582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377684+0000","last_change":"2024-09-10T06:26:34.268758+0000","last_active":"2024-09-10T06:28:48.377684+0000","last_peered":"2024-09-10T06:28:48.377684+0000","last_clean":"2024-09-10T06:28:48.377684+0000","last_became_active":"2024-09-10T06:26:34.268279+0000","last_became_peered":"2024-09-10T06:26:34.268279+0000","last_unstale":"2024-09-10T06:28:48.377684+0000","last_undegraded":"2024-09-10T06:28:48.377684+0000","last_fullsized":"2024-09-10T06:28:48.377684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:42.052702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'6","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380478+0000","last_change":"2024-09-10T06:26:36.273991+0000","last_active":"2024-09-10T06:28:48.380478+0000","last_peered":"2024-09-10T06:28:48.380478+0000","last_clean":"2024-09-10T06:28:48.380478+0000","last_became_active":"2024-09-10T06:26:36.273138+0000","last_became_peered":"2024-09-10T06:26:36.273138+0000","last_unstale":"2024-09-10T06:28:48.380478+0000","last_undegraded":"2024-09-10T06:28:48.380478+0000","last_fullsized":"2024-09-10T06:28:48.380478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379823+0000","last_change":"2024-09-10T06:26:38.294543+0000","last_active":"2024-09-10T06:28:48.379823+0000","last_peered":"2024-09-10T06:28:48.379823+0000","last_clean":"2024-09-10T06:28:48.379823+0000","last_became_active":"2024-09-10T06:26:38.293754+0000","last_became_peered":"2024-09-10T06:26:38.293754+0000","last_unstale":"2024-09-10T06:28:48.379823+0000","last_undegraded":"2024-09-10T06:28:48.379823+0000","last_fullsized":"2024-09-10T06:28:48.379823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"62'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375308+0000","last_change":"2024-09-10T06:26:40.326998+0000","last_active":"2024-09-10T06:28:48.375308+0000","last_peered":"2024-09-10T06:28:48.375308+0000","last_clean":"2024-09-10T06:28:48.375308+0000","last_became_active":"2024-09-10T06:26:40.322648+0000","last_became_peered":"2024-09-10T06:26:40.322648+0000","last_unstale":"2024-09-10T06:28:48.375308+0000","last_undegraded":"2024-09-10T06:28:48.375308+0000","last_fullsized":"2024-09-10T06:28:48.375308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:19.837495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"76'4","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.591930+0000","last_change":"2024-09-10T06:29:34.591930+0000","last_active":"2024-09-10T06:29:34.591930+0000","last_peered":"2024-09-10T06:29:34.591930+0000","last_clean":"2024-09-10T06:29:34.591930+0000","last_became_active":"2024-09-10T06:26:32.256701+0000","last_became_peered":"2024-09-10T06:26:32.256701+0000","last_unstale":"2024-09-10T06:29:34.591930+0000","last_undegraded":"2024-09-10T06:29:34.591930+0000","last_fullsized":"2024-09-10T06:29:34.591930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:34.591748+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:34.591748+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.591748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:42.899472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"95'26","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.309115+0000","last_change":"2024-09-10T06:29:30.309115+0000","last_active":"2024-09-10T06:29:30.309115+0000","last_peered":"2024-09-10T06:29:30.309115+0000","last_clean":"2024-09-10T06:29:30.309115+0000","last_became_active":"2024-09-10T06:26:30.597703+0000","last_became_peered":"2024-09-10T06:26:30.597703+0000","last_unstale":"2024-09-10T06:29:30.309115+0000","last_undegraded":"2024-09-10T06:29:30.309115+0000","last_fullsized":"2024-09-10T06:29:30.309115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-10T06:29:30.308944+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-10T06:29:30.308944+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.308944+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:32.390030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380025+0000","last_change":"2024-09-10T06:26:34.268741+0000","last_active":"2024-09-10T06:28:48.380025+0000","last_peered":"2024-09-10T06:28:48.380025+0000","last_clean":"2024-09-10T06:28:48.380025+0000","last_became_active":"2024-09-10T06:26:34.268192+0000","last_became_peered":"2024-09-10T06:26:34.268192+0000","last_unstale":"2024-09-10T06:28:48.380025+0000","last_undegraded":"2024-09-10T06:28:48.380025+0000","last_fullsized":"2024-09-10T06:28:48.380025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:42:10.110645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"95'15","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.486844+0000","last_change":"2024-09-10T06:29:39.486844+0000","last_active":"2024-09-10T06:29:39.486844+0000","last_peered":"2024-09-10T06:29:39.486844+0000","last_clean":"2024-09-10T06:29:39.486844+0000","last_became_active":"2024-09-10T06:26:36.275306+0000","last_became_peered":"2024-09-10T06:26:36.275306+0000","last_unstale":"2024-09-10T06:29:39.486844+0000","last_undegraded":"2024-09-10T06:29:39.486844+0000","last_fullsized":"2024-09-10T06:29:39.486844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'15","last_scrub_stamp":"2024-09-10T06:29:39.486605+0000","last_deep_scrub":"95'15","last_deep_scrub_stamp":"2024-09-10T06:29:39.486605+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.486605+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:49.469847+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'105","reported_seq":405,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.323456+0000","last_change":"2024-09-10T06:26:38.302764+0000","last_active":"2024-09-10T06:29:17.323456+0000","last_peered":"2024-09-10T06:29:17.323456+0000","last_clean":"2024-09-10T06:29:17.323456+0000","last_became_active":"2024-09-10T06:26:38.300326+0000","last_became_peered":"2024-09-10T06:26:38.300326+0000","last_unstale":"2024-09-10T06:29:17.323456+0000","last_undegraded":"2024-09-10T06:29:17.323456+0000","last_fullsized":"2024-09-10T06:29:17.323456+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:41:29.851085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376634+0000","last_change":"2024-09-10T06:26:40.297893+0000","last_active":"2024-09-10T06:28:48.376634+0000","last_peered":"2024-09-10T06:28:48.376634+0000","last_clean":"2024-09-10T06:28:48.376634+0000","last_became_active":"2024-09-10T06:26:40.297296+0000","last_became_peered":"2024-09-10T06:26:40.297296+0000","last_unstale":"2024-09-10T06:28:48.376634+0000","last_undegraded":"2024-09-10T06:28:48.376634+0000","last_fullsized":"2024-09-10T06:28:48.376634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.011364+0000","last_change":"2024-09-10T06:29:36.011364+0000","last_active":"2024-09-10T06:29:36.011364+0000","last_peered":"2024-09-10T06:29:36.011364+0000","last_clean":"2024-09-10T06:29:36.011364+0000","last_became_active":"2024-09-10T06:26:32.264334+0000","last_became_peered":"2024-09-10T06:26:32.264334+0000","last_unstale":"2024-09-10T06:29:36.011364+0000","last_undegraded":"2024-09-10T06:29:36.011364+0000","last_fullsized":"2024-09-10T06:29:36.011364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:36.011186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:36.011186+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.011186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:25.230585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"95'26","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.499786+0000","last_change":"2024-09-10T06:29:25.499786+0000","last_active":"2024-09-10T06:29:25.499786+0000","last_peered":"2024-09-10T06:29:25.499786+0000","last_clean":"2024-09-10T06:29:25.499786+0000","last_became_active":"2024-09-10T06:26:30.575433+0000","last_became_peered":"2024-09-10T06:26:30.575433+0000","last_unstale":"2024-09-10T06:29:25.499786+0000","last_undegraded":"2024-09-10T06:29:25.499786+0000","last_fullsized":"2024-09-10T06:29:25.499786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-10T06:29:25.499572+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-10T06:29:25.499572+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.499572+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:04.580943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459995+0000","last_change":"2024-09-10T06:26:34.283701+0000","last_active":"2024-09-10T06:28:48.459995+0000","last_peered":"2024-09-10T06:28:48.459995+0000","last_clean":"2024-09-10T06:28:48.459995+0000","last_became_active":"2024-09-10T06:26:34.282941+0000","last_became_peered":"2024-09-10T06:26:34.282941+0000","last_unstale":"2024-09-10T06:28:48.459995+0000","last_undegraded":"2024-09-10T06:28:48.459995+0000","last_fullsized":"2024-09-10T06:28:48.459995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:29.688340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"95'19","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.481712+0000","last_change":"2024-09-10T06:26:36.298510+0000","last_active":"2024-09-10T06:29:17.481712+0000","last_peered":"2024-09-10T06:29:17.481712+0000","last_clean":"2024-09-10T06:29:17.481712+0000","last_became_active":"2024-09-10T06:26:36.297309+0000","last_became_peered":"2024-09-10T06:26:36.297309+0000","last_unstale":"2024-09-10T06:29:17.481712+0000","last_undegraded":"2024-09-10T06:29:17.481712+0000","last_fullsized":"2024-09-10T06:29:17.481712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'105","reported_seq":272,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.329858+0000","last_change":"2024-09-10T06:26:38.300228+0000","last_active":"2024-09-10T06:29:17.329858+0000","last_peered":"2024-09-10T06:29:17.329858+0000","last_clean":"2024-09-10T06:29:17.329858+0000","last_became_active":"2024-09-10T06:26:38.299355+0000","last_became_peered":"2024-09-10T06:26:38.299355+0000","last_unstale":"2024-09-10T06:29:17.329858+0000","last_undegraded":"2024-09-10T06:29:17.329858+0000","last_fullsized":"2024-09-10T06:29:17.329858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:20.050096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.286958+0000","last_change":"2024-09-10T06:29:34.286958+0000","last_active":"2024-09-10T06:29:34.286958+0000","last_peered":"2024-09-10T06:29:34.286958+0000","last_clean":"2024-09-10T06:29:34.286958+0000","last_became_active":"2024-09-10T06:26:32.270496+0000","last_became_peered":"2024-09-10T06:26:32.270496+0000","last_unstale":"2024-09-10T06:29:34.286958+0000","last_undegraded":"2024-09-10T06:29:34.286958+0000","last_fullsized":"2024-09-10T06:29:34.286958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:34.286772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:34.286772+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.286772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:10.128919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"95'14","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.358994+0000","last_change":"2024-09-10T06:29:31.358994+0000","last_active":"2024-09-10T06:29:31.358994+0000","last_peered":"2024-09-10T06:29:31.358994+0000","last_clean":"2024-09-10T06:29:31.358994+0000","last_became_active":"2024-09-10T06:26:30.606685+0000","last_became_peered":"2024-09-10T06:26:30.606685+0000","last_unstale":"2024-09-10T06:29:31.358994+0000","last_undegraded":"2024-09-10T06:29:31.358994+0000","last_fullsized":"2024-09-10T06:29:31.358994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:31.358776+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:31.358776+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.358776+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:21.505655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.156236+0000","last_change":"2024-09-10T06:29:40.156236+0000","last_active":"2024-09-10T06:29:40.156236+0000","last_peered":"2024-09-10T06:29:40.156236+0000","last_clean":"2024-09-10T06:29:40.156236+0000","last_became_active":"2024-09-10T06:26:34.285787+0000","last_became_peered":"2024-09-10T06:26:34.285787+0000","last_unstale":"2024-09-10T06:29:40.156236+0000","last_undegraded":"2024-09-10T06:29:40.156236+0000","last_fullsized":"2024-09-10T06:29:40.156236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:40.156062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:40.156062+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.156062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:38.844026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"95'28","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.734400+0000","last_change":"2024-09-10T06:26:36.293988+0000","last_active":"2024-09-10T06:29:17.734400+0000","last_peered":"2024-09-10T06:29:17.734400+0000","last_clean":"2024-09-10T06:29:17.734400+0000","last_became_active":"2024-09-10T06:26:36.293226+0000","last_became_peered":"2024-09-10T06:26:36.293226+0000","last_unstale":"2024-09-10T06:29:17.734400+0000","last_undegraded":"2024-09-10T06:29:17.734400+0000","last_fullsized":"2024-09-10T06:29:17.734400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453865+0000","last_change":"2024-09-10T06:26:38.305826+0000","last_active":"2024-09-10T06:28:48.453865+0000","last_peered":"2024-09-10T06:28:48.453865+0000","last_clean":"2024-09-10T06:28:48.453865+0000","last_became_active":"2024-09-10T06:26:38.304601+0000","last_became_peered":"2024-09-10T06:26:38.304601+0000","last_unstale":"2024-09-10T06:28:48.453865+0000","last_undegraded":"2024-09-10T06:28:48.453865+0000","last_fullsized":"2024-09-10T06:28:48.453865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:12.545261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"62'8","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460978+0000","last_change":"2024-09-10T06:26:40.332286+0000","last_active":"2024-09-10T06:28:48.460978+0000","last_peered":"2024-09-10T06:28:48.460978+0000","last_clean":"2024-09-10T06:28:48.460978+0000","last_became_active":"2024-09-10T06:26:40.331262+0000","last_became_peered":"2024-09-10T06:26:40.331262+0000","last_unstale":"2024-09-10T06:28:48.460978+0000","last_undegraded":"2024-09-10T06:28:48.460978+0000","last_fullsized":"2024-09-10T06:28:48.460978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.063454+0000","last_change":"2024-09-10T06:29:29.063454+0000","last_active":"2024-09-10T06:29:29.063454+0000","last_peered":"2024-09-10T06:29:29.063454+0000","last_clean":"2024-09-10T06:29:29.063454+0000","last_became_active":"2024-09-10T06:26:32.261423+0000","last_became_peered":"2024-09-10T06:26:32.261423+0000","last_unstale":"2024-09-10T06:29:29.063454+0000","last_undegraded":"2024-09-10T06:29:29.063454+0000","last_fullsized":"2024-09-10T06:29:29.063454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:29.063273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:29.063273+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.063273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:03.742022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"95'24","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.284702+0000","last_change":"2024-09-10T06:29:29.284702+0000","last_active":"2024-09-10T06:29:29.284702+0000","last_peered":"2024-09-10T06:29:29.284702+0000","last_clean":"2024-09-10T06:29:29.284702+0000","last_became_active":"2024-09-10T06:26:30.595269+0000","last_became_peered":"2024-09-10T06:26:30.595269+0000","last_unstale":"2024-09-10T06:29:29.284702+0000","last_undegraded":"2024-09-10T06:29:29.284702+0000","last_fullsized":"2024-09-10T06:29:29.284702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:29.284526+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:29.284526+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.284526+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:29.270685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":32,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.528881+0000","last_change":"2024-09-10T06:29:34.528881+0000","last_active":"2024-09-10T06:29:34.528881+0000","last_peered":"2024-09-10T06:29:34.528881+0000","last_clean":"2024-09-10T06:29:34.528881+0000","last_became_active":"2024-09-10T06:26:34.266017+0000","last_became_peered":"2024-09-10T06:26:34.266017+0000","last_unstale":"2024-09-10T06:29:34.528881+0000","last_undegraded":"2024-09-10T06:29:34.528881+0000","last_fullsized":"2024-09-10T06:29:34.528881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:34.528700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:34.528700+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.528700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:16.132928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"95'20","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.935405+0000","last_change":"2024-09-10T06:26:36.297020+0000","last_active":"2024-09-10T06:29:17.935405+0000","last_peered":"2024-09-10T06:29:17.935405+0000","last_clean":"2024-09-10T06:29:17.935405+0000","last_became_active":"2024-09-10T06:26:36.295796+0000","last_became_peered":"2024-09-10T06:26:36.295796+0000","last_unstale":"2024-09-10T06:29:17.935405+0000","last_undegraded":"2024-09-10T06:29:17.935405+0000","last_fullsized":"2024-09-10T06:29:17.935405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":38,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375244+0000","last_change":"2024-09-10T06:26:38.297273+0000","last_active":"2024-09-10T06:28:48.375244+0000","last_peered":"2024-09-10T06:28:48.375244+0000","last_clean":"2024-09-10T06:28:48.375244+0000","last_became_active":"2024-09-10T06:26:38.296455+0000","last_became_peered":"2024-09-10T06:26:38.296455+0000","last_unstale":"2024-09-10T06:28:48.375244+0000","last_undegraded":"2024-09-10T06:28:48.375244+0000","last_fullsized":"2024-09-10T06:28:48.375244+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:26.766702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458102+0000","last_change":"2024-09-10T06:26:40.328294+0000","last_active":"2024-09-10T06:28:48.458102+0000","last_peered":"2024-09-10T06:28:48.458102+0000","last_clean":"2024-09-10T06:28:48.458102+0000","last_became_active":"2024-09-10T06:26:40.327585+0000","last_became_peered":"2024-09-10T06:26:40.327585+0000","last_unstale":"2024-09-10T06:28:48.458102+0000","last_undegraded":"2024-09-10T06:28:48.458102+0000","last_fullsized":"2024-09-10T06:28:48.458102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:46.537210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.376436+0000","last_change":"2024-09-10T06:29:34.376436+0000","last_active":"2024-09-10T06:29:34.376436+0000","last_peered":"2024-09-10T06:29:34.376436+0000","last_clean":"2024-09-10T06:29:34.376436+0000","last_became_active":"2024-09-10T06:27:08.599875+0000","last_became_peered":"2024-09-10T06:27:08.599875+0000","last_unstale":"2024-09-10T06:29:34.376436+0000","last_undegraded":"2024-09-10T06:29:34.376436+0000","last_fullsized":"2024-09-10T06:29:34.376436+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:34.376265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:34.376265+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.376265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:57.000500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"95'14","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.294397+0000","last_change":"2024-09-10T06:29:27.294397+0000","last_active":"2024-09-10T06:29:27.294397+0000","last_peered":"2024-09-10T06:29:27.294397+0000","last_clean":"2024-09-10T06:29:27.294397+0000","last_became_active":"2024-09-10T06:26:30.611039+0000","last_became_peered":"2024-09-10T06:26:30.611039+0000","last_unstale":"2024-09-10T06:29:27.294397+0000","last_undegraded":"2024-09-10T06:29:27.294397+0000","last_fullsized":"2024-09-10T06:29:27.294397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:27.294207+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:27.294207+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.294207+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:06.186017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.512254+0000","last_change":"2024-09-10T06:29:37.512254+0000","last_active":"2024-09-10T06:29:37.512254+0000","last_peered":"2024-09-10T06:29:37.512254+0000","last_clean":"2024-09-10T06:29:37.512254+0000","last_became_active":"2024-09-10T06:26:34.262793+0000","last_became_peered":"2024-09-10T06:26:34.262793+0000","last_unstale":"2024-09-10T06:29:37.512254+0000","last_undegraded":"2024-09-10T06:29:37.512254+0000","last_fullsized":"2024-09-10T06:29:37.512254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.512054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.512054+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.512054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:24.188192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"95'26","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.753735+0000","last_change":"2024-09-10T06:26:36.299923+0000","last_active":"2024-09-10T06:29:17.753735+0000","last_peered":"2024-09-10T06:29:17.753735+0000","last_clean":"2024-09-10T06:29:17.753735+0000","last_became_active":"2024-09-10T06:26:36.299140+0000","last_became_peered":"2024-09-10T06:26:36.299140+0000","last_unstale":"2024-09-10T06:29:17.753735+0000","last_undegraded":"2024-09-10T06:29:17.753735+0000","last_fullsized":"2024-09-10T06:29:17.753735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:12.246303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":44,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'105","reported_seq":270,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.330984+0000","last_change":"2024-09-10T06:26:38.292019+0000","last_active":"2024-09-10T06:29:17.330984+0000","last_peered":"2024-09-10T06:29:17.330984+0000","last_clean":"2024-09-10T06:29:17.330984+0000","last_became_active":"2024-09-10T06:26:38.291322+0000","last_became_peered":"2024-09-10T06:26:38.291322+0000","last_unstale":"2024-09-10T06:29:17.330984+0000","last_undegraded":"2024-09-10T06:29:17.330984+0000","last_fullsized":"2024-09-10T06:29:17.330984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"64'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378724+0000","last_change":"2024-09-10T06:26:40.328427+0000","last_active":"2024-09-10T06:28:48.378724+0000","last_peered":"2024-09-10T06:28:48.378724+0000","last_clean":"2024-09-10T06:28:48.378724+0000","last_became_active":"2024-09-10T06:26:40.323249+0000","last_became_peered":"2024-09-10T06:26:40.323249+0000","last_unstale":"2024-09-10T06:28:48.378724+0000","last_undegraded":"2024-09-10T06:28:48.378724+0000","last_fullsized":"2024-09-10T06:28:48.378724+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:04:50.823195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.604989+0000","last_change":"2024-09-10T06:29:33.604989+0000","last_active":"2024-09-10T06:29:33.604989+0000","last_peered":"2024-09-10T06:29:33.604989+0000","last_clean":"2024-09-10T06:29:33.604989+0000","last_became_active":"2024-09-10T06:26:32.274496+0000","last_became_peered":"2024-09-10T06:26:32.274496+0000","last_unstale":"2024-09-10T06:29:33.604989+0000","last_undegraded":"2024-09-10T06:29:33.604989+0000","last_fullsized":"2024-09-10T06:29:33.604989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:33.604805+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:33.604805+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.604805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:39.925661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"95'14","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.434461+0000","last_change":"2024-09-10T06:29:24.434461+0000","last_active":"2024-09-10T06:29:24.434461+0000","last_peered":"2024-09-10T06:29:24.434461+0000","last_clean":"2024-09-10T06:29:24.434461+0000","last_became_active":"2024-09-10T06:26:30.593432+0000","last_became_peered":"2024-09-10T06:26:30.593432+0000","last_unstale":"2024-09-10T06:29:24.434461+0000","last_undegraded":"2024-09-10T06:29:24.434461+0000","last_fullsized":"2024-09-10T06:29:24.434461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:24.434275+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:24.434275+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.434275+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:42.528344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.537178+0000","last_change":"2024-09-10T06:29:35.537178+0000","last_active":"2024-09-10T06:29:35.537178+0000","last_peered":"2024-09-10T06:29:35.537178+0000","last_clean":"2024-09-10T06:29:35.537178+0000","last_became_active":"2024-09-10T06:26:34.256256+0000","last_became_peered":"2024-09-10T06:26:34.256256+0000","last_unstale":"2024-09-10T06:29:35.537178+0000","last_undegraded":"2024-09-10T06:29:35.537178+0000","last_fullsized":"2024-09-10T06:29:35.537178+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:35.536986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:35.536986+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.536986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:46.124657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"95'33","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.772462+0000","last_change":"2024-09-10T06:26:36.296631+0000","last_active":"2024-09-10T06:29:17.772462+0000","last_peered":"2024-09-10T06:29:17.772462+0000","last_clean":"2024-09-10T06:29:17.772462+0000","last_became_active":"2024-09-10T06:26:36.295838+0000","last_became_peered":"2024-09-10T06:26:36.295838+0000","last_unstale":"2024-09-10T06:29:17.772462+0000","last_undegraded":"2024-09-10T06:29:17.772462+0000","last_fullsized":"2024-09-10T06:29:17.772462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:04.271824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":49,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.492017+0000","last_change":"2024-09-10T06:29:40.492017+0000","last_active":"2024-09-10T06:29:40.492017+0000","last_peered":"2024-09-10T06:29:40.492017+0000","last_clean":"2024-09-10T06:29:40.492017+0000","last_became_active":"2024-09-10T06:26:38.307965+0000","last_became_peered":"2024-09-10T06:26:38.307965+0000","last_unstale":"2024-09-10T06:29:40.492017+0000","last_undegraded":"2024-09-10T06:29:40.492017+0000","last_fullsized":"2024-09-10T06:29:40.492017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:40.491832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:40.491832+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.491832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:12.085817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"62'4","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454102+0000","last_change":"2024-09-10T06:26:40.326474+0000","last_active":"2024-09-10T06:28:48.454102+0000","last_peered":"2024-09-10T06:28:48.454102+0000","last_clean":"2024-09-10T06:28:48.454102+0000","last_became_active":"2024-09-10T06:26:40.325731+0000","last_became_peered":"2024-09-10T06:26:40.325731+0000","last_unstale":"2024-09-10T06:28:48.454102+0000","last_undegraded":"2024-09-10T06:28:48.454102+0000","last_fullsized":"2024-09-10T06:28:48.454102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:48:19.400355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"64'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.101641+0000","last_change":"2024-09-10T06:29:30.101641+0000","last_active":"2024-09-10T06:29:30.101641+0000","last_peered":"2024-09-10T06:29:30.101641+0000","last_clean":"2024-09-10T06:29:30.101641+0000","last_became_active":"2024-09-10T06:26:32.253154+0000","last_became_peered":"2024-09-10T06:26:32.253154+0000","last_unstale":"2024-09-10T06:29:30.101641+0000","last_undegraded":"2024-09-10T06:29:30.101641+0000","last_fullsized":"2024-09-10T06:29:30.101641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'2","last_scrub_stamp":"2024-09-10T06:29:30.101463+0000","last_deep_scrub":"64'2","last_deep_scrub_stamp":"2024-09-10T06:29:30.101463+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.101463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:48.195532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'10","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.070099+0000","last_change":"2024-09-10T06:29:25.070099+0000","last_active":"2024-09-10T06:29:25.070099+0000","last_peered":"2024-09-10T06:29:25.070099+0000","last_clean":"2024-09-10T06:29:25.070099+0000","last_became_active":"2024-09-10T06:26:30.571829+0000","last_became_peered":"2024-09-10T06:26:30.571829+0000","last_unstale":"2024-09-10T06:29:25.070099+0000","last_undegraded":"2024-09-10T06:29:25.070099+0000","last_fullsized":"2024-09-10T06:29:25.070099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-10T06:29:25.069903+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-10T06:29:25.069903+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.069903+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:04.002647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.510461+0000","last_change":"2024-09-10T06:29:38.510461+0000","last_active":"2024-09-10T06:29:38.510461+0000","last_peered":"2024-09-10T06:29:38.510461+0000","last_clean":"2024-09-10T06:29:38.510461+0000","last_became_active":"2024-09-10T06:26:34.285004+0000","last_became_peered":"2024-09-10T06:26:34.285004+0000","last_unstale":"2024-09-10T06:29:38.510461+0000","last_undegraded":"2024-09-10T06:29:38.510461+0000","last_fullsized":"2024-09-10T06:29:38.510461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:38.510241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:38.510241+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.510241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:21.881655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"95'24","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.426311+0000","last_change":"2024-09-10T06:26:36.293191+0000","last_active":"2024-09-10T06:29:17.426311+0000","last_peered":"2024-09-10T06:29:17.426311+0000","last_clean":"2024-09-10T06:29:17.426311+0000","last_became_active":"2024-09-10T06:26:36.292423+0000","last_became_peered":"2024-09-10T06:26:36.292423+0000","last_unstale":"2024-09-10T06:29:17.426311+0000","last_undegraded":"2024-09-10T06:29:17.426311+0000","last_fullsized":"2024-09-10T06:29:17.426311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":30,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378126+0000","last_change":"2024-09-10T06:26:38.293667+0000","last_active":"2024-09-10T06:28:48.378126+0000","last_peered":"2024-09-10T06:28:48.378126+0000","last_clean":"2024-09-10T06:28:48.378126+0000","last_became_active":"2024-09-10T06:26:38.292918+0000","last_became_peered":"2024-09-10T06:26:38.292918+0000","last_unstale":"2024-09-10T06:28:48.378126+0000","last_undegraded":"2024-09-10T06:28:48.378126+0000","last_fullsized":"2024-09-10T06:28:48.378126+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:39:57.055090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376446+0000","last_change":"2024-09-10T06:26:40.327061+0000","last_active":"2024-09-10T06:28:48.376446+0000","last_peered":"2024-09-10T06:28:48.376446+0000","last_clean":"2024-09-10T06:28:48.376446+0000","last_became_active":"2024-09-10T06:26:40.326431+0000","last_became_peered":"2024-09-10T06:26:40.326431+0000","last_unstale":"2024-09-10T06:28:48.376446+0000","last_undegraded":"2024-09-10T06:28:48.376446+0000","last_fullsized":"2024-09-10T06:28:48.376446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:27.631214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"64'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.105015+0000","last_change":"2024-09-10T06:29:31.105015+0000","last_active":"2024-09-10T06:29:31.105015+0000","last_peered":"2024-09-10T06:29:31.105015+0000","last_clean":"2024-09-10T06:29:31.105015+0000","last_became_active":"2024-09-10T06:26:32.253524+0000","last_became_peered":"2024-09-10T06:26:32.253524+0000","last_unstale":"2024-09-10T06:29:31.105015+0000","last_undegraded":"2024-09-10T06:29:31.105015+0000","last_fullsized":"2024-09-10T06:29:31.105015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'2","last_scrub_stamp":"2024-09-10T06:29:31.104822+0000","last_deep_scrub":"64'2","last_deep_scrub_stamp":"2024-09-10T06:29:31.104822+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.104822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:52.845705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'16","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.518214+0000","last_change":"2024-09-10T06:29:24.518214+0000","last_active":"2024-09-10T06:29:24.518214+0000","last_peered":"2024-09-10T06:29:24.518214+0000","last_clean":"2024-09-10T06:29:24.518214+0000","last_became_active":"2024-09-10T06:26:30.591125+0000","last_became_peered":"2024-09-10T06:26:30.591125+0000","last_unstale":"2024-09-10T06:29:24.518214+0000","last_undegraded":"2024-09-10T06:29:24.518214+0000","last_fullsized":"2024-09-10T06:29:24.518214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:24.518012+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:24.518012+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.518012+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:35.325269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.776224+0000","last_change":"2024-09-10T06:29:37.776224+0000","last_active":"2024-09-10T06:29:37.776224+0000","last_peered":"2024-09-10T06:29:37.776224+0000","last_clean":"2024-09-10T06:29:37.776224+0000","last_became_active":"2024-09-10T06:26:34.280058+0000","last_became_peered":"2024-09-10T06:26:34.280058+0000","last_unstale":"2024-09-10T06:29:37.776224+0000","last_undegraded":"2024-09-10T06:29:37.776224+0000","last_fullsized":"2024-09-10T06:29:37.776224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.776040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.776040+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.776040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:42.371352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"95'26","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.909956+0000","last_change":"2024-09-10T06:26:36.277547+0000","last_active":"2024-09-10T06:29:17.909956+0000","last_peered":"2024-09-10T06:29:17.909956+0000","last_clean":"2024-09-10T06:29:17.909956+0000","last_became_active":"2024-09-10T06:26:36.276965+0000","last_became_peered":"2024-09-10T06:26:36.276965+0000","last_unstale":"2024-09-10T06:29:17.909956+0000","last_undegraded":"2024-09-10T06:29:17.909956+0000","last_fullsized":"2024-09-10T06:29:17.909956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:43.212945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'105","reported_seq":301,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.325594+0000","last_change":"2024-09-10T06:26:38.306134+0000","last_active":"2024-09-10T06:29:17.325594+0000","last_peered":"2024-09-10T06:29:17.325594+0000","last_clean":"2024-09-10T06:29:17.325594+0000","last_became_active":"2024-09-10T06:26:38.299012+0000","last_became_peered":"2024-09-10T06:26:38.299012+0000","last_unstale":"2024-09-10T06:29:17.325594+0000","last_undegraded":"2024-09-10T06:29:17.325594+0000","last_fullsized":"2024-09-10T06:29:17.325594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:37.468047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"61'2","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454114+0000","last_change":"2024-09-10T06:26:40.336036+0000","last_active":"2024-09-10T06:28:48.454114+0000","last_peered":"2024-09-10T06:28:48.454114+0000","last_clean":"2024-09-10T06:28:48.454114+0000","last_became_active":"2024-09-10T06:26:40.335302+0000","last_became_peered":"2024-09-10T06:26:40.335302+0000","last_unstale":"2024-09-10T06:28:48.454114+0000","last_undegraded":"2024-09-10T06:28:48.454114+0000","last_fullsized":"2024-09-10T06:28:48.454114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:24.024562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.073055+0000","last_change":"2024-09-10T06:29:32.073055+0000","last_active":"2024-09-10T06:29:32.073055+0000","last_peered":"2024-09-10T06:29:32.073055+0000","last_clean":"2024-09-10T06:29:32.073055+0000","last_became_active":"2024-09-10T06:26:32.287315+0000","last_became_peered":"2024-09-10T06:26:32.287315+0000","last_unstale":"2024-09-10T06:29:32.073055+0000","last_undegraded":"2024-09-10T06:29:32.073055+0000","last_fullsized":"2024-09-10T06:29:32.073055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2024-09-10T06:29:32.072864+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2024-09-10T06:29:32.072864+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.072864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.911842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'14","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.077576+0000","last_change":"2024-09-10T06:29:25.077576+0000","last_active":"2024-09-10T06:29:25.077576+0000","last_peered":"2024-09-10T06:29:25.077576+0000","last_clean":"2024-09-10T06:29:25.077576+0000","last_became_active":"2024-09-10T06:26:30.568464+0000","last_became_peered":"2024-09-10T06:26:30.568464+0000","last_unstale":"2024-09-10T06:29:25.077576+0000","last_undegraded":"2024-09-10T06:29:25.077576+0000","last_fullsized":"2024-09-10T06:29:25.077576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:25.077383+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:25.077383+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.077383+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:12.962962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":284,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.291130+0000","last_change":"2024-09-10T06:26:34.279935+0000","last_active":"2024-09-10T06:29:17.291130+0000","last_peered":"2024-09-10T06:29:17.291130+0000","last_clean":"2024-09-10T06:29:17.291130+0000","last_became_active":"2024-09-10T06:26:34.279192+0000","last_became_peered":"2024-09-10T06:26:34.279192+0000","last_unstale":"2024-09-10T06:29:17.291130+0000","last_undegraded":"2024-09-10T06:29:17.291130+0000","last_fullsized":"2024-09-10T06:29:17.291130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:18.753175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377130+0000","last_change":"2024-09-10T06:26:36.290330+0000","last_active":"2024-09-10T06:28:48.377130+0000","last_peered":"2024-09-10T06:28:48.377130+0000","last_clean":"2024-09-10T06:28:48.377130+0000","last_became_active":"2024-09-10T06:26:36.289527+0000","last_became_peered":"2024-09-10T06:26:36.289527+0000","last_unstale":"2024-09-10T06:28:48.377130+0000","last_undegraded":"2024-09-10T06:28:48.377130+0000","last_fullsized":"2024-09-10T06:28:48.377130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:59:26.472394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'105","reported_seq":313,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.327392+0000","last_change":"2024-09-10T06:26:38.288663+0000","last_active":"2024-09-10T06:29:17.327392+0000","last_peered":"2024-09-10T06:29:17.327392+0000","last_clean":"2024-09-10T06:29:17.327392+0000","last_became_active":"2024-09-10T06:26:38.287740+0000","last_became_peered":"2024-09-10T06:26:38.287740+0000","last_unstale":"2024-09-10T06:29:17.327392+0000","last_undegraded":"2024-09-10T06:29:17.327392+0000","last_fullsized":"2024-09-10T06:29:17.327392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:08:22.078943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'8","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377335+0000","last_change":"2024-09-10T06:26:40.329737+0000","last_active":"2024-09-10T06:28:48.377335+0000","last_peered":"2024-09-10T06:28:48.377335+0000","last_clean":"2024-09-10T06:28:48.377335+0000","last_became_active":"2024-09-10T06:26:40.328952+0000","last_became_peered":"2024-09-10T06:26:40.328952+0000","last_unstale":"2024-09-10T06:28:48.377335+0000","last_undegraded":"2024-09-10T06:28:48.377335+0000","last_fullsized":"2024-09-10T06:28:48.377335+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.726186+0000","last_change":"2024-09-10T06:29:36.726186+0000","last_active":"2024-09-10T06:29:36.726186+0000","last_peered":"2024-09-10T06:29:36.726186+0000","last_clean":"2024-09-10T06:29:36.726186+0000","last_became_active":"2024-09-10T06:26:32.270265+0000","last_became_peered":"2024-09-10T06:26:32.270265+0000","last_unstale":"2024-09-10T06:29:36.726186+0000","last_undegraded":"2024-09-10T06:29:36.726186+0000","last_fullsized":"2024-09-10T06:29:36.726186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:36.726005+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:36.726005+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.726005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:53.188286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"95'22","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.586338+0000","last_change":"2024-09-10T06:29:24.586338+0000","last_active":"2024-09-10T06:29:24.586338+0000","last_peered":"2024-09-10T06:29:24.586338+0000","last_clean":"2024-09-10T06:29:24.586338+0000","last_became_active":"2024-09-10T06:27:08.592864+0000","last_became_peered":"2024-09-10T06:27:08.592864+0000","last_unstale":"2024-09-10T06:29:24.586338+0000","last_undegraded":"2024-09-10T06:29:24.586338+0000","last_fullsized":"2024-09-10T06:29:24.586338+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:24.586253+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:24.586253+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.586253+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:13.559714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380176+0000","last_change":"2024-09-10T06:26:34.286497+0000","last_active":"2024-09-10T06:28:48.380176+0000","last_peered":"2024-09-10T06:28:48.380176+0000","last_clean":"2024-09-10T06:28:48.380176+0000","last_became_active":"2024-09-10T06:26:34.285334+0000","last_became_peered":"2024-09-10T06:26:34.285334+0000","last_unstale":"2024-09-10T06:28:48.380176+0000","last_undegraded":"2024-09-10T06:28:48.380176+0000","last_fullsized":"2024-09-10T06:28:48.380176+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:18:54.506182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"95'26","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.525558+0000","last_change":"2024-09-10T06:26:36.288213+0000","last_active":"2024-09-10T06:29:17.525558+0000","last_peered":"2024-09-10T06:29:17.525558+0000","last_clean":"2024-09-10T06:29:17.525558+0000","last_became_active":"2024-09-10T06:26:36.287468+0000","last_became_peered":"2024-09-10T06:26:36.287468+0000","last_unstale":"2024-09-10T06:29:17.525558+0000","last_undegraded":"2024-09-10T06:29:17.525558+0000","last_fullsized":"2024-09-10T06:29:17.525558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457697+0000","last_change":"2024-09-10T06:26:38.291943+0000","last_active":"2024-09-10T06:28:48.457697+0000","last_peered":"2024-09-10T06:28:48.457697+0000","last_clean":"2024-09-10T06:28:48.457697+0000","last_became_active":"2024-09-10T06:26:38.291214+0000","last_became_peered":"2024-09-10T06:26:38.291214+0000","last_unstale":"2024-09-10T06:28:48.457697+0000","last_undegraded":"2024-09-10T06:28:48.457697+0000","last_fullsized":"2024-09-10T06:28:48.457697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:57:56.906454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"67'4","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453374+0000","last_change":"2024-09-10T06:26:40.331977+0000","last_active":"2024-09-10T06:28:48.453374+0000","last_peered":"2024-09-10T06:28:48.453374+0000","last_clean":"2024-09-10T06:28:48.453374+0000","last_became_active":"2024-09-10T06:26:40.331502+0000","last_became_peered":"2024-09-10T06:26:40.331502+0000","last_unstale":"2024-09-10T06:28:48.453374+0000","last_undegraded":"2024-09-10T06:28:48.453374+0000","last_fullsized":"2024-09-10T06:28:48.453374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:33:43.572813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.416313+0000","last_change":"2024-09-10T06:29:33.416313+0000","last_active":"2024-09-10T06:29:33.416313+0000","last_peered":"2024-09-10T06:29:33.416313+0000","last_clean":"2024-09-10T06:29:33.416313+0000","last_became_active":"2024-09-10T06:26:32.273727+0000","last_became_peered":"2024-09-10T06:26:32.273727+0000","last_unstale":"2024-09-10T06:29:33.416313+0000","last_undegraded":"2024-09-10T06:29:33.416313+0000","last_fullsized":"2024-09-10T06:29:33.416313+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:33.416125+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:33.416125+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.416125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:57.777260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"95'74","reported_seq":268,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.264881+0000","last_change":"2024-09-10T06:29:25.264881+0000","last_active":"2024-09-10T06:29:25.264881+0000","last_peered":"2024-09-10T06:29:25.264881+0000","last_clean":"2024-09-10T06:29:25.264881+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:29:25.264881+0000","last_undegraded":"2024-09-10T06:29:25.264881+0000","last_fullsized":"2024-09-10T06:29:25.264881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'74","last_scrub_stamp":"2024-09-10T06:29:25.264687+0000","last_deep_scrub":"95'74","last_deep_scrub_stamp":"2024-09-10T06:29:25.264687+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.264687+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:10.255426+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"95'2","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.364086+0000","last_change":"2024-09-10T06:29:27.364086+0000","last_active":"2024-09-10T06:29:27.364086+0000","last_peered":"2024-09-10T06:29:27.364086+0000","last_clean":"2024-09-10T06:29:27.364086+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:29:27.364086+0000","last_undegraded":"2024-09-10T06:29:27.364086+0000","last_fullsized":"2024-09-10T06:29:27.364086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-10T06:29:27.363883+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-10T06:29:27.363883+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.363883+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:22.736354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'18","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.090343+0000","last_change":"2024-09-10T06:29:23.090343+0000","last_active":"2024-09-10T06:29:23.090343+0000","last_peered":"2024-09-10T06:29:23.090343+0000","last_clean":"2024-09-10T06:29:23.090343+0000","last_became_active":"2024-09-10T06:26:30.606348+0000","last_became_peered":"2024-09-10T06:26:30.606348+0000","last_unstale":"2024-09-10T06:29:23.090343+0000","last_undegraded":"2024-09-10T06:29:23.090343+0000","last_fullsized":"2024-09-10T06:29:23.090343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:23.090275+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:23.090275+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.090275+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:50.992919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.202712+0000","last_change":"2024-09-10T06:29:39.202712+0000","last_active":"2024-09-10T06:29:39.202712+0000","last_peered":"2024-09-10T06:29:39.202712+0000","last_clean":"2024-09-10T06:29:39.202712+0000","last_became_active":"2024-09-10T06:26:34.285248+0000","last_became_peered":"2024-09-10T06:26:34.285248+0000","last_unstale":"2024-09-10T06:29:39.202712+0000","last_undegraded":"2024-09-10T06:29:39.202712+0000","last_fullsized":"2024-09-10T06:29:39.202712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:39.202537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:39.202537+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.202537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:58.998710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"95'42","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.786714+0000","last_change":"2024-09-10T06:26:36.296684+0000","last_active":"2024-09-10T06:29:17.786714+0000","last_peered":"2024-09-10T06:29:17.786714+0000","last_clean":"2024-09-10T06:29:17.786714+0000","last_became_active":"2024-09-10T06:26:36.295901+0000","last_became_peered":"2024-09-10T06:26:36.295901+0000","last_unstale":"2024-09-10T06:29:17.786714+0000","last_undegraded":"2024-09-10T06:29:17.786714+0000","last_fullsized":"2024-09-10T06:29:17.786714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:30.688691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":160,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378965+0000","last_change":"2024-09-10T06:26:38.306412+0000","last_active":"2024-09-10T06:28:48.378965+0000","last_peered":"2024-09-10T06:28:48.378965+0000","last_clean":"2024-09-10T06:28:48.378965+0000","last_became_active":"2024-09-10T06:26:38.305496+0000","last_became_peered":"2024-09-10T06:26:38.305496+0000","last_unstale":"2024-09-10T06:28:48.378965+0000","last_undegraded":"2024-09-10T06:28:48.378965+0000","last_fullsized":"2024-09-10T06:28:48.378965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:49:15.370035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"64'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456581+0000","last_change":"2024-09-10T06:26:40.331981+0000","last_active":"2024-09-10T06:28:48.456581+0000","last_peered":"2024-09-10T06:28:48.456581+0000","last_clean":"2024-09-10T06:28:48.456581+0000","last_became_active":"2024-09-10T06:26:40.331294+0000","last_became_peered":"2024-09-10T06:26:40.331294+0000","last_unstale":"2024-09-10T06:28:48.456581+0000","last_undegraded":"2024-09-10T06:28:48.456581+0000","last_fullsized":"2024-09-10T06:28:48.456581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:00.535925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.564019+0000","last_change":"2024-09-10T06:29:32.564019+0000","last_active":"2024-09-10T06:29:32.564019+0000","last_peered":"2024-09-10T06:29:32.564019+0000","last_clean":"2024-09-10T06:29:32.564019+0000","last_became_active":"2024-09-10T06:26:32.278118+0000","last_became_peered":"2024-09-10T06:26:32.278118+0000","last_unstale":"2024-09-10T06:29:32.564019+0000","last_undegraded":"2024-09-10T06:29:32.564019+0000","last_fullsized":"2024-09-10T06:29:32.564019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:32.563849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:32.563849+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.563849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:22.391297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.251882+0000","last_change":"2024-09-10T06:29:26.251882+0000","last_active":"2024-09-10T06:29:26.251882+0000","last_peered":"2024-09-10T06:29:26.251882+0000","last_clean":"2024-09-10T06:29:26.251882+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:29:26.251882+0000","last_undegraded":"2024-09-10T06:29:26.251882+0000","last_fullsized":"2024-09-10T06:29:26.251882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:26.251712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:26.251712+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.251712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:18.145262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"95'22","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.578231+0000","last_change":"2024-09-10T06:29:23.578231+0000","last_active":"2024-09-10T06:29:23.578231+0000","last_peered":"2024-09-10T06:29:23.578231+0000","last_clean":"2024-09-10T06:29:23.578231+0000","last_became_active":"2024-09-10T06:26:30.593978+0000","last_became_peered":"2024-09-10T06:26:30.593978+0000","last_unstale":"2024-09-10T06:29:23.578231+0000","last_undegraded":"2024-09-10T06:29:23.578231+0000","last_fullsized":"2024-09-10T06:29:23.578231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:23.578147+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:23.578147+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.578147+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:35:24.778260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460472+0000","last_change":"2024-09-10T06:26:34.279889+0000","last_active":"2024-09-10T06:28:48.460472+0000","last_peered":"2024-09-10T06:28:48.460472+0000","last_clean":"2024-09-10T06:28:48.460472+0000","last_became_active":"2024-09-10T06:26:34.279147+0000","last_became_peered":"2024-09-10T06:26:34.279147+0000","last_unstale":"2024-09-10T06:28:48.460472+0000","last_undegraded":"2024-09-10T06:28:48.460472+0000","last_fullsized":"2024-09-10T06:28:48.460472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:02.260309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'119","reported_seq":351,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.940308+0000","last_change":"2024-09-10T06:26:36.290005+0000","last_active":"2024-09-10T06:29:17.940308+0000","last_peered":"2024-09-10T06:29:17.940308+0000","last_clean":"2024-09-10T06:29:17.940308+0000","last_became_active":"2024-09-10T06:26:36.289232+0000","last_became_peered":"2024-09-10T06:26:36.289232+0000","last_unstale":"2024-09-10T06:29:17.940308+0000","last_undegraded":"2024-09-10T06:29:17.940308+0000","last_fullsized":"2024-09-10T06:29:17.940308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:51.597427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":162,"num_read_kb":147,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463283+0000","last_change":"2024-09-10T06:26:38.302505+0000","last_active":"2024-09-10T06:28:48.463283+0000","last_peered":"2024-09-10T06:28:48.463283+0000","last_clean":"2024-09-10T06:28:48.463283+0000","last_became_active":"2024-09-10T06:26:38.301104+0000","last_became_peered":"2024-09-10T06:26:38.301104+0000","last_unstale":"2024-09-10T06:28:48.463283+0000","last_undegraded":"2024-09-10T06:28:48.463283+0000","last_fullsized":"2024-09-10T06:28:48.463283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:59:31.863622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"76'2","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453152+0000","last_change":"2024-09-10T06:26:40.320079+0000","last_active":"2024-09-10T06:28:48.453152+0000","last_peered":"2024-09-10T06:28:48.453152+0000","last_clean":"2024-09-10T06:28:48.453152+0000","last_became_active":"2024-09-10T06:26:40.319266+0000","last_became_peered":"2024-09-10T06:26:40.319266+0000","last_unstale":"2024-09-10T06:28:48.453152+0000","last_undegraded":"2024-09-10T06:28:48.453152+0000","last_fullsized":"2024-09-10T06:28:48.453152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:57.937745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"76'14","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.690686+0000","last_change":"2024-09-10T06:29:32.690686+0000","last_active":"2024-09-10T06:29:32.690686+0000","last_peered":"2024-09-10T06:29:32.690686+0000","last_clean":"2024-09-10T06:29:32.690686+0000","last_became_active":"2024-09-10T06:26:32.282235+0000","last_became_peered":"2024-09-10T06:26:32.282235+0000","last_unstale":"2024-09-10T06:29:32.690686+0000","last_undegraded":"2024-09-10T06:29:32.690686+0000","last_fullsized":"2024-09-10T06:29:32.690686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'14","last_scrub_stamp":"2024-09-10T06:29:32.690477+0000","last_deep_scrub":"76'14","last_deep_scrub_stamp":"2024-09-10T06:29:32.690477+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.690477+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:45.934951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.535434+0000","last_change":"2024-09-10T06:29:23.535434+0000","last_active":"2024-09-10T06:29:23.535434+0000","last_peered":"2024-09-10T06:29:23.535434+0000","last_clean":"2024-09-10T06:29:23.535434+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:29:23.535434+0000","last_undegraded":"2024-09-10T06:29:23.535434+0000","last_fullsized":"2024-09-10T06:29:23.535434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:23.535349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:23.535349+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.535349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:38.274075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"95'16","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.757031+0000","last_change":"2024-09-10T06:29:24.757031+0000","last_active":"2024-09-10T06:29:24.757031+0000","last_peered":"2024-09-10T06:29:24.757031+0000","last_clean":"2024-09-10T06:29:24.757031+0000","last_became_active":"2024-09-10T06:26:30.570037+0000","last_became_peered":"2024-09-10T06:26:30.570037+0000","last_unstale":"2024-09-10T06:29:24.757031+0000","last_undegraded":"2024-09-10T06:29:24.757031+0000","last_fullsized":"2024-09-10T06:29:24.757031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:24.756843+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:24.756843+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.756843+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:05.933687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"95'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.572089+0000","last_change":"2024-09-10T06:29:33.572089+0000","last_active":"2024-09-10T06:29:33.572089+0000","last_peered":"2024-09-10T06:29:33.572089+0000","last_clean":"2024-09-10T06:29:33.572089+0000","last_became_active":"2024-09-10T06:26:34.283980+0000","last_became_peered":"2024-09-10T06:26:34.283980+0000","last_unstale":"2024-09-10T06:29:33.572089+0000","last_undegraded":"2024-09-10T06:29:33.572089+0000","last_fullsized":"2024-09-10T06:29:33.572089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-10T06:29:33.571908+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-10T06:29:33.571908+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.571908+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:00.057364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'19","reported_seq":241,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:49.467565+0000","last_change":"2024-09-10T06:28:47.073398+0000","last_active":"2024-09-10T06:28:49.467565+0000","last_peered":"2024-09-10T06:28:49.467565+0000","last_clean":"2024-09-10T06:28:49.467565+0000","last_became_active":"2024-09-10T06:28:46.327631+0000","last_became_peered":"2024-09-10T06:28:46.327631+0000","last_unstale":"2024-09-10T06:28:49.467565+0000","last_undegraded":"2024-09-10T06:28:49.467565+0000","last_fullsized":"2024-09-10T06:28:49.467565+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:17:25.802510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375982+0000","last_change":"2024-09-10T06:26:38.292411+0000","last_active":"2024-09-10T06:28:48.375982+0000","last_peered":"2024-09-10T06:28:48.375982+0000","last_clean":"2024-09-10T06:28:48.375982+0000","last_became_active":"2024-09-10T06:26:38.291623+0000","last_became_peered":"2024-09-10T06:26:38.291623+0000","last_unstale":"2024-09-10T06:28:48.375982+0000","last_undegraded":"2024-09-10T06:28:48.375982+0000","last_fullsized":"2024-09-10T06:28:48.375982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377385+0000","last_change":"2024-09-10T06:26:40.303598+0000","last_active":"2024-09-10T06:28:48.377385+0000","last_peered":"2024-09-10T06:28:48.377385+0000","last_clean":"2024-09-10T06:28:48.377385+0000","last_became_active":"2024-09-10T06:26:40.302898+0000","last_became_peered":"2024-09-10T06:26:40.302898+0000","last_unstale":"2024-09-10T06:28:48.377385+0000","last_undegraded":"2024-09-10T06:28:48.377385+0000","last_fullsized":"2024-09-10T06:28:48.377385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:52:49.851639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"76'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.705655+0000","last_change":"2024-09-10T06:29:31.705655+0000","last_active":"2024-09-10T06:29:31.705655+0000","last_peered":"2024-09-10T06:29:31.705655+0000","last_clean":"2024-09-10T06:29:31.705655+0000","last_became_active":"2024-09-10T06:26:32.273183+0000","last_became_peered":"2024-09-10T06:26:32.273183+0000","last_unstale":"2024-09-10T06:29:31.705655+0000","last_undegraded":"2024-09-10T06:29:31.705655+0000","last_fullsized":"2024-09-10T06:29:31.705655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:31.705463+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:31.705463+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.705463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:13.950948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"95'3","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.389873+0000","last_change":"2024-09-10T06:29:25.389873+0000","last_active":"2024-09-10T06:29:25.389873+0000","last_peered":"2024-09-10T06:29:25.389873+0000","last_clean":"2024-09-10T06:29:25.389873+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:29:25.389873+0000","last_undegraded":"2024-09-10T06:29:25.389873+0000","last_fullsized":"2024-09-10T06:29:25.389873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-10T06:29:25.389673+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-10T06:29:25.389673+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.389673+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:47.130556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"95'16","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.119629+0000","last_change":"2024-09-10T06:29:23.119629+0000","last_active":"2024-09-10T06:29:23.119629+0000","last_peered":"2024-09-10T06:29:23.119629+0000","last_clean":"2024-09-10T06:29:23.119629+0000","last_became_active":"2024-09-10T06:26:30.577934+0000","last_became_peered":"2024-09-10T06:26:30.577934+0000","last_unstale":"2024-09-10T06:29:23.119629+0000","last_undegraded":"2024-09-10T06:29:23.119629+0000","last_fullsized":"2024-09-10T06:29:23.119629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:23.119438+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:23.119438+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.119438+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:44.272106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377724+0000","last_change":"2024-09-10T06:26:34.275458+0000","last_active":"2024-09-10T06:28:48.377724+0000","last_peered":"2024-09-10T06:28:48.377724+0000","last_clean":"2024-09-10T06:28:48.377724+0000","last_became_active":"2024-09-10T06:26:34.274705+0000","last_became_peered":"2024-09-10T06:26:34.274705+0000","last_unstale":"2024-09-10T06:28:48.377724+0000","last_undegraded":"2024-09-10T06:28:48.377724+0000","last_fullsized":"2024-09-10T06:28:48.377724+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:20.624872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379364+0000","last_change":"2024-09-10T06:26:36.266077+0000","last_active":"2024-09-10T06:28:48.379364+0000","last_peered":"2024-09-10T06:28:48.379364+0000","last_clean":"2024-09-10T06:28:48.379364+0000","last_became_active":"2024-09-10T06:26:36.265322+0000","last_became_peered":"2024-09-10T06:26:36.265322+0000","last_unstale":"2024-09-10T06:28:48.379364+0000","last_undegraded":"2024-09-10T06:28:48.379364+0000","last_fullsized":"2024-09-10T06:28:48.379364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459162+0000","last_change":"2024-09-10T06:28:46.345843+0000","last_active":"2024-09-10T06:28:48.459162+0000","last_peered":"2024-09-10T06:28:48.459162+0000","last_clean":"2024-09-10T06:28:48.459162+0000","last_became_active":"2024-09-10T06:28:46.344951+0000","last_became_peered":"2024-09-10T06:28:46.344951+0000","last_unstale":"2024-09-10T06:28:48.459162+0000","last_undegraded":"2024-09-10T06:28:48.459162+0000","last_fullsized":"2024-09-10T06:28:48.459162+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:00:17.825354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"76'8","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456074+0000","last_change":"2024-09-10T06:26:40.326887+0000","last_active":"2024-09-10T06:28:48.456074+0000","last_peered":"2024-09-10T06:28:48.456074+0000","last_clean":"2024-09-10T06:28:48.456074+0000","last_became_active":"2024-09-10T06:26:40.326130+0000","last_became_peered":"2024-09-10T06:26:40.326130+0000","last_unstale":"2024-09-10T06:28:48.456074+0000","last_undegraded":"2024-09-10T06:28:48.456074+0000","last_fullsized":"2024-09-10T06:28:48.456074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:58:28.237428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'8","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.702304+0000","last_change":"2024-09-10T06:29:29.702304+0000","last_active":"2024-09-10T06:29:29.702304+0000","last_peered":"2024-09-10T06:29:29.702304+0000","last_clean":"2024-09-10T06:29:29.702304+0000","last_became_active":"2024-09-10T06:26:32.282086+0000","last_became_peered":"2024-09-10T06:26:32.282086+0000","last_unstale":"2024-09-10T06:29:29.702304+0000","last_undegraded":"2024-09-10T06:29:29.702304+0000","last_fullsized":"2024-09-10T06:29:29.702304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8","last_scrub_stamp":"2024-09-10T06:29:29.702110+0000","last_deep_scrub":"67'8","last_deep_scrub_stamp":"2024-09-10T06:29:29.702110+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.702110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:02.172256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'32","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.404438+0000","last_change":"2024-09-10T06:29:23.404438+0000","last_active":"2024-09-10T06:29:23.404438+0000","last_peered":"2024-09-10T06:29:23.404438+0000","last_clean":"2024-09-10T06:29:23.404438+0000","last_became_active":"2024-09-10T06:26:30.591140+0000","last_became_peered":"2024-09-10T06:26:30.591140+0000","last_unstale":"2024-09-10T06:29:23.404438+0000","last_undegraded":"2024-09-10T06:29:23.404438+0000","last_fullsized":"2024-09-10T06:29:23.404438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'32","last_scrub_stamp":"2024-09-10T06:29:23.404208+0000","last_deep_scrub":"95'32","last_deep_scrub_stamp":"2024-09-10T06:29:23.404208+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.404208+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:58.082957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.783568+0000","last_change":"2024-09-10T06:29:23.783568+0000","last_active":"2024-09-10T06:29:23.783568+0000","last_peered":"2024-09-10T06:29:23.783568+0000","last_clean":"2024-09-10T06:29:23.783568+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:29:23.783568+0000","last_undegraded":"2024-09-10T06:29:23.783568+0000","last_fullsized":"2024-09-10T06:29:23.783568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:23.783333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:23.783333+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.783333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:11.916364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376269+0000","last_change":"2024-09-10T06:26:34.276099+0000","last_active":"2024-09-10T06:28:48.376269+0000","last_peered":"2024-09-10T06:28:48.376269+0000","last_clean":"2024-09-10T06:28:48.376269+0000","last_became_active":"2024-09-10T06:26:34.273984+0000","last_became_peered":"2024-09-10T06:26:34.273984+0000","last_unstale":"2024-09-10T06:28:48.376269+0000","last_undegraded":"2024-09-10T06:28:48.376269+0000","last_fullsized":"2024-09-10T06:28:48.376269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"95'38","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.905345+0000","last_change":"2024-09-10T06:26:36.272589+0000","last_active":"2024-09-10T06:29:17.905345+0000","last_peered":"2024-09-10T06:29:17.905345+0000","last_clean":"2024-09-10T06:29:17.905345+0000","last_became_active":"2024-09-10T06:26:36.270914+0000","last_became_peered":"2024-09-10T06:26:36.270914+0000","last_unstale":"2024-09-10T06:29:17.905345+0000","last_undegraded":"2024-09-10T06:29:17.905345+0000","last_fullsized":"2024-09-10T06:29:17.905345+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:34:20.764690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":157,"num_write":28,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376397+0000","last_change":"2024-09-10T06:26:38.278069+0000","last_active":"2024-09-10T06:28:48.376397+0000","last_peered":"2024-09-10T06:28:48.376397+0000","last_clean":"2024-09-10T06:28:48.376397+0000","last_became_active":"2024-09-10T06:26:38.277261+0000","last_became_peered":"2024-09-10T06:26:38.277261+0000","last_unstale":"2024-09-10T06:28:48.376397+0000","last_undegraded":"2024-09-10T06:28:48.376397+0000","last_fullsized":"2024-09-10T06:28:48.376397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:55.527767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"67'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378048+0000","last_change":"2024-09-10T06:26:40.333741+0000","last_active":"2024-09-10T06:28:48.378048+0000","last_peered":"2024-09-10T06:28:48.378048+0000","last_clean":"2024-09-10T06:28:48.378048+0000","last_became_active":"2024-09-10T06:26:40.329701+0000","last_became_peered":"2024-09-10T06:26:40.329701+0000","last_unstale":"2024-09-10T06:28:48.378048+0000","last_undegraded":"2024-09-10T06:28:48.378048+0000","last_fullsized":"2024-09-10T06:28:48.378048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:53.704790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"67'4","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.553050+0000","last_change":"2024-09-10T06:29:30.553050+0000","last_active":"2024-09-10T06:29:30.553050+0000","last_peered":"2024-09-10T06:29:30.553050+0000","last_clean":"2024-09-10T06:29:30.553050+0000","last_became_active":"2024-09-10T06:26:32.274946+0000","last_became_peered":"2024-09-10T06:26:32.274946+0000","last_unstale":"2024-09-10T06:29:30.553050+0000","last_undegraded":"2024-09-10T06:29:30.553050+0000","last_fullsized":"2024-09-10T06:29:30.553050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:30.552860+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:30.552860+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.552860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:06.395007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"95'16","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.713294+0000","last_change":"2024-09-10T06:29:28.713294+0000","last_active":"2024-09-10T06:29:28.713294+0000","last_peered":"2024-09-10T06:29:28.713294+0000","last_clean":"2024-09-10T06:29:28.713294+0000","last_became_active":"2024-09-10T06:26:30.565220+0000","last_became_peered":"2024-09-10T06:26:30.565220+0000","last_unstale":"2024-09-10T06:29:28.713294+0000","last_undegraded":"2024-09-10T06:29:28.713294+0000","last_fullsized":"2024-09-10T06:29:28.713294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:28.713108+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:28.713108+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.713108+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:48:49.954032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.248692+0000","last_change":"2024-09-10T06:29:28.248692+0000","last_active":"2024-09-10T06:29:28.248692+0000","last_peered":"2024-09-10T06:29:28.248692+0000","last_clean":"2024-09-10T06:29:28.248692+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:29:28.248692+0000","last_undegraded":"2024-09-10T06:29:28.248692+0000","last_fullsized":"2024-09-10T06:29:28.248692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:28.248480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:28.248480+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.248480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:25.157883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.375020+0000","last_change":"2024-09-10T06:29:38.375020+0000","last_active":"2024-09-10T06:29:38.375020+0000","last_peered":"2024-09-10T06:29:38.375020+0000","last_clean":"2024-09-10T06:29:38.375020+0000","last_became_active":"2024-09-10T06:26:34.272192+0000","last_became_peered":"2024-09-10T06:26:34.272192+0000","last_unstale":"2024-09-10T06:29:38.375020+0000","last_undegraded":"2024-09-10T06:29:38.375020+0000","last_fullsized":"2024-09-10T06:29:38.375020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:38.374854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:38.374854+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.374854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:02.446964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'14","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453060+0000","last_change":"2024-09-10T06:26:36.291431+0000","last_active":"2024-09-10T06:28:48.453060+0000","last_peered":"2024-09-10T06:28:48.453060+0000","last_clean":"2024-09-10T06:28:48.453060+0000","last_became_active":"2024-09-10T06:26:36.290570+0000","last_became_peered":"2024-09-10T06:26:36.290570+0000","last_unstale":"2024-09-10T06:28:48.453060+0000","last_undegraded":"2024-09-10T06:28:48.453060+0000","last_fullsized":"2024-09-10T06:28:48.453060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:43:10.565531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'105","reported_seq":286,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.321737+0000","last_change":"2024-09-10T06:26:38.312069+0000","last_active":"2024-09-10T06:29:17.321737+0000","last_peered":"2024-09-10T06:29:17.321737+0000","last_clean":"2024-09-10T06:29:17.321737+0000","last_became_active":"2024-09-10T06:26:38.310450+0000","last_became_peered":"2024-09-10T06:26:38.310450+0000","last_unstale":"2024-09-10T06:29:17.321737+0000","last_undegraded":"2024-09-10T06:29:17.321737+0000","last_fullsized":"2024-09-10T06:29:17.321737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379767+0000","last_change":"2024-09-10T06:26:40.312990+0000","last_active":"2024-09-10T06:28:48.379767+0000","last_peered":"2024-09-10T06:28:48.379767+0000","last_clean":"2024-09-10T06:28:48.379767+0000","last_became_active":"2024-09-10T06:26:40.312266+0000","last_became_peered":"2024-09-10T06:26:40.312266+0000","last_unstale":"2024-09-10T06:28:48.379767+0000","last_undegraded":"2024-09-10T06:28:48.379767+0000","last_fullsized":"2024-09-10T06:28:48.379767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:20:15.777105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"76'4","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.054582+0000","last_change":"2024-09-10T06:29:35.054582+0000","last_active":"2024-09-10T06:29:35.054582+0000","last_peered":"2024-09-10T06:29:35.054582+0000","last_clean":"2024-09-10T06:29:35.054582+0000","last_became_active":"2024-09-10T06:26:32.258337+0000","last_became_peered":"2024-09-10T06:26:32.258337+0000","last_unstale":"2024-09-10T06:29:35.054582+0000","last_undegraded":"2024-09-10T06:29:35.054582+0000","last_fullsized":"2024-09-10T06:29:35.054582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:35.054359+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:35.054359+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.054359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:50.284064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"95'16","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.067565+0000","last_change":"2024-09-10T06:29:24.067565+0000","last_active":"2024-09-10T06:29:24.067565+0000","last_peered":"2024-09-10T06:29:24.067565+0000","last_clean":"2024-09-10T06:29:24.067565+0000","last_became_active":"2024-09-10T06:26:30.581115+0000","last_became_peered":"2024-09-10T06:26:30.581115+0000","last_unstale":"2024-09-10T06:29:24.067565+0000","last_undegraded":"2024-09-10T06:29:24.067565+0000","last_fullsized":"2024-09-10T06:29:24.067565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:24.067500+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:24.067500+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.067500+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:15.114685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:21.800732+0000","last_change":"2024-09-10T06:29:21.800732+0000","last_active":"2024-09-10T06:29:21.800732+0000","last_peered":"2024-09-10T06:29:21.800732+0000","last_clean":"2024-09-10T06:29:21.800732+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:29:21.800732+0000","last_undegraded":"2024-09-10T06:29:21.800732+0000","last_fullsized":"2024-09-10T06:29:21.800732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:21.800559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:21.800559+0000","last_clean_scrub_stamp":"2024-09-10T06:29:21.800559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:01.214476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377381+0000","last_change":"2024-09-10T06:26:34.258956+0000","last_active":"2024-09-10T06:28:48.377381+0000","last_peered":"2024-09-10T06:28:48.377381+0000","last_clean":"2024-09-10T06:28:48.377381+0000","last_became_active":"2024-09-10T06:26:34.257739+0000","last_became_peered":"2024-09-10T06:26:34.257739+0000","last_unstale":"2024-09-10T06:28:48.377381+0000","last_undegraded":"2024-09-10T06:28:48.377381+0000","last_fullsized":"2024-09-10T06:28:48.377381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:18.547827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'10","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377884+0000","last_change":"2024-09-10T06:26:36.271096+0000","last_active":"2024-09-10T06:28:48.377884+0000","last_peered":"2024-09-10T06:28:48.377884+0000","last_clean":"2024-09-10T06:28:48.377884+0000","last_became_active":"2024-09-10T06:26:36.270325+0000","last_became_peered":"2024-09-10T06:26:36.270325+0000","last_unstale":"2024-09-10T06:28:48.377884+0000","last_undegraded":"2024-09-10T06:28:48.377884+0000","last_fullsized":"2024-09-10T06:28:48.377884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'105","reported_seq":272,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.328189+0000","last_change":"2024-09-10T06:26:38.300795+0000","last_active":"2024-09-10T06:29:17.328189+0000","last_peered":"2024-09-10T06:29:17.328189+0000","last_clean":"2024-09-10T06:29:17.328189+0000","last_became_active":"2024-09-10T06:26:38.299466+0000","last_became_peered":"2024-09-10T06:26:38.299466+0000","last_unstale":"2024-09-10T06:29:17.328189+0000","last_undegraded":"2024-09-10T06:29:17.328189+0000","last_fullsized":"2024-09-10T06:29:17.328189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:38.641500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"67'4","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377214+0000","last_change":"2024-09-10T06:26:40.329688+0000","last_active":"2024-09-10T06:28:48.377214+0000","last_peered":"2024-09-10T06:28:48.377214+0000","last_clean":"2024-09-10T06:28:48.377214+0000","last_became_active":"2024-09-10T06:26:40.329009+0000","last_became_peered":"2024-09-10T06:26:40.329009+0000","last_unstale":"2024-09-10T06:28:48.377214+0000","last_undegraded":"2024-09-10T06:28:48.377214+0000","last_fullsized":"2024-09-10T06:28:48.377214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:35.428848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'8","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.112413+0000","last_change":"2024-09-10T06:29:28.112413+0000","last_active":"2024-09-10T06:29:28.112413+0000","last_peered":"2024-09-10T06:29:28.112413+0000","last_clean":"2024-09-10T06:29:28.112413+0000","last_became_active":"2024-09-10T06:26:32.282794+0000","last_became_peered":"2024-09-10T06:26:32.282794+0000","last_unstale":"2024-09-10T06:29:28.112413+0000","last_undegraded":"2024-09-10T06:29:28.112413+0000","last_fullsized":"2024-09-10T06:29:28.112413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8","last_scrub_stamp":"2024-09-10T06:29:28.112223+0000","last_deep_scrub":"67'8","last_deep_scrub_stamp":"2024-09-10T06:29:28.112223+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.112223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:30.193309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'12","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:22.547386+0000","last_change":"2024-09-10T06:29:22.547386+0000","last_active":"2024-09-10T06:29:22.547386+0000","last_peered":"2024-09-10T06:29:22.547386+0000","last_clean":"2024-09-10T06:29:22.547386+0000","last_became_active":"2024-09-10T06:26:30.577985+0000","last_became_peered":"2024-09-10T06:26:30.577985+0000","last_unstale":"2024-09-10T06:29:22.547386+0000","last_undegraded":"2024-09-10T06:29:22.547386+0000","last_fullsized":"2024-09-10T06:29:22.547386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:22.547307+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:22.547307+0000","last_clean_scrub_stamp":"2024-09-10T06:29:22.547307+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:40.427930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.476396+0000","last_change":"2024-09-10T06:29:26.476396+0000","last_active":"2024-09-10T06:29:26.476396+0000","last_peered":"2024-09-10T06:29:26.476396+0000","last_clean":"2024-09-10T06:29:26.476396+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:29:26.476396+0000","last_undegraded":"2024-09-10T06:29:26.476396+0000","last_fullsized":"2024-09-10T06:29:26.476396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:26.476196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:26.476196+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.476196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:37.063867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374863+0000","last_change":"2024-09-10T06:26:34.268710+0000","last_active":"2024-09-10T06:28:48.374863+0000","last_peered":"2024-09-10T06:28:48.374863+0000","last_clean":"2024-09-10T06:28:48.374863+0000","last_became_active":"2024-09-10T06:26:34.268359+0000","last_became_peered":"2024-09-10T06:26:34.268359+0000","last_unstale":"2024-09-10T06:28:48.374863+0000","last_undegraded":"2024-09-10T06:28:48.374863+0000","last_fullsized":"2024-09-10T06:28:48.374863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:31:27.191787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"95'46","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.510298+0000","last_change":"2024-09-10T06:26:36.299700+0000","last_active":"2024-09-10T06:29:17.510298+0000","last_peered":"2024-09-10T06:29:17.510298+0000","last_clean":"2024-09-10T06:29:17.510298+0000","last_became_active":"2024-09-10T06:26:36.297606+0000","last_became_peered":"2024-09-10T06:26:36.297606+0000","last_unstale":"2024-09-10T06:29:17.510298+0000","last_undegraded":"2024-09-10T06:29:17.510298+0000","last_fullsized":"2024-09-10T06:29:17.510298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:51:53.200274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375382+0000","last_change":"2024-09-10T06:26:38.290601+0000","last_active":"2024-09-10T06:28:48.375382+0000","last_peered":"2024-09-10T06:28:48.375382+0000","last_clean":"2024-09-10T06:28:48.375382+0000","last_became_active":"2024-09-10T06:26:38.289589+0000","last_became_peered":"2024-09-10T06:26:38.289589+0000","last_unstale":"2024-09-10T06:28:48.375382+0000","last_undegraded":"2024-09-10T06:28:48.375382+0000","last_fullsized":"2024-09-10T06:28:48.375382+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:22.625936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458656+0000","last_change":"2024-09-10T06:26:40.332819+0000","last_active":"2024-09-10T06:28:48.458656+0000","last_peered":"2024-09-10T06:28:48.458656+0000","last_clean":"2024-09-10T06:28:48.458656+0000","last_became_active":"2024-09-10T06:26:40.332160+0000","last_became_peered":"2024-09-10T06:26:40.332160+0000","last_unstale":"2024-09-10T06:28:48.458656+0000","last_undegraded":"2024-09-10T06:28:48.458656+0000","last_fullsized":"2024-09-10T06:28:48.458656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:23:38.784870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378032+0000","last_change":"2024-09-10T06:26:40.334393+0000","last_active":"2024-09-10T06:28:48.378032+0000","last_peered":"2024-09-10T06:28:48.378032+0000","last_clean":"2024-09-10T06:28:48.378032+0000","last_became_active":"2024-09-10T06:26:40.333474+0000","last_became_peered":"2024-09-10T06:26:40.333474+0000","last_unstale":"2024-09-10T06:28:48.378032+0000","last_undegraded":"2024-09-10T06:28:48.378032+0000","last_fullsized":"2024-09-10T06:28:48.378032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:10:35.031954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'6","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.070380+0000","last_change":"2024-09-10T06:29:33.070380+0000","last_active":"2024-09-10T06:29:33.070380+0000","last_peered":"2024-09-10T06:29:33.070380+0000","last_clean":"2024-09-10T06:29:33.070380+0000","last_became_active":"2024-09-10T06:26:32.272178+0000","last_became_peered":"2024-09-10T06:26:32.272178+0000","last_unstale":"2024-09-10T06:29:33.070380+0000","last_undegraded":"2024-09-10T06:29:33.070380+0000","last_fullsized":"2024-09-10T06:29:33.070380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2024-09-10T06:29:33.070110+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2024-09-10T06:29:33.070110+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.070110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:35:34.270223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"95'16","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.085643+0000","last_change":"2024-09-10T06:29:24.085643+0000","last_active":"2024-09-10T06:29:24.085643+0000","last_peered":"2024-09-10T06:29:24.085643+0000","last_clean":"2024-09-10T06:29:24.085643+0000","last_became_active":"2024-09-10T06:26:30.592753+0000","last_became_peered":"2024-09-10T06:26:30.592753+0000","last_unstale":"2024-09-10T06:29:24.085643+0000","last_undegraded":"2024-09-10T06:29:24.085643+0000","last_fullsized":"2024-09-10T06:29:24.085643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:24.085456+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:24.085456+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.085456+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:15.979005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453697+0000","last_change":"2024-09-10T06:26:34.282877+0000","last_active":"2024-09-10T06:28:48.453697+0000","last_peered":"2024-09-10T06:28:48.453697+0000","last_clean":"2024-09-10T06:28:48.453697+0000","last_became_active":"2024-09-10T06:26:34.282281+0000","last_became_peered":"2024-09-10T06:26:34.282281+0000","last_unstale":"2024-09-10T06:28:48.453697+0000","last_undegraded":"2024-09-10T06:28:48.453697+0000","last_fullsized":"2024-09-10T06:28:48.453697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:26:41.449174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"95'20","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.737305+0000","last_change":"2024-09-10T06:26:36.273166+0000","last_active":"2024-09-10T06:29:17.737305+0000","last_peered":"2024-09-10T06:29:17.737305+0000","last_clean":"2024-09-10T06:29:17.737305+0000","last_became_active":"2024-09-10T06:26:36.272386+0000","last_became_peered":"2024-09-10T06:26:36.272386+0000","last_unstale":"2024-09-10T06:29:17.737305+0000","last_undegraded":"2024-09-10T06:29:17.737305+0000","last_fullsized":"2024-09-10T06:29:17.737305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:21:03.305283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374570+0000","last_change":"2024-09-10T06:26:38.297347+0000","last_active":"2024-09-10T06:28:48.374570+0000","last_peered":"2024-09-10T06:28:48.374570+0000","last_clean":"2024-09-10T06:28:48.374570+0000","last_became_active":"2024-09-10T06:26:38.296600+0000","last_became_peered":"2024-09-10T06:26:38.296600+0000","last_unstale":"2024-09-10T06:28:48.374570+0000","last_undegraded":"2024-09-10T06:28:48.374570+0000","last_fullsized":"2024-09-10T06:28:48.374570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:25:08.758126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"67'20","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379025+0000","last_change":"2024-09-10T06:26:40.321844+0000","last_active":"2024-09-10T06:28:48.379025+0000","last_peered":"2024-09-10T06:28:48.379025+0000","last_clean":"2024-09-10T06:28:48.379025+0000","last_became_active":"2024-09-10T06:26:40.321097+0000","last_became_peered":"2024-09-10T06:26:40.321097+0000","last_unstale":"2024-09-10T06:28:48.379025+0000","last_undegraded":"2024-09-10T06:28:48.379025+0000","last_fullsized":"2024-09-10T06:28:48.379025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:10.004849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"67'6","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.672747+0000","last_change":"2024-09-10T06:29:33.672747+0000","last_active":"2024-09-10T06:29:33.672747+0000","last_peered":"2024-09-10T06:29:33.672747+0000","last_clean":"2024-09-10T06:29:33.672747+0000","last_became_active":"2024-09-10T06:26:32.286519+0000","last_became_peered":"2024-09-10T06:26:32.286519+0000","last_unstale":"2024-09-10T06:29:33.672747+0000","last_undegraded":"2024-09-10T06:29:33.672747+0000","last_fullsized":"2024-09-10T06:29:33.672747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T06:29:33.672546+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T06:29:33.672546+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.672546+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:42.478459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"95'12","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.328207+0000","last_change":"2024-09-10T06:29:33.328207+0000","last_active":"2024-09-10T06:29:33.328207+0000","last_peered":"2024-09-10T06:29:33.328207+0000","last_clean":"2024-09-10T06:29:33.328207+0000","last_became_active":"2024-09-10T06:26:30.586611+0000","last_became_peered":"2024-09-10T06:26:30.586611+0000","last_unstale":"2024-09-10T06:29:33.328207+0000","last_undegraded":"2024-09-10T06:29:33.328207+0000","last_fullsized":"2024-09-10T06:29:33.328207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:33.328008+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:33.328008+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.328008+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:10.166985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"27'1","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.278125+0000","last_change":"2024-09-10T06:26:34.271770+0000","last_active":"2024-09-10T06:29:17.278125+0000","last_peered":"2024-09-10T06:29:17.278125+0000","last_clean":"2024-09-10T06:29:17.278125+0000","last_became_active":"2024-09-10T06:26:34.269875+0000","last_became_peered":"2024-09-10T06:26:34.269875+0000","last_unstale":"2024-09-10T06:29:17.278125+0000","last_undegraded":"2024-09-10T06:29:17.278125+0000","last_fullsized":"2024-09-10T06:29:17.278125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:57:09.570079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"67'6","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375286+0000","last_change":"2024-09-10T06:26:36.289140+0000","last_active":"2024-09-10T06:28:48.375286+0000","last_peered":"2024-09-10T06:28:48.375286+0000","last_clean":"2024-09-10T06:28:48.375286+0000","last_became_active":"2024-09-10T06:26:36.288355+0000","last_became_peered":"2024-09-10T06:26:36.288355+0000","last_unstale":"2024-09-10T06:28:48.375286+0000","last_undegraded":"2024-09-10T06:28:48.375286+0000","last_fullsized":"2024-09-10T06:28:48.375286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:42.518982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456930+0000","last_change":"2024-09-10T06:26:38.302040+0000","last_active":"2024-09-10T06:28:48.456930+0000","last_peered":"2024-09-10T06:28:48.456930+0000","last_clean":"2024-09-10T06:28:48.456930+0000","last_became_active":"2024-09-10T06:26:38.301064+0000","last_became_peered":"2024-09-10T06:26:38.301064+0000","last_unstale":"2024-09-10T06:28:48.456930+0000","last_undegraded":"2024-09-10T06:28:48.456930+0000","last_fullsized":"2024-09-10T06:28:48.456930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:41.513255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"64'4","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.377597+0000","last_change":"2024-09-10T06:26:40.322368+0000","last_active":"2024-09-10T06:28:48.377597+0000","last_peered":"2024-09-10T06:28:48.377597+0000","last_clean":"2024-09-10T06:28:48.377597+0000","last_became_active":"2024-09-10T06:26:40.321592+0000","last_became_peered":"2024-09-10T06:26:40.321592+0000","last_unstale":"2024-09-10T06:28:48.377597+0000","last_undegraded":"2024-09-10T06:28:48.377597+0000","last_fullsized":"2024-09-10T06:28:48.377597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:03.809744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"61'4","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.090925+0000","last_change":"2024-09-10T06:29:32.090925+0000","last_active":"2024-09-10T06:29:32.090925+0000","last_peered":"2024-09-10T06:29:32.090925+0000","last_clean":"2024-09-10T06:29:32.090925+0000","last_became_active":"2024-09-10T06:26:32.258775+0000","last_became_peered":"2024-09-10T06:26:32.258775+0000","last_unstale":"2024-09-10T06:29:32.090925+0000","last_undegraded":"2024-09-10T06:29:32.090925+0000","last_fullsized":"2024-09-10T06:29:32.090925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'4","last_scrub_stamp":"2024-09-10T06:29:32.090697+0000","last_deep_scrub":"61'4","last_deep_scrub_stamp":"2024-09-10T06:29:32.090697+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.090697+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:44.035503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"95'24","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.352352+0000","last_change":"2024-09-10T06:29:26.352352+0000","last_active":"2024-09-10T06:29:26.352352+0000","last_peered":"2024-09-10T06:29:26.352352+0000","last_clean":"2024-09-10T06:29:26.352352+0000","last_became_active":"2024-09-10T06:26:30.590566+0000","last_became_peered":"2024-09-10T06:26:30.590566+0000","last_unstale":"2024-09-10T06:29:26.352352+0000","last_undegraded":"2024-09-10T06:29:26.352352+0000","last_fullsized":"2024-09-10T06:29:26.352352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:26.352136+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:26.352136+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.352136+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:03.191113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":32,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455138+0000","last_change":"2024-09-10T06:26:34.281690+0000","last_active":"2024-09-10T06:28:48.455138+0000","last_peered":"2024-09-10T06:28:48.455138+0000","last_clean":"2024-09-10T06:28:48.455138+0000","last_became_active":"2024-09-10T06:26:34.281008+0000","last_became_peered":"2024-09-10T06:26:34.281008+0000","last_unstale":"2024-09-10T06:28:48.455138+0000","last_undegraded":"2024-09-10T06:28:48.455138+0000","last_fullsized":"2024-09-10T06:28:48.455138+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:22:18.879041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"95'20","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.472823+0000","last_change":"2024-09-10T06:26:36.277028+0000","last_active":"2024-09-10T06:29:17.472823+0000","last_peered":"2024-09-10T06:29:17.472823+0000","last_clean":"2024-09-10T06:29:17.472823+0000","last_became_active":"2024-09-10T06:26:36.276248+0000","last_became_peered":"2024-09-10T06:26:36.276248+0000","last_unstale":"2024-09-10T06:29:17.472823+0000","last_undegraded":"2024-09-10T06:29:17.472823+0000","last_fullsized":"2024-09-10T06:29:17.472823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:53.521681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.457566+0000","last_change":"2024-09-10T06:28:46.344566+0000","last_active":"2024-09-10T06:28:48.457566+0000","last_peered":"2024-09-10T06:28:48.457566+0000","last_clean":"2024-09-10T06:28:48.457566+0000","last_became_active":"2024-09-10T06:28:46.343657+0000","last_became_peered":"2024-09-10T06:28:46.343657+0000","last_unstale":"2024-09-10T06:28:48.457566+0000","last_undegraded":"2024-09-10T06:28:48.457566+0000","last_fullsized":"2024-09-10T06:28:48.457566+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:45:25.681176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.460858+0000","last_change":"2024-09-10T06:26:40.331445+0000","last_active":"2024-09-10T06:28:48.460858+0000","last_peered":"2024-09-10T06:28:48.460858+0000","last_clean":"2024-09-10T06:28:48.460858+0000","last_became_active":"2024-09-10T06:26:40.330707+0000","last_became_peered":"2024-09-10T06:26:40.330707+0000","last_unstale":"2024-09-10T06:28:48.460858+0000","last_undegraded":"2024-09-10T06:28:48.460858+0000","last_fullsized":"2024-09-10T06:28:48.460858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:45:37.822687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375781+0000","last_change":"2024-09-10T06:26:32.266221+0000","last_active":"2024-09-10T06:28:48.375781+0000","last_peered":"2024-09-10T06:28:48.375781+0000","last_clean":"2024-09-10T06:28:48.375781+0000","last_became_active":"2024-09-10T06:26:32.265705+0000","last_became_peered":"2024-09-10T06:26:32.265705+0000","last_unstale":"2024-09-10T06:28:48.375781+0000","last_undegraded":"2024-09-10T06:28:48.375781+0000","last_fullsized":"2024-09-10T06:28:48.375781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:24:37.199962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"95'18","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.575589+0000","last_change":"2024-09-10T06:29:24.575589+0000","last_active":"2024-09-10T06:29:24.575589+0000","last_peered":"2024-09-10T06:29:24.575589+0000","last_clean":"2024-09-10T06:29:24.575589+0000","last_became_active":"2024-09-10T06:26:30.593326+0000","last_became_peered":"2024-09-10T06:26:30.593326+0000","last_unstale":"2024-09-10T06:29:24.575589+0000","last_undegraded":"2024-09-10T06:29:24.575589+0000","last_fullsized":"2024-09-10T06:29:24.575589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:24.575459+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:24.575459+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.575459+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:21.110383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.382052+0000","last_change":"2024-09-10T06:29:39.382052+0000","last_active":"2024-09-10T06:29:39.382052+0000","last_peered":"2024-09-10T06:29:39.382052+0000","last_clean":"2024-09-10T06:29:39.382052+0000","last_became_active":"2024-09-10T06:26:34.281147+0000","last_became_peered":"2024-09-10T06:26:34.281147+0000","last_unstale":"2024-09-10T06:29:39.382052+0000","last_undegraded":"2024-09-10T06:29:39.382052+0000","last_fullsized":"2024-09-10T06:29:39.382052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:39.381863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:39.381863+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.381863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:14.041644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"95'18","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.439882+0000","last_change":"2024-09-10T06:26:36.298537+0000","last_active":"2024-09-10T06:29:17.439882+0000","last_peered":"2024-09-10T06:29:17.439882+0000","last_clean":"2024-09-10T06:29:17.439882+0000","last_became_active":"2024-09-10T06:26:36.297372+0000","last_became_peered":"2024-09-10T06:26:36.297372+0000","last_unstale":"2024-09-10T06:29:17.439882+0000","last_undegraded":"2024-09-10T06:29:17.439882+0000","last_fullsized":"2024-09-10T06:29:17.439882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376070+0000","last_change":"2024-09-10T06:26:38.301461+0000","last_active":"2024-09-10T06:28:48.376070+0000","last_peered":"2024-09-10T06:28:48.376070+0000","last_clean":"2024-09-10T06:28:48.376070+0000","last_became_active":"2024-09-10T06:26:38.300580+0000","last_became_peered":"2024-09-10T06:26:38.300580+0000","last_unstale":"2024-09-10T06:28:48.376070+0000","last_undegraded":"2024-09-10T06:28:48.376070+0000","last_fullsized":"2024-09-10T06:28:48.376070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:36:50.547953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"67'10","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.421377+0000","last_change":"2024-09-10T06:29:35.421377+0000","last_active":"2024-09-10T06:29:35.421377+0000","last_peered":"2024-09-10T06:29:35.421377+0000","last_clean":"2024-09-10T06:29:35.421377+0000","last_became_active":"2024-09-10T06:26:32.284457+0000","last_became_peered":"2024-09-10T06:26:32.284457+0000","last_unstale":"2024-09-10T06:29:35.421377+0000","last_undegraded":"2024-09-10T06:29:35.421377+0000","last_fullsized":"2024-09-10T06:29:35.421377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T06:29:35.421160+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T06:29:35.421160+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.421160+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:45.636212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"95'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.149600+0000","last_change":"2024-09-10T06:29:29.149600+0000","last_active":"2024-09-10T06:29:29.149600+0000","last_peered":"2024-09-10T06:29:29.149600+0000","last_clean":"2024-09-10T06:29:29.149600+0000","last_became_active":"2024-09-10T06:26:30.571377+0000","last_became_peered":"2024-09-10T06:26:30.571377+0000","last_unstale":"2024-09-10T06:29:29.149600+0000","last_undegraded":"2024-09-10T06:29:29.149600+0000","last_fullsized":"2024-09-10T06:29:29.149600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:29.149420+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:29.149420+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.149420+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:30.977630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.378936+0000","last_change":"2024-09-10T06:26:34.269013+0000","last_active":"2024-09-10T06:28:48.378936+0000","last_peered":"2024-09-10T06:28:48.378936+0000","last_clean":"2024-09-10T06:28:48.378936+0000","last_became_active":"2024-09-10T06:26:34.268677+0000","last_became_peered":"2024-09-10T06:26:34.268677+0000","last_unstale":"2024-09-10T06:28:48.378936+0000","last_undegraded":"2024-09-10T06:28:48.378936+0000","last_fullsized":"2024-09-10T06:28:48.378936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:24.235006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"95'30","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.782628+0000","last_change":"2024-09-10T06:26:36.300362+0000","last_active":"2024-09-10T06:29:17.782628+0000","last_peered":"2024-09-10T06:29:17.782628+0000","last_clean":"2024-09-10T06:29:17.782628+0000","last_became_active":"2024-09-10T06:26:36.299645+0000","last_became_peered":"2024-09-10T06:26:36.299645+0000","last_unstale":"2024-09-10T06:29:17.782628+0000","last_undegraded":"2024-09-10T06:29:17.782628+0000","last_fullsized":"2024-09-10T06:29:17.782628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:17.424354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.461312+0000","last_change":"2024-09-10T06:26:38.299751+0000","last_active":"2024-09-10T06:28:48.461312+0000","last_peered":"2024-09-10T06:28:48.461312+0000","last_clean":"2024-09-10T06:28:48.461312+0000","last_became_active":"2024-09-10T06:26:38.298414+0000","last_became_peered":"2024-09-10T06:26:38.298414+0000","last_unstale":"2024-09-10T06:28:48.461312+0000","last_undegraded":"2024-09-10T06:28:48.461312+0000","last_fullsized":"2024-09-10T06:28:48.461312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:49:39.136844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'2","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375129+0000","last_change":"2024-09-10T06:26:40.312752+0000","last_active":"2024-09-10T06:28:48.375129+0000","last_peered":"2024-09-10T06:28:48.375129+0000","last_clean":"2024-09-10T06:28:48.375129+0000","last_became_active":"2024-09-10T06:26:40.312026+0000","last_became_peered":"2024-09-10T06:26:40.312026+0000","last_unstale":"2024-09-10T06:28:48.375129+0000","last_undegraded":"2024-09-10T06:28:48.375129+0000","last_fullsized":"2024-09-10T06:28:48.375129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:50.071224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.556968+0000","last_change":"2024-09-10T06:29:35.556968+0000","last_active":"2024-09-10T06:29:35.556968+0000","last_peered":"2024-09-10T06:29:35.556968+0000","last_clean":"2024-09-10T06:29:35.556968+0000","last_became_active":"2024-09-10T06:26:32.266682+0000","last_became_peered":"2024-09-10T06:26:32.266682+0000","last_unstale":"2024-09-10T06:29:35.556968+0000","last_undegraded":"2024-09-10T06:29:35.556968+0000","last_fullsized":"2024-09-10T06:29:35.556968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:35.556785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:35.556785+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.556785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:52.129101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'28","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.729826+0000","last_change":"2024-09-10T06:29:25.729826+0000","last_active":"2024-09-10T06:29:25.729826+0000","last_peered":"2024-09-10T06:29:25.729826+0000","last_clean":"2024-09-10T06:29:25.729826+0000","last_became_active":"2024-09-10T06:26:30.578692+0000","last_became_peered":"2024-09-10T06:26:30.578692+0000","last_unstale":"2024-09-10T06:29:25.729826+0000","last_undegraded":"2024-09-10T06:29:25.729826+0000","last_fullsized":"2024-09-10T06:29:25.729826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'28","last_scrub_stamp":"2024-09-10T06:29:25.729659+0000","last_deep_scrub":"95'28","last_deep_scrub_stamp":"2024-09-10T06:29:25.729659+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.729659+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:17.803992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":36,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"95'2","reported_seq":223,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.384665+0000","last_change":"2024-09-10T06:29:40.384665+0000","last_active":"2024-09-10T06:29:40.384665+0000","last_peered":"2024-09-10T06:29:40.384665+0000","last_clean":"2024-09-10T06:29:40.384665+0000","last_became_active":"2024-09-10T06:26:34.281167+0000","last_became_peered":"2024-09-10T06:26:34.281167+0000","last_unstale":"2024-09-10T06:29:40.384665+0000","last_undegraded":"2024-09-10T06:29:40.384665+0000","last_fullsized":"2024-09-10T06:29:40.384665+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-10T06:29:40.384488+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-10T06:29:40.384488+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.384488+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:40.370647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"95'26","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.456999+0000","last_change":"2024-09-10T06:26:36.301277+0000","last_active":"2024-09-10T06:29:17.456999+0000","last_peered":"2024-09-10T06:29:17.456999+0000","last_clean":"2024-09-10T06:29:17.456999+0000","last_became_active":"2024-09-10T06:26:36.300501+0000","last_became_peered":"2024-09-10T06:26:36.300501+0000","last_unstale":"2024-09-10T06:29:17.456999+0000","last_undegraded":"2024-09-10T06:29:17.456999+0000","last_fullsized":"2024-09-10T06:29:17.456999+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:38.477946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454339+0000","last_change":"2024-09-10T06:26:38.305737+0000","last_active":"2024-09-10T06:28:48.454339+0000","last_peered":"2024-09-10T06:28:48.454339+0000","last_clean":"2024-09-10T06:28:48.454339+0000","last_became_active":"2024-09-10T06:26:38.303318+0000","last_became_peered":"2024-09-10T06:26:38.303318+0000","last_unstale":"2024-09-10T06:28:48.454339+0000","last_undegraded":"2024-09-10T06:28:48.454339+0000","last_fullsized":"2024-09-10T06:28:48.454339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:28:52.587622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"67'10","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458108+0000","last_change":"2024-09-10T06:26:40.318587+0000","last_active":"2024-09-10T06:28:48.458108+0000","last_peered":"2024-09-10T06:28:48.458108+0000","last_clean":"2024-09-10T06:28:48.458108+0000","last_became_active":"2024-09-10T06:26:40.317695+0000","last_became_peered":"2024-09-10T06:26:40.317695+0000","last_unstale":"2024-09-10T06:28:48.458108+0000","last_undegraded":"2024-09-10T06:28:48.458108+0000","last_fullsized":"2024-09-10T06:28:48.458108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:48.298686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.900641+0000","last_change":"2024-09-10T06:29:38.900641+0000","last_active":"2024-09-10T06:29:38.900641+0000","last_peered":"2024-09-10T06:29:38.900641+0000","last_clean":"2024-09-10T06:29:38.900641+0000","last_became_active":"2024-09-10T06:26:32.275805+0000","last_became_peered":"2024-09-10T06:26:32.275805+0000","last_unstale":"2024-09-10T06:29:38.900641+0000","last_undegraded":"2024-09-10T06:29:38.900641+0000","last_fullsized":"2024-09-10T06:29:38.900641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:38.900412+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:38.900412+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.900412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:18.879138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"95'14","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.038073+0000","last_change":"2024-09-10T06:29:26.038073+0000","last_active":"2024-09-10T06:29:26.038073+0000","last_peered":"2024-09-10T06:29:26.038073+0000","last_clean":"2024-09-10T06:29:26.038073+0000","last_became_active":"2024-09-10T06:26:30.567937+0000","last_became_peered":"2024-09-10T06:26:30.567937+0000","last_unstale":"2024-09-10T06:29:26.038073+0000","last_undegraded":"2024-09-10T06:29:26.038073+0000","last_fullsized":"2024-09-10T06:29:26.038073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:26.037883+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:26.037883+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.037883+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:00.697665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.380895+0000","last_change":"2024-09-10T06:26:34.266227+0000","last_active":"2024-09-10T06:28:48.380895+0000","last_peered":"2024-09-10T06:28:48.380895+0000","last_clean":"2024-09-10T06:28:48.380895+0000","last_became_active":"2024-09-10T06:26:34.262443+0000","last_became_peered":"2024-09-10T06:26:34.262443+0000","last_unstale":"2024-09-10T06:28:48.380895+0000","last_undegraded":"2024-09-10T06:28:48.380895+0000","last_fullsized":"2024-09-10T06:28:48.380895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:13:35.918813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"95'21","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.775723+0000","last_change":"2024-09-10T06:26:36.292958+0000","last_active":"2024-09-10T06:29:17.775723+0000","last_peered":"2024-09-10T06:29:17.775723+0000","last_clean":"2024-09-10T06:29:17.775723+0000","last_became_active":"2024-09-10T06:26:36.292149+0000","last_became_peered":"2024-09-10T06:26:36.292149+0000","last_unstale":"2024-09-10T06:29:17.775723+0000","last_undegraded":"2024-09-10T06:29:17.775723+0000","last_fullsized":"2024-09-10T06:29:17.775723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:26:13.960693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.453832+0000","last_change":"2024-09-10T06:26:38.302991+0000","last_active":"2024-09-10T06:28:48.453832+0000","last_peered":"2024-09-10T06:28:48.453832+0000","last_clean":"2024-09-10T06:28:48.453832+0000","last_became_active":"2024-09-10T06:26:38.289306+0000","last_became_peered":"2024-09-10T06:26:38.289306+0000","last_unstale":"2024-09-10T06:28:48.453832+0000","last_undegraded":"2024-09-10T06:28:48.453832+0000","last_fullsized":"2024-09-10T06:28:48.453832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:57.625329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456492+0000","last_change":"2024-09-10T06:26:40.327627+0000","last_active":"2024-09-10T06:28:48.456492+0000","last_peered":"2024-09-10T06:28:48.456492+0000","last_clean":"2024-09-10T06:28:48.456492+0000","last_became_active":"2024-09-10T06:26:40.326888+0000","last_became_peered":"2024-09-10T06:26:40.326888+0000","last_unstale":"2024-09-10T06:28:48.456492+0000","last_undegraded":"2024-09-10T06:28:48.456492+0000","last_fullsized":"2024-09-10T06:28:48.456492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:00:41.122562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.534235+0000","last_change":"2024-09-10T06:29:28.534235+0000","last_active":"2024-09-10T06:29:28.534235+0000","last_peered":"2024-09-10T06:29:28.534235+0000","last_clean":"2024-09-10T06:29:28.534235+0000","last_became_active":"2024-09-10T06:26:32.274395+0000","last_became_peered":"2024-09-10T06:26:32.274395+0000","last_unstale":"2024-09-10T06:29:28.534235+0000","last_undegraded":"2024-09-10T06:29:28.534235+0000","last_fullsized":"2024-09-10T06:29:28.534235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-10T06:29:28.533919+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-10T06:29:28.533919+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.533919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:34:22.535590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"95'14","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.586596+0000","last_change":"2024-09-10T06:29:25.586596+0000","last_active":"2024-09-10T06:29:25.586596+0000","last_peered":"2024-09-10T06:29:25.586596+0000","last_clean":"2024-09-10T06:29:25.586596+0000","last_became_active":"2024-09-10T06:26:30.594058+0000","last_became_peered":"2024-09-10T06:26:30.594058+0000","last_unstale":"2024-09-10T06:29:25.586596+0000","last_undegraded":"2024-09-10T06:29:25.586596+0000","last_fullsized":"2024-09-10T06:29:25.586596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:25.586401+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:25.586401+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.586401+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:32.336377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.454445+0000","last_change":"2024-09-10T06:26:34.279538+0000","last_active":"2024-09-10T06:28:48.454445+0000","last_peered":"2024-09-10T06:28:48.454445+0000","last_clean":"2024-09-10T06:28:48.454445+0000","last_became_active":"2024-09-10T06:26:34.278871+0000","last_became_peered":"2024-09-10T06:26:34.278871+0000","last_unstale":"2024-09-10T06:28:48.454445+0000","last_undegraded":"2024-09-10T06:28:48.454445+0000","last_fullsized":"2024-09-10T06:28:48.454445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:03:13.203357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"71'12","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379969+0000","last_change":"2024-09-10T06:26:36.290976+0000","last_active":"2024-09-10T06:28:48.379969+0000","last_peered":"2024-09-10T06:28:48.379969+0000","last_clean":"2024-09-10T06:28:48.379969+0000","last_became_active":"2024-09-10T06:26:36.290265+0000","last_became_peered":"2024-09-10T06:26:36.290265+0000","last_unstale":"2024-09-10T06:28:48.379969+0000","last_undegraded":"2024-09-10T06:28:48.379969+0000","last_fullsized":"2024-09-10T06:28:48.379969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'105","reported_seq":274,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.319705+0000","last_change":"2024-09-10T06:26:38.292031+0000","last_active":"2024-09-10T06:29:17.319705+0000","last_peered":"2024-09-10T06:29:17.319705+0000","last_clean":"2024-09-10T06:29:17.319705+0000","last_became_active":"2024-09-10T06:26:38.288791+0000","last_became_peered":"2024-09-10T06:26:38.288791+0000","last_unstale":"2024-09-10T06:29:17.319705+0000","last_undegraded":"2024-09-10T06:29:17.319705+0000","last_fullsized":"2024-09-10T06:29:17.319705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:07.830355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"76'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.455098+0000","last_change":"2024-09-10T06:26:40.336448+0000","last_active":"2024-09-10T06:28:48.455098+0000","last_peered":"2024-09-10T06:28:48.455098+0000","last_clean":"2024-09-10T06:28:48.455098+0000","last_became_active":"2024-09-10T06:26:40.335771+0000","last_became_peered":"2024-09-10T06:26:40.335771+0000","last_unstale":"2024-09-10T06:28:48.455098+0000","last_undegraded":"2024-09-10T06:28:48.455098+0000","last_fullsized":"2024-09-10T06:28:48.455098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:28.778844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.077261+0000","last_change":"2024-09-10T06:29:36.077261+0000","last_active":"2024-09-10T06:29:36.077261+0000","last_peered":"2024-09-10T06:29:36.077261+0000","last_clean":"2024-09-10T06:29:36.077261+0000","last_became_active":"2024-09-10T06:26:32.261250+0000","last_became_peered":"2024-09-10T06:26:32.261250+0000","last_unstale":"2024-09-10T06:29:36.077261+0000","last_undegraded":"2024-09-10T06:29:36.077261+0000","last_fullsized":"2024-09-10T06:29:36.077261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:36.077082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:36.077082+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.077082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:34.084912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"95'16","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.341624+0000","last_change":"2024-09-10T06:29:28.341624+0000","last_active":"2024-09-10T06:29:28.341624+0000","last_peered":"2024-09-10T06:29:28.341624+0000","last_clean":"2024-09-10T06:29:28.341624+0000","last_became_active":"2024-09-10T06:26:30.603175+0000","last_became_peered":"2024-09-10T06:26:30.603175+0000","last_unstale":"2024-09-10T06:29:28.341624+0000","last_undegraded":"2024-09-10T06:29:28.341624+0000","last_fullsized":"2024-09-10T06:29:28.341624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:28.341424+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:28.341424+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.341424+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:41.882711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.458290+0000","last_change":"2024-09-10T06:26:34.286028+0000","last_active":"2024-09-10T06:28:48.458290+0000","last_peered":"2024-09-10T06:28:48.458290+0000","last_clean":"2024-09-10T06:28:48.458290+0000","last_became_active":"2024-09-10T06:26:34.285169+0000","last_became_peered":"2024-09-10T06:26:34.285169+0000","last_unstale":"2024-09-10T06:28:48.458290+0000","last_undegraded":"2024-09-10T06:28:48.458290+0000","last_fullsized":"2024-09-10T06:28:48.458290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:24.146088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"95'24","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.913573+0000","last_change":"2024-09-10T06:26:36.292679+0000","last_active":"2024-09-10T06:29:17.913573+0000","last_peered":"2024-09-10T06:29:17.913573+0000","last_clean":"2024-09-10T06:29:17.913573+0000","last_became_active":"2024-09-10T06:26:36.288780+0000","last_became_peered":"2024-09-10T06:26:36.288780+0000","last_unstale":"2024-09-10T06:29:17.913573+0000","last_undegraded":"2024-09-10T06:29:17.913573+0000","last_fullsized":"2024-09-10T06:29:17.913573+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:13:34.701629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.374709+0000","last_change":"2024-09-10T06:26:38.293015+0000","last_active":"2024-09-10T06:28:48.374709+0000","last_peered":"2024-09-10T06:28:48.374709+0000","last_clean":"2024-09-10T06:28:48.374709+0000","last_became_active":"2024-09-10T06:26:38.292185+0000","last_became_peered":"2024-09-10T06:26:38.292185+0000","last_unstale":"2024-09-10T06:28:48.374709+0000","last_undegraded":"2024-09-10T06:28:48.374709+0000","last_fullsized":"2024-09-10T06:28:48.374709+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:12:32.694777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"64'10","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.464937+0000","last_change":"2024-09-10T06:26:40.336074+0000","last_active":"2024-09-10T06:28:48.464937+0000","last_peered":"2024-09-10T06:28:48.464937+0000","last_clean":"2024-09-10T06:28:48.464937+0000","last_became_active":"2024-09-10T06:26:40.335339+0000","last_became_peered":"2024-09-10T06:26:40.335339+0000","last_unstale":"2024-09-10T06:28:48.464937+0000","last_undegraded":"2024-09-10T06:28:48.464937+0000","last_fullsized":"2024-09-10T06:28:48.464937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:22.062237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"76'4","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.087554+0000","last_change":"2024-09-10T06:29:35.087554+0000","last_active":"2024-09-10T06:29:35.087554+0000","last_peered":"2024-09-10T06:29:35.087554+0000","last_clean":"2024-09-10T06:29:35.087554+0000","last_became_active":"2024-09-10T06:26:32.262041+0000","last_became_peered":"2024-09-10T06:26:32.262041+0000","last_unstale":"2024-09-10T06:29:35.087554+0000","last_undegraded":"2024-09-10T06:29:35.087554+0000","last_fullsized":"2024-09-10T06:29:35.087554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:35.087363+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:35.087363+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.087363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:40.057300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"95'14","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:22.516504+0000","last_change":"2024-09-10T06:29:22.516444+0000","last_active":"2024-09-10T06:29:22.516504+0000","last_peered":"2024-09-10T06:29:22.516504+0000","last_clean":"2024-09-10T06:29:22.516504+0000","last_became_active":"2024-09-10T06:27:08.868399+0000","last_became_peered":"2024-09-10T06:27:08.868399+0000","last_unstale":"2024-09-10T06:29:22.516504+0000","last_undegraded":"2024-09-10T06:29:22.516504+0000","last_fullsized":"2024-09-10T06:29:22.516504+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:22.516374+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:22.516374+0000","last_clean_scrub_stamp":"2024-09-10T06:29:22.516374+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:49.935970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.459883+0000","last_change":"2024-09-10T06:26:34.282651+0000","last_active":"2024-09-10T06:28:48.459883+0000","last_peered":"2024-09-10T06:28:48.459883+0000","last_clean":"2024-09-10T06:28:48.459883+0000","last_became_active":"2024-09-10T06:26:34.281777+0000","last_became_peered":"2024-09-10T06:26:34.281777+0000","last_unstale":"2024-09-10T06:28:48.459883+0000","last_undegraded":"2024-09-10T06:28:48.459883+0000","last_fullsized":"2024-09-10T06:28:48.459883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:42.268943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"95'18","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.916486+0000","last_change":"2024-09-10T06:26:36.285192+0000","last_active":"2024-09-10T06:29:17.916486+0000","last_peered":"2024-09-10T06:29:17.916486+0000","last_clean":"2024-09-10T06:29:17.916486+0000","last_became_active":"2024-09-10T06:26:36.284470+0000","last_became_peered":"2024-09-10T06:26:36.284470+0000","last_unstale":"2024-09-10T06:29:17.916486+0000","last_undegraded":"2024-09-10T06:29:17.916486+0000","last_fullsized":"2024-09-10T06:29:17.916486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:13:44.280458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.456932+0000","last_change":"2024-09-10T06:26:38.303425+0000","last_active":"2024-09-10T06:28:48.456932+0000","last_peered":"2024-09-10T06:28:48.456932+0000","last_clean":"2024-09-10T06:28:48.456932+0000","last_became_active":"2024-09-10T06:26:38.302606+0000","last_became_peered":"2024-09-10T06:26:38.302606+0000","last_unstale":"2024-09-10T06:28:48.456932+0000","last_undegraded":"2024-09-10T06:28:48.456932+0000","last_fullsized":"2024-09-10T06:28:48.456932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:23:14.055228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"76'13","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379260+0000","last_change":"2024-09-10T06:26:40.311253+0000","last_active":"2024-09-10T06:28:48.379260+0000","last_peered":"2024-09-10T06:28:48.379260+0000","last_clean":"2024-09-10T06:28:48.379260+0000","last_became_active":"2024-09-10T06:26:40.310414+0000","last_became_peered":"2024-09-10T06:26:40.310414+0000","last_unstale":"2024-09-10T06:28:48.379260+0000","last_undegraded":"2024-09-10T06:28:48.379260+0000","last_fullsized":"2024-09-10T06:28:48.379260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:20.868195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.087455+0000","last_change":"2024-09-10T06:29:33.087455+0000","last_active":"2024-09-10T06:29:33.087455+0000","last_peered":"2024-09-10T06:29:33.087455+0000","last_clean":"2024-09-10T06:29:33.087455+0000","last_became_active":"2024-09-10T06:26:32.262469+0000","last_became_peered":"2024-09-10T06:26:32.262469+0000","last_unstale":"2024-09-10T06:29:33.087455+0000","last_undegraded":"2024-09-10T06:29:33.087455+0000","last_fullsized":"2024-09-10T06:29:33.087455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:33.087265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:33.087265+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.087265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:32.570874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"95'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.076609+0000","last_change":"2024-09-10T06:29:26.076609+0000","last_active":"2024-09-10T06:29:26.076609+0000","last_peered":"2024-09-10T06:29:26.076609+0000","last_clean":"2024-09-10T06:29:26.076609+0000","last_became_active":"2024-09-10T06:26:30.601672+0000","last_became_peered":"2024-09-10T06:26:30.601672+0000","last_unstale":"2024-09-10T06:29:26.076609+0000","last_undegraded":"2024-09-10T06:29:26.076609+0000","last_fullsized":"2024-09-10T06:29:26.076609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:26.076397+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:26.076397+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.076397+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:07.806859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376590+0000","last_change":"2024-09-10T06:26:34.277010+0000","last_active":"2024-09-10T06:28:48.376590+0000","last_peered":"2024-09-10T06:28:48.376590+0000","last_clean":"2024-09-10T06:28:48.376590+0000","last_became_active":"2024-09-10T06:26:34.276197+0000","last_became_peered":"2024-09-10T06:26:34.276197+0000","last_unstale":"2024-09-10T06:28:48.376590+0000","last_undegraded":"2024-09-10T06:28:48.376590+0000","last_fullsized":"2024-09-10T06:28:48.376590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:33.234225+0000","last_clean_scrub_stamp":"2024-09-10T06:26:33.234225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:52:32.113293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"95'14","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.756849+0000","last_change":"2024-09-10T06:26:36.297514+0000","last_active":"2024-09-10T06:29:17.756849+0000","last_peered":"2024-09-10T06:29:17.756849+0000","last_clean":"2024-09-10T06:29:17.756849+0000","last_became_active":"2024-09-10T06:26:36.296615+0000","last_became_peered":"2024-09-10T06:26:36.296615+0000","last_unstale":"2024-09-10T06:29:17.756849+0000","last_undegraded":"2024-09-10T06:29:17.756849+0000","last_fullsized":"2024-09-10T06:29:17.756849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:16:16.263324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376631+0000","last_change":"2024-09-10T06:26:38.288794+0000","last_active":"2024-09-10T06:28:48.376631+0000","last_peered":"2024-09-10T06:28:48.376631+0000","last_clean":"2024-09-10T06:28:48.376631+0000","last_became_active":"2024-09-10T06:26:38.288055+0000","last_became_peered":"2024-09-10T06:26:38.288055+0000","last_unstale":"2024-09-10T06:28:48.376631+0000","last_undegraded":"2024-09-10T06:28:48.376631+0000","last_fullsized":"2024-09-10T06:28:48.376631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.463598+0000","last_change":"2024-09-10T06:26:40.318067+0000","last_active":"2024-09-10T06:28:48.463598+0000","last_peered":"2024-09-10T06:28:48.463598+0000","last_clean":"2024-09-10T06:28:48.463598+0000","last_became_active":"2024-09-10T06:26:40.317244+0000","last_became_peered":"2024-09-10T06:26:40.317244+0000","last_unstale":"2024-09-10T06:28:48.463598+0000","last_undegraded":"2024-09-10T06:28:48.463598+0000","last_fullsized":"2024-09-10T06:28:48.463598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:37:24.638077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"76'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.104229+0000","last_change":"2024-09-10T06:29:34.104229+0000","last_active":"2024-09-10T06:29:34.104229+0000","last_peered":"2024-09-10T06:29:34.104229+0000","last_clean":"2024-09-10T06:29:34.104229+0000","last_became_active":"2024-09-10T06:26:32.274812+0000","last_became_peered":"2024-09-10T06:26:32.274812+0000","last_unstale":"2024-09-10T06:29:34.104229+0000","last_undegraded":"2024-09-10T06:29:34.104229+0000","last_fullsized":"2024-09-10T06:29:34.104229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:34.104024+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:34.104024+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.104024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:30.638947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"95'20","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.561214+0000","last_change":"2024-09-10T06:29:28.561214+0000","last_active":"2024-09-10T06:29:28.561214+0000","last_peered":"2024-09-10T06:29:28.561214+0000","last_clean":"2024-09-10T06:29:28.561214+0000","last_became_active":"2024-09-10T06:26:30.593687+0000","last_became_peered":"2024-09-10T06:26:30.593687+0000","last_unstale":"2024-09-10T06:29:28.561214+0000","last_undegraded":"2024-09-10T06:29:28.561214+0000","last_fullsized":"2024-09-10T06:29:28.561214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:28.561010+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:28.561010+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.561010+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:35.631710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"95'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.804848+0000","last_change":"2024-09-10T06:29:39.804848+0000","last_active":"2024-09-10T06:29:39.804848+0000","last_peered":"2024-09-10T06:29:39.804848+0000","last_clean":"2024-09-10T06:29:39.804848+0000","last_became_active":"2024-09-10T06:26:34.282931+0000","last_became_peered":"2024-09-10T06:26:34.282931+0000","last_unstale":"2024-09-10T06:29:39.804848+0000","last_undegraded":"2024-09-10T06:29:39.804848+0000","last_fullsized":"2024-09-10T06:29:39.804848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-10T06:29:39.804639+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-10T06:29:39.804639+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.804639+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:02.780607+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"95'18","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.779335+0000","last_change":"2024-09-10T06:26:36.289834+0000","last_active":"2024-09-10T06:29:17.779335+0000","last_peered":"2024-09-10T06:29:17.779335+0000","last_clean":"2024-09-10T06:29:17.779335+0000","last_became_active":"2024-09-10T06:26:36.289033+0000","last_became_peered":"2024-09-10T06:26:36.289033+0000","last_unstale":"2024-09-10T06:29:17.779335+0000","last_undegraded":"2024-09-10T06:29:17.779335+0000","last_fullsized":"2024-09-10T06:29:17.779335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:35.245740+0000","last_clean_scrub_stamp":"2024-09-10T06:26:35.245740+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:08.503237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375982+0000","last_change":"2024-09-10T06:26:38.299568+0000","last_active":"2024-09-10T06:28:48.375982+0000","last_peered":"2024-09-10T06:28:48.375982+0000","last_clean":"2024-09-10T06:28:48.375982+0000","last_became_active":"2024-09-10T06:26:38.298779+0000","last_became_peered":"2024-09-10T06:26:38.298779+0000","last_unstale":"2024-09-10T06:28:48.375982+0000","last_undegraded":"2024-09-10T06:28:48.375982+0000","last_fullsized":"2024-09-10T06:28:48.375982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:37.251826+0000","last_clean_scrub_stamp":"2024-09-10T06:26:37.251826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:33.498910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.381022+0000","last_change":"2024-09-10T06:26:40.336329+0000","last_active":"2024-09-10T06:28:48.381022+0000","last_peered":"2024-09-10T06:28:48.381022+0000","last_clean":"2024-09-10T06:28:48.381022+0000","last_became_active":"2024-09-10T06:26:40.335348+0000","last_became_peered":"2024-09-10T06:26:40.335348+0000","last_unstale":"2024-09-10T06:28:48.381022+0000","last_undegraded":"2024-09-10T06:28:48.381022+0000","last_fullsized":"2024-09-10T06:28:48.381022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:15:40.653642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"62'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.807660+0000","last_change":"2024-09-10T06:29:38.807660+0000","last_active":"2024-09-10T06:29:38.807660+0000","last_peered":"2024-09-10T06:29:38.807660+0000","last_clean":"2024-09-10T06:29:38.807660+0000","last_became_active":"2024-09-10T06:26:32.275855+0000","last_became_peered":"2024-09-10T06:26:32.275855+0000","last_unstale":"2024-09-10T06:29:38.807660+0000","last_undegraded":"2024-09-10T06:29:38.807660+0000","last_fullsized":"2024-09-10T06:29:38.807660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-10T06:29:38.807377+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-10T06:29:38.807377+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.807377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:35.562150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"95'22","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.481630+0000","last_change":"2024-09-10T06:29:28.481630+0000","last_active":"2024-09-10T06:29:28.481630+0000","last_peered":"2024-09-10T06:29:28.481630+0000","last_clean":"2024-09-10T06:29:28.481630+0000","last_became_active":"2024-09-10T06:26:30.590801+0000","last_became_peered":"2024-09-10T06:26:30.590801+0000","last_unstale":"2024-09-10T06:29:28.481630+0000","last_undegraded":"2024-09-10T06:29:28.481630+0000","last_fullsized":"2024-09-10T06:29:28.481630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:28.481459+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:28.481459+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.481459+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:15.157597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.681891+0000","last_change":"2024-09-10T06:29:35.681891+0000","last_active":"2024-09-10T06:29:35.681891+0000","last_peered":"2024-09-10T06:29:35.681891+0000","last_clean":"2024-09-10T06:29:35.681891+0000","last_became_active":"2024-09-10T06:26:32.267915+0000","last_became_peered":"2024-09-10T06:26:32.267915+0000","last_unstale":"2024-09-10T06:29:35.681891+0000","last_undegraded":"2024-09-10T06:29:35.681891+0000","last_fullsized":"2024-09-10T06:29:35.681891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:35.681619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:35.681619+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.681619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:47.762330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"95'20","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.565966+0000","last_change":"2024-09-10T06:29:26.565966+0000","last_active":"2024-09-10T06:29:26.565966+0000","last_peered":"2024-09-10T06:29:26.565966+0000","last_clean":"2024-09-10T06:29:26.565966+0000","last_became_active":"2024-09-10T06:26:30.593506+0000","last_became_peered":"2024-09-10T06:26:30.593506+0000","last_unstale":"2024-09-10T06:29:26.565966+0000","last_undegraded":"2024-09-10T06:29:26.565966+0000","last_fullsized":"2024-09-10T06:29:26.565966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:26.565797+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:26.565797+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.565797+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:10.093988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'6","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.297180+0000","last_change":"2024-09-10T06:29:40.297180+0000","last_active":"2024-09-10T06:29:40.297180+0000","last_peered":"2024-09-10T06:29:40.297180+0000","last_clean":"2024-09-10T06:29:40.297180+0000","last_became_active":"2024-09-10T06:26:32.287839+0000","last_became_peered":"2024-09-10T06:26:32.287839+0000","last_unstale":"2024-09-10T06:29:40.297180+0000","last_undegraded":"2024-09-10T06:29:40.297180+0000","last_fullsized":"2024-09-10T06:29:40.297180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2024-09-10T06:29:40.296901+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2024-09-10T06:29:40.296901+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.296901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:26.239244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"95'10","reported_seq":83,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.594030+0000","last_change":"2024-09-10T06:29:25.594030+0000","last_active":"2024-09-10T06:29:25.594030+0000","last_peered":"2024-09-10T06:29:25.594030+0000","last_clean":"2024-09-10T06:29:25.594030+0000","last_became_active":"2024-09-10T06:28:09.544344+0000","last_became_peered":"2024-09-10T06:28:09.544344+0000","last_unstale":"2024-09-10T06:29:25.594030+0000","last_undegraded":"2024-09-10T06:29:25.594030+0000","last_fullsized":"2024-09-10T06:29:25.594030+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-10T06:29:25.593753+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-10T06:29:25.593753+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.593753+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:27.452348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"62'4","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.634746+0000","last_change":"2024-09-10T06:29:34.634746+0000","last_active":"2024-09-10T06:29:34.634746+0000","last_peered":"2024-09-10T06:29:34.634746+0000","last_clean":"2024-09-10T06:29:34.634746+0000","last_became_active":"2024-09-10T06:26:32.272279+0000","last_became_peered":"2024-09-10T06:26:32.272279+0000","last_unstale":"2024-09-10T06:29:34.634746+0000","last_undegraded":"2024-09-10T06:29:34.634746+0000","last_fullsized":"2024-09-10T06:29:34.634746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-10T06:29:34.634524+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-10T06:29:34.634524+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.634524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:34.244616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"95'24","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.566184+0000","last_change":"2024-09-10T06:29:26.566184+0000","last_active":"2024-09-10T06:29:26.566184+0000","last_peered":"2024-09-10T06:29:26.566184+0000","last_clean":"2024-09-10T06:29:26.566184+0000","last_became_active":"2024-09-10T06:26:30.579189+0000","last_became_peered":"2024-09-10T06:26:30.579189+0000","last_unstale":"2024-09-10T06:29:26.566184+0000","last_undegraded":"2024-09-10T06:29:26.566184+0000","last_fullsized":"2024-09-10T06:29:26.566184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:26.565846+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:26.565846+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.565846+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:54.468490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.971489+0000","last_change":"2024-09-10T06:29:36.971489+0000","last_active":"2024-09-10T06:29:36.971489+0000","last_peered":"2024-09-10T06:29:36.971489+0000","last_clean":"2024-09-10T06:29:36.971489+0000","last_became_active":"2024-09-10T06:26:32.259644+0000","last_became_peered":"2024-09-10T06:26:32.259644+0000","last_unstale":"2024-09-10T06:29:36.971489+0000","last_undegraded":"2024-09-10T06:29:36.971489+0000","last_fullsized":"2024-09-10T06:29:36.971489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:36.971273+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:36.971273+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.971273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:17.237836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"95'22","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.133853+0000","last_change":"2024-09-10T06:29:30.133853+0000","last_active":"2024-09-10T06:29:30.133853+0000","last_peered":"2024-09-10T06:29:30.133853+0000","last_clean":"2024-09-10T06:29:30.133853+0000","last_became_active":"2024-09-10T06:26:30.575605+0000","last_became_peered":"2024-09-10T06:26:30.575605+0000","last_unstale":"2024-09-10T06:29:30.133853+0000","last_undegraded":"2024-09-10T06:29:30.133853+0000","last_fullsized":"2024-09-10T06:29:30.133853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:30.133668+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:30.133668+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.133668+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:38.055165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"76'10","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.089233+0000","last_change":"2024-09-10T06:29:37.089233+0000","last_active":"2024-09-10T06:29:37.089233+0000","last_peered":"2024-09-10T06:29:37.089233+0000","last_clean":"2024-09-10T06:29:37.089233+0000","last_became_active":"2024-09-10T06:26:32.272454+0000","last_became_peered":"2024-09-10T06:26:32.272454+0000","last_unstale":"2024-09-10T06:29:37.089233+0000","last_undegraded":"2024-09-10T06:29:37.089233+0000","last_fullsized":"2024-09-10T06:29:37.089233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'10","last_scrub_stamp":"2024-09-10T06:29:37.089011+0000","last_deep_scrub":"76'10","last_deep_scrub_stamp":"2024-09-10T06:29:37.089011+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.089011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:20.087601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"95'12","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.727328+0000","last_change":"2024-09-10T06:29:26.727328+0000","last_active":"2024-09-10T06:29:26.727328+0000","last_peered":"2024-09-10T06:29:26.727328+0000","last_clean":"2024-09-10T06:29:26.727328+0000","last_became_active":"2024-09-10T06:26:30.578732+0000","last_became_peered":"2024-09-10T06:26:30.578732+0000","last_unstale":"2024-09-10T06:29:26.727328+0000","last_undegraded":"2024-09-10T06:29:26.727328+0000","last_fullsized":"2024-09-10T06:29:26.727328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:26.727144+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:26.727144+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.727144+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:01.138095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.927336+0000","last_change":"2024-09-10T06:29:37.927336+0000","last_active":"2024-09-10T06:29:37.927336+0000","last_peered":"2024-09-10T06:29:37.927336+0000","last_clean":"2024-09-10T06:29:37.927336+0000","last_became_active":"2024-09-10T06:26:32.270327+0000","last_became_peered":"2024-09-10T06:26:32.270327+0000","last_unstale":"2024-09-10T06:29:37.927336+0000","last_undegraded":"2024-09-10T06:29:37.927336+0000","last_fullsized":"2024-09-10T06:29:37.927336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.927124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.927124+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.927124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:36.175407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"95'12","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.442680+0000","last_change":"2024-09-10T06:29:29.442680+0000","last_active":"2024-09-10T06:29:29.442680+0000","last_peered":"2024-09-10T06:29:29.442680+0000","last_clean":"2024-09-10T06:29:29.442680+0000","last_became_active":"2024-09-10T06:26:30.596254+0000","last_became_peered":"2024-09-10T06:26:30.596254+0000","last_unstale":"2024-09-10T06:29:29.442680+0000","last_undegraded":"2024-09-10T06:29:29.442680+0000","last_fullsized":"2024-09-10T06:29:29.442680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:29.442459+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:29.442459+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.442459+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:12.813873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'2","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.398908+0000","last_change":"2024-09-10T06:29:36.398908+0000","last_active":"2024-09-10T06:29:36.398908+0000","last_peered":"2024-09-10T06:29:36.398908+0000","last_clean":"2024-09-10T06:29:36.398908+0000","last_became_active":"2024-09-10T06:26:32.275133+0000","last_became_peered":"2024-09-10T06:26:32.275133+0000","last_unstale":"2024-09-10T06:29:36.398908+0000","last_undegraded":"2024-09-10T06:29:36.398908+0000","last_fullsized":"2024-09-10T06:29:36.398908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:36.398697+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:36.398697+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.398697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:57.551366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"95'18","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.123679+0000","last_change":"2024-09-10T06:29:27.123679+0000","last_active":"2024-09-10T06:29:27.123679+0000","last_peered":"2024-09-10T06:29:27.123679+0000","last_clean":"2024-09-10T06:29:27.123679+0000","last_became_active":"2024-09-10T06:26:30.580134+0000","last_became_peered":"2024-09-10T06:26:30.580134+0000","last_unstale":"2024-09-10T06:29:27.123679+0000","last_undegraded":"2024-09-10T06:29:27.123679+0000","last_fullsized":"2024-09-10T06:29:27.123679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:27.123490+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:27.123490+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.123490+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:41.216401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.593717+0000","last_change":"2024-09-10T06:29:37.593717+0000","last_active":"2024-09-10T06:29:37.593717+0000","last_peered":"2024-09-10T06:29:37.593717+0000","last_clean":"2024-09-10T06:29:37.593717+0000","last_became_active":"2024-09-10T06:26:32.256052+0000","last_became_peered":"2024-09-10T06:26:32.256052+0000","last_unstale":"2024-09-10T06:29:37.593717+0000","last_undegraded":"2024-09-10T06:29:37.593717+0000","last_fullsized":"2024-09-10T06:29:37.593717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:37.593531+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:37.593531+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.593531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:46.073261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"95'16","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.322872+0000","last_change":"2024-09-10T06:29:29.322872+0000","last_active":"2024-09-10T06:29:29.322872+0000","last_peered":"2024-09-10T06:29:29.322872+0000","last_clean":"2024-09-10T06:29:29.322872+0000","last_became_active":"2024-09-10T06:26:30.584443+0000","last_became_peered":"2024-09-10T06:26:30.584443+0000","last_unstale":"2024-09-10T06:29:29.322872+0000","last_undegraded":"2024-09-10T06:29:29.322872+0000","last_fullsized":"2024-09-10T06:29:29.322872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:29.322684+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:29.322684+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.322684+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:34.292621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"76'4","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.177377+0000","last_change":"2024-09-10T06:29:39.177377+0000","last_active":"2024-09-10T06:29:39.177377+0000","last_peered":"2024-09-10T06:29:39.177377+0000","last_clean":"2024-09-10T06:29:39.177377+0000","last_became_active":"2024-09-10T06:26:32.258513+0000","last_became_peered":"2024-09-10T06:26:32.258513+0000","last_unstale":"2024-09-10T06:29:39.177377+0000","last_undegraded":"2024-09-10T06:29:39.177377+0000","last_fullsized":"2024-09-10T06:29:39.177377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:39.177196+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:39.177196+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.177196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:37.865159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"95'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.102245+0000","last_change":"2024-09-10T06:29:31.102245+0000","last_active":"2024-09-10T06:29:31.102245+0000","last_peered":"2024-09-10T06:29:31.102245+0000","last_clean":"2024-09-10T06:29:31.102245+0000","last_became_active":"2024-09-10T06:26:30.580913+0000","last_became_peered":"2024-09-10T06:26:30.580913+0000","last_unstale":"2024-09-10T06:29:31.102245+0000","last_undegraded":"2024-09-10T06:29:31.102245+0000","last_fullsized":"2024-09-10T06:29:31.102245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:31.102016+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:31.102016+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.102016+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:16.248697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"76'2","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.501181+0000","last_change":"2024-09-10T06:29:31.501181+0000","last_active":"2024-09-10T06:29:31.501181+0000","last_peered":"2024-09-10T06:29:31.501181+0000","last_clean":"2024-09-10T06:29:31.501181+0000","last_became_active":"2024-09-10T06:26:32.274327+0000","last_became_peered":"2024-09-10T06:26:32.274327+0000","last_unstale":"2024-09-10T06:29:31.501181+0000","last_undegraded":"2024-09-10T06:29:31.501181+0000","last_fullsized":"2024-09-10T06:29:31.501181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:31.500938+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:31.500938+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.500938+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:43.060165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"95'12","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.526438+0000","last_change":"2024-09-10T06:29:27.526438+0000","last_active":"2024-09-10T06:29:27.526438+0000","last_peered":"2024-09-10T06:29:27.526438+0000","last_clean":"2024-09-10T06:29:27.526438+0000","last_became_active":"2024-09-10T06:27:08.592637+0000","last_became_peered":"2024-09-10T06:27:08.592637+0000","last_unstale":"2024-09-10T06:29:27.526438+0000","last_undegraded":"2024-09-10T06:29:27.526438+0000","last_fullsized":"2024-09-10T06:29:27.526438+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:27.526241+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:27.526241+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.526241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:26.084961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.135197+0000","last_change":"2024-09-10T06:29:38.135197+0000","last_active":"2024-09-10T06:29:38.135197+0000","last_peered":"2024-09-10T06:29:38.135197+0000","last_clean":"2024-09-10T06:29:38.135197+0000","last_became_active":"2024-09-10T06:26:32.278461+0000","last_became_peered":"2024-09-10T06:26:32.278461+0000","last_unstale":"2024-09-10T06:29:38.135197+0000","last_undegraded":"2024-09-10T06:29:38.135197+0000","last_fullsized":"2024-09-10T06:29:38.135197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:38.134976+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:38.134976+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.134976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:57.931148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"95'16","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.573008+0000","last_change":"2024-09-10T06:29:27.573008+0000","last_active":"2024-09-10T06:29:27.573008+0000","last_peered":"2024-09-10T06:29:27.573008+0000","last_clean":"2024-09-10T06:29:27.573008+0000","last_became_active":"2024-09-10T06:26:30.605225+0000","last_became_peered":"2024-09-10T06:26:30.605225+0000","last_unstale":"2024-09-10T06:29:27.573008+0000","last_undegraded":"2024-09-10T06:29:27.573008+0000","last_fullsized":"2024-09-10T06:29:27.573008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:27.572826+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:27.572826+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.572826+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:18.620011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"64'8","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.462698+0000","last_change":"2024-09-10T06:26:32.267201+0000","last_active":"2024-09-10T06:28:48.462698+0000","last_peered":"2024-09-10T06:28:48.462698+0000","last_clean":"2024-09-10T06:28:48.462698+0000","last_became_active":"2024-09-10T06:26:32.266234+0000","last_became_peered":"2024-09-10T06:26:32.266234+0000","last_unstale":"2024-09-10T06:28:48.462698+0000","last_undegraded":"2024-09-10T06:28:48.462698+0000","last_fullsized":"2024-09-10T06:28:48.462698+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:26:42.191274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"95'20","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.508009+0000","last_change":"2024-09-10T06:29:27.508009+0000","last_active":"2024-09-10T06:29:27.508009+0000","last_peered":"2024-09-10T06:29:27.508009+0000","last_clean":"2024-09-10T06:29:27.508009+0000","last_became_active":"2024-09-10T06:26:30.593598+0000","last_became_peered":"2024-09-10T06:26:30.593598+0000","last_unstale":"2024-09-10T06:29:27.508009+0000","last_undegraded":"2024-09-10T06:29:27.508009+0000","last_fullsized":"2024-09-10T06:29:27.508009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:27.507794+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:27.507794+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.507794+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:52.834192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"76'2","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.569752+0000","last_change":"2024-09-10T06:29:36.569752+0000","last_active":"2024-09-10T06:29:36.569752+0000","last_peered":"2024-09-10T06:29:36.569752+0000","last_clean":"2024-09-10T06:29:36.569752+0000","last_became_active":"2024-09-10T06:26:32.278032+0000","last_became_peered":"2024-09-10T06:26:32.278032+0000","last_unstale":"2024-09-10T06:29:36.569752+0000","last_undegraded":"2024-09-10T06:29:36.569752+0000","last_fullsized":"2024-09-10T06:29:36.569752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:36.569563+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:36.569563+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.569563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:22.916358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"95'18","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:17.873299+0000","last_change":"2024-09-10T06:26:30.580552+0000","last_active":"2024-09-10T06:29:17.873299+0000","last_peered":"2024-09-10T06:29:17.873299+0000","last_clean":"2024-09-10T06:29:17.873299+0000","last_became_active":"2024-09-10T06:26:30.579319+0000","last_became_peered":"2024-09-10T06:26:30.579319+0000","last_unstale":"2024-09-10T06:29:17.873299+0000","last_undegraded":"2024-09-10T06:29:17.873299+0000","last_fullsized":"2024-09-10T06:29:17.873299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:29.531900+0000","last_clean_scrub_stamp":"2024-09-10T06:26:29.531900+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:52:59.885311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"67'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375088+0000","last_change":"2024-09-10T06:26:32.257601+0000","last_active":"2024-09-10T06:28:48.375088+0000","last_peered":"2024-09-10T06:28:48.375088+0000","last_clean":"2024-09-10T06:28:48.375088+0000","last_became_active":"2024-09-10T06:26:32.256851+0000","last_became_peered":"2024-09-10T06:26:32.256851+0000","last_unstale":"2024-09-10T06:28:48.375088+0000","last_undegraded":"2024-09-10T06:28:48.375088+0000","last_fullsized":"2024-09-10T06:28:48.375088+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:31.546271+0000","last_clean_scrub_stamp":"2024-09-10T06:26:31.546271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:26.624765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"95'24","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.489479+0000","last_change":"2024-09-10T06:29:29.489479+0000","last_active":"2024-09-10T06:29:29.489479+0000","last_peered":"2024-09-10T06:29:29.489479+0000","last_clean":"2024-09-10T06:29:29.489479+0000","last_became_active":"2024-09-10T06:28:46.326501+0000","last_became_peered":"2024-09-10T06:28:46.326501+0000","last_unstale":"2024-09-10T06:29:29.489479+0000","last_undegraded":"2024-09-10T06:29:29.489479+0000","last_fullsized":"2024-09-10T06:29:29.489479+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:29.489292+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:29.489292+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.489292+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:43.930114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"62'8","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.302392+0000","last_change":"2024-09-10T06:29:36.302392+0000","last_active":"2024-09-10T06:29:36.302392+0000","last_peered":"2024-09-10T06:29:36.302392+0000","last_clean":"2024-09-10T06:29:36.302392+0000","last_became_active":"2024-09-10T06:26:32.266000+0000","last_became_peered":"2024-09-10T06:26:32.266000+0000","last_unstale":"2024-09-10T06:29:36.302392+0000","last_undegraded":"2024-09-10T06:29:36.302392+0000","last_fullsized":"2024-09-10T06:29:36.302392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-09-10T06:29:36.302107+0000","last_deep_scrub":"62'8","last_deep_scrub_stamp":"2024-09-10T06:29:36.302107+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.302107+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:41.272044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"95'18","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.304733+0000","last_change":"2024-09-10T06:29:30.304733+0000","last_active":"2024-09-10T06:29:30.304733+0000","last_peered":"2024-09-10T06:29:30.304733+0000","last_clean":"2024-09-10T06:29:30.304733+0000","last_became_active":"2024-09-10T06:26:30.609674+0000","last_became_peered":"2024-09-10T06:26:30.609674+0000","last_unstale":"2024-09-10T06:29:30.304733+0000","last_undegraded":"2024-09-10T06:29:30.304733+0000","last_fullsized":"2024-09-10T06:29:30.304733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:30.304509+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:30.304509+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.304509+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.312339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"95'20","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.290101+0000","last_change":"2024-09-10T06:29:31.290101+0000","last_active":"2024-09-10T06:29:31.290101+0000","last_peered":"2024-09-10T06:29:31.290101+0000","last_clean":"2024-09-10T06:29:31.290101+0000","last_became_active":"2024-09-10T06:26:30.590640+0000","last_became_peered":"2024-09-10T06:26:30.590640+0000","last_unstale":"2024-09-10T06:29:31.290101+0000","last_undegraded":"2024-09-10T06:29:31.290101+0000","last_fullsized":"2024-09-10T06:29:31.290101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:31.289915+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:31.289915+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.289915+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:59.192559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"67'10","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.624607+0000","last_change":"2024-09-10T06:29:38.624607+0000","last_active":"2024-09-10T06:29:38.624607+0000","last_peered":"2024-09-10T06:29:38.624607+0000","last_clean":"2024-09-10T06:29:38.624607+0000","last_became_active":"2024-09-10T06:26:32.266876+0000","last_became_peered":"2024-09-10T06:26:32.266876+0000","last_unstale":"2024-09-10T06:29:38.624607+0000","last_undegraded":"2024-09-10T06:29:38.624607+0000","last_fullsized":"2024-09-10T06:29:38.624607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T06:29:38.624380+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T06:29:38.624380+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.624380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:43.077926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"95'26","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.725676+0000","last_change":"2024-09-10T06:29:30.725676+0000","last_active":"2024-09-10T06:29:30.725676+0000","last_peered":"2024-09-10T06:29:30.725676+0000","last_clean":"2024-09-10T06:29:30.725676+0000","last_became_active":"2024-09-10T06:26:30.590415+0000","last_became_peered":"2024-09-10T06:26:30.590415+0000","last_unstale":"2024-09-10T06:29:30.725676+0000","last_undegraded":"2024-09-10T06:29:30.725676+0000","last_fullsized":"2024-09-10T06:29:30.725676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-10T06:29:30.725485+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-10T06:29:30.725485+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.725485+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:11.273687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.277539+0000","last_change":"2024-09-10T06:29:36.277539+0000","last_active":"2024-09-10T06:29:36.277539+0000","last_peered":"2024-09-10T06:29:36.277539+0000","last_clean":"2024-09-10T06:29:36.277539+0000","last_became_active":"2024-09-10T06:26:32.282581+0000","last_became_peered":"2024-09-10T06:26:32.282581+0000","last_unstale":"2024-09-10T06:29:36.277539+0000","last_undegraded":"2024-09-10T06:29:36.277539+0000","last_fullsized":"2024-09-10T06:29:36.277539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:36.277311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:36.277311+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.277311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:26.104758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":840,"ondisk_log_size":840,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":27618,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1027,"num_read_kb":1076,"num_write":535,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":778,"ondisk_log_size":778,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":344,"num_read_kb":344,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":567,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":15,"num_write":1204,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":209715200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1156,"ondisk_log_size":1156,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1769472,"data_stored":1236965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542189,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1155072,"data_stored":646930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542190,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1200128,"data_stored":646784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542189,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1142784,"data_stored":646428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1171456,"data_stored":646769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542190,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1138688,"data_stored":645499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36488,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335352,"statfs":{"total":96636764160,"available":96599400448,"internally_reserved":0,"allocated":1171456,"data_stored":646206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542189,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":1236807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:29:45.012 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.013 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.013 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.013 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.013 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.013 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.013 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.014 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.014 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.014 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.014 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.014 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.014 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.014 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.014 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.015 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.015 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.015 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.015 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.015 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.015 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.015 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.015 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.015 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.016 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.016 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.016 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.016 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.016 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.016 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.016 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.017 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.017 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.017 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.017 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.017 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.017 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.017 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.017 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.018 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.018 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.018 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.018 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.018 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.018 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.018 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.018 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.018 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.019 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.019 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.019 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.019 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.019 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.019 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.019 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.019 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.019 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.020 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.020 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.020 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.020 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.020 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.020 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.020 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.020 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.021 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.021 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.021 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.021 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.021 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.021 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.021 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.021 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.022 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.022 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.022 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.022 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.022 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.022 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.022 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.022 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.023 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.023 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.023 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.023 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.023 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.023 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.023 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.023 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.024 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.024 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.024 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.024 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.024 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.024 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.024 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.024 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.025 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.025 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.025 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.025 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.025 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.025 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.025 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.025 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.026 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.026 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.026 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.026 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.026 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.026 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.026 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T06:26:33.234225+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=33, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.026 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.026 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.027 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.027 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T06:26:35.245740+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=35, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.027 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T06:26:37.251826+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=37, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.027 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.027 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.028 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T06:26:29.531900+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=29, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.028 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T06:26:31.546271+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=31, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:29:45.028 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T06:30:05.029 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:30:05.350 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:30:05.360 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:30:05.372 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-10T06:30:03.496890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":619618,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":2868,"num_read_kb":2295,"num_write":2317,"num_write_kb":2367369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":209715508,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6092,"num_omap_keys":28,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3359,"ondisk_log_size":3359,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263888,"kb_used_data":10256,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754710832,"statfs":{"total":773094113280,"available":772823891968,"internally_reserved":0,"allocated":10502144,"data_stored":6352388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1348,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006867"},"pg_stats":[{"pgid":"3.3f","version":"95'24","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.708872+0000","last_change":"2024-09-10T06:29:27.708872+0000","last_active":"2024-09-10T06:29:27.708872+0000","last_peered":"2024-09-10T06:29:27.708872+0000","last_clean":"2024-09-10T06:29:27.708872+0000","last_became_active":"2024-09-10T06:27:08.597026+0000","last_became_peered":"2024-09-10T06:27:08.597026+0000","last_unstale":"2024-09-10T06:29:27.708872+0000","last_undegraded":"2024-09-10T06:29:27.708872+0000","last_fullsized":"2024-09-10T06:29:27.708872+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:27.708694+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:27.708694+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.708694+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:43.032190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"67'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.274618+0000","last_change":"2024-09-10T06:29:39.274618+0000","last_active":"2024-09-10T06:29:39.274618+0000","last_peered":"2024-09-10T06:29:39.274618+0000","last_clean":"2024-09-10T06:29:39.274618+0000","last_became_active":"2024-09-10T06:26:32.279098+0000","last_became_peered":"2024-09-10T06:26:32.279098+0000","last_unstale":"2024-09-10T06:29:39.274618+0000","last_undegraded":"2024-09-10T06:29:39.274618+0000","last_fullsized":"2024-09-10T06:29:39.274618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:39.274400+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:39.274400+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.274400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:55.846716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"95'10","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:22.776727+0000","last_change":"2024-09-10T06:29:22.776727+0000","last_active":"2024-09-10T06:29:22.776727+0000","last_peered":"2024-09-10T06:29:22.776727+0000","last_clean":"2024-09-10T06:29:22.776727+0000","last_became_active":"2024-09-10T06:26:30.572798+0000","last_became_peered":"2024-09-10T06:26:30.572798+0000","last_unstale":"2024-09-10T06:29:22.776727+0000","last_undegraded":"2024-09-10T06:29:22.776727+0000","last_fullsized":"2024-09-10T06:29:22.776727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-10T06:29:22.776555+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-10T06:29:22.776555+0000","last_clean_scrub_stamp":"2024-09-10T06:29:22.776555+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:35.963583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"62'2","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.234971+0000","last_change":"2024-09-10T06:29:38.234971+0000","last_active":"2024-09-10T06:29:38.234971+0000","last_peered":"2024-09-10T06:29:38.234971+0000","last_clean":"2024-09-10T06:29:38.234971+0000","last_became_active":"2024-09-10T06:26:32.275990+0000","last_became_peered":"2024-09-10T06:26:32.275990+0000","last_unstale":"2024-09-10T06:29:38.234971+0000","last_undegraded":"2024-09-10T06:29:38.234971+0000","last_fullsized":"2024-09-10T06:29:38.234971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-10T06:29:38.234787+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-10T06:29:38.234787+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.234787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:21.233377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"95'18","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.536070+0000","last_change":"2024-09-10T06:29:31.536070+0000","last_active":"2024-09-10T06:29:31.536070+0000","last_peered":"2024-09-10T06:29:31.536070+0000","last_clean":"2024-09-10T06:29:31.536070+0000","last_became_active":"2024-09-10T06:26:30.577688+0000","last_became_peered":"2024-09-10T06:26:30.577688+0000","last_unstale":"2024-09-10T06:29:31.536070+0000","last_undegraded":"2024-09-10T06:29:31.536070+0000","last_fullsized":"2024-09-10T06:29:31.536070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:31.535858+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:31.535858+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.535858+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:58.685339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":26,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.112184+0000","last_change":"2024-09-10T06:29:42.112184+0000","last_active":"2024-09-10T06:29:42.112184+0000","last_peered":"2024-09-10T06:29:42.112184+0000","last_clean":"2024-09-10T06:29:42.112184+0000","last_became_active":"2024-09-10T06:26:32.256117+0000","last_became_peered":"2024-09-10T06:26:32.256117+0000","last_unstale":"2024-09-10T06:29:42.112184+0000","last_undegraded":"2024-09-10T06:29:42.112184+0000","last_fullsized":"2024-09-10T06:29:42.112184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-10T06:29:42.111989+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-10T06:29:42.111989+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.111989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:43.940199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"95'22","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.278259+0000","last_change":"2024-09-10T06:29:33.278259+0000","last_active":"2024-09-10T06:29:33.278259+0000","last_peered":"2024-09-10T06:29:33.278259+0000","last_clean":"2024-09-10T06:29:33.278259+0000","last_became_active":"2024-09-10T06:26:30.591807+0000","last_became_peered":"2024-09-10T06:26:30.591807+0000","last_unstale":"2024-09-10T06:29:33.278259+0000","last_undegraded":"2024-09-10T06:29:33.278259+0000","last_fullsized":"2024-09-10T06:29:33.278259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:33.278071+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:33.278071+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.278071+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:12.210815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.636019+0000","last_change":"2024-09-10T06:29:39.636019+0000","last_active":"2024-09-10T06:29:39.636019+0000","last_peered":"2024-09-10T06:29:39.636019+0000","last_clean":"2024-09-10T06:29:39.636019+0000","last_became_active":"2024-09-10T06:26:32.264199+0000","last_became_peered":"2024-09-10T06:26:32.264199+0000","last_unstale":"2024-09-10T06:29:39.636019+0000","last_undegraded":"2024-09-10T06:29:39.636019+0000","last_fullsized":"2024-09-10T06:29:39.636019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:39.635843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:39.635843+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.635843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:47.814837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"95'14","reported_seq":86,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.454785+0000","last_change":"2024-09-10T06:29:32.454785+0000","last_active":"2024-09-10T06:29:32.454785+0000","last_peered":"2024-09-10T06:29:32.454785+0000","last_clean":"2024-09-10T06:29:32.454785+0000","last_became_active":"2024-09-10T06:28:09.546624+0000","last_became_peered":"2024-09-10T06:28:09.546624+0000","last_unstale":"2024-09-10T06:29:32.454785+0000","last_undegraded":"2024-09-10T06:29:32.454785+0000","last_fullsized":"2024-09-10T06:29:32.454785+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:32.454564+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:32.454564+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.454564+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:28.594324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"67'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.382374+0000","last_change":"2024-09-10T06:29:37.382374+0000","last_active":"2024-09-10T06:29:37.382374+0000","last_peered":"2024-09-10T06:29:37.382374+0000","last_clean":"2024-09-10T06:29:37.382374+0000","last_became_active":"2024-09-10T06:26:32.289840+0000","last_became_peered":"2024-09-10T06:26:32.289840+0000","last_unstale":"2024-09-10T06:29:37.382374+0000","last_undegraded":"2024-09-10T06:29:37.382374+0000","last_fullsized":"2024-09-10T06:29:37.382374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:37.382087+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:37.382087+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.382087+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:43.663439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"95'12","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.244429+0000","last_change":"2024-09-10T06:29:32.244429+0000","last_active":"2024-09-10T06:29:32.244429+0000","last_peered":"2024-09-10T06:29:32.244429+0000","last_clean":"2024-09-10T06:29:32.244429+0000","last_became_active":"2024-09-10T06:26:30.603330+0000","last_became_peered":"2024-09-10T06:26:30.603330+0000","last_unstale":"2024-09-10T06:29:32.244429+0000","last_undegraded":"2024-09-10T06:29:32.244429+0000","last_fullsized":"2024-09-10T06:29:32.244429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:32.244240+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:32.244240+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.244240+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:52.040413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"67'4","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:43.127630+0000","last_change":"2024-09-10T06:29:43.127630+0000","last_active":"2024-09-10T06:29:43.127630+0000","last_peered":"2024-09-10T06:29:43.127630+0000","last_clean":"2024-09-10T06:29:43.127630+0000","last_became_active":"2024-09-10T06:26:32.254437+0000","last_became_peered":"2024-09-10T06:26:32.254437+0000","last_unstale":"2024-09-10T06:29:43.127630+0000","last_undegraded":"2024-09-10T06:29:43.127630+0000","last_fullsized":"2024-09-10T06:29:43.127630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:43.127447+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:43.127447+0000","last_clean_scrub_stamp":"2024-09-10T06:29:43.127447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:51.048944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"95'26","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.321454+0000","last_change":"2024-09-10T06:29:34.321454+0000","last_active":"2024-09-10T06:29:34.321454+0000","last_peered":"2024-09-10T06:29:34.321454+0000","last_clean":"2024-09-10T06:29:34.321454+0000","last_became_active":"2024-09-10T06:26:30.578033+0000","last_became_peered":"2024-09-10T06:26:30.578033+0000","last_unstale":"2024-09-10T06:29:34.321454+0000","last_undegraded":"2024-09-10T06:29:34.321454+0000","last_fullsized":"2024-09-10T06:29:34.321454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-10T06:29:34.321257+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-10T06:29:34.321257+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.321257+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:29.693727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":34,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"76'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.283018+0000","last_change":"2024-09-10T06:29:38.283018+0000","last_active":"2024-09-10T06:29:38.283018+0000","last_peered":"2024-09-10T06:29:38.283018+0000","last_clean":"2024-09-10T06:29:38.283018+0000","last_became_active":"2024-09-10T06:26:32.280480+0000","last_became_peered":"2024-09-10T06:26:32.280480+0000","last_unstale":"2024-09-10T06:29:38.283018+0000","last_undegraded":"2024-09-10T06:29:38.283018+0000","last_fullsized":"2024-09-10T06:29:38.283018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:38.282778+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:38.282778+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.282778+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:46.590502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"95'16","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.860335+0000","last_change":"2024-09-10T06:29:39.860335+0000","last_active":"2024-09-10T06:29:39.860335+0000","last_peered":"2024-09-10T06:29:39.860335+0000","last_clean":"2024-09-10T06:29:39.860335+0000","last_became_active":"2024-09-10T06:26:30.592770+0000","last_became_peered":"2024-09-10T06:26:30.592770+0000","last_unstale":"2024-09-10T06:29:39.860335+0000","last_undegraded":"2024-09-10T06:29:39.860335+0000","last_fullsized":"2024-09-10T06:29:39.860335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:39.860132+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:39.860132+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.860132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:55.569488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'10","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.493294+0000","last_change":"2024-09-10T06:29:36.493294+0000","last_active":"2024-09-10T06:29:36.493294+0000","last_peered":"2024-09-10T06:29:36.493294+0000","last_clean":"2024-09-10T06:29:36.493294+0000","last_became_active":"2024-09-10T06:26:32.265788+0000","last_became_peered":"2024-09-10T06:26:32.265788+0000","last_unstale":"2024-09-10T06:29:36.493294+0000","last_undegraded":"2024-09-10T06:29:36.493294+0000","last_fullsized":"2024-09-10T06:29:36.493294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T06:29:36.493094+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T06:29:36.493094+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.493094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:13.006231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'10","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.168415+0000","last_change":"2024-09-10T06:29:40.168415+0000","last_active":"2024-09-10T06:29:40.168415+0000","last_peered":"2024-09-10T06:29:40.168415+0000","last_clean":"2024-09-10T06:29:40.168415+0000","last_became_active":"2024-09-10T06:26:32.254281+0000","last_became_peered":"2024-09-10T06:26:32.254281+0000","last_unstale":"2024-09-10T06:29:40.168415+0000","last_undegraded":"2024-09-10T06:29:40.168415+0000","last_fullsized":"2024-09-10T06:29:40.168415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'10","last_scrub_stamp":"2024-09-10T06:29:40.168233+0000","last_deep_scrub":"76'10","last_deep_scrub_stamp":"2024-09-10T06:29:40.168233+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.168233+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:54.261144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"95'18","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.290785+0000","last_change":"2024-09-10T06:29:35.290785+0000","last_active":"2024-09-10T06:29:35.290785+0000","last_peered":"2024-09-10T06:29:35.290785+0000","last_clean":"2024-09-10T06:29:35.290785+0000","last_became_active":"2024-09-10T06:26:30.605602+0000","last_became_peered":"2024-09-10T06:26:30.605602+0000","last_unstale":"2024-09-10T06:29:35.290785+0000","last_undegraded":"2024-09-10T06:29:35.290785+0000","last_fullsized":"2024-09-10T06:29:35.290785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:35.290595+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:35.290595+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.290595+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:48.831881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.274245+0000","last_change":"2024-09-10T06:29:37.274245+0000","last_active":"2024-09-10T06:29:37.274245+0000","last_peered":"2024-09-10T06:29:37.274245+0000","last_clean":"2024-09-10T06:29:37.274245+0000","last_became_active":"2024-09-10T06:26:32.274264+0000","last_became_peered":"2024-09-10T06:26:32.274264+0000","last_unstale":"2024-09-10T06:29:37.274245+0000","last_undegraded":"2024-09-10T06:29:37.274245+0000","last_fullsized":"2024-09-10T06:29:37.274245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.274064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.274064+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.274064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:35.281894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'10","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.448555+0000","last_change":"2024-09-10T06:29:31.448555+0000","last_active":"2024-09-10T06:29:31.448555+0000","last_peered":"2024-09-10T06:29:31.448555+0000","last_clean":"2024-09-10T06:29:31.448555+0000","last_became_active":"2024-09-10T06:28:46.332355+0000","last_became_peered":"2024-09-10T06:28:46.332355+0000","last_unstale":"2024-09-10T06:29:31.448555+0000","last_undegraded":"2024-09-10T06:29:31.448555+0000","last_fullsized":"2024-09-10T06:29:31.448555+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-10T06:29:31.448378+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-10T06:29:31.448378+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.448378+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:22.005148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.327524+0000","last_change":"2024-09-10T06:29:37.327524+0000","last_active":"2024-09-10T06:29:37.327524+0000","last_peered":"2024-09-10T06:29:37.327524+0000","last_clean":"2024-09-10T06:29:37.327524+0000","last_became_active":"2024-09-10T06:26:32.278407+0000","last_became_peered":"2024-09-10T06:26:32.278407+0000","last_unstale":"2024-09-10T06:29:37.327524+0000","last_undegraded":"2024-09-10T06:29:37.327524+0000","last_fullsized":"2024-09-10T06:29:37.327524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.327343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.327343+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.327343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:43.648199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"95'20","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.434236+0000","last_change":"2024-09-10T06:29:30.434236+0000","last_active":"2024-09-10T06:29:30.434236+0000","last_peered":"2024-09-10T06:29:30.434236+0000","last_clean":"2024-09-10T06:29:30.434236+0000","last_became_active":"2024-09-10T06:26:30.606807+0000","last_became_peered":"2024-09-10T06:26:30.606807+0000","last_unstale":"2024-09-10T06:29:30.434236+0000","last_undegraded":"2024-09-10T06:29:30.434236+0000","last_fullsized":"2024-09-10T06:29:30.434236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:30.434051+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:30.434051+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.434051+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:40.417294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"76'8","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.536701+0000","last_change":"2024-09-10T06:29:32.536701+0000","last_active":"2024-09-10T06:29:32.536701+0000","last_peered":"2024-09-10T06:29:32.536701+0000","last_clean":"2024-09-10T06:29:32.536701+0000","last_became_active":"2024-09-10T06:27:08.801461+0000","last_became_peered":"2024-09-10T06:27:08.801461+0000","last_unstale":"2024-09-10T06:29:32.536701+0000","last_undegraded":"2024-09-10T06:29:32.536701+0000","last_fullsized":"2024-09-10T06:29:32.536701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'8","last_scrub_stamp":"2024-09-10T06:29:32.536506+0000","last_deep_scrub":"76'8","last_deep_scrub_stamp":"2024-09-10T06:29:32.536506+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.536506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:43.474143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"95'22","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.069975+0000","last_change":"2024-09-10T06:29:27.069975+0000","last_active":"2024-09-10T06:29:27.069975+0000","last_peered":"2024-09-10T06:29:27.069975+0000","last_clean":"2024-09-10T06:29:27.069975+0000","last_became_active":"2024-09-10T06:26:30.597271+0000","last_became_peered":"2024-09-10T06:26:30.597271+0000","last_unstale":"2024-09-10T06:29:27.069975+0000","last_undegraded":"2024-09-10T06:29:27.069975+0000","last_fullsized":"2024-09-10T06:29:27.069975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:27.069733+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:27.069733+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.069733+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:42.474681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.482195+0000","last_change":"2024-09-10T06:29:30.482195+0000","last_active":"2024-09-10T06:29:30.482195+0000","last_peered":"2024-09-10T06:29:30.482195+0000","last_clean":"2024-09-10T06:29:30.482195+0000","last_became_active":"2024-09-10T06:26:32.246938+0000","last_became_peered":"2024-09-10T06:26:32.246938+0000","last_unstale":"2024-09-10T06:29:30.482195+0000","last_undegraded":"2024-09-10T06:29:30.482195+0000","last_fullsized":"2024-09-10T06:29:30.482195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:30.481993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:30.481993+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.481993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:26.249980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"95'22","reported_seq":236,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.153479+0000","last_change":"2024-09-10T06:29:28.153479+0000","last_active":"2024-09-10T06:29:28.153479+0000","last_peered":"2024-09-10T06:29:28.153479+0000","last_clean":"2024-09-10T06:29:28.153479+0000","last_became_active":"2024-09-10T06:28:46.326710+0000","last_became_peered":"2024-09-10T06:28:46.326710+0000","last_unstale":"2024-09-10T06:29:28.153479+0000","last_undegraded":"2024-09-10T06:29:28.153479+0000","last_fullsized":"2024-09-10T06:29:28.153479+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:28.153264+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:28.153264+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.153264+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:44.327241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.145264+0000","last_change":"2024-09-10T06:29:41.145264+0000","last_active":"2024-09-10T06:29:41.145264+0000","last_peered":"2024-09-10T06:29:41.145264+0000","last_clean":"2024-09-10T06:29:41.145264+0000","last_became_active":"2024-09-10T06:26:32.275206+0000","last_became_peered":"2024-09-10T06:26:32.275206+0000","last_unstale":"2024-09-10T06:29:41.145264+0000","last_undegraded":"2024-09-10T06:29:41.145264+0000","last_fullsized":"2024-09-10T06:29:41.145264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:41.145065+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:41.145065+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.145065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:08.294547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"95'24","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.531466+0000","last_change":"2024-09-10T06:29:29.531466+0000","last_active":"2024-09-10T06:29:29.531466+0000","last_peered":"2024-09-10T06:29:29.531466+0000","last_clean":"2024-09-10T06:29:29.531466+0000","last_became_active":"2024-09-10T06:26:30.572043+0000","last_became_peered":"2024-09-10T06:26:30.572043+0000","last_unstale":"2024-09-10T06:29:29.531466+0000","last_undegraded":"2024-09-10T06:29:29.531466+0000","last_fullsized":"2024-09-10T06:29:29.531466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:29.531261+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:29.531261+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.531261+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:28.219225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":32,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"76'2","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:58.265425+0000","last_change":"2024-09-10T06:29:58.265425+0000","last_active":"2024-09-10T06:29:58.265425+0000","last_peered":"2024-09-10T06:29:58.265425+0000","last_clean":"2024-09-10T06:29:58.265425+0000","last_became_active":"2024-09-10T06:26:40.322711+0000","last_became_peered":"2024-09-10T06:26:40.322711+0000","last_unstale":"2024-09-10T06:29:58.265425+0000","last_undegraded":"2024-09-10T06:29:58.265425+0000","last_fullsized":"2024-09-10T06:29:58.265425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:58.265232+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:58.265232+0000","last_clean_scrub_stamp":"2024-09-10T06:29:58.265232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:04.531119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.095654+0000","last_change":"2024-09-10T06:29:34.095654+0000","last_active":"2024-09-10T06:29:34.095654+0000","last_peered":"2024-09-10T06:29:34.095654+0000","last_clean":"2024-09-10T06:29:34.095654+0000","last_became_active":"2024-09-10T06:26:32.275889+0000","last_became_peered":"2024-09-10T06:26:32.275889+0000","last_unstale":"2024-09-10T06:29:34.095654+0000","last_undegraded":"2024-09-10T06:29:34.095654+0000","last_fullsized":"2024-09-10T06:29:34.095654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:34.095475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:34.095475+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.095475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:44.266638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"95'28","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.363170+0000","last_change":"2024-09-10T06:29:32.363170+0000","last_active":"2024-09-10T06:29:32.363170+0000","last_peered":"2024-09-10T06:29:32.363170+0000","last_clean":"2024-09-10T06:29:32.363170+0000","last_became_active":"2024-09-10T06:26:30.595128+0000","last_became_peered":"2024-09-10T06:26:30.595128+0000","last_unstale":"2024-09-10T06:29:32.363170+0000","last_undegraded":"2024-09-10T06:29:32.363170+0000","last_fullsized":"2024-09-10T06:29:32.363170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'28","last_scrub_stamp":"2024-09-10T06:29:32.362977+0000","last_deep_scrub":"95'28","last_deep_scrub_stamp":"2024-09-10T06:29:32.362977+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.362977+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:54.103860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:43.229588+0000","last_change":"2024-09-10T06:29:43.229588+0000","last_active":"2024-09-10T06:29:43.229588+0000","last_peered":"2024-09-10T06:29:43.229588+0000","last_clean":"2024-09-10T06:29:43.229588+0000","last_became_active":"2024-09-10T06:26:34.279074+0000","last_became_peered":"2024-09-10T06:26:34.279074+0000","last_unstale":"2024-09-10T06:29:43.229588+0000","last_undegraded":"2024-09-10T06:29:43.229588+0000","last_fullsized":"2024-09-10T06:29:43.229588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:43.229332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:43.229332+0000","last_clean_scrub_stamp":"2024-09-10T06:29:43.229332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:58.459037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"95'21","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:47.486201+0000","last_change":"2024-09-10T06:29:47.486201+0000","last_active":"2024-09-10T06:29:47.486201+0000","last_peered":"2024-09-10T06:29:47.486201+0000","last_clean":"2024-09-10T06:29:47.486201+0000","last_became_active":"2024-09-10T06:26:36.295786+0000","last_became_peered":"2024-09-10T06:26:36.295786+0000","last_unstale":"2024-09-10T06:29:47.486201+0000","last_undegraded":"2024-09-10T06:29:47.486201+0000","last_fullsized":"2024-09-10T06:29:47.486201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'21","last_scrub_stamp":"2024-09-10T06:29:47.485967+0000","last_deep_scrub":"95'21","last_deep_scrub_stamp":"2024-09-10T06:29:47.485967+0000","last_clean_scrub_stamp":"2024-09-10T06:29:47.485967+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:19.812836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:54.325253+0000","last_change":"2024-09-10T06:29:54.325253+0000","last_active":"2024-09-10T06:29:54.325253+0000","last_peered":"2024-09-10T06:29:54.325253+0000","last_clean":"2024-09-10T06:29:54.325253+0000","last_became_active":"2024-09-10T06:26:38.304847+0000","last_became_peered":"2024-09-10T06:26:38.304847+0000","last_unstale":"2024-09-10T06:29:54.325253+0000","last_undegraded":"2024-09-10T06:29:54.325253+0000","last_fullsized":"2024-09-10T06:29:54.325253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:54.325077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:54.325077+0000","last_clean_scrub_stamp":"2024-09-10T06:29:54.325077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:34.303803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:56.332209+0000","last_change":"2024-09-10T06:29:56.332209+0000","last_active":"2024-09-10T06:29:56.332209+0000","last_peered":"2024-09-10T06:29:56.332209+0000","last_clean":"2024-09-10T06:29:56.332209+0000","last_became_active":"2024-09-10T06:26:40.330777+0000","last_became_peered":"2024-09-10T06:26:40.330777+0000","last_unstale":"2024-09-10T06:29:56.332209+0000","last_undegraded":"2024-09-10T06:29:56.332209+0000","last_fullsized":"2024-09-10T06:29:56.332209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:56.332038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:56.332038+0000","last_clean_scrub_stamp":"2024-09-10T06:29:56.332038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:10.323547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.286857+0000","last_change":"2024-09-10T06:29:35.286857+0000","last_active":"2024-09-10T06:29:35.286857+0000","last_peered":"2024-09-10T06:29:35.286857+0000","last_clean":"2024-09-10T06:29:35.286857+0000","last_became_active":"2024-09-10T06:26:32.282263+0000","last_became_peered":"2024-09-10T06:26:32.282263+0000","last_unstale":"2024-09-10T06:29:35.286857+0000","last_undegraded":"2024-09-10T06:29:35.286857+0000","last_fullsized":"2024-09-10T06:29:35.286857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:35.286670+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:35.286670+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.286670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:17.003291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"95'14","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:21.505766+0000","last_change":"2024-09-10T06:29:21.505766+0000","last_active":"2024-09-10T06:29:21.505766+0000","last_peered":"2024-09-10T06:29:21.505766+0000","last_clean":"2024-09-10T06:29:21.505766+0000","last_became_active":"2024-09-10T06:26:30.576039+0000","last_became_peered":"2024-09-10T06:26:30.576039+0000","last_unstale":"2024-09-10T06:29:21.505766+0000","last_undegraded":"2024-09-10T06:29:21.505766+0000","last_fullsized":"2024-09-10T06:29:21.505766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:21.505699+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:21.505699+0000","last_clean_scrub_stamp":"2024-09-10T06:29:21.505699+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:43.246582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:43.851660+0000","last_change":"2024-09-10T06:29:43.851660+0000","last_active":"2024-09-10T06:29:43.851660+0000","last_peered":"2024-09-10T06:29:43.851660+0000","last_clean":"2024-09-10T06:29:43.851660+0000","last_became_active":"2024-09-10T06:26:34.268279+0000","last_became_peered":"2024-09-10T06:26:34.268279+0000","last_unstale":"2024-09-10T06:29:43.851660+0000","last_undegraded":"2024-09-10T06:29:43.851660+0000","last_fullsized":"2024-09-10T06:29:43.851660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:43.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:43.851456+0000","last_clean_scrub_stamp":"2024-09-10T06:29:43.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:50.117344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"95'9","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:50.268248+0000","last_change":"2024-09-10T06:29:50.268248+0000","last_active":"2024-09-10T06:29:50.268248+0000","last_peered":"2024-09-10T06:29:50.268248+0000","last_clean":"2024-09-10T06:29:50.268248+0000","last_became_active":"2024-09-10T06:26:36.273138+0000","last_became_peered":"2024-09-10T06:26:36.273138+0000","last_unstale":"2024-09-10T06:29:50.268248+0000","last_undegraded":"2024-09-10T06:29:50.268248+0000","last_fullsized":"2024-09-10T06:29:50.268248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'9","last_scrub_stamp":"2024-09-10T06:29:50.268047+0000","last_deep_scrub":"95'9","last_deep_scrub_stamp":"2024-09-10T06:29:50.268047+0000","last_clean_scrub_stamp":"2024-09-10T06:29:50.268047+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:33.400376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:54.231269+0000","last_change":"2024-09-10T06:29:54.231269+0000","last_active":"2024-09-10T06:29:54.231269+0000","last_peered":"2024-09-10T06:29:54.231269+0000","last_clean":"2024-09-10T06:29:54.231269+0000","last_became_active":"2024-09-10T06:26:38.293754+0000","last_became_peered":"2024-09-10T06:26:38.293754+0000","last_unstale":"2024-09-10T06:29:54.231269+0000","last_undegraded":"2024-09-10T06:29:54.231269+0000","last_fullsized":"2024-09-10T06:29:54.231269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:54.231086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:54.231086+0000","last_clean_scrub_stamp":"2024-09-10T06:29:54.231086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:25:09.940441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"62'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:57.478403+0000","last_change":"2024-09-10T06:29:57.478403+0000","last_active":"2024-09-10T06:29:57.478403+0000","last_peered":"2024-09-10T06:29:57.478403+0000","last_clean":"2024-09-10T06:29:57.478403+0000","last_became_active":"2024-09-10T06:26:40.322648+0000","last_became_peered":"2024-09-10T06:26:40.322648+0000","last_unstale":"2024-09-10T06:29:57.478403+0000","last_undegraded":"2024-09-10T06:29:57.478403+0000","last_fullsized":"2024-09-10T06:29:57.478403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-10T06:29:57.478212+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-10T06:29:57.478212+0000","last_clean_scrub_stamp":"2024-09-10T06:29:57.478212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:59.541252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"76'4","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.591930+0000","last_change":"2024-09-10T06:29:34.591930+0000","last_active":"2024-09-10T06:29:34.591930+0000","last_peered":"2024-09-10T06:29:34.591930+0000","last_clean":"2024-09-10T06:29:34.591930+0000","last_became_active":"2024-09-10T06:26:32.256701+0000","last_became_peered":"2024-09-10T06:26:32.256701+0000","last_unstale":"2024-09-10T06:29:34.591930+0000","last_undegraded":"2024-09-10T06:29:34.591930+0000","last_fullsized":"2024-09-10T06:29:34.591930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:34.591748+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:34.591748+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.591748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:42.899472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"95'26","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.309115+0000","last_change":"2024-09-10T06:29:30.309115+0000","last_active":"2024-09-10T06:29:30.309115+0000","last_peered":"2024-09-10T06:29:30.309115+0000","last_clean":"2024-09-10T06:29:30.309115+0000","last_became_active":"2024-09-10T06:26:30.597703+0000","last_became_peered":"2024-09-10T06:26:30.597703+0000","last_unstale":"2024-09-10T06:29:30.309115+0000","last_undegraded":"2024-09-10T06:29:30.309115+0000","last_fullsized":"2024-09-10T06:29:30.309115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-10T06:29:30.308944+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-10T06:29:30.308944+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.308944+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:32.390030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:44.860339+0000","last_change":"2024-09-10T06:29:44.860339+0000","last_active":"2024-09-10T06:29:44.860339+0000","last_peered":"2024-09-10T06:29:44.860339+0000","last_clean":"2024-09-10T06:29:44.860339+0000","last_became_active":"2024-09-10T06:26:34.268192+0000","last_became_peered":"2024-09-10T06:26:34.268192+0000","last_unstale":"2024-09-10T06:29:44.860339+0000","last_undegraded":"2024-09-10T06:29:44.860339+0000","last_fullsized":"2024-09-10T06:29:44.860339+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:44.860145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:44.860145+0000","last_clean_scrub_stamp":"2024-09-10T06:29:44.860145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:02.333696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"95'15","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.486844+0000","last_change":"2024-09-10T06:29:39.486844+0000","last_active":"2024-09-10T06:29:39.486844+0000","last_peered":"2024-09-10T06:29:39.486844+0000","last_clean":"2024-09-10T06:29:39.486844+0000","last_became_active":"2024-09-10T06:26:36.275306+0000","last_became_peered":"2024-09-10T06:26:36.275306+0000","last_unstale":"2024-09-10T06:29:39.486844+0000","last_undegraded":"2024-09-10T06:29:39.486844+0000","last_fullsized":"2024-09-10T06:29:39.486844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'15","last_scrub_stamp":"2024-09-10T06:29:39.486605+0000","last_deep_scrub":"95'15","last_deep_scrub_stamp":"2024-09-10T06:29:39.486605+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.486605+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:49.469847+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'106","reported_seq":414,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:53.331986+0000","last_change":"2024-09-10T06:29:53.331986+0000","last_active":"2024-09-10T06:29:53.331986+0000","last_peered":"2024-09-10T06:29:53.331986+0000","last_clean":"2024-09-10T06:29:53.331986+0000","last_became_active":"2024-09-10T06:26:38.300326+0000","last_became_peered":"2024-09-10T06:26:38.300326+0000","last_unstale":"2024-09-10T06:29:53.331986+0000","last_undegraded":"2024-09-10T06:29:53.331986+0000","last_fullsized":"2024-09-10T06:29:53.331986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'106","last_scrub_stamp":"2024-09-10T06:29:53.331817+0000","last_deep_scrub":"95'106","last_deep_scrub_stamp":"2024-09-10T06:29:53.331817+0000","last_clean_scrub_stamp":"2024-09-10T06:29:53.331817+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:12.531124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:59.244786+0000","last_change":"2024-09-10T06:29:59.244786+0000","last_active":"2024-09-10T06:29:59.244786+0000","last_peered":"2024-09-10T06:29:59.244786+0000","last_clean":"2024-09-10T06:29:59.244786+0000","last_became_active":"2024-09-10T06:26:40.297296+0000","last_became_peered":"2024-09-10T06:26:40.297296+0000","last_unstale":"2024-09-10T06:29:59.244786+0000","last_undegraded":"2024-09-10T06:29:59.244786+0000","last_fullsized":"2024-09-10T06:29:59.244786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:59.244599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:59.244599+0000","last_clean_scrub_stamp":"2024-09-10T06:29:59.244599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:16.718150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.011364+0000","last_change":"2024-09-10T06:29:36.011364+0000","last_active":"2024-09-10T06:29:36.011364+0000","last_peered":"2024-09-10T06:29:36.011364+0000","last_clean":"2024-09-10T06:29:36.011364+0000","last_became_active":"2024-09-10T06:26:32.264334+0000","last_became_peered":"2024-09-10T06:26:32.264334+0000","last_unstale":"2024-09-10T06:29:36.011364+0000","last_undegraded":"2024-09-10T06:29:36.011364+0000","last_fullsized":"2024-09-10T06:29:36.011364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:36.011186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:36.011186+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.011186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:25.230585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"95'26","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.499786+0000","last_change":"2024-09-10T06:29:25.499786+0000","last_active":"2024-09-10T06:29:25.499786+0000","last_peered":"2024-09-10T06:29:25.499786+0000","last_clean":"2024-09-10T06:29:25.499786+0000","last_became_active":"2024-09-10T06:26:30.575433+0000","last_became_peered":"2024-09-10T06:26:30.575433+0000","last_unstale":"2024-09-10T06:29:25.499786+0000","last_undegraded":"2024-09-10T06:29:25.499786+0000","last_fullsized":"2024-09-10T06:29:25.499786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-10T06:29:25.499572+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-10T06:29:25.499572+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.499572+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:04.580943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:44.224865+0000","last_change":"2024-09-10T06:29:44.224865+0000","last_active":"2024-09-10T06:29:44.224865+0000","last_peered":"2024-09-10T06:29:44.224865+0000","last_clean":"2024-09-10T06:29:44.224865+0000","last_became_active":"2024-09-10T06:26:34.282941+0000","last_became_peered":"2024-09-10T06:26:34.282941+0000","last_unstale":"2024-09-10T06:29:44.224865+0000","last_undegraded":"2024-09-10T06:29:44.224865+0000","last_fullsized":"2024-09-10T06:29:44.224865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:44.224656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:44.224656+0000","last_clean_scrub_stamp":"2024-09-10T06:29:44.224656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:27.356984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"95'23","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:49.183081+0000","last_change":"2024-09-10T06:29:49.183081+0000","last_active":"2024-09-10T06:29:49.183081+0000","last_peered":"2024-09-10T06:29:49.183081+0000","last_clean":"2024-09-10T06:29:49.183081+0000","last_became_active":"2024-09-10T06:26:36.297309+0000","last_became_peered":"2024-09-10T06:26:36.297309+0000","last_unstale":"2024-09-10T06:29:49.183081+0000","last_undegraded":"2024-09-10T06:29:49.183081+0000","last_fullsized":"2024-09-10T06:29:49.183081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'23","last_scrub_stamp":"2024-09-10T06:29:49.182871+0000","last_deep_scrub":"95'23","last_deep_scrub_stamp":"2024-09-10T06:29:49.182871+0000","last_clean_scrub_stamp":"2024-09-10T06:29:49.182871+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:53.636417+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'106","reported_seq":281,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:57.821156+0000","last_change":"2024-09-10T06:29:57.821156+0000","last_active":"2024-09-10T06:29:57.821156+0000","last_peered":"2024-09-10T06:29:57.821156+0000","last_clean":"2024-09-10T06:29:57.821156+0000","last_became_active":"2024-09-10T06:26:38.299355+0000","last_became_peered":"2024-09-10T06:26:38.299355+0000","last_unstale":"2024-09-10T06:29:57.821156+0000","last_undegraded":"2024-09-10T06:29:57.821156+0000","last_fullsized":"2024-09-10T06:29:57.821156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'106","last_scrub_stamp":"2024-09-10T06:29:57.820950+0000","last_deep_scrub":"95'106","last_deep_scrub_stamp":"2024-09-10T06:29:57.820950+0000","last_clean_scrub_stamp":"2024-09-10T06:29:57.820950+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:56.230004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.286958+0000","last_change":"2024-09-10T06:29:34.286958+0000","last_active":"2024-09-10T06:29:34.286958+0000","last_peered":"2024-09-10T06:29:34.286958+0000","last_clean":"2024-09-10T06:29:34.286958+0000","last_became_active":"2024-09-10T06:26:32.270496+0000","last_became_peered":"2024-09-10T06:26:32.270496+0000","last_unstale":"2024-09-10T06:29:34.286958+0000","last_undegraded":"2024-09-10T06:29:34.286958+0000","last_fullsized":"2024-09-10T06:29:34.286958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:34.286772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:34.286772+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.286772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:10.128919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"95'14","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.358994+0000","last_change":"2024-09-10T06:29:31.358994+0000","last_active":"2024-09-10T06:29:31.358994+0000","last_peered":"2024-09-10T06:29:31.358994+0000","last_clean":"2024-09-10T06:29:31.358994+0000","last_became_active":"2024-09-10T06:26:30.606685+0000","last_became_peered":"2024-09-10T06:26:30.606685+0000","last_unstale":"2024-09-10T06:29:31.358994+0000","last_undegraded":"2024-09-10T06:29:31.358994+0000","last_fullsized":"2024-09-10T06:29:31.358994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:31.358776+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:31.358776+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.358776+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:21.505655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.156236+0000","last_change":"2024-09-10T06:29:40.156236+0000","last_active":"2024-09-10T06:29:40.156236+0000","last_peered":"2024-09-10T06:29:40.156236+0000","last_clean":"2024-09-10T06:29:40.156236+0000","last_became_active":"2024-09-10T06:26:34.285787+0000","last_became_peered":"2024-09-10T06:26:34.285787+0000","last_unstale":"2024-09-10T06:29:40.156236+0000","last_undegraded":"2024-09-10T06:29:40.156236+0000","last_fullsized":"2024-09-10T06:29:40.156236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:40.156062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:40.156062+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.156062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:38.844026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"95'36","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:47.220008+0000","last_change":"2024-09-10T06:29:47.220008+0000","last_active":"2024-09-10T06:29:47.220008+0000","last_peered":"2024-09-10T06:29:47.220008+0000","last_clean":"2024-09-10T06:29:47.220008+0000","last_became_active":"2024-09-10T06:26:36.293226+0000","last_became_peered":"2024-09-10T06:26:36.293226+0000","last_unstale":"2024-09-10T06:29:47.220008+0000","last_undegraded":"2024-09-10T06:29:47.220008+0000","last_fullsized":"2024-09-10T06:29:47.220008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'36","last_scrub_stamp":"2024-09-10T06:29:47.219803+0000","last_deep_scrub":"95'36","last_deep_scrub_stamp":"2024-09-10T06:29:47.219803+0000","last_clean_scrub_stamp":"2024-09-10T06:29:47.219803+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:48.836267+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:45.818620+0000","last_change":"2024-09-10T06:29:45.818620+0000","last_active":"2024-09-10T06:29:45.818620+0000","last_peered":"2024-09-10T06:29:45.818620+0000","last_clean":"2024-09-10T06:29:45.818620+0000","last_became_active":"2024-09-10T06:26:38.304601+0000","last_became_peered":"2024-09-10T06:26:38.304601+0000","last_unstale":"2024-09-10T06:29:45.818620+0000","last_undegraded":"2024-09-10T06:29:45.818620+0000","last_fullsized":"2024-09-10T06:29:45.818620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:45.818412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:45.818412+0000","last_clean_scrub_stamp":"2024-09-10T06:29:45.818412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:11:43.321973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"62'8","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:52.386843+0000","last_change":"2024-09-10T06:29:52.386843+0000","last_active":"2024-09-10T06:29:52.386843+0000","last_peered":"2024-09-10T06:29:52.386843+0000","last_clean":"2024-09-10T06:29:52.386843+0000","last_became_active":"2024-09-10T06:26:40.331262+0000","last_became_peered":"2024-09-10T06:26:40.331262+0000","last_unstale":"2024-09-10T06:29:52.386843+0000","last_undegraded":"2024-09-10T06:29:52.386843+0000","last_fullsized":"2024-09-10T06:29:52.386843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-09-10T06:29:52.386560+0000","last_deep_scrub":"62'8","last_deep_scrub_stamp":"2024-09-10T06:29:52.386560+0000","last_clean_scrub_stamp":"2024-09-10T06:29:52.386560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:24.713429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.063454+0000","last_change":"2024-09-10T06:29:29.063454+0000","last_active":"2024-09-10T06:29:29.063454+0000","last_peered":"2024-09-10T06:29:29.063454+0000","last_clean":"2024-09-10T06:29:29.063454+0000","last_became_active":"2024-09-10T06:26:32.261423+0000","last_became_peered":"2024-09-10T06:26:32.261423+0000","last_unstale":"2024-09-10T06:29:29.063454+0000","last_undegraded":"2024-09-10T06:29:29.063454+0000","last_fullsized":"2024-09-10T06:29:29.063454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:29.063273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:29.063273+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.063273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:03.742022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"95'24","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.284702+0000","last_change":"2024-09-10T06:29:29.284702+0000","last_active":"2024-09-10T06:29:29.284702+0000","last_peered":"2024-09-10T06:29:29.284702+0000","last_clean":"2024-09-10T06:29:29.284702+0000","last_became_active":"2024-09-10T06:26:30.595269+0000","last_became_peered":"2024-09-10T06:26:30.595269+0000","last_unstale":"2024-09-10T06:29:29.284702+0000","last_undegraded":"2024-09-10T06:29:29.284702+0000","last_fullsized":"2024-09-10T06:29:29.284702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:29.284526+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:29.284526+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.284526+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:29.270685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":32,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.528881+0000","last_change":"2024-09-10T06:29:34.528881+0000","last_active":"2024-09-10T06:29:34.528881+0000","last_peered":"2024-09-10T06:29:34.528881+0000","last_clean":"2024-09-10T06:29:34.528881+0000","last_became_active":"2024-09-10T06:26:34.266017+0000","last_became_peered":"2024-09-10T06:26:34.266017+0000","last_unstale":"2024-09-10T06:29:34.528881+0000","last_undegraded":"2024-09-10T06:29:34.528881+0000","last_fullsized":"2024-09-10T06:29:34.528881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:34.528700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:34.528700+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.528700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:16.132928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"95'24","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:49.919331+0000","last_change":"2024-09-10T06:29:49.919331+0000","last_active":"2024-09-10T06:29:49.919331+0000","last_peered":"2024-09-10T06:29:49.919331+0000","last_clean":"2024-09-10T06:29:49.919331+0000","last_became_active":"2024-09-10T06:26:36.295796+0000","last_became_peered":"2024-09-10T06:26:36.295796+0000","last_unstale":"2024-09-10T06:29:49.919331+0000","last_undegraded":"2024-09-10T06:29:49.919331+0000","last_fullsized":"2024-09-10T06:29:49.919331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:49.919119+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:49.919119+0000","last_clean_scrub_stamp":"2024-09-10T06:29:49.919119+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:44.722255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":38,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:55.793367+0000","last_change":"2024-09-10T06:29:55.793367+0000","last_active":"2024-09-10T06:29:55.793367+0000","last_peered":"2024-09-10T06:29:55.793367+0000","last_clean":"2024-09-10T06:29:55.793367+0000","last_became_active":"2024-09-10T06:26:38.296455+0000","last_became_peered":"2024-09-10T06:26:38.296455+0000","last_unstale":"2024-09-10T06:29:55.793367+0000","last_undegraded":"2024-09-10T06:29:55.793367+0000","last_fullsized":"2024-09-10T06:29:55.793367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:55.793162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:55.793162+0000","last_clean_scrub_stamp":"2024-09-10T06:29:55.793162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:20.586356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:46.517907+0000","last_change":"2024-09-10T06:29:46.517907+0000","last_active":"2024-09-10T06:29:46.517907+0000","last_peered":"2024-09-10T06:29:46.517907+0000","last_clean":"2024-09-10T06:29:46.517907+0000","last_became_active":"2024-09-10T06:26:40.327585+0000","last_became_peered":"2024-09-10T06:26:40.327585+0000","last_unstale":"2024-09-10T06:29:46.517907+0000","last_undegraded":"2024-09-10T06:29:46.517907+0000","last_fullsized":"2024-09-10T06:29:46.517907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:46.517708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:46.517708+0000","last_clean_scrub_stamp":"2024-09-10T06:29:46.517708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:00.058994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.376436+0000","last_change":"2024-09-10T06:29:34.376436+0000","last_active":"2024-09-10T06:29:34.376436+0000","last_peered":"2024-09-10T06:29:34.376436+0000","last_clean":"2024-09-10T06:29:34.376436+0000","last_became_active":"2024-09-10T06:27:08.599875+0000","last_became_peered":"2024-09-10T06:27:08.599875+0000","last_unstale":"2024-09-10T06:29:34.376436+0000","last_undegraded":"2024-09-10T06:29:34.376436+0000","last_fullsized":"2024-09-10T06:29:34.376436+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:34.376265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:34.376265+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.376265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:57.000500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"95'14","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.294397+0000","last_change":"2024-09-10T06:29:27.294397+0000","last_active":"2024-09-10T06:29:27.294397+0000","last_peered":"2024-09-10T06:29:27.294397+0000","last_clean":"2024-09-10T06:29:27.294397+0000","last_became_active":"2024-09-10T06:26:30.611039+0000","last_became_peered":"2024-09-10T06:26:30.611039+0000","last_unstale":"2024-09-10T06:29:27.294397+0000","last_undegraded":"2024-09-10T06:29:27.294397+0000","last_fullsized":"2024-09-10T06:29:27.294397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:27.294207+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:27.294207+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.294207+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:06.186017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.512254+0000","last_change":"2024-09-10T06:29:37.512254+0000","last_active":"2024-09-10T06:29:37.512254+0000","last_peered":"2024-09-10T06:29:37.512254+0000","last_clean":"2024-09-10T06:29:37.512254+0000","last_became_active":"2024-09-10T06:26:34.262793+0000","last_became_peered":"2024-09-10T06:26:34.262793+0000","last_unstale":"2024-09-10T06:29:37.512254+0000","last_undegraded":"2024-09-10T06:29:37.512254+0000","last_fullsized":"2024-09-10T06:29:37.512254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.512054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.512054+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.512054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:24.188192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"95'32","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:47.239786+0000","last_change":"2024-09-10T06:29:47.239786+0000","last_active":"2024-09-10T06:29:47.239786+0000","last_peered":"2024-09-10T06:29:47.239786+0000","last_clean":"2024-09-10T06:29:47.239786+0000","last_became_active":"2024-09-10T06:26:36.299140+0000","last_became_peered":"2024-09-10T06:26:36.299140+0000","last_unstale":"2024-09-10T06:29:47.239786+0000","last_undegraded":"2024-09-10T06:29:47.239786+0000","last_fullsized":"2024-09-10T06:29:47.239786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'32","last_scrub_stamp":"2024-09-10T06:29:47.239597+0000","last_deep_scrub":"95'32","last_deep_scrub_stamp":"2024-09-10T06:29:47.239597+0000","last_clean_scrub_stamp":"2024-09-10T06:29:47.239597+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:59.184404+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":44,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'106","reported_seq":279,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:50.514697+0000","last_change":"2024-09-10T06:29:50.514697+0000","last_active":"2024-09-10T06:29:50.514697+0000","last_peered":"2024-09-10T06:29:50.514697+0000","last_clean":"2024-09-10T06:29:50.514697+0000","last_became_active":"2024-09-10T06:26:38.291322+0000","last_became_peered":"2024-09-10T06:26:38.291322+0000","last_unstale":"2024-09-10T06:29:50.514697+0000","last_undegraded":"2024-09-10T06:29:50.514697+0000","last_fullsized":"2024-09-10T06:29:50.514697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'106","last_scrub_stamp":"2024-09-10T06:29:50.514483+0000","last_deep_scrub":"95'106","last_deep_scrub_stamp":"2024-09-10T06:29:50.514483+0000","last_clean_scrub_stamp":"2024-09-10T06:29:50.514483+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:42.206342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"64'2","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:54.457969+0000","last_change":"2024-09-10T06:29:54.457969+0000","last_active":"2024-09-10T06:29:54.457969+0000","last_peered":"2024-09-10T06:29:54.457969+0000","last_clean":"2024-09-10T06:29:54.457969+0000","last_became_active":"2024-09-10T06:26:40.323249+0000","last_became_peered":"2024-09-10T06:26:40.323249+0000","last_unstale":"2024-09-10T06:29:54.457969+0000","last_undegraded":"2024-09-10T06:29:54.457969+0000","last_fullsized":"2024-09-10T06:29:54.457969+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'2","last_scrub_stamp":"2024-09-10T06:29:54.457792+0000","last_deep_scrub":"64'2","last_deep_scrub_stamp":"2024-09-10T06:29:54.457792+0000","last_clean_scrub_stamp":"2024-09-10T06:29:54.457792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:06.054141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.604989+0000","last_change":"2024-09-10T06:29:33.604989+0000","last_active":"2024-09-10T06:29:33.604989+0000","last_peered":"2024-09-10T06:29:33.604989+0000","last_clean":"2024-09-10T06:29:33.604989+0000","last_became_active":"2024-09-10T06:26:32.274496+0000","last_became_peered":"2024-09-10T06:26:32.274496+0000","last_unstale":"2024-09-10T06:29:33.604989+0000","last_undegraded":"2024-09-10T06:29:33.604989+0000","last_fullsized":"2024-09-10T06:29:33.604989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:33.604805+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:33.604805+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.604805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:39.925661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"95'14","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.434461+0000","last_change":"2024-09-10T06:29:24.434461+0000","last_active":"2024-09-10T06:29:24.434461+0000","last_peered":"2024-09-10T06:29:24.434461+0000","last_clean":"2024-09-10T06:29:24.434461+0000","last_became_active":"2024-09-10T06:26:30.593432+0000","last_became_peered":"2024-09-10T06:26:30.593432+0000","last_unstale":"2024-09-10T06:29:24.434461+0000","last_undegraded":"2024-09-10T06:29:24.434461+0000","last_fullsized":"2024-09-10T06:29:24.434461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:24.434275+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:24.434275+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.434275+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:42.528344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.537178+0000","last_change":"2024-09-10T06:29:35.537178+0000","last_active":"2024-09-10T06:29:35.537178+0000","last_peered":"2024-09-10T06:29:35.537178+0000","last_clean":"2024-09-10T06:29:35.537178+0000","last_became_active":"2024-09-10T06:26:34.256256+0000","last_became_peered":"2024-09-10T06:26:34.256256+0000","last_unstale":"2024-09-10T06:29:35.537178+0000","last_undegraded":"2024-09-10T06:29:35.537178+0000","last_fullsized":"2024-09-10T06:29:35.537178+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:35.536986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:35.536986+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.536986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:46.124657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"95'36","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:43.584421+0000","last_change":"2024-09-10T06:29:43.584421+0000","last_active":"2024-09-10T06:29:43.584421+0000","last_peered":"2024-09-10T06:29:43.584421+0000","last_clean":"2024-09-10T06:29:43.584421+0000","last_became_active":"2024-09-10T06:26:36.295838+0000","last_became_peered":"2024-09-10T06:26:36.295838+0000","last_unstale":"2024-09-10T06:29:43.584421+0000","last_undegraded":"2024-09-10T06:29:43.584421+0000","last_fullsized":"2024-09-10T06:29:43.584421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'36","last_scrub_stamp":"2024-09-10T06:29:43.584159+0000","last_deep_scrub":"95'36","last_deep_scrub_stamp":"2024-09-10T06:29:43.584159+0000","last_clean_scrub_stamp":"2024-09-10T06:29:43.584159+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:23.562884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":49,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.492017+0000","last_change":"2024-09-10T06:29:40.492017+0000","last_active":"2024-09-10T06:29:40.492017+0000","last_peered":"2024-09-10T06:29:40.492017+0000","last_clean":"2024-09-10T06:29:40.492017+0000","last_became_active":"2024-09-10T06:26:38.307965+0000","last_became_peered":"2024-09-10T06:26:38.307965+0000","last_unstale":"2024-09-10T06:29:40.492017+0000","last_undegraded":"2024-09-10T06:29:40.492017+0000","last_fullsized":"2024-09-10T06:29:40.492017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:40.491832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:40.491832+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.491832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:12.085817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"62'4","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:50.826270+0000","last_change":"2024-09-10T06:29:50.826270+0000","last_active":"2024-09-10T06:29:50.826270+0000","last_peered":"2024-09-10T06:29:50.826270+0000","last_clean":"2024-09-10T06:29:50.826270+0000","last_became_active":"2024-09-10T06:26:40.325731+0000","last_became_peered":"2024-09-10T06:26:40.325731+0000","last_unstale":"2024-09-10T06:29:50.826270+0000","last_undegraded":"2024-09-10T06:29:50.826270+0000","last_fullsized":"2024-09-10T06:29:50.826270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-10T06:29:50.826070+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-10T06:29:50.826070+0000","last_clean_scrub_stamp":"2024-09-10T06:29:50.826070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:53.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"64'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.101641+0000","last_change":"2024-09-10T06:29:30.101641+0000","last_active":"2024-09-10T06:29:30.101641+0000","last_peered":"2024-09-10T06:29:30.101641+0000","last_clean":"2024-09-10T06:29:30.101641+0000","last_became_active":"2024-09-10T06:26:32.253154+0000","last_became_peered":"2024-09-10T06:26:32.253154+0000","last_unstale":"2024-09-10T06:29:30.101641+0000","last_undegraded":"2024-09-10T06:29:30.101641+0000","last_fullsized":"2024-09-10T06:29:30.101641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'2","last_scrub_stamp":"2024-09-10T06:29:30.101463+0000","last_deep_scrub":"64'2","last_deep_scrub_stamp":"2024-09-10T06:29:30.101463+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.101463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:48.195532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'10","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.070099+0000","last_change":"2024-09-10T06:29:25.070099+0000","last_active":"2024-09-10T06:29:25.070099+0000","last_peered":"2024-09-10T06:29:25.070099+0000","last_clean":"2024-09-10T06:29:25.070099+0000","last_became_active":"2024-09-10T06:26:30.571829+0000","last_became_peered":"2024-09-10T06:26:30.571829+0000","last_unstale":"2024-09-10T06:29:25.070099+0000","last_undegraded":"2024-09-10T06:29:25.070099+0000","last_fullsized":"2024-09-10T06:29:25.070099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-10T06:29:25.069903+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-10T06:29:25.069903+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.069903+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:04.002647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.510461+0000","last_change":"2024-09-10T06:29:38.510461+0000","last_active":"2024-09-10T06:29:38.510461+0000","last_peered":"2024-09-10T06:29:38.510461+0000","last_clean":"2024-09-10T06:29:38.510461+0000","last_became_active":"2024-09-10T06:26:34.285004+0000","last_became_peered":"2024-09-10T06:26:34.285004+0000","last_unstale":"2024-09-10T06:29:38.510461+0000","last_undegraded":"2024-09-10T06:29:38.510461+0000","last_fullsized":"2024-09-10T06:29:38.510461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:38.510241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:38.510241+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.510241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:21.881655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"95'30","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:49.242923+0000","last_change":"2024-09-10T06:29:49.242923+0000","last_active":"2024-09-10T06:29:49.242923+0000","last_peered":"2024-09-10T06:29:49.242923+0000","last_clean":"2024-09-10T06:29:49.242923+0000","last_became_active":"2024-09-10T06:26:36.292423+0000","last_became_peered":"2024-09-10T06:26:36.292423+0000","last_unstale":"2024-09-10T06:29:49.242923+0000","last_undegraded":"2024-09-10T06:29:49.242923+0000","last_fullsized":"2024-09-10T06:29:49.242923+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'30","last_scrub_stamp":"2024-09-10T06:29:49.242696+0000","last_deep_scrub":"95'30","last_deep_scrub_stamp":"2024-09-10T06:29:49.242696+0000","last_clean_scrub_stamp":"2024-09-10T06:29:49.242696+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:57.421690+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":30,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3102,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:51.500722+0000","last_change":"2024-09-10T06:29:51.500722+0000","last_active":"2024-09-10T06:29:51.500722+0000","last_peered":"2024-09-10T06:29:51.500722+0000","last_clean":"2024-09-10T06:29:51.500722+0000","last_became_active":"2024-09-10T06:26:38.292918+0000","last_became_peered":"2024-09-10T06:26:38.292918+0000","last_unstale":"2024-09-10T06:29:51.500722+0000","last_undegraded":"2024-09-10T06:29:51.500722+0000","last_fullsized":"2024-09-10T06:29:51.500722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:51.500433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:51.500433+0000","last_clean_scrub_stamp":"2024-09-10T06:29:51.500433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:05.491942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.376446+0000","last_change":"2024-09-10T06:26:40.327061+0000","last_active":"2024-09-10T06:28:48.376446+0000","last_peered":"2024-09-10T06:28:48.376446+0000","last_clean":"2024-09-10T06:28:48.376446+0000","last_became_active":"2024-09-10T06:26:40.326431+0000","last_became_peered":"2024-09-10T06:26:40.326431+0000","last_unstale":"2024-09-10T06:28:48.376446+0000","last_undegraded":"2024-09-10T06:28:48.376446+0000","last_fullsized":"2024-09-10T06:28:48.376446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:27.631214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"64'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.105015+0000","last_change":"2024-09-10T06:29:31.105015+0000","last_active":"2024-09-10T06:29:31.105015+0000","last_peered":"2024-09-10T06:29:31.105015+0000","last_clean":"2024-09-10T06:29:31.105015+0000","last_became_active":"2024-09-10T06:26:32.253524+0000","last_became_peered":"2024-09-10T06:26:32.253524+0000","last_unstale":"2024-09-10T06:29:31.105015+0000","last_undegraded":"2024-09-10T06:29:31.105015+0000","last_fullsized":"2024-09-10T06:29:31.105015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'2","last_scrub_stamp":"2024-09-10T06:29:31.104822+0000","last_deep_scrub":"64'2","last_deep_scrub_stamp":"2024-09-10T06:29:31.104822+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.104822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:52.845705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'16","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.518214+0000","last_change":"2024-09-10T06:29:24.518214+0000","last_active":"2024-09-10T06:29:24.518214+0000","last_peered":"2024-09-10T06:29:24.518214+0000","last_clean":"2024-09-10T06:29:24.518214+0000","last_became_active":"2024-09-10T06:26:30.591125+0000","last_became_peered":"2024-09-10T06:26:30.591125+0000","last_unstale":"2024-09-10T06:29:24.518214+0000","last_undegraded":"2024-09-10T06:29:24.518214+0000","last_fullsized":"2024-09-10T06:29:24.518214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:24.518012+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:24.518012+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.518012+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:35.325269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.776224+0000","last_change":"2024-09-10T06:29:37.776224+0000","last_active":"2024-09-10T06:29:37.776224+0000","last_peered":"2024-09-10T06:29:37.776224+0000","last_clean":"2024-09-10T06:29:37.776224+0000","last_became_active":"2024-09-10T06:26:34.280058+0000","last_became_peered":"2024-09-10T06:26:34.280058+0000","last_unstale":"2024-09-10T06:29:37.776224+0000","last_undegraded":"2024-09-10T06:29:37.776224+0000","last_fullsized":"2024-09-10T06:29:37.776224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.776040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.776040+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.776040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:42.371352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"95'33","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.496560+0000","last_change":"2024-09-10T06:29:41.496560+0000","last_active":"2024-09-10T06:29:41.496560+0000","last_peered":"2024-09-10T06:29:41.496560+0000","last_clean":"2024-09-10T06:29:41.496560+0000","last_became_active":"2024-09-10T06:26:36.276965+0000","last_became_peered":"2024-09-10T06:26:36.276965+0000","last_unstale":"2024-09-10T06:29:41.496560+0000","last_undegraded":"2024-09-10T06:29:41.496560+0000","last_fullsized":"2024-09-10T06:29:41.496560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'33","last_scrub_stamp":"2024-09-10T06:29:41.496344+0000","last_deep_scrub":"95'33","last_deep_scrub_stamp":"2024-09-10T06:29:41.496344+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.496344+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:37.636104+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1348,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'105","reported_seq":309,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.490221+0000","last_change":"2024-09-10T06:29:42.490221+0000","last_active":"2024-09-10T06:29:42.490221+0000","last_peered":"2024-09-10T06:29:42.490221+0000","last_clean":"2024-09-10T06:29:42.490221+0000","last_became_active":"2024-09-10T06:26:38.299012+0000","last_became_peered":"2024-09-10T06:26:38.299012+0000","last_unstale":"2024-09-10T06:29:42.490221+0000","last_undegraded":"2024-09-10T06:29:42.490221+0000","last_fullsized":"2024-09-10T06:29:42.490221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'105","last_scrub_stamp":"2024-09-10T06:29:42.490046+0000","last_deep_scrub":"95'105","last_deep_scrub_stamp":"2024-09-10T06:29:42.490046+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.490046+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:06.851181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"61'2","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:48.819728+0000","last_change":"2024-09-10T06:29:48.819728+0000","last_active":"2024-09-10T06:29:48.819728+0000","last_peered":"2024-09-10T06:29:48.819728+0000","last_clean":"2024-09-10T06:29:48.819728+0000","last_became_active":"2024-09-10T06:26:40.335302+0000","last_became_peered":"2024-09-10T06:26:40.335302+0000","last_unstale":"2024-09-10T06:29:48.819728+0000","last_undegraded":"2024-09-10T06:29:48.819728+0000","last_fullsized":"2024-09-10T06:29:48.819728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-09-10T06:29:48.819537+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-09-10T06:29:48.819537+0000","last_clean_scrub_stamp":"2024-09-10T06:29:48.819537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:43.058221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.073055+0000","last_change":"2024-09-10T06:29:32.073055+0000","last_active":"2024-09-10T06:29:32.073055+0000","last_peered":"2024-09-10T06:29:32.073055+0000","last_clean":"2024-09-10T06:29:32.073055+0000","last_became_active":"2024-09-10T06:26:32.287315+0000","last_became_peered":"2024-09-10T06:26:32.287315+0000","last_unstale":"2024-09-10T06:29:32.073055+0000","last_undegraded":"2024-09-10T06:29:32.073055+0000","last_fullsized":"2024-09-10T06:29:32.073055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2024-09-10T06:29:32.072864+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2024-09-10T06:29:32.072864+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.072864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.911842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'14","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.077576+0000","last_change":"2024-09-10T06:29:25.077576+0000","last_active":"2024-09-10T06:29:25.077576+0000","last_peered":"2024-09-10T06:29:25.077576+0000","last_clean":"2024-09-10T06:29:25.077576+0000","last_became_active":"2024-09-10T06:26:30.568464+0000","last_became_peered":"2024-09-10T06:26:30.568464+0000","last_unstale":"2024-09-10T06:29:25.077576+0000","last_undegraded":"2024-09-10T06:29:25.077576+0000","last_fullsized":"2024-09-10T06:29:25.077576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:25.077383+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:25.077383+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.077383+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:12.962962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"95'4","reported_seq":294,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.268274+0000","last_change":"2024-09-10T06:29:42.268274+0000","last_active":"2024-09-10T06:29:42.268274+0000","last_peered":"2024-09-10T06:29:42.268274+0000","last_clean":"2024-09-10T06:29:42.268274+0000","last_became_active":"2024-09-10T06:26:34.279192+0000","last_became_peered":"2024-09-10T06:26:34.279192+0000","last_unstale":"2024-09-10T06:29:42.268274+0000","last_undegraded":"2024-09-10T06:29:42.268274+0000","last_fullsized":"2024-09-10T06:29:42.268274+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'4","last_scrub_stamp":"2024-09-10T06:29:42.268035+0000","last_deep_scrub":"95'4","last_deep_scrub_stamp":"2024-09-10T06:29:42.268035+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.268035+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:52.439198+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"95'15","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:48.898500+0000","last_change":"2024-09-10T06:29:48.898500+0000","last_active":"2024-09-10T06:29:48.898500+0000","last_peered":"2024-09-10T06:29:48.898500+0000","last_clean":"2024-09-10T06:29:48.898500+0000","last_became_active":"2024-09-10T06:26:36.289527+0000","last_became_peered":"2024-09-10T06:26:36.289527+0000","last_unstale":"2024-09-10T06:29:48.898500+0000","last_undegraded":"2024-09-10T06:29:48.898500+0000","last_fullsized":"2024-09-10T06:29:48.898500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'15","last_scrub_stamp":"2024-09-10T06:29:48.898296+0000","last_deep_scrub":"95'15","last_deep_scrub_stamp":"2024-09-10T06:29:48.898296+0000","last_clean_scrub_stamp":"2024-09-10T06:29:48.898296+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:11.068778+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'105","reported_seq":321,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:43.506131+0000","last_change":"2024-09-10T06:29:43.506131+0000","last_active":"2024-09-10T06:29:43.506131+0000","last_peered":"2024-09-10T06:29:43.506131+0000","last_clean":"2024-09-10T06:29:43.506131+0000","last_became_active":"2024-09-10T06:26:38.287740+0000","last_became_peered":"2024-09-10T06:26:38.287740+0000","last_unstale":"2024-09-10T06:29:43.506131+0000","last_undegraded":"2024-09-10T06:29:43.506131+0000","last_fullsized":"2024-09-10T06:29:43.506131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'105","last_scrub_stamp":"2024-09-10T06:29:43.505943+0000","last_deep_scrub":"95'105","last_deep_scrub_stamp":"2024-09-10T06:29:43.505943+0000","last_clean_scrub_stamp":"2024-09-10T06:29:43.505943+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:01.600012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'8","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:56.216310+0000","last_change":"2024-09-10T06:29:56.216310+0000","last_active":"2024-09-10T06:29:56.216310+0000","last_peered":"2024-09-10T06:29:56.216310+0000","last_clean":"2024-09-10T06:29:56.216310+0000","last_became_active":"2024-09-10T06:26:40.328952+0000","last_became_peered":"2024-09-10T06:26:40.328952+0000","last_unstale":"2024-09-10T06:29:56.216310+0000","last_undegraded":"2024-09-10T06:29:56.216310+0000","last_fullsized":"2024-09-10T06:29:56.216310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8","last_scrub_stamp":"2024-09-10T06:29:56.216125+0000","last_deep_scrub":"67'8","last_deep_scrub_stamp":"2024-09-10T06:29:56.216125+0000","last_clean_scrub_stamp":"2024-09-10T06:29:56.216125+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:07.738898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.726186+0000","last_change":"2024-09-10T06:29:36.726186+0000","last_active":"2024-09-10T06:29:36.726186+0000","last_peered":"2024-09-10T06:29:36.726186+0000","last_clean":"2024-09-10T06:29:36.726186+0000","last_became_active":"2024-09-10T06:26:32.270265+0000","last_became_peered":"2024-09-10T06:26:32.270265+0000","last_unstale":"2024-09-10T06:29:36.726186+0000","last_undegraded":"2024-09-10T06:29:36.726186+0000","last_fullsized":"2024-09-10T06:29:36.726186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:36.726005+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:36.726005+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.726005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:53.188286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"95'22","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.586338+0000","last_change":"2024-09-10T06:29:24.586338+0000","last_active":"2024-09-10T06:29:24.586338+0000","last_peered":"2024-09-10T06:29:24.586338+0000","last_clean":"2024-09-10T06:29:24.586338+0000","last_became_active":"2024-09-10T06:27:08.592864+0000","last_became_peered":"2024-09-10T06:27:08.592864+0000","last_unstale":"2024-09-10T06:29:24.586338+0000","last_undegraded":"2024-09-10T06:29:24.586338+0000","last_fullsized":"2024-09-10T06:29:24.586338+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:24.586253+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:24.586253+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.586253+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:13.559714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:45.215758+0000","last_change":"2024-09-10T06:29:45.215758+0000","last_active":"2024-09-10T06:29:45.215758+0000","last_peered":"2024-09-10T06:29:45.215758+0000","last_clean":"2024-09-10T06:29:45.215758+0000","last_became_active":"2024-09-10T06:26:34.285334+0000","last_became_peered":"2024-09-10T06:26:34.285334+0000","last_unstale":"2024-09-10T06:29:45.215758+0000","last_undegraded":"2024-09-10T06:29:45.215758+0000","last_fullsized":"2024-09-10T06:29:45.215758+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:45.215496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:45.215496+0000","last_clean_scrub_stamp":"2024-09-10T06:29:45.215496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:30.362178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"95'34","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:48.264841+0000","last_change":"2024-09-10T06:29:48.264841+0000","last_active":"2024-09-10T06:29:48.264841+0000","last_peered":"2024-09-10T06:29:48.264841+0000","last_clean":"2024-09-10T06:29:48.264841+0000","last_became_active":"2024-09-10T06:26:36.287468+0000","last_became_peered":"2024-09-10T06:26:36.287468+0000","last_unstale":"2024-09-10T06:29:48.264841+0000","last_undegraded":"2024-09-10T06:29:48.264841+0000","last_fullsized":"2024-09-10T06:29:48.264841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'34","last_scrub_stamp":"2024-09-10T06:29:48.264657+0000","last_deep_scrub":"95'34","last_deep_scrub_stamp":"2024-09-10T06:29:48.264657+0000","last_clean_scrub_stamp":"2024-09-10T06:29:48.264657+0000","objects_scrubbed":8,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:25:03.974012+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.464134+0000","last_change":"2024-09-10T06:29:42.464134+0000","last_active":"2024-09-10T06:29:42.464134+0000","last_peered":"2024-09-10T06:29:42.464134+0000","last_clean":"2024-09-10T06:29:42.464134+0000","last_became_active":"2024-09-10T06:26:38.291214+0000","last_became_peered":"2024-09-10T06:26:38.291214+0000","last_unstale":"2024-09-10T06:29:42.464134+0000","last_undegraded":"2024-09-10T06:29:42.464134+0000","last_fullsized":"2024-09-10T06:29:42.464134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:42.463940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:42.463940+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.463940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:17.142689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"67'4","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:49.854083+0000","last_change":"2024-09-10T06:29:49.854083+0000","last_active":"2024-09-10T06:29:49.854083+0000","last_peered":"2024-09-10T06:29:49.854083+0000","last_clean":"2024-09-10T06:29:49.854083+0000","last_became_active":"2024-09-10T06:26:40.331502+0000","last_became_peered":"2024-09-10T06:26:40.331502+0000","last_unstale":"2024-09-10T06:29:49.854083+0000","last_undegraded":"2024-09-10T06:29:49.854083+0000","last_fullsized":"2024-09-10T06:29:49.854083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:49.853882+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:49.853882+0000","last_clean_scrub_stamp":"2024-09-10T06:29:49.853882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:02:27.710763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.416313+0000","last_change":"2024-09-10T06:29:33.416313+0000","last_active":"2024-09-10T06:29:33.416313+0000","last_peered":"2024-09-10T06:29:33.416313+0000","last_clean":"2024-09-10T06:29:33.416313+0000","last_became_active":"2024-09-10T06:26:32.273727+0000","last_became_peered":"2024-09-10T06:26:32.273727+0000","last_unstale":"2024-09-10T06:29:33.416313+0000","last_undegraded":"2024-09-10T06:29:33.416313+0000","last_fullsized":"2024-09-10T06:29:33.416313+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:33.416125+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:33.416125+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.416125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:57.777260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"95'74","reported_seq":268,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.264881+0000","last_change":"2024-09-10T06:29:25.264881+0000","last_active":"2024-09-10T06:29:25.264881+0000","last_peered":"2024-09-10T06:29:25.264881+0000","last_clean":"2024-09-10T06:29:25.264881+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:29:25.264881+0000","last_undegraded":"2024-09-10T06:29:25.264881+0000","last_fullsized":"2024-09-10T06:29:25.264881+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'74","last_scrub_stamp":"2024-09-10T06:29:25.264687+0000","last_deep_scrub":"95'74","last_deep_scrub_stamp":"2024-09-10T06:29:25.264687+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.264687+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:10.255426+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"95'2","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.364086+0000","last_change":"2024-09-10T06:29:27.364086+0000","last_active":"2024-09-10T06:29:27.364086+0000","last_peered":"2024-09-10T06:29:27.364086+0000","last_clean":"2024-09-10T06:29:27.364086+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:29:27.364086+0000","last_undegraded":"2024-09-10T06:29:27.364086+0000","last_fullsized":"2024-09-10T06:29:27.364086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-10T06:29:27.363883+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-10T06:29:27.363883+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.363883+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:22.736354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'18","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.090343+0000","last_change":"2024-09-10T06:29:23.090343+0000","last_active":"2024-09-10T06:29:23.090343+0000","last_peered":"2024-09-10T06:29:23.090343+0000","last_clean":"2024-09-10T06:29:23.090343+0000","last_became_active":"2024-09-10T06:26:30.606348+0000","last_became_peered":"2024-09-10T06:26:30.606348+0000","last_unstale":"2024-09-10T06:29:23.090343+0000","last_undegraded":"2024-09-10T06:29:23.090343+0000","last_fullsized":"2024-09-10T06:29:23.090343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:23.090275+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:23.090275+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.090275+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:50.992919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.202712+0000","last_change":"2024-09-10T06:29:39.202712+0000","last_active":"2024-09-10T06:29:39.202712+0000","last_peered":"2024-09-10T06:29:39.202712+0000","last_clean":"2024-09-10T06:29:39.202712+0000","last_became_active":"2024-09-10T06:26:34.285248+0000","last_became_peered":"2024-09-10T06:26:34.285248+0000","last_unstale":"2024-09-10T06:29:39.202712+0000","last_undegraded":"2024-09-10T06:29:39.202712+0000","last_fullsized":"2024-09-10T06:29:39.202712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:39.202537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:39.202537+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.202537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:58.998710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"95'44","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:46.247925+0000","last_change":"2024-09-10T06:29:46.247925+0000","last_active":"2024-09-10T06:29:46.247925+0000","last_peered":"2024-09-10T06:29:46.247925+0000","last_clean":"2024-09-10T06:29:46.247925+0000","last_became_active":"2024-09-10T06:26:36.295901+0000","last_became_peered":"2024-09-10T06:26:36.295901+0000","last_unstale":"2024-09-10T06:29:46.247925+0000","last_undegraded":"2024-09-10T06:29:46.247925+0000","last_fullsized":"2024-09-10T06:29:46.247925+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'44","last_scrub_stamp":"2024-09-10T06:29:46.247702+0000","last_deep_scrub":"95'44","last_deep_scrub_stamp":"2024-09-10T06:29:46.247702+0000","last_clean_scrub_stamp":"2024-09-10T06:29:46.247702+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:44.495985+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":160,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:49.503741+0000","last_change":"2024-09-10T06:29:49.503741+0000","last_active":"2024-09-10T06:29:49.503741+0000","last_peered":"2024-09-10T06:29:49.503741+0000","last_clean":"2024-09-10T06:29:49.503741+0000","last_became_active":"2024-09-10T06:26:38.305496+0000","last_became_peered":"2024-09-10T06:26:38.305496+0000","last_unstale":"2024-09-10T06:29:49.503741+0000","last_undegraded":"2024-09-10T06:29:49.503741+0000","last_fullsized":"2024-09-10T06:29:49.503741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:49.503562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:49.503562+0000","last_clean_scrub_stamp":"2024-09-10T06:29:49.503562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:41.711791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"64'2","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:48.470958+0000","last_change":"2024-09-10T06:29:48.470958+0000","last_active":"2024-09-10T06:29:48.470958+0000","last_peered":"2024-09-10T06:29:48.470958+0000","last_clean":"2024-09-10T06:29:48.470958+0000","last_became_active":"2024-09-10T06:26:40.331294+0000","last_became_peered":"2024-09-10T06:26:40.331294+0000","last_unstale":"2024-09-10T06:29:48.470958+0000","last_undegraded":"2024-09-10T06:29:48.470958+0000","last_fullsized":"2024-09-10T06:29:48.470958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'2","last_scrub_stamp":"2024-09-10T06:29:48.470749+0000","last_deep_scrub":"64'2","last_deep_scrub_stamp":"2024-09-10T06:29:48.470749+0000","last_clean_scrub_stamp":"2024-09-10T06:29:48.470749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:55.220725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.564019+0000","last_change":"2024-09-10T06:29:32.564019+0000","last_active":"2024-09-10T06:29:32.564019+0000","last_peered":"2024-09-10T06:29:32.564019+0000","last_clean":"2024-09-10T06:29:32.564019+0000","last_became_active":"2024-09-10T06:26:32.278118+0000","last_became_peered":"2024-09-10T06:26:32.278118+0000","last_unstale":"2024-09-10T06:29:32.564019+0000","last_undegraded":"2024-09-10T06:29:32.564019+0000","last_fullsized":"2024-09-10T06:29:32.564019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:32.563849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:32.563849+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.563849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:22.391297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.251882+0000","last_change":"2024-09-10T06:29:26.251882+0000","last_active":"2024-09-10T06:29:26.251882+0000","last_peered":"2024-09-10T06:29:26.251882+0000","last_clean":"2024-09-10T06:29:26.251882+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:29:26.251882+0000","last_undegraded":"2024-09-10T06:29:26.251882+0000","last_fullsized":"2024-09-10T06:29:26.251882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:26.251712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:26.251712+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.251712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:18.145262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"95'22","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.578231+0000","last_change":"2024-09-10T06:29:23.578231+0000","last_active":"2024-09-10T06:29:23.578231+0000","last_peered":"2024-09-10T06:29:23.578231+0000","last_clean":"2024-09-10T06:29:23.578231+0000","last_became_active":"2024-09-10T06:26:30.593978+0000","last_became_peered":"2024-09-10T06:26:30.593978+0000","last_unstale":"2024-09-10T06:29:23.578231+0000","last_undegraded":"2024-09-10T06:29:23.578231+0000","last_fullsized":"2024-09-10T06:29:23.578231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:23.578147+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:23.578147+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.578147+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:35:24.778260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.292878+0000","last_change":"2024-09-10T06:29:41.292878+0000","last_active":"2024-09-10T06:29:41.292878+0000","last_peered":"2024-09-10T06:29:41.292878+0000","last_clean":"2024-09-10T06:29:41.292878+0000","last_became_active":"2024-09-10T06:26:34.279147+0000","last_became_peered":"2024-09-10T06:26:34.279147+0000","last_unstale":"2024-09-10T06:29:41.292878+0000","last_undegraded":"2024-09-10T06:29:41.292878+0000","last_fullsized":"2024-09-10T06:29:41.292878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:41.292660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:41.292660+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.292660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:40.776269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'125","reported_seq":365,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.845590+0000","last_change":"2024-09-10T06:29:42.845590+0000","last_active":"2024-09-10T06:29:42.845590+0000","last_peered":"2024-09-10T06:29:42.845590+0000","last_clean":"2024-09-10T06:29:42.845590+0000","last_became_active":"2024-09-10T06:26:36.289232+0000","last_became_peered":"2024-09-10T06:26:36.289232+0000","last_unstale":"2024-09-10T06:29:42.845590+0000","last_undegraded":"2024-09-10T06:29:42.845590+0000","last_fullsized":"2024-09-10T06:29:42.845590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'125","last_scrub_stamp":"2024-09-10T06:29:42.845383+0000","last_deep_scrub":"95'125","last_deep_scrub_stamp":"2024-09-10T06:29:42.845383+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.845383+0000","objects_scrubbed":10,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:51.171028+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":162,"num_read_kb":147,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:51.241505+0000","last_change":"2024-09-10T06:29:51.241505+0000","last_active":"2024-09-10T06:29:51.241505+0000","last_peered":"2024-09-10T06:29:51.241505+0000","last_clean":"2024-09-10T06:29:51.241505+0000","last_became_active":"2024-09-10T06:26:38.301104+0000","last_became_peered":"2024-09-10T06:26:38.301104+0000","last_unstale":"2024-09-10T06:29:51.241505+0000","last_undegraded":"2024-09-10T06:29:51.241505+0000","last_fullsized":"2024-09-10T06:29:51.241505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:51.241324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:51.241324+0000","last_clean_scrub_stamp":"2024-09-10T06:29:51.241324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:34.373652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"76'2","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:51.836554+0000","last_change":"2024-09-10T06:29:51.836554+0000","last_active":"2024-09-10T06:29:51.836554+0000","last_peered":"2024-09-10T06:29:51.836554+0000","last_clean":"2024-09-10T06:29:51.836554+0000","last_became_active":"2024-09-10T06:26:40.319266+0000","last_became_peered":"2024-09-10T06:26:40.319266+0000","last_unstale":"2024-09-10T06:29:51.836554+0000","last_undegraded":"2024-09-10T06:29:51.836554+0000","last_fullsized":"2024-09-10T06:29:51.836554+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:51.836359+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:51.836359+0000","last_clean_scrub_stamp":"2024-09-10T06:29:51.836359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:38.086367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"76'14","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.690686+0000","last_change":"2024-09-10T06:29:32.690686+0000","last_active":"2024-09-10T06:29:32.690686+0000","last_peered":"2024-09-10T06:29:32.690686+0000","last_clean":"2024-09-10T06:29:32.690686+0000","last_became_active":"2024-09-10T06:26:32.282235+0000","last_became_peered":"2024-09-10T06:26:32.282235+0000","last_unstale":"2024-09-10T06:29:32.690686+0000","last_undegraded":"2024-09-10T06:29:32.690686+0000","last_fullsized":"2024-09-10T06:29:32.690686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'14","last_scrub_stamp":"2024-09-10T06:29:32.690477+0000","last_deep_scrub":"76'14","last_deep_scrub_stamp":"2024-09-10T06:29:32.690477+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.690477+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:45.934951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.535434+0000","last_change":"2024-09-10T06:29:23.535434+0000","last_active":"2024-09-10T06:29:23.535434+0000","last_peered":"2024-09-10T06:29:23.535434+0000","last_clean":"2024-09-10T06:29:23.535434+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:29:23.535434+0000","last_undegraded":"2024-09-10T06:29:23.535434+0000","last_fullsized":"2024-09-10T06:29:23.535434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:23.535349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:23.535349+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.535349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:38.274075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"95'16","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.757031+0000","last_change":"2024-09-10T06:29:24.757031+0000","last_active":"2024-09-10T06:29:24.757031+0000","last_peered":"2024-09-10T06:29:24.757031+0000","last_clean":"2024-09-10T06:29:24.757031+0000","last_became_active":"2024-09-10T06:26:30.570037+0000","last_became_peered":"2024-09-10T06:26:30.570037+0000","last_unstale":"2024-09-10T06:29:24.757031+0000","last_undegraded":"2024-09-10T06:29:24.757031+0000","last_fullsized":"2024-09-10T06:29:24.757031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:24.756843+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:24.756843+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.756843+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:05.933687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"95'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.572089+0000","last_change":"2024-09-10T06:29:33.572089+0000","last_active":"2024-09-10T06:29:33.572089+0000","last_peered":"2024-09-10T06:29:33.572089+0000","last_clean":"2024-09-10T06:29:33.572089+0000","last_became_active":"2024-09-10T06:26:34.283980+0000","last_became_peered":"2024-09-10T06:26:34.283980+0000","last_unstale":"2024-09-10T06:29:33.572089+0000","last_undegraded":"2024-09-10T06:29:33.572089+0000","last_fullsized":"2024-09-10T06:29:33.572089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-10T06:29:33.571908+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-10T06:29:33.571908+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.571908+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:00.057364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'27","reported_seq":257,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:46.273133+0000","last_change":"2024-09-10T06:29:46.273133+0000","last_active":"2024-09-10T06:29:46.273133+0000","last_peered":"2024-09-10T06:29:46.273133+0000","last_clean":"2024-09-10T06:29:46.273133+0000","last_became_active":"2024-09-10T06:28:46.327631+0000","last_became_peered":"2024-09-10T06:28:46.327631+0000","last_unstale":"2024-09-10T06:29:46.273133+0000","last_undegraded":"2024-09-10T06:29:46.273133+0000","last_fullsized":"2024-09-10T06:29:46.273133+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'27","last_scrub_stamp":"2024-09-10T06:29:46.272936+0000","last_deep_scrub":"95'27","last_deep_scrub_stamp":"2024-09-10T06:29:46.272936+0000","last_clean_scrub_stamp":"2024-09-10T06:29:46.272936+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:31.419618+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:48.470365+0000","last_change":"2024-09-10T06:29:48.470365+0000","last_active":"2024-09-10T06:29:48.470365+0000","last_peered":"2024-09-10T06:29:48.470365+0000","last_clean":"2024-09-10T06:29:48.470365+0000","last_became_active":"2024-09-10T06:26:38.291623+0000","last_became_peered":"2024-09-10T06:26:38.291623+0000","last_unstale":"2024-09-10T06:29:48.470365+0000","last_undegraded":"2024-09-10T06:29:48.470365+0000","last_fullsized":"2024-09-10T06:29:48.470365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:48.470183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:48.470183+0000","last_clean_scrub_stamp":"2024-09-10T06:29:48.470183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:24.486789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:59.826657+0000","last_change":"2024-09-10T06:29:59.826657+0000","last_active":"2024-09-10T06:29:59.826657+0000","last_peered":"2024-09-10T06:29:59.826657+0000","last_clean":"2024-09-10T06:29:59.826657+0000","last_became_active":"2024-09-10T06:26:40.302898+0000","last_became_peered":"2024-09-10T06:26:40.302898+0000","last_unstale":"2024-09-10T06:29:59.826657+0000","last_undegraded":"2024-09-10T06:29:59.826657+0000","last_fullsized":"2024-09-10T06:29:59.826657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:59.826415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:59.826415+0000","last_clean_scrub_stamp":"2024-09-10T06:29:59.826415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:19.529366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"76'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.705655+0000","last_change":"2024-09-10T06:29:31.705655+0000","last_active":"2024-09-10T06:29:31.705655+0000","last_peered":"2024-09-10T06:29:31.705655+0000","last_clean":"2024-09-10T06:29:31.705655+0000","last_became_active":"2024-09-10T06:26:32.273183+0000","last_became_peered":"2024-09-10T06:26:32.273183+0000","last_unstale":"2024-09-10T06:29:31.705655+0000","last_undegraded":"2024-09-10T06:29:31.705655+0000","last_fullsized":"2024-09-10T06:29:31.705655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:31.705463+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:31.705463+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.705463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:13.950948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"95'3","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.389873+0000","last_change":"2024-09-10T06:29:25.389873+0000","last_active":"2024-09-10T06:29:25.389873+0000","last_peered":"2024-09-10T06:29:25.389873+0000","last_clean":"2024-09-10T06:29:25.389873+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:29:25.389873+0000","last_undegraded":"2024-09-10T06:29:25.389873+0000","last_fullsized":"2024-09-10T06:29:25.389873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-10T06:29:25.389673+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-10T06:29:25.389673+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.389673+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:47.130556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"95'16","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.119629+0000","last_change":"2024-09-10T06:29:23.119629+0000","last_active":"2024-09-10T06:29:23.119629+0000","last_peered":"2024-09-10T06:29:23.119629+0000","last_clean":"2024-09-10T06:29:23.119629+0000","last_became_active":"2024-09-10T06:26:30.577934+0000","last_became_peered":"2024-09-10T06:26:30.577934+0000","last_unstale":"2024-09-10T06:29:23.119629+0000","last_undegraded":"2024-09-10T06:29:23.119629+0000","last_fullsized":"2024-09-10T06:29:23.119629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:23.119438+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:23.119438+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.119438+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:44.272106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.598604+0000","last_change":"2024-09-10T06:29:41.598604+0000","last_active":"2024-09-10T06:29:41.598604+0000","last_peered":"2024-09-10T06:29:41.598604+0000","last_clean":"2024-09-10T06:29:41.598604+0000","last_became_active":"2024-09-10T06:26:34.274705+0000","last_became_peered":"2024-09-10T06:26:34.274705+0000","last_unstale":"2024-09-10T06:29:41.598604+0000","last_undegraded":"2024-09-10T06:29:41.598604+0000","last_fullsized":"2024-09-10T06:29:41.598604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:41.598403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:41.598403+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.598403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:44.526904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"95'18","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:45.863912+0000","last_change":"2024-09-10T06:29:45.863912+0000","last_active":"2024-09-10T06:29:45.863912+0000","last_peered":"2024-09-10T06:29:45.863912+0000","last_clean":"2024-09-10T06:29:45.863912+0000","last_became_active":"2024-09-10T06:26:36.265322+0000","last_became_peered":"2024-09-10T06:26:36.265322+0000","last_unstale":"2024-09-10T06:29:45.863912+0000","last_undegraded":"2024-09-10T06:29:45.863912+0000","last_fullsized":"2024-09-10T06:29:45.863912+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:45.863710+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:45.863710+0000","last_clean_scrub_stamp":"2024-09-10T06:29:45.863710+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:33.825123+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.416645+0000","last_change":"2024-09-10T06:29:41.416645+0000","last_active":"2024-09-10T06:29:41.416645+0000","last_peered":"2024-09-10T06:29:41.416645+0000","last_clean":"2024-09-10T06:29:41.416645+0000","last_became_active":"2024-09-10T06:28:46.344951+0000","last_became_peered":"2024-09-10T06:28:46.344951+0000","last_unstale":"2024-09-10T06:29:41.416645+0000","last_undegraded":"2024-09-10T06:29:41.416645+0000","last_fullsized":"2024-09-10T06:29:41.416645+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:41.416461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:41.416461+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.416461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:43.497547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"76'8","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:53.340820+0000","last_change":"2024-09-10T06:29:53.340820+0000","last_active":"2024-09-10T06:29:53.340820+0000","last_peered":"2024-09-10T06:29:53.340820+0000","last_clean":"2024-09-10T06:29:53.340820+0000","last_became_active":"2024-09-10T06:26:40.326130+0000","last_became_peered":"2024-09-10T06:26:40.326130+0000","last_unstale":"2024-09-10T06:29:53.340820+0000","last_undegraded":"2024-09-10T06:29:53.340820+0000","last_fullsized":"2024-09-10T06:29:53.340820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'8","last_scrub_stamp":"2024-09-10T06:29:53.340614+0000","last_deep_scrub":"76'8","last_deep_scrub_stamp":"2024-09-10T06:29:53.340614+0000","last_clean_scrub_stamp":"2024-09-10T06:29:53.340614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:29.357221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'8","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.702304+0000","last_change":"2024-09-10T06:29:29.702304+0000","last_active":"2024-09-10T06:29:29.702304+0000","last_peered":"2024-09-10T06:29:29.702304+0000","last_clean":"2024-09-10T06:29:29.702304+0000","last_became_active":"2024-09-10T06:26:32.282086+0000","last_became_peered":"2024-09-10T06:26:32.282086+0000","last_unstale":"2024-09-10T06:29:29.702304+0000","last_undegraded":"2024-09-10T06:29:29.702304+0000","last_fullsized":"2024-09-10T06:29:29.702304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8","last_scrub_stamp":"2024-09-10T06:29:29.702110+0000","last_deep_scrub":"67'8","last_deep_scrub_stamp":"2024-09-10T06:29:29.702110+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.702110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:02.172256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'32","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.404438+0000","last_change":"2024-09-10T06:29:23.404438+0000","last_active":"2024-09-10T06:29:23.404438+0000","last_peered":"2024-09-10T06:29:23.404438+0000","last_clean":"2024-09-10T06:29:23.404438+0000","last_became_active":"2024-09-10T06:26:30.591140+0000","last_became_peered":"2024-09-10T06:26:30.591140+0000","last_unstale":"2024-09-10T06:29:23.404438+0000","last_undegraded":"2024-09-10T06:29:23.404438+0000","last_fullsized":"2024-09-10T06:29:23.404438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'32","last_scrub_stamp":"2024-09-10T06:29:23.404208+0000","last_deep_scrub":"95'32","last_deep_scrub_stamp":"2024-09-10T06:29:23.404208+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.404208+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:58.082957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.783568+0000","last_change":"2024-09-10T06:29:23.783568+0000","last_active":"2024-09-10T06:29:23.783568+0000","last_peered":"2024-09-10T06:29:23.783568+0000","last_clean":"2024-09-10T06:29:23.783568+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:29:23.783568+0000","last_undegraded":"2024-09-10T06:29:23.783568+0000","last_fullsized":"2024-09-10T06:29:23.783568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:23.783333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:23.783333+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.783333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:11.916364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.634257+0000","last_change":"2024-09-10T06:29:40.634257+0000","last_active":"2024-09-10T06:29:40.634257+0000","last_peered":"2024-09-10T06:29:40.634257+0000","last_clean":"2024-09-10T06:29:40.634257+0000","last_became_active":"2024-09-10T06:26:34.273984+0000","last_became_peered":"2024-09-10T06:26:34.273984+0000","last_unstale":"2024-09-10T06:29:40.634257+0000","last_undegraded":"2024-09-10T06:29:40.634257+0000","last_fullsized":"2024-09-10T06:29:40.634257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:40.634065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:40.634065+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.634065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:31.811649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"95'44","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.628583+0000","last_change":"2024-09-10T06:29:42.628583+0000","last_active":"2024-09-10T06:29:42.628583+0000","last_peered":"2024-09-10T06:29:42.628583+0000","last_clean":"2024-09-10T06:29:42.628583+0000","last_became_active":"2024-09-10T06:26:36.270914+0000","last_became_peered":"2024-09-10T06:26:36.270914+0000","last_unstale":"2024-09-10T06:29:42.628583+0000","last_undegraded":"2024-09-10T06:29:42.628583+0000","last_fullsized":"2024-09-10T06:29:42.628583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'44","last_scrub_stamp":"2024-09-10T06:29:42.628354+0000","last_deep_scrub":"95'44","last_deep_scrub_stamp":"2024-09-10T06:29:42.628354+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.628354+0000","objects_scrubbed":8,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:01.827661+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":157,"num_write":28,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:53.226292+0000","last_change":"2024-09-10T06:29:53.226292+0000","last_active":"2024-09-10T06:29:53.226292+0000","last_peered":"2024-09-10T06:29:53.226292+0000","last_clean":"2024-09-10T06:29:53.226292+0000","last_became_active":"2024-09-10T06:26:38.277261+0000","last_became_peered":"2024-09-10T06:26:38.277261+0000","last_unstale":"2024-09-10T06:29:53.226292+0000","last_undegraded":"2024-09-10T06:29:53.226292+0000","last_fullsized":"2024-09-10T06:29:53.226292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:53.226112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:53.226112+0000","last_clean_scrub_stamp":"2024-09-10T06:29:53.226112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:33.204837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"67'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:30:00.542706+0000","last_change":"2024-09-10T06:30:00.542706+0000","last_active":"2024-09-10T06:30:00.542706+0000","last_peered":"2024-09-10T06:30:00.542706+0000","last_clean":"2024-09-10T06:30:00.542706+0000","last_became_active":"2024-09-10T06:26:40.329701+0000","last_became_peered":"2024-09-10T06:26:40.329701+0000","last_unstale":"2024-09-10T06:30:00.542706+0000","last_undegraded":"2024-09-10T06:30:00.542706+0000","last_fullsized":"2024-09-10T06:30:00.542706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:30:00.542497+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:30:00.542497+0000","last_clean_scrub_stamp":"2024-09-10T06:30:00.542497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:58.951551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"67'4","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.553050+0000","last_change":"2024-09-10T06:29:30.553050+0000","last_active":"2024-09-10T06:29:30.553050+0000","last_peered":"2024-09-10T06:29:30.553050+0000","last_clean":"2024-09-10T06:29:30.553050+0000","last_became_active":"2024-09-10T06:26:32.274946+0000","last_became_peered":"2024-09-10T06:26:32.274946+0000","last_unstale":"2024-09-10T06:29:30.553050+0000","last_undegraded":"2024-09-10T06:29:30.553050+0000","last_fullsized":"2024-09-10T06:29:30.553050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:30.552860+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:30.552860+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.552860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:06.395007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"95'16","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.713294+0000","last_change":"2024-09-10T06:29:28.713294+0000","last_active":"2024-09-10T06:29:28.713294+0000","last_peered":"2024-09-10T06:29:28.713294+0000","last_clean":"2024-09-10T06:29:28.713294+0000","last_became_active":"2024-09-10T06:26:30.565220+0000","last_became_peered":"2024-09-10T06:26:30.565220+0000","last_unstale":"2024-09-10T06:29:28.713294+0000","last_undegraded":"2024-09-10T06:29:28.713294+0000","last_fullsized":"2024-09-10T06:29:28.713294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:28.713108+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:28.713108+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.713108+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:48:49.954032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.248692+0000","last_change":"2024-09-10T06:29:28.248692+0000","last_active":"2024-09-10T06:29:28.248692+0000","last_peered":"2024-09-10T06:29:28.248692+0000","last_clean":"2024-09-10T06:29:28.248692+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:29:28.248692+0000","last_undegraded":"2024-09-10T06:29:28.248692+0000","last_fullsized":"2024-09-10T06:29:28.248692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:28.248480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:28.248480+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.248480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:25.157883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.375020+0000","last_change":"2024-09-10T06:29:38.375020+0000","last_active":"2024-09-10T06:29:38.375020+0000","last_peered":"2024-09-10T06:29:38.375020+0000","last_clean":"2024-09-10T06:29:38.375020+0000","last_became_active":"2024-09-10T06:26:34.272192+0000","last_became_peered":"2024-09-10T06:26:34.272192+0000","last_unstale":"2024-09-10T06:29:38.375020+0000","last_undegraded":"2024-09-10T06:29:38.375020+0000","last_fullsized":"2024-09-10T06:29:38.375020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:38.374854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:38.374854+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.374854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:02.446964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"95'21","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.844304+0000","last_change":"2024-09-10T06:29:41.844304+0000","last_active":"2024-09-10T06:29:41.844304+0000","last_peered":"2024-09-10T06:29:41.844304+0000","last_clean":"2024-09-10T06:29:41.844304+0000","last_became_active":"2024-09-10T06:26:36.290570+0000","last_became_peered":"2024-09-10T06:26:36.290570+0000","last_unstale":"2024-09-10T06:29:41.844304+0000","last_undegraded":"2024-09-10T06:29:41.844304+0000","last_fullsized":"2024-09-10T06:29:41.844304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'21","last_scrub_stamp":"2024-09-10T06:29:41.844191+0000","last_deep_scrub":"95'21","last_deep_scrub_stamp":"2024-09-10T06:29:41.844191+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.844191+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:28.928912+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'106","reported_seq":295,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:50.348089+0000","last_change":"2024-09-10T06:29:50.348089+0000","last_active":"2024-09-10T06:29:50.348089+0000","last_peered":"2024-09-10T06:29:50.348089+0000","last_clean":"2024-09-10T06:29:50.348089+0000","last_became_active":"2024-09-10T06:26:38.310450+0000","last_became_peered":"2024-09-10T06:26:38.310450+0000","last_unstale":"2024-09-10T06:29:50.348089+0000","last_undegraded":"2024-09-10T06:29:50.348089+0000","last_fullsized":"2024-09-10T06:29:50.348089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'106","last_scrub_stamp":"2024-09-10T06:29:50.347877+0000","last_deep_scrub":"95'106","last_deep_scrub_stamp":"2024-09-10T06:29:50.347877+0000","last_clean_scrub_stamp":"2024-09-10T06:29:50.347877+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:01.870651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:58.789247+0000","last_change":"2024-09-10T06:29:58.789247+0000","last_active":"2024-09-10T06:29:58.789247+0000","last_peered":"2024-09-10T06:29:58.789247+0000","last_clean":"2024-09-10T06:29:58.789247+0000","last_became_active":"2024-09-10T06:26:40.312266+0000","last_became_peered":"2024-09-10T06:26:40.312266+0000","last_unstale":"2024-09-10T06:29:58.789247+0000","last_undegraded":"2024-09-10T06:29:58.789247+0000","last_fullsized":"2024-09-10T06:29:58.789247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:58.789036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:58.789036+0000","last_clean_scrub_stamp":"2024-09-10T06:29:58.789036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:08:19.043106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"76'4","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.054582+0000","last_change":"2024-09-10T06:29:35.054582+0000","last_active":"2024-09-10T06:29:35.054582+0000","last_peered":"2024-09-10T06:29:35.054582+0000","last_clean":"2024-09-10T06:29:35.054582+0000","last_became_active":"2024-09-10T06:26:32.258337+0000","last_became_peered":"2024-09-10T06:26:32.258337+0000","last_unstale":"2024-09-10T06:29:35.054582+0000","last_undegraded":"2024-09-10T06:29:35.054582+0000","last_fullsized":"2024-09-10T06:29:35.054582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:35.054359+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:35.054359+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.054359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:50.284064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"95'16","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.067565+0000","last_change":"2024-09-10T06:29:24.067565+0000","last_active":"2024-09-10T06:29:24.067565+0000","last_peered":"2024-09-10T06:29:24.067565+0000","last_clean":"2024-09-10T06:29:24.067565+0000","last_became_active":"2024-09-10T06:26:30.581115+0000","last_became_peered":"2024-09-10T06:26:30.581115+0000","last_unstale":"2024-09-10T06:29:24.067565+0000","last_undegraded":"2024-09-10T06:29:24.067565+0000","last_fullsized":"2024-09-10T06:29:24.067565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:24.067500+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:24.067500+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.067500+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:15.114685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:21.800732+0000","last_change":"2024-09-10T06:29:21.800732+0000","last_active":"2024-09-10T06:29:21.800732+0000","last_peered":"2024-09-10T06:29:21.800732+0000","last_clean":"2024-09-10T06:29:21.800732+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:29:21.800732+0000","last_undegraded":"2024-09-10T06:29:21.800732+0000","last_fullsized":"2024-09-10T06:29:21.800732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:21.800559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:21.800559+0000","last_clean_scrub_stamp":"2024-09-10T06:29:21.800559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:01.214476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:44.176911+0000","last_change":"2024-09-10T06:29:44.176911+0000","last_active":"2024-09-10T06:29:44.176911+0000","last_peered":"2024-09-10T06:29:44.176911+0000","last_clean":"2024-09-10T06:29:44.176911+0000","last_became_active":"2024-09-10T06:26:34.257739+0000","last_became_peered":"2024-09-10T06:26:34.257739+0000","last_unstale":"2024-09-10T06:29:44.176911+0000","last_undegraded":"2024-09-10T06:29:44.176911+0000","last_fullsized":"2024-09-10T06:29:44.176911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:44.176731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:44.176731+0000","last_clean_scrub_stamp":"2024-09-10T06:29:44.176731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:12.238450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"95'15","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:48.236267+0000","last_change":"2024-09-10T06:29:48.236267+0000","last_active":"2024-09-10T06:29:48.236267+0000","last_peered":"2024-09-10T06:29:48.236267+0000","last_clean":"2024-09-10T06:29:48.236267+0000","last_became_active":"2024-09-10T06:26:36.270325+0000","last_became_peered":"2024-09-10T06:26:36.270325+0000","last_unstale":"2024-09-10T06:29:48.236267+0000","last_undegraded":"2024-09-10T06:29:48.236267+0000","last_fullsized":"2024-09-10T06:29:48.236267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'15","last_scrub_stamp":"2024-09-10T06:29:48.236072+0000","last_deep_scrub":"95'15","last_deep_scrub_stamp":"2024-09-10T06:29:48.236072+0000","last_clean_scrub_stamp":"2024-09-10T06:29:48.236072+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:52.689618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'106","reported_seq":281,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:54.839060+0000","last_change":"2024-09-10T06:29:54.839060+0000","last_active":"2024-09-10T06:29:54.839060+0000","last_peered":"2024-09-10T06:29:54.839060+0000","last_clean":"2024-09-10T06:29:54.839060+0000","last_became_active":"2024-09-10T06:26:38.299466+0000","last_became_peered":"2024-09-10T06:26:38.299466+0000","last_unstale":"2024-09-10T06:29:54.839060+0000","last_undegraded":"2024-09-10T06:29:54.839060+0000","last_fullsized":"2024-09-10T06:29:54.839060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'106","last_scrub_stamp":"2024-09-10T06:29:54.838867+0000","last_deep_scrub":"95'106","last_deep_scrub_stamp":"2024-09-10T06:29:54.838867+0000","last_clean_scrub_stamp":"2024-09-10T06:29:54.838867+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:56.901907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"67'4","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:55.470285+0000","last_change":"2024-09-10T06:29:55.470285+0000","last_active":"2024-09-10T06:29:55.470285+0000","last_peered":"2024-09-10T06:29:55.470285+0000","last_clean":"2024-09-10T06:29:55.470285+0000","last_became_active":"2024-09-10T06:26:40.329009+0000","last_became_peered":"2024-09-10T06:26:40.329009+0000","last_unstale":"2024-09-10T06:29:55.470285+0000","last_undegraded":"2024-09-10T06:29:55.470285+0000","last_fullsized":"2024-09-10T06:29:55.470285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:55.469956+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:55.469956+0000","last_clean_scrub_stamp":"2024-09-10T06:29:55.469956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:54.818058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'8","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.112413+0000","last_change":"2024-09-10T06:29:28.112413+0000","last_active":"2024-09-10T06:29:28.112413+0000","last_peered":"2024-09-10T06:29:28.112413+0000","last_clean":"2024-09-10T06:29:28.112413+0000","last_became_active":"2024-09-10T06:26:32.282794+0000","last_became_peered":"2024-09-10T06:26:32.282794+0000","last_unstale":"2024-09-10T06:29:28.112413+0000","last_undegraded":"2024-09-10T06:29:28.112413+0000","last_fullsized":"2024-09-10T06:29:28.112413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8","last_scrub_stamp":"2024-09-10T06:29:28.112223+0000","last_deep_scrub":"67'8","last_deep_scrub_stamp":"2024-09-10T06:29:28.112223+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.112223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:30.193309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'12","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:22.547386+0000","last_change":"2024-09-10T06:29:22.547386+0000","last_active":"2024-09-10T06:29:22.547386+0000","last_peered":"2024-09-10T06:29:22.547386+0000","last_clean":"2024-09-10T06:29:22.547386+0000","last_became_active":"2024-09-10T06:26:30.577985+0000","last_became_peered":"2024-09-10T06:26:30.577985+0000","last_unstale":"2024-09-10T06:29:22.547386+0000","last_undegraded":"2024-09-10T06:29:22.547386+0000","last_fullsized":"2024-09-10T06:29:22.547386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:22.547307+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:22.547307+0000","last_clean_scrub_stamp":"2024-09-10T06:29:22.547307+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:40.427930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.476396+0000","last_change":"2024-09-10T06:29:26.476396+0000","last_active":"2024-09-10T06:29:26.476396+0000","last_peered":"2024-09-10T06:29:26.476396+0000","last_clean":"2024-09-10T06:29:26.476396+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:29:26.476396+0000","last_undegraded":"2024-09-10T06:29:26.476396+0000","last_fullsized":"2024-09-10T06:29:26.476396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:26.476196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:26.476196+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.476196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:37.063867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:46.897202+0000","last_change":"2024-09-10T06:29:46.897202+0000","last_active":"2024-09-10T06:29:46.897202+0000","last_peered":"2024-09-10T06:29:46.897202+0000","last_clean":"2024-09-10T06:29:46.897202+0000","last_became_active":"2024-09-10T06:26:34.268359+0000","last_became_peered":"2024-09-10T06:26:34.268359+0000","last_unstale":"2024-09-10T06:29:46.897202+0000","last_undegraded":"2024-09-10T06:29:46.897202+0000","last_fullsized":"2024-09-10T06:29:46.897202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:46.897001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:46.897001+0000","last_clean_scrub_stamp":"2024-09-10T06:29:46.897001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:38.588859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"95'51","reported_seq":230,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:45.225630+0000","last_change":"2024-09-10T06:29:45.225630+0000","last_active":"2024-09-10T06:29:45.225630+0000","last_peered":"2024-09-10T06:29:45.225630+0000","last_clean":"2024-09-10T06:29:45.225630+0000","last_became_active":"2024-09-10T06:26:36.297606+0000","last_became_peered":"2024-09-10T06:26:36.297606+0000","last_unstale":"2024-09-10T06:29:45.225630+0000","last_undegraded":"2024-09-10T06:29:45.225630+0000","last_fullsized":"2024-09-10T06:29:45.225630+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'51","last_scrub_stamp":"2024-09-10T06:29:45.225392+0000","last_deep_scrub":"95'51","last_deep_scrub_stamp":"2024-09-10T06:29:45.225392+0000","last_clean_scrub_stamp":"2024-09-10T06:29:45.225392+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:13.287111+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:52.867226+0000","last_change":"2024-09-10T06:29:52.867226+0000","last_active":"2024-09-10T06:29:52.867226+0000","last_peered":"2024-09-10T06:29:52.867226+0000","last_clean":"2024-09-10T06:29:52.867226+0000","last_became_active":"2024-09-10T06:26:38.289589+0000","last_became_peered":"2024-09-10T06:26:38.289589+0000","last_unstale":"2024-09-10T06:29:52.867226+0000","last_undegraded":"2024-09-10T06:29:52.867226+0000","last_fullsized":"2024-09-10T06:29:52.867226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:52.867045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:52.867045+0000","last_clean_scrub_stamp":"2024-09-10T06:29:52.867045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:52.215147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:54.344710+0000","last_change":"2024-09-10T06:29:54.344710+0000","last_active":"2024-09-10T06:29:54.344710+0000","last_peered":"2024-09-10T06:29:54.344710+0000","last_clean":"2024-09-10T06:29:54.344710+0000","last_became_active":"2024-09-10T06:26:40.332160+0000","last_became_peered":"2024-09-10T06:26:40.332160+0000","last_unstale":"2024-09-10T06:29:54.344710+0000","last_undegraded":"2024-09-10T06:29:54.344710+0000","last_fullsized":"2024-09-10T06:29:54.344710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:54.344526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:54.344526+0000","last_clean_scrub_stamp":"2024-09-10T06:29:54.344526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:42.305939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:59.500313+0000","last_change":"2024-09-10T06:29:59.500313+0000","last_active":"2024-09-10T06:29:59.500313+0000","last_peered":"2024-09-10T06:29:59.500313+0000","last_clean":"2024-09-10T06:29:59.500313+0000","last_became_active":"2024-09-10T06:26:40.333474+0000","last_became_peered":"2024-09-10T06:26:40.333474+0000","last_unstale":"2024-09-10T06:29:59.500313+0000","last_undegraded":"2024-09-10T06:29:59.500313+0000","last_fullsized":"2024-09-10T06:29:59.500313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:59.500109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:59.500109+0000","last_clean_scrub_stamp":"2024-09-10T06:29:59.500109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:40:24.645067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'6","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.070380+0000","last_change":"2024-09-10T06:29:33.070380+0000","last_active":"2024-09-10T06:29:33.070380+0000","last_peered":"2024-09-10T06:29:33.070380+0000","last_clean":"2024-09-10T06:29:33.070380+0000","last_became_active":"2024-09-10T06:26:32.272178+0000","last_became_peered":"2024-09-10T06:26:32.272178+0000","last_unstale":"2024-09-10T06:29:33.070380+0000","last_undegraded":"2024-09-10T06:29:33.070380+0000","last_fullsized":"2024-09-10T06:29:33.070380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2024-09-10T06:29:33.070110+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2024-09-10T06:29:33.070110+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.070110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:35:34.270223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"95'16","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.085643+0000","last_change":"2024-09-10T06:29:24.085643+0000","last_active":"2024-09-10T06:29:24.085643+0000","last_peered":"2024-09-10T06:29:24.085643+0000","last_clean":"2024-09-10T06:29:24.085643+0000","last_became_active":"2024-09-10T06:26:30.592753+0000","last_became_peered":"2024-09-10T06:26:30.592753+0000","last_unstale":"2024-09-10T06:29:24.085643+0000","last_undegraded":"2024-09-10T06:29:24.085643+0000","last_fullsized":"2024-09-10T06:29:24.085643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:24.085456+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:24.085456+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.085456+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:15.979005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.849954+0000","last_change":"2024-09-10T06:29:40.849954+0000","last_active":"2024-09-10T06:29:40.849954+0000","last_peered":"2024-09-10T06:29:40.849954+0000","last_clean":"2024-09-10T06:29:40.849954+0000","last_became_active":"2024-09-10T06:26:34.282281+0000","last_became_peered":"2024-09-10T06:26:34.282281+0000","last_unstale":"2024-09-10T06:29:40.849954+0000","last_undegraded":"2024-09-10T06:29:40.849954+0000","last_fullsized":"2024-09-10T06:29:40.849954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:40.849756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:40.849756+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.849756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:30.571829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"95'25","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:51.891088+0000","last_change":"2024-09-10T06:29:51.891088+0000","last_active":"2024-09-10T06:29:51.891088+0000","last_peered":"2024-09-10T06:29:51.891088+0000","last_clean":"2024-09-10T06:29:51.891088+0000","last_became_active":"2024-09-10T06:26:36.272386+0000","last_became_peered":"2024-09-10T06:26:36.272386+0000","last_unstale":"2024-09-10T06:29:51.891088+0000","last_undegraded":"2024-09-10T06:29:51.891088+0000","last_fullsized":"2024-09-10T06:29:51.891088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'25","last_scrub_stamp":"2024-09-10T06:29:51.890886+0000","last_deep_scrub":"95'25","last_deep_scrub_stamp":"2024-09-10T06:29:51.890886+0000","last_clean_scrub_stamp":"2024-09-10T06:29:51.890886+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:03.487235+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:56.806982+0000","last_change":"2024-09-10T06:29:56.806982+0000","last_active":"2024-09-10T06:29:56.806982+0000","last_peered":"2024-09-10T06:29:56.806982+0000","last_clean":"2024-09-10T06:29:56.806982+0000","last_became_active":"2024-09-10T06:26:38.296600+0000","last_became_peered":"2024-09-10T06:26:38.296600+0000","last_unstale":"2024-09-10T06:29:56.806982+0000","last_undegraded":"2024-09-10T06:29:56.806982+0000","last_fullsized":"2024-09-10T06:29:56.806982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:56.806800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:56.806800+0000","last_clean_scrub_stamp":"2024-09-10T06:29:56.806800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:40:21.951759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"67'20","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379025+0000","last_change":"2024-09-10T06:26:40.321844+0000","last_active":"2024-09-10T06:28:48.379025+0000","last_peered":"2024-09-10T06:28:48.379025+0000","last_clean":"2024-09-10T06:28:48.379025+0000","last_became_active":"2024-09-10T06:26:40.321097+0000","last_became_peered":"2024-09-10T06:26:40.321097+0000","last_unstale":"2024-09-10T06:28:48.379025+0000","last_undegraded":"2024-09-10T06:28:48.379025+0000","last_fullsized":"2024-09-10T06:28:48.379025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:10.004849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"67'6","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.672747+0000","last_change":"2024-09-10T06:29:33.672747+0000","last_active":"2024-09-10T06:29:33.672747+0000","last_peered":"2024-09-10T06:29:33.672747+0000","last_clean":"2024-09-10T06:29:33.672747+0000","last_became_active":"2024-09-10T06:26:32.286519+0000","last_became_peered":"2024-09-10T06:26:32.286519+0000","last_unstale":"2024-09-10T06:29:33.672747+0000","last_undegraded":"2024-09-10T06:29:33.672747+0000","last_fullsized":"2024-09-10T06:29:33.672747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T06:29:33.672546+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T06:29:33.672546+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.672546+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:42.478459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"95'12","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.328207+0000","last_change":"2024-09-10T06:29:33.328207+0000","last_active":"2024-09-10T06:29:33.328207+0000","last_peered":"2024-09-10T06:29:33.328207+0000","last_clean":"2024-09-10T06:29:33.328207+0000","last_became_active":"2024-09-10T06:26:30.586611+0000","last_became_peered":"2024-09-10T06:26:30.586611+0000","last_unstale":"2024-09-10T06:29:33.328207+0000","last_undegraded":"2024-09-10T06:29:33.328207+0000","last_fullsized":"2024-09-10T06:29:33.328207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:33.328008+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:33.328008+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.328008+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:10.166985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"95'2","reported_seq":227,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.830344+0000","last_change":"2024-09-10T06:29:42.830344+0000","last_active":"2024-09-10T06:29:42.830344+0000","last_peered":"2024-09-10T06:29:42.830344+0000","last_clean":"2024-09-10T06:29:42.830344+0000","last_became_active":"2024-09-10T06:26:34.269875+0000","last_became_peered":"2024-09-10T06:26:34.269875+0000","last_unstale":"2024-09-10T06:29:42.830344+0000","last_undegraded":"2024-09-10T06:29:42.830344+0000","last_fullsized":"2024-09-10T06:29:42.830344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-10T06:29:42.830115+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-10T06:29:42.830115+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.830115+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:02.274405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"95'9","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:45.552372+0000","last_change":"2024-09-10T06:29:45.552372+0000","last_active":"2024-09-10T06:29:45.552372+0000","last_peered":"2024-09-10T06:29:45.552372+0000","last_clean":"2024-09-10T06:29:45.552372+0000","last_became_active":"2024-09-10T06:26:36.288355+0000","last_became_peered":"2024-09-10T06:26:36.288355+0000","last_unstale":"2024-09-10T06:29:45.552372+0000","last_undegraded":"2024-09-10T06:29:45.552372+0000","last_fullsized":"2024-09-10T06:29:45.552372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'9","last_scrub_stamp":"2024-09-10T06:29:45.552182+0000","last_deep_scrub":"95'9","last_deep_scrub_stamp":"2024-09-10T06:29:45.552182+0000","last_clean_scrub_stamp":"2024-09-10T06:29:45.552182+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:17.435535+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:52.287058+0000","last_change":"2024-09-10T06:29:52.287058+0000","last_active":"2024-09-10T06:29:52.287058+0000","last_peered":"2024-09-10T06:29:52.287058+0000","last_clean":"2024-09-10T06:29:52.287058+0000","last_became_active":"2024-09-10T06:26:38.301064+0000","last_became_peered":"2024-09-10T06:26:38.301064+0000","last_unstale":"2024-09-10T06:29:52.287058+0000","last_undegraded":"2024-09-10T06:29:52.287058+0000","last_fullsized":"2024-09-10T06:29:52.287058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:52.286817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:52.286817+0000","last_clean_scrub_stamp":"2024-09-10T06:29:52.286817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:32.553380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"64'4","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:58.472336+0000","last_change":"2024-09-10T06:29:58.472336+0000","last_active":"2024-09-10T06:29:58.472336+0000","last_peered":"2024-09-10T06:29:58.472336+0000","last_clean":"2024-09-10T06:29:58.472336+0000","last_became_active":"2024-09-10T06:26:40.321592+0000","last_became_peered":"2024-09-10T06:26:40.321592+0000","last_unstale":"2024-09-10T06:29:58.472336+0000","last_undegraded":"2024-09-10T06:29:58.472336+0000","last_fullsized":"2024-09-10T06:29:58.472336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'4","last_scrub_stamp":"2024-09-10T06:29:58.472103+0000","last_deep_scrub":"64'4","last_deep_scrub_stamp":"2024-09-10T06:29:58.472103+0000","last_clean_scrub_stamp":"2024-09-10T06:29:58.472103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:23.265297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"61'4","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.090925+0000","last_change":"2024-09-10T06:29:32.090925+0000","last_active":"2024-09-10T06:29:32.090925+0000","last_peered":"2024-09-10T06:29:32.090925+0000","last_clean":"2024-09-10T06:29:32.090925+0000","last_became_active":"2024-09-10T06:26:32.258775+0000","last_became_peered":"2024-09-10T06:26:32.258775+0000","last_unstale":"2024-09-10T06:29:32.090925+0000","last_undegraded":"2024-09-10T06:29:32.090925+0000","last_fullsized":"2024-09-10T06:29:32.090925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'4","last_scrub_stamp":"2024-09-10T06:29:32.090697+0000","last_deep_scrub":"61'4","last_deep_scrub_stamp":"2024-09-10T06:29:32.090697+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.090697+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:44.035503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"95'24","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.352352+0000","last_change":"2024-09-10T06:29:26.352352+0000","last_active":"2024-09-10T06:29:26.352352+0000","last_peered":"2024-09-10T06:29:26.352352+0000","last_clean":"2024-09-10T06:29:26.352352+0000","last_became_active":"2024-09-10T06:26:30.590566+0000","last_became_peered":"2024-09-10T06:26:30.590566+0000","last_unstale":"2024-09-10T06:29:26.352352+0000","last_undegraded":"2024-09-10T06:29:26.352352+0000","last_fullsized":"2024-09-10T06:29:26.352352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:26.352136+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:26.352136+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.352136+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:03.191113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":32,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:43.228431+0000","last_change":"2024-09-10T06:29:43.228431+0000","last_active":"2024-09-10T06:29:43.228431+0000","last_peered":"2024-09-10T06:29:43.228431+0000","last_clean":"2024-09-10T06:29:43.228431+0000","last_became_active":"2024-09-10T06:26:34.281008+0000","last_became_peered":"2024-09-10T06:26:34.281008+0000","last_unstale":"2024-09-10T06:29:43.228431+0000","last_undegraded":"2024-09-10T06:29:43.228431+0000","last_fullsized":"2024-09-10T06:29:43.228431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:43.228252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:43.228252+0000","last_clean_scrub_stamp":"2024-09-10T06:29:43.228252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:45.056463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"95'25","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:47.897021+0000","last_change":"2024-09-10T06:29:47.897021+0000","last_active":"2024-09-10T06:29:47.897021+0000","last_peered":"2024-09-10T06:29:47.897021+0000","last_clean":"2024-09-10T06:29:47.897021+0000","last_became_active":"2024-09-10T06:26:36.276248+0000","last_became_peered":"2024-09-10T06:26:36.276248+0000","last_unstale":"2024-09-10T06:29:47.897021+0000","last_undegraded":"2024-09-10T06:29:47.897021+0000","last_fullsized":"2024-09-10T06:29:47.897021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'25","last_scrub_stamp":"2024-09-10T06:29:47.896824+0000","last_deep_scrub":"95'25","last_deep_scrub_stamp":"2024-09-10T06:29:47.896824+0000","last_clean_scrub_stamp":"2024-09-10T06:29:47.896824+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:44.042208+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":23,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:44.505168+0000","last_change":"2024-09-10T06:29:44.505168+0000","last_active":"2024-09-10T06:29:44.505168+0000","last_peered":"2024-09-10T06:29:44.505168+0000","last_clean":"2024-09-10T06:29:44.505168+0000","last_became_active":"2024-09-10T06:28:46.343657+0000","last_became_peered":"2024-09-10T06:28:46.343657+0000","last_unstale":"2024-09-10T06:29:44.505168+0000","last_undegraded":"2024-09-10T06:29:44.505168+0000","last_fullsized":"2024-09-10T06:29:44.505168+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:44.504964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:44.504964+0000","last_clean_scrub_stamp":"2024-09-10T06:29:44.504964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:53.155803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:57.325044+0000","last_change":"2024-09-10T06:29:57.325044+0000","last_active":"2024-09-10T06:29:57.325044+0000","last_peered":"2024-09-10T06:29:57.325044+0000","last_clean":"2024-09-10T06:29:57.325044+0000","last_became_active":"2024-09-10T06:26:40.330707+0000","last_became_peered":"2024-09-10T06:26:40.330707+0000","last_unstale":"2024-09-10T06:29:57.325044+0000","last_undegraded":"2024-09-10T06:29:57.325044+0000","last_fullsized":"2024-09-10T06:29:57.325044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:57.324862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:57.324862+0000","last_clean_scrub_stamp":"2024-09-10T06:29:57.324862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:08.995690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.817949+0000","last_change":"2024-09-10T06:29:41.817949+0000","last_active":"2024-09-10T06:29:41.817949+0000","last_peered":"2024-09-10T06:29:41.817949+0000","last_clean":"2024-09-10T06:29:41.817949+0000","last_became_active":"2024-09-10T06:26:32.265705+0000","last_became_peered":"2024-09-10T06:26:32.265705+0000","last_unstale":"2024-09-10T06:29:41.817949+0000","last_undegraded":"2024-09-10T06:29:41.817949+0000","last_fullsized":"2024-09-10T06:29:41.817949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:41.817756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:41.817756+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.817756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:05.836921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"95'18","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.575589+0000","last_change":"2024-09-10T06:29:24.575589+0000","last_active":"2024-09-10T06:29:24.575589+0000","last_peered":"2024-09-10T06:29:24.575589+0000","last_clean":"2024-09-10T06:29:24.575589+0000","last_became_active":"2024-09-10T06:26:30.593326+0000","last_became_peered":"2024-09-10T06:26:30.593326+0000","last_unstale":"2024-09-10T06:29:24.575589+0000","last_undegraded":"2024-09-10T06:29:24.575589+0000","last_fullsized":"2024-09-10T06:29:24.575589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:24.575459+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:24.575459+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.575459+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:21.110383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.382052+0000","last_change":"2024-09-10T06:29:39.382052+0000","last_active":"2024-09-10T06:29:39.382052+0000","last_peered":"2024-09-10T06:29:39.382052+0000","last_clean":"2024-09-10T06:29:39.382052+0000","last_became_active":"2024-09-10T06:26:34.281147+0000","last_became_peered":"2024-09-10T06:26:34.281147+0000","last_unstale":"2024-09-10T06:29:39.382052+0000","last_undegraded":"2024-09-10T06:29:39.382052+0000","last_fullsized":"2024-09-10T06:29:39.382052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:39.381863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:39.381863+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.381863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:14.041644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"95'22","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:48.202474+0000","last_change":"2024-09-10T06:29:48.202474+0000","last_active":"2024-09-10T06:29:48.202474+0000","last_peered":"2024-09-10T06:29:48.202474+0000","last_clean":"2024-09-10T06:29:48.202474+0000","last_became_active":"2024-09-10T06:26:36.297372+0000","last_became_peered":"2024-09-10T06:26:36.297372+0000","last_unstale":"2024-09-10T06:29:48.202474+0000","last_undegraded":"2024-09-10T06:29:48.202474+0000","last_fullsized":"2024-09-10T06:29:48.202474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:48.202288+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:48.202288+0000","last_clean_scrub_stamp":"2024-09-10T06:29:48.202288+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:56.682018+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:52.452376+0000","last_change":"2024-09-10T06:29:52.452376+0000","last_active":"2024-09-10T06:29:52.452376+0000","last_peered":"2024-09-10T06:29:52.452376+0000","last_clean":"2024-09-10T06:29:52.452376+0000","last_became_active":"2024-09-10T06:26:38.300580+0000","last_became_peered":"2024-09-10T06:26:38.300580+0000","last_unstale":"2024-09-10T06:29:52.452376+0000","last_undegraded":"2024-09-10T06:29:52.452376+0000","last_fullsized":"2024-09-10T06:29:52.452376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:52.452191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:52.452191+0000","last_clean_scrub_stamp":"2024-09-10T06:29:52.452191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:14.622673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"67'10","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.421377+0000","last_change":"2024-09-10T06:29:35.421377+0000","last_active":"2024-09-10T06:29:35.421377+0000","last_peered":"2024-09-10T06:29:35.421377+0000","last_clean":"2024-09-10T06:29:35.421377+0000","last_became_active":"2024-09-10T06:26:32.284457+0000","last_became_peered":"2024-09-10T06:26:32.284457+0000","last_unstale":"2024-09-10T06:29:35.421377+0000","last_undegraded":"2024-09-10T06:29:35.421377+0000","last_fullsized":"2024-09-10T06:29:35.421377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T06:29:35.421160+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T06:29:35.421160+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.421160+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:45.636212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"95'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.149600+0000","last_change":"2024-09-10T06:29:29.149600+0000","last_active":"2024-09-10T06:29:29.149600+0000","last_peered":"2024-09-10T06:29:29.149600+0000","last_clean":"2024-09-10T06:29:29.149600+0000","last_became_active":"2024-09-10T06:26:30.571377+0000","last_became_peered":"2024-09-10T06:26:30.571377+0000","last_unstale":"2024-09-10T06:29:29.149600+0000","last_undegraded":"2024-09-10T06:29:29.149600+0000","last_fullsized":"2024-09-10T06:29:29.149600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:29.149420+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:29.149420+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.149420+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:30.977630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:44.552658+0000","last_change":"2024-09-10T06:29:44.552658+0000","last_active":"2024-09-10T06:29:44.552658+0000","last_peered":"2024-09-10T06:29:44.552658+0000","last_clean":"2024-09-10T06:29:44.552658+0000","last_became_active":"2024-09-10T06:26:34.268677+0000","last_became_peered":"2024-09-10T06:26:34.268677+0000","last_unstale":"2024-09-10T06:29:44.552658+0000","last_undegraded":"2024-09-10T06:29:44.552658+0000","last_fullsized":"2024-09-10T06:29:44.552658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:44.552483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:44.552483+0000","last_clean_scrub_stamp":"2024-09-10T06:29:44.552483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:25:00.261839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"95'33","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:44.780275+0000","last_change":"2024-09-10T06:29:44.780275+0000","last_active":"2024-09-10T06:29:44.780275+0000","last_peered":"2024-09-10T06:29:44.780275+0000","last_clean":"2024-09-10T06:29:44.780275+0000","last_became_active":"2024-09-10T06:26:36.299645+0000","last_became_peered":"2024-09-10T06:26:36.299645+0000","last_unstale":"2024-09-10T06:29:44.780275+0000","last_undegraded":"2024-09-10T06:29:44.780275+0000","last_fullsized":"2024-09-10T06:29:44.780275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'33","last_scrub_stamp":"2024-09-10T06:29:44.780200+0000","last_deep_scrub":"95'33","last_deep_scrub_stamp":"2024-09-10T06:29:44.780200+0000","last_clean_scrub_stamp":"2024-09-10T06:29:44.780200+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:55.081037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:51.385652+0000","last_change":"2024-09-10T06:29:51.385652+0000","last_active":"2024-09-10T06:29:51.385652+0000","last_peered":"2024-09-10T06:29:51.385652+0000","last_clean":"2024-09-10T06:29:51.385652+0000","last_became_active":"2024-09-10T06:26:38.298414+0000","last_became_peered":"2024-09-10T06:26:38.298414+0000","last_unstale":"2024-09-10T06:29:51.385652+0000","last_undegraded":"2024-09-10T06:29:51.385652+0000","last_fullsized":"2024-09-10T06:29:51.385652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:51.385463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:51.385463+0000","last_clean_scrub_stamp":"2024-09-10T06:29:51.385463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:29.589652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'2","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.375129+0000","last_change":"2024-09-10T06:26:40.312752+0000","last_active":"2024-09-10T06:28:48.375129+0000","last_peered":"2024-09-10T06:28:48.375129+0000","last_clean":"2024-09-10T06:28:48.375129+0000","last_became_active":"2024-09-10T06:26:40.312026+0000","last_became_peered":"2024-09-10T06:26:40.312026+0000","last_unstale":"2024-09-10T06:28:48.375129+0000","last_undegraded":"2024-09-10T06:28:48.375129+0000","last_fullsized":"2024-09-10T06:28:48.375129+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:01:50.071224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.556968+0000","last_change":"2024-09-10T06:29:35.556968+0000","last_active":"2024-09-10T06:29:35.556968+0000","last_peered":"2024-09-10T06:29:35.556968+0000","last_clean":"2024-09-10T06:29:35.556968+0000","last_became_active":"2024-09-10T06:26:32.266682+0000","last_became_peered":"2024-09-10T06:26:32.266682+0000","last_unstale":"2024-09-10T06:29:35.556968+0000","last_undegraded":"2024-09-10T06:29:35.556968+0000","last_fullsized":"2024-09-10T06:29:35.556968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:35.556785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:35.556785+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.556785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:52.129101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'28","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.729826+0000","last_change":"2024-09-10T06:29:25.729826+0000","last_active":"2024-09-10T06:29:25.729826+0000","last_peered":"2024-09-10T06:29:25.729826+0000","last_clean":"2024-09-10T06:29:25.729826+0000","last_became_active":"2024-09-10T06:26:30.578692+0000","last_became_peered":"2024-09-10T06:26:30.578692+0000","last_unstale":"2024-09-10T06:29:25.729826+0000","last_undegraded":"2024-09-10T06:29:25.729826+0000","last_fullsized":"2024-09-10T06:29:25.729826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'28","last_scrub_stamp":"2024-09-10T06:29:25.729659+0000","last_deep_scrub":"95'28","last_deep_scrub_stamp":"2024-09-10T06:29:25.729659+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.729659+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:17.803992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":36,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"95'2","reported_seq":223,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.384665+0000","last_change":"2024-09-10T06:29:40.384665+0000","last_active":"2024-09-10T06:29:40.384665+0000","last_peered":"2024-09-10T06:29:40.384665+0000","last_clean":"2024-09-10T06:29:40.384665+0000","last_became_active":"2024-09-10T06:26:34.281167+0000","last_became_peered":"2024-09-10T06:26:34.281167+0000","last_unstale":"2024-09-10T06:29:40.384665+0000","last_undegraded":"2024-09-10T06:29:40.384665+0000","last_fullsized":"2024-09-10T06:29:40.384665+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-10T06:29:40.384488+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-10T06:29:40.384488+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.384488+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:40.370647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"95'33","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:50.213266+0000","last_change":"2024-09-10T06:29:50.213266+0000","last_active":"2024-09-10T06:29:50.213266+0000","last_peered":"2024-09-10T06:29:50.213266+0000","last_clean":"2024-09-10T06:29:50.213266+0000","last_became_active":"2024-09-10T06:26:36.300501+0000","last_became_peered":"2024-09-10T06:26:36.300501+0000","last_unstale":"2024-09-10T06:29:50.213266+0000","last_undegraded":"2024-09-10T06:29:50.213266+0000","last_fullsized":"2024-09-10T06:29:50.213266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'33","last_scrub_stamp":"2024-09-10T06:29:50.213080+0000","last_deep_scrub":"95'33","last_deep_scrub_stamp":"2024-09-10T06:29:50.213080+0000","last_clean_scrub_stamp":"2024-09-10T06:29:50.213080+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:58.392073+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:47.787447+0000","last_change":"2024-09-10T06:29:47.787447+0000","last_active":"2024-09-10T06:29:47.787447+0000","last_peered":"2024-09-10T06:29:47.787447+0000","last_clean":"2024-09-10T06:29:47.787447+0000","last_became_active":"2024-09-10T06:26:38.303318+0000","last_became_peered":"2024-09-10T06:26:38.303318+0000","last_unstale":"2024-09-10T06:29:47.787447+0000","last_undegraded":"2024-09-10T06:29:47.787447+0000","last_fullsized":"2024-09-10T06:29:47.787447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:47.787262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:47.787262+0000","last_clean_scrub_stamp":"2024-09-10T06:29:47.787262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:02:06.828204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"67'10","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:49.436499+0000","last_change":"2024-09-10T06:29:49.436499+0000","last_active":"2024-09-10T06:29:49.436499+0000","last_peered":"2024-09-10T06:29:49.436499+0000","last_clean":"2024-09-10T06:29:49.436499+0000","last_became_active":"2024-09-10T06:26:40.317695+0000","last_became_peered":"2024-09-10T06:26:40.317695+0000","last_unstale":"2024-09-10T06:29:49.436499+0000","last_undegraded":"2024-09-10T06:29:49.436499+0000","last_fullsized":"2024-09-10T06:29:49.436499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T06:29:49.436324+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T06:29:49.436324+0000","last_clean_scrub_stamp":"2024-09-10T06:29:49.436324+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:17.338968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.900641+0000","last_change":"2024-09-10T06:29:38.900641+0000","last_active":"2024-09-10T06:29:38.900641+0000","last_peered":"2024-09-10T06:29:38.900641+0000","last_clean":"2024-09-10T06:29:38.900641+0000","last_became_active":"2024-09-10T06:26:32.275805+0000","last_became_peered":"2024-09-10T06:26:32.275805+0000","last_unstale":"2024-09-10T06:29:38.900641+0000","last_undegraded":"2024-09-10T06:29:38.900641+0000","last_fullsized":"2024-09-10T06:29:38.900641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:38.900412+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:38.900412+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.900412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:18.879138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"95'14","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.038073+0000","last_change":"2024-09-10T06:29:26.038073+0000","last_active":"2024-09-10T06:29:26.038073+0000","last_peered":"2024-09-10T06:29:26.038073+0000","last_clean":"2024-09-10T06:29:26.038073+0000","last_became_active":"2024-09-10T06:26:30.567937+0000","last_became_peered":"2024-09-10T06:26:30.567937+0000","last_unstale":"2024-09-10T06:29:26.038073+0000","last_undegraded":"2024-09-10T06:29:26.038073+0000","last_fullsized":"2024-09-10T06:29:26.038073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:26.037883+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:26.037883+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.037883+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:00.697665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:47.192722+0000","last_change":"2024-09-10T06:29:47.192722+0000","last_active":"2024-09-10T06:29:47.192722+0000","last_peered":"2024-09-10T06:29:47.192722+0000","last_clean":"2024-09-10T06:29:47.192722+0000","last_became_active":"2024-09-10T06:26:34.262443+0000","last_became_peered":"2024-09-10T06:26:34.262443+0000","last_unstale":"2024-09-10T06:29:47.192722+0000","last_undegraded":"2024-09-10T06:29:47.192722+0000","last_fullsized":"2024-09-10T06:29:47.192722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:47.192532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:47.192532+0000","last_clean_scrub_stamp":"2024-09-10T06:29:47.192532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:55.672262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"95'26","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:53.873910+0000","last_change":"2024-09-10T06:29:53.873910+0000","last_active":"2024-09-10T06:29:53.873910+0000","last_peered":"2024-09-10T06:29:53.873910+0000","last_clean":"2024-09-10T06:29:53.873910+0000","last_became_active":"2024-09-10T06:26:36.292149+0000","last_became_peered":"2024-09-10T06:26:36.292149+0000","last_unstale":"2024-09-10T06:29:53.873910+0000","last_undegraded":"2024-09-10T06:29:53.873910+0000","last_fullsized":"2024-09-10T06:29:53.873910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-10T06:29:53.873717+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-10T06:29:53.873717+0000","last_clean_scrub_stamp":"2024-09-10T06:29:53.873717+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:08.931175+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:46.782379+0000","last_change":"2024-09-10T06:29:46.782379+0000","last_active":"2024-09-10T06:29:46.782379+0000","last_peered":"2024-09-10T06:29:46.782379+0000","last_clean":"2024-09-10T06:29:46.782379+0000","last_became_active":"2024-09-10T06:26:38.289306+0000","last_became_peered":"2024-09-10T06:26:38.289306+0000","last_unstale":"2024-09-10T06:29:46.782379+0000","last_undegraded":"2024-09-10T06:29:46.782379+0000","last_fullsized":"2024-09-10T06:29:46.782379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:46.782189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:46.782189+0000","last_clean_scrub_stamp":"2024-09-10T06:29:46.782189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:39.891565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:55.371112+0000","last_change":"2024-09-10T06:29:55.371112+0000","last_active":"2024-09-10T06:29:55.371112+0000","last_peered":"2024-09-10T06:29:55.371112+0000","last_clean":"2024-09-10T06:29:55.371112+0000","last_became_active":"2024-09-10T06:26:40.326888+0000","last_became_peered":"2024-09-10T06:26:40.326888+0000","last_unstale":"2024-09-10T06:29:55.371112+0000","last_undegraded":"2024-09-10T06:29:55.371112+0000","last_fullsized":"2024-09-10T06:29:55.371112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:55.370885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:55.370885+0000","last_clean_scrub_stamp":"2024-09-10T06:29:55.370885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:47.062744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.534235+0000","last_change":"2024-09-10T06:29:28.534235+0000","last_active":"2024-09-10T06:29:28.534235+0000","last_peered":"2024-09-10T06:29:28.534235+0000","last_clean":"2024-09-10T06:29:28.534235+0000","last_became_active":"2024-09-10T06:26:32.274395+0000","last_became_peered":"2024-09-10T06:26:32.274395+0000","last_unstale":"2024-09-10T06:29:28.534235+0000","last_undegraded":"2024-09-10T06:29:28.534235+0000","last_fullsized":"2024-09-10T06:29:28.534235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-10T06:29:28.533919+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-10T06:29:28.533919+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.533919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:34:22.535590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"95'14","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.586596+0000","last_change":"2024-09-10T06:29:25.586596+0000","last_active":"2024-09-10T06:29:25.586596+0000","last_peered":"2024-09-10T06:29:25.586596+0000","last_clean":"2024-09-10T06:29:25.586596+0000","last_became_active":"2024-09-10T06:26:30.594058+0000","last_became_peered":"2024-09-10T06:26:30.594058+0000","last_unstale":"2024-09-10T06:29:25.586596+0000","last_undegraded":"2024-09-10T06:29:25.586596+0000","last_fullsized":"2024-09-10T06:29:25.586596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:25.586401+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:25.586401+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.586401+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:32.336377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:43.817154+0000","last_change":"2024-09-10T06:29:43.817154+0000","last_active":"2024-09-10T06:29:43.817154+0000","last_peered":"2024-09-10T06:29:43.817154+0000","last_clean":"2024-09-10T06:29:43.817154+0000","last_became_active":"2024-09-10T06:26:34.278871+0000","last_became_peered":"2024-09-10T06:26:34.278871+0000","last_unstale":"2024-09-10T06:29:43.817154+0000","last_undegraded":"2024-09-10T06:29:43.817154+0000","last_fullsized":"2024-09-10T06:29:43.817154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:43.816970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:43.816970+0000","last_clean_scrub_stamp":"2024-09-10T06:29:43.816970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:22.145075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"95'18","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:52.204269+0000","last_change":"2024-09-10T06:29:52.204269+0000","last_active":"2024-09-10T06:29:52.204269+0000","last_peered":"2024-09-10T06:29:52.204269+0000","last_clean":"2024-09-10T06:29:52.204269+0000","last_became_active":"2024-09-10T06:26:36.290265+0000","last_became_peered":"2024-09-10T06:26:36.290265+0000","last_unstale":"2024-09-10T06:29:52.204269+0000","last_undegraded":"2024-09-10T06:29:52.204269+0000","last_fullsized":"2024-09-10T06:29:52.204269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:52.204043+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:52.204043+0000","last_clean_scrub_stamp":"2024-09-10T06:29:52.204043+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:11.403350+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1348,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'105","reported_seq":282,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:47.498349+0000","last_change":"2024-09-10T06:29:47.498349+0000","last_active":"2024-09-10T06:29:47.498349+0000","last_peered":"2024-09-10T06:29:47.498349+0000","last_clean":"2024-09-10T06:29:47.498349+0000","last_became_active":"2024-09-10T06:26:38.288791+0000","last_became_peered":"2024-09-10T06:26:38.288791+0000","last_unstale":"2024-09-10T06:29:47.498349+0000","last_undegraded":"2024-09-10T06:29:47.498349+0000","last_fullsized":"2024-09-10T06:29:47.498349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'105","last_scrub_stamp":"2024-09-10T06:29:47.498168+0000","last_deep_scrub":"95'105","last_deep_scrub_stamp":"2024-09-10T06:29:47.498168+0000","last_clean_scrub_stamp":"2024-09-10T06:29:47.498168+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:11.322516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"76'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:55.300095+0000","last_change":"2024-09-10T06:29:55.300095+0000","last_active":"2024-09-10T06:29:55.300095+0000","last_peered":"2024-09-10T06:29:55.300095+0000","last_clean":"2024-09-10T06:29:55.300095+0000","last_became_active":"2024-09-10T06:26:40.335771+0000","last_became_peered":"2024-09-10T06:26:40.335771+0000","last_unstale":"2024-09-10T06:29:55.300095+0000","last_undegraded":"2024-09-10T06:29:55.300095+0000","last_fullsized":"2024-09-10T06:29:55.300095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:55.299881+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:55.299881+0000","last_clean_scrub_stamp":"2024-09-10T06:29:55.299881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:25:11.009236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.077261+0000","last_change":"2024-09-10T06:29:36.077261+0000","last_active":"2024-09-10T06:29:36.077261+0000","last_peered":"2024-09-10T06:29:36.077261+0000","last_clean":"2024-09-10T06:29:36.077261+0000","last_became_active":"2024-09-10T06:26:32.261250+0000","last_became_peered":"2024-09-10T06:26:32.261250+0000","last_unstale":"2024-09-10T06:29:36.077261+0000","last_undegraded":"2024-09-10T06:29:36.077261+0000","last_fullsized":"2024-09-10T06:29:36.077261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:36.077082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:36.077082+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.077082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:34.084912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"95'16","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.341624+0000","last_change":"2024-09-10T06:29:28.341624+0000","last_active":"2024-09-10T06:29:28.341624+0000","last_peered":"2024-09-10T06:29:28.341624+0000","last_clean":"2024-09-10T06:29:28.341624+0000","last_became_active":"2024-09-10T06:26:30.603175+0000","last_became_peered":"2024-09-10T06:26:30.603175+0000","last_unstale":"2024-09-10T06:29:28.341624+0000","last_undegraded":"2024-09-10T06:29:28.341624+0000","last_fullsized":"2024-09-10T06:29:28.341624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:28.341424+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:28.341424+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.341424+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:41.882711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:44.236526+0000","last_change":"2024-09-10T06:29:44.236526+0000","last_active":"2024-09-10T06:29:44.236526+0000","last_peered":"2024-09-10T06:29:44.236526+0000","last_clean":"2024-09-10T06:29:44.236526+0000","last_became_active":"2024-09-10T06:26:34.285169+0000","last_became_peered":"2024-09-10T06:26:34.285169+0000","last_unstale":"2024-09-10T06:29:44.236526+0000","last_undegraded":"2024-09-10T06:29:44.236526+0000","last_fullsized":"2024-09-10T06:29:44.236526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:44.236321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:44.236321+0000","last_clean_scrub_stamp":"2024-09-10T06:29:44.236321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:52.157818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"95'31","reported_seq":193,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:49.310270+0000","last_change":"2024-09-10T06:29:49.310270+0000","last_active":"2024-09-10T06:29:49.310270+0000","last_peered":"2024-09-10T06:29:49.310270+0000","last_clean":"2024-09-10T06:29:49.310270+0000","last_became_active":"2024-09-10T06:26:36.288780+0000","last_became_peered":"2024-09-10T06:26:36.288780+0000","last_unstale":"2024-09-10T06:29:49.310270+0000","last_undegraded":"2024-09-10T06:29:49.310270+0000","last_fullsized":"2024-09-10T06:29:49.310270+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'31","last_scrub_stamp":"2024-09-10T06:29:49.310157+0000","last_deep_scrub":"95'31","last_deep_scrub_stamp":"2024-09-10T06:29:49.310157+0000","last_clean_scrub_stamp":"2024-09-10T06:29:49.310157+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:11.501092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:56.516640+0000","last_change":"2024-09-10T06:29:56.516640+0000","last_active":"2024-09-10T06:29:56.516640+0000","last_peered":"2024-09-10T06:29:56.516640+0000","last_clean":"2024-09-10T06:29:56.516640+0000","last_became_active":"2024-09-10T06:26:38.292185+0000","last_became_peered":"2024-09-10T06:26:38.292185+0000","last_unstale":"2024-09-10T06:29:56.516640+0000","last_undegraded":"2024-09-10T06:29:56.516640+0000","last_fullsized":"2024-09-10T06:29:56.516640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:56.516467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:56.516467+0000","last_clean_scrub_stamp":"2024-09-10T06:29:56.516467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:11.573925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"64'10","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:57.297701+0000","last_change":"2024-09-10T06:29:57.297701+0000","last_active":"2024-09-10T06:29:57.297701+0000","last_peered":"2024-09-10T06:29:57.297701+0000","last_clean":"2024-09-10T06:29:57.297701+0000","last_became_active":"2024-09-10T06:26:40.335339+0000","last_became_peered":"2024-09-10T06:26:40.335339+0000","last_unstale":"2024-09-10T06:29:57.297701+0000","last_undegraded":"2024-09-10T06:29:57.297701+0000","last_fullsized":"2024-09-10T06:29:57.297701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'10","last_scrub_stamp":"2024-09-10T06:29:57.297518+0000","last_deep_scrub":"64'10","last_deep_scrub_stamp":"2024-09-10T06:29:57.297518+0000","last_clean_scrub_stamp":"2024-09-10T06:29:57.297518+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:08.820291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"76'4","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.087554+0000","last_change":"2024-09-10T06:29:35.087554+0000","last_active":"2024-09-10T06:29:35.087554+0000","last_peered":"2024-09-10T06:29:35.087554+0000","last_clean":"2024-09-10T06:29:35.087554+0000","last_became_active":"2024-09-10T06:26:32.262041+0000","last_became_peered":"2024-09-10T06:26:32.262041+0000","last_unstale":"2024-09-10T06:29:35.087554+0000","last_undegraded":"2024-09-10T06:29:35.087554+0000","last_fullsized":"2024-09-10T06:29:35.087554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:35.087363+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:35.087363+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.087363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:40.057300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"95'14","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:22.516504+0000","last_change":"2024-09-10T06:29:22.516444+0000","last_active":"2024-09-10T06:29:22.516504+0000","last_peered":"2024-09-10T06:29:22.516504+0000","last_clean":"2024-09-10T06:29:22.516504+0000","last_became_active":"2024-09-10T06:27:08.868399+0000","last_became_peered":"2024-09-10T06:27:08.868399+0000","last_unstale":"2024-09-10T06:29:22.516504+0000","last_undegraded":"2024-09-10T06:29:22.516504+0000","last_fullsized":"2024-09-10T06:29:22.516504+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:22.516374+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:22.516374+0000","last_clean_scrub_stamp":"2024-09-10T06:29:22.516374+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:49.935970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:45.218142+0000","last_change":"2024-09-10T06:29:45.218142+0000","last_active":"2024-09-10T06:29:45.218142+0000","last_peered":"2024-09-10T06:29:45.218142+0000","last_clean":"2024-09-10T06:29:45.218142+0000","last_became_active":"2024-09-10T06:26:34.281777+0000","last_became_peered":"2024-09-10T06:26:34.281777+0000","last_unstale":"2024-09-10T06:29:45.218142+0000","last_undegraded":"2024-09-10T06:29:45.218142+0000","last_fullsized":"2024-09-10T06:29:45.218142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:45.217937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:45.217937+0000","last_clean_scrub_stamp":"2024-09-10T06:29:45.217937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:25.484500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"95'21","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:46.524827+0000","last_change":"2024-09-10T06:29:46.524827+0000","last_active":"2024-09-10T06:29:46.524827+0000","last_peered":"2024-09-10T06:29:46.524827+0000","last_clean":"2024-09-10T06:29:46.524827+0000","last_became_active":"2024-09-10T06:26:36.284470+0000","last_became_peered":"2024-09-10T06:26:36.284470+0000","last_unstale":"2024-09-10T06:29:46.524827+0000","last_undegraded":"2024-09-10T06:29:46.524827+0000","last_fullsized":"2024-09-10T06:29:46.524827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'21","last_scrub_stamp":"2024-09-10T06:29:46.524617+0000","last_deep_scrub":"95'21","last_deep_scrub_stamp":"2024-09-10T06:29:46.524617+0000","last_clean_scrub_stamp":"2024-09-10T06:29:46.524617+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:10.543782+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:45.480359+0000","last_change":"2024-09-10T06:29:45.480359+0000","last_active":"2024-09-10T06:29:45.480359+0000","last_peered":"2024-09-10T06:29:45.480359+0000","last_clean":"2024-09-10T06:29:45.480359+0000","last_became_active":"2024-09-10T06:26:38.302606+0000","last_became_peered":"2024-09-10T06:26:38.302606+0000","last_unstale":"2024-09-10T06:29:45.480359+0000","last_undegraded":"2024-09-10T06:29:45.480359+0000","last_fullsized":"2024-09-10T06:29:45.480359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:45.480176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:45.480176+0000","last_clean_scrub_stamp":"2024-09-10T06:29:45.480176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:03.360800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"76'13","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:28:48.379260+0000","last_change":"2024-09-10T06:26:40.311253+0000","last_active":"2024-09-10T06:28:48.379260+0000","last_peered":"2024-09-10T06:28:48.379260+0000","last_clean":"2024-09-10T06:28:48.379260+0000","last_became_active":"2024-09-10T06:26:40.310414+0000","last_became_peered":"2024-09-10T06:26:40.310414+0000","last_unstale":"2024-09-10T06:28:48.379260+0000","last_undegraded":"2024-09-10T06:28:48.379260+0000","last_fullsized":"2024-09-10T06:28:48.379260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:26:39.263967+0000","last_clean_scrub_stamp":"2024-09-10T06:26:39.263967+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:06:20.868195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.087455+0000","last_change":"2024-09-10T06:29:33.087455+0000","last_active":"2024-09-10T06:29:33.087455+0000","last_peered":"2024-09-10T06:29:33.087455+0000","last_clean":"2024-09-10T06:29:33.087455+0000","last_became_active":"2024-09-10T06:26:32.262469+0000","last_became_peered":"2024-09-10T06:26:32.262469+0000","last_unstale":"2024-09-10T06:29:33.087455+0000","last_undegraded":"2024-09-10T06:29:33.087455+0000","last_fullsized":"2024-09-10T06:29:33.087455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:33.087265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:33.087265+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.087265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:32.570874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"95'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.076609+0000","last_change":"2024-09-10T06:29:26.076609+0000","last_active":"2024-09-10T06:29:26.076609+0000","last_peered":"2024-09-10T06:29:26.076609+0000","last_clean":"2024-09-10T06:29:26.076609+0000","last_became_active":"2024-09-10T06:26:30.601672+0000","last_became_peered":"2024-09-10T06:26:30.601672+0000","last_unstale":"2024-09-10T06:29:26.076609+0000","last_undegraded":"2024-09-10T06:29:26.076609+0000","last_fullsized":"2024-09-10T06:29:26.076609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:26.076397+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:26.076397+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.076397+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:07.806859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:46.182010+0000","last_change":"2024-09-10T06:29:46.182010+0000","last_active":"2024-09-10T06:29:46.182010+0000","last_peered":"2024-09-10T06:29:46.182010+0000","last_clean":"2024-09-10T06:29:46.182010+0000","last_became_active":"2024-09-10T06:26:34.276197+0000","last_became_peered":"2024-09-10T06:26:34.276197+0000","last_unstale":"2024-09-10T06:29:46.182010+0000","last_undegraded":"2024-09-10T06:29:46.182010+0000","last_fullsized":"2024-09-10T06:29:46.182010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:46.181774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:46.181774+0000","last_clean_scrub_stamp":"2024-09-10T06:29:46.181774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:58.126580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"95'16","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:50.913561+0000","last_change":"2024-09-10T06:29:50.913561+0000","last_active":"2024-09-10T06:29:50.913561+0000","last_peered":"2024-09-10T06:29:50.913561+0000","last_clean":"2024-09-10T06:29:50.913561+0000","last_became_active":"2024-09-10T06:26:36.296615+0000","last_became_peered":"2024-09-10T06:26:36.296615+0000","last_unstale":"2024-09-10T06:29:50.913561+0000","last_undegraded":"2024-09-10T06:29:50.913561+0000","last_fullsized":"2024-09-10T06:29:50.913561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:50.913371+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:50.913371+0000","last_clean_scrub_stamp":"2024-09-10T06:29:50.913371+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:16.544717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:55.244712+0000","last_change":"2024-09-10T06:29:55.244712+0000","last_active":"2024-09-10T06:29:55.244712+0000","last_peered":"2024-09-10T06:29:55.244712+0000","last_clean":"2024-09-10T06:29:55.244712+0000","last_became_active":"2024-09-10T06:26:38.288055+0000","last_became_peered":"2024-09-10T06:26:38.288055+0000","last_unstale":"2024-09-10T06:29:55.244712+0000","last_undegraded":"2024-09-10T06:29:55.244712+0000","last_fullsized":"2024-09-10T06:29:55.244712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:55.244536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:55.244536+0000","last_clean_scrub_stamp":"2024-09-10T06:29:55.244536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:17.435471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:56.296532+0000","last_change":"2024-09-10T06:29:56.296532+0000","last_active":"2024-09-10T06:29:56.296532+0000","last_peered":"2024-09-10T06:29:56.296532+0000","last_clean":"2024-09-10T06:29:56.296532+0000","last_became_active":"2024-09-10T06:26:40.317244+0000","last_became_peered":"2024-09-10T06:26:40.317244+0000","last_unstale":"2024-09-10T06:29:56.296532+0000","last_undegraded":"2024-09-10T06:29:56.296532+0000","last_fullsized":"2024-09-10T06:29:56.296532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:56.296238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:56.296238+0000","last_clean_scrub_stamp":"2024-09-10T06:29:56.296238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:18.487172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"76'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.104229+0000","last_change":"2024-09-10T06:29:34.104229+0000","last_active":"2024-09-10T06:29:34.104229+0000","last_peered":"2024-09-10T06:29:34.104229+0000","last_clean":"2024-09-10T06:29:34.104229+0000","last_became_active":"2024-09-10T06:26:32.274812+0000","last_became_peered":"2024-09-10T06:26:32.274812+0000","last_unstale":"2024-09-10T06:29:34.104229+0000","last_undegraded":"2024-09-10T06:29:34.104229+0000","last_fullsized":"2024-09-10T06:29:34.104229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:34.104024+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:34.104024+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.104024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:30.638947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"95'20","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.561214+0000","last_change":"2024-09-10T06:29:28.561214+0000","last_active":"2024-09-10T06:29:28.561214+0000","last_peered":"2024-09-10T06:29:28.561214+0000","last_clean":"2024-09-10T06:29:28.561214+0000","last_became_active":"2024-09-10T06:26:30.593687+0000","last_became_peered":"2024-09-10T06:26:30.593687+0000","last_unstale":"2024-09-10T06:29:28.561214+0000","last_undegraded":"2024-09-10T06:29:28.561214+0000","last_fullsized":"2024-09-10T06:29:28.561214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:28.561010+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:28.561010+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.561010+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:35.631710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"95'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.804848+0000","last_change":"2024-09-10T06:29:39.804848+0000","last_active":"2024-09-10T06:29:39.804848+0000","last_peered":"2024-09-10T06:29:39.804848+0000","last_clean":"2024-09-10T06:29:39.804848+0000","last_became_active":"2024-09-10T06:26:34.282931+0000","last_became_peered":"2024-09-10T06:26:34.282931+0000","last_unstale":"2024-09-10T06:29:39.804848+0000","last_undegraded":"2024-09-10T06:29:39.804848+0000","last_fullsized":"2024-09-10T06:29:39.804848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-10T06:29:39.804639+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-10T06:29:39.804639+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.804639+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:02.780607+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"95'22","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:51.220667+0000","last_change":"2024-09-10T06:29:51.220667+0000","last_active":"2024-09-10T06:29:51.220667+0000","last_peered":"2024-09-10T06:29:51.220667+0000","last_clean":"2024-09-10T06:29:51.220667+0000","last_became_active":"2024-09-10T06:26:36.289033+0000","last_became_peered":"2024-09-10T06:26:36.289033+0000","last_unstale":"2024-09-10T06:29:51.220667+0000","last_undegraded":"2024-09-10T06:29:51.220667+0000","last_fullsized":"2024-09-10T06:29:51.220667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:51.220458+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:51.220458+0000","last_clean_scrub_stamp":"2024-09-10T06:29:51.220458+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:31.487022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:53.425744+0000","last_change":"2024-09-10T06:29:53.425744+0000","last_active":"2024-09-10T06:29:53.425744+0000","last_peered":"2024-09-10T06:29:53.425744+0000","last_clean":"2024-09-10T06:29:53.425744+0000","last_became_active":"2024-09-10T06:26:38.298779+0000","last_became_peered":"2024-09-10T06:26:38.298779+0000","last_unstale":"2024-09-10T06:29:53.425744+0000","last_undegraded":"2024-09-10T06:29:53.425744+0000","last_fullsized":"2024-09-10T06:29:53.425744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:53.425462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:53.425462+0000","last_clean_scrub_stamp":"2024-09-10T06:29:53.425462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:06.773548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:57.245327+0000","last_change":"2024-09-10T06:29:57.245327+0000","last_active":"2024-09-10T06:29:57.245327+0000","last_peered":"2024-09-10T06:29:57.245327+0000","last_clean":"2024-09-10T06:29:57.245327+0000","last_became_active":"2024-09-10T06:26:40.335348+0000","last_became_peered":"2024-09-10T06:26:40.335348+0000","last_unstale":"2024-09-10T06:29:57.245327+0000","last_undegraded":"2024-09-10T06:29:57.245327+0000","last_fullsized":"2024-09-10T06:29:57.245327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:57.245090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:57.245090+0000","last_clean_scrub_stamp":"2024-09-10T06:29:57.245090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:35.449278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"62'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.807660+0000","last_change":"2024-09-10T06:29:38.807660+0000","last_active":"2024-09-10T06:29:38.807660+0000","last_peered":"2024-09-10T06:29:38.807660+0000","last_clean":"2024-09-10T06:29:38.807660+0000","last_became_active":"2024-09-10T06:26:32.275855+0000","last_became_peered":"2024-09-10T06:26:32.275855+0000","last_unstale":"2024-09-10T06:29:38.807660+0000","last_undegraded":"2024-09-10T06:29:38.807660+0000","last_fullsized":"2024-09-10T06:29:38.807660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-10T06:29:38.807377+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-10T06:29:38.807377+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.807377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:35.562150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"95'22","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.481630+0000","last_change":"2024-09-10T06:29:28.481630+0000","last_active":"2024-09-10T06:29:28.481630+0000","last_peered":"2024-09-10T06:29:28.481630+0000","last_clean":"2024-09-10T06:29:28.481630+0000","last_became_active":"2024-09-10T06:26:30.590801+0000","last_became_peered":"2024-09-10T06:26:30.590801+0000","last_unstale":"2024-09-10T06:29:28.481630+0000","last_undegraded":"2024-09-10T06:29:28.481630+0000","last_fullsized":"2024-09-10T06:29:28.481630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:28.481459+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:28.481459+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.481459+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:15.157597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.681891+0000","last_change":"2024-09-10T06:29:35.681891+0000","last_active":"2024-09-10T06:29:35.681891+0000","last_peered":"2024-09-10T06:29:35.681891+0000","last_clean":"2024-09-10T06:29:35.681891+0000","last_became_active":"2024-09-10T06:26:32.267915+0000","last_became_peered":"2024-09-10T06:26:32.267915+0000","last_unstale":"2024-09-10T06:29:35.681891+0000","last_undegraded":"2024-09-10T06:29:35.681891+0000","last_fullsized":"2024-09-10T06:29:35.681891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:35.681619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:35.681619+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.681619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:47.762330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"95'20","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.565966+0000","last_change":"2024-09-10T06:29:26.565966+0000","last_active":"2024-09-10T06:29:26.565966+0000","last_peered":"2024-09-10T06:29:26.565966+0000","last_clean":"2024-09-10T06:29:26.565966+0000","last_became_active":"2024-09-10T06:26:30.593506+0000","last_became_peered":"2024-09-10T06:26:30.593506+0000","last_unstale":"2024-09-10T06:29:26.565966+0000","last_undegraded":"2024-09-10T06:29:26.565966+0000","last_fullsized":"2024-09-10T06:29:26.565966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:26.565797+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:26.565797+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.565797+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:10.093988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'6","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.297180+0000","last_change":"2024-09-10T06:29:40.297180+0000","last_active":"2024-09-10T06:29:40.297180+0000","last_peered":"2024-09-10T06:29:40.297180+0000","last_clean":"2024-09-10T06:29:40.297180+0000","last_became_active":"2024-09-10T06:26:32.287839+0000","last_became_peered":"2024-09-10T06:26:32.287839+0000","last_unstale":"2024-09-10T06:29:40.297180+0000","last_undegraded":"2024-09-10T06:29:40.297180+0000","last_fullsized":"2024-09-10T06:29:40.297180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2024-09-10T06:29:40.296901+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2024-09-10T06:29:40.296901+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.296901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:26.239244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"95'10","reported_seq":83,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.594030+0000","last_change":"2024-09-10T06:29:25.594030+0000","last_active":"2024-09-10T06:29:25.594030+0000","last_peered":"2024-09-10T06:29:25.594030+0000","last_clean":"2024-09-10T06:29:25.594030+0000","last_became_active":"2024-09-10T06:28:09.544344+0000","last_became_peered":"2024-09-10T06:28:09.544344+0000","last_unstale":"2024-09-10T06:29:25.594030+0000","last_undegraded":"2024-09-10T06:29:25.594030+0000","last_fullsized":"2024-09-10T06:29:25.594030+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-10T06:29:25.593753+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-10T06:29:25.593753+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.593753+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:27.452348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"62'4","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.634746+0000","last_change":"2024-09-10T06:29:34.634746+0000","last_active":"2024-09-10T06:29:34.634746+0000","last_peered":"2024-09-10T06:29:34.634746+0000","last_clean":"2024-09-10T06:29:34.634746+0000","last_became_active":"2024-09-10T06:26:32.272279+0000","last_became_peered":"2024-09-10T06:26:32.272279+0000","last_unstale":"2024-09-10T06:29:34.634746+0000","last_undegraded":"2024-09-10T06:29:34.634746+0000","last_fullsized":"2024-09-10T06:29:34.634746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-10T06:29:34.634524+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-10T06:29:34.634524+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.634524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:34.244616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"95'24","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.566184+0000","last_change":"2024-09-10T06:29:26.566184+0000","last_active":"2024-09-10T06:29:26.566184+0000","last_peered":"2024-09-10T06:29:26.566184+0000","last_clean":"2024-09-10T06:29:26.566184+0000","last_became_active":"2024-09-10T06:26:30.579189+0000","last_became_peered":"2024-09-10T06:26:30.579189+0000","last_unstale":"2024-09-10T06:29:26.566184+0000","last_undegraded":"2024-09-10T06:29:26.566184+0000","last_fullsized":"2024-09-10T06:29:26.566184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:26.565846+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:26.565846+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.565846+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:54.468490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.971489+0000","last_change":"2024-09-10T06:29:36.971489+0000","last_active":"2024-09-10T06:29:36.971489+0000","last_peered":"2024-09-10T06:29:36.971489+0000","last_clean":"2024-09-10T06:29:36.971489+0000","last_became_active":"2024-09-10T06:26:32.259644+0000","last_became_peered":"2024-09-10T06:26:32.259644+0000","last_unstale":"2024-09-10T06:29:36.971489+0000","last_undegraded":"2024-09-10T06:29:36.971489+0000","last_fullsized":"2024-09-10T06:29:36.971489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:36.971273+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:36.971273+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.971273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:17.237836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"95'22","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.133853+0000","last_change":"2024-09-10T06:29:30.133853+0000","last_active":"2024-09-10T06:29:30.133853+0000","last_peered":"2024-09-10T06:29:30.133853+0000","last_clean":"2024-09-10T06:29:30.133853+0000","last_became_active":"2024-09-10T06:26:30.575605+0000","last_became_peered":"2024-09-10T06:26:30.575605+0000","last_unstale":"2024-09-10T06:29:30.133853+0000","last_undegraded":"2024-09-10T06:29:30.133853+0000","last_fullsized":"2024-09-10T06:29:30.133853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:30.133668+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:30.133668+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.133668+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:38.055165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"76'10","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.089233+0000","last_change":"2024-09-10T06:29:37.089233+0000","last_active":"2024-09-10T06:29:37.089233+0000","last_peered":"2024-09-10T06:29:37.089233+0000","last_clean":"2024-09-10T06:29:37.089233+0000","last_became_active":"2024-09-10T06:26:32.272454+0000","last_became_peered":"2024-09-10T06:26:32.272454+0000","last_unstale":"2024-09-10T06:29:37.089233+0000","last_undegraded":"2024-09-10T06:29:37.089233+0000","last_fullsized":"2024-09-10T06:29:37.089233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'10","last_scrub_stamp":"2024-09-10T06:29:37.089011+0000","last_deep_scrub":"76'10","last_deep_scrub_stamp":"2024-09-10T06:29:37.089011+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.089011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:20.087601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"95'12","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.727328+0000","last_change":"2024-09-10T06:29:26.727328+0000","last_active":"2024-09-10T06:29:26.727328+0000","last_peered":"2024-09-10T06:29:26.727328+0000","last_clean":"2024-09-10T06:29:26.727328+0000","last_became_active":"2024-09-10T06:26:30.578732+0000","last_became_peered":"2024-09-10T06:26:30.578732+0000","last_unstale":"2024-09-10T06:29:26.727328+0000","last_undegraded":"2024-09-10T06:29:26.727328+0000","last_fullsized":"2024-09-10T06:29:26.727328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:26.727144+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:26.727144+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.727144+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:01.138095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.927336+0000","last_change":"2024-09-10T06:29:37.927336+0000","last_active":"2024-09-10T06:29:37.927336+0000","last_peered":"2024-09-10T06:29:37.927336+0000","last_clean":"2024-09-10T06:29:37.927336+0000","last_became_active":"2024-09-10T06:26:32.270327+0000","last_became_peered":"2024-09-10T06:26:32.270327+0000","last_unstale":"2024-09-10T06:29:37.927336+0000","last_undegraded":"2024-09-10T06:29:37.927336+0000","last_fullsized":"2024-09-10T06:29:37.927336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.927124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.927124+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.927124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:36.175407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"95'12","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.442680+0000","last_change":"2024-09-10T06:29:29.442680+0000","last_active":"2024-09-10T06:29:29.442680+0000","last_peered":"2024-09-10T06:29:29.442680+0000","last_clean":"2024-09-10T06:29:29.442680+0000","last_became_active":"2024-09-10T06:26:30.596254+0000","last_became_peered":"2024-09-10T06:26:30.596254+0000","last_unstale":"2024-09-10T06:29:29.442680+0000","last_undegraded":"2024-09-10T06:29:29.442680+0000","last_fullsized":"2024-09-10T06:29:29.442680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:29.442459+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:29.442459+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.442459+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:12.813873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'2","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.398908+0000","last_change":"2024-09-10T06:29:36.398908+0000","last_active":"2024-09-10T06:29:36.398908+0000","last_peered":"2024-09-10T06:29:36.398908+0000","last_clean":"2024-09-10T06:29:36.398908+0000","last_became_active":"2024-09-10T06:26:32.275133+0000","last_became_peered":"2024-09-10T06:26:32.275133+0000","last_unstale":"2024-09-10T06:29:36.398908+0000","last_undegraded":"2024-09-10T06:29:36.398908+0000","last_fullsized":"2024-09-10T06:29:36.398908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:36.398697+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:36.398697+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.398697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:57.551366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"95'18","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.123679+0000","last_change":"2024-09-10T06:29:27.123679+0000","last_active":"2024-09-10T06:29:27.123679+0000","last_peered":"2024-09-10T06:29:27.123679+0000","last_clean":"2024-09-10T06:29:27.123679+0000","last_became_active":"2024-09-10T06:26:30.580134+0000","last_became_peered":"2024-09-10T06:26:30.580134+0000","last_unstale":"2024-09-10T06:29:27.123679+0000","last_undegraded":"2024-09-10T06:29:27.123679+0000","last_fullsized":"2024-09-10T06:29:27.123679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:27.123490+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:27.123490+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.123490+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:41.216401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.593717+0000","last_change":"2024-09-10T06:29:37.593717+0000","last_active":"2024-09-10T06:29:37.593717+0000","last_peered":"2024-09-10T06:29:37.593717+0000","last_clean":"2024-09-10T06:29:37.593717+0000","last_became_active":"2024-09-10T06:26:32.256052+0000","last_became_peered":"2024-09-10T06:26:32.256052+0000","last_unstale":"2024-09-10T06:29:37.593717+0000","last_undegraded":"2024-09-10T06:29:37.593717+0000","last_fullsized":"2024-09-10T06:29:37.593717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:37.593531+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:37.593531+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.593531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:46.073261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"95'16","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.322872+0000","last_change":"2024-09-10T06:29:29.322872+0000","last_active":"2024-09-10T06:29:29.322872+0000","last_peered":"2024-09-10T06:29:29.322872+0000","last_clean":"2024-09-10T06:29:29.322872+0000","last_became_active":"2024-09-10T06:26:30.584443+0000","last_became_peered":"2024-09-10T06:26:30.584443+0000","last_unstale":"2024-09-10T06:29:29.322872+0000","last_undegraded":"2024-09-10T06:29:29.322872+0000","last_fullsized":"2024-09-10T06:29:29.322872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:29.322684+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:29.322684+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.322684+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:34.292621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"76'4","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.177377+0000","last_change":"2024-09-10T06:29:39.177377+0000","last_active":"2024-09-10T06:29:39.177377+0000","last_peered":"2024-09-10T06:29:39.177377+0000","last_clean":"2024-09-10T06:29:39.177377+0000","last_became_active":"2024-09-10T06:26:32.258513+0000","last_became_peered":"2024-09-10T06:26:32.258513+0000","last_unstale":"2024-09-10T06:29:39.177377+0000","last_undegraded":"2024-09-10T06:29:39.177377+0000","last_fullsized":"2024-09-10T06:29:39.177377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:39.177196+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:39.177196+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.177196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:37.865159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"95'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.102245+0000","last_change":"2024-09-10T06:29:31.102245+0000","last_active":"2024-09-10T06:29:31.102245+0000","last_peered":"2024-09-10T06:29:31.102245+0000","last_clean":"2024-09-10T06:29:31.102245+0000","last_became_active":"2024-09-10T06:26:30.580913+0000","last_became_peered":"2024-09-10T06:26:30.580913+0000","last_unstale":"2024-09-10T06:29:31.102245+0000","last_undegraded":"2024-09-10T06:29:31.102245+0000","last_fullsized":"2024-09-10T06:29:31.102245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:31.102016+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:31.102016+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.102016+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:16.248697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"76'2","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.501181+0000","last_change":"2024-09-10T06:29:31.501181+0000","last_active":"2024-09-10T06:29:31.501181+0000","last_peered":"2024-09-10T06:29:31.501181+0000","last_clean":"2024-09-10T06:29:31.501181+0000","last_became_active":"2024-09-10T06:26:32.274327+0000","last_became_peered":"2024-09-10T06:26:32.274327+0000","last_unstale":"2024-09-10T06:29:31.501181+0000","last_undegraded":"2024-09-10T06:29:31.501181+0000","last_fullsized":"2024-09-10T06:29:31.501181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:31.500938+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:31.500938+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.500938+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:43.060165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"95'12","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.526438+0000","last_change":"2024-09-10T06:29:27.526438+0000","last_active":"2024-09-10T06:29:27.526438+0000","last_peered":"2024-09-10T06:29:27.526438+0000","last_clean":"2024-09-10T06:29:27.526438+0000","last_became_active":"2024-09-10T06:27:08.592637+0000","last_became_peered":"2024-09-10T06:27:08.592637+0000","last_unstale":"2024-09-10T06:29:27.526438+0000","last_undegraded":"2024-09-10T06:29:27.526438+0000","last_fullsized":"2024-09-10T06:29:27.526438+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:27.526241+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:27.526241+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.526241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:26.084961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.135197+0000","last_change":"2024-09-10T06:29:38.135197+0000","last_active":"2024-09-10T06:29:38.135197+0000","last_peered":"2024-09-10T06:29:38.135197+0000","last_clean":"2024-09-10T06:29:38.135197+0000","last_became_active":"2024-09-10T06:26:32.278461+0000","last_became_peered":"2024-09-10T06:26:32.278461+0000","last_unstale":"2024-09-10T06:29:38.135197+0000","last_undegraded":"2024-09-10T06:29:38.135197+0000","last_fullsized":"2024-09-10T06:29:38.135197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:38.134976+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:38.134976+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.134976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:57.931148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"95'16","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.573008+0000","last_change":"2024-09-10T06:29:27.573008+0000","last_active":"2024-09-10T06:29:27.573008+0000","last_peered":"2024-09-10T06:29:27.573008+0000","last_clean":"2024-09-10T06:29:27.573008+0000","last_became_active":"2024-09-10T06:26:30.605225+0000","last_became_peered":"2024-09-10T06:26:30.605225+0000","last_unstale":"2024-09-10T06:29:27.573008+0000","last_undegraded":"2024-09-10T06:29:27.573008+0000","last_fullsized":"2024-09-10T06:29:27.573008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:27.572826+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:27.572826+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.572826+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:18.620011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"64'8","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.184350+0000","last_change":"2024-09-10T06:29:42.184350+0000","last_active":"2024-09-10T06:29:42.184350+0000","last_peered":"2024-09-10T06:29:42.184350+0000","last_clean":"2024-09-10T06:29:42.184350+0000","last_became_active":"2024-09-10T06:26:32.266234+0000","last_became_peered":"2024-09-10T06:26:32.266234+0000","last_unstale":"2024-09-10T06:29:42.184350+0000","last_undegraded":"2024-09-10T06:29:42.184350+0000","last_fullsized":"2024-09-10T06:29:42.184350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'8","last_scrub_stamp":"2024-09-10T06:29:42.184142+0000","last_deep_scrub":"64'8","last_deep_scrub_stamp":"2024-09-10T06:29:42.184142+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.184142+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:09.333624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"95'20","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.508009+0000","last_change":"2024-09-10T06:29:27.508009+0000","last_active":"2024-09-10T06:29:27.508009+0000","last_peered":"2024-09-10T06:29:27.508009+0000","last_clean":"2024-09-10T06:29:27.508009+0000","last_became_active":"2024-09-10T06:26:30.593598+0000","last_became_peered":"2024-09-10T06:26:30.593598+0000","last_unstale":"2024-09-10T06:29:27.508009+0000","last_undegraded":"2024-09-10T06:29:27.508009+0000","last_fullsized":"2024-09-10T06:29:27.508009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:27.507794+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:27.507794+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.507794+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:52.834192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"76'2","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.569752+0000","last_change":"2024-09-10T06:29:36.569752+0000","last_active":"2024-09-10T06:29:36.569752+0000","last_peered":"2024-09-10T06:29:36.569752+0000","last_clean":"2024-09-10T06:29:36.569752+0000","last_became_active":"2024-09-10T06:26:32.278032+0000","last_became_peered":"2024-09-10T06:26:32.278032+0000","last_unstale":"2024-09-10T06:29:36.569752+0000","last_undegraded":"2024-09-10T06:29:36.569752+0000","last_fullsized":"2024-09-10T06:29:36.569752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:36.569563+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:36.569563+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.569563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:22.916358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"95'18","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.188677+0000","last_change":"2024-09-10T06:29:41.188677+0000","last_active":"2024-09-10T06:29:41.188677+0000","last_peered":"2024-09-10T06:29:41.188677+0000","last_clean":"2024-09-10T06:29:41.188677+0000","last_became_active":"2024-09-10T06:26:30.579319+0000","last_became_peered":"2024-09-10T06:26:30.579319+0000","last_unstale":"2024-09-10T06:29:41.188677+0000","last_undegraded":"2024-09-10T06:29:41.188677+0000","last_fullsized":"2024-09-10T06:29:41.188677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:41.188480+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:41.188480+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.188480+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:55.281391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"67'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.838271+0000","last_change":"2024-09-10T06:29:40.838271+0000","last_active":"2024-09-10T06:29:40.838271+0000","last_peered":"2024-09-10T06:29:40.838271+0000","last_clean":"2024-09-10T06:29:40.838271+0000","last_became_active":"2024-09-10T06:26:32.256851+0000","last_became_peered":"2024-09-10T06:26:32.256851+0000","last_unstale":"2024-09-10T06:29:40.838271+0000","last_undegraded":"2024-09-10T06:29:40.838271+0000","last_fullsized":"2024-09-10T06:29:40.838271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:40.838077+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:40.838077+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.838077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:03.029012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"95'24","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.489479+0000","last_change":"2024-09-10T06:29:29.489479+0000","last_active":"2024-09-10T06:29:29.489479+0000","last_peered":"2024-09-10T06:29:29.489479+0000","last_clean":"2024-09-10T06:29:29.489479+0000","last_became_active":"2024-09-10T06:28:46.326501+0000","last_became_peered":"2024-09-10T06:28:46.326501+0000","last_unstale":"2024-09-10T06:29:29.489479+0000","last_undegraded":"2024-09-10T06:29:29.489479+0000","last_fullsized":"2024-09-10T06:29:29.489479+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:29.489292+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:29.489292+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.489292+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:43.930114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"62'8","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.302392+0000","last_change":"2024-09-10T06:29:36.302392+0000","last_active":"2024-09-10T06:29:36.302392+0000","last_peered":"2024-09-10T06:29:36.302392+0000","last_clean":"2024-09-10T06:29:36.302392+0000","last_became_active":"2024-09-10T06:26:32.266000+0000","last_became_peered":"2024-09-10T06:26:32.266000+0000","last_unstale":"2024-09-10T06:29:36.302392+0000","last_undegraded":"2024-09-10T06:29:36.302392+0000","last_fullsized":"2024-09-10T06:29:36.302392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-09-10T06:29:36.302107+0000","last_deep_scrub":"62'8","last_deep_scrub_stamp":"2024-09-10T06:29:36.302107+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.302107+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:41.272044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"95'18","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.304733+0000","last_change":"2024-09-10T06:29:30.304733+0000","last_active":"2024-09-10T06:29:30.304733+0000","last_peered":"2024-09-10T06:29:30.304733+0000","last_clean":"2024-09-10T06:29:30.304733+0000","last_became_active":"2024-09-10T06:26:30.609674+0000","last_became_peered":"2024-09-10T06:26:30.609674+0000","last_unstale":"2024-09-10T06:29:30.304733+0000","last_undegraded":"2024-09-10T06:29:30.304733+0000","last_fullsized":"2024-09-10T06:29:30.304733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:30.304509+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:30.304509+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.304509+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.312339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"95'20","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.290101+0000","last_change":"2024-09-10T06:29:31.290101+0000","last_active":"2024-09-10T06:29:31.290101+0000","last_peered":"2024-09-10T06:29:31.290101+0000","last_clean":"2024-09-10T06:29:31.290101+0000","last_became_active":"2024-09-10T06:26:30.590640+0000","last_became_peered":"2024-09-10T06:26:30.590640+0000","last_unstale":"2024-09-10T06:29:31.290101+0000","last_undegraded":"2024-09-10T06:29:31.290101+0000","last_fullsized":"2024-09-10T06:29:31.290101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:31.289915+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:31.289915+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.289915+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:59.192559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"67'10","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.624607+0000","last_change":"2024-09-10T06:29:38.624607+0000","last_active":"2024-09-10T06:29:38.624607+0000","last_peered":"2024-09-10T06:29:38.624607+0000","last_clean":"2024-09-10T06:29:38.624607+0000","last_became_active":"2024-09-10T06:26:32.266876+0000","last_became_peered":"2024-09-10T06:26:32.266876+0000","last_unstale":"2024-09-10T06:29:38.624607+0000","last_undegraded":"2024-09-10T06:29:38.624607+0000","last_fullsized":"2024-09-10T06:29:38.624607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T06:29:38.624380+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T06:29:38.624380+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.624380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:43.077926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"95'26","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.725676+0000","last_change":"2024-09-10T06:29:30.725676+0000","last_active":"2024-09-10T06:29:30.725676+0000","last_peered":"2024-09-10T06:29:30.725676+0000","last_clean":"2024-09-10T06:29:30.725676+0000","last_became_active":"2024-09-10T06:26:30.590415+0000","last_became_peered":"2024-09-10T06:26:30.590415+0000","last_unstale":"2024-09-10T06:29:30.725676+0000","last_undegraded":"2024-09-10T06:29:30.725676+0000","last_fullsized":"2024-09-10T06:29:30.725676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-10T06:29:30.725485+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-10T06:29:30.725485+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.725485+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:11.273687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.277539+0000","last_change":"2024-09-10T06:29:36.277539+0000","last_active":"2024-09-10T06:29:36.277539+0000","last_peered":"2024-09-10T06:29:36.277539+0000","last_clean":"2024-09-10T06:29:36.277539+0000","last_became_active":"2024-09-10T06:26:32.282581+0000","last_became_peered":"2024-09-10T06:26:32.282581+0000","last_unstale":"2024-09-10T06:29:36.277539+0000","last_undegraded":"2024-09-10T06:29:36.277539+0000","last_fullsized":"2024-09-10T06:29:36.277539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:36.277311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:36.277311+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.277311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:26.104758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":845,"ondisk_log_size":845,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":27618,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1027,"num_read_kb":1076,"num_write":535,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6092,"num_omap_keys":28,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":934,"ondisk_log_size":934,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":344,"num_read_kb":344,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":567,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":15,"num_write":1204,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":209715200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1156,"ondisk_log_size":1156,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542193,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1769472,"data_stored":1236965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542193,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1155072,"data_stored":646930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1200128,"data_stored":646784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542193,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1142784,"data_stored":646428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542194,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1171456,"data_stored":646769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542194,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1138688,"data_stored":645499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542194,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36488,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335352,"statfs":{"total":96636764160,"available":96599400448,"internally_reserved":0,"allocated":1171456,"data_stored":646206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542193,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":1236807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:30:05.383 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:30:05.384 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:30:05.385 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:30:05.385 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T06:26:39.263967+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=26, tm_sec=39, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=6, tm_min=29, tm_sec=19, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T06:30:05.386 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T06:30:25.387 DEBUG:teuthology.orchestra.run.smithi112:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T06:30:25.725 INFO:teuthology.orchestra.run.smithi112.stdout: 2024-09-10T06:30:25.732 INFO:teuthology.orchestra.run.smithi112.stderr:dumped all 2024-09-10T06:30:25.742 INFO:teuthology.orchestra.run.smithi112.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-09-10T06:30:25.507945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":619618,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":2868,"num_read_kb":2295,"num_write":2317,"num_write_kb":2367369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":66,"num_bytes_recovered":209715508,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6092,"num_omap_keys":28,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3359,"ondisk_log_size":3359,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263888,"kb_used_data":10256,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754710832,"statfs":{"total":773094113280,"available":772823891968,"internally_reserved":0,"allocated":10502144,"data_stored":6352388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005780"},"pg_stats":[{"pgid":"3.3f","version":"95'24","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.708872+0000","last_change":"2024-09-10T06:29:27.708872+0000","last_active":"2024-09-10T06:29:27.708872+0000","last_peered":"2024-09-10T06:29:27.708872+0000","last_clean":"2024-09-10T06:29:27.708872+0000","last_became_active":"2024-09-10T06:27:08.597026+0000","last_became_peered":"2024-09-10T06:27:08.597026+0000","last_unstale":"2024-09-10T06:29:27.708872+0000","last_undegraded":"2024-09-10T06:29:27.708872+0000","last_fullsized":"2024-09-10T06:29:27.708872+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:27.708694+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:27.708694+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.708694+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:05:43.032190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"67'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.274618+0000","last_change":"2024-09-10T06:29:39.274618+0000","last_active":"2024-09-10T06:29:39.274618+0000","last_peered":"2024-09-10T06:29:39.274618+0000","last_clean":"2024-09-10T06:29:39.274618+0000","last_became_active":"2024-09-10T06:26:32.279098+0000","last_became_peered":"2024-09-10T06:26:32.279098+0000","last_unstale":"2024-09-10T06:29:39.274618+0000","last_undegraded":"2024-09-10T06:29:39.274618+0000","last_fullsized":"2024-09-10T06:29:39.274618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:39.274400+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:39.274400+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.274400+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:55.846716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"95'10","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:22.776727+0000","last_change":"2024-09-10T06:29:22.776727+0000","last_active":"2024-09-10T06:29:22.776727+0000","last_peered":"2024-09-10T06:29:22.776727+0000","last_clean":"2024-09-10T06:29:22.776727+0000","last_became_active":"2024-09-10T06:26:30.572798+0000","last_became_peered":"2024-09-10T06:26:30.572798+0000","last_unstale":"2024-09-10T06:29:22.776727+0000","last_undegraded":"2024-09-10T06:29:22.776727+0000","last_fullsized":"2024-09-10T06:29:22.776727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-10T06:29:22.776555+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-10T06:29:22.776555+0000","last_clean_scrub_stamp":"2024-09-10T06:29:22.776555+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:35.963583+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"62'2","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.234971+0000","last_change":"2024-09-10T06:29:38.234971+0000","last_active":"2024-09-10T06:29:38.234971+0000","last_peered":"2024-09-10T06:29:38.234971+0000","last_clean":"2024-09-10T06:29:38.234971+0000","last_became_active":"2024-09-10T06:26:32.275990+0000","last_became_peered":"2024-09-10T06:26:32.275990+0000","last_unstale":"2024-09-10T06:29:38.234971+0000","last_undegraded":"2024-09-10T06:29:38.234971+0000","last_fullsized":"2024-09-10T06:29:38.234971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-10T06:29:38.234787+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-10T06:29:38.234787+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.234787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:21.233377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"95'18","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.536070+0000","last_change":"2024-09-10T06:29:31.536070+0000","last_active":"2024-09-10T06:29:31.536070+0000","last_peered":"2024-09-10T06:29:31.536070+0000","last_clean":"2024-09-10T06:29:31.536070+0000","last_became_active":"2024-09-10T06:26:30.577688+0000","last_became_peered":"2024-09-10T06:26:30.577688+0000","last_unstale":"2024-09-10T06:29:31.536070+0000","last_undegraded":"2024-09-10T06:29:31.536070+0000","last_fullsized":"2024-09-10T06:29:31.536070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:31.535858+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:31.535858+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.535858+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:58.685339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":26,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"62'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.112184+0000","last_change":"2024-09-10T06:29:42.112184+0000","last_active":"2024-09-10T06:29:42.112184+0000","last_peered":"2024-09-10T06:29:42.112184+0000","last_clean":"2024-09-10T06:29:42.112184+0000","last_became_active":"2024-09-10T06:26:32.256117+0000","last_became_peered":"2024-09-10T06:26:32.256117+0000","last_unstale":"2024-09-10T06:29:42.112184+0000","last_undegraded":"2024-09-10T06:29:42.112184+0000","last_fullsized":"2024-09-10T06:29:42.112184+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-10T06:29:42.111989+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-10T06:29:42.111989+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.111989+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:43.940199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"95'22","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.278259+0000","last_change":"2024-09-10T06:29:33.278259+0000","last_active":"2024-09-10T06:29:33.278259+0000","last_peered":"2024-09-10T06:29:33.278259+0000","last_clean":"2024-09-10T06:29:33.278259+0000","last_became_active":"2024-09-10T06:26:30.591807+0000","last_became_peered":"2024-09-10T06:26:30.591807+0000","last_unstale":"2024-09-10T06:29:33.278259+0000","last_undegraded":"2024-09-10T06:29:33.278259+0000","last_fullsized":"2024-09-10T06:29:33.278259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:33.278071+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:33.278071+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.278071+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:12.210815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.636019+0000","last_change":"2024-09-10T06:29:39.636019+0000","last_active":"2024-09-10T06:29:39.636019+0000","last_peered":"2024-09-10T06:29:39.636019+0000","last_clean":"2024-09-10T06:29:39.636019+0000","last_became_active":"2024-09-10T06:26:32.264199+0000","last_became_peered":"2024-09-10T06:26:32.264199+0000","last_unstale":"2024-09-10T06:29:39.636019+0000","last_undegraded":"2024-09-10T06:29:39.636019+0000","last_fullsized":"2024-09-10T06:29:39.636019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:39.635843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:39.635843+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.635843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:47.814837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"95'14","reported_seq":86,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.454785+0000","last_change":"2024-09-10T06:29:32.454785+0000","last_active":"2024-09-10T06:29:32.454785+0000","last_peered":"2024-09-10T06:29:32.454785+0000","last_clean":"2024-09-10T06:29:32.454785+0000","last_became_active":"2024-09-10T06:28:09.546624+0000","last_became_peered":"2024-09-10T06:28:09.546624+0000","last_unstale":"2024-09-10T06:29:32.454785+0000","last_undegraded":"2024-09-10T06:29:32.454785+0000","last_fullsized":"2024-09-10T06:29:32.454785+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:32.454564+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:32.454564+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.454564+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:28.594324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3c","version":"67'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.382374+0000","last_change":"2024-09-10T06:29:37.382374+0000","last_active":"2024-09-10T06:29:37.382374+0000","last_peered":"2024-09-10T06:29:37.382374+0000","last_clean":"2024-09-10T06:29:37.382374+0000","last_became_active":"2024-09-10T06:26:32.289840+0000","last_became_peered":"2024-09-10T06:26:32.289840+0000","last_unstale":"2024-09-10T06:29:37.382374+0000","last_undegraded":"2024-09-10T06:29:37.382374+0000","last_fullsized":"2024-09-10T06:29:37.382374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:37.382087+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:37.382087+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.382087+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:44:43.663439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"95'12","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.244429+0000","last_change":"2024-09-10T06:29:32.244429+0000","last_active":"2024-09-10T06:29:32.244429+0000","last_peered":"2024-09-10T06:29:32.244429+0000","last_clean":"2024-09-10T06:29:32.244429+0000","last_became_active":"2024-09-10T06:26:30.603330+0000","last_became_peered":"2024-09-10T06:26:30.603330+0000","last_unstale":"2024-09-10T06:29:32.244429+0000","last_undegraded":"2024-09-10T06:29:32.244429+0000","last_fullsized":"2024-09-10T06:29:32.244429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:32.244240+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:32.244240+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.244240+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:52.040413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"67'4","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:43.127630+0000","last_change":"2024-09-10T06:29:43.127630+0000","last_active":"2024-09-10T06:29:43.127630+0000","last_peered":"2024-09-10T06:29:43.127630+0000","last_clean":"2024-09-10T06:29:43.127630+0000","last_became_active":"2024-09-10T06:26:32.254437+0000","last_became_peered":"2024-09-10T06:26:32.254437+0000","last_unstale":"2024-09-10T06:29:43.127630+0000","last_undegraded":"2024-09-10T06:29:43.127630+0000","last_fullsized":"2024-09-10T06:29:43.127630+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:43.127447+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:43.127447+0000","last_clean_scrub_stamp":"2024-09-10T06:29:43.127447+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:51.048944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"95'26","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.321454+0000","last_change":"2024-09-10T06:29:34.321454+0000","last_active":"2024-09-10T06:29:34.321454+0000","last_peered":"2024-09-10T06:29:34.321454+0000","last_clean":"2024-09-10T06:29:34.321454+0000","last_became_active":"2024-09-10T06:26:30.578033+0000","last_became_peered":"2024-09-10T06:26:30.578033+0000","last_unstale":"2024-09-10T06:29:34.321454+0000","last_undegraded":"2024-09-10T06:29:34.321454+0000","last_fullsized":"2024-09-10T06:29:34.321454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-10T06:29:34.321257+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-10T06:29:34.321257+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.321257+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:29.693727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":34,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"76'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.283018+0000","last_change":"2024-09-10T06:29:38.283018+0000","last_active":"2024-09-10T06:29:38.283018+0000","last_peered":"2024-09-10T06:29:38.283018+0000","last_clean":"2024-09-10T06:29:38.283018+0000","last_became_active":"2024-09-10T06:26:32.280480+0000","last_became_peered":"2024-09-10T06:26:32.280480+0000","last_unstale":"2024-09-10T06:29:38.283018+0000","last_undegraded":"2024-09-10T06:29:38.283018+0000","last_fullsized":"2024-09-10T06:29:38.283018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:38.282778+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:38.282778+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.282778+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:46.590502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"95'16","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.860335+0000","last_change":"2024-09-10T06:29:39.860335+0000","last_active":"2024-09-10T06:29:39.860335+0000","last_peered":"2024-09-10T06:29:39.860335+0000","last_clean":"2024-09-10T06:29:39.860335+0000","last_became_active":"2024-09-10T06:26:30.592770+0000","last_became_peered":"2024-09-10T06:26:30.592770+0000","last_unstale":"2024-09-10T06:29:39.860335+0000","last_undegraded":"2024-09-10T06:29:39.860335+0000","last_fullsized":"2024-09-10T06:29:39.860335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:39.860132+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:39.860132+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.860132+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:24:55.569488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"67'10","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.493294+0000","last_change":"2024-09-10T06:29:36.493294+0000","last_active":"2024-09-10T06:29:36.493294+0000","last_peered":"2024-09-10T06:29:36.493294+0000","last_clean":"2024-09-10T06:29:36.493294+0000","last_became_active":"2024-09-10T06:26:32.265788+0000","last_became_peered":"2024-09-10T06:26:32.265788+0000","last_unstale":"2024-09-10T06:29:36.493294+0000","last_undegraded":"2024-09-10T06:29:36.493294+0000","last_fullsized":"2024-09-10T06:29:36.493294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T06:29:36.493094+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T06:29:36.493094+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.493094+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:23:13.006231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"76'10","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.168415+0000","last_change":"2024-09-10T06:29:40.168415+0000","last_active":"2024-09-10T06:29:40.168415+0000","last_peered":"2024-09-10T06:29:40.168415+0000","last_clean":"2024-09-10T06:29:40.168415+0000","last_became_active":"2024-09-10T06:26:32.254281+0000","last_became_peered":"2024-09-10T06:26:32.254281+0000","last_unstale":"2024-09-10T06:29:40.168415+0000","last_undegraded":"2024-09-10T06:29:40.168415+0000","last_fullsized":"2024-09-10T06:29:40.168415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'10","last_scrub_stamp":"2024-09-10T06:29:40.168233+0000","last_deep_scrub":"76'10","last_deep_scrub_stamp":"2024-09-10T06:29:40.168233+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.168233+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:54.261144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"95'18","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.290785+0000","last_change":"2024-09-10T06:29:35.290785+0000","last_active":"2024-09-10T06:29:35.290785+0000","last_peered":"2024-09-10T06:29:35.290785+0000","last_clean":"2024-09-10T06:29:35.290785+0000","last_became_active":"2024-09-10T06:26:30.605602+0000","last_became_peered":"2024-09-10T06:26:30.605602+0000","last_unstale":"2024-09-10T06:29:35.290785+0000","last_undegraded":"2024-09-10T06:29:35.290785+0000","last_fullsized":"2024-09-10T06:29:35.290785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:35.290595+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:35.290595+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.290595+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:48.831881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.274245+0000","last_change":"2024-09-10T06:29:37.274245+0000","last_active":"2024-09-10T06:29:37.274245+0000","last_peered":"2024-09-10T06:29:37.274245+0000","last_clean":"2024-09-10T06:29:37.274245+0000","last_became_active":"2024-09-10T06:26:32.274264+0000","last_became_peered":"2024-09-10T06:26:32.274264+0000","last_unstale":"2024-09-10T06:29:37.274245+0000","last_undegraded":"2024-09-10T06:29:37.274245+0000","last_fullsized":"2024-09-10T06:29:37.274245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.274064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.274064+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.274064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:35.281894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'10","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.448555+0000","last_change":"2024-09-10T06:29:31.448555+0000","last_active":"2024-09-10T06:29:31.448555+0000","last_peered":"2024-09-10T06:29:31.448555+0000","last_clean":"2024-09-10T06:29:31.448555+0000","last_became_active":"2024-09-10T06:28:46.332355+0000","last_became_peered":"2024-09-10T06:28:46.332355+0000","last_unstale":"2024-09-10T06:29:31.448555+0000","last_undegraded":"2024-09-10T06:29:31.448555+0000","last_fullsized":"2024-09-10T06:29:31.448555+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-10T06:29:31.448378+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-10T06:29:31.448378+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.448378+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:22.005148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.327524+0000","last_change":"2024-09-10T06:29:37.327524+0000","last_active":"2024-09-10T06:29:37.327524+0000","last_peered":"2024-09-10T06:29:37.327524+0000","last_clean":"2024-09-10T06:29:37.327524+0000","last_became_active":"2024-09-10T06:26:32.278407+0000","last_became_peered":"2024-09-10T06:26:32.278407+0000","last_unstale":"2024-09-10T06:29:37.327524+0000","last_undegraded":"2024-09-10T06:29:37.327524+0000","last_fullsized":"2024-09-10T06:29:37.327524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.327343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.327343+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.327343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:43.648199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"95'20","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.434236+0000","last_change":"2024-09-10T06:29:30.434236+0000","last_active":"2024-09-10T06:29:30.434236+0000","last_peered":"2024-09-10T06:29:30.434236+0000","last_clean":"2024-09-10T06:29:30.434236+0000","last_became_active":"2024-09-10T06:26:30.606807+0000","last_became_peered":"2024-09-10T06:26:30.606807+0000","last_unstale":"2024-09-10T06:29:30.434236+0000","last_undegraded":"2024-09-10T06:29:30.434236+0000","last_fullsized":"2024-09-10T06:29:30.434236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:30.434051+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:30.434051+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.434051+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:40.417294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"76'8","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.536701+0000","last_change":"2024-09-10T06:29:32.536701+0000","last_active":"2024-09-10T06:29:32.536701+0000","last_peered":"2024-09-10T06:29:32.536701+0000","last_clean":"2024-09-10T06:29:32.536701+0000","last_became_active":"2024-09-10T06:27:08.801461+0000","last_became_peered":"2024-09-10T06:27:08.801461+0000","last_unstale":"2024-09-10T06:29:32.536701+0000","last_undegraded":"2024-09-10T06:29:32.536701+0000","last_fullsized":"2024-09-10T06:29:32.536701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'8","last_scrub_stamp":"2024-09-10T06:29:32.536506+0000","last_deep_scrub":"76'8","last_deep_scrub_stamp":"2024-09-10T06:29:32.536506+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.536506+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:16:43.474143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"95'22","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.069975+0000","last_change":"2024-09-10T06:29:27.069975+0000","last_active":"2024-09-10T06:29:27.069975+0000","last_peered":"2024-09-10T06:29:27.069975+0000","last_clean":"2024-09-10T06:29:27.069975+0000","last_became_active":"2024-09-10T06:26:30.597271+0000","last_became_peered":"2024-09-10T06:26:30.597271+0000","last_unstale":"2024-09-10T06:29:27.069975+0000","last_undegraded":"2024-09-10T06:29:27.069975+0000","last_fullsized":"2024-09-10T06:29:27.069975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:27.069733+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:27.069733+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.069733+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:09:42.474681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.482195+0000","last_change":"2024-09-10T06:29:30.482195+0000","last_active":"2024-09-10T06:29:30.482195+0000","last_peered":"2024-09-10T06:29:30.482195+0000","last_clean":"2024-09-10T06:29:30.482195+0000","last_became_active":"2024-09-10T06:26:32.246938+0000","last_became_peered":"2024-09-10T06:26:32.246938+0000","last_unstale":"2024-09-10T06:29:30.482195+0000","last_undegraded":"2024-09-10T06:29:30.482195+0000","last_fullsized":"2024-09-10T06:29:30.482195+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:30.481993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:30.481993+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.481993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:13:26.249980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"95'22","reported_seq":236,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.153479+0000","last_change":"2024-09-10T06:29:28.153479+0000","last_active":"2024-09-10T06:29:28.153479+0000","last_peered":"2024-09-10T06:29:28.153479+0000","last_clean":"2024-09-10T06:29:28.153479+0000","last_became_active":"2024-09-10T06:28:46.326710+0000","last_became_peered":"2024-09-10T06:28:46.326710+0000","last_unstale":"2024-09-10T06:29:28.153479+0000","last_undegraded":"2024-09-10T06:29:28.153479+0000","last_fullsized":"2024-09-10T06:29:28.153479+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:28.153264+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:28.153264+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.153264+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:11:44.327241+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"76'4","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.145264+0000","last_change":"2024-09-10T06:29:41.145264+0000","last_active":"2024-09-10T06:29:41.145264+0000","last_peered":"2024-09-10T06:29:41.145264+0000","last_clean":"2024-09-10T06:29:41.145264+0000","last_became_active":"2024-09-10T06:26:32.275206+0000","last_became_peered":"2024-09-10T06:26:32.275206+0000","last_unstale":"2024-09-10T06:29:41.145264+0000","last_undegraded":"2024-09-10T06:29:41.145264+0000","last_fullsized":"2024-09-10T06:29:41.145264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:41.145065+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:41.145065+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.145065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:08.294547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"95'24","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.531466+0000","last_change":"2024-09-10T06:29:29.531466+0000","last_active":"2024-09-10T06:29:29.531466+0000","last_peered":"2024-09-10T06:29:29.531466+0000","last_clean":"2024-09-10T06:29:29.531466+0000","last_became_active":"2024-09-10T06:26:30.572043+0000","last_became_peered":"2024-09-10T06:26:30.572043+0000","last_unstale":"2024-09-10T06:29:29.531466+0000","last_undegraded":"2024-09-10T06:29:29.531466+0000","last_fullsized":"2024-09-10T06:29:29.531466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:29.531261+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:29.531261+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.531261+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:28.219225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":32,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"76'2","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:58.265425+0000","last_change":"2024-09-10T06:29:58.265425+0000","last_active":"2024-09-10T06:29:58.265425+0000","last_peered":"2024-09-10T06:29:58.265425+0000","last_clean":"2024-09-10T06:29:58.265425+0000","last_became_active":"2024-09-10T06:26:40.322711+0000","last_became_peered":"2024-09-10T06:26:40.322711+0000","last_unstale":"2024-09-10T06:29:58.265425+0000","last_undegraded":"2024-09-10T06:29:58.265425+0000","last_fullsized":"2024-09-10T06:29:58.265425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:58.265232+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:58.265232+0000","last_clean_scrub_stamp":"2024-09-10T06:29:58.265232+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:10:04.531119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.095654+0000","last_change":"2024-09-10T06:29:34.095654+0000","last_active":"2024-09-10T06:29:34.095654+0000","last_peered":"2024-09-10T06:29:34.095654+0000","last_clean":"2024-09-10T06:29:34.095654+0000","last_became_active":"2024-09-10T06:26:32.275889+0000","last_became_peered":"2024-09-10T06:26:32.275889+0000","last_unstale":"2024-09-10T06:29:34.095654+0000","last_undegraded":"2024-09-10T06:29:34.095654+0000","last_fullsized":"2024-09-10T06:29:34.095654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:34.095475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:34.095475+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.095475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:44.266638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"95'28","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.363170+0000","last_change":"2024-09-10T06:29:32.363170+0000","last_active":"2024-09-10T06:29:32.363170+0000","last_peered":"2024-09-10T06:29:32.363170+0000","last_clean":"2024-09-10T06:29:32.363170+0000","last_became_active":"2024-09-10T06:26:30.595128+0000","last_became_peered":"2024-09-10T06:26:30.595128+0000","last_unstale":"2024-09-10T06:29:32.363170+0000","last_undegraded":"2024-09-10T06:29:32.363170+0000","last_fullsized":"2024-09-10T06:29:32.363170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'28","last_scrub_stamp":"2024-09-10T06:29:32.362977+0000","last_deep_scrub":"95'28","last_deep_scrub_stamp":"2024-09-10T06:29:32.362977+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.362977+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:54.103860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:43.229588+0000","last_change":"2024-09-10T06:29:43.229588+0000","last_active":"2024-09-10T06:29:43.229588+0000","last_peered":"2024-09-10T06:29:43.229588+0000","last_clean":"2024-09-10T06:29:43.229588+0000","last_became_active":"2024-09-10T06:26:34.279074+0000","last_became_peered":"2024-09-10T06:26:34.279074+0000","last_unstale":"2024-09-10T06:29:43.229588+0000","last_undegraded":"2024-09-10T06:29:43.229588+0000","last_fullsized":"2024-09-10T06:29:43.229588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:43.229332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:43.229332+0000","last_clean_scrub_stamp":"2024-09-10T06:29:43.229332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:58.459037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"95'21","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:47.486201+0000","last_change":"2024-09-10T06:29:47.486201+0000","last_active":"2024-09-10T06:29:47.486201+0000","last_peered":"2024-09-10T06:29:47.486201+0000","last_clean":"2024-09-10T06:29:47.486201+0000","last_became_active":"2024-09-10T06:26:36.295786+0000","last_became_peered":"2024-09-10T06:26:36.295786+0000","last_unstale":"2024-09-10T06:29:47.486201+0000","last_undegraded":"2024-09-10T06:29:47.486201+0000","last_fullsized":"2024-09-10T06:29:47.486201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'21","last_scrub_stamp":"2024-09-10T06:29:47.485967+0000","last_deep_scrub":"95'21","last_deep_scrub_stamp":"2024-09-10T06:29:47.485967+0000","last_clean_scrub_stamp":"2024-09-10T06:29:47.485967+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:19.812836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:54.325253+0000","last_change":"2024-09-10T06:29:54.325253+0000","last_active":"2024-09-10T06:29:54.325253+0000","last_peered":"2024-09-10T06:29:54.325253+0000","last_clean":"2024-09-10T06:29:54.325253+0000","last_became_active":"2024-09-10T06:26:38.304847+0000","last_became_peered":"2024-09-10T06:26:38.304847+0000","last_unstale":"2024-09-10T06:29:54.325253+0000","last_undegraded":"2024-09-10T06:29:54.325253+0000","last_fullsized":"2024-09-10T06:29:54.325253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:54.325077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:54.325077+0000","last_clean_scrub_stamp":"2024-09-10T06:29:54.325077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:34.303803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:56.332209+0000","last_change":"2024-09-10T06:29:56.332209+0000","last_active":"2024-09-10T06:29:56.332209+0000","last_peered":"2024-09-10T06:29:56.332209+0000","last_clean":"2024-09-10T06:29:56.332209+0000","last_became_active":"2024-09-10T06:26:40.330777+0000","last_became_peered":"2024-09-10T06:26:40.330777+0000","last_unstale":"2024-09-10T06:29:56.332209+0000","last_undegraded":"2024-09-10T06:29:56.332209+0000","last_fullsized":"2024-09-10T06:29:56.332209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:56.332038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:56.332038+0000","last_clean_scrub_stamp":"2024-09-10T06:29:56.332038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:10.323547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"67'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.286857+0000","last_change":"2024-09-10T06:29:35.286857+0000","last_active":"2024-09-10T06:29:35.286857+0000","last_peered":"2024-09-10T06:29:35.286857+0000","last_clean":"2024-09-10T06:29:35.286857+0000","last_became_active":"2024-09-10T06:26:32.282263+0000","last_became_peered":"2024-09-10T06:26:32.282263+0000","last_unstale":"2024-09-10T06:29:35.286857+0000","last_undegraded":"2024-09-10T06:29:35.286857+0000","last_fullsized":"2024-09-10T06:29:35.286857+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:35.286670+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:35.286670+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.286670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:50:17.003291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"95'14","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:21.505766+0000","last_change":"2024-09-10T06:29:21.505766+0000","last_active":"2024-09-10T06:29:21.505766+0000","last_peered":"2024-09-10T06:29:21.505766+0000","last_clean":"2024-09-10T06:29:21.505766+0000","last_became_active":"2024-09-10T06:26:30.576039+0000","last_became_peered":"2024-09-10T06:26:30.576039+0000","last_unstale":"2024-09-10T06:29:21.505766+0000","last_undegraded":"2024-09-10T06:29:21.505766+0000","last_fullsized":"2024-09-10T06:29:21.505766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:21.505699+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:21.505699+0000","last_clean_scrub_stamp":"2024-09-10T06:29:21.505699+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:43.246582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:43.851660+0000","last_change":"2024-09-10T06:29:43.851660+0000","last_active":"2024-09-10T06:29:43.851660+0000","last_peered":"2024-09-10T06:29:43.851660+0000","last_clean":"2024-09-10T06:29:43.851660+0000","last_became_active":"2024-09-10T06:26:34.268279+0000","last_became_peered":"2024-09-10T06:26:34.268279+0000","last_unstale":"2024-09-10T06:29:43.851660+0000","last_undegraded":"2024-09-10T06:29:43.851660+0000","last_fullsized":"2024-09-10T06:29:43.851660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:43.851456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:43.851456+0000","last_clean_scrub_stamp":"2024-09-10T06:29:43.851456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:09:50.117344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"95'9","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:50.268248+0000","last_change":"2024-09-10T06:29:50.268248+0000","last_active":"2024-09-10T06:29:50.268248+0000","last_peered":"2024-09-10T06:29:50.268248+0000","last_clean":"2024-09-10T06:29:50.268248+0000","last_became_active":"2024-09-10T06:26:36.273138+0000","last_became_peered":"2024-09-10T06:26:36.273138+0000","last_unstale":"2024-09-10T06:29:50.268248+0000","last_undegraded":"2024-09-10T06:29:50.268248+0000","last_fullsized":"2024-09-10T06:29:50.268248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'9","last_scrub_stamp":"2024-09-10T06:29:50.268047+0000","last_deep_scrub":"95'9","last_deep_scrub_stamp":"2024-09-10T06:29:50.268047+0000","last_clean_scrub_stamp":"2024-09-10T06:29:50.268047+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:33.400376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:54.231269+0000","last_change":"2024-09-10T06:29:54.231269+0000","last_active":"2024-09-10T06:29:54.231269+0000","last_peered":"2024-09-10T06:29:54.231269+0000","last_clean":"2024-09-10T06:29:54.231269+0000","last_became_active":"2024-09-10T06:26:38.293754+0000","last_became_peered":"2024-09-10T06:26:38.293754+0000","last_unstale":"2024-09-10T06:29:54.231269+0000","last_undegraded":"2024-09-10T06:29:54.231269+0000","last_fullsized":"2024-09-10T06:29:54.231269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:54.231086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:54.231086+0000","last_clean_scrub_stamp":"2024-09-10T06:29:54.231086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:25:09.940441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"62'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:57.478403+0000","last_change":"2024-09-10T06:29:57.478403+0000","last_active":"2024-09-10T06:29:57.478403+0000","last_peered":"2024-09-10T06:29:57.478403+0000","last_clean":"2024-09-10T06:29:57.478403+0000","last_became_active":"2024-09-10T06:26:40.322648+0000","last_became_peered":"2024-09-10T06:26:40.322648+0000","last_unstale":"2024-09-10T06:29:57.478403+0000","last_undegraded":"2024-09-10T06:29:57.478403+0000","last_fullsized":"2024-09-10T06:29:57.478403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-10T06:29:57.478212+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-10T06:29:57.478212+0000","last_clean_scrub_stamp":"2024-09-10T06:29:57.478212+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:59.541252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"76'4","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.591930+0000","last_change":"2024-09-10T06:29:34.591930+0000","last_active":"2024-09-10T06:29:34.591930+0000","last_peered":"2024-09-10T06:29:34.591930+0000","last_clean":"2024-09-10T06:29:34.591930+0000","last_became_active":"2024-09-10T06:26:32.256701+0000","last_became_peered":"2024-09-10T06:26:32.256701+0000","last_unstale":"2024-09-10T06:29:34.591930+0000","last_undegraded":"2024-09-10T06:29:34.591930+0000","last_fullsized":"2024-09-10T06:29:34.591930+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:34.591748+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:34.591748+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.591748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:42:42.899472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"95'26","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.309115+0000","last_change":"2024-09-10T06:29:30.309115+0000","last_active":"2024-09-10T06:29:30.309115+0000","last_peered":"2024-09-10T06:29:30.309115+0000","last_clean":"2024-09-10T06:29:30.309115+0000","last_became_active":"2024-09-10T06:26:30.597703+0000","last_became_peered":"2024-09-10T06:26:30.597703+0000","last_unstale":"2024-09-10T06:29:30.309115+0000","last_undegraded":"2024-09-10T06:29:30.309115+0000","last_fullsized":"2024-09-10T06:29:30.309115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-10T06:29:30.308944+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-10T06:29:30.308944+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.308944+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:32.390030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:44.860339+0000","last_change":"2024-09-10T06:29:44.860339+0000","last_active":"2024-09-10T06:29:44.860339+0000","last_peered":"2024-09-10T06:29:44.860339+0000","last_clean":"2024-09-10T06:29:44.860339+0000","last_became_active":"2024-09-10T06:26:34.268192+0000","last_became_peered":"2024-09-10T06:26:34.268192+0000","last_unstale":"2024-09-10T06:29:44.860339+0000","last_undegraded":"2024-09-10T06:29:44.860339+0000","last_fullsized":"2024-09-10T06:29:44.860339+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:44.860145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:44.860145+0000","last_clean_scrub_stamp":"2024-09-10T06:29:44.860145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:02.333696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"95'15","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.486844+0000","last_change":"2024-09-10T06:29:39.486844+0000","last_active":"2024-09-10T06:29:39.486844+0000","last_peered":"2024-09-10T06:29:39.486844+0000","last_clean":"2024-09-10T06:29:39.486844+0000","last_became_active":"2024-09-10T06:26:36.275306+0000","last_became_peered":"2024-09-10T06:26:36.275306+0000","last_unstale":"2024-09-10T06:29:39.486844+0000","last_undegraded":"2024-09-10T06:29:39.486844+0000","last_fullsized":"2024-09-10T06:29:39.486844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'15","last_scrub_stamp":"2024-09-10T06:29:39.486605+0000","last_deep_scrub":"95'15","last_deep_scrub_stamp":"2024-09-10T06:29:39.486605+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.486605+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:46:49.469847+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'106","reported_seq":414,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:53.331986+0000","last_change":"2024-09-10T06:29:53.331986+0000","last_active":"2024-09-10T06:29:53.331986+0000","last_peered":"2024-09-10T06:29:53.331986+0000","last_clean":"2024-09-10T06:29:53.331986+0000","last_became_active":"2024-09-10T06:26:38.300326+0000","last_became_peered":"2024-09-10T06:26:38.300326+0000","last_unstale":"2024-09-10T06:29:53.331986+0000","last_undegraded":"2024-09-10T06:29:53.331986+0000","last_fullsized":"2024-09-10T06:29:53.331986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'106","last_scrub_stamp":"2024-09-10T06:29:53.331817+0000","last_deep_scrub":"95'106","last_deep_scrub_stamp":"2024-09-10T06:29:53.331817+0000","last_clean_scrub_stamp":"2024-09-10T06:29:53.331817+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:12.531124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:59.244786+0000","last_change":"2024-09-10T06:29:59.244786+0000","last_active":"2024-09-10T06:29:59.244786+0000","last_peered":"2024-09-10T06:29:59.244786+0000","last_clean":"2024-09-10T06:29:59.244786+0000","last_became_active":"2024-09-10T06:26:40.297296+0000","last_became_peered":"2024-09-10T06:26:40.297296+0000","last_unstale":"2024-09-10T06:29:59.244786+0000","last_undegraded":"2024-09-10T06:29:59.244786+0000","last_fullsized":"2024-09-10T06:29:59.244786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:59.244599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:59.244599+0000","last_clean_scrub_stamp":"2024-09-10T06:29:59.244599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:55:16.718150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.011364+0000","last_change":"2024-09-10T06:29:36.011364+0000","last_active":"2024-09-10T06:29:36.011364+0000","last_peered":"2024-09-10T06:29:36.011364+0000","last_clean":"2024-09-10T06:29:36.011364+0000","last_became_active":"2024-09-10T06:26:32.264334+0000","last_became_peered":"2024-09-10T06:26:32.264334+0000","last_unstale":"2024-09-10T06:29:36.011364+0000","last_undegraded":"2024-09-10T06:29:36.011364+0000","last_fullsized":"2024-09-10T06:29:36.011364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:36.011186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:36.011186+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.011186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:14:25.230585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"95'26","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.499786+0000","last_change":"2024-09-10T06:29:25.499786+0000","last_active":"2024-09-10T06:29:25.499786+0000","last_peered":"2024-09-10T06:29:25.499786+0000","last_clean":"2024-09-10T06:29:25.499786+0000","last_became_active":"2024-09-10T06:26:30.575433+0000","last_became_peered":"2024-09-10T06:26:30.575433+0000","last_unstale":"2024-09-10T06:29:25.499786+0000","last_undegraded":"2024-09-10T06:29:25.499786+0000","last_fullsized":"2024-09-10T06:29:25.499786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-10T06:29:25.499572+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-10T06:29:25.499572+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.499572+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:57:04.580943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:44.224865+0000","last_change":"2024-09-10T06:29:44.224865+0000","last_active":"2024-09-10T06:29:44.224865+0000","last_peered":"2024-09-10T06:29:44.224865+0000","last_clean":"2024-09-10T06:29:44.224865+0000","last_became_active":"2024-09-10T06:26:34.282941+0000","last_became_peered":"2024-09-10T06:26:34.282941+0000","last_unstale":"2024-09-10T06:29:44.224865+0000","last_undegraded":"2024-09-10T06:29:44.224865+0000","last_fullsized":"2024-09-10T06:29:44.224865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:44.224656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:44.224656+0000","last_clean_scrub_stamp":"2024-09-10T06:29:44.224656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:27.356984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"95'23","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:49.183081+0000","last_change":"2024-09-10T06:29:49.183081+0000","last_active":"2024-09-10T06:29:49.183081+0000","last_peered":"2024-09-10T06:29:49.183081+0000","last_clean":"2024-09-10T06:29:49.183081+0000","last_became_active":"2024-09-10T06:26:36.297309+0000","last_became_peered":"2024-09-10T06:26:36.297309+0000","last_unstale":"2024-09-10T06:29:49.183081+0000","last_undegraded":"2024-09-10T06:29:49.183081+0000","last_fullsized":"2024-09-10T06:29:49.183081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'23","last_scrub_stamp":"2024-09-10T06:29:49.182871+0000","last_deep_scrub":"95'23","last_deep_scrub_stamp":"2024-09-10T06:29:49.182871+0000","last_clean_scrub_stamp":"2024-09-10T06:29:49.182871+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:53.636417+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'106","reported_seq":281,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:57.821156+0000","last_change":"2024-09-10T06:29:57.821156+0000","last_active":"2024-09-10T06:29:57.821156+0000","last_peered":"2024-09-10T06:29:57.821156+0000","last_clean":"2024-09-10T06:29:57.821156+0000","last_became_active":"2024-09-10T06:26:38.299355+0000","last_became_peered":"2024-09-10T06:26:38.299355+0000","last_unstale":"2024-09-10T06:29:57.821156+0000","last_undegraded":"2024-09-10T06:29:57.821156+0000","last_fullsized":"2024-09-10T06:29:57.821156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'106","last_scrub_stamp":"2024-09-10T06:29:57.820950+0000","last_deep_scrub":"95'106","last_deep_scrub_stamp":"2024-09-10T06:29:57.820950+0000","last_clean_scrub_stamp":"2024-09-10T06:29:57.820950+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:56.230004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.286958+0000","last_change":"2024-09-10T06:29:34.286958+0000","last_active":"2024-09-10T06:29:34.286958+0000","last_peered":"2024-09-10T06:29:34.286958+0000","last_clean":"2024-09-10T06:29:34.286958+0000","last_became_active":"2024-09-10T06:26:32.270496+0000","last_became_peered":"2024-09-10T06:26:32.270496+0000","last_unstale":"2024-09-10T06:29:34.286958+0000","last_undegraded":"2024-09-10T06:29:34.286958+0000","last_fullsized":"2024-09-10T06:29:34.286958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:34.286772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:34.286772+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.286772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:10.128919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"95'14","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.358994+0000","last_change":"2024-09-10T06:29:31.358994+0000","last_active":"2024-09-10T06:29:31.358994+0000","last_peered":"2024-09-10T06:29:31.358994+0000","last_clean":"2024-09-10T06:29:31.358994+0000","last_became_active":"2024-09-10T06:26:30.606685+0000","last_became_peered":"2024-09-10T06:26:30.606685+0000","last_unstale":"2024-09-10T06:29:31.358994+0000","last_undegraded":"2024-09-10T06:29:31.358994+0000","last_fullsized":"2024-09-10T06:29:31.358994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:31.358776+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:31.358776+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.358776+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:21.505655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.156236+0000","last_change":"2024-09-10T06:29:40.156236+0000","last_active":"2024-09-10T06:29:40.156236+0000","last_peered":"2024-09-10T06:29:40.156236+0000","last_clean":"2024-09-10T06:29:40.156236+0000","last_became_active":"2024-09-10T06:26:34.285787+0000","last_became_peered":"2024-09-10T06:26:34.285787+0000","last_unstale":"2024-09-10T06:29:40.156236+0000","last_undegraded":"2024-09-10T06:29:40.156236+0000","last_fullsized":"2024-09-10T06:29:40.156236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:40.156062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:40.156062+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.156062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:38.844026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"95'36","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:47.220008+0000","last_change":"2024-09-10T06:29:47.220008+0000","last_active":"2024-09-10T06:29:47.220008+0000","last_peered":"2024-09-10T06:29:47.220008+0000","last_clean":"2024-09-10T06:29:47.220008+0000","last_became_active":"2024-09-10T06:26:36.293226+0000","last_became_peered":"2024-09-10T06:26:36.293226+0000","last_unstale":"2024-09-10T06:29:47.220008+0000","last_undegraded":"2024-09-10T06:29:47.220008+0000","last_fullsized":"2024-09-10T06:29:47.220008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'36","last_scrub_stamp":"2024-09-10T06:29:47.219803+0000","last_deep_scrub":"95'36","last_deep_scrub_stamp":"2024-09-10T06:29:47.219803+0000","last_clean_scrub_stamp":"2024-09-10T06:29:47.219803+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:32:48.836267+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":38,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:45.818620+0000","last_change":"2024-09-10T06:29:45.818620+0000","last_active":"2024-09-10T06:29:45.818620+0000","last_peered":"2024-09-10T06:29:45.818620+0000","last_clean":"2024-09-10T06:29:45.818620+0000","last_became_active":"2024-09-10T06:26:38.304601+0000","last_became_peered":"2024-09-10T06:26:38.304601+0000","last_unstale":"2024-09-10T06:29:45.818620+0000","last_undegraded":"2024-09-10T06:29:45.818620+0000","last_fullsized":"2024-09-10T06:29:45.818620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:45.818412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:45.818412+0000","last_clean_scrub_stamp":"2024-09-10T06:29:45.818412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:11:43.321973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"62'8","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:52.386843+0000","last_change":"2024-09-10T06:29:52.386843+0000","last_active":"2024-09-10T06:29:52.386843+0000","last_peered":"2024-09-10T06:29:52.386843+0000","last_clean":"2024-09-10T06:29:52.386843+0000","last_became_active":"2024-09-10T06:26:40.331262+0000","last_became_peered":"2024-09-10T06:26:40.331262+0000","last_unstale":"2024-09-10T06:29:52.386843+0000","last_undegraded":"2024-09-10T06:29:52.386843+0000","last_fullsized":"2024-09-10T06:29:52.386843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-09-10T06:29:52.386560+0000","last_deep_scrub":"62'8","last_deep_scrub_stamp":"2024-09-10T06:29:52.386560+0000","last_clean_scrub_stamp":"2024-09-10T06:29:52.386560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:26:24.713429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.063454+0000","last_change":"2024-09-10T06:29:29.063454+0000","last_active":"2024-09-10T06:29:29.063454+0000","last_peered":"2024-09-10T06:29:29.063454+0000","last_clean":"2024-09-10T06:29:29.063454+0000","last_became_active":"2024-09-10T06:26:32.261423+0000","last_became_peered":"2024-09-10T06:26:32.261423+0000","last_unstale":"2024-09-10T06:29:29.063454+0000","last_undegraded":"2024-09-10T06:29:29.063454+0000","last_fullsized":"2024-09-10T06:29:29.063454+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:29.063273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:29.063273+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.063273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:03.742022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"95'24","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.284702+0000","last_change":"2024-09-10T06:29:29.284702+0000","last_active":"2024-09-10T06:29:29.284702+0000","last_peered":"2024-09-10T06:29:29.284702+0000","last_clean":"2024-09-10T06:29:29.284702+0000","last_became_active":"2024-09-10T06:26:30.595269+0000","last_became_peered":"2024-09-10T06:26:30.595269+0000","last_unstale":"2024-09-10T06:29:29.284702+0000","last_undegraded":"2024-09-10T06:29:29.284702+0000","last_fullsized":"2024-09-10T06:29:29.284702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:29.284526+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:29.284526+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.284526+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:29.270685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":32,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.528881+0000","last_change":"2024-09-10T06:29:34.528881+0000","last_active":"2024-09-10T06:29:34.528881+0000","last_peered":"2024-09-10T06:29:34.528881+0000","last_clean":"2024-09-10T06:29:34.528881+0000","last_became_active":"2024-09-10T06:26:34.266017+0000","last_became_peered":"2024-09-10T06:26:34.266017+0000","last_unstale":"2024-09-10T06:29:34.528881+0000","last_undegraded":"2024-09-10T06:29:34.528881+0000","last_fullsized":"2024-09-10T06:29:34.528881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:34.528700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:34.528700+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.528700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:09:16.132928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"95'24","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:49.919331+0000","last_change":"2024-09-10T06:29:49.919331+0000","last_active":"2024-09-10T06:29:49.919331+0000","last_peered":"2024-09-10T06:29:49.919331+0000","last_clean":"2024-09-10T06:29:49.919331+0000","last_became_active":"2024-09-10T06:26:36.295796+0000","last_became_peered":"2024-09-10T06:26:36.295796+0000","last_unstale":"2024-09-10T06:29:49.919331+0000","last_undegraded":"2024-09-10T06:29:49.919331+0000","last_fullsized":"2024-09-10T06:29:49.919331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:49.919119+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:49.919119+0000","last_clean_scrub_stamp":"2024-09-10T06:29:49.919119+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:44.722255+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":38,"num_write":16,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:55.793367+0000","last_change":"2024-09-10T06:29:55.793367+0000","last_active":"2024-09-10T06:29:55.793367+0000","last_peered":"2024-09-10T06:29:55.793367+0000","last_clean":"2024-09-10T06:29:55.793367+0000","last_became_active":"2024-09-10T06:26:38.296455+0000","last_became_peered":"2024-09-10T06:26:38.296455+0000","last_unstale":"2024-09-10T06:29:55.793367+0000","last_undegraded":"2024-09-10T06:29:55.793367+0000","last_fullsized":"2024-09-10T06:29:55.793367+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:55.793162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:55.793162+0000","last_clean_scrub_stamp":"2024-09-10T06:29:55.793162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:20.586356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:46.517907+0000","last_change":"2024-09-10T06:29:46.517907+0000","last_active":"2024-09-10T06:29:46.517907+0000","last_peered":"2024-09-10T06:29:46.517907+0000","last_clean":"2024-09-10T06:29:46.517907+0000","last_became_active":"2024-09-10T06:26:40.327585+0000","last_became_peered":"2024-09-10T06:26:40.327585+0000","last_unstale":"2024-09-10T06:29:46.517907+0000","last_undegraded":"2024-09-10T06:29:46.517907+0000","last_fullsized":"2024-09-10T06:29:46.517907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:46.517708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:46.517708+0000","last_clean_scrub_stamp":"2024-09-10T06:29:46.517708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:55:00.058994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.376436+0000","last_change":"2024-09-10T06:29:34.376436+0000","last_active":"2024-09-10T06:29:34.376436+0000","last_peered":"2024-09-10T06:29:34.376436+0000","last_clean":"2024-09-10T06:29:34.376436+0000","last_became_active":"2024-09-10T06:27:08.599875+0000","last_became_peered":"2024-09-10T06:27:08.599875+0000","last_unstale":"2024-09-10T06:29:34.376436+0000","last_undegraded":"2024-09-10T06:29:34.376436+0000","last_fullsized":"2024-09-10T06:29:34.376436+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:34.376265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:34.376265+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.376265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:47:57.000500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"95'14","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.294397+0000","last_change":"2024-09-10T06:29:27.294397+0000","last_active":"2024-09-10T06:29:27.294397+0000","last_peered":"2024-09-10T06:29:27.294397+0000","last_clean":"2024-09-10T06:29:27.294397+0000","last_became_active":"2024-09-10T06:26:30.611039+0000","last_became_peered":"2024-09-10T06:26:30.611039+0000","last_unstale":"2024-09-10T06:29:27.294397+0000","last_undegraded":"2024-09-10T06:29:27.294397+0000","last_fullsized":"2024-09-10T06:29:27.294397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:27.294207+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:27.294207+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.294207+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:16:06.186017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.512254+0000","last_change":"2024-09-10T06:29:37.512254+0000","last_active":"2024-09-10T06:29:37.512254+0000","last_peered":"2024-09-10T06:29:37.512254+0000","last_clean":"2024-09-10T06:29:37.512254+0000","last_became_active":"2024-09-10T06:26:34.262793+0000","last_became_peered":"2024-09-10T06:26:34.262793+0000","last_unstale":"2024-09-10T06:29:37.512254+0000","last_undegraded":"2024-09-10T06:29:37.512254+0000","last_fullsized":"2024-09-10T06:29:37.512254+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.512054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.512054+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.512054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:24.188192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"95'32","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:47.239786+0000","last_change":"2024-09-10T06:29:47.239786+0000","last_active":"2024-09-10T06:29:47.239786+0000","last_peered":"2024-09-10T06:29:47.239786+0000","last_clean":"2024-09-10T06:29:47.239786+0000","last_became_active":"2024-09-10T06:26:36.299140+0000","last_became_peered":"2024-09-10T06:26:36.299140+0000","last_unstale":"2024-09-10T06:29:47.239786+0000","last_undegraded":"2024-09-10T06:29:47.239786+0000","last_fullsized":"2024-09-10T06:29:47.239786+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'32","last_scrub_stamp":"2024-09-10T06:29:47.239597+0000","last_deep_scrub":"95'32","last_deep_scrub_stamp":"2024-09-10T06:29:47.239597+0000","last_clean_scrub_stamp":"2024-09-10T06:29:47.239597+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:59.184404+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":44,"num_write":22,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'106","reported_seq":279,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:50.514697+0000","last_change":"2024-09-10T06:29:50.514697+0000","last_active":"2024-09-10T06:29:50.514697+0000","last_peered":"2024-09-10T06:29:50.514697+0000","last_clean":"2024-09-10T06:29:50.514697+0000","last_became_active":"2024-09-10T06:26:38.291322+0000","last_became_peered":"2024-09-10T06:26:38.291322+0000","last_unstale":"2024-09-10T06:29:50.514697+0000","last_undegraded":"2024-09-10T06:29:50.514697+0000","last_fullsized":"2024-09-10T06:29:50.514697+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'106","last_scrub_stamp":"2024-09-10T06:29:50.514483+0000","last_deep_scrub":"95'106","last_deep_scrub_stamp":"2024-09-10T06:29:50.514483+0000","last_clean_scrub_stamp":"2024-09-10T06:29:50.514483+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:42.206342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"64'2","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:54.457969+0000","last_change":"2024-09-10T06:29:54.457969+0000","last_active":"2024-09-10T06:29:54.457969+0000","last_peered":"2024-09-10T06:29:54.457969+0000","last_clean":"2024-09-10T06:29:54.457969+0000","last_became_active":"2024-09-10T06:26:40.323249+0000","last_became_peered":"2024-09-10T06:26:40.323249+0000","last_unstale":"2024-09-10T06:29:54.457969+0000","last_undegraded":"2024-09-10T06:29:54.457969+0000","last_fullsized":"2024-09-10T06:29:54.457969+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'2","last_scrub_stamp":"2024-09-10T06:29:54.457792+0000","last_deep_scrub":"64'2","last_deep_scrub_stamp":"2024-09-10T06:29:54.457792+0000","last_clean_scrub_stamp":"2024-09-10T06:29:54.457792+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:06.054141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"67'2","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.604989+0000","last_change":"2024-09-10T06:29:33.604989+0000","last_active":"2024-09-10T06:29:33.604989+0000","last_peered":"2024-09-10T06:29:33.604989+0000","last_clean":"2024-09-10T06:29:33.604989+0000","last_became_active":"2024-09-10T06:26:32.274496+0000","last_became_peered":"2024-09-10T06:26:32.274496+0000","last_unstale":"2024-09-10T06:29:33.604989+0000","last_undegraded":"2024-09-10T06:29:33.604989+0000","last_fullsized":"2024-09-10T06:29:33.604989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:33.604805+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:33.604805+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.604805+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:39.925661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"95'14","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.434461+0000","last_change":"2024-09-10T06:29:24.434461+0000","last_active":"2024-09-10T06:29:24.434461+0000","last_peered":"2024-09-10T06:29:24.434461+0000","last_clean":"2024-09-10T06:29:24.434461+0000","last_became_active":"2024-09-10T06:26:30.593432+0000","last_became_peered":"2024-09-10T06:26:30.593432+0000","last_unstale":"2024-09-10T06:29:24.434461+0000","last_undegraded":"2024-09-10T06:29:24.434461+0000","last_fullsized":"2024-09-10T06:29:24.434461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:24.434275+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:24.434275+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.434275+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:42.528344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.537178+0000","last_change":"2024-09-10T06:29:35.537178+0000","last_active":"2024-09-10T06:29:35.537178+0000","last_peered":"2024-09-10T06:29:35.537178+0000","last_clean":"2024-09-10T06:29:35.537178+0000","last_became_active":"2024-09-10T06:26:34.256256+0000","last_became_peered":"2024-09-10T06:26:34.256256+0000","last_unstale":"2024-09-10T06:29:35.537178+0000","last_undegraded":"2024-09-10T06:29:35.537178+0000","last_fullsized":"2024-09-10T06:29:35.537178+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:35.536986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:35.536986+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.536986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:46.124657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"95'36","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:43.584421+0000","last_change":"2024-09-10T06:29:43.584421+0000","last_active":"2024-09-10T06:29:43.584421+0000","last_peered":"2024-09-10T06:29:43.584421+0000","last_clean":"2024-09-10T06:29:43.584421+0000","last_became_active":"2024-09-10T06:26:36.295838+0000","last_became_peered":"2024-09-10T06:26:36.295838+0000","last_unstale":"2024-09-10T06:29:43.584421+0000","last_undegraded":"2024-09-10T06:29:43.584421+0000","last_fullsized":"2024-09-10T06:29:43.584421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'36","last_scrub_stamp":"2024-09-10T06:29:43.584159+0000","last_deep_scrub":"95'36","last_deep_scrub_stamp":"2024-09-10T06:29:43.584159+0000","last_clean_scrub_stamp":"2024-09-10T06:29:43.584159+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:23.562884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":49,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.492017+0000","last_change":"2024-09-10T06:29:40.492017+0000","last_active":"2024-09-10T06:29:40.492017+0000","last_peered":"2024-09-10T06:29:40.492017+0000","last_clean":"2024-09-10T06:29:40.492017+0000","last_became_active":"2024-09-10T06:26:38.307965+0000","last_became_peered":"2024-09-10T06:26:38.307965+0000","last_unstale":"2024-09-10T06:29:40.492017+0000","last_undegraded":"2024-09-10T06:29:40.492017+0000","last_fullsized":"2024-09-10T06:29:40.492017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:40.491832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:40.491832+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.491832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:12.085817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"62'4","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:50.826270+0000","last_change":"2024-09-10T06:29:50.826270+0000","last_active":"2024-09-10T06:29:50.826270+0000","last_peered":"2024-09-10T06:29:50.826270+0000","last_clean":"2024-09-10T06:29:50.826270+0000","last_became_active":"2024-09-10T06:26:40.325731+0000","last_became_peered":"2024-09-10T06:26:40.325731+0000","last_unstale":"2024-09-10T06:29:50.826270+0000","last_undegraded":"2024-09-10T06:29:50.826270+0000","last_fullsized":"2024-09-10T06:29:50.826270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-10T06:29:50.826070+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-10T06:29:50.826070+0000","last_clean_scrub_stamp":"2024-09-10T06:29:50.826070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:15:53.950670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"64'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.101641+0000","last_change":"2024-09-10T06:29:30.101641+0000","last_active":"2024-09-10T06:29:30.101641+0000","last_peered":"2024-09-10T06:29:30.101641+0000","last_clean":"2024-09-10T06:29:30.101641+0000","last_became_active":"2024-09-10T06:26:32.253154+0000","last_became_peered":"2024-09-10T06:26:32.253154+0000","last_unstale":"2024-09-10T06:29:30.101641+0000","last_undegraded":"2024-09-10T06:29:30.101641+0000","last_fullsized":"2024-09-10T06:29:30.101641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'2","last_scrub_stamp":"2024-09-10T06:29:30.101463+0000","last_deep_scrub":"64'2","last_deep_scrub_stamp":"2024-09-10T06:29:30.101463+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.101463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:32:48.195532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'10","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.070099+0000","last_change":"2024-09-10T06:29:25.070099+0000","last_active":"2024-09-10T06:29:25.070099+0000","last_peered":"2024-09-10T06:29:25.070099+0000","last_clean":"2024-09-10T06:29:25.070099+0000","last_became_active":"2024-09-10T06:26:30.571829+0000","last_became_peered":"2024-09-10T06:26:30.571829+0000","last_unstale":"2024-09-10T06:29:25.070099+0000","last_undegraded":"2024-09-10T06:29:25.070099+0000","last_fullsized":"2024-09-10T06:29:25.070099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-10T06:29:25.069903+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-10T06:29:25.069903+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.069903+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:53:04.002647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.510461+0000","last_change":"2024-09-10T06:29:38.510461+0000","last_active":"2024-09-10T06:29:38.510461+0000","last_peered":"2024-09-10T06:29:38.510461+0000","last_clean":"2024-09-10T06:29:38.510461+0000","last_became_active":"2024-09-10T06:26:34.285004+0000","last_became_peered":"2024-09-10T06:26:34.285004+0000","last_unstale":"2024-09-10T06:29:38.510461+0000","last_undegraded":"2024-09-10T06:29:38.510461+0000","last_fullsized":"2024-09-10T06:29:38.510461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:38.510241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:38.510241+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.510241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:21.881655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"95'30","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:49.242923+0000","last_change":"2024-09-10T06:29:49.242923+0000","last_active":"2024-09-10T06:29:49.242923+0000","last_peered":"2024-09-10T06:29:49.242923+0000","last_clean":"2024-09-10T06:29:49.242923+0000","last_became_active":"2024-09-10T06:26:36.292423+0000","last_became_peered":"2024-09-10T06:26:36.292423+0000","last_unstale":"2024-09-10T06:29:49.242923+0000","last_undegraded":"2024-09-10T06:29:49.242923+0000","last_fullsized":"2024-09-10T06:29:49.242923+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'30","last_scrub_stamp":"2024-09-10T06:29:49.242696+0000","last_deep_scrub":"95'30","last_deep_scrub_stamp":"2024-09-10T06:29:49.242696+0000","last_clean_scrub_stamp":"2024-09-10T06:29:49.242696+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:57.421690+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":30,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3102,"num_omap_keys":14,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:51.500722+0000","last_change":"2024-09-10T06:29:51.500722+0000","last_active":"2024-09-10T06:29:51.500722+0000","last_peered":"2024-09-10T06:29:51.500722+0000","last_clean":"2024-09-10T06:29:51.500722+0000","last_became_active":"2024-09-10T06:26:38.292918+0000","last_became_peered":"2024-09-10T06:26:38.292918+0000","last_unstale":"2024-09-10T06:29:51.500722+0000","last_undegraded":"2024-09-10T06:29:51.500722+0000","last_fullsized":"2024-09-10T06:29:51.500722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:51.500433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:51.500433+0000","last_clean_scrub_stamp":"2024-09-10T06:29:51.500433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:29:05.491942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:30:00.778147+0000","last_change":"2024-09-10T06:30:00.778147+0000","last_active":"2024-09-10T06:30:00.778147+0000","last_peered":"2024-09-10T06:30:00.778147+0000","last_clean":"2024-09-10T06:30:00.778147+0000","last_became_active":"2024-09-10T06:26:40.326431+0000","last_became_peered":"2024-09-10T06:26:40.326431+0000","last_unstale":"2024-09-10T06:30:00.778147+0000","last_undegraded":"2024-09-10T06:30:00.778147+0000","last_fullsized":"2024-09-10T06:30:00.778147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:30:00.777933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:30:00.777933+0000","last_clean_scrub_stamp":"2024-09-10T06:30:00.777933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:39:34.472373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"64'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.105015+0000","last_change":"2024-09-10T06:29:31.105015+0000","last_active":"2024-09-10T06:29:31.105015+0000","last_peered":"2024-09-10T06:29:31.105015+0000","last_clean":"2024-09-10T06:29:31.105015+0000","last_became_active":"2024-09-10T06:26:32.253524+0000","last_became_peered":"2024-09-10T06:26:32.253524+0000","last_unstale":"2024-09-10T06:29:31.105015+0000","last_undegraded":"2024-09-10T06:29:31.105015+0000","last_fullsized":"2024-09-10T06:29:31.105015+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'2","last_scrub_stamp":"2024-09-10T06:29:31.104822+0000","last_deep_scrub":"64'2","last_deep_scrub_stamp":"2024-09-10T06:29:31.104822+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.104822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:52.845705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'16","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.518214+0000","last_change":"2024-09-10T06:29:24.518214+0000","last_active":"2024-09-10T06:29:24.518214+0000","last_peered":"2024-09-10T06:29:24.518214+0000","last_clean":"2024-09-10T06:29:24.518214+0000","last_became_active":"2024-09-10T06:26:30.591125+0000","last_became_peered":"2024-09-10T06:26:30.591125+0000","last_unstale":"2024-09-10T06:29:24.518214+0000","last_undegraded":"2024-09-10T06:29:24.518214+0000","last_fullsized":"2024-09-10T06:29:24.518214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:24.518012+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:24.518012+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.518012+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:04:35.325269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.776224+0000","last_change":"2024-09-10T06:29:37.776224+0000","last_active":"2024-09-10T06:29:37.776224+0000","last_peered":"2024-09-10T06:29:37.776224+0000","last_clean":"2024-09-10T06:29:37.776224+0000","last_became_active":"2024-09-10T06:26:34.280058+0000","last_became_peered":"2024-09-10T06:26:34.280058+0000","last_unstale":"2024-09-10T06:29:37.776224+0000","last_undegraded":"2024-09-10T06:29:37.776224+0000","last_fullsized":"2024-09-10T06:29:37.776224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.776040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.776040+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.776040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:15:42.371352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"95'33","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.496560+0000","last_change":"2024-09-10T06:29:41.496560+0000","last_active":"2024-09-10T06:29:41.496560+0000","last_peered":"2024-09-10T06:29:41.496560+0000","last_clean":"2024-09-10T06:29:41.496560+0000","last_became_active":"2024-09-10T06:26:36.276965+0000","last_became_peered":"2024-09-10T06:26:36.276965+0000","last_unstale":"2024-09-10T06:29:41.496560+0000","last_undegraded":"2024-09-10T06:29:41.496560+0000","last_fullsized":"2024-09-10T06:29:41.496560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'33","last_scrub_stamp":"2024-09-10T06:29:41.496344+0000","last_deep_scrub":"95'33","last_deep_scrub_stamp":"2024-09-10T06:29:41.496344+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.496344+0000","objects_scrubbed":8,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:43:37.636104+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1348,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'105","reported_seq":309,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.490221+0000","last_change":"2024-09-10T06:29:42.490221+0000","last_active":"2024-09-10T06:29:42.490221+0000","last_peered":"2024-09-10T06:29:42.490221+0000","last_clean":"2024-09-10T06:29:42.490221+0000","last_became_active":"2024-09-10T06:26:38.299012+0000","last_became_peered":"2024-09-10T06:26:38.299012+0000","last_unstale":"2024-09-10T06:29:42.490221+0000","last_undegraded":"2024-09-10T06:29:42.490221+0000","last_fullsized":"2024-09-10T06:29:42.490221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'105","last_scrub_stamp":"2024-09-10T06:29:42.490046+0000","last_deep_scrub":"95'105","last_deep_scrub_stamp":"2024-09-10T06:29:42.490046+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.490046+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:20:06.851181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"61'2","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:48.819728+0000","last_change":"2024-09-10T06:29:48.819728+0000","last_active":"2024-09-10T06:29:48.819728+0000","last_peered":"2024-09-10T06:29:48.819728+0000","last_clean":"2024-09-10T06:29:48.819728+0000","last_became_active":"2024-09-10T06:26:40.335302+0000","last_became_peered":"2024-09-10T06:26:40.335302+0000","last_unstale":"2024-09-10T06:29:48.819728+0000","last_undegraded":"2024-09-10T06:29:48.819728+0000","last_fullsized":"2024-09-10T06:29:48.819728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'2","last_scrub_stamp":"2024-09-10T06:29:48.819537+0000","last_deep_scrub":"61'2","last_deep_scrub_stamp":"2024-09-10T06:29:48.819537+0000","last_clean_scrub_stamp":"2024-09-10T06:29:48.819537+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:27:43.058221+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"76'6","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.073055+0000","last_change":"2024-09-10T06:29:32.073055+0000","last_active":"2024-09-10T06:29:32.073055+0000","last_peered":"2024-09-10T06:29:32.073055+0000","last_clean":"2024-09-10T06:29:32.073055+0000","last_became_active":"2024-09-10T06:26:32.287315+0000","last_became_peered":"2024-09-10T06:26:32.287315+0000","last_unstale":"2024-09-10T06:29:32.073055+0000","last_undegraded":"2024-09-10T06:29:32.073055+0000","last_fullsized":"2024-09-10T06:29:32.073055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2024-09-10T06:29:32.072864+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2024-09-10T06:29:32.072864+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.072864+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:08.911842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'14","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.077576+0000","last_change":"2024-09-10T06:29:25.077576+0000","last_active":"2024-09-10T06:29:25.077576+0000","last_peered":"2024-09-10T06:29:25.077576+0000","last_clean":"2024-09-10T06:29:25.077576+0000","last_became_active":"2024-09-10T06:26:30.568464+0000","last_became_peered":"2024-09-10T06:26:30.568464+0000","last_unstale":"2024-09-10T06:29:25.077576+0000","last_undegraded":"2024-09-10T06:29:25.077576+0000","last_fullsized":"2024-09-10T06:29:25.077576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:25.077383+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:25.077383+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.077383+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:12.962962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"95'4","reported_seq":294,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.268274+0000","last_change":"2024-09-10T06:29:42.268274+0000","last_active":"2024-09-10T06:29:42.268274+0000","last_peered":"2024-09-10T06:29:42.268274+0000","last_clean":"2024-09-10T06:29:42.268274+0000","last_became_active":"2024-09-10T06:26:34.279192+0000","last_became_peered":"2024-09-10T06:26:34.279192+0000","last_unstale":"2024-09-10T06:29:42.268274+0000","last_undegraded":"2024-09-10T06:29:42.268274+0000","last_fullsized":"2024-09-10T06:29:42.268274+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'4","last_scrub_stamp":"2024-09-10T06:29:42.268035+0000","last_deep_scrub":"95'4","last_deep_scrub_stamp":"2024-09-10T06:29:42.268035+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.268035+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:28:52.439198+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"95'15","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:48.898500+0000","last_change":"2024-09-10T06:29:48.898500+0000","last_active":"2024-09-10T06:29:48.898500+0000","last_peered":"2024-09-10T06:29:48.898500+0000","last_clean":"2024-09-10T06:29:48.898500+0000","last_became_active":"2024-09-10T06:26:36.289527+0000","last_became_peered":"2024-09-10T06:26:36.289527+0000","last_unstale":"2024-09-10T06:29:48.898500+0000","last_undegraded":"2024-09-10T06:29:48.898500+0000","last_fullsized":"2024-09-10T06:29:48.898500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'15","last_scrub_stamp":"2024-09-10T06:29:48.898296+0000","last_deep_scrub":"95'15","last_deep_scrub_stamp":"2024-09-10T06:29:48.898296+0000","last_clean_scrub_stamp":"2024-09-10T06:29:48.898296+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:11.068778+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'105","reported_seq":321,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:43.506131+0000","last_change":"2024-09-10T06:29:43.506131+0000","last_active":"2024-09-10T06:29:43.506131+0000","last_peered":"2024-09-10T06:29:43.506131+0000","last_clean":"2024-09-10T06:29:43.506131+0000","last_became_active":"2024-09-10T06:26:38.287740+0000","last_became_peered":"2024-09-10T06:26:38.287740+0000","last_unstale":"2024-09-10T06:29:43.506131+0000","last_undegraded":"2024-09-10T06:29:43.506131+0000","last_fullsized":"2024-09-10T06:29:43.506131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'105","last_scrub_stamp":"2024-09-10T06:29:43.505943+0000","last_deep_scrub":"95'105","last_deep_scrub_stamp":"2024-09-10T06:29:43.505943+0000","last_clean_scrub_stamp":"2024-09-10T06:29:43.505943+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:33:01.600012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"67'8","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:56.216310+0000","last_change":"2024-09-10T06:29:56.216310+0000","last_active":"2024-09-10T06:29:56.216310+0000","last_peered":"2024-09-10T06:29:56.216310+0000","last_clean":"2024-09-10T06:29:56.216310+0000","last_became_active":"2024-09-10T06:26:40.328952+0000","last_became_peered":"2024-09-10T06:26:40.328952+0000","last_unstale":"2024-09-10T06:29:56.216310+0000","last_undegraded":"2024-09-10T06:29:56.216310+0000","last_fullsized":"2024-09-10T06:29:56.216310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8","last_scrub_stamp":"2024-09-10T06:29:56.216125+0000","last_deep_scrub":"67'8","last_deep_scrub_stamp":"2024-09-10T06:29:56.216125+0000","last_clean_scrub_stamp":"2024-09-10T06:29:56.216125+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:07.738898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"67'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.726186+0000","last_change":"2024-09-10T06:29:36.726186+0000","last_active":"2024-09-10T06:29:36.726186+0000","last_peered":"2024-09-10T06:29:36.726186+0000","last_clean":"2024-09-10T06:29:36.726186+0000","last_became_active":"2024-09-10T06:26:32.270265+0000","last_became_peered":"2024-09-10T06:26:32.270265+0000","last_unstale":"2024-09-10T06:29:36.726186+0000","last_undegraded":"2024-09-10T06:29:36.726186+0000","last_fullsized":"2024-09-10T06:29:36.726186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:36.726005+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:36.726005+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.726005+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:53.188286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"95'22","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.586338+0000","last_change":"2024-09-10T06:29:24.586338+0000","last_active":"2024-09-10T06:29:24.586338+0000","last_peered":"2024-09-10T06:29:24.586338+0000","last_clean":"2024-09-10T06:29:24.586338+0000","last_became_active":"2024-09-10T06:27:08.592864+0000","last_became_peered":"2024-09-10T06:27:08.592864+0000","last_unstale":"2024-09-10T06:29:24.586338+0000","last_undegraded":"2024-09-10T06:29:24.586338+0000","last_fullsized":"2024-09-10T06:29:24.586338+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:24.586253+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:24.586253+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.586253+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:01:13.559714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:45.215758+0000","last_change":"2024-09-10T06:29:45.215758+0000","last_active":"2024-09-10T06:29:45.215758+0000","last_peered":"2024-09-10T06:29:45.215758+0000","last_clean":"2024-09-10T06:29:45.215758+0000","last_became_active":"2024-09-10T06:26:34.285334+0000","last_became_peered":"2024-09-10T06:26:34.285334+0000","last_unstale":"2024-09-10T06:29:45.215758+0000","last_undegraded":"2024-09-10T06:29:45.215758+0000","last_fullsized":"2024-09-10T06:29:45.215758+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:45.215496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:45.215496+0000","last_clean_scrub_stamp":"2024-09-10T06:29:45.215496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:30.362178+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"95'34","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:48.264841+0000","last_change":"2024-09-10T06:29:48.264841+0000","last_active":"2024-09-10T06:29:48.264841+0000","last_peered":"2024-09-10T06:29:48.264841+0000","last_clean":"2024-09-10T06:29:48.264841+0000","last_became_active":"2024-09-10T06:26:36.287468+0000","last_became_peered":"2024-09-10T06:26:36.287468+0000","last_unstale":"2024-09-10T06:29:48.264841+0000","last_undegraded":"2024-09-10T06:29:48.264841+0000","last_fullsized":"2024-09-10T06:29:48.264841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'34","last_scrub_stamp":"2024-09-10T06:29:48.264657+0000","last_deep_scrub":"95'34","last_deep_scrub_stamp":"2024-09-10T06:29:48.264657+0000","last_clean_scrub_stamp":"2024-09-10T06:29:48.264657+0000","objects_scrubbed":8,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:25:03.974012+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":35,"num_read_kb":25,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.464134+0000","last_change":"2024-09-10T06:29:42.464134+0000","last_active":"2024-09-10T06:29:42.464134+0000","last_peered":"2024-09-10T06:29:42.464134+0000","last_clean":"2024-09-10T06:29:42.464134+0000","last_became_active":"2024-09-10T06:26:38.291214+0000","last_became_peered":"2024-09-10T06:26:38.291214+0000","last_unstale":"2024-09-10T06:29:42.464134+0000","last_undegraded":"2024-09-10T06:29:42.464134+0000","last_fullsized":"2024-09-10T06:29:42.464134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:42.463940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:42.463940+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.463940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:33:17.142689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"67'4","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:49.854083+0000","last_change":"2024-09-10T06:29:49.854083+0000","last_active":"2024-09-10T06:29:49.854083+0000","last_peered":"2024-09-10T06:29:49.854083+0000","last_clean":"2024-09-10T06:29:49.854083+0000","last_became_active":"2024-09-10T06:26:40.331502+0000","last_became_peered":"2024-09-10T06:26:40.331502+0000","last_unstale":"2024-09-10T06:29:49.854083+0000","last_undegraded":"2024-09-10T06:29:49.854083+0000","last_fullsized":"2024-09-10T06:29:49.854083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:49.853882+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:49.853882+0000","last_clean_scrub_stamp":"2024-09-10T06:29:49.853882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:02:27.710763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"76'4","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.416313+0000","last_change":"2024-09-10T06:29:33.416313+0000","last_active":"2024-09-10T06:29:33.416313+0000","last_peered":"2024-09-10T06:29:33.416313+0000","last_clean":"2024-09-10T06:29:33.416313+0000","last_became_active":"2024-09-10T06:26:32.273727+0000","last_became_peered":"2024-09-10T06:26:32.273727+0000","last_unstale":"2024-09-10T06:29:33.416313+0000","last_undegraded":"2024-09-10T06:29:33.416313+0000","last_fullsized":"2024-09-10T06:29:33.416313+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:33.416125+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:33.416125+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.416125+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:19:57.777260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"95'74","reported_seq":269,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.265036+0000","last_change":"2024-09-10T06:29:25.264881+0000","last_active":"2024-09-10T06:29:25.265036+0000","last_peered":"2024-09-10T06:29:25.265036+0000","last_clean":"2024-09-10T06:29:25.265036+0000","last_became_active":"2024-09-10T06:26:18.151259+0000","last_became_peered":"2024-09-10T06:26:18.151259+0000","last_unstale":"2024-09-10T06:29:25.265036+0000","last_undegraded":"2024-09-10T06:29:25.265036+0000","last_fullsized":"2024-09-10T06:29:25.265036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'74","last_scrub_stamp":"2024-09-10T06:29:25.264687+0000","last_deep_scrub":"95'74","last_deep_scrub_stamp":"2024-09-10T06:29:25.264687+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.264687+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:01:10.255426+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"95'2","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.364086+0000","last_change":"2024-09-10T06:29:27.364086+0000","last_active":"2024-09-10T06:29:27.364086+0000","last_peered":"2024-09-10T06:29:27.364086+0000","last_clean":"2024-09-10T06:29:27.364086+0000","last_became_active":"2024-09-10T06:26:23.505806+0000","last_became_peered":"2024-09-10T06:26:23.505806+0000","last_unstale":"2024-09-10T06:29:27.364086+0000","last_undegraded":"2024-09-10T06:29:27.364086+0000","last_fullsized":"2024-09-10T06:29:27.364086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-10T06:29:27.363883+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-10T06:29:27.363883+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.363883+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:22.736354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00083109999999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'18","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.090343+0000","last_change":"2024-09-10T06:29:23.090343+0000","last_active":"2024-09-10T06:29:23.090343+0000","last_peered":"2024-09-10T06:29:23.090343+0000","last_clean":"2024-09-10T06:29:23.090343+0000","last_became_active":"2024-09-10T06:26:30.606348+0000","last_became_peered":"2024-09-10T06:26:30.606348+0000","last_unstale":"2024-09-10T06:29:23.090343+0000","last_undegraded":"2024-09-10T06:29:23.090343+0000","last_fullsized":"2024-09-10T06:29:23.090343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:23.090275+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:23.090275+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.090275+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:50.992919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.202712+0000","last_change":"2024-09-10T06:29:39.202712+0000","last_active":"2024-09-10T06:29:39.202712+0000","last_peered":"2024-09-10T06:29:39.202712+0000","last_clean":"2024-09-10T06:29:39.202712+0000","last_became_active":"2024-09-10T06:26:34.285248+0000","last_became_peered":"2024-09-10T06:26:34.285248+0000","last_unstale":"2024-09-10T06:29:39.202712+0000","last_undegraded":"2024-09-10T06:29:39.202712+0000","last_fullsized":"2024-09-10T06:29:39.202712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:39.202537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:39.202537+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.202537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:58.998710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"95'44","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:46.247925+0000","last_change":"2024-09-10T06:29:46.247925+0000","last_active":"2024-09-10T06:29:46.247925+0000","last_peered":"2024-09-10T06:29:46.247925+0000","last_clean":"2024-09-10T06:29:46.247925+0000","last_became_active":"2024-09-10T06:26:36.295901+0000","last_became_peered":"2024-09-10T06:26:36.295901+0000","last_unstale":"2024-09-10T06:29:46.247925+0000","last_undegraded":"2024-09-10T06:29:46.247925+0000","last_fullsized":"2024-09-10T06:29:46.247925+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'44","last_scrub_stamp":"2024-09-10T06:29:46.247702+0000","last_deep_scrub":"95'44","last_deep_scrub_stamp":"2024-09-10T06:29:46.247702+0000","last_clean_scrub_stamp":"2024-09-10T06:29:46.247702+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:44.495985+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":53,"num_read_kb":160,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:49.503741+0000","last_change":"2024-09-10T06:29:49.503741+0000","last_active":"2024-09-10T06:29:49.503741+0000","last_peered":"2024-09-10T06:29:49.503741+0000","last_clean":"2024-09-10T06:29:49.503741+0000","last_became_active":"2024-09-10T06:26:38.305496+0000","last_became_peered":"2024-09-10T06:26:38.305496+0000","last_unstale":"2024-09-10T06:29:49.503741+0000","last_undegraded":"2024-09-10T06:29:49.503741+0000","last_fullsized":"2024-09-10T06:29:49.503741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:49.503562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:49.503562+0000","last_clean_scrub_stamp":"2024-09-10T06:29:49.503562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:41.711791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"64'2","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:48.470958+0000","last_change":"2024-09-10T06:29:48.470958+0000","last_active":"2024-09-10T06:29:48.470958+0000","last_peered":"2024-09-10T06:29:48.470958+0000","last_clean":"2024-09-10T06:29:48.470958+0000","last_became_active":"2024-09-10T06:26:40.331294+0000","last_became_peered":"2024-09-10T06:26:40.331294+0000","last_unstale":"2024-09-10T06:29:48.470958+0000","last_undegraded":"2024-09-10T06:29:48.470958+0000","last_fullsized":"2024-09-10T06:29:48.470958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'2","last_scrub_stamp":"2024-09-10T06:29:48.470749+0000","last_deep_scrub":"64'2","last_deep_scrub_stamp":"2024-09-10T06:29:48.470749+0000","last_clean_scrub_stamp":"2024-09-10T06:29:48.470749+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:55.220725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.564019+0000","last_change":"2024-09-10T06:29:32.564019+0000","last_active":"2024-09-10T06:29:32.564019+0000","last_peered":"2024-09-10T06:29:32.564019+0000","last_clean":"2024-09-10T06:29:32.564019+0000","last_became_active":"2024-09-10T06:26:32.278118+0000","last_became_peered":"2024-09-10T06:26:32.278118+0000","last_unstale":"2024-09-10T06:29:32.564019+0000","last_undegraded":"2024-09-10T06:29:32.564019+0000","last_fullsized":"2024-09-10T06:29:32.564019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:32.563849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:32.563849+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.563849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:22.391297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.251882+0000","last_change":"2024-09-10T06:29:26.251882+0000","last_active":"2024-09-10T06:29:26.251882+0000","last_peered":"2024-09-10T06:29:26.251882+0000","last_clean":"2024-09-10T06:29:26.251882+0000","last_became_active":"2024-09-10T06:26:23.508652+0000","last_became_peered":"2024-09-10T06:26:23.508652+0000","last_unstale":"2024-09-10T06:29:26.251882+0000","last_undegraded":"2024-09-10T06:29:26.251882+0000","last_fullsized":"2024-09-10T06:29:26.251882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:26.251712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:26.251712+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.251712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:18.145262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00080984399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"95'22","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.578231+0000","last_change":"2024-09-10T06:29:23.578231+0000","last_active":"2024-09-10T06:29:23.578231+0000","last_peered":"2024-09-10T06:29:23.578231+0000","last_clean":"2024-09-10T06:29:23.578231+0000","last_became_active":"2024-09-10T06:26:30.593978+0000","last_became_peered":"2024-09-10T06:26:30.593978+0000","last_unstale":"2024-09-10T06:29:23.578231+0000","last_undegraded":"2024-09-10T06:29:23.578231+0000","last_fullsized":"2024-09-10T06:29:23.578231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:23.578147+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:23.578147+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.578147+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:35:24.778260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.292878+0000","last_change":"2024-09-10T06:29:41.292878+0000","last_active":"2024-09-10T06:29:41.292878+0000","last_peered":"2024-09-10T06:29:41.292878+0000","last_clean":"2024-09-10T06:29:41.292878+0000","last_became_active":"2024-09-10T06:26:34.279147+0000","last_became_peered":"2024-09-10T06:26:34.279147+0000","last_unstale":"2024-09-10T06:29:41.292878+0000","last_undegraded":"2024-09-10T06:29:41.292878+0000","last_fullsized":"2024-09-10T06:29:41.292878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:41.292660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:41.292660+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.292660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:40.776269+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'125","reported_seq":365,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.845590+0000","last_change":"2024-09-10T06:29:42.845590+0000","last_active":"2024-09-10T06:29:42.845590+0000","last_peered":"2024-09-10T06:29:42.845590+0000","last_clean":"2024-09-10T06:29:42.845590+0000","last_became_active":"2024-09-10T06:26:36.289232+0000","last_became_peered":"2024-09-10T06:26:36.289232+0000","last_unstale":"2024-09-10T06:29:42.845590+0000","last_undegraded":"2024-09-10T06:29:42.845590+0000","last_fullsized":"2024-09-10T06:29:42.845590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'125","last_scrub_stamp":"2024-09-10T06:29:42.845383+0000","last_deep_scrub":"95'125","last_deep_scrub_stamp":"2024-09-10T06:29:42.845383+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.845383+0000","objects_scrubbed":10,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:59:51.171028+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":162,"num_read_kb":147,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:51.241505+0000","last_change":"2024-09-10T06:29:51.241505+0000","last_active":"2024-09-10T06:29:51.241505+0000","last_peered":"2024-09-10T06:29:51.241505+0000","last_clean":"2024-09-10T06:29:51.241505+0000","last_became_active":"2024-09-10T06:26:38.301104+0000","last_became_peered":"2024-09-10T06:26:38.301104+0000","last_unstale":"2024-09-10T06:29:51.241505+0000","last_undegraded":"2024-09-10T06:29:51.241505+0000","last_fullsized":"2024-09-10T06:29:51.241505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:51.241324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:51.241324+0000","last_clean_scrub_stamp":"2024-09-10T06:29:51.241324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:55:34.373652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"76'2","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:51.836554+0000","last_change":"2024-09-10T06:29:51.836554+0000","last_active":"2024-09-10T06:29:51.836554+0000","last_peered":"2024-09-10T06:29:51.836554+0000","last_clean":"2024-09-10T06:29:51.836554+0000","last_became_active":"2024-09-10T06:26:40.319266+0000","last_became_peered":"2024-09-10T06:26:40.319266+0000","last_unstale":"2024-09-10T06:29:51.836554+0000","last_undegraded":"2024-09-10T06:29:51.836554+0000","last_fullsized":"2024-09-10T06:29:51.836554+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:51.836359+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:51.836359+0000","last_clean_scrub_stamp":"2024-09-10T06:29:51.836359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:38.086367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"76'14","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.690686+0000","last_change":"2024-09-10T06:29:32.690686+0000","last_active":"2024-09-10T06:29:32.690686+0000","last_peered":"2024-09-10T06:29:32.690686+0000","last_clean":"2024-09-10T06:29:32.690686+0000","last_became_active":"2024-09-10T06:26:32.282235+0000","last_became_peered":"2024-09-10T06:26:32.282235+0000","last_unstale":"2024-09-10T06:29:32.690686+0000","last_undegraded":"2024-09-10T06:29:32.690686+0000","last_fullsized":"2024-09-10T06:29:32.690686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'14","last_scrub_stamp":"2024-09-10T06:29:32.690477+0000","last_deep_scrub":"76'14","last_deep_scrub_stamp":"2024-09-10T06:29:32.690477+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.690477+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:45.934951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.535434+0000","last_change":"2024-09-10T06:29:23.535434+0000","last_active":"2024-09-10T06:29:23.535434+0000","last_peered":"2024-09-10T06:29:23.535434+0000","last_clean":"2024-09-10T06:29:23.535434+0000","last_became_active":"2024-09-10T06:26:23.504398+0000","last_became_peered":"2024-09-10T06:26:23.504398+0000","last_unstale":"2024-09-10T06:29:23.535434+0000","last_undegraded":"2024-09-10T06:29:23.535434+0000","last_fullsized":"2024-09-10T06:29:23.535434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:23.535349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:23.535349+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.535349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:38.274075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012739940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"95'16","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.757031+0000","last_change":"2024-09-10T06:29:24.757031+0000","last_active":"2024-09-10T06:29:24.757031+0000","last_peered":"2024-09-10T06:29:24.757031+0000","last_clean":"2024-09-10T06:29:24.757031+0000","last_became_active":"2024-09-10T06:26:30.570037+0000","last_became_peered":"2024-09-10T06:26:30.570037+0000","last_unstale":"2024-09-10T06:29:24.757031+0000","last_undegraded":"2024-09-10T06:29:24.757031+0000","last_fullsized":"2024-09-10T06:29:24.757031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:24.756843+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:24.756843+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.756843+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:35:05.933687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"95'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.572089+0000","last_change":"2024-09-10T06:29:33.572089+0000","last_active":"2024-09-10T06:29:33.572089+0000","last_peered":"2024-09-10T06:29:33.572089+0000","last_clean":"2024-09-10T06:29:33.572089+0000","last_became_active":"2024-09-10T06:26:34.283980+0000","last_became_peered":"2024-09-10T06:26:34.283980+0000","last_unstale":"2024-09-10T06:29:33.572089+0000","last_undegraded":"2024-09-10T06:29:33.572089+0000","last_fullsized":"2024-09-10T06:29:33.572089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-10T06:29:33.571908+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-10T06:29:33.571908+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.571908+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:51:00.057364+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'27","reported_seq":257,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:46.273133+0000","last_change":"2024-09-10T06:29:46.273133+0000","last_active":"2024-09-10T06:29:46.273133+0000","last_peered":"2024-09-10T06:29:46.273133+0000","last_clean":"2024-09-10T06:29:46.273133+0000","last_became_active":"2024-09-10T06:28:46.327631+0000","last_became_peered":"2024-09-10T06:28:46.327631+0000","last_unstale":"2024-09-10T06:29:46.273133+0000","last_undegraded":"2024-09-10T06:29:46.273133+0000","last_fullsized":"2024-09-10T06:29:46.273133+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'27","last_scrub_stamp":"2024-09-10T06:29:46.272936+0000","last_deep_scrub":"95'27","last_deep_scrub_stamp":"2024-09-10T06:29:46.272936+0000","last_clean_scrub_stamp":"2024-09-10T06:29:46.272936+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:31.419618+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:48.470365+0000","last_change":"2024-09-10T06:29:48.470365+0000","last_active":"2024-09-10T06:29:48.470365+0000","last_peered":"2024-09-10T06:29:48.470365+0000","last_clean":"2024-09-10T06:29:48.470365+0000","last_became_active":"2024-09-10T06:26:38.291623+0000","last_became_peered":"2024-09-10T06:26:38.291623+0000","last_unstale":"2024-09-10T06:29:48.470365+0000","last_undegraded":"2024-09-10T06:29:48.470365+0000","last_fullsized":"2024-09-10T06:29:48.470365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:48.470183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:48.470183+0000","last_clean_scrub_stamp":"2024-09-10T06:29:48.470183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:24.486789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:59.826657+0000","last_change":"2024-09-10T06:29:59.826657+0000","last_active":"2024-09-10T06:29:59.826657+0000","last_peered":"2024-09-10T06:29:59.826657+0000","last_clean":"2024-09-10T06:29:59.826657+0000","last_became_active":"2024-09-10T06:26:40.302898+0000","last_became_peered":"2024-09-10T06:26:40.302898+0000","last_unstale":"2024-09-10T06:29:59.826657+0000","last_undegraded":"2024-09-10T06:29:59.826657+0000","last_fullsized":"2024-09-10T06:29:59.826657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:59.826415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:59.826415+0000","last_clean_scrub_stamp":"2024-09-10T06:29:59.826415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:40:19.529366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"76'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.705655+0000","last_change":"2024-09-10T06:29:31.705655+0000","last_active":"2024-09-10T06:29:31.705655+0000","last_peered":"2024-09-10T06:29:31.705655+0000","last_clean":"2024-09-10T06:29:31.705655+0000","last_became_active":"2024-09-10T06:26:32.273183+0000","last_became_peered":"2024-09-10T06:26:32.273183+0000","last_unstale":"2024-09-10T06:29:31.705655+0000","last_undegraded":"2024-09-10T06:29:31.705655+0000","last_fullsized":"2024-09-10T06:29:31.705655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:31.705463+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:31.705463+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.705463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:48:13.950948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"95'3","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.389873+0000","last_change":"2024-09-10T06:29:25.389873+0000","last_active":"2024-09-10T06:29:25.389873+0000","last_peered":"2024-09-10T06:29:25.389873+0000","last_clean":"2024-09-10T06:29:25.389873+0000","last_became_active":"2024-09-10T06:26:23.505127+0000","last_became_peered":"2024-09-10T06:26:23.505127+0000","last_unstale":"2024-09-10T06:29:25.389873+0000","last_undegraded":"2024-09-10T06:29:25.389873+0000","last_fullsized":"2024-09-10T06:29:25.389873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-10T06:29:25.389673+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-10T06:29:25.389673+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.389673+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:47.130556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0025922800000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"95'16","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.119629+0000","last_change":"2024-09-10T06:29:23.119629+0000","last_active":"2024-09-10T06:29:23.119629+0000","last_peered":"2024-09-10T06:29:23.119629+0000","last_clean":"2024-09-10T06:29:23.119629+0000","last_became_active":"2024-09-10T06:26:30.577934+0000","last_became_peered":"2024-09-10T06:26:30.577934+0000","last_unstale":"2024-09-10T06:29:23.119629+0000","last_undegraded":"2024-09-10T06:29:23.119629+0000","last_fullsized":"2024-09-10T06:29:23.119629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:23.119438+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:23.119438+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.119438+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:44.272106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.598604+0000","last_change":"2024-09-10T06:29:41.598604+0000","last_active":"2024-09-10T06:29:41.598604+0000","last_peered":"2024-09-10T06:29:41.598604+0000","last_clean":"2024-09-10T06:29:41.598604+0000","last_became_active":"2024-09-10T06:26:34.274705+0000","last_became_peered":"2024-09-10T06:26:34.274705+0000","last_unstale":"2024-09-10T06:29:41.598604+0000","last_undegraded":"2024-09-10T06:29:41.598604+0000","last_fullsized":"2024-09-10T06:29:41.598604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:41.598403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:41.598403+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.598403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:20:44.526904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"95'18","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:45.863912+0000","last_change":"2024-09-10T06:29:45.863912+0000","last_active":"2024-09-10T06:29:45.863912+0000","last_peered":"2024-09-10T06:29:45.863912+0000","last_clean":"2024-09-10T06:29:45.863912+0000","last_became_active":"2024-09-10T06:26:36.265322+0000","last_became_peered":"2024-09-10T06:26:36.265322+0000","last_unstale":"2024-09-10T06:29:45.863912+0000","last_undegraded":"2024-09-10T06:29:45.863912+0000","last_fullsized":"2024-09-10T06:29:45.863912+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:45.863710+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:45.863710+0000","last_clean_scrub_stamp":"2024-09-10T06:29:45.863710+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:33.825123+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.416645+0000","last_change":"2024-09-10T06:29:41.416645+0000","last_active":"2024-09-10T06:29:41.416645+0000","last_peered":"2024-09-10T06:29:41.416645+0000","last_clean":"2024-09-10T06:29:41.416645+0000","last_became_active":"2024-09-10T06:28:46.344951+0000","last_became_peered":"2024-09-10T06:28:46.344951+0000","last_unstale":"2024-09-10T06:29:41.416645+0000","last_undegraded":"2024-09-10T06:29:41.416645+0000","last_fullsized":"2024-09-10T06:29:41.416645+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:41.416461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:41.416461+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.416461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:43.497547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"76'8","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:53.340820+0000","last_change":"2024-09-10T06:29:53.340820+0000","last_active":"2024-09-10T06:29:53.340820+0000","last_peered":"2024-09-10T06:29:53.340820+0000","last_clean":"2024-09-10T06:29:53.340820+0000","last_became_active":"2024-09-10T06:26:40.326130+0000","last_became_peered":"2024-09-10T06:26:40.326130+0000","last_unstale":"2024-09-10T06:29:53.340820+0000","last_undegraded":"2024-09-10T06:29:53.340820+0000","last_fullsized":"2024-09-10T06:29:53.340820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'8","last_scrub_stamp":"2024-09-10T06:29:53.340614+0000","last_deep_scrub":"76'8","last_deep_scrub_stamp":"2024-09-10T06:29:53.340614+0000","last_clean_scrub_stamp":"2024-09-10T06:29:53.340614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:29.357221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"67'8","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.702304+0000","last_change":"2024-09-10T06:29:29.702304+0000","last_active":"2024-09-10T06:29:29.702304+0000","last_peered":"2024-09-10T06:29:29.702304+0000","last_clean":"2024-09-10T06:29:29.702304+0000","last_became_active":"2024-09-10T06:26:32.282086+0000","last_became_peered":"2024-09-10T06:26:32.282086+0000","last_unstale":"2024-09-10T06:29:29.702304+0000","last_undegraded":"2024-09-10T06:29:29.702304+0000","last_fullsized":"2024-09-10T06:29:29.702304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8","last_scrub_stamp":"2024-09-10T06:29:29.702110+0000","last_deep_scrub":"67'8","last_deep_scrub_stamp":"2024-09-10T06:29:29.702110+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.702110+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:02.172256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'32","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.404438+0000","last_change":"2024-09-10T06:29:23.404438+0000","last_active":"2024-09-10T06:29:23.404438+0000","last_peered":"2024-09-10T06:29:23.404438+0000","last_clean":"2024-09-10T06:29:23.404438+0000","last_became_active":"2024-09-10T06:26:30.591140+0000","last_became_peered":"2024-09-10T06:26:30.591140+0000","last_unstale":"2024-09-10T06:29:23.404438+0000","last_undegraded":"2024-09-10T06:29:23.404438+0000","last_fullsized":"2024-09-10T06:29:23.404438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'32","last_scrub_stamp":"2024-09-10T06:29:23.404208+0000","last_deep_scrub":"95'32","last_deep_scrub_stamp":"2024-09-10T06:29:23.404208+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.404208+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:58.082957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:23.783568+0000","last_change":"2024-09-10T06:29:23.783568+0000","last_active":"2024-09-10T06:29:23.783568+0000","last_peered":"2024-09-10T06:29:23.783568+0000","last_clean":"2024-09-10T06:29:23.783568+0000","last_became_active":"2024-09-10T06:26:23.863175+0000","last_became_peered":"2024-09-10T06:26:23.863175+0000","last_unstale":"2024-09-10T06:29:23.783568+0000","last_undegraded":"2024-09-10T06:29:23.783568+0000","last_fullsized":"2024-09-10T06:29:23.783568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:23.783333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:23.783333+0000","last_clean_scrub_stamp":"2024-09-10T06:29:23.783333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:41:11.916364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011654980000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.634257+0000","last_change":"2024-09-10T06:29:40.634257+0000","last_active":"2024-09-10T06:29:40.634257+0000","last_peered":"2024-09-10T06:29:40.634257+0000","last_clean":"2024-09-10T06:29:40.634257+0000","last_became_active":"2024-09-10T06:26:34.273984+0000","last_became_peered":"2024-09-10T06:26:34.273984+0000","last_unstale":"2024-09-10T06:29:40.634257+0000","last_undegraded":"2024-09-10T06:29:40.634257+0000","last_fullsized":"2024-09-10T06:29:40.634257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:40.634065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:40.634065+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.634065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:42:31.811649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"95'44","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.628583+0000","last_change":"2024-09-10T06:29:42.628583+0000","last_active":"2024-09-10T06:29:42.628583+0000","last_peered":"2024-09-10T06:29:42.628583+0000","last_clean":"2024-09-10T06:29:42.628583+0000","last_became_active":"2024-09-10T06:26:36.270914+0000","last_became_peered":"2024-09-10T06:26:36.270914+0000","last_unstale":"2024-09-10T06:29:42.628583+0000","last_undegraded":"2024-09-10T06:29:42.628583+0000","last_fullsized":"2024-09-10T06:29:42.628583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'44","last_scrub_stamp":"2024-09-10T06:29:42.628354+0000","last_deep_scrub":"95'44","last_deep_scrub_stamp":"2024-09-10T06:29:42.628354+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.628354+0000","objects_scrubbed":8,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:01.827661+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":51,"num_read_kb":157,"num_write":28,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:53.226292+0000","last_change":"2024-09-10T06:29:53.226292+0000","last_active":"2024-09-10T06:29:53.226292+0000","last_peered":"2024-09-10T06:29:53.226292+0000","last_clean":"2024-09-10T06:29:53.226292+0000","last_became_active":"2024-09-10T06:26:38.277261+0000","last_became_peered":"2024-09-10T06:26:38.277261+0000","last_unstale":"2024-09-10T06:29:53.226292+0000","last_undegraded":"2024-09-10T06:29:53.226292+0000","last_fullsized":"2024-09-10T06:29:53.226292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:53.226112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:53.226112+0000","last_clean_scrub_stamp":"2024-09-10T06:29:53.226112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:33.204837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"67'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:30:00.542706+0000","last_change":"2024-09-10T06:30:00.542706+0000","last_active":"2024-09-10T06:30:00.542706+0000","last_peered":"2024-09-10T06:30:00.542706+0000","last_clean":"2024-09-10T06:30:00.542706+0000","last_became_active":"2024-09-10T06:26:40.329701+0000","last_became_peered":"2024-09-10T06:26:40.329701+0000","last_unstale":"2024-09-10T06:30:00.542706+0000","last_undegraded":"2024-09-10T06:30:00.542706+0000","last_fullsized":"2024-09-10T06:30:00.542706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:30:00.542497+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:30:00.542497+0000","last_clean_scrub_stamp":"2024-09-10T06:30:00.542497+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:14:58.951551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"67'4","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.553050+0000","last_change":"2024-09-10T06:29:30.553050+0000","last_active":"2024-09-10T06:29:30.553050+0000","last_peered":"2024-09-10T06:29:30.553050+0000","last_clean":"2024-09-10T06:29:30.553050+0000","last_became_active":"2024-09-10T06:26:32.274946+0000","last_became_peered":"2024-09-10T06:26:32.274946+0000","last_unstale":"2024-09-10T06:29:30.553050+0000","last_undegraded":"2024-09-10T06:29:30.553050+0000","last_fullsized":"2024-09-10T06:29:30.553050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:30.552860+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:30.552860+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.552860+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:13:06.395007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"95'16","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.713294+0000","last_change":"2024-09-10T06:29:28.713294+0000","last_active":"2024-09-10T06:29:28.713294+0000","last_peered":"2024-09-10T06:29:28.713294+0000","last_clean":"2024-09-10T06:29:28.713294+0000","last_became_active":"2024-09-10T06:26:30.565220+0000","last_became_peered":"2024-09-10T06:26:30.565220+0000","last_unstale":"2024-09-10T06:29:28.713294+0000","last_undegraded":"2024-09-10T06:29:28.713294+0000","last_fullsized":"2024-09-10T06:29:28.713294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:28.713108+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:28.713108+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.713108+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:48:49.954032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.248692+0000","last_change":"2024-09-10T06:29:28.248692+0000","last_active":"2024-09-10T06:29:28.248692+0000","last_peered":"2024-09-10T06:29:28.248692+0000","last_clean":"2024-09-10T06:29:28.248692+0000","last_became_active":"2024-09-10T06:26:23.863380+0000","last_became_peered":"2024-09-10T06:26:23.863380+0000","last_unstale":"2024-09-10T06:29:28.248692+0000","last_undegraded":"2024-09-10T06:29:28.248692+0000","last_fullsized":"2024-09-10T06:29:28.248692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:28.248480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:28.248480+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.248480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:25.157883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079326799999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.375020+0000","last_change":"2024-09-10T06:29:38.375020+0000","last_active":"2024-09-10T06:29:38.375020+0000","last_peered":"2024-09-10T06:29:38.375020+0000","last_clean":"2024-09-10T06:29:38.375020+0000","last_became_active":"2024-09-10T06:26:34.272192+0000","last_became_peered":"2024-09-10T06:26:34.272192+0000","last_unstale":"2024-09-10T06:29:38.375020+0000","last_undegraded":"2024-09-10T06:29:38.375020+0000","last_fullsized":"2024-09-10T06:29:38.375020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:38.374854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:38.374854+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.374854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:29:02.446964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"95'21","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.844304+0000","last_change":"2024-09-10T06:29:41.844304+0000","last_active":"2024-09-10T06:29:41.844304+0000","last_peered":"2024-09-10T06:29:41.844304+0000","last_clean":"2024-09-10T06:29:41.844304+0000","last_became_active":"2024-09-10T06:26:36.290570+0000","last_became_peered":"2024-09-10T06:26:36.290570+0000","last_unstale":"2024-09-10T06:29:41.844304+0000","last_undegraded":"2024-09-10T06:29:41.844304+0000","last_fullsized":"2024-09-10T06:29:41.844304+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'21","last_scrub_stamp":"2024-09-10T06:29:41.844191+0000","last_deep_scrub":"95'21","last_deep_scrub_stamp":"2024-09-10T06:29:41.844191+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.844191+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:40:28.928912+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'106","reported_seq":295,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:50.348089+0000","last_change":"2024-09-10T06:29:50.348089+0000","last_active":"2024-09-10T06:29:50.348089+0000","last_peered":"2024-09-10T06:29:50.348089+0000","last_clean":"2024-09-10T06:29:50.348089+0000","last_became_active":"2024-09-10T06:26:38.310450+0000","last_became_peered":"2024-09-10T06:26:38.310450+0000","last_unstale":"2024-09-10T06:29:50.348089+0000","last_undegraded":"2024-09-10T06:29:50.348089+0000","last_fullsized":"2024-09-10T06:29:50.348089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'106","last_scrub_stamp":"2024-09-10T06:29:50.347877+0000","last_deep_scrub":"95'106","last_deep_scrub_stamp":"2024-09-10T06:29:50.347877+0000","last_clean_scrub_stamp":"2024-09-10T06:29:50.347877+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:01.870651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:58.789247+0000","last_change":"2024-09-10T06:29:58.789247+0000","last_active":"2024-09-10T06:29:58.789247+0000","last_peered":"2024-09-10T06:29:58.789247+0000","last_clean":"2024-09-10T06:29:58.789247+0000","last_became_active":"2024-09-10T06:26:40.312266+0000","last_became_peered":"2024-09-10T06:26:40.312266+0000","last_unstale":"2024-09-10T06:29:58.789247+0000","last_undegraded":"2024-09-10T06:29:58.789247+0000","last_fullsized":"2024-09-10T06:29:58.789247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:58.789036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:58.789036+0000","last_clean_scrub_stamp":"2024-09-10T06:29:58.789036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:08:19.043106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"76'4","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.054582+0000","last_change":"2024-09-10T06:29:35.054582+0000","last_active":"2024-09-10T06:29:35.054582+0000","last_peered":"2024-09-10T06:29:35.054582+0000","last_clean":"2024-09-10T06:29:35.054582+0000","last_became_active":"2024-09-10T06:26:32.258337+0000","last_became_peered":"2024-09-10T06:26:32.258337+0000","last_unstale":"2024-09-10T06:29:35.054582+0000","last_undegraded":"2024-09-10T06:29:35.054582+0000","last_fullsized":"2024-09-10T06:29:35.054582+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:35.054359+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:35.054359+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.054359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:50.284064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"95'16","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.067565+0000","last_change":"2024-09-10T06:29:24.067565+0000","last_active":"2024-09-10T06:29:24.067565+0000","last_peered":"2024-09-10T06:29:24.067565+0000","last_clean":"2024-09-10T06:29:24.067565+0000","last_became_active":"2024-09-10T06:26:30.581115+0000","last_became_peered":"2024-09-10T06:26:30.581115+0000","last_unstale":"2024-09-10T06:29:24.067565+0000","last_undegraded":"2024-09-10T06:29:24.067565+0000","last_fullsized":"2024-09-10T06:29:24.067565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:24.067500+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:24.067500+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.067500+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:15.114685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:21.800732+0000","last_change":"2024-09-10T06:29:21.800732+0000","last_active":"2024-09-10T06:29:21.800732+0000","last_peered":"2024-09-10T06:29:21.800732+0000","last_clean":"2024-09-10T06:29:21.800732+0000","last_became_active":"2024-09-10T06:26:23.502706+0000","last_became_peered":"2024-09-10T06:26:23.502706+0000","last_unstale":"2024-09-10T06:29:21.800732+0000","last_undegraded":"2024-09-10T06:29:21.800732+0000","last_fullsized":"2024-09-10T06:29:21.800732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:21.800559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:21.800559+0000","last_clean_scrub_stamp":"2024-09-10T06:29:21.800559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:09:01.214476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00097916699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:44.176911+0000","last_change":"2024-09-10T06:29:44.176911+0000","last_active":"2024-09-10T06:29:44.176911+0000","last_peered":"2024-09-10T06:29:44.176911+0000","last_clean":"2024-09-10T06:29:44.176911+0000","last_became_active":"2024-09-10T06:26:34.257739+0000","last_became_peered":"2024-09-10T06:26:34.257739+0000","last_unstale":"2024-09-10T06:29:44.176911+0000","last_undegraded":"2024-09-10T06:29:44.176911+0000","last_fullsized":"2024-09-10T06:29:44.176911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:44.176731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:44.176731+0000","last_clean_scrub_stamp":"2024-09-10T06:29:44.176731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:12.238450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"95'15","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:48.236267+0000","last_change":"2024-09-10T06:29:48.236267+0000","last_active":"2024-09-10T06:29:48.236267+0000","last_peered":"2024-09-10T06:29:48.236267+0000","last_clean":"2024-09-10T06:29:48.236267+0000","last_became_active":"2024-09-10T06:26:36.270325+0000","last_became_peered":"2024-09-10T06:26:36.270325+0000","last_unstale":"2024-09-10T06:29:48.236267+0000","last_undegraded":"2024-09-10T06:29:48.236267+0000","last_fullsized":"2024-09-10T06:29:48.236267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'15","last_scrub_stamp":"2024-09-10T06:29:48.236072+0000","last_deep_scrub":"95'15","last_deep_scrub_stamp":"2024-09-10T06:29:48.236072+0000","last_clean_scrub_stamp":"2024-09-10T06:29:48.236072+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:52.689618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'106","reported_seq":281,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:54.839060+0000","last_change":"2024-09-10T06:29:54.839060+0000","last_active":"2024-09-10T06:29:54.839060+0000","last_peered":"2024-09-10T06:29:54.839060+0000","last_clean":"2024-09-10T06:29:54.839060+0000","last_became_active":"2024-09-10T06:26:38.299466+0000","last_became_peered":"2024-09-10T06:26:38.299466+0000","last_unstale":"2024-09-10T06:29:54.839060+0000","last_undegraded":"2024-09-10T06:29:54.839060+0000","last_fullsized":"2024-09-10T06:29:54.839060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'106","last_scrub_stamp":"2024-09-10T06:29:54.838867+0000","last_deep_scrub":"95'106","last_deep_scrub_stamp":"2024-09-10T06:29:54.838867+0000","last_clean_scrub_stamp":"2024-09-10T06:29:54.838867+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:56.901907+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"67'4","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:55.470285+0000","last_change":"2024-09-10T06:29:55.470285+0000","last_active":"2024-09-10T06:29:55.470285+0000","last_peered":"2024-09-10T06:29:55.470285+0000","last_clean":"2024-09-10T06:29:55.470285+0000","last_became_active":"2024-09-10T06:26:40.329009+0000","last_became_peered":"2024-09-10T06:26:40.329009+0000","last_unstale":"2024-09-10T06:29:55.470285+0000","last_undegraded":"2024-09-10T06:29:55.470285+0000","last_fullsized":"2024-09-10T06:29:55.470285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T06:29:55.469956+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T06:29:55.469956+0000","last_clean_scrub_stamp":"2024-09-10T06:29:55.469956+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:54.818058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"67'8","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.112413+0000","last_change":"2024-09-10T06:29:28.112413+0000","last_active":"2024-09-10T06:29:28.112413+0000","last_peered":"2024-09-10T06:29:28.112413+0000","last_clean":"2024-09-10T06:29:28.112413+0000","last_became_active":"2024-09-10T06:26:32.282794+0000","last_became_peered":"2024-09-10T06:26:32.282794+0000","last_unstale":"2024-09-10T06:29:28.112413+0000","last_undegraded":"2024-09-10T06:29:28.112413+0000","last_fullsized":"2024-09-10T06:29:28.112413+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'8","last_scrub_stamp":"2024-09-10T06:29:28.112223+0000","last_deep_scrub":"67'8","last_deep_scrub_stamp":"2024-09-10T06:29:28.112223+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.112223+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:19:30.193309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'12","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:22.547386+0000","last_change":"2024-09-10T06:29:22.547386+0000","last_active":"2024-09-10T06:29:22.547386+0000","last_peered":"2024-09-10T06:29:22.547386+0000","last_clean":"2024-09-10T06:29:22.547386+0000","last_became_active":"2024-09-10T06:26:30.577985+0000","last_became_peered":"2024-09-10T06:26:30.577985+0000","last_unstale":"2024-09-10T06:29:22.547386+0000","last_undegraded":"2024-09-10T06:29:22.547386+0000","last_fullsized":"2024-09-10T06:29:22.547386+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:22.547307+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:22.547307+0000","last_clean_scrub_stamp":"2024-09-10T06:29:22.547307+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:43:40.427930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.476396+0000","last_change":"2024-09-10T06:29:26.476396+0000","last_active":"2024-09-10T06:29:26.476396+0000","last_peered":"2024-09-10T06:29:26.476396+0000","last_clean":"2024-09-10T06:29:26.476396+0000","last_became_active":"2024-09-10T06:26:23.507213+0000","last_became_peered":"2024-09-10T06:26:23.507213+0000","last_unstale":"2024-09-10T06:29:26.476396+0000","last_undegraded":"2024-09-10T06:29:26.476396+0000","last_fullsized":"2024-09-10T06:29:26.476396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:26.476196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:26.476196+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.476196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:37.063867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086969,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:46.897202+0000","last_change":"2024-09-10T06:29:46.897202+0000","last_active":"2024-09-10T06:29:46.897202+0000","last_peered":"2024-09-10T06:29:46.897202+0000","last_clean":"2024-09-10T06:29:46.897202+0000","last_became_active":"2024-09-10T06:26:34.268359+0000","last_became_peered":"2024-09-10T06:26:34.268359+0000","last_unstale":"2024-09-10T06:29:46.897202+0000","last_undegraded":"2024-09-10T06:29:46.897202+0000","last_fullsized":"2024-09-10T06:29:46.897202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:46.897001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:46.897001+0000","last_clean_scrub_stamp":"2024-09-10T06:29:46.897001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:38.588859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"95'51","reported_seq":230,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:45.225630+0000","last_change":"2024-09-10T06:29:45.225630+0000","last_active":"2024-09-10T06:29:45.225630+0000","last_peered":"2024-09-10T06:29:45.225630+0000","last_clean":"2024-09-10T06:29:45.225630+0000","last_became_active":"2024-09-10T06:26:36.297606+0000","last_became_peered":"2024-09-10T06:26:36.297606+0000","last_unstale":"2024-09-10T06:29:45.225630+0000","last_undegraded":"2024-09-10T06:29:45.225630+0000","last_fullsized":"2024-09-10T06:29:45.225630+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'51","last_scrub_stamp":"2024-09-10T06:29:45.225392+0000","last_deep_scrub":"95'51","last_deep_scrub_stamp":"2024-09-10T06:29:45.225392+0000","last_clean_scrub_stamp":"2024-09-10T06:29:45.225392+0000","objects_scrubbed":8,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:13.287111+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":57,"num_read_kb":43,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:52.867226+0000","last_change":"2024-09-10T06:29:52.867226+0000","last_active":"2024-09-10T06:29:52.867226+0000","last_peered":"2024-09-10T06:29:52.867226+0000","last_clean":"2024-09-10T06:29:52.867226+0000","last_became_active":"2024-09-10T06:26:38.289589+0000","last_became_peered":"2024-09-10T06:26:38.289589+0000","last_unstale":"2024-09-10T06:29:52.867226+0000","last_undegraded":"2024-09-10T06:29:52.867226+0000","last_fullsized":"2024-09-10T06:29:52.867226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:52.867045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:52.867045+0000","last_clean_scrub_stamp":"2024-09-10T06:29:52.867045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:58:52.215147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:54.344710+0000","last_change":"2024-09-10T06:29:54.344710+0000","last_active":"2024-09-10T06:29:54.344710+0000","last_peered":"2024-09-10T06:29:54.344710+0000","last_clean":"2024-09-10T06:29:54.344710+0000","last_became_active":"2024-09-10T06:26:40.332160+0000","last_became_peered":"2024-09-10T06:26:40.332160+0000","last_unstale":"2024-09-10T06:29:54.344710+0000","last_undegraded":"2024-09-10T06:29:54.344710+0000","last_fullsized":"2024-09-10T06:29:54.344710+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:54.344526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:54.344526+0000","last_clean_scrub_stamp":"2024-09-10T06:29:54.344526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:12:42.305939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:59.500313+0000","last_change":"2024-09-10T06:29:59.500313+0000","last_active":"2024-09-10T06:29:59.500313+0000","last_peered":"2024-09-10T06:29:59.500313+0000","last_clean":"2024-09-10T06:29:59.500313+0000","last_became_active":"2024-09-10T06:26:40.333474+0000","last_became_peered":"2024-09-10T06:26:40.333474+0000","last_unstale":"2024-09-10T06:29:59.500313+0000","last_undegraded":"2024-09-10T06:29:59.500313+0000","last_fullsized":"2024-09-10T06:29:59.500313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:59.500109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:59.500109+0000","last_clean_scrub_stamp":"2024-09-10T06:29:59.500109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:40:24.645067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"76'6","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.070380+0000","last_change":"2024-09-10T06:29:33.070380+0000","last_active":"2024-09-10T06:29:33.070380+0000","last_peered":"2024-09-10T06:29:33.070380+0000","last_clean":"2024-09-10T06:29:33.070380+0000","last_became_active":"2024-09-10T06:26:32.272178+0000","last_became_peered":"2024-09-10T06:26:32.272178+0000","last_unstale":"2024-09-10T06:29:33.070380+0000","last_undegraded":"2024-09-10T06:29:33.070380+0000","last_fullsized":"2024-09-10T06:29:33.070380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2024-09-10T06:29:33.070110+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2024-09-10T06:29:33.070110+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.070110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:35:34.270223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"95'16","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.085643+0000","last_change":"2024-09-10T06:29:24.085643+0000","last_active":"2024-09-10T06:29:24.085643+0000","last_peered":"2024-09-10T06:29:24.085643+0000","last_clean":"2024-09-10T06:29:24.085643+0000","last_became_active":"2024-09-10T06:26:30.592753+0000","last_became_peered":"2024-09-10T06:26:30.592753+0000","last_unstale":"2024-09-10T06:29:24.085643+0000","last_undegraded":"2024-09-10T06:29:24.085643+0000","last_fullsized":"2024-09-10T06:29:24.085643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:24.085456+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:24.085456+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.085456+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:15.979005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.849954+0000","last_change":"2024-09-10T06:29:40.849954+0000","last_active":"2024-09-10T06:29:40.849954+0000","last_peered":"2024-09-10T06:29:40.849954+0000","last_clean":"2024-09-10T06:29:40.849954+0000","last_became_active":"2024-09-10T06:26:34.282281+0000","last_became_peered":"2024-09-10T06:26:34.282281+0000","last_unstale":"2024-09-10T06:29:40.849954+0000","last_undegraded":"2024-09-10T06:29:40.849954+0000","last_fullsized":"2024-09-10T06:29:40.849954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:40.849756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:40.849756+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.849756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:31:30.571829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"95'25","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:51.891088+0000","last_change":"2024-09-10T06:29:51.891088+0000","last_active":"2024-09-10T06:29:51.891088+0000","last_peered":"2024-09-10T06:29:51.891088+0000","last_clean":"2024-09-10T06:29:51.891088+0000","last_became_active":"2024-09-10T06:26:36.272386+0000","last_became_peered":"2024-09-10T06:26:36.272386+0000","last_unstale":"2024-09-10T06:29:51.891088+0000","last_undegraded":"2024-09-10T06:29:51.891088+0000","last_fullsized":"2024-09-10T06:29:51.891088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'25","last_scrub_stamp":"2024-09-10T06:29:51.890886+0000","last_deep_scrub":"95'25","last_deep_scrub_stamp":"2024-09-10T06:29:51.890886+0000","last_clean_scrub_stamp":"2024-09-10T06:29:51.890886+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:03.487235+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:56.806982+0000","last_change":"2024-09-10T06:29:56.806982+0000","last_active":"2024-09-10T06:29:56.806982+0000","last_peered":"2024-09-10T06:29:56.806982+0000","last_clean":"2024-09-10T06:29:56.806982+0000","last_became_active":"2024-09-10T06:26:38.296600+0000","last_became_peered":"2024-09-10T06:26:38.296600+0000","last_unstale":"2024-09-10T06:29:56.806982+0000","last_undegraded":"2024-09-10T06:29:56.806982+0000","last_fullsized":"2024-09-10T06:29:56.806982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:56.806800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:56.806800+0000","last_clean_scrub_stamp":"2024-09-10T06:29:56.806800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:40:21.951759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"67'20","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:30:03.720498+0000","last_change":"2024-09-10T06:30:03.720498+0000","last_active":"2024-09-10T06:30:03.720498+0000","last_peered":"2024-09-10T06:30:03.720498+0000","last_clean":"2024-09-10T06:30:03.720498+0000","last_became_active":"2024-09-10T06:26:40.321097+0000","last_became_peered":"2024-09-10T06:26:40.321097+0000","last_unstale":"2024-09-10T06:30:03.720498+0000","last_undegraded":"2024-09-10T06:30:03.720498+0000","last_fullsized":"2024-09-10T06:30:03.720498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'20","last_scrub_stamp":"2024-09-10T06:30:03.720270+0000","last_deep_scrub":"67'20","last_deep_scrub_stamp":"2024-09-10T06:30:03.720270+0000","last_clean_scrub_stamp":"2024-09-10T06:30:03.720270+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:30:26.172697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"67'6","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.672747+0000","last_change":"2024-09-10T06:29:33.672747+0000","last_active":"2024-09-10T06:29:33.672747+0000","last_peered":"2024-09-10T06:29:33.672747+0000","last_clean":"2024-09-10T06:29:33.672747+0000","last_became_active":"2024-09-10T06:26:32.286519+0000","last_became_peered":"2024-09-10T06:26:32.286519+0000","last_unstale":"2024-09-10T06:29:33.672747+0000","last_undegraded":"2024-09-10T06:29:33.672747+0000","last_fullsized":"2024-09-10T06:29:33.672747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T06:29:33.672546+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T06:29:33.672546+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.672546+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:37:42.478459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"95'12","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.328207+0000","last_change":"2024-09-10T06:29:33.328207+0000","last_active":"2024-09-10T06:29:33.328207+0000","last_peered":"2024-09-10T06:29:33.328207+0000","last_clean":"2024-09-10T06:29:33.328207+0000","last_became_active":"2024-09-10T06:26:30.586611+0000","last_became_peered":"2024-09-10T06:26:30.586611+0000","last_unstale":"2024-09-10T06:29:33.328207+0000","last_undegraded":"2024-09-10T06:29:33.328207+0000","last_fullsized":"2024-09-10T06:29:33.328207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:33.328008+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:33.328008+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.328008+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:10.166985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"95'2","reported_seq":227,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.830344+0000","last_change":"2024-09-10T06:29:42.830344+0000","last_active":"2024-09-10T06:29:42.830344+0000","last_peered":"2024-09-10T06:29:42.830344+0000","last_clean":"2024-09-10T06:29:42.830344+0000","last_became_active":"2024-09-10T06:26:34.269875+0000","last_became_peered":"2024-09-10T06:26:34.269875+0000","last_unstale":"2024-09-10T06:29:42.830344+0000","last_undegraded":"2024-09-10T06:29:42.830344+0000","last_fullsized":"2024-09-10T06:29:42.830344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-10T06:29:42.830115+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-10T06:29:42.830115+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.830115+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:30:02.274405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"95'9","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:45.552372+0000","last_change":"2024-09-10T06:29:45.552372+0000","last_active":"2024-09-10T06:29:45.552372+0000","last_peered":"2024-09-10T06:29:45.552372+0000","last_clean":"2024-09-10T06:29:45.552372+0000","last_became_active":"2024-09-10T06:26:36.288355+0000","last_became_peered":"2024-09-10T06:26:36.288355+0000","last_unstale":"2024-09-10T06:29:45.552372+0000","last_undegraded":"2024-09-10T06:29:45.552372+0000","last_fullsized":"2024-09-10T06:29:45.552372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'9","last_scrub_stamp":"2024-09-10T06:29:45.552182+0000","last_deep_scrub":"95'9","last_deep_scrub_stamp":"2024-09-10T06:29:45.552182+0000","last_clean_scrub_stamp":"2024-09-10T06:29:45.552182+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:17.435535+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:52.287058+0000","last_change":"2024-09-10T06:29:52.287058+0000","last_active":"2024-09-10T06:29:52.287058+0000","last_peered":"2024-09-10T06:29:52.287058+0000","last_clean":"2024-09-10T06:29:52.287058+0000","last_became_active":"2024-09-10T06:26:38.301064+0000","last_became_peered":"2024-09-10T06:26:38.301064+0000","last_unstale":"2024-09-10T06:29:52.287058+0000","last_undegraded":"2024-09-10T06:29:52.287058+0000","last_fullsized":"2024-09-10T06:29:52.287058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:52.286817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:52.286817+0000","last_clean_scrub_stamp":"2024-09-10T06:29:52.286817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:32.553380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"64'4","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:58.472336+0000","last_change":"2024-09-10T06:29:58.472336+0000","last_active":"2024-09-10T06:29:58.472336+0000","last_peered":"2024-09-10T06:29:58.472336+0000","last_clean":"2024-09-10T06:29:58.472336+0000","last_became_active":"2024-09-10T06:26:40.321592+0000","last_became_peered":"2024-09-10T06:26:40.321592+0000","last_unstale":"2024-09-10T06:29:58.472336+0000","last_undegraded":"2024-09-10T06:29:58.472336+0000","last_fullsized":"2024-09-10T06:29:58.472336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'4","last_scrub_stamp":"2024-09-10T06:29:58.472103+0000","last_deep_scrub":"64'4","last_deep_scrub_stamp":"2024-09-10T06:29:58.472103+0000","last_clean_scrub_stamp":"2024-09-10T06:29:58.472103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:03:23.265297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"61'4","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:32.090925+0000","last_change":"2024-09-10T06:29:32.090925+0000","last_active":"2024-09-10T06:29:32.090925+0000","last_peered":"2024-09-10T06:29:32.090925+0000","last_clean":"2024-09-10T06:29:32.090925+0000","last_became_active":"2024-09-10T06:26:32.258775+0000","last_became_peered":"2024-09-10T06:26:32.258775+0000","last_unstale":"2024-09-10T06:29:32.090925+0000","last_undegraded":"2024-09-10T06:29:32.090925+0000","last_fullsized":"2024-09-10T06:29:32.090925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"61'4","last_scrub_stamp":"2024-09-10T06:29:32.090697+0000","last_deep_scrub":"61'4","last_deep_scrub_stamp":"2024-09-10T06:29:32.090697+0000","last_clean_scrub_stamp":"2024-09-10T06:29:32.090697+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:44.035503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"95'24","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.352352+0000","last_change":"2024-09-10T06:29:26.352352+0000","last_active":"2024-09-10T06:29:26.352352+0000","last_peered":"2024-09-10T06:29:26.352352+0000","last_clean":"2024-09-10T06:29:26.352352+0000","last_became_active":"2024-09-10T06:26:30.590566+0000","last_became_peered":"2024-09-10T06:26:30.590566+0000","last_unstale":"2024-09-10T06:29:26.352352+0000","last_undegraded":"2024-09-10T06:29:26.352352+0000","last_fullsized":"2024-09-10T06:29:26.352352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:26.352136+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:26.352136+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.352136+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:45:03.191113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":32,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:43.228431+0000","last_change":"2024-09-10T06:29:43.228431+0000","last_active":"2024-09-10T06:29:43.228431+0000","last_peered":"2024-09-10T06:29:43.228431+0000","last_clean":"2024-09-10T06:29:43.228431+0000","last_became_active":"2024-09-10T06:26:34.281008+0000","last_became_peered":"2024-09-10T06:26:34.281008+0000","last_unstale":"2024-09-10T06:29:43.228431+0000","last_undegraded":"2024-09-10T06:29:43.228431+0000","last_fullsized":"2024-09-10T06:29:43.228431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:43.228252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:43.228252+0000","last_clean_scrub_stamp":"2024-09-10T06:29:43.228252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:45.056463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"95'25","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:47.897021+0000","last_change":"2024-09-10T06:29:47.897021+0000","last_active":"2024-09-10T06:29:47.897021+0000","last_peered":"2024-09-10T06:29:47.897021+0000","last_clean":"2024-09-10T06:29:47.897021+0000","last_became_active":"2024-09-10T06:26:36.276248+0000","last_became_peered":"2024-09-10T06:26:36.276248+0000","last_unstale":"2024-09-10T06:29:47.897021+0000","last_undegraded":"2024-09-10T06:29:47.897021+0000","last_fullsized":"2024-09-10T06:29:47.897021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'25","last_scrub_stamp":"2024-09-10T06:29:47.896824+0000","last_deep_scrub":"95'25","last_deep_scrub_stamp":"2024-09-10T06:29:47.896824+0000","last_clean_scrub_stamp":"2024-09-10T06:29:47.896824+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:37:44.042208+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":23,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:44.505168+0000","last_change":"2024-09-10T06:29:44.505168+0000","last_active":"2024-09-10T06:29:44.505168+0000","last_peered":"2024-09-10T06:29:44.505168+0000","last_clean":"2024-09-10T06:29:44.505168+0000","last_became_active":"2024-09-10T06:28:46.343657+0000","last_became_peered":"2024-09-10T06:28:46.343657+0000","last_unstale":"2024-09-10T06:29:44.505168+0000","last_undegraded":"2024-09-10T06:29:44.505168+0000","last_fullsized":"2024-09-10T06:29:44.505168+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:44.504964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:44.504964+0000","last_clean_scrub_stamp":"2024-09-10T06:29:44.504964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:53.155803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:57.325044+0000","last_change":"2024-09-10T06:29:57.325044+0000","last_active":"2024-09-10T06:29:57.325044+0000","last_peered":"2024-09-10T06:29:57.325044+0000","last_clean":"2024-09-10T06:29:57.325044+0000","last_became_active":"2024-09-10T06:26:40.330707+0000","last_became_peered":"2024-09-10T06:26:40.330707+0000","last_unstale":"2024-09-10T06:29:57.325044+0000","last_undegraded":"2024-09-10T06:29:57.325044+0000","last_fullsized":"2024-09-10T06:29:57.325044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:57.324862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:57.324862+0000","last_clean_scrub_stamp":"2024-09-10T06:29:57.324862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:08.995690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.817949+0000","last_change":"2024-09-10T06:29:41.817949+0000","last_active":"2024-09-10T06:29:41.817949+0000","last_peered":"2024-09-10T06:29:41.817949+0000","last_clean":"2024-09-10T06:29:41.817949+0000","last_became_active":"2024-09-10T06:26:32.265705+0000","last_became_peered":"2024-09-10T06:26:32.265705+0000","last_unstale":"2024-09-10T06:29:41.817949+0000","last_undegraded":"2024-09-10T06:29:41.817949+0000","last_fullsized":"2024-09-10T06:29:41.817949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:41.817756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:41.817756+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.817756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:05.836921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"95'18","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:24.575589+0000","last_change":"2024-09-10T06:29:24.575589+0000","last_active":"2024-09-10T06:29:24.575589+0000","last_peered":"2024-09-10T06:29:24.575589+0000","last_clean":"2024-09-10T06:29:24.575589+0000","last_became_active":"2024-09-10T06:26:30.593326+0000","last_became_peered":"2024-09-10T06:26:30.593326+0000","last_unstale":"2024-09-10T06:29:24.575589+0000","last_undegraded":"2024-09-10T06:29:24.575589+0000","last_fullsized":"2024-09-10T06:29:24.575589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:24.575459+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:24.575459+0000","last_clean_scrub_stamp":"2024-09-10T06:29:24.575459+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:21.110383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.382052+0000","last_change":"2024-09-10T06:29:39.382052+0000","last_active":"2024-09-10T06:29:39.382052+0000","last_peered":"2024-09-10T06:29:39.382052+0000","last_clean":"2024-09-10T06:29:39.382052+0000","last_became_active":"2024-09-10T06:26:34.281147+0000","last_became_peered":"2024-09-10T06:26:34.281147+0000","last_unstale":"2024-09-10T06:29:39.382052+0000","last_undegraded":"2024-09-10T06:29:39.382052+0000","last_fullsized":"2024-09-10T06:29:39.382052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:39.381863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:39.381863+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.381863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:14.041644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"95'22","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:48.202474+0000","last_change":"2024-09-10T06:29:48.202474+0000","last_active":"2024-09-10T06:29:48.202474+0000","last_peered":"2024-09-10T06:29:48.202474+0000","last_clean":"2024-09-10T06:29:48.202474+0000","last_became_active":"2024-09-10T06:26:36.297372+0000","last_became_peered":"2024-09-10T06:26:36.297372+0000","last_unstale":"2024-09-10T06:29:48.202474+0000","last_undegraded":"2024-09-10T06:29:48.202474+0000","last_fullsized":"2024-09-10T06:29:48.202474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:48.202288+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:48.202288+0000","last_clean_scrub_stamp":"2024-09-10T06:29:48.202288+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:56.682018+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:52.452376+0000","last_change":"2024-09-10T06:29:52.452376+0000","last_active":"2024-09-10T06:29:52.452376+0000","last_peered":"2024-09-10T06:29:52.452376+0000","last_clean":"2024-09-10T06:29:52.452376+0000","last_became_active":"2024-09-10T06:26:38.300580+0000","last_became_peered":"2024-09-10T06:26:38.300580+0000","last_unstale":"2024-09-10T06:29:52.452376+0000","last_undegraded":"2024-09-10T06:29:52.452376+0000","last_fullsized":"2024-09-10T06:29:52.452376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:52.452191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:52.452191+0000","last_clean_scrub_stamp":"2024-09-10T06:29:52.452191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:49:14.622673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"67'10","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.421377+0000","last_change":"2024-09-10T06:29:35.421377+0000","last_active":"2024-09-10T06:29:35.421377+0000","last_peered":"2024-09-10T06:29:35.421377+0000","last_clean":"2024-09-10T06:29:35.421377+0000","last_became_active":"2024-09-10T06:26:32.284457+0000","last_became_peered":"2024-09-10T06:26:32.284457+0000","last_unstale":"2024-09-10T06:29:35.421377+0000","last_undegraded":"2024-09-10T06:29:35.421377+0000","last_fullsized":"2024-09-10T06:29:35.421377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T06:29:35.421160+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T06:29:35.421160+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.421160+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:24:45.636212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"95'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.149600+0000","last_change":"2024-09-10T06:29:29.149600+0000","last_active":"2024-09-10T06:29:29.149600+0000","last_peered":"2024-09-10T06:29:29.149600+0000","last_clean":"2024-09-10T06:29:29.149600+0000","last_became_active":"2024-09-10T06:26:30.571377+0000","last_became_peered":"2024-09-10T06:26:30.571377+0000","last_unstale":"2024-09-10T06:29:29.149600+0000","last_undegraded":"2024-09-10T06:29:29.149600+0000","last_fullsized":"2024-09-10T06:29:29.149600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:29.149420+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:29.149420+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.149420+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:12:30.977630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:44.552658+0000","last_change":"2024-09-10T06:29:44.552658+0000","last_active":"2024-09-10T06:29:44.552658+0000","last_peered":"2024-09-10T06:29:44.552658+0000","last_clean":"2024-09-10T06:29:44.552658+0000","last_became_active":"2024-09-10T06:26:34.268677+0000","last_became_peered":"2024-09-10T06:26:34.268677+0000","last_unstale":"2024-09-10T06:29:44.552658+0000","last_undegraded":"2024-09-10T06:29:44.552658+0000","last_fullsized":"2024-09-10T06:29:44.552658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:44.552483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:44.552483+0000","last_clean_scrub_stamp":"2024-09-10T06:29:44.552483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:25:00.261839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"95'33","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:44.780275+0000","last_change":"2024-09-10T06:29:44.780275+0000","last_active":"2024-09-10T06:29:44.780275+0000","last_peered":"2024-09-10T06:29:44.780275+0000","last_clean":"2024-09-10T06:29:44.780275+0000","last_became_active":"2024-09-10T06:26:36.299645+0000","last_became_peered":"2024-09-10T06:26:36.299645+0000","last_unstale":"2024-09-10T06:29:44.780275+0000","last_undegraded":"2024-09-10T06:29:44.780275+0000","last_fullsized":"2024-09-10T06:29:44.780275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'33","last_scrub_stamp":"2024-09-10T06:29:44.780200+0000","last_deep_scrub":"95'33","last_deep_scrub_stamp":"2024-09-10T06:29:44.780200+0000","last_clean_scrub_stamp":"2024-09-10T06:29:44.780200+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:55.081037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:51.385652+0000","last_change":"2024-09-10T06:29:51.385652+0000","last_active":"2024-09-10T06:29:51.385652+0000","last_peered":"2024-09-10T06:29:51.385652+0000","last_clean":"2024-09-10T06:29:51.385652+0000","last_became_active":"2024-09-10T06:26:38.298414+0000","last_became_peered":"2024-09-10T06:26:38.298414+0000","last_unstale":"2024-09-10T06:29:51.385652+0000","last_undegraded":"2024-09-10T06:29:51.385652+0000","last_fullsized":"2024-09-10T06:29:51.385652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:51.385463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:51.385463+0000","last_clean_scrub_stamp":"2024-09-10T06:29:51.385463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:29.589652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'2","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:30:02.768122+0000","last_change":"2024-09-10T06:30:02.768122+0000","last_active":"2024-09-10T06:30:02.768122+0000","last_peered":"2024-09-10T06:30:02.768122+0000","last_clean":"2024-09-10T06:30:02.768122+0000","last_became_active":"2024-09-10T06:26:40.312026+0000","last_became_peered":"2024-09-10T06:26:40.312026+0000","last_unstale":"2024-09-10T06:30:02.768122+0000","last_undegraded":"2024-09-10T06:30:02.768122+0000","last_fullsized":"2024-09-10T06:30:02.768122+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-10T06:30:02.767923+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-10T06:30:02.767923+0000","last_clean_scrub_stamp":"2024-09-10T06:30:02.767923+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:01:13.898493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.556968+0000","last_change":"2024-09-10T06:29:35.556968+0000","last_active":"2024-09-10T06:29:35.556968+0000","last_peered":"2024-09-10T06:29:35.556968+0000","last_clean":"2024-09-10T06:29:35.556968+0000","last_became_active":"2024-09-10T06:26:32.266682+0000","last_became_peered":"2024-09-10T06:26:32.266682+0000","last_unstale":"2024-09-10T06:29:35.556968+0000","last_undegraded":"2024-09-10T06:29:35.556968+0000","last_fullsized":"2024-09-10T06:29:35.556968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:35.556785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:35.556785+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.556785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:33:52.129101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'28","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.729826+0000","last_change":"2024-09-10T06:29:25.729826+0000","last_active":"2024-09-10T06:29:25.729826+0000","last_peered":"2024-09-10T06:29:25.729826+0000","last_clean":"2024-09-10T06:29:25.729826+0000","last_became_active":"2024-09-10T06:26:30.578692+0000","last_became_peered":"2024-09-10T06:26:30.578692+0000","last_unstale":"2024-09-10T06:29:25.729826+0000","last_undegraded":"2024-09-10T06:29:25.729826+0000","last_fullsized":"2024-09-10T06:29:25.729826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'28","last_scrub_stamp":"2024-09-10T06:29:25.729659+0000","last_deep_scrub":"95'28","last_deep_scrub_stamp":"2024-09-10T06:29:25.729659+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.729659+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:25:17.803992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":36,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"95'2","reported_seq":223,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.384665+0000","last_change":"2024-09-10T06:29:40.384665+0000","last_active":"2024-09-10T06:29:40.384665+0000","last_peered":"2024-09-10T06:29:40.384665+0000","last_clean":"2024-09-10T06:29:40.384665+0000","last_became_active":"2024-09-10T06:26:34.281167+0000","last_became_peered":"2024-09-10T06:26:34.281167+0000","last_unstale":"2024-09-10T06:29:40.384665+0000","last_undegraded":"2024-09-10T06:29:40.384665+0000","last_fullsized":"2024-09-10T06:29:40.384665+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-10T06:29:40.384488+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-10T06:29:40.384488+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.384488+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:32:40.370647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"95'33","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:50.213266+0000","last_change":"2024-09-10T06:29:50.213266+0000","last_active":"2024-09-10T06:29:50.213266+0000","last_peered":"2024-09-10T06:29:50.213266+0000","last_clean":"2024-09-10T06:29:50.213266+0000","last_became_active":"2024-09-10T06:26:36.300501+0000","last_became_peered":"2024-09-10T06:26:36.300501+0000","last_unstale":"2024-09-10T06:29:50.213266+0000","last_undegraded":"2024-09-10T06:29:50.213266+0000","last_fullsized":"2024-09-10T06:29:50.213266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'33","last_scrub_stamp":"2024-09-10T06:29:50.213080+0000","last_deep_scrub":"95'33","last_deep_scrub_stamp":"2024-09-10T06:29:50.213080+0000","last_clean_scrub_stamp":"2024-09-10T06:29:50.213080+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:58.392073+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:47.787447+0000","last_change":"2024-09-10T06:29:47.787447+0000","last_active":"2024-09-10T06:29:47.787447+0000","last_peered":"2024-09-10T06:29:47.787447+0000","last_clean":"2024-09-10T06:29:47.787447+0000","last_became_active":"2024-09-10T06:26:38.303318+0000","last_became_peered":"2024-09-10T06:26:38.303318+0000","last_unstale":"2024-09-10T06:29:47.787447+0000","last_undegraded":"2024-09-10T06:29:47.787447+0000","last_fullsized":"2024-09-10T06:29:47.787447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:47.787262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:47.787262+0000","last_clean_scrub_stamp":"2024-09-10T06:29:47.787262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:02:06.828204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"67'10","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:49.436499+0000","last_change":"2024-09-10T06:29:49.436499+0000","last_active":"2024-09-10T06:29:49.436499+0000","last_peered":"2024-09-10T06:29:49.436499+0000","last_clean":"2024-09-10T06:29:49.436499+0000","last_became_active":"2024-09-10T06:26:40.317695+0000","last_became_peered":"2024-09-10T06:26:40.317695+0000","last_unstale":"2024-09-10T06:29:49.436499+0000","last_undegraded":"2024-09-10T06:29:49.436499+0000","last_fullsized":"2024-09-10T06:29:49.436499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T06:29:49.436324+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T06:29:49.436324+0000","last_clean_scrub_stamp":"2024-09-10T06:29:49.436324+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:12:17.338968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":19,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.900641+0000","last_change":"2024-09-10T06:29:38.900641+0000","last_active":"2024-09-10T06:29:38.900641+0000","last_peered":"2024-09-10T06:29:38.900641+0000","last_clean":"2024-09-10T06:29:38.900641+0000","last_became_active":"2024-09-10T06:26:32.275805+0000","last_became_peered":"2024-09-10T06:26:32.275805+0000","last_unstale":"2024-09-10T06:29:38.900641+0000","last_undegraded":"2024-09-10T06:29:38.900641+0000","last_fullsized":"2024-09-10T06:29:38.900641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:38.900412+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:38.900412+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.900412+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:52:18.879138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"95'14","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.038073+0000","last_change":"2024-09-10T06:29:26.038073+0000","last_active":"2024-09-10T06:29:26.038073+0000","last_peered":"2024-09-10T06:29:26.038073+0000","last_clean":"2024-09-10T06:29:26.038073+0000","last_became_active":"2024-09-10T06:26:30.567937+0000","last_became_peered":"2024-09-10T06:26:30.567937+0000","last_unstale":"2024-09-10T06:29:26.038073+0000","last_undegraded":"2024-09-10T06:29:26.038073+0000","last_fullsized":"2024-09-10T06:29:26.038073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:26.037883+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:26.037883+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.037883+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:55:00.697665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:47.192722+0000","last_change":"2024-09-10T06:29:47.192722+0000","last_active":"2024-09-10T06:29:47.192722+0000","last_peered":"2024-09-10T06:29:47.192722+0000","last_clean":"2024-09-10T06:29:47.192722+0000","last_became_active":"2024-09-10T06:26:34.262443+0000","last_became_peered":"2024-09-10T06:26:34.262443+0000","last_unstale":"2024-09-10T06:29:47.192722+0000","last_undegraded":"2024-09-10T06:29:47.192722+0000","last_fullsized":"2024-09-10T06:29:47.192722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:47.192532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:47.192532+0000","last_clean_scrub_stamp":"2024-09-10T06:29:47.192532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:55.672262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"95'26","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:53.873910+0000","last_change":"2024-09-10T06:29:53.873910+0000","last_active":"2024-09-10T06:29:53.873910+0000","last_peered":"2024-09-10T06:29:53.873910+0000","last_clean":"2024-09-10T06:29:53.873910+0000","last_became_active":"2024-09-10T06:26:36.292149+0000","last_became_peered":"2024-09-10T06:26:36.292149+0000","last_unstale":"2024-09-10T06:29:53.873910+0000","last_undegraded":"2024-09-10T06:29:53.873910+0000","last_fullsized":"2024-09-10T06:29:53.873910+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-10T06:29:53.873717+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-10T06:29:53.873717+0000","last_clean_scrub_stamp":"2024-09-10T06:29:53.873717+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:08.931175+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:46.782379+0000","last_change":"2024-09-10T06:29:46.782379+0000","last_active":"2024-09-10T06:29:46.782379+0000","last_peered":"2024-09-10T06:29:46.782379+0000","last_clean":"2024-09-10T06:29:46.782379+0000","last_became_active":"2024-09-10T06:26:38.289306+0000","last_became_peered":"2024-09-10T06:26:38.289306+0000","last_unstale":"2024-09-10T06:29:46.782379+0000","last_undegraded":"2024-09-10T06:29:46.782379+0000","last_fullsized":"2024-09-10T06:29:46.782379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:46.782189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:46.782189+0000","last_clean_scrub_stamp":"2024-09-10T06:29:46.782189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:33:39.891565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:55.371112+0000","last_change":"2024-09-10T06:29:55.371112+0000","last_active":"2024-09-10T06:29:55.371112+0000","last_peered":"2024-09-10T06:29:55.371112+0000","last_clean":"2024-09-10T06:29:55.371112+0000","last_became_active":"2024-09-10T06:26:40.326888+0000","last_became_peered":"2024-09-10T06:26:40.326888+0000","last_unstale":"2024-09-10T06:29:55.371112+0000","last_undegraded":"2024-09-10T06:29:55.371112+0000","last_fullsized":"2024-09-10T06:29:55.371112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:55.370885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:55.370885+0000","last_clean_scrub_stamp":"2024-09-10T06:29:55.370885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:47.062744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"62'4","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.534235+0000","last_change":"2024-09-10T06:29:28.534235+0000","last_active":"2024-09-10T06:29:28.534235+0000","last_peered":"2024-09-10T06:29:28.534235+0000","last_clean":"2024-09-10T06:29:28.534235+0000","last_became_active":"2024-09-10T06:26:32.274395+0000","last_became_peered":"2024-09-10T06:26:32.274395+0000","last_unstale":"2024-09-10T06:29:28.534235+0000","last_undegraded":"2024-09-10T06:29:28.534235+0000","last_fullsized":"2024-09-10T06:29:28.534235+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-10T06:29:28.533919+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-10T06:29:28.533919+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.533919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:34:22.535590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"95'14","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.586596+0000","last_change":"2024-09-10T06:29:25.586596+0000","last_active":"2024-09-10T06:29:25.586596+0000","last_peered":"2024-09-10T06:29:25.586596+0000","last_clean":"2024-09-10T06:29:25.586596+0000","last_became_active":"2024-09-10T06:26:30.594058+0000","last_became_peered":"2024-09-10T06:26:30.594058+0000","last_unstale":"2024-09-10T06:29:25.586596+0000","last_undegraded":"2024-09-10T06:29:25.586596+0000","last_fullsized":"2024-09-10T06:29:25.586596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:25.586401+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:25.586401+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.586401+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:32.336377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:43.817154+0000","last_change":"2024-09-10T06:29:43.817154+0000","last_active":"2024-09-10T06:29:43.817154+0000","last_peered":"2024-09-10T06:29:43.817154+0000","last_clean":"2024-09-10T06:29:43.817154+0000","last_became_active":"2024-09-10T06:26:34.278871+0000","last_became_peered":"2024-09-10T06:26:34.278871+0000","last_unstale":"2024-09-10T06:29:43.817154+0000","last_undegraded":"2024-09-10T06:29:43.817154+0000","last_fullsized":"2024-09-10T06:29:43.817154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:43.816970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:43.816970+0000","last_clean_scrub_stamp":"2024-09-10T06:29:43.816970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:57:22.145075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"95'18","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:52.204269+0000","last_change":"2024-09-10T06:29:52.204269+0000","last_active":"2024-09-10T06:29:52.204269+0000","last_peered":"2024-09-10T06:29:52.204269+0000","last_clean":"2024-09-10T06:29:52.204269+0000","last_became_active":"2024-09-10T06:26:36.290265+0000","last_became_peered":"2024-09-10T06:26:36.290265+0000","last_unstale":"2024-09-10T06:29:52.204269+0000","last_undegraded":"2024-09-10T06:29:52.204269+0000","last_fullsized":"2024-09-10T06:29:52.204269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:52.204043+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:52.204043+0000","last_clean_scrub_stamp":"2024-09-10T06:29:52.204043+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:11.403350+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":13,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1348,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'105","reported_seq":282,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:47.498349+0000","last_change":"2024-09-10T06:29:47.498349+0000","last_active":"2024-09-10T06:29:47.498349+0000","last_peered":"2024-09-10T06:29:47.498349+0000","last_clean":"2024-09-10T06:29:47.498349+0000","last_became_active":"2024-09-10T06:26:38.288791+0000","last_became_peered":"2024-09-10T06:26:38.288791+0000","last_unstale":"2024-09-10T06:29:47.498349+0000","last_undegraded":"2024-09-10T06:29:47.498349+0000","last_fullsized":"2024-09-10T06:29:47.498349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'105","last_scrub_stamp":"2024-09-10T06:29:47.498168+0000","last_deep_scrub":"95'105","last_deep_scrub_stamp":"2024-09-10T06:29:47.498168+0000","last_clean_scrub_stamp":"2024-09-10T06:29:47.498168+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:54:11.322516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"76'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:55.300095+0000","last_change":"2024-09-10T06:29:55.300095+0000","last_active":"2024-09-10T06:29:55.300095+0000","last_peered":"2024-09-10T06:29:55.300095+0000","last_clean":"2024-09-10T06:29:55.300095+0000","last_became_active":"2024-09-10T06:26:40.335771+0000","last_became_peered":"2024-09-10T06:26:40.335771+0000","last_unstale":"2024-09-10T06:29:55.300095+0000","last_undegraded":"2024-09-10T06:29:55.300095+0000","last_fullsized":"2024-09-10T06:29:55.300095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:55.299881+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:55.299881+0000","last_clean_scrub_stamp":"2024-09-10T06:29:55.299881+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:25:11.009236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.077261+0000","last_change":"2024-09-10T06:29:36.077261+0000","last_active":"2024-09-10T06:29:36.077261+0000","last_peered":"2024-09-10T06:29:36.077261+0000","last_clean":"2024-09-10T06:29:36.077261+0000","last_became_active":"2024-09-10T06:26:32.261250+0000","last_became_peered":"2024-09-10T06:26:32.261250+0000","last_unstale":"2024-09-10T06:29:36.077261+0000","last_undegraded":"2024-09-10T06:29:36.077261+0000","last_fullsized":"2024-09-10T06:29:36.077261+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:36.077082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:36.077082+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.077082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:34.084912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"95'16","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.341624+0000","last_change":"2024-09-10T06:29:28.341624+0000","last_active":"2024-09-10T06:29:28.341624+0000","last_peered":"2024-09-10T06:29:28.341624+0000","last_clean":"2024-09-10T06:29:28.341624+0000","last_became_active":"2024-09-10T06:26:30.603175+0000","last_became_peered":"2024-09-10T06:26:30.603175+0000","last_unstale":"2024-09-10T06:29:28.341624+0000","last_undegraded":"2024-09-10T06:29:28.341624+0000","last_fullsized":"2024-09-10T06:29:28.341624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:28.341424+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:28.341424+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.341424+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:54:41.882711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:44.236526+0000","last_change":"2024-09-10T06:29:44.236526+0000","last_active":"2024-09-10T06:29:44.236526+0000","last_peered":"2024-09-10T06:29:44.236526+0000","last_clean":"2024-09-10T06:29:44.236526+0000","last_became_active":"2024-09-10T06:26:34.285169+0000","last_became_peered":"2024-09-10T06:26:34.285169+0000","last_unstale":"2024-09-10T06:29:44.236526+0000","last_undegraded":"2024-09-10T06:29:44.236526+0000","last_fullsized":"2024-09-10T06:29:44.236526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:44.236321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:44.236321+0000","last_clean_scrub_stamp":"2024-09-10T06:29:44.236321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:52.157818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"95'31","reported_seq":193,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:49.310270+0000","last_change":"2024-09-10T06:29:49.310270+0000","last_active":"2024-09-10T06:29:49.310270+0000","last_peered":"2024-09-10T06:29:49.310270+0000","last_clean":"2024-09-10T06:29:49.310270+0000","last_became_active":"2024-09-10T06:26:36.288780+0000","last_became_peered":"2024-09-10T06:26:36.288780+0000","last_unstale":"2024-09-10T06:29:49.310270+0000","last_undegraded":"2024-09-10T06:29:49.310270+0000","last_fullsized":"2024-09-10T06:29:49.310270+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'31","last_scrub_stamp":"2024-09-10T06:29:49.310157+0000","last_deep_scrub":"95'31","last_deep_scrub_stamp":"2024-09-10T06:29:49.310157+0000","last_clean_scrub_stamp":"2024-09-10T06:29:49.310157+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:11.501092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":23,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:56.516640+0000","last_change":"2024-09-10T06:29:56.516640+0000","last_active":"2024-09-10T06:29:56.516640+0000","last_peered":"2024-09-10T06:29:56.516640+0000","last_clean":"2024-09-10T06:29:56.516640+0000","last_became_active":"2024-09-10T06:26:38.292185+0000","last_became_peered":"2024-09-10T06:26:38.292185+0000","last_unstale":"2024-09-10T06:29:56.516640+0000","last_undegraded":"2024-09-10T06:29:56.516640+0000","last_fullsized":"2024-09-10T06:29:56.516640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:56.516467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:56.516467+0000","last_clean_scrub_stamp":"2024-09-10T06:29:56.516467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:11.573925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"64'10","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:57.297701+0000","last_change":"2024-09-10T06:29:57.297701+0000","last_active":"2024-09-10T06:29:57.297701+0000","last_peered":"2024-09-10T06:29:57.297701+0000","last_clean":"2024-09-10T06:29:57.297701+0000","last_became_active":"2024-09-10T06:26:40.335339+0000","last_became_peered":"2024-09-10T06:26:40.335339+0000","last_unstale":"2024-09-10T06:29:57.297701+0000","last_undegraded":"2024-09-10T06:29:57.297701+0000","last_fullsized":"2024-09-10T06:29:57.297701+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'10","last_scrub_stamp":"2024-09-10T06:29:57.297518+0000","last_deep_scrub":"64'10","last_deep_scrub_stamp":"2024-09-10T06:29:57.297518+0000","last_clean_scrub_stamp":"2024-09-10T06:29:57.297518+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:20:08.820291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":29,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"76'4","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.087554+0000","last_change":"2024-09-10T06:29:35.087554+0000","last_active":"2024-09-10T06:29:35.087554+0000","last_peered":"2024-09-10T06:29:35.087554+0000","last_clean":"2024-09-10T06:29:35.087554+0000","last_became_active":"2024-09-10T06:26:32.262041+0000","last_became_peered":"2024-09-10T06:26:32.262041+0000","last_unstale":"2024-09-10T06:29:35.087554+0000","last_undegraded":"2024-09-10T06:29:35.087554+0000","last_fullsized":"2024-09-10T06:29:35.087554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:35.087363+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:35.087363+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.087363+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:40.057300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"95'14","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:22.516504+0000","last_change":"2024-09-10T06:29:22.516444+0000","last_active":"2024-09-10T06:29:22.516504+0000","last_peered":"2024-09-10T06:29:22.516504+0000","last_clean":"2024-09-10T06:29:22.516504+0000","last_became_active":"2024-09-10T06:27:08.868399+0000","last_became_peered":"2024-09-10T06:27:08.868399+0000","last_unstale":"2024-09-10T06:29:22.516504+0000","last_undegraded":"2024-09-10T06:29:22.516504+0000","last_fullsized":"2024-09-10T06:29:22.516504+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:22.516374+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:22.516374+0000","last_clean_scrub_stamp":"2024-09-10T06:29:22.516374+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:49.935970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:45.218142+0000","last_change":"2024-09-10T06:29:45.218142+0000","last_active":"2024-09-10T06:29:45.218142+0000","last_peered":"2024-09-10T06:29:45.218142+0000","last_clean":"2024-09-10T06:29:45.218142+0000","last_became_active":"2024-09-10T06:26:34.281777+0000","last_became_peered":"2024-09-10T06:26:34.281777+0000","last_unstale":"2024-09-10T06:29:45.218142+0000","last_undegraded":"2024-09-10T06:29:45.218142+0000","last_fullsized":"2024-09-10T06:29:45.218142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:45.217937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:45.217937+0000","last_clean_scrub_stamp":"2024-09-10T06:29:45.217937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:25.484500+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"95'21","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:46.524827+0000","last_change":"2024-09-10T06:29:46.524827+0000","last_active":"2024-09-10T06:29:46.524827+0000","last_peered":"2024-09-10T06:29:46.524827+0000","last_clean":"2024-09-10T06:29:46.524827+0000","last_became_active":"2024-09-10T06:26:36.284470+0000","last_became_peered":"2024-09-10T06:26:36.284470+0000","last_unstale":"2024-09-10T06:29:46.524827+0000","last_undegraded":"2024-09-10T06:29:46.524827+0000","last_fullsized":"2024-09-10T06:29:46.524827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'21","last_scrub_stamp":"2024-09-10T06:29:46.524617+0000","last_deep_scrub":"95'21","last_deep_scrub_stamp":"2024-09-10T06:29:46.524617+0000","last_clean_scrub_stamp":"2024-09-10T06:29:46.524617+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:13:10.543782+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:45.480359+0000","last_change":"2024-09-10T06:29:45.480359+0000","last_active":"2024-09-10T06:29:45.480359+0000","last_peered":"2024-09-10T06:29:45.480359+0000","last_clean":"2024-09-10T06:29:45.480359+0000","last_became_active":"2024-09-10T06:26:38.302606+0000","last_became_peered":"2024-09-10T06:26:38.302606+0000","last_unstale":"2024-09-10T06:29:45.480359+0000","last_undegraded":"2024-09-10T06:29:45.480359+0000","last_fullsized":"2024-09-10T06:29:45.480359+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:45.480176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:45.480176+0000","last_clean_scrub_stamp":"2024-09-10T06:29:45.480176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:44:03.360800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"76'13","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:30:01.798097+0000","last_change":"2024-09-10T06:30:01.798097+0000","last_active":"2024-09-10T06:30:01.798097+0000","last_peered":"2024-09-10T06:30:01.798097+0000","last_clean":"2024-09-10T06:30:01.798097+0000","last_became_active":"2024-09-10T06:26:40.310414+0000","last_became_peered":"2024-09-10T06:26:40.310414+0000","last_unstale":"2024-09-10T06:30:01.798097+0000","last_undegraded":"2024-09-10T06:30:01.798097+0000","last_fullsized":"2024-09-10T06:30:01.798097+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'13","last_scrub_stamp":"2024-09-10T06:30:01.797872+0000","last_deep_scrub":"76'13","last_deep_scrub_stamp":"2024-09-10T06:30:01.797872+0000","last_clean_scrub_stamp":"2024-09-10T06:30:01.797872+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:57.662793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:33.087455+0000","last_change":"2024-09-10T06:29:33.087455+0000","last_active":"2024-09-10T06:29:33.087455+0000","last_peered":"2024-09-10T06:29:33.087455+0000","last_clean":"2024-09-10T06:29:33.087455+0000","last_became_active":"2024-09-10T06:26:32.262469+0000","last_became_peered":"2024-09-10T06:26:32.262469+0000","last_unstale":"2024-09-10T06:29:33.087455+0000","last_undegraded":"2024-09-10T06:29:33.087455+0000","last_fullsized":"2024-09-10T06:29:33.087455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:33.087265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:33.087265+0000","last_clean_scrub_stamp":"2024-09-10T06:29:33.087265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:40:32.570874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"95'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.076609+0000","last_change":"2024-09-10T06:29:26.076609+0000","last_active":"2024-09-10T06:29:26.076609+0000","last_peered":"2024-09-10T06:29:26.076609+0000","last_clean":"2024-09-10T06:29:26.076609+0000","last_became_active":"2024-09-10T06:26:30.601672+0000","last_became_peered":"2024-09-10T06:26:30.601672+0000","last_unstale":"2024-09-10T06:29:26.076609+0000","last_undegraded":"2024-09-10T06:29:26.076609+0000","last_fullsized":"2024-09-10T06:29:26.076609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:26.076397+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:26.076397+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.076397+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:47:07.806859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":153,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:46.182010+0000","last_change":"2024-09-10T06:29:46.182010+0000","last_active":"2024-09-10T06:29:46.182010+0000","last_peered":"2024-09-10T06:29:46.182010+0000","last_clean":"2024-09-10T06:29:46.182010+0000","last_became_active":"2024-09-10T06:26:34.276197+0000","last_became_peered":"2024-09-10T06:26:34.276197+0000","last_unstale":"2024-09-10T06:29:46.182010+0000","last_undegraded":"2024-09-10T06:29:46.182010+0000","last_fullsized":"2024-09-10T06:29:46.182010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:46.181774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:46.181774+0000","last_clean_scrub_stamp":"2024-09-10T06:29:46.181774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:58.126580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"95'16","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:50.913561+0000","last_change":"2024-09-10T06:29:50.913561+0000","last_active":"2024-09-10T06:29:50.913561+0000","last_peered":"2024-09-10T06:29:50.913561+0000","last_clean":"2024-09-10T06:29:50.913561+0000","last_became_active":"2024-09-10T06:26:36.296615+0000","last_became_peered":"2024-09-10T06:26:36.296615+0000","last_unstale":"2024-09-10T06:29:50.913561+0000","last_undegraded":"2024-09-10T06:29:50.913561+0000","last_fullsized":"2024-09-10T06:29:50.913561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:50.913371+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:50.913371+0000","last_clean_scrub_stamp":"2024-09-10T06:29:50.913371+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:36:16.544717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:55.244712+0000","last_change":"2024-09-10T06:29:55.244712+0000","last_active":"2024-09-10T06:29:55.244712+0000","last_peered":"2024-09-10T06:29:55.244712+0000","last_clean":"2024-09-10T06:29:55.244712+0000","last_became_active":"2024-09-10T06:26:38.288055+0000","last_became_peered":"2024-09-10T06:26:38.288055+0000","last_unstale":"2024-09-10T06:29:55.244712+0000","last_undegraded":"2024-09-10T06:29:55.244712+0000","last_fullsized":"2024-09-10T06:29:55.244712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:55.244536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:55.244536+0000","last_clean_scrub_stamp":"2024-09-10T06:29:55.244536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:17.435471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:56.296532+0000","last_change":"2024-09-10T06:29:56.296532+0000","last_active":"2024-09-10T06:29:56.296532+0000","last_peered":"2024-09-10T06:29:56.296532+0000","last_clean":"2024-09-10T06:29:56.296532+0000","last_became_active":"2024-09-10T06:26:40.317244+0000","last_became_peered":"2024-09-10T06:26:40.317244+0000","last_unstale":"2024-09-10T06:29:56.296532+0000","last_undegraded":"2024-09-10T06:29:56.296532+0000","last_fullsized":"2024-09-10T06:29:56.296532+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:56.296238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:56.296238+0000","last_clean_scrub_stamp":"2024-09-10T06:29:56.296238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:18.487172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"76'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.104229+0000","last_change":"2024-09-10T06:29:34.104229+0000","last_active":"2024-09-10T06:29:34.104229+0000","last_peered":"2024-09-10T06:29:34.104229+0000","last_clean":"2024-09-10T06:29:34.104229+0000","last_became_active":"2024-09-10T06:26:32.274812+0000","last_became_peered":"2024-09-10T06:26:32.274812+0000","last_unstale":"2024-09-10T06:29:34.104229+0000","last_undegraded":"2024-09-10T06:29:34.104229+0000","last_fullsized":"2024-09-10T06:29:34.104229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:34.104024+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:34.104024+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.104024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:34:30.638947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"95'20","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.561214+0000","last_change":"2024-09-10T06:29:28.561214+0000","last_active":"2024-09-10T06:29:28.561214+0000","last_peered":"2024-09-10T06:29:28.561214+0000","last_clean":"2024-09-10T06:29:28.561214+0000","last_became_active":"2024-09-10T06:26:30.593687+0000","last_became_peered":"2024-09-10T06:26:30.593687+0000","last_unstale":"2024-09-10T06:29:28.561214+0000","last_undegraded":"2024-09-10T06:29:28.561214+0000","last_fullsized":"2024-09-10T06:29:28.561214+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:28.561010+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:28.561010+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.561010+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:35.631710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"95'2","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.804848+0000","last_change":"2024-09-10T06:29:39.804848+0000","last_active":"2024-09-10T06:29:39.804848+0000","last_peered":"2024-09-10T06:29:39.804848+0000","last_clean":"2024-09-10T06:29:39.804848+0000","last_became_active":"2024-09-10T06:26:34.282931+0000","last_became_peered":"2024-09-10T06:26:34.282931+0000","last_unstale":"2024-09-10T06:29:39.804848+0000","last_undegraded":"2024-09-10T06:29:39.804848+0000","last_fullsized":"2024-09-10T06:29:39.804848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-10T06:29:39.804639+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-10T06:29:39.804639+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.804639+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:58:02.780607+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"95'22","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:51.220667+0000","last_change":"2024-09-10T06:29:51.220667+0000","last_active":"2024-09-10T06:29:51.220667+0000","last_peered":"2024-09-10T06:29:51.220667+0000","last_clean":"2024-09-10T06:29:51.220667+0000","last_became_active":"2024-09-10T06:26:36.289033+0000","last_became_peered":"2024-09-10T06:26:36.289033+0000","last_unstale":"2024-09-10T06:29:51.220667+0000","last_undegraded":"2024-09-10T06:29:51.220667+0000","last_fullsized":"2024-09-10T06:29:51.220667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:51.220458+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:51.220458+0000","last_clean_scrub_stamp":"2024-09-10T06:29:51.220458+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:31.487022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:53.425744+0000","last_change":"2024-09-10T06:29:53.425744+0000","last_active":"2024-09-10T06:29:53.425744+0000","last_peered":"2024-09-10T06:29:53.425744+0000","last_clean":"2024-09-10T06:29:53.425744+0000","last_became_active":"2024-09-10T06:26:38.298779+0000","last_became_peered":"2024-09-10T06:26:38.298779+0000","last_unstale":"2024-09-10T06:29:53.425744+0000","last_undegraded":"2024-09-10T06:29:53.425744+0000","last_fullsized":"2024-09-10T06:29:53.425744+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:53.425462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:53.425462+0000","last_clean_scrub_stamp":"2024-09-10T06:29:53.425462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:06.773548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":141,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:57.245327+0000","last_change":"2024-09-10T06:29:57.245327+0000","last_active":"2024-09-10T06:29:57.245327+0000","last_peered":"2024-09-10T06:29:57.245327+0000","last_clean":"2024-09-10T06:29:57.245327+0000","last_became_active":"2024-09-10T06:26:40.335348+0000","last_became_peered":"2024-09-10T06:26:40.335348+0000","last_unstale":"2024-09-10T06:29:57.245327+0000","last_undegraded":"2024-09-10T06:29:57.245327+0000","last_fullsized":"2024-09-10T06:29:57.245327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:57.245090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:57.245090+0000","last_clean_scrub_stamp":"2024-09-10T06:29:57.245090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:38:35.449278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"62'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.807660+0000","last_change":"2024-09-10T06:29:38.807660+0000","last_active":"2024-09-10T06:29:38.807660+0000","last_peered":"2024-09-10T06:29:38.807660+0000","last_clean":"2024-09-10T06:29:38.807660+0000","last_became_active":"2024-09-10T06:26:32.275855+0000","last_became_peered":"2024-09-10T06:26:32.275855+0000","last_unstale":"2024-09-10T06:29:38.807660+0000","last_undegraded":"2024-09-10T06:29:38.807660+0000","last_fullsized":"2024-09-10T06:29:38.807660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'2","last_scrub_stamp":"2024-09-10T06:29:38.807377+0000","last_deep_scrub":"62'2","last_deep_scrub_stamp":"2024-09-10T06:29:38.807377+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.807377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:40:35.562150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"95'22","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:28.481630+0000","last_change":"2024-09-10T06:29:28.481630+0000","last_active":"2024-09-10T06:29:28.481630+0000","last_peered":"2024-09-10T06:29:28.481630+0000","last_clean":"2024-09-10T06:29:28.481630+0000","last_became_active":"2024-09-10T06:26:30.590801+0000","last_became_peered":"2024-09-10T06:26:30.590801+0000","last_unstale":"2024-09-10T06:29:28.481630+0000","last_undegraded":"2024-09-10T06:29:28.481630+0000","last_fullsized":"2024-09-10T06:29:28.481630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:28.481459+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:28.481459+0000","last_clean_scrub_stamp":"2024-09-10T06:29:28.481459+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:39:15.157597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:35.681891+0000","last_change":"2024-09-10T06:29:35.681891+0000","last_active":"2024-09-10T06:29:35.681891+0000","last_peered":"2024-09-10T06:29:35.681891+0000","last_clean":"2024-09-10T06:29:35.681891+0000","last_became_active":"2024-09-10T06:26:32.267915+0000","last_became_peered":"2024-09-10T06:26:32.267915+0000","last_unstale":"2024-09-10T06:29:35.681891+0000","last_undegraded":"2024-09-10T06:29:35.681891+0000","last_fullsized":"2024-09-10T06:29:35.681891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:35.681619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:35.681619+0000","last_clean_scrub_stamp":"2024-09-10T06:29:35.681619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:03:47.762330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"95'20","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.565966+0000","last_change":"2024-09-10T06:29:26.565966+0000","last_active":"2024-09-10T06:29:26.565966+0000","last_peered":"2024-09-10T06:29:26.565966+0000","last_clean":"2024-09-10T06:29:26.565966+0000","last_became_active":"2024-09-10T06:26:30.593506+0000","last_became_peered":"2024-09-10T06:26:30.593506+0000","last_unstale":"2024-09-10T06:29:26.565966+0000","last_undegraded":"2024-09-10T06:29:26.565966+0000","last_fullsized":"2024-09-10T06:29:26.565966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:26.565797+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:26.565797+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.565797+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:42:10.093988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"76'6","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.297180+0000","last_change":"2024-09-10T06:29:40.297180+0000","last_active":"2024-09-10T06:29:40.297180+0000","last_peered":"2024-09-10T06:29:40.297180+0000","last_clean":"2024-09-10T06:29:40.297180+0000","last_became_active":"2024-09-10T06:26:32.287839+0000","last_became_peered":"2024-09-10T06:26:32.287839+0000","last_unstale":"2024-09-10T06:29:40.297180+0000","last_undegraded":"2024-09-10T06:29:40.297180+0000","last_fullsized":"2024-09-10T06:29:40.297180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2024-09-10T06:29:40.296901+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2024-09-10T06:29:40.296901+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.296901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:15:26.239244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"95'10","reported_seq":84,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:25.594249+0000","last_change":"2024-09-10T06:29:25.594030+0000","last_active":"2024-09-10T06:29:25.594249+0000","last_peered":"2024-09-10T06:29:25.594249+0000","last_clean":"2024-09-10T06:29:25.594249+0000","last_became_active":"2024-09-10T06:28:09.544344+0000","last_became_peered":"2024-09-10T06:28:09.544344+0000","last_unstale":"2024-09-10T06:29:25.594249+0000","last_undegraded":"2024-09-10T06:29:25.594249+0000","last_fullsized":"2024-09-10T06:29:25.594249+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-10T06:29:25.593753+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-10T06:29:25.593753+0000","last_clean_scrub_stamp":"2024-09-10T06:29:25.593753+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:03:27.452348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"62'4","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:34.634746+0000","last_change":"2024-09-10T06:29:34.634746+0000","last_active":"2024-09-10T06:29:34.634746+0000","last_peered":"2024-09-10T06:29:34.634746+0000","last_clean":"2024-09-10T06:29:34.634746+0000","last_became_active":"2024-09-10T06:26:32.272279+0000","last_became_peered":"2024-09-10T06:26:32.272279+0000","last_unstale":"2024-09-10T06:29:34.634746+0000","last_undegraded":"2024-09-10T06:29:34.634746+0000","last_fullsized":"2024-09-10T06:29:34.634746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'4","last_scrub_stamp":"2024-09-10T06:29:34.634524+0000","last_deep_scrub":"62'4","last_deep_scrub_stamp":"2024-09-10T06:29:34.634524+0000","last_clean_scrub_stamp":"2024-09-10T06:29:34.634524+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:22:34.244616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"95'24","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.566184+0000","last_change":"2024-09-10T06:29:26.566184+0000","last_active":"2024-09-10T06:29:26.566184+0000","last_peered":"2024-09-10T06:29:26.566184+0000","last_clean":"2024-09-10T06:29:26.566184+0000","last_became_active":"2024-09-10T06:26:30.579189+0000","last_became_peered":"2024-09-10T06:26:30.579189+0000","last_unstale":"2024-09-10T06:29:26.566184+0000","last_undegraded":"2024-09-10T06:29:26.566184+0000","last_fullsized":"2024-09-10T06:29:26.566184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:26.565846+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:26.565846+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.565846+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:54.468490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"76'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.971489+0000","last_change":"2024-09-10T06:29:36.971489+0000","last_active":"2024-09-10T06:29:36.971489+0000","last_peered":"2024-09-10T06:29:36.971489+0000","last_clean":"2024-09-10T06:29:36.971489+0000","last_became_active":"2024-09-10T06:26:32.259644+0000","last_became_peered":"2024-09-10T06:26:32.259644+0000","last_unstale":"2024-09-10T06:29:36.971489+0000","last_undegraded":"2024-09-10T06:29:36.971489+0000","last_fullsized":"2024-09-10T06:29:36.971489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:36.971273+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:36.971273+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.971273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T06:43:17.237836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"95'22","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.133853+0000","last_change":"2024-09-10T06:29:30.133853+0000","last_active":"2024-09-10T06:29:30.133853+0000","last_peered":"2024-09-10T06:29:30.133853+0000","last_clean":"2024-09-10T06:29:30.133853+0000","last_became_active":"2024-09-10T06:26:30.575605+0000","last_became_peered":"2024-09-10T06:26:30.575605+0000","last_unstale":"2024-09-10T06:29:30.133853+0000","last_undegraded":"2024-09-10T06:29:30.133853+0000","last_fullsized":"2024-09-10T06:29:30.133853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-10T06:29:30.133668+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-10T06:29:30.133668+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.133668+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:39:38.055165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":0,"num_write":22,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"76'10","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.089233+0000","last_change":"2024-09-10T06:29:37.089233+0000","last_active":"2024-09-10T06:29:37.089233+0000","last_peered":"2024-09-10T06:29:37.089233+0000","last_clean":"2024-09-10T06:29:37.089233+0000","last_became_active":"2024-09-10T06:26:32.272454+0000","last_became_peered":"2024-09-10T06:26:32.272454+0000","last_unstale":"2024-09-10T06:29:37.089233+0000","last_undegraded":"2024-09-10T06:29:37.089233+0000","last_fullsized":"2024-09-10T06:29:37.089233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'10","last_scrub_stamp":"2024-09-10T06:29:37.089011+0000","last_deep_scrub":"76'10","last_deep_scrub_stamp":"2024-09-10T06:29:37.089011+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.089011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:22:20.087601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"95'12","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:26.727328+0000","last_change":"2024-09-10T06:29:26.727328+0000","last_active":"2024-09-10T06:29:26.727328+0000","last_peered":"2024-09-10T06:29:26.727328+0000","last_clean":"2024-09-10T06:29:26.727328+0000","last_became_active":"2024-09-10T06:26:30.578732+0000","last_became_peered":"2024-09-10T06:26:30.578732+0000","last_unstale":"2024-09-10T06:29:26.727328+0000","last_undegraded":"2024-09-10T06:29:26.727328+0000","last_fullsized":"2024-09-10T06:29:26.727328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:26.727144+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:26.727144+0000","last_clean_scrub_stamp":"2024-09-10T06:29:26.727144+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:01.138095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.927336+0000","last_change":"2024-09-10T06:29:37.927336+0000","last_active":"2024-09-10T06:29:37.927336+0000","last_peered":"2024-09-10T06:29:37.927336+0000","last_clean":"2024-09-10T06:29:37.927336+0000","last_became_active":"2024-09-10T06:26:32.270327+0000","last_became_peered":"2024-09-10T06:26:32.270327+0000","last_unstale":"2024-09-10T06:29:37.927336+0000","last_undegraded":"2024-09-10T06:29:37.927336+0000","last_fullsized":"2024-09-10T06:29:37.927336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:37.927124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:37.927124+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.927124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:34:36.175407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"95'12","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.442680+0000","last_change":"2024-09-10T06:29:29.442680+0000","last_active":"2024-09-10T06:29:29.442680+0000","last_peered":"2024-09-10T06:29:29.442680+0000","last_clean":"2024-09-10T06:29:29.442680+0000","last_became_active":"2024-09-10T06:26:30.596254+0000","last_became_peered":"2024-09-10T06:26:30.596254+0000","last_unstale":"2024-09-10T06:29:29.442680+0000","last_undegraded":"2024-09-10T06:29:29.442680+0000","last_fullsized":"2024-09-10T06:29:29.442680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:29.442459+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:29.442459+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.442459+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:37:12.813873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"67'2","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.398908+0000","last_change":"2024-09-10T06:29:36.398908+0000","last_active":"2024-09-10T06:29:36.398908+0000","last_peered":"2024-09-10T06:29:36.398908+0000","last_clean":"2024-09-10T06:29:36.398908+0000","last_became_active":"2024-09-10T06:26:32.275133+0000","last_became_peered":"2024-09-10T06:26:32.275133+0000","last_unstale":"2024-09-10T06:29:36.398908+0000","last_undegraded":"2024-09-10T06:29:36.398908+0000","last_fullsized":"2024-09-10T06:29:36.398908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:36.398697+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:36.398697+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.398697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:11:57.551366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"95'18","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.123679+0000","last_change":"2024-09-10T06:29:27.123679+0000","last_active":"2024-09-10T06:29:27.123679+0000","last_peered":"2024-09-10T06:29:27.123679+0000","last_clean":"2024-09-10T06:29:27.123679+0000","last_became_active":"2024-09-10T06:26:30.580134+0000","last_became_peered":"2024-09-10T06:26:30.580134+0000","last_unstale":"2024-09-10T06:29:27.123679+0000","last_undegraded":"2024-09-10T06:29:27.123679+0000","last_fullsized":"2024-09-10T06:29:27.123679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:27.123490+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:27.123490+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.123490+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:41.216401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"67'2","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:37.593717+0000","last_change":"2024-09-10T06:29:37.593717+0000","last_active":"2024-09-10T06:29:37.593717+0000","last_peered":"2024-09-10T06:29:37.593717+0000","last_clean":"2024-09-10T06:29:37.593717+0000","last_became_active":"2024-09-10T06:26:32.256052+0000","last_became_peered":"2024-09-10T06:26:32.256052+0000","last_unstale":"2024-09-10T06:29:37.593717+0000","last_undegraded":"2024-09-10T06:29:37.593717+0000","last_fullsized":"2024-09-10T06:29:37.593717+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:37.593531+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:37.593531+0000","last_clean_scrub_stamp":"2024-09-10T06:29:37.593531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:12:46.073261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"95'16","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.322872+0000","last_change":"2024-09-10T06:29:29.322872+0000","last_active":"2024-09-10T06:29:29.322872+0000","last_peered":"2024-09-10T06:29:29.322872+0000","last_clean":"2024-09-10T06:29:29.322872+0000","last_became_active":"2024-09-10T06:26:30.584443+0000","last_became_peered":"2024-09-10T06:26:30.584443+0000","last_unstale":"2024-09-10T06:29:29.322872+0000","last_undegraded":"2024-09-10T06:29:29.322872+0000","last_fullsized":"2024-09-10T06:29:29.322872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:29.322684+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:29.322684+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.322684+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:34.292621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"76'4","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:39.177377+0000","last_change":"2024-09-10T06:29:39.177377+0000","last_active":"2024-09-10T06:29:39.177377+0000","last_peered":"2024-09-10T06:29:39.177377+0000","last_clean":"2024-09-10T06:29:39.177377+0000","last_became_active":"2024-09-10T06:26:32.258513+0000","last_became_peered":"2024-09-10T06:26:32.258513+0000","last_unstale":"2024-09-10T06:29:39.177377+0000","last_undegraded":"2024-09-10T06:29:39.177377+0000","last_fullsized":"2024-09-10T06:29:39.177377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2024-09-10T06:29:39.177196+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2024-09-10T06:29:39.177196+0000","last_clean_scrub_stamp":"2024-09-10T06:29:39.177196+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:41:37.865159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"95'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.102245+0000","last_change":"2024-09-10T06:29:31.102245+0000","last_active":"2024-09-10T06:29:31.102245+0000","last_peered":"2024-09-10T06:29:31.102245+0000","last_clean":"2024-09-10T06:29:31.102245+0000","last_became_active":"2024-09-10T06:26:30.580913+0000","last_became_peered":"2024-09-10T06:26:30.580913+0000","last_unstale":"2024-09-10T06:29:31.102245+0000","last_undegraded":"2024-09-10T06:29:31.102245+0000","last_fullsized":"2024-09-10T06:29:31.102245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-10T06:29:31.102016+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-10T06:29:31.102016+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.102016+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:58:16.248697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"76'2","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.501181+0000","last_change":"2024-09-10T06:29:31.501181+0000","last_active":"2024-09-10T06:29:31.501181+0000","last_peered":"2024-09-10T06:29:31.501181+0000","last_clean":"2024-09-10T06:29:31.501181+0000","last_became_active":"2024-09-10T06:26:32.274327+0000","last_became_peered":"2024-09-10T06:26:32.274327+0000","last_unstale":"2024-09-10T06:29:31.501181+0000","last_undegraded":"2024-09-10T06:29:31.501181+0000","last_fullsized":"2024-09-10T06:29:31.501181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:31.500938+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:31.500938+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.500938+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:07:43.060165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"95'12","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.526438+0000","last_change":"2024-09-10T06:29:27.526438+0000","last_active":"2024-09-10T06:29:27.526438+0000","last_peered":"2024-09-10T06:29:27.526438+0000","last_clean":"2024-09-10T06:29:27.526438+0000","last_became_active":"2024-09-10T06:27:08.592637+0000","last_became_peered":"2024-09-10T06:27:08.592637+0000","last_unstale":"2024-09-10T06:29:27.526438+0000","last_undegraded":"2024-09-10T06:29:27.526438+0000","last_fullsized":"2024-09-10T06:29:27.526438+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-10T06:29:27.526241+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-10T06:29:27.526241+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.526241+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:48:26.084961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"67'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.135197+0000","last_change":"2024-09-10T06:29:38.135197+0000","last_active":"2024-09-10T06:29:38.135197+0000","last_peered":"2024-09-10T06:29:38.135197+0000","last_clean":"2024-09-10T06:29:38.135197+0000","last_became_active":"2024-09-10T06:26:32.278461+0000","last_became_peered":"2024-09-10T06:26:32.278461+0000","last_unstale":"2024-09-10T06:29:38.135197+0000","last_undegraded":"2024-09-10T06:29:38.135197+0000","last_fullsized":"2024-09-10T06:29:38.135197+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:38.134976+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:38.134976+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.134976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:54:57.931148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"95'16","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.573008+0000","last_change":"2024-09-10T06:29:27.573008+0000","last_active":"2024-09-10T06:29:27.573008+0000","last_peered":"2024-09-10T06:29:27.573008+0000","last_clean":"2024-09-10T06:29:27.573008+0000","last_became_active":"2024-09-10T06:26:30.605225+0000","last_became_peered":"2024-09-10T06:26:30.605225+0000","last_unstale":"2024-09-10T06:29:27.573008+0000","last_undegraded":"2024-09-10T06:29:27.573008+0000","last_fullsized":"2024-09-10T06:29:27.573008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-10T06:29:27.572826+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-10T06:29:27.572826+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.572826+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:58:18.620011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":0,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"64'8","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:42.184350+0000","last_change":"2024-09-10T06:29:42.184350+0000","last_active":"2024-09-10T06:29:42.184350+0000","last_peered":"2024-09-10T06:29:42.184350+0000","last_clean":"2024-09-10T06:29:42.184350+0000","last_became_active":"2024-09-10T06:26:32.266234+0000","last_became_peered":"2024-09-10T06:26:32.266234+0000","last_unstale":"2024-09-10T06:29:42.184350+0000","last_undegraded":"2024-09-10T06:29:42.184350+0000","last_fullsized":"2024-09-10T06:29:42.184350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'8","last_scrub_stamp":"2024-09-10T06:29:42.184142+0000","last_deep_scrub":"64'8","last_deep_scrub_stamp":"2024-09-10T06:29:42.184142+0000","last_clean_scrub_stamp":"2024-09-10T06:29:42.184142+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:09:09.333624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"95'20","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:27.508009+0000","last_change":"2024-09-10T06:29:27.508009+0000","last_active":"2024-09-10T06:29:27.508009+0000","last_peered":"2024-09-10T06:29:27.508009+0000","last_clean":"2024-09-10T06:29:27.508009+0000","last_became_active":"2024-09-10T06:26:30.593598+0000","last_became_peered":"2024-09-10T06:26:30.593598+0000","last_unstale":"2024-09-10T06:29:27.508009+0000","last_undegraded":"2024-09-10T06:29:27.508009+0000","last_fullsized":"2024-09-10T06:29:27.508009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:27.507794+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:27.507794+0000","last_clean_scrub_stamp":"2024-09-10T06:29:27.507794+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:52.834192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"76'2","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.569752+0000","last_change":"2024-09-10T06:29:36.569752+0000","last_active":"2024-09-10T06:29:36.569752+0000","last_peered":"2024-09-10T06:29:36.569752+0000","last_clean":"2024-09-10T06:29:36.569752+0000","last_became_active":"2024-09-10T06:26:32.278032+0000","last_became_peered":"2024-09-10T06:26:32.278032+0000","last_unstale":"2024-09-10T06:29:36.569752+0000","last_undegraded":"2024-09-10T06:29:36.569752+0000","last_fullsized":"2024-09-10T06:29:36.569752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T06:29:36.569563+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T06:29:36.569563+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.569563+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:04:22.916358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"95'18","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:41.188677+0000","last_change":"2024-09-10T06:29:41.188677+0000","last_active":"2024-09-10T06:29:41.188677+0000","last_peered":"2024-09-10T06:29:41.188677+0000","last_clean":"2024-09-10T06:29:41.188677+0000","last_became_active":"2024-09-10T06:26:30.579319+0000","last_became_peered":"2024-09-10T06:26:30.579319+0000","last_unstale":"2024-09-10T06:29:41.188677+0000","last_undegraded":"2024-09-10T06:29:41.188677+0000","last_fullsized":"2024-09-10T06:29:41.188677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:41.188480+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:41.188480+0000","last_clean_scrub_stamp":"2024-09-10T06:29:41.188480+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:55.281391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"67'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:40.838271+0000","last_change":"2024-09-10T06:29:40.838271+0000","last_active":"2024-09-10T06:29:40.838271+0000","last_peered":"2024-09-10T06:29:40.838271+0000","last_clean":"2024-09-10T06:29:40.838271+0000","last_became_active":"2024-09-10T06:26:32.256851+0000","last_became_peered":"2024-09-10T06:26:32.256851+0000","last_unstale":"2024-09-10T06:29:40.838271+0000","last_undegraded":"2024-09-10T06:29:40.838271+0000","last_fullsized":"2024-09-10T06:29:40.838271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T06:29:40.838077+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T06:29:40.838077+0000","last_clean_scrub_stamp":"2024-09-10T06:29:40.838077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:30:03.029012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"95'24","reported_seq":237,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:29.489479+0000","last_change":"2024-09-10T06:29:29.489479+0000","last_active":"2024-09-10T06:29:29.489479+0000","last_peered":"2024-09-10T06:29:29.489479+0000","last_clean":"2024-09-10T06:29:29.489479+0000","last_became_active":"2024-09-10T06:28:46.326501+0000","last_became_peered":"2024-09-10T06:28:46.326501+0000","last_unstale":"2024-09-10T06:29:29.489479+0000","last_undegraded":"2024-09-10T06:29:29.489479+0000","last_fullsized":"2024-09-10T06:29:29.489479+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-10T06:29:29.489292+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-10T06:29:29.489292+0000","last_clean_scrub_stamp":"2024-09-10T06:29:29.489292+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:20:43.930114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":0,"num_write":24,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"62'8","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.302392+0000","last_change":"2024-09-10T06:29:36.302392+0000","last_active":"2024-09-10T06:29:36.302392+0000","last_peered":"2024-09-10T06:29:36.302392+0000","last_clean":"2024-09-10T06:29:36.302392+0000","last_became_active":"2024-09-10T06:26:32.266000+0000","last_became_peered":"2024-09-10T06:26:32.266000+0000","last_unstale":"2024-09-10T06:29:36.302392+0000","last_undegraded":"2024-09-10T06:29:36.302392+0000","last_fullsized":"2024-09-10T06:29:36.302392+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'8","last_scrub_stamp":"2024-09-10T06:29:36.302107+0000","last_deep_scrub":"62'8","last_deep_scrub_stamp":"2024-09-10T06:29:36.302107+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.302107+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:49:41.272044+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"95'18","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.304733+0000","last_change":"2024-09-10T06:29:30.304733+0000","last_active":"2024-09-10T06:29:30.304733+0000","last_peered":"2024-09-10T06:29:30.304733+0000","last_clean":"2024-09-10T06:29:30.304733+0000","last_became_active":"2024-09-10T06:26:30.609674+0000","last_became_peered":"2024-09-10T06:26:30.609674+0000","last_unstale":"2024-09-10T06:29:30.304733+0000","last_undegraded":"2024-09-10T06:29:30.304733+0000","last_fullsized":"2024-09-10T06:29:30.304733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-10T06:29:30.304509+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-10T06:29:30.304509+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.304509+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T07:50:28.312339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"95'20","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:31.290101+0000","last_change":"2024-09-10T06:29:31.290101+0000","last_active":"2024-09-10T06:29:31.290101+0000","last_peered":"2024-09-10T06:29:31.290101+0000","last_clean":"2024-09-10T06:29:31.290101+0000","last_became_active":"2024-09-10T06:26:30.590640+0000","last_became_peered":"2024-09-10T06:26:30.590640+0000","last_unstale":"2024-09-10T06:29:31.290101+0000","last_undegraded":"2024-09-10T06:29:31.290101+0000","last_fullsized":"2024-09-10T06:29:31.290101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-10T06:29:31.289915+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-10T06:29:31.289915+0000","last_clean_scrub_stamp":"2024-09-10T06:29:31.289915+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:11:59.192559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":0,"num_write":20,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"67'10","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:38.624607+0000","last_change":"2024-09-10T06:29:38.624607+0000","last_active":"2024-09-10T06:29:38.624607+0000","last_peered":"2024-09-10T06:29:38.624607+0000","last_clean":"2024-09-10T06:29:38.624607+0000","last_became_active":"2024-09-10T06:26:32.266876+0000","last_became_peered":"2024-09-10T06:26:32.266876+0000","last_unstale":"2024-09-10T06:29:38.624607+0000","last_undegraded":"2024-09-10T06:29:38.624607+0000","last_fullsized":"2024-09-10T06:29:38.624607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T06:29:38.624380+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T06:29:38.624380+0000","last_clean_scrub_stamp":"2024-09-10T06:29:38.624380+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:00:43.077926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":27,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"95'26","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:30.725676+0000","last_change":"2024-09-10T06:29:30.725676+0000","last_active":"2024-09-10T06:29:30.725676+0000","last_peered":"2024-09-10T06:29:30.725676+0000","last_clean":"2024-09-10T06:29:30.725676+0000","last_became_active":"2024-09-10T06:26:30.590415+0000","last_became_peered":"2024-09-10T06:26:30.590415+0000","last_unstale":"2024-09-10T06:29:30.725676+0000","last_undegraded":"2024-09-10T06:29:30.725676+0000","last_fullsized":"2024-09-10T06:29:30.725676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-10T06:29:30.725485+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-10T06:29:30.725485+0000","last_clean_scrub_stamp":"2024-09-10T06:29:30.725485+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:11.273687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-10T06:29:36.277539+0000","last_change":"2024-09-10T06:29:36.277539+0000","last_active":"2024-09-10T06:29:36.277539+0000","last_peered":"2024-09-10T06:29:36.277539+0000","last_clean":"2024-09-10T06:29:36.277539+0000","last_became_active":"2024-09-10T06:26:32.282581+0000","last_became_peered":"2024-09-10T06:26:32.282581+0000","last_unstale":"2024-09-10T06:29:36.277539+0000","last_undegraded":"2024-09-10T06:29:36.277539+0000","last_fullsized":"2024-09-10T06:29:36.277539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T06:29:36.277311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T06:29:36.277311+0000","last_clean_scrub_stamp":"2024-09-10T06:29:36.277311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:36:26.104758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":238,"num_write":231,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":845,"ondisk_log_size":845,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":27618,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1027,"num_read_kb":1076,"num_write":535,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":308,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6092,"num_omap_keys":28,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":934,"ondisk_log_size":934,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":344,"num_read_kb":344,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":591,"num_read_kb":567,"num_write":234,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":593,"num_read_kb":15,"num_write":1204,"num_write_kb":2365440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":209715200,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1156,"ondisk_log_size":1156,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542197,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1769472,"data_stored":1236965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542197,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1155072,"data_stored":646930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542198,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1200128,"data_stored":646784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542197,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1142784,"data_stored":646428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542198,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1171456,"data_stored":646769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542198,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1138688,"data_stored":645499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542198,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36488,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335352,"statfs":{"total":96636764160,"available":96599400448,"internally_reserved":0,"allocated":1171456,"data_stored":646206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542197,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1753088,"data_stored":1236807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T06:30:25.758 DEBUG:teuthology.orchestra.run.smithi112:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T06:30:26.092 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T06:30:26.093 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T06:30:26.093 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T06:30:26.093 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:30:26.169 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T06:30:26.170 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T06:30:26.170 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:30:26.242 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T06:30:26.243 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T06:30:26.243 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:30:26.329 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T06:30:26.329 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T06:30:26.329 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:30:26.415 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T06:30:26.415 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T06:30:26.415 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:30:26.479 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T06:30:26.479 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T06:30:26.479 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:30:26.579 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T06:30:26.579 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T06:30:26.579 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:30:26.656 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T06:30:26.656 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T06:30:26.656 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:30:26.724 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T06:30:26.724 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T06:30:26.724 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T06:30:26.724 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:30:26.754 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T06:30:26.755 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T06:30:26.755 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:30:26.783 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T06:30:26.783 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T06:30:26.783 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T06:30:26.783 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:30:26.811 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T06:30:26.812 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T06:30:26.812 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:30:26.867 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T06:30:26.868 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T06:30:26.868 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T06:30:26.885 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T06:30:26.885 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T06:30:26.885 DEBUG:teuthology.orchestra.run.smithi112:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-10T06:30:26.927 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T06:30:26.928 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T06:30:27.315 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T06:30:27.316 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T06:30:27.549 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T06:30:27.549 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T06:30:27.743 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T06:30:27.743 DEBUG:teuthology.orchestra.run.smithi112:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T06:30:27.941 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-10T06:30:27.942 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T06:30:28.200 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-10T06:30:28.200 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T06:30:28.385 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-10T06:30:28.386 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T06:30:28.550 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi120.front.sepia.ceph.com 2024-09-10T06:30:28.551 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T06:30:28.710 INFO:tasks.ceph:Archiving mon data... 2024-09-10T06:30:28.711 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898794/data/mon.a.tgz 2024-09-10T06:30:28.711 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-10T06:30:28.717 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.gLenUtRMxZ 2024-09-10T06:30:28.717 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.gLenUtRMxZ 2024-09-10T06:30:28.878 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.gLenUtRMxZ 2024-09-10T06:30:28.942 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.gLenUtRMxZ is 485KB 2024-09-10T06:30:29.008 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.gLenUtRMxZ 2024-09-10T06:30:29.013 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898794/data/mon.c.tgz 2024-09-10T06:30:29.013 DEBUG:teuthology.orchestra.run.smithi112:> mktemp 2024-09-10T06:30:29.062 INFO:teuthology.orchestra.run.smithi112.stdout:/tmp/tmp.NPyqlGlapF 2024-09-10T06:30:29.062 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.NPyqlGlapF 2024-09-10T06:30:29.251 DEBUG:teuthology.orchestra.run.smithi112:> sudo chmod 0666 /tmp/tmp.NPyqlGlapF 2024-09-10T06:30:29.314 DEBUG:teuthology.orchestra.remote:smithi112:/tmp/tmp.NPyqlGlapF is 636KB 2024-09-10T06:30:29.380 DEBUG:teuthology.orchestra.run.smithi112:> rm -fr /tmp/tmp.NPyqlGlapF 2024-09-10T06:30:29.385 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898794/data/mon.b.tgz 2024-09-10T06:30:29.385 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-09-10T06:30:29.391 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.jxNOmauI3k 2024-09-10T06:30:29.391 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.jxNOmauI3k 2024-09-10T06:30:29.586 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.jxNOmauI3k 2024-09-10T06:30:29.649 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.jxNOmauI3k is 635KB 2024-09-10T06:30:29.711 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.jxNOmauI3k 2024-09-10T06:30:29.716 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T06:30:29.717 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T06:30:29.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T06:30:29.778 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T06:30:29.818 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T06:30:29.818 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T06:30:29.819 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898794/remote/smithi112/crash 2024-09-10T06:30:29.820 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T06:30:29.834 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898794/remote/smithi120/crash 2024-09-10T06:30:29.835 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T06:30:29.873 INFO:tasks.ceph:Compressing logs... 2024-09-10T06:30:29.874 DEBUG:teuthology.orchestra.run.smithi112:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T06:30:29.879 DEBUG:teuthology.orchestra.run.smithi120:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T06:30:29.896 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35457.log 2024-09-10T06:30:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35988.log 2024-09-10T06:30:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33288.log 2024-09-10T06:30:29.899 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35457.log.gz 2024-09-10T06:30:29.899 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45254.log 2024-09-10T06:30:29.900 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35988.log.gz 2024-09-10T06:30:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48348.log 2024-09-10T06:30:29.900 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33288.log.gz 2024-09-10T06:30:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54053.log 2024-09-10T06:30:29.900 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45254.log.gz 2024-09-10T06:30:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57624.log 2024-09-10T06:30:29.900 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48348.log.gz 2024-09-10T06:30:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54053.log.gz 2024-09-10T06:30:29.900 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-10T06:30:29.905 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57239.log 2024-09-10T06:30:29.905 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57624.log.gz 2024-09-10T06:30:29.905 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34810.log 2024-09-10T06:30:29.905 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57239.log: 85.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-10T06:30:29.905 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57239.log.gz 2024-09-10T06:30:29.905 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35680.log 2024-09-10T06:30:29.905 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34133.log 2024-09-10T06:30:29.905 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34810.log.gz 2024-09-10T06:30:29.905 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40831.log 2024-09-10T06:30:29.906 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35680.log.gz 2024-09-10T06:30:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34133.log.gz 2024-09-10T06:30:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T06:30:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57838.log 2024-09-10T06:30:29.906 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40831.log.gz 2024-09-10T06:30:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59290.log 2024-09-10T06:30:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57838.log.gz 2024-09-10T06:30:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35778.log 2024-09-10T06:30:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52595.log 2024-09-10T06:30:29.906 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59290.log.gz 2024-09-10T06:30:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35778.log.gz 2024-09-10T06:30:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54049.log 2024-09-10T06:30:29.906 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52005.log 2024-09-10T06:30:29.906 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52595.log.gz 2024-09-10T06:30:29.907 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54049.log.gz 2024-09-10T06:30:29.907 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45227.log 2024-09-10T06:30:29.911 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34480.log 2024-09-10T06:30:29.911 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.52005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52005.log.gz 2024-09-10T06:30:29.911 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45227.log.gz 2024-09-10T06:30:29.911 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45127.log 2024-09-10T06:30:29.911 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34480.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T06:30:29.911 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34480.log.gz 2024-09-10T06:30:29.911 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37230.log 2024-09-10T06:30:29.911 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45127.log.gz 2024-09-10T06:30:29.911 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35598.log 2024-09-10T06:30:29.911 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57213.log 2024-09-10T06:30:29.911 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37230.log.gz 2024-09-10T06:30:29.912 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35598.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.35598.log.gz -5 2024-09-10T06:30:29.912 INFO:teuthology.orchestra.run.smithi112.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59368.log 2024-09-10T06:30:29.912 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57213.log.gz 2024-09-10T06:30:29.912 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58046.log 2024-09-10T06:30:29.912 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33939.log 2024-09-10T06:30:29.912 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59368.log.gz 2024-09-10T06:30:29.912 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58046.log.gz 2024-09-10T06:30:29.912 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35333.log 2024-09-10T06:30:29.912 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33740.log 2024-09-10T06:30:29.912 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33939.log.gz 2024-09-10T06:30:29.912 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35333.log.gz 2024-09-10T06:30:29.912 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59238.log 2024-09-10T06:30:29.912 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33740.log.gz 2024-09-10T06:30:29.912 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32010.log 2024-09-10T06:30:29.915 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59238.log.gz 2024-09-10T06:30:29.915 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57820.log 2024-09-10T06:30:29.915 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48967.log 2024-09-10T06:30:29.915 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32010.log.gz 2024-09-10T06:30:29.915 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33262.log 2024-09-10T06:30:29.915 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57820.log.gz 2024-09-10T06:30:29.915 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.48967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48967.log.gz 2024-09-10T06:30:29.915 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56381.log 2024-09-10T06:30:29.915 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35895.log 2024-09-10T06:30:29.915 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33262.log.gz 2024-09-10T06:30:29.916 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.56381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56381.log.gz 2024-09-10T06:30:29.916 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57499.log 2024-09-10T06:30:29.921 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37766.log 2024-09-10T06:30:29.921 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35895.log.gz 2024-09-10T06:30:29.921 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57499.log.gz 2024-09-10T06:30:29.921 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53344.log 2024-09-10T06:30:29.921 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31814.log 2024-09-10T06:30:29.922 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37766.log.gz 2024-09-10T06:30:29.922 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55700.log 2024-09-10T06:30:29.922 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53344.log.gz 2024-09-10T06:30:29.922 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.31814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34179.log 2024-09-10T06:30:29.922 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31814.log.gz 2024-09-10T06:30:29.922 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59316.log 2024-09-10T06:30:29.922 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55700.log.gz 2024-09-10T06:30:29.922 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31962.log 2024-09-10T06:30:29.922 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34179.log.gz 2024-09-10T06:30:29.922 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57623.log 2024-09-10T06:30:29.922 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59316.log.gz 2024-09-10T06:30:29.922 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.31962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34561.log 2024-09-10T06:30:29.922 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31962.log.gz 2024-09-10T06:30:29.922 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32224.log 2024-09-10T06:30:29.923 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57623.log.gz 2024-09-10T06:30:29.923 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34590.log 2024-09-10T06:30:29.923 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34561.log.gz 2024-09-10T06:30:29.923 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35121.log 2024-09-10T06:30:29.923 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32224.log.gz 2024-09-10T06:30:29.923 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35560.log 2024-09-10T06:30:29.923 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34590.log.gz 2024-09-10T06:30:29.923 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58227.log 2024-09-10T06:30:29.923 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35121.log.gz 2024-09-10T06:30:29.923 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54231.log 2024-09-10T06:30:29.923 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35560.log.gz 2024-09-10T06:30:29.929 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58227.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T06:30:29.929 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58227.log.gz 2024-09-10T06:30:29.929 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57525.log 2024-09-10T06:30:29.930 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54231.log.gz 2024-09-10T06:30:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35321.log 2024-09-10T06:30:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57525.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.57525.log.gz 2024-09-10T06:30:29.930 INFO:teuthology.orchestra.run.smithi112.stderr: /var/log/ceph/ceph-client.admin.32215.log 2024-09-10T06:30:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59522.log 2024-09-10T06:30:29.930 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35321.log.gz 2024-09-10T06:30:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35164.log 2024-09-10T06:30:29.930 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32215.log.gz 2024-09-10T06:30:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34940.log 2024-09-10T06:30:29.930 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59522.log.gz 2024-09-10T06:30:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58043.log 2024-09-10T06:30:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35164.log.gz 2024-09-10T06:30:29.930 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45190.log 2024-09-10T06:30:29.931 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34940.log.gz 2024-09-10T06:30:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58047.log 2024-09-10T06:30:29.931 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58043.log.gz 2024-09-10T06:30:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47712.log 2024-09-10T06:30:29.931 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45190.log.gz 2024-09-10T06:30:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58047.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T06:30:29.931 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58047.log.gz 2024-09-10T06:30:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55592.log 2024-09-10T06:30:29.931 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47712.log.gz 2024-09-10T06:30:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37844.log 2024-09-10T06:30:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57831.log 2024-09-10T06:30:29.931 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55592.log.gz 2024-09-10T06:30:29.931 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.37844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37844.log.gz 2024-09-10T06:30:29.932 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31910.log 2024-09-10T06:30:29.932 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.57831.log: -- /var/log/ceph/ceph-client.admin.57317.log 2024-09-10T06:30:29.932 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57831.log.gz 2024-09-10T06:30:29.932 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.31910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34533.log 2024-09-10T06:30:29.932 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31910.log.gz 2024-09-10T06:30:29.932 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57317.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.31884.log 2024-09-10T06:30:29.932 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57317.log.gz 2024-09-10T06:30:29.945 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26439.log 2024-09-10T06:30:29.945 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34533.log.gz 2024-09-10T06:30:29.945 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.31884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57187.log 2024-09-10T06:30:29.945 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31884.log.gz 2024-09-10T06:30:29.945 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57369.log 2024-09-10T06:30:29.945 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26439.log.gz 2024-09-10T06:30:29.946 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45882.log 2024-09-10T06:30:29.946 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57187.log.gz 2024-09-10T06:30:29.946 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.57369.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59056.log 2024-09-10T06:30:29.946 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57369.log.gz 2024-09-10T06:30:29.946 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57551.log 2024-09-10T06:30:29.946 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45882.log.gz 2024-09-10T06:30:29.946 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33774.log 2024-09-10T06:30:29.946 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59056.log.gz 2024-09-10T06:30:29.946 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51415.log 2024-09-10T06:30:29.946 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57551.log.gz 2024-09-10T06:30:29.946 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58019.log 2024-09-10T06:30:29.946 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33774.log.gz 2024-09-10T06:30:29.946 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33650.log 2024-09-10T06:30:29.946 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51415.log.gz 2024-09-10T06:30:29.947 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33384.log 2024-09-10T06:30:29.947 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58019.log.gz 2024-09-10T06:30:29.947 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59030.log 2024-09-10T06:30:29.947 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33650.log.gz 2024-09-10T06:30:29.947 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54177.log 2024-09-10T06:30:29.947 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33384.log.gz 2024-09-10T06:30:29.947 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57817.log 2024-09-10T06:30:29.947 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59030.log.gz 2024-09-10T06:30:29.947 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41462.log 2024-09-10T06:30:29.947 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54177.log.gz 2024-09-10T06:30:29.947 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57824.log 2024-09-10T06:30:29.947 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57817.log.gz 2024-09-10T06:30:29.948 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.41462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34713.log 2024-09-10T06:30:29.948 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41462.log.gz 2024-09-10T06:30:29.948 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42653.log 2024-09-10T06:30:29.948 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57824.log.gz 2024-09-10T06:30:29.948 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58952.log 2024-09-10T06:30:29.948 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34713.log.gz 2024-09-10T06:30:29.948 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.42653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57473.log 2024-09-10T06:30:29.948 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42653.log.gz 2024-09-10T06:30:29.948 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47708.log 2024-09-10T06:30:29.948 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58952.log.gz 2024-09-10T06:30:29.948 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32556.log 2024-09-10T06:30:29.948 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57473.log.gz 2024-09-10T06:30:29.949 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35000.log 2024-09-10T06:30:29.949 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47708.log.gz 2024-09-10T06:30:29.949 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32210.log 2024-09-10T06:30:29.949 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32556.log.gz 2024-09-10T06:30:29.949 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39037.log 2024-09-10T06:30:29.949 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35000.log.gz 2024-09-10T06:30:29.949 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32210.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T06:30:29.949 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32210.log.gz 2024-09-10T06:30:29.949 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39037.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.34861.log -- replaced with /var/log/ceph/ceph-client.admin.39037.log.gz 2024-09-10T06:30:29.949 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T06:30:29.949 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57839.log 2024-09-10T06:30:29.949 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57628.log 2024-09-10T06:30:29.949 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34861.log.gz 2024-09-10T06:30:29.950 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57839.log.gz 2024-09-10T06:30:29.950 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31864.log 2024-09-10T06:30:29.950 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34092.log 2024-09-10T06:30:29.950 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57628.log.gz 2024-09-10T06:30:29.950 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.31864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55453.log 2024-09-10T06:30:29.950 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31864.log.gz 2024-09-10T06:30:29.950 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59082.log 2024-09-10T06:30:29.950 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34092.log: /var/log/ceph/ceph-client.admin.55453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34092.log.gz 2024-09-10T06:30:29.950 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55453.log.gz 2024-09-10T06:30:29.950 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54233.log 2024-09-10T06:30:29.950 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32197.log 2024-09-10T06:30:29.950 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59082.log.gz 2024-09-10T06:30:29.950 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57052.log 2024-09-10T06:30:29.950 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54233.log.gz 2024-09-10T06:30:29.951 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59160.log 2024-09-10T06:30:29.951 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32197.log.gz 2024-09-10T06:30:29.951 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31997.log 2024-09-10T06:30:29.951 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57052.log.gz 2024-09-10T06:30:29.951 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59160.log.gz 2024-09-10T06:30:29.951 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58900.log 2024-09-10T06:30:29.960 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26345.log 2024-09-10T06:30:29.960 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T06:30:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T06:30:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.26345.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T06:30:29.961 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26345.log.gz 2024-09-10T06:30:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26321.log 2024-09-10T06:30:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26393.log 2024-09-10T06:30:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.26321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26321.log.gz 2024-09-10T06:30:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T06:30:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T06:30:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.26393.log: /var/log/ceph/ceph-mgr.x.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26393.log.gz 2024-09-10T06:30:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26489.log 2024-09-10T06:30:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:gzip/var/log/ceph/ceph.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.26417.log 2024-09-10T06:30:29.961 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.26489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26465.log 2024-09-10T06:30:29.961 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26489.log.gz 2024-09-10T06:30:29.962 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.26417.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T06:30:29.962 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26417.log.gz 2024-09-10T06:30:29.962 INFO:teuthology.orchestra.run.smithi120.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26369.log 2024-09-10T06:30:29.962 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.26465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26465.log.gz 2024-09-10T06:30:29.962 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26441.log 2024-09-10T06:30:29.962 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.26369.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T06:30:29.962 INFO:teuthology.orchestra.run.smithi120.stderr: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T06:30:29.962 INFO:teuthology.orchestra.run.smithi120.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26369.log.gz 2024-09-10T06:30:29.962 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-client.admin.26441.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T06:30:29.962 INFO:teuthology.orchestra.run.smithi120.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T06:30:29.962 INFO:teuthology.orchestra.run.smithi120.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26441.log.gz 2024-09-10T06:30:29.962 INFO:teuthology.orchestra.run.smithi120.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T06:30:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.31997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32456.log 2024-09-10T06:30:29.977 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31997.log.gz 2024-09-10T06:30:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44430.log 2024-09-10T06:30:29.977 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58900.log.gz 2024-09-10T06:30:29.977 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54854.log 2024-09-10T06:30:29.977 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32456.log.gz 2024-09-10T06:30:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47074.log 2024-09-10T06:30:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44430.log: /var/log/ceph/ceph-client.admin.54854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44430.log.gz 2024-09-10T06:30:29.978 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54854.log.gz 2024-09-10T06:30:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32530.log 2024-09-10T06:30:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47074.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47074.log.gz -5 2024-09-10T06:30:29.978 INFO:teuthology.orchestra.run.smithi112.stderr: --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T06:30:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59472.log 2024-09-10T06:30:29.978 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32530.log.gz 2024-09-10T06:30:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53369.log 2024-09-10T06:30:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26285.log 2024-09-10T06:30:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59472.log: /var/log/ceph/ceph-client.admin.53369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59472.log.gz 2024-09-10T06:30:29.978 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53369.log.gz 2024-09-10T06:30:29.978 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43837.log 2024-09-10T06:30:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.26285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26285.log.gz 2024-09-10T06:30:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53303.log 2024-09-10T06:30:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57620.log 2024-09-10T06:30:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.43837.log: /var/log/ceph/ceph-client.admin.53303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43837.log.gz 2024-09-10T06:30:29.979 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53303.log.gz 2024-09-10T06:30:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26530.log 2024-09-10T06:30:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38443.log 2024-09-10T06:30:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57620.log: /var/log/ceph/ceph-client.admin.26530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57620.log.gz 2024-09-10T06:30:29.979 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26530.log.gz 2024-09-10T06:30:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46482.log 2024-09-10T06:30:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35639.log 2024-09-10T06:30:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.38443.log: /var/log/ceph/ceph-client.admin.46482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38443.log.gz 2024-09-10T06:30:29.979 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46482.log.gz 2024-09-10T06:30:29.979 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58027.log 2024-09-10T06:30:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57265.log 2024-09-10T06:30:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35639.log: /var/log/ceph/ceph-client.admin.58027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35639.log.gz 2024-09-10T06:30:29.980 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58027.log.gz 2024-09-10T06:30:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35234.log 2024-09-10T06:30:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58026.log 2024-09-10T06:30:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57265.log: /var/log/ceph/ceph-client.admin.35234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57265.log.gz 2024-09-10T06:30:29.980 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35234.log.gz 2024-09-10T06:30:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33502.log 2024-09-10T06:30:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59264.log 2024-09-10T06:30:29.980 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58026.log: /var/log/ceph/ceph-client.admin.33502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58026.log.gz 2024-09-10T06:30:29.980 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33502.log.gz 2024-09-10T06:30:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32223.log 2024-09-10T06:30:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59342.log 2024-09-10T06:30:29.981 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0%/var/log/ceph/ceph-client.admin.32223.log: -- replaced with /var/log/ceph/ceph-client.admin.59264.log.gz 2024-09-10T06:30:29.981 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32223.log.gz 2024-09-10T06:30:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35499.log 2024-09-10T06:30:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58253.log 2024-09-10T06:30:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59342.log: /var/log/ceph/ceph-client.admin.35499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59342.log.gz 2024-09-10T06:30:29.981 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35499.log.gz 2024-09-10T06:30:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32015.log 2024-09-10T06:30:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33543.log 2024-09-10T06:30:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58253.log.gz 2024-09-10T06:30:29.981 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32015.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33385.log 2024-09-10T06:30:29.981 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T06:30:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33543.log.gz 2024-09-10T06:30:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55482.log 2024-09-10T06:30:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57421.log 2024-09-10T06:30:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33385.log.gz 2024-09-10T06:30:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34294.log 2024-09-10T06:30:29.982 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55482.log.gz 2024-09-10T06:30:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57421.log.gz 2024-09-10T06:30:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T06:30:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59212.log 2024-09-10T06:30:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34294.log.gz 2024-09-10T06:30:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36639.log 2024-09-10T06:30:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59212.log.gz 2024-09-10T06:30:29.982 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58279.log 2024-09-10T06:30:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36639.log.gz 2024-09-10T06:30:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32004.log 2024-09-10T06:30:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58279.log: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T06:30:29.983 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58279.log.gz 2024-09-10T06:30:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31723.log 2024-09-10T06:30:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57447.log 2024-09-10T06:30:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32004.log: /var/log/ceph/ceph-client.admin.31723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32004.log.gz 2024-09-10T06:30:29.983 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31723.log.gz 2024-09-10T06:30:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33236.log 2024-09-10T06:30:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34650.log 2024-09-10T06:30:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57447.log.gz 2024-09-10T06:30:29.983 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33236.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51391.log 2024-09-10T06:30:29.983 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T06:30:29.984 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34650.log.gz 2024-09-10T06:30:29.984 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31936.log 2024-09-10T06:30:29.984 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57611.log 2024-09-10T06:30:29.984 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.51391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51391.log.gz 2024-09-10T06:30:29.984 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.31936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31936.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47078.log 2024-09-10T06:30:29.984 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T06:30:29.984 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57611.log.gz 2024-09-10T06:30:29.984 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45276.log 2024-09-10T06:30:29.984 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32209.log 2024-09-10T06:30:29.984 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47078.log.gz 2024-09-10T06:30:29.984 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35093.log 2024-09-10T06:30:29.984 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45276.log.gz 2024-09-10T06:30:29.984 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32209.log.gz 2024-09-10T06:30:29.984 INFO:teuthology.orchestra.run.smithi112.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T06:30:29.985 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33314.log 2024-09-10T06:30:29.985 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45045.log 2024-09-10T06:30:29.985 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35093.log: /var/log/ceph/ceph-client.admin.33314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53457.log 2024-09-10T06:30:29.985 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35093.log.gz 2024-09-10T06:30:29.985 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33314.log.gz 2024-09-10T06:30:29.985 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58045.log 2024-09-10T06:30:29.985 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45045.log.gz 2024-09-10T06:30:29.985 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58307.log 2024-09-10T06:30:29.985 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53457.log: /var/log/ceph/ceph-client.admin.58045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33344.log 2024-09-10T06:30:29.985 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53457.log.gz 2024-09-10T06:30:29.985 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58045.log.gz 2024-09-10T06:30:29.985 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.0.58307.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.0.58307.log.gz --verbose 2024-09-10T06:30:29.985 INFO:teuthology.orchestra.run.smithi112.stderr: -- /var/log/ceph/ceph-client.admin.59134.log 2024-09-10T06:30:29.999 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T06:30:29.999 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33344.log: /var/log/ceph/ceph-client.admin.59134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57291.log 2024-09-10T06:30:29.999 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33344.log.gz 2024-09-10T06:30:29.999 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59134.log.gz 2024-09-10T06:30:29.999 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59108.log 2024-09-10T06:30:29.999 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57104.log 2024-09-10T06:30:29.999 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57291.log.gz 2024-09-10T06:30:29.999 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59108.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34944.log 2024-09-10T06:30:29.999 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T06:30:29.999 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57104.log.gz 2024-09-10T06:30:30.000 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42059.log 2024-09-10T06:30:30.000 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58926.log 2024-09-10T06:30:30.000 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34944.log: /var/log/ceph/ceph-client.admin.42059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34944.log.gz 2024-09-10T06:30:30.000 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42059.log.gz 2024-09-10T06:30:30.000 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50204.log 2024-09-10T06:30:30.000 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45123.log 2024-09-10T06:30:30.000 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58926.log.gz 2024-09-10T06:30:30.000 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50204.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33684.log 2024-09-10T06:30:30.000 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T06:30:30.000 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.45123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45123.log.gz 2024-09-10T06:30:30.000 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34373.log 2024-09-10T06:30:30.000 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32430.log 2024-09-10T06:30:30.000 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33684.log: /var/log/ceph/ceph-client.admin.34373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33684.log.gz 2024-09-10T06:30:30.000 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34373.log.gz 2024-09-10T06:30:30.001 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34688.log 2024-09-10T06:30:30.001 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59420.log 2024-09-10T06:30:30.001 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32430.log: /var/log/ceph/ceph-client.admin.34688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32430.log.gz 2024-09-10T06:30:30.001 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34688.log.gz 2024-09-10T06:30:30.001 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57631.log 2024-09-10T06:30:30.001 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34335.log 2024-09-10T06:30:30.001 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59420.log: /var/log/ceph/ceph-client.admin.57631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59420.log.gz 2024-09-10T06:30:30.001 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57631.log.gz 2024-09-10T06:30:30.001 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56383.log 2024-09-10T06:30:30.001 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-10T06:30:30.002 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34335.log: /var/log/ceph/ceph-client.admin.56383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34335.log.gz 2024-09-10T06:30:30.002 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56383.log.gz 2024-09-10T06:30:30.002 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35258.log 2024-09-10T06:30:30.002 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34022.log 2024-09-10T06:30:30.002 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ops-log-ceph-client.0.log: /var/log/ceph/ceph-client.admin.35258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35258.log.gz 2024-09-10T06:30:30.002 INFO:teuthology.orchestra.run.smithi112.stderr: 90.3% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-10T06:30:30.002 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32202.log 2024-09-10T06:30:30.002 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34022.log.gz 2024-09-10T06:30:30.002 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32016.log 2024-09-10T06:30:30.002 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53187.log 2024-09-10T06:30:30.002 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32202.log: /var/log/ceph/ceph-client.admin.32016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32202.log.gz 2024-09-10T06:30:30.002 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32016.log.gz 2024-09-10T06:30:30.002 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T06:30:30.002 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57626.log 2024-09-10T06:30:30.003 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53187.log: /var/log/ceph/ceph.audit.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53187.log.gz 2024-09-10T06:30:30.003 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54120.log 2024-09-10T06:30:30.003 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57626.log.gz 2024-09-10T06:30:30.003 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32007.log 2024-09-10T06:30:30.003 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.54120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54120.log.gz 2024-09-10T06:30:30.003 INFO:teuthology.orchestra.run.smithi112.stderr: 93.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49578.log 2024-09-10T06:30:30.003 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T06:30:30.003 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32007.log.gz 2024-09-10T06:30:30.003 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57577.log 2024-09-10T06:30:30.003 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57078.log 2024-09-10T06:30:30.003 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.49578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49578.log.gz 2024-09-10T06:30:30.003 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57577.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32006.log 2024-09-10T06:30:30.003 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T06:30:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57078.log.gz 2024-09-10T06:30:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59446.log 2024-09-10T06:30:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47714.log 2024-09-10T06:30:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32006.log.gz 2024-09-10T06:30:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59446.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33996.log 2024-09-10T06:30:30.004 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T06:30:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.47714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47714.log.gz 2024-09-10T06:30:30.004 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32014.log 2024-09-10T06:30:30.013 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57161.log 2024-09-10T06:30:30.013 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33996.log.gz 2024-09-10T06:30:30.013 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32014.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53257.log 2024-09-10T06:30:30.013 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T06:30:30.013 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57161.log.gz 2024-09-10T06:30:30.014 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36049.log 2024-09-10T06:30:30.014 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57630.log 2024-09-10T06:30:30.014 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.53257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53257.log.gz 2024-09-10T06:30:30.014 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.36049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36049.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59004.log 2024-09-10T06:30:30.014 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T06:30:30.014 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57630.log.gz 2024-09-10T06:30:30.014 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57811.log 2024-09-10T06:30:30.014 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44432.log 2024-09-10T06:30:30.014 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59004.log.gz 2024-09-10T06:30:30.014 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57811.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55651.log 2024-09-10T06:30:30.014 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T06:30:30.014 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.44432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44432.log.gz 2024-09-10T06:30:30.014 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55747.log 2024-09-10T06:30:30.015 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35024.log 2024-09-10T06:30:30.015 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55651.log: /var/log/ceph/ceph-client.admin.55747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55651.log.gz 2024-09-10T06:30:30.015 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55747.log.gz 2024-09-10T06:30:30.015 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55568.log 2024-09-10T06:30:30.015 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35024.log.gz 2024-09-10T06:30:30.015 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49571.log 2024-09-10T06:30:30.015 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35754.log 2024-09-10T06:30:30.015 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.55568.log: /var/log/ceph/ceph-client.admin.49571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55568.log.gz 2024-09-10T06:30:30.015 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49571.log.gz 2024-09-10T06:30:30.015 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57395.log 2024-09-10T06:30:30.015 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35846.log 2024-09-10T06:30:30.015 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35754.log: /var/log/ceph/ceph-client.admin.57395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35754.log.gz 2024-09-10T06:30:30.015 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57395.log.gz 2024-09-10T06:30:30.015 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35416.log 2024-09-10T06:30:30.016 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58042.log 2024-09-10T06:30:30.016 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35846.log: /var/log/ceph/ceph-client.admin.35416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35846.log.gz 2024-09-10T06:30:30.016 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35416.log.gz 2024-09-10T06:30:30.016 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45862.log 2024-09-10T06:30:30.016 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57343.log 2024-09-10T06:30:30.016 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58042.log: /var/log/ceph/ceph-client.admin.45862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58042.log.gz 2024-09-10T06:30:30.016 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45862.log.gz 2024-09-10T06:30:30.016 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59498.log 2024-09-10T06:30:30.016 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34449.log 2024-09-10T06:30:30.016 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.57343.log: /var/log/ceph/ceph-client.admin.59498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57343.log.gz 2024-09-10T06:30:30.016 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59498.log.gz 2024-09-10T06:30:30.016 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59394.log 2024-09-10T06:30:30.016 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32404.log 2024-09-10T06:30:30.016 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34449.log: /var/log/ceph/ceph-client.admin.59394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34449.log.gz 2024-09-10T06:30:30.017 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59394.log.gz 2024-09-10T06:30:30.017 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32480.log 2024-09-10T06:30:30.024 INFO:teuthology.orchestra.run.smithi112.stderr:gzip/var/log/ceph/ceph-client.admin.32480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32480.log.gz 2024-09-10T06:30:30.024 INFO:teuthology.orchestra.run.smithi112.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34857.log 2024-09-10T06:30:30.024 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32216.log 2024-09-10T06:30:30.024 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32404.log.gz 2024-09-10T06:30:30.024 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34857.log.gz 2024-09-10T06:30:30.024 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35067.log 2024-09-10T06:30:30.024 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31839.log 2024-09-10T06:30:30.024 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32216.log.gz 2024-09-10T06:30:30.024 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.35067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35067.log.gz 2024-09-10T06:30:30.024 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57828.log 2024-09-10T06:30:30.024 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33584.log 2024-09-10T06:30:30.025 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.31839.log: /var/log/ceph/ceph-client.admin.57828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31839.log.gz 2024-09-10T06:30:30.025 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57828.log.gz 2024-09-10T06:30:30.025 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32506.log 2024-09-10T06:30:30.025 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33584.log.gz 2024-09-10T06:30:30.025 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39636.log 2024-09-10T06:30:30.025 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33840.log 2024-09-10T06:30:30.025 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.32506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32506.log.gz 2024-09-10T06:30:30.025 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.39636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39636.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50799.log 2024-09-10T06:30:30.025 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T06:30:30.025 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33840.log.gz 2024-09-10T06:30:30.025 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57135.log 2024-09-10T06:30:30.025 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33881.log 2024-09-10T06:30:30.025 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.50799.log: /var/log/ceph/ceph-client.admin.57135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50799.log.gz 2024-09-10T06:30:30.025 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57135.log.gz 2024-09-10T06:30:30.026 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58978.log 2024-09-10T06:30:30.026 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40235.log 2024-09-10T06:30:30.026 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.33881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33881.log.gz 2024-09-10T06:30:30.026 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.58978.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59186.log 2024-09-10T06:30:30.026 INFO:teuthology.orchestra.run.smithi112.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58978.log.gz 2024-09-10T06:30:30.026 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40235.log.gz 2024-09-10T06:30:30.026 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34751.log 2024-09-10T06:30:30.026 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43247.log 2024-09-10T06:30:30.026 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.59186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59186.log.gz 2024-09-10T06:30:30.026 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34751.log.gz 2024-09-10T06:30:30.026 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21491.log 2024-09-10T06:30:30.029 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.43247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43247.log.gz 2024-09-10T06:30:30.029 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34187.log 2024-09-10T06:30:30.029 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40833.log 2024-09-10T06:30:30.029 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph.tmp-client.admin.21491.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21491.log.gz 2024-09-10T06:30:30.029 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34187.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34757.log 2024-09-10T06:30:30.029 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T06:30:30.029 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.40833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40833.log.gz 2024-09-10T06:30:30.029 INFO:teuthology.orchestra.run.smithi112.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56340.log 2024-09-10T06:30:30.029 INFO:teuthology.orchestra.run.smithi112.stderr:/var/log/ceph/ceph-client.admin.34757.log: 0.0%/var/log/ceph/ceph-client.admin.56340.log: -- replaced with /var/log/ceph/ceph-client.admin.34757.log.gz 2024-09-10T06:30:30.029 INFO:teuthology.orchestra.run.smithi112.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56340.log.gz 2024-09-10T06:30:30.062 INFO:teuthology.orchestra.run.smithi120.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T06:30:30.186 INFO:teuthology.orchestra.run.smithi112.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T06:30:30.305 INFO:teuthology.orchestra.run.smithi112.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T06:30:30.362 INFO:teuthology.orchestra.run.smithi112.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T06:30:30.486 INFO:teuthology.orchestra.run.smithi112.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T06:30:30.497 INFO:teuthology.orchestra.run.smithi120.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T06:30:30.504 INFO:teuthology.orchestra.run.smithi120.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T06:30:30.512 INFO:teuthology.orchestra.run.smithi120.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T06:30:30.534 INFO:teuthology.orchestra.run.smithi120.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T06:30:30.535 INFO:teuthology.orchestra.run.smithi120.stderr: 2024-09-10T06:30:30.535 INFO:teuthology.orchestra.run.smithi120.stderr:real 0m0.607s 2024-09-10T06:30:30.535 INFO:teuthology.orchestra.run.smithi120.stderr:user 0m2.274s 2024-09-10T06:30:30.535 INFO:teuthology.orchestra.run.smithi120.stderr:sys 0m0.113s 2024-09-10T06:30:30.562 INFO:teuthology.orchestra.run.smithi112.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T06:30:30.634 INFO:teuthology.orchestra.run.smithi112.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T06:30:30.636 INFO:teuthology.orchestra.run.smithi112.stderr: 2024-09-10T06:30:30.636 INFO:teuthology.orchestra.run.smithi112.stderr:real 0m0.755s 2024-09-10T06:30:30.636 INFO:teuthology.orchestra.run.smithi112.stderr:user 0m3.083s 2024-09-10T06:30:30.636 INFO:teuthology.orchestra.run.smithi112.stderr:sys 0m0.163s 2024-09-10T06:30:30.636 INFO:tasks.ceph:Archiving logs... 2024-09-10T06:30:30.636 DEBUG:teuthology.misc:Transferring archived files from smithi112:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898794/remote/smithi112/log 2024-09-10T06:30:30.637 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T06:30:31.182 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898794/remote/smithi120/log 2024-09-10T06:30:31.182 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T06:30:31.454 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T06:30:31.464 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T06:30:31.465 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T06:30:31.467 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T06:30:31.529 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T06:30:31.537 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T06:30:31.537 DEBUG:teuthology.orchestra.run.smithi112:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T06:30:31.540 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T06:30:31.549 INFO:teuthology.orchestra.run.smithi112.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T06:30:31.549 INFO:teuthology.orchestra.run.smithi112.stdout:============================================================================== 2024-09-10T06:30:31.549 INFO:teuthology.orchestra.run.smithi112.stdout:*hv01.front.sepi 67.205.162.81 3 u 28 64 177 0.133 -1.370 1.032 2024-09-10T06:30:31.549 INFO:teuthology.orchestra.run.smithi112.stdout:+hv02.front.sepi 63.231.80.2 3 u 19 64 177 0.112 -1.168 1.023 2024-09-10T06:30:31.549 INFO:teuthology.orchestra.run.smithi112.stdout:+hv03.front.sepi 74.6.168.72 3 u 25 64 177 0.090 +0.426 1.321 2024-09-10T06:30:31.549 INFO:teuthology.orchestra.run.smithi112.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:30:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T06:30:31.554 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2024-09-10T06:30:31.554 INFO:teuthology.orchestra.run.smithi120.stdout:+hv01.front.sepi 67.205.162.81 3 u 22 64 177 0.095 -1.058 1.426 2024-09-10T06:30:31.554 INFO:teuthology.orchestra.run.smithi120.stdout:*hv02.front.sepi 63.231.80.2 3 u 29 64 177 0.136 -0.918 1.408 2024-09-10T06:30:31.554 INFO:teuthology.orchestra.run.smithi120.stdout:+hv03.front.sepi 74.6.168.72 3 u 24 64 177 0.060 +0.714 1.863 2024-09-10T06:30:31.554 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T06:30:31.555 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T06:30:31.573 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T06:30:31.573 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T06:30:31.624 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T06:30:31.674 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T06:30:31.724 INFO:teuthology.task.internal:Duration was 873.498923 seconds 2024-09-10T06:30:31.724 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T06:30:31.774 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T06:30:31.775 DEBUG:teuthology.orchestra.run.smithi112:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T06:30:31.777 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T06:30:31.816 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T06:30:31.816 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi112.front.sepia.ceph.com 2024-09-10T06:30:31.816 DEBUG:teuthology.orchestra.run.smithi112:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T06:30:31.867 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-09-10T06:30:31.867 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T06:30:31.877 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T06:30:31.877 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T06:30:31.910 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T06:30:31.947 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T06:30:31.947 DEBUG:teuthology.orchestra.run.smithi112:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T06:30:31.982 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T06:30:32.054 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T06:30:32.064 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T06:30:32.064 DEBUG:teuthology.orchestra.run.smithi112:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T06:30:32.075 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T06:30:32.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T06:30:32.100 DEBUG:teuthology.orchestra.run.smithi112:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T06:30:32.119 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T06:30:32.128 INFO:teuthology.orchestra.run.smithi112.stdout:kernel.core_pattern = core 2024-09-10T06:30:32.136 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-09-10T06:30:32.154 DEBUG:teuthology.orchestra.run.smithi112:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T06:30:32.185 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:30:32.185 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T06:30:32.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T06:30:32.200 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T06:30:32.210 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T06:30:32.211 DEBUG:teuthology.misc:Transferring archived files from smithi112:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898794/remote/smithi112 2024-09-10T06:30:32.211 DEBUG:teuthology.orchestra.run.smithi112:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T06:30:32.249 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-10_03:24:22-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7898794/remote/smithi120 2024-09-10T06:30:32.250 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T06:30:32.267 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T06:30:32.267 DEBUG:teuthology.orchestra.run.smithi112:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T06:30:32.291 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T06:30:32.308 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T06:30:32.319 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T06:30:32.319 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T06:30:32.351 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T06:30:32.352 DEBUG:teuthology.orchestra.run.smithi112:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T06:30:32.354 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T06:30:32.358 INFO:teuthology.orchestra.run.smithi112.stdout: 658636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 06:30 /home/ubuntu/cephtest 2024-09-10T06:30:32.359 INFO:teuthology.orchestra.run.smithi120.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 06:30 /home/ubuntu/cephtest 2024-09-10T06:30:32.360 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T06:30:32.400 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T06:30:32.511 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_user_quota} duration: 873.4989233016968 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-10T06:30:32.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T06:30:32.587 INFO:teuthology.run:pass